All frameworks and cheat sheets

Reference table

Client concept testing methods compared

Survey tests, focus groups, human interviews and AI-moderated interviews for agency concept work

Table comparing four ways to run a client concept test (survey, focus groups, human interviews, Koji) on depth, speed, consistency, candour and analysis.
Each route wins somewhere. Koji's column is the one built for reasons at scale.

A comparison of four ways a research agency can run a client concept test: a survey concept test, focus groups, human-moderated interviews and AI-moderated interviews in Koji. It sets them side by side on the reasons behind scores, speed, sample per concept, consistency across cells, candour, analysis effort, the stimulus each can show and what each is best for, so an agency can pick the route that fits the client's decision.

What's in this reference table

Survey concept testFocus groupsHuman interviewsKoji (us)
The why behind a scoreOpen-ends, often shortRich, shaped by the groupRichA probe after every answer
SpeedFastSlow: recruiting, venuesSlow: schedulingFast: interviews run in parallel
Sample per conceptLargeA few groupsLimited by moderator timeLimited by recruitment
Same questions in every cellYesVaries by moderatorVaries by moderatorYes, same guide and probes
CandourAnonymous, low effortDominant voicesHigh with a good moderatorOne to one, no audience
Analysis effortLow for numbersHigh: transcripts, codingHigh: transcripts, codingThemes with linked quotes
StimulusImages and videoAnything physicalAnythingOne still image per question
Best forRobust go/no-go numbersCo-creation, group energyComplex, emotional topicsReasons at scale, fast

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/agency-concept-testing-methods-compared"><img src="https://www.koji.so/visuals/agency-concept-testing-methods-compared/agency-concept-testing-methods-compared.png" alt="Table comparing four ways to run a client concept test (survey, focus groups, human interviews, Koji) on depth, speed, consistency, candour and analysis." width="1200" height="1002" /></a>
<p>Source: <a href="https://www.koji.so/visuals/agency-concept-testing-methods-compared">Client concept testing methods compared</a>, Koji</p>