Reference table
Client concept testing methods compared
Survey tests, focus groups, human interviews and AI-moderated interviews for agency concept work

A comparison of four ways a research agency can run a client concept test: a survey concept test, focus groups, human-moderated interviews and AI-moderated interviews in Koji. It sets them side by side on the reasons behind scores, speed, sample per concept, consistency across cells, candour, analysis effort, the stimulus each can show and what each is best for, so an agency can pick the route that fits the client's decision.
What's in this reference table
| Survey concept test | Focus groups | Human interviews | Koji (us) | |
|---|---|---|---|---|
| The why behind a score | Open-ends, often short | Rich, shaped by the group | Rich | A probe after every answer |
| Speed | Fast | Slow: recruiting, venues | Slow: scheduling | Fast: interviews run in parallel |
| Sample per concept | Large | A few groups | Limited by moderator time | Limited by recruitment |
| Same questions in every cell | Yes | Varies by moderator | Varies by moderator | Yes, same guide and probes |
| Candour | Anonymous, low effort | Dominant voices | High with a good moderator | One to one, no audience |
| Analysis effort | Low for numbers | High: transcripts, coding | High: transcripts, coding | Themes with linked quotes |
| Stimulus | Images and video | Anything physical | Anything | One still image per question |
| Best for | Robust go/no-go numbers | Co-creation, group energy | Complex, emotional topics | Reasons at scale, fast |
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/agency-concept-testing-methods-compared"><img src="https://www.koji.so/visuals/agency-concept-testing-methods-compared/agency-concept-testing-methods-compared.png" alt="Table comparing four ways to run a client concept test (survey, focus groups, human interviews, Koji) on depth, speed, consistency, candour and analysis." width="1200" height="1002" /></a>
<p>Source: <a href="https://www.koji.so/visuals/agency-concept-testing-methods-compared">Client concept testing methods compared</a>, Koji</p>




