New

Now in Claude, ChatGPT, Cursor & more with our MCP server

Back to docs
Research Methods

Focus Group vs. Survey: Which Research Method to Use

Focus groups produce rich group discussion but cost thousands and suffer from groupthink; surveys reach scale cheaply but can't probe and face collapsing response rates. Learn when to use each — and how AI interviews give you the depth of a focus group at the scale of a survey.

A focus group gathers a small group of people for a moderated discussion to explore attitudes and reactions in depth. A survey collects structured answers from many people at once to measure what and how many at scale. They trade off against each other on the same two axes: depth versus reach, and cost versus speed.

The short answer: use a survey when you need to measure something across a large, representative sample, and use a focus group when you need to explore the "why" behind attitudes and observe how people react to ideas. But both methods carry serious, often-underappreciated weaknesses — and a third option now gives you much of the upside of each.

The Core Difference

DimensionFocus GroupSurvey
Data typeQualitative — discussion, reactions, languageQuantitative — numbers, percentages, distributions
Sample size6–10 per group, a few groupsDozens to thousands
DepthHigh — moderator can probeLow — no follow-up possible
CostHigh — $4,000–$8,000+ per groupLow per response
Speed to fieldSlow — recruit, schedule, facilitateFast — distribute a link
Main weaknessGroupthink, dominant voicesSay-do gap, declining response rates
Best question"Why do you feel that way?""How many, how often, how satisfied?"

What Is a Focus Group?

A focus group brings 6–10 participants together for a 60–90 minute moderated discussion. A facilitator works from a discussion guide while observers watch. The format was pioneered by sociologist Robert Merton in the 1940s and remains common in brand, advertising, and concept research, where participant interaction generates value.

Strengths:

  • Depth and nuance. A skilled moderator can probe, follow tangents, and uncover the reasoning behind opinions.
  • Group dynamics. You can observe debate, consensus, and how ideas spread — useful for messaging and concept testing.
  • Rich language. You hear how customers describe problems in their own words.

Weaknesses:

  • Groupthink and dominant participants. Per Drive Research, the "group effect" occurs when one or two vocal participants steer the conversation and others conform — meaning you may be hearing one loud opinion, not a cross-section. Quieter participants with valuable insights get drowned out.
  • Expensive. Costs typically run $4,000–$8,000+ per session once you include facility rental, recruiting, incentives ($75–$200 per participant), and moderator fees.
  • Small, unrepresentative samples. A few groups cannot support quantitative claims about a population.
  • Slow. Recruiting, scheduling, and facilitating take weeks.

What Is a Survey?

A survey is a structured questionnaire with predefined response options, distributed to a large sample. It produces numbers you can aggregate, segment, and track over time.

Strengths:

  • Scale and representativeness. Reach hundreds or thousands of respondents.
  • Cheap per response and fast to field.
  • Statistical power. Calculate margins of error, significance, and segment differences.
  • Benchmarkable. Track metrics like NPS and CSAT over time.

Weaknesses:

  • No probing. Nielsen Norman Group puts it plainly: "A limitation of surveys is that researchers cannot probe to better understand responses." A confusing answer stays confusing.
  • Collapsing response rates. Pew Research documented typical telephone survey response rates falling from 36% in 1997 to 9% in 2012 and just 6% by 2018 — raising real questions about who is and isn't answering.
  • The say-do gap. People's stated preferences routinely diverge from actual behavior because of limited self-awareness and social desirability. As one analysis put it, surveys and behavior often part ways — and the gap usually tells you more about the survey than about the customer.
  • Shallow. You learn what people chose, never why.

Choosing Between Them

Use a survey when:

  • You need to measure prevalence, frequency, or satisfaction across a population
  • You need statistical confidence and segment comparisons
  • You are tracking a metric over time (NPS, CSAT, CES)
  • Budget and timeline are tight and the questions are well understood

Use a focus group when:

  • You are exploring unfamiliar territory and need rich qualitative depth
  • Group interaction is the point — testing messaging, reactions, or concepts
  • You want to hear customers' own language to inform survey design later
  • You can afford the cost and weeks of lead time

Classic research practice runs them in sequence: a focus group (or interviews) to generate hypotheses and language, then a survey to quantify them. The problem is that this is slow and expensive — and the focus group half is compromised by groupthink while the survey half is compromised by the say-do gap and falling response rates.

The Modern Approach: AI Interviews — Depth at Scale

The historic trade-off was unavoidable: you could have the depth of a focus group or the scale of a survey, not both. AI-native research changes that. Platforms like Koji run AI-moderated one-on-one interviews with hundreds of people simultaneously — combining the probing depth of qualitative research with the reach and speed of a survey.

Why this beats the old binary:

  • Depth of a focus group, no groupthink. Because every Koji interview is one-on-one, there's no dominant participant or peer pressure — each person speaks freely. The AI consultant probes with follow-up questions a static survey never could.
  • Scale of a survey, without the say-do gap. Run hundreds of interviews in parallel and get a large, diverse sample — while conversational questioning anchored in past behavior cuts through stated-preference noise.
  • A fraction of the cost. No facility rental, no moderator day-rate, no scheduling overhead. You replace a $4,000–$8,000 focus group with continuous, on-demand interviews.
  • Six structured question types built in. Combine quantitative measurement with qualitative depth in one study using open_ended, scale, single_choice, multiple_choice, ranking, and yes_no questions — the best of survey and conversation together. See the Structured Questions Guide.
  • Real-time thematic analysis. Koji synthesizes themes, representative quotes, and frequencies automatically, with 1–5 quality scoring on every interview — no transcription marathon, no manual coding.
  • Voice or text. Capture tone and emotion with async voice interviews, or run text interviews for global speed.

Where traditional tools like SurveyMonkey give you breadth without depth and a focus group facility gives you depth without scale, Koji delivers both at once — democratizing rigorous research so you don't need a dedicated research team or a five-figure budget to understand your customers.

A Decision Framework

Run through these questions in order to pick the right method:

  1. Do you need a number you can defend statistically? If yes, you need a survey (or AI interviews with structured questions) — focus groups can't support quantitative claims.
  2. Do you understand the topic well enough to write good closed-ended questions? If no, you need exploratory qualitative work first; a premature survey will measure the wrong things precisely.
  3. Is group interaction the actual object of study (testing how a message spreads, watching consensus form)? That's the one case where a traditional focus group's group dynamic is a feature, not a bug.
  4. Do you need both depth and scale, fast, on a budget? That's the gap AI-moderated interviews fill.

Most teams discover that what they really wanted was never "a focus group" or "a survey" in the abstract — it was the answer to a question, with enough depth to act and enough reach to trust. The method is just a means to that end.

Common Mistakes to Avoid

  • Running a survey before you understand the problem. Without prior qualitative work, you'll write closed-ended questions around your own assumptions and get precise answers to the wrong questions.
  • Generalizing from a focus group. Two groups of eight people are not a representative sample. Never report focus-group findings as percentages of your market.
  • Ignoring who didn't respond. With survey response rates near 6%, the people who answer may differ systematically from those who don't — a non-response bias that no sample size fixes.
  • Trusting stated intent. "I would definitely buy this" in a survey or focus group is among the least reliable data you can collect. Anchor questions in actual past behavior instead.
  • Letting one voice dominate. In a focus group, an unmanaged dominant participant can quietly determine your "findings." One-on-one formats remove this risk entirely.

A Cost and Time Comparison

The practical gap between these methods is stark once you put numbers to it. A single in-person focus group runs $4,000–$8,000 or more, takes two to three weeks to recruit and schedule, and yields the perspectives of roughly eight people — filtered through whatever group dynamic emerges on the day. A survey is cheap to field but, at a 6% response rate, may require thousands of invitations to net a usable sample, and it returns numbers with no explanation behind them.

AI-moderated interviews collapse this trade-off. A study can be live in minutes, run hundreds of one-on-one conversations in parallel, and return synthesized themes the same day — at a fraction of a single focus group's cost. For a product team that needs to make a decision this sprint rather than next quarter, the difference is not incremental; it changes what kinds of questions are even worth asking, because research stops being a special event and becomes a continuous habit.

The Bottom Line

Surveys answer what and how many. Focus groups answer why and how — but at high cost and with real bias risks. For most modern product and customer-research questions, AI-moderated one-on-one interviews give you the depth of the focus group and the scale of the survey at once, without groupthink, scheduling overhead, or a five-figure budget. The old trade-off between depth and reach is no longer one you have to make.

Related Resources