Guide
Four checks for a flat theme discovery curve

Four checks to tell whether a flat theme discovery curve means real saturation or a recruiting pipeline that stopped reaching new kinds of people: per-channel restarts, cross-channel exclusive theme lists, screener drift and a non-participant check. All four use data you already have. In Koji, themes are tagged with the interview they came from, which makes the first two checks quick.
Where this appears
What's in this guide
- Restart the curve per channel: Plot each recruiting channel from zero. A late channel with a burst of new themes means the first one ran dry.
- Compare cross-channel theme lists: If themes found only in channel A and only in channel B are both long, the channels reach different people.
- Look for screener drift: Compare the accepted profile in week 1 with week 3. A tighter screener flattens the curve by itself.
- Check who never took part: Nonresponse and survivorship bias shape the themes too, and they hit the second pass just like the first.
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
<a href="https://www.koji.so/visuals/flat-theme-discovery-curve-four-checks"><img src="https://www.koji.so/visuals/flat-theme-discovery-curve-four-checks/flat-theme-discovery-curve-four-checks.png" alt="List of four checks for a flat theme discovery curve: per-channel restarts, cross-channel theme lists, screener drift and non-participants." width="1200" height="698" /></a>
<p>Source: <a href="https://www.koji.so/visuals/flat-theme-discovery-curve-four-checks">Four checks for a flat theme discovery curve</a>, Koji</p>Related

Reported vs true theme coverage as passes get more alike

How to make a second research pass unlike the first

How many interviews: sample size by project type

Start small: when to add more interviews

How many customer discovery interviews: what four sources say

Researcher biases in user interviews and how to counter them