All frameworks and cheat sheets

Reference table

Ways to hear from pilot users

Calls, surveys and AI interviews compared

Table comparing calls, usage surveys and Koji interviews for hearing from pilot users, across depth, speed, reach, consistency and analysis effort.
Founders with twelve users and one week need reach and depth, which calls and surveys trade off.

A comparison of three ways a founder can learn what end users think during an enterprise pilot: calling them, sending a usage survey, or running AI-moderated interviews in Koji. It rates each on depth, time, reach, consistency, candour, analysis effort and comparing waves. Use it to choose a method before the pilot starts.

Where this appears

What's in this reference table

Calling users yourselfUsage surveyKoji interviews
DepthHigh, one call at a timeShallowFollow-ups on every answer
Time to resultsDays of schedulingFastUsers answer when free
Reach3 to 5 usersWhole group, low responseWhole group, personal links
ConsistencyVaries by callFixedSame guide every time
CandourUsers guard wordsModerateTalking to an AI, not the vendor
Analysis effortNotes to write upCharts onlyThemes with linked quotes
Wave comparisonManualPossibleRepeat scale questions

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/pilot-end-user-interviews-method-comparison"><img src="https://www.koji.so/visuals/pilot-end-user-interviews-method-comparison/pilot-end-user-interviews-method-comparison.png" alt="Table comparing calls, usage surveys and Koji interviews for hearing from pilot users, across depth, speed, reach, consistency and analysis effort." width="1200" height="803" /></a>
<p>Source: <a href="https://www.koji.so/visuals/pilot-end-user-interviews-method-comparison">Ways to hear from pilot users</a>, Koji</p>