Reference table
Testing AI substitution risk: methods compared
Three ways to check how sticky a portfolio company is
A comparison of three ways to test whether a portfolio company's customers would switch to an AI-native rival: Koji interviews, consultant-led interviews and surveys. It covers depth, sample control, time to results, scale, consistency, rerun and analysis effort. Operating partners can use it to choose a method before an operating review.
Where this appears
What's in this reference table
| Koji | Consultant-led interviews | Survey | |
|---|---|---|---|
| Depth | Open conversation with follow-ups | Deep, trained interviewer | Shallow, fixed answers |
| Sample control | You set quotas and invite by segment | Agreed with the firm | Self-selected responders |
| Time to results | Days to a few weeks | Weeks | Days |
| Scale | Dozens to hundreds | Tens | Hundreds |
| Probing "we would never leave" | Follow-ups on every answer | Skilled probing | None |
| Consistency | Same guide for every account | Varies by interviewer | Identical |
| Rerun in six months | Same guide, same questions | New engagement | Easy |
| Analysis effort | Themes and quotes generated | Done by the firm | Manual for open text |
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/pe-ai-substitution-methods-compared"><img src="https://www.koji.so/visuals/pe-ai-substitution-methods-compared/pe-ai-substitution-methods-compared.png" alt="Table comparing Koji, consultant-led interviews and surveys for testing AI substitution risk, on depth, sample control, speed, scale and rerun." width="1200" height="1005" /></a>
<p>Source: <a href="https://www.koji.so/visuals/pe-ai-substitution-methods-compared">Testing AI substitution risk: methods compared</a>, Koji</p>
