Reference table
Ways to run a redesign before-and-after study
Compares a survey tool with SUS, an unmoderated test platform, moderated sessions and Koji for a redesign before-and-after study, on seven things the study needs: score and reasons together, follow-ups, matched participants, sample size, consistent questions, analysis effort and task testing. For UX researchers choosing a method. Koji pairs each score with its reason in an AI-moderated interview but does not test tasks in the live product.
Where this appears
What's in this reference table
| Survey tool with SUS | Unmoderated test platform | Moderated sessions | Koji | |
|---|---|---|---|---|
| Score and reasons from one person | Score, optional comment | Score and recording | Yes | Yes, with follow-ups on every score |
| Follows up on a low score | No | No | Yes | Yes, score-aware probing |
| Same people in both rounds | With your own list | Depends on the panel | Yes, if you schedule it | Personal invite links per person |
| Sample size for a real comparison | Easy | Easy | Hard, moderator hours | Easy, interviews run in parallel |
| Same questions every time | Yes | Yes | Varies by moderator | Yes, structured questions |
| Analysis effort | Low for scores, high for comments | Hours of video | Hours of notes | Report with quotes per score |
| Tests tasks in the live product | No | Yes | Yes | No, asks about real use |
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/redesign-study-comparison-koji-vs-alternatives"><img src="https://www.koji.so/visuals/redesign-study-comparison-koji-vs-alternatives/redesign-study-comparison-koji-vs-alternatives.png" alt="Comparison table of four ways to run a redesign before-and-after study, Koji highlighted, on criteria like follow-up probing and matched participants." width="1200" height="976" /></a>
<p>Source: <a href="https://www.koji.so/visuals/redesign-study-comparison-koji-vs-alternatives">Ways to run a redesign before-and-after study</a>, Koji</p>
