All frameworks and cheat sheets

Flowchart

Monadic or sequential monadic testing?

Flowchart for choosing between monadic and sequential monadic testing: three questions, one side step, ending in a sequential monadic test
Work through it before you recruit, since the design sets your sample size

A decision flowchart for picking a concept testing design. It asks whether the decision is costly to undo, whether the concepts are close variations of one idea and how many concepts you have, then points to a monadic or a sequential monadic test. Use it before you set your sample size, since a monadic test needs a fresh group for every concept. Koji can run either design as AI-moderated interviews, with each concept shown as an image on the question.

Where this appears

What's in this flowchart

Start: You have two or more concepts to test

  1. Is the decision costly or hard to undo?
    • No: go to 2.
    • Yes: Run a monadic test. One fresh group per concept, each large enough to read on its own.
  2. Are the concepts close variations of one idea?
    • Yes: go to 3.
    • No: Run a monadic test. Very different ideas deserve to be judged alone.
  3. Do you have more than five concepts?
    • No: go to 4.
    • Yes: Cut to your strongest three to five. Answer quality drops with each extra concept. Then go to 4.
  4. Randomize the order for each person. The concept seen first tends to get a halo.
  5. Finish: Run a sequential monadic test. Same questions after every concept, one at a time.

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/monadic-vs-sequential-monadic-flowchart"><img src="https://www.koji.so/visuals/monadic-vs-sequential-monadic-flowchart/monadic-vs-sequential-monadic-flowchart.png" alt="Flowchart for choosing between monadic and sequential monadic testing: three questions, one side step, ending in a sequential monadic test" width="1200" height="1343" /></a>
<p>Source: <a href="https://www.koji.so/visuals/monadic-vs-sequential-monadic-flowchart">Monadic or sequential monadic testing?</a>, Koji</p>