All frameworks and cheat sheets

Flowchart

Test two offers with customers or with an A/B test?

A decision path for small businesses choosing between two versions of an offer

Flowchart for choosing between a live A/B test and asking 20 customers about two offers: three questions, one side step, ending in a split send.
Most small businesses land on the customer route, then confirm with a real send
Download PNGRead the full guide

A decision path for a small business owner with two versions of an offer. It starts from a plain traffic check, since a live A/B test needs thousands of visitors per version, and otherwise sends you to about 20 recent customers. It ends with a real send to half your list, because what customers say is not what they pay. Koji can run the customer conversations if you attach a picture of each offer to a question.

Where this appears

What's in this flowchart

Start: Two offers, one decision

  1. Can each version reach about 14,000 visitors?
    • No: go to 2.
    • Yes: Run a live A/B test.
  2. Do you have 20 recent customers to ask?
    • Yes: go to 3.
    • No: Ask at the till or by text. Find 20 buyers first, then come back. Then go to 3.
  3. Show each offer, then ask. One picture each, the same questions, order balanced.
  4. Does one offer win 15 of 20 or more?
    • Yes: go to 5.
    • No: Read the reasons, then fix. With a tie or a lean, the reasons matter most.
  5. Send the winner to half your list. Count real bookings against your old offer.
  6. Finish: Keep what customers paid for.

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/test-two-offers-or-ab-test-flowchart"><img src="https://www.koji.so/visuals/test-two-offers-or-ab-test-flowchart/test-two-offers-or-ab-test-flowchart.png" alt="Flowchart for choosing between a live A/B test and asking 20 customers about two offers: three questions, one side step, ending in a split send." width="1200" height="1493" /></a>
<p>Source: <a href="https://www.koji.so/visuals/test-two-offers-or-ab-test-flowchart">Test two offers with customers or with an A/B test?</a>, Koji</p>

Related

Checklist for reading a two-offer customer test: count the picks, read the reasons, compare regulars with newcomers and confirm with a real send.

How to read a two-offer test with 20 customers

Question bank for testing two offers with customers: what they took in, a head-to-head choice, and what they do today. Ten questions in three sections.

Questions for testing two offers with your customers

Flowchart for reporting Likert results: three questions on groups, crossing distributions and audience, ending with the mean shown beside its distribution.

How to report Likert scale results