{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-11-01T10:21:58.562Z"},"content":[{"type":"blog","id":"3847bc86-908d-49f9-9d12-53d70e43c7b8","slug":"test-ad-creative-before-you-spend","title":"Test Your Ad Creative Before You Spend on It","url":"https://www.koji.so/blog/test-ad-creative-before-you-spend","summary":"To test ad creative before spending, show two or three versions that differ on one thing to 20 to 30 people from the target audience, each for 3 to 5 seconds, then ask what they remember, what the ad offers and who it is for. Compare versions and ask which they would act on and why. Keep the creative people understand and want, then confirm with a small live split test. Nielsen attributed 47% of advertising sales contribution to the creative across about 500 campaigns. Koji runs this as an AI interview with an image on the question and a timed view of 3, 5, 10 or 15 seconds.","content":"You can test ad creative before you spend on it in about a week, with 20 to 30 people from your target audience. Show each person two or three creatives for a few seconds, ask what they remember and what they think the ad is offering, then ask which one they would act on and why. Keep the creative that people both understand and want, fix what they misread, and then put a small live budget behind the top two to confirm with real clicks. The pre-test tells you why an ad works or fails. The live spend tells you whether it does.\n\nThis guide is for founders, small marketing teams and agencies without a research budget. It covers what a pre-test can and cannot tell you, a six-step method, the questions to ask, how to read the answers and how to pair it with a small live test.\n\n## Why the creative is the part worth testing\n\nMost of what an ad achieves comes from the creative, not the media plan.\n\n- Nielsen Catalina Solutions analysed about 500 campaigns from 2016 to early 2017 and attributed **47%** of advertising's sales contribution to the creative, ahead of reach (22%), brand (15%), targeting (9%), recency (5%) and context (2%) ([Nielsen, 2017](https://www.nielsen.com/es/insights/2017/perspectives-want-a-successful-ad-get-creative/)).\n- For digital campaigns specifically, Nielsen put the creative's share of sales lift at **56%**, against 30% for media ([MarketingCharts summary of Nielsen data](https://www.marketingcharts.com/television-80662)).\n- Ipsos ASI found that creative quality explains about **three quarters** of the variation in ad recall between ads ([The Drum, reporting Ipsos ASI](https://www.thedrum.com/news/2010/04/21/ipsos-mori-asi-reveals-top-ten-media-lessons)).\n\n![Bar chart of ad sales contribution by factor across about 500 campaigns: creative 47%, reach 22%, brand 15%, targeting 9%, recency 5%, context 2%.](/visuals/ad-sales-contribution-by-factor-nielsen/ad-sales-contribution-by-factor-nielsen.png \"The creative carries more of the result than every media choice combined · Source: Nielsen Catalina Solutions, about 500 campaigns, 2016 to Q1 2017\")\n\nAnd people judge fast. In a study by Gitte Lindgaard and colleagues, ratings of a web page's visual appeal after a 50 millisecond glimpse closely matched ratings made after a longer look ([Behaviour and Information Technology, 2006](https://www.nature.com/news/2006/060109/full/news060109-13.html)). An ad in a feed gets roughly that kind of glance. If the message does not land in the first second or two, the rest of the ad rarely gets a chance.\n\nSo the cheapest money in a campaign is the money spent finding out which creative people understand before you pay to show it to thousands of them.\n\n## What a pre-test can and cannot tell you\n\nA small qualitative pre-test is good at:\n\n![A person scrolling a social feed on a phone, the quick glance an ad gets before someone moves on](https://images.unsplash.com/photo-1683181480131-c597f7f222e0?crop=entropy&cs=tinysrgb&fit=max&fm=jpg&ixid=M3w5NDUzMDN8MHwxfHNlYXJjaHw1fHxwZXJzb24lMjBzY3JvbGxpbmclMjBwaG9uZSUyMHNvY2lhbCUyMGZlZWR8ZW58MXwwfHx8MTc5MzUxNTgxMXww&ixlib=rb-4.1.0&q=80&w=1080)\n\n_Photo by [Viralyft](https://unsplash.com/@viralyft?utm_source=koji&utm_medium=referral) on [Unsplash](https://unsplash.com/?utm_source=koji&utm_medium=referral)_\n\n- **Comprehension:** do people get what is being offered, and for whom?\n- **Recall:** after a short look, do they remember the brand and the main claim?\n- **Reactions and objections:** what feels off, confusing, cheap or not for them, in their words.\n- **Preference with reasons:** which version they would act on and why.\n\nIt is not good at predicting click-through rates, cost per acquisition or how an ad performs at scale in a real feed, next to other ads, with a real algorithm deciding who sees it. Twenty-five people cannot tell you the difference between a 1.1% and a 1.4% click rate. That is why the method ends with a small live spend.\n\n## The six-step method\n\n1. **Pick two or three creatives that differ on one thing.** Same offer, different hook. Or same image, different headline. If they differ on everything, you will not know what made the winner win.\n2. **Decide who you need to hear from.** People who match the audience you will target, not your team or your most loyal customers. Include a few who use a competitor.\n3. **Show each creative briefly, then hide it.** Three to five seconds for a static ad or a thumbnail is close to a scroll. Then ask what they remember, before they can look again.\n4. **Ask what it is offering and who it is for.** Compare their answer to the one message you meant the ad to carry.\n5. **Show them side by side and ask which they would act on.** Then ask why, and what would make the other one work.\n6. **Confirm with a small live test.** Put a modest budget behind the top two in your ad platform's split test and let behaviour decide between them.\n\n![Process of six steps to test ad creative before you spend: pick versions, choose people, show briefly, check the message, compare, confirm live.](/visuals/ad-creative-pre-test-six-steps/ad-creative-pre-test-six-steps.png \"Steps 1 to 5 tell you why a creative works, step 6 tells you whether it does\")\n\n### How many people\n\nFor the qualitative part, 20 to 30 people is usually enough to see whether the message lands and to hear the main objections. Comprehension problems show up fast: if 8 of 25 people think your accounting tool is a bank, you do not need 500 more to know the headline is the problem. Our [concept testing methodology guide](/docs/concept-testing-methodology) covers when you need a bigger sample.\n\n### Show the versions in a fair order\n\nThe first creative anyone sees gets an unfair advantage or disadvantage. Change the order for different people. The simplest way is two copies of the same study with the creatives in opposite order, each sent to half your audience.\n\n## The questions to ask\n\nAsk in this order, so later questions do not contaminate earlier ones:\n\n**Right after the timed view**\n- What do you remember from what you just saw?\n- What brand was it for?\n- What do you think they were offering?\n\n**With the creative in view**\n- Who do you think this is for? Is that you?\n- What, if anything, is confusing or hard to believe?\n- What would you expect to happen if you clicked?\n\n**Comparing versions**\n- Which of these would you be most likely to click, and why?\n- What would make the other one work better for you?\n- If you saw this in your feed today, what would you do?\n\n![Question bank for pre-testing ad creative, with questions to ask after a timed view, with the creative in view, and when comparing versions.](/visuals/ad-creative-pre-test-questions/ad-creative-pre-test-questions.png \"Ask recall questions first, before people can look again\")\n\n## How to read the answers\n\nYou are looking for one creative that clears three bars:\n\n- **The message lands.** Most people describe the offer roughly the way you would. If a third or more get it wrong, fix the copy before anything else.\n- **The brand is remembered.** If people recall the joke but not the name, the ad is entertaining for someone else.\n- **People want it, for the right reason.** A version people prefer because the photo is nice, while misreading the offer, is a trap.\n\nIf no version clears all three, do not pick the least bad. Fix the problem people named and test again. That second round is still far cheaper than a week of spend on a creative nobody understands.\n\nThen write down what you learned in one line per creative (\"Version B: people remember the price, think it is for agencies, not freelancers\"). That line is worth more to the next campaign than the winner itself.\n\n## Pair it with a small live test\n\nOnce you have one or two creatives that people understand and want, run them in a small split test on the platform you will use. Keep the audience, budget and placement the same, change only the creative, and set the length and budget before you start so you are not tempted to stop at the first good day. The pre-test explains the result; the live test confirms it. When they disagree (people loved B, but A gets the clicks), go back to the reasons. Often the winning ad is getting clicks from people who misread it, which shows up later as poor conversion.\n\n## Mistakes that waste the test\n\n- **Testing finished ads only.** Rough mockups test the idea for much less effort. Polish the one that wins.\n- **Asking \"do you like it?\"** Liking does not predict action. Ask what they remember, what it offers and what they would do.\n- **Showing the ad for too long.** A minute of study is not how anyone sees an ad. Time the first look.\n- **Testing with colleagues.** They know the offer already. Recruit people who do not.\n- **Letting the preference vote decide.** A version can win the vote and lose the message. Read the reasons.\n\n## How to run it in Koji\n\nIn Koji you can run the whole qualitative part as an AI interview, in text or voice.\n\n- **Add an image to a question.** Attach one image (PNG, JPEG or WebP, up to 4 MB) to any interview question: the ad, a thumbnail, a landing page. Participants see it with the question, and Koji knows what the image shows, so its follow-up questions are about the ad.\n- **Use a timed view for the first look.** Set the image to show once, full screen, for 3, 5, 10 or 15 seconds, then hide it. Koji then asks what they remember and what they think, which is the five-second test in step 3. Our [5-second test guide](/docs/5-second-test-guide) covers that method in depth.\n- **Ask the comparison as a choice question with shuffled options,** then let Koji follow up on the reason.\n- **Reach the right people.** Share the link with your own list, or recruit from Koji's panel by country and audience.\n\nTimed images work in text and voice interviews, not phone calls. Uploaded images are resized, stripped of metadata and stored privately. Before you send the link, run a preview to check the timing and the follow-ups.\n\n![Koji text interview chat where the AI asks a probing follow-up after a participant's answer](/email/shots/shot-text-interview.jpg \"After the image is hidden, Koji asks follow-ups about what the participant saw\")\n\nThe report groups what people remembered and misread, with the quotes behind each theme. For more on method, see [concept testing with AI interviews](/docs/concept-testing-ai-interviews) and the older [ad testing survey guide](/docs/ad-testing-survey-guide). For tools that score ads at scale, see our [comparison of ad testing software](/blog/best-ad-testing-software-2026).\n\n## Test your next ad before it goes live\n\nPick the two creatives you are about to launch, attach each to a question with a 5-second timed view, add the recall and comparison questions above and send the link to 25 people who match your audience. You will know by the end of the week which one people understand, and why. [Start free on Koji](https://www.koji.so) and set up your first creative test, then put your launch budget behind the version that passes.\n","category":"Tutorial","lastModified":"2026-11-01T07:20:14.556765+00:00","metaTitle":"How to Test Ad Creative Before You Spend (2026 Guide)","metaDescription":"Pre-test ad creative with 20 to 30 people in a week: timed views, recall and message checks, a question bank and how to confirm with a small live split test.","keywords":["ad creative testing","test ad creative before launch","ad pre-testing","creative testing","ad testing questions","five second test ads","ad concept testing"],"aiSummary":"To test ad creative before spending, show two or three versions that differ on one thing to 20 to 30 people from the target audience, each for 3 to 5 seconds, then ask what they remember, what the ad offers and who it is for. Compare versions and ask which they would act on and why. Keep the creative people understand and want, then confirm with a small live split test. Nielsen attributed 47% of advertising sales contribution to the creative across about 500 campaigns. Koji runs this as an AI interview with an image on the question and a timed view of 3, 5, 10 or 15 seconds.","aiKeywords":["ad creative testing","ad pre-testing","creative pre-test","five second test","ad recall","message testing","split test"],"aiContentType":"guide","faqItems":[{"answer":"For a qualitative pre-test, 20 to 30 people from your target audience is usually enough to see whether the message lands and to hear the main objections. To predict click-through rates you need a live test with real spend instead.","question":"How many people do I need to pre-test an ad?"},{"answer":"Three to five seconds for a static ad or thumbnail is close to how long it gets in a feed. Hide it, then ask what they remember. Use longer views only when you are testing detail, such as copy or a landing page.","question":"How long should people see the ad in a pre-test?"},{"answer":"Not precisely. It tells you whether people understand the offer, remember the brand and want it, and why. It cannot tell a 1.1% click rate from a 1.4% one. Pair it with a small live split test on the platform you will use.","question":"Can a pre-test predict ad performance?"},{"answer":"Ask recall first: what do you remember, what brand was it, what was it offering. Then, with the ad in view: who is it for, what is confusing or hard to believe, what would happen if you clicked. Finish by comparing versions and asking why.","question":"What questions should I ask in an ad pre-test?"},{"answer":"Test rough mockups when you are choosing between ideas, since they cost far less to make. Polish the version that wins, then test the finished ad once more if the budget behind it is large.","question":"Should I test finished ads or rough concepts?"}],"relatedTopics":["ad testing","creative testing","concept testing","message testing","five second test","advertising research"]}],"pagination":{"total":1,"returned":1,"offset":0}}