{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-10-22T07:59:54.155Z"},"content":[{"type":"documentation","id":"f8adfb7b-4645-49e8-a637-c8cab1f7c44a","slug":"sponsorship-bias-research","title":"Sponsorship Bias: When Knowing Who Is Asking Changes the Answers","url":"https://www.koji.so/docs/sponsorship-bias-research","summary":"Sponsorship bias is the shift in research results caused by participants knowing or guessing who runs the study. It changes who answers and what they say. Edwards et al. (2002, BMJ) pooled 292 trials with 258,315 participants and found questionnaires from a university were more likely to be returned than those from other organisations (odds ratio 1.31), while monetary incentives roughly doubled response odds (2.02). The 2009 Cochrane update found lower response when \"Survey\" was in the email subject line (0.81) or the email had a male signature (0.55). Lundh et al. (2017, Cochrane, 75 papers) found industry-sponsored drug and device studies more often favoured the sponsor. Rob Fitzpatrick's The Mom Test warns that everyone will lie to you at least a little. The guide explains when to run blind or branded studies, why blind is not deceptive, an eight-point checklist and how Koji's editable welcome page, honest badges, guardrails, neutral AI interviewer, follow-ups and preview help.","content":"Sponsorship bias is the shift in research results caused by participants knowing, or guessing, who is behind the study. When customers know your company is asking about your product, many soften criticism, praise features they barely use and tell you what they think you want to hear. Others do the opposite and use the interview to vent. Either way, the answers say as much about their relationship with you as about the product.\n\nIt affects two things: who agrees to take part, and what they say once they do. You can't always hide who's asking, and sometimes you shouldn't. But you can choose deliberately between a branded and a blind study, and design the questions so the sponsor matters less. This guide covers what sponsorship bias is, the evidence, when to reveal the sponsor and a checklist for limiting the effect.\n\n## What sponsorship bias is\n\nEvery research invitation carries a signal about who wants to know. A survey from your bank, an interview request from a university, a feedback form from a startup founder and a call from an anonymous market research firm all prompt different reactions before the first question is asked.\n\nSponsorship bias is the part of that reaction that ends up in your data. It is related to several other biases but not the same:\n\n- **[Social desirability bias](/docs/social-desirability-bias)** is the general pull towards answers that make the participant look good.\n- **[Courtesy bias](/docs/courtesy-bias)** is the pull towards polite answers that avoid offending the person asking.\n- **[Demand characteristics](/docs/demand-characteristics)** are cues in a study that tell participants what the researcher hopes to find.\n\nSponsorship bias is what happens when the sponsor's identity is the cue. Once a participant knows the product team is listening, courtesy and demand characteristics both get stronger.\n\n## Two ways the sponsor changes your data\n\n**It changes who answers.** People respond to some senders more than others. Your loyal customers are more likely to open an email with your logo on it. People who left on bad terms may delete it unread. A study branded with your name can end up over-representing fans, which overlaps with [self-selection bias](/docs/self-selection-bias).\n\n**It changes what they say.** Once someone knows who's asking, their answers take your feelings into account. Rob Fitzpatrick built _The Mom Test_ around this problem. \"You shouldn't ask anyone if your business is a good idea,\" he writes. \"It's a bad question and everyone will lie to you at least a little.\" People who like you will protect your feelings. People who want something from you, like a discount or a feature, will tell you what helps them get it.\n\n## The evidence: sponsors shape responses\n\n**Who sends the questionnaire affects whether it comes back.** Phil Edwards and colleagues published a systematic review in the _BMJ_ in 2002 that pooled 292 randomised controlled trials, with 258,315 participants, testing ways to raise response to postal questionnaires. Questionnaires that came from a university were more likely to be returned than those from other organisations, with an odds ratio of 1.31. For comparison, the same review found monetary incentives roughly doubled the odds of a response, an odds ratio of 2.02. The sender is not as strong a lever as paying people, but it is a real one.\n\n**Small signals about the sender matter too.** The 2009 Cochrane update of that review, covering electronic questionnaires as well, found the odds of a response were lower when the word \"Survey\" appeared in the email subject line (odds ratio 0.81) and when the email had a male signature (0.55). Participants judge who's asking from very little.\n\n**Sponsorship shapes results even among researchers.** A 2017 Cochrane review by Andreas Lundh and colleagues, drawing on 75 papers, concluded that drug and device studies sponsored by industry more often reported results favourable to the sponsor's products than studies with other sponsors, through biases that standard risk-of-bias tools did not explain. That review is about how studies are designed and reported, not about participants. But it's a useful reminder that the sponsor's interest can leak into a study from both sides of the table.\n\n## Blind or branded: which should you run?\n\nA blind study hides the sponsor, at least until the end. A branded study tells participants up front. Neither is always right.\n\n![Comparison of blind and branded research studies, listing what each does well and where each skews answers](/visuals/blind-vs-branded-research-study-comparison/blind-vs-branded-research-study-comparison.png \"Choose based on whether you need honest comparisons or deep context from people who already know you\")\n\n**Run it blind when:**\n\n- You're comparing your product with competitors and want unprompted views.\n- You're testing brand perception, positioning or messaging, where knowing the sponsor changes the very thing you measure.\n- You're interviewing people who don't know you yet, such as prospects or non-users. See [non-user research](/docs/non-user-research).\n\n**Run it branded when:**\n\n- You're talking to existing customers about their own account, history or experience. They'll recognise the product anyway, and pretending otherwise damages trust.\n- You need context only a known relationship gives, such as details of their setup or a recent support case.\n- Your response rate depends on recognition. A personal invitation from a company people use is far more likely to be answered than one from a stranger.\n\n**Blind is not the same as deceptive.** Hiding the sponsor's name during the questions is a common and accepted practice. Lying about who will use the data is not. Privacy law in many places, including the GDPR, requires you to tell people who is responsible for their data, so plan the disclosure with your privacy team. A short debrief at the end that names the sponsor is good practice. See [deception, cover stories and debriefing](/docs/research-deception-cover-stories-debriefing).\n\n## How to limit sponsorship bias\n\nWhether you run blind or branded, these habits reduce how much the sponsor shapes the answers.\n\n![Checklist of eight ways to limit sponsorship bias in surveys and interviews, from choosing blind or branded on purpose to reading praise with care](/visuals/sponsorship-bias-research-checklist/sponsorship-bias-research-checklist.png \"Run it on your invitation, welcome page and discussion guide before launch\")\n\n1. **Decide blind or branded on purpose.** Write down which you chose and why, so it's in the report.\n2. **Keep the invitation neutral.** Describe the topic, the time it takes and what happens to the answers. Don't hint at the answer you want.\n3. **Ask about behaviour, not about you.** \"Tell me about the last time you exported a report\" beats \"How do you like our export feature?\"\n4. **Hold back product names until late.** Use the [funnel technique](/docs/funnel-technique-interview-questions): start broad and only mention your product once the participant has described their world in their own terms.\n5. **Separate the interviewer from the product team.** A participant will be more candid with a neutral researcher than with the person who built the feature.\n6. **Promise only the confidentiality you can keep.** Honest reassurance about who sees the answers makes criticism easier to give.\n7. **Ask for criticism directly.** \"If you could change one thing, what would it be?\" gives people permission to be critical.\n8. **Read praise with care.** Treat compliments as low-value data unless they come with a specific example of what happened.\n\n## Who should ask the questions\n\nThe person or voice asking the questions is part of the sponsorship signal. A founder interviewing customers hears more praise than a researcher from outside the team would. An account manager asking about renewal hears whatever protects the relationship.\n\n![A researcher with a notebook listening to a participant across a table, someone with no stake in the product's answer](https://images.unsplash.com/photo-1758520144437-f068ecaf0d83?crop=entropy&cs=tinysrgb&fit=max&fm=jpg&ixid=M3w5NDUzMDN8MHwxfHNlYXJjaHw4fHx0d28lMjBwZW9wbGUlMjBpbnRlcnZpZXclMjB0YWJsZSUyMG5vdGVib29rfGVufDF8MHx8fDE3OTI2NDgyMTJ8MA&ixlib=rb-4.1.0&q=80&w=1080)\n\n_Photo by [Vitaly Gariev](https://unsplash.com/@silverkblack?utm_source=koji&utm_medium=referral) on [Unsplash](https://unsplash.com/?utm_source=koji&utm_medium=referral)_\n\nWhere you can, have someone without a stake in the answer run the session, and introduce them as there to learn rather than to defend. If the founder or product manager has to do it, say so honestly and work harder on the question design: open questions, specific past events and explicit invitations to criticise. [Courtesy bias](/docs/courtesy-bias) and the [Mom Test](/docs/mom-test-methodology) both cover techniques that help.\n\n## How Koji helps\n\nKoji runs AI-moderated interviews by voice or text. It doesn't remove the sponsor from the picture, but it gives you control over the sponsorship signal and puts a neutral interviewer between participants and your team.\n\n- **You decide what the welcome page says.** The headline, subheadline and description are yours to write, so the page can name your company or simply describe the topic. A workspace logo only appears if you apply a brand theme.\n- **Honest trust signals.** You can show or hide the anonymous badge, change its wording and add your own badges and consent text. When someone arrives through a personal invite link, the anonymous badge is hidden automatically, because their answers are tied to who they are.\n- **Tell the interviewer what not to say.** Guardrails list topics the AI interviewer must avoid, such as naming your company or product until the end, or quoting prices.\n- **A neutral voice asking.** The AI interviewer has no feelings for participants to protect, and AI follow-ups, from none up to three per question, ask for specific examples instead of accepting a polite \"it's great\".\n- **Check before launch.** The Preview tab lets you take your own interview by voice or text, exactly as a participant would, so you can hear where the brand comes through too early.\n\n![Koji guardrails settings listing topics the AI interviewer should avoid, like prices and other customers](/email/shots/shot-guardrails.jpg \"Guardrails keep the interviewer from naming the sponsor or the product before you want it to\")\n\n## Related Resources\n\n- [Courtesy bias](/docs/courtesy-bias)\n- [Social desirability bias](/docs/social-desirability-bias)\n- [Demand characteristics](/docs/demand-characteristics)\n- [Deception, cover stories and debriefing](/docs/research-deception-cover-stories-debriefing)\n- [The Mom Test methodology](/docs/mom-test-methodology)\n- [Structured questions guide](/docs/structured-questions-guide)\n\n## Sources\n\n- Edwards, P., Roberts, I., Clarke, M., DiGuiseppi, C., Pratap, S., Wentz, R., & Kwan, I. (2002). Increasing response rates to postal questionnaires: Systematic review. _BMJ_, 324, 1183.\n- Edwards, P. J., Roberts, I., Clarke, M. J., et al. (2009). Methods to increase response to postal and electronic questionnaires. _Cochrane Database of Systematic Reviews_, MR000008.\n- Fitzpatrick, R. (2013). _The Mom Test: How to talk to customers and learn if your business is a good idea when everyone is lying to you_.\n- Lundh, A., Lexchin, J., Mintzes, B., Schroll, J. B., & Bero, L. (2017). Industry sponsorship and research outcome. _Cochrane Database of Systematic Reviews_, MR000033.\n","category":"Research Methods","lastModified":"2026-10-22T05:50:12.310656+00:00","metaTitle":"Sponsorship Bias in Research: Blind vs Branded Studies (2026)","metaDescription":"How knowing who is asking changes survey and interview answers, the evidence, when to run a blind or branded study and 8 ways to limit sponsorship bias.","keywords":["sponsorship bias","sponsor bias survey","blind vs branded survey","reveal survey sponsor","sponsorship bias research","blind study market research","survey sponsor effect"],"aiSummary":"Sponsorship bias is the shift in research results caused by participants knowing or guessing who runs the study. It changes who answers and what they say. Edwards et al. (2002, BMJ) pooled 292 trials with 258,315 participants and found questionnaires from a university were more likely to be returned than those from other organisations (odds ratio 1.31), while monetary incentives roughly doubled response odds (2.02). The 2009 Cochrane update found lower response when \"Survey\" was in the email subject line (0.81) or the email had a male signature (0.55). Lundh et al. (2017, Cochrane, 75 papers) found industry-sponsored drug and device studies more often favoured the sponsor. Rob Fitzpatrick's The Mom Test warns that everyone will lie to you at least a little. The guide explains when to run blind or branded studies, why blind is not deceptive, an eight-point checklist and how Koji's editable welcome page, honest badges, guardrails, neutral AI interviewer, follow-ups and preview help.","aiPrerequisites":["Some experience running surveys or customer interviews"],"aiLearningOutcomes":["Define sponsorship bias and tell it apart from courtesy and social desirability bias","Explain how the sponsor changes both who responds and what they say","Summarise the evidence on sponsor effects in surveys and studies","Decide when to run a blind or branded study without deceiving participants","Apply an eight-point checklist to limit sponsorship bias"],"aiDifficulty":"intermediate","aiEstimatedTime":"9 min read"}],"pagination":{"total":1,"returned":1,"offset":0}}