{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-08-07T14:24:53.047Z"},"content":[{"type":"documentation","id":"d35c0ba4-dbbb-466d-b1ec-f90d3752cf35","slug":"health-claim-substantiation-research","title":"Health and Nutrition Claims: What Consumer Research Can and Cannot Substantiate","url":"https://www.koji.so/docs/health-claim-substantiation-research","summary":"FTC Health Products Compliance Guidance states that anecdotal evidence about consumer experiences, including surveys of consumer experiences, is never sufficient to substantiate health product efficacy claims - while the same document says extrinsic evidence such as consumer surveys and copy tests can be valuable in determining how consumers interpret implied claims. Efficacy requires competent and reliable scientific evidence, generally randomised controlled human clinical testing; observational, animal, in vitro, practitioner observation, and public health recommendations are insufficient. The perception file is built with research: net impression is assessed across text, product name, charts and images, and if a significant minority of consumers take a misleading claim despite a disclosure, the disclosure is not sufficient. Vague hedges and words like promising, preliminary, initial or pilot read as positive attributes rather than disclaimers. FDA structure/function labeling rules do not govern FTC assessment of advertising claims.","content":"Start with the sentence that should govern every conversation about research and health marketing. In its **Health Products Compliance Guidance**, the FTC states that anecdotal evidence about individual consumer experiences, **including surveys of consumer experiences, are never sufficient** to substantiate claims about the effects of a health product.\n\nNow hold that beside a second statement from the same document: **extrinsic evidence such as consumer surveys and copy tests can be valuable** in determining how consumers interpret implied claims.\n\nBoth are correct, and together they define the job precisely. Consumer research can never tell you that your product works. It is one of the only tools that tells you **what you claimed** - and under FTC law you are responsible for substantiating every reasonable interpretation of your marketing, not just the sentence you intended.\n\nThis guide covers that boundary, the evidence the efficacy side actually requires, and how to build the perception file that almost no health brand has.\n\n## Two files, two owners\n\n| | Efficacy file | Perception file |\n| --- | --- | --- |\n| Question | Does the product produce the benefit? | What benefit do consumers understand us to be promising? |\n| Standard | Competent and reliable scientific evidence | Net impression on a reasonable member of the audience |\n| Evidence | Randomised controlled human clinical trials | Copy tests, comprehension studies, consumer interviews |\n| Owner | Clinical, scientific affairs | Insights, marketing |\n| Typically funded | Heavily | Almost never |\n\nEnforcement usually finds the gap in the second column. A brand holds a genuine study supporting a modest, carefully worded finding, and its advertising conveys something considerably larger through imagery, placement, and emphasis. The science was real; the claim that was actually communicated was never substantiated because nobody ever measured what it was.\n\n## What the efficacy file requires\n\nKnow this side even though research is not how you build it, because it determines which claims are worth testing at all.\n\nThe FTC's standard is **competent and reliable scientific evidence**, defined as tests, analyses, research, or studies that (1) have been conducted and evaluated in an objective manner by experts in the relevant disease, condition, or function, and (2) are generally accepted in the profession to yield accurate and reliable results. The evidence must also be sufficient in quality and quantity, judged **in light of the entire body of relevant and reliable evidence**.\n\nAs a general matter, health benefit substantiation needs to be **randomised, controlled human clinical testing**. The guidance is explicit about what does not clear the bar:\n\n- **Epidemiological or observational studies** can show association but do not prove causation. High-quality epidemiologic evidence is accepted only where experts consider it an acceptable substitute and RCTs are not feasible.\n- **Animal and in vitro studies** may provide supporting background but are not sufficient without human RCT confirmation.\n- **Consumer experience, including surveys of it**, is never sufficient - genuine experiences may reflect placebo effects or unrelated change.\n- **A practitioner's observation** about effects on patients is likewise anecdotal.\n- **Public health recommendations** from medical organisations are not substantiation; they reflect judgement on available evidence, not a finding of causation.\n\nThe quality criteria are equally specific: a control group, appropriate randomisation, blinding, **statistically significant** results, and results that are **clinically meaningful** rather than merely detectable. Studies using multiple outcome measures should report all outcomes with statistical adjustment, and **post hoc analysis departing from the original protocol** is flagged as a p-hacking indicator that generally does not provide reliable substantiation.\n\nThe amount and type of substantiation required scales with the type of product, the type of claim, the **consequences of a false claim**, the benefits of a truthful one weighed against the cost of substantiation, and the amount of substantiation experts in the field consider reasonable. Health claims that consumers cannot verify themselves - a benefit subject to placebo effect, or one relating to a naturally varying condition - are held to a **more exacting standard**.\n\nIf your claim cannot be supported at that level, no amount of consumer research rescues it. The correct response is to change the claim.\n\n## What the perception file requires\n\nHere is where research is not merely useful but close to irreplaceable.\n\nClaims are assessed on the **net impression** conveyed by all elements of the advertisement together - text, product name, charts, graphs, and images. When an advertisement supports more than one reasonable interpretation, the advertiser must substantiate **each** of them. And claims are evaluated from the standpoint of the intended audience, with the guidance noting that some audiences may be particularly susceptible to exaggerated claims.\n\nThe guidance illustrates implied claims with an example worth memorising: a weight-loss brochure showing **doctors in white lab coats looking through microscopes, molecular structures, and a stack of medical journals** likely conveys an implied claim that the product has been clinically proven effective - with no such words appearing. Visual vocabulary makes claims.\n\n### The disclosure threshold you can actually measure\n\nThe single most useful sentence in the guidance for a research team is this: the ultimate test of a disclosure is the net impression consumers take away, and **if a significant minority of consumers take a misleading claim from an ad despite a disclosure, the disclosure is not sufficient**.\n\nThat is an empirical threshold. Not a drafting standard, not a font-size rule - a statement about a measurable proportion of an audience. It means:\n\n- The pass mark is not \"most people understood.\" A minority misreading is a failure.\n- The only way to know is to test, because there is no armchair method of estimating the size of a misreading minority.\n- If an effective disclosure is not achievable, the guidance is direct: modify the claim so a disclosure is unnecessary, or do not make it.\n\n### Qualifiers that do not qualify\n\nThe guidance is unusually specific about language that fails, and each item is a testable hypothesis:\n\n- **Vague hedges are inadequate.** Saying a product \"may\" have a benefit or \"helps\" achieve it is not enough.\n- **Science-stage words read as praise.** Consumers are likely to interpret \"promising,\" \"preliminary,\" \"initial,\" or \"pilot\" as **positive product attributes rather than substantial disclaimers** - particularly when the study is positively touted in the same advertisement.\n- **Qualifying emerging science is very difficult.** The guidance acknowledges directly that it is hard to adequately convey the uncertain and limited nature of support for a claim based on still-emerging science.\n- **Placement matters.** A fine-print disclosure at the bottom of an advertisement is not clear and conspicuous; a disclosure immediately next to the claim, in the same font size and high contrast, is far more likely to work.\n- **Disclosures buried in terms and conditions** do not cure a claim made in the advertisement.\n\nEvery one of those is a hypothesis you can test in an afternoon, and the results routinely surprise the people who wrote the copy.\n\n## Designing the study\n\n**Stage 1 - unaided takeaway.** Show the real asset. Ask what this product does and who it is for, open-ended, before any health vocabulary enters the conversation. Record verbatim. This is the stage that cannot be skipped or reordered.\n\n**Stage 2 - implied claim inventory.** Test the specific interpretations you suspect. Does this tell you the product treats a condition, or supports a normal function? Does it tell you the product was clinically tested? Does it suggest results without diet or exercise change? Binary questions here give countable rates per claim.\n\n**Stage 3 - disclosure effectiveness.** Present the asset with your qualifier in place and measure how many still take away the unsupported claim. This directly operationalises the significant-minority threshold and is the stage that produces the number worth reporting.\n\n**Stage 4 - audience check.** Because claims are judged from the standpoint of the intended audience, run the study on the population you are actually targeting. A claim that reads modestly to a general sample can read very differently to people managing the condition it touches.\n\nKoji's six [structured question types](/docs/structured-questions-guide) cover the whole design:\n\n| Stage | Question type | Output |\n| --- | --- | --- |\n| Unaided takeaway | open_ended | Verbatim comprehension with AI follow-up on the reasoning |\n| Implied claim testing | yes_no | Countable rate per implied claim |\n| Claim strength | scale | How strong a promise the copy reads as |\n| Benefit attribution | multiple_choice | Which benefits consumers assign to the product |\n| Condition inference | single_choice | Whether they read it as treating a condition |\n| Benefit weighting | ranking | Which claimed benefit drives purchase |\n\nThe unaided stage is the expensive one to do properly, because a useful answer needs a follow-up question tailored to whatever the participant just said - *what specifically gave you that impression?* Koji's AI moderator asks that of every participant simultaneously, which is what makes a well-sequenced comprehension study something you can field before a launch rather than after a warning letter.\n\n## The trap to avoid\n\nDo not let a positive perception study drift into the efficacy file. A finding that customers believe the product helps them is a fact about belief. Presented as support for the benefit itself, it is precisely the anecdotal consumer-experience evidence the guidance rules out.\n\nLabel the files separately, store them separately, and write the limitation into the report. A research report that states plainly what it does not establish is more credible internally and considerably more defensible externally. The same discipline applies to [customer testimonial interviews](/docs/ai-customer-testimonial-interviews) - see [using research quotes in marketing](/docs/research-quotes-marketing-ftc-endorsement-guides) for the endorsement rules that attach the moment a quote enters an advertisement.\n\nNote too that FDA labeling categories - including structure/function claims - do not govern the FTC's assessment of those claims in advertising. Clearing a claim under one framework does not clear it under the other.\n\n## A workable sequence\n\n1. Inventory every health-adjacent claim across pack, site, ads, and influencer briefs.\n2. For each, confirm the efficacy file meets the competent and reliable standard. Downgrade or delete anything that does not.\n3. Run the perception study on the surviving claims, on the target audience, with assets as they will appear.\n4. Where a significant minority takes away an unsupported claim, rewrite - then re-test the rewrite rather than assuming it worked.\n5. Retain both files with dates and asset versions in a [research repository](/docs/research-repository-guide).\n\nFor the shared structure across claim types, see [green claims research](/docs/green-claims-consumer-perception-research) and [advertising claim substantiation](/docs/survey-claim-substantiation-advertising); for reporting qualitative counts honestly, see [qualitative research validity](/docs/qualitative-research-validity).\n\n## Frequently asked questions\n\n### Can consumer research substantiate a health benefit claim?\n\nNo. The FTC guidance states that anecdotal evidence about individual consumer experiences, including surveys of consumer experiences, is never sufficient to substantiate claims about the effects of a health product, because genuine experiences may reflect placebo effects or factors unrelated to the product. Health benefit substantiation generally requires randomised, controlled human clinical testing.\n\n### Then why run consumer research at all in this category?\n\nBecause you must substantiate every reasonable interpretation your marketing conveys, and you cannot substantiate a claim you have not identified. The same guidance notes that extrinsic evidence such as consumer surveys and copy tests can be valuable in determining how consumers interpret implied claims. Research builds the perception file, not the efficacy file.\n\n### What counts as an adequate disclosure?\n\nThe test is the net impression consumers take from the advertisement with the disclosure present. The guidance states that if a significant minority of consumers still take a misleading claim despite the disclosure, the disclosure is not sufficient. Vague hedges like \"may\" or \"helps\" are inadequate, and words such as promising, preliminary, initial, or pilot are likely to be read as positive attributes rather than as disclaimers.\n\n### Do our images and product name matter, or just the claim text?\n\nThey matter. Net impression is assessed across all elements including text, product name, charts, graphs, and images. The guidance gives the example of a brochure showing doctors in lab coats, microscopes, and medical journals conveying an implied clinically-proven claim without saying so in words.\n\n### Does FDA structure/function compliance cover us with the FTC?\n\nNo. The guidance is explicit that FDA labeling rules for structure/function claims do not govern the FTC's assessment of those claims in advertising. The two frameworks operate independently and a claim can be compliant under one and deceptive under the other.\n\n### Who should we recruit for a health claim perception study?\n\nThe audience you actually target, because claims are evaluated from the standpoint of the intended audience. A claim that reads modestly to a general population sample can convey a much stronger promise to people managing the condition it relates to, and that is the group whose interpretation governs.\n\n## Related Resources\n\n- [Structured Questions Guide](/docs/structured-questions-guide) - the six question types and when to use each\n- [Advertising Claim Substantiation](/docs/survey-claim-substantiation-advertising) - designing survey research that backs a marketing claim\n- [Green Claims Research](/docs/green-claims-consumer-perception-research) - the same two-file structure for sustainability claims\n- [AI Claims Substantiation](/docs/ai-claims-substantiation-research) - the engineering burden and the perception burden for AI copy\n- [Using Research Quotes in Marketing](/docs/research-quotes-marketing-ftc-endorsement-guides) - endorsement rules for testimonials\n- [HCP Research Guide](/docs/hcp-research-guide) - recruiting and interviewing healthcare professionals\n- [AI Research for Pharma and Life Sciences](/docs/ai-research-for-pharma-life-sciences) - the wider life sciences programme\n\n---\n\n**Build your perception file.** New Koji accounts include 10 credits - enough to run an unaided takeaway study with AI follow-up probing and find out which claim your packaging is actually making.","category":"Research Methods","lastModified":"2026-08-07T03:24:06.592797+00:00","metaTitle":"Health and Nutrition Claim Substantiation Research | Koji","metaDescription":"What consumer research can and cannot substantiate for health claims: why surveys are never sufficient for efficacy, why they are essential for net impression, and how to test disclosure effectiveness.","keywords":["health claim substantiation","nutrition claim research","competent and reliable scientific evidence","structure function claims","supplement claim testing","net impression health advertising","disclosure effectiveness research"],"aiSummary":"FTC Health Products Compliance Guidance states that anecdotal evidence about consumer experiences, including surveys of consumer experiences, is never sufficient to substantiate health product efficacy claims - while the same document says extrinsic evidence such as consumer surveys and copy tests can be valuable in determining how consumers interpret implied claims. Efficacy requires competent and reliable scientific evidence, generally randomised controlled human clinical testing; observational, animal, in vitro, practitioner observation, and public health recommendations are insufficient. The perception file is built with research: net impression is assessed across text, product name, charts and images, and if a significant minority of consumers take a misleading claim despite a disclosure, the disclosure is not sufficient. Vague hedges and words like promising, preliminary, initial or pilot read as positive attributes rather than disclaimers. FDA structure/function labeling rules do not govern FTC assessment of advertising claims.","aiPrerequisites":["Access to the marketing assets under test","Knowledge of what clinical evidence exists for the product"],"aiLearningOutcomes":["Separate the efficacy evidence file from the perception evidence file","Recognise what does not meet the competent and reliable standard","Test disclosure effectiveness against the significant-minority threshold","Identify implied health claims carried by imagery and product name"],"aiDifficulty":"intermediate","aiEstimatedTime":"13 min"}],"pagination":{"total":1,"returned":1,"offset":0}}