{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-10-07T22:57:41.083Z"},"content":[{"type":"documentation","id":"0014a196-38db-4a2f-884d-ba3ce7b869ed","slug":"member-checking-qualitative-research","title":"Member Checking in Qualitative Research: How to Validate Findings With Participants","url":"https://www.koji.so/docs/member-checking-qualitative-research","summary":"Member checking, also called respondent validation, means returning data or findings to participants to test whether they recognise their experience in them. Lincoln and Guba (1985) called it \"the most crucial technique for establishing credibility\", while a review of 44 articles by Thomas (2017) found no evidence that member checks enhance research quality. The four main types are transcript review, interview summaries, synthesized member checking and follow-up interviews or groups. In Birt et al.'s synthesized member checking study (2016), 56% (n=28) of participants returned the findings document and younger participants were less likely to reply. A good member check returns five to eight plain-language findings, asks a rating and an open question about each, treats responses as data, and reports what changed. Koji runs a member check as a short follow-up study with scale and open-ended questions, AI follow-up probing on disagreement, personalized links back to original participants, and asynchronous text or voice responses.","content":"## The short answer\n\n**Member checking** (also called respondent validation or participant validation) means taking your data or your interpretation back to the people you studied and asking: does this match your experience? It is the classic way to test the credibility of qualitative findings. Lincoln and Guba, who set out the trustworthiness criteria most qualitative researchers still use, called it \"the most crucial technique for establishing credibility\" (_Naturalistic Inquiry_, 1985).\n\nIt is also one of the most debated techniques in qualitative research. A narrative review of 44 journal articles that used member checks concluded: \"no evidence was found to support the view that member checks enhance research quality\" (Thomas, _Qualitative Research in Psychology_, 2017). Both views are useful. Member checking will not prove your findings are true, but done well it catches misreadings, surfaces what you missed, and gives participants a voice in how they are represented.\n\nThis guide covers what member checking is, the main types, a step-by-step process, how to handle disagreement, and how to run a member check at a scale that used to be impractical.\n\n## What member checking is (and is not)\n\nMember checking sits under **credibility**, the qualitative counterpart to internal validity. In Lincoln and Guba's framework it is one of several credibility techniques, alongside prolonged engagement, persistent observation, triangulation and peer debriefing. You return something to participants and invite a response:\n\n- **Raw data**: a transcript or recording of their own interview, to check accuracy\n- **Interpreted data**: a summary of what you think they said\n- **Synthesized findings**: the themes you built across all participants, to see whether they recognise themselves in the whole\n\nWhat it is not:\n\n- **Not a vote.** If three participants disagree with a theme, the theme is not automatically wrong. Participants see their own experience; you see the pattern across 20 people.\n- **Not a substitute for analysis.** Sending transcripts back for typo correction is a transcription check, not a credibility check.\n- **Not proof.** Agreement can come from politeness, fatigue or not reading closely. Disagreement can come from a participant whose view changed since the interview.\n\nThomas (2017) draws the main line between approaches that return raw data and those that return analysed findings. The second is harder and far more informative.\n\n## The four main types of member checking\n\n| Type | What you return | When it is worth it | Main risk |\n| --- | --- | --- | --- |\n| Transcript review | The participant's own transcript | Sensitive or legal contexts where verbatim accuracy matters | Participants edit what they said to sound better |\n| Interview summary | A short summary of their individual interview | Studies where you want to confirm your reading of each person | Low effort for participants, so shallow responses |\n| Synthesized member check | Cross-participant themes with quotes | Most applied research; the strongest test of interpretation | Participants struggle to find themselves in abstract themes |\n| Member-check interview or group | A follow-up conversation about the findings | High-stakes findings or co-design work | Costly, and group settings can produce false consensus |\n\n### Synthesized member checking\n\nThe best-documented structured method is **Synthesized Member Checking**, developed by Linda Birt and colleagues (_Qualitative Health Research_, 2016) in a study with people diagnosed with melanoma. Several months after their interviews, participants received a document of synthesized findings with illustrative quotes and were invited to comment, add to or disagree with them. **56% (n=28) returned the document.** Respondents were broadly similar in gender, age and melanoma type to the main sample, but **younger participants were less likely to reply**.\n\nTwo lessons from that study apply to any team:\n\n1. Expect a little over half of participants to respond, at best, and plan for it.\n2. The people who respond are not a random subset. Check who is missing before you treat silence as agreement.\n\n### Asynchronous and video member checks\n\nMember checks used to rely on paper summaries or follow-up meetings. Schafer and Phillippi (_International Journal of Qualitative Methods_, 2025) describe an exemplar with **25 participants** where findings were presented in a recorded video with slides and responses were collected through an online survey. They argue that asynchronous technology can raise engagement and equity in member checking, because participants respond when it suits them rather than when the researcher is free.\n\n## How to run a member check, step by step\n\n### Step 1: Decide what you are testing\n\nWrite one sentence: \"We want participants to tell us whether \\_\\_\\_.\" Common goals:\n\n- Did we represent each person's experience accurately?\n- Do the themes resonate with people who lived them?\n- Is anything important missing?\n- Are any of our interpretations wrong or harmful?\n\nYour goal decides what you return. Accuracy needs transcripts or summaries. Resonance and gaps need synthesized findings.\n\n### Step 2: Plan it before the first interview\n\nTell participants at consent time that you may contact them again with findings. This sets expectations, lets people opt out early, and avoids a cold re-contact months later. Record how each person prefers to be contacted.\n\n### Step 3: Prepare findings people can actually read\n\nMost member checks fail here. Academic theme names (\"negotiating identity under uncertainty\") mean little to participants. For each finding:\n\n- Write it in plain language, one or two sentences\n- Add one or two short, anonymised quotes\n- Say who it applies to (\"most people we spoke to\", \"people who switched from a competitor\")\n- Keep the full set to five to eight findings\n\nRemove anything that could identify another participant. Synthesized findings mix many voices, so de-identification matters more here than anywhere else in the study.\n\n### Step 4: Ask structured and open questions about each finding\n\nGive people a fast way to react and room to explain. For each finding:\n\n1. **A rating**: \"How well does this match your experience?\" on a 1 to 5 scale\n2. **An open question**: \"What, if anything, is wrong or missing?\"\n\nEnd with one overall question: \"Is there anything important about your experience that these findings do not capture?\"\n\nThe rating lets you see patterns across responses. The open answer is where the real value is.\n\n### Step 5: Time it well\n\nBirt and colleagues went back several months after the interviews. Longer gaps let participants reflect, but memories fade and situations change. In fast-moving product research, two to six weeks is usually a better balance. Whatever you choose, record it, because it affects how you read disagreement.\n\n### Step 6: Analyse responses as data\n\nTreat member-check responses as a new, small dataset:\n\n- **Confirmations**: note them, but weigh them lightly\n- **Corrections of fact**: fix the finding\n- **Disagreements of interpretation**: investigate (see below)\n- **New material**: decide whether it extends a theme or warrants a new one\n\n### Step 7: Report what you did and what changed\n\nThomas (2017) found that published studies rarely say how member checks were done or what changed as a result. Close that gap in your own report: who you contacted, how many responded, what you asked, and which findings changed.\n\n## What to do when participants disagree\n\nDisagreement is the most useful outcome of a member check, and the hardest to handle. Work through it in order:\n\n1. **Is it a factual error?** You misheard, misquoted or misattributed. Fix it.\n2. **Is it about representation?** The participant agrees with the pattern but not with being placed in it. Check your coding of their interview.\n3. **Is it a different interpretation?** The participant sees the same events differently. Look across the dataset. If others support your reading, keep it and report the dissent. If the participant's reading fits the data better, revise.\n4. **Has their situation changed?** A churned customer who has since returned may now remember things differently. Note the change; it may be a finding in itself.\n\nNever quietly drop a theme because one person objected, and never ignore a disagreement because most people agreed. Report both.\n\n## Common mistakes\n\n- **Sending a 30-page report.** Nobody reads it. Five to eight plain-language findings get real responses.\n- **Treating silence as agreement.** Non-response is missing data, not consent.\n- **Only checking with friendly participants.** The people most likely to disagree are often the ones you most need to hear from.\n- **Asking leading questions.** \"Does this capture your experience well?\" invites a yes. Ask what is wrong or missing.\n- **Over-correcting.** Participants are experts in their own experience, not in the pattern across the sample.\n- **Breaking confidentiality.** A distinctive quote can identify someone to a colleague who also took part.\n\n## When member checking is worth it\n\nMember checking costs time for you and for participants. It is most worth it when:\n\n- Findings will drive a significant decision (pricing, a market entry, a product cut)\n- You are studying a group you are not part of, where misreading is likely\n- Participants are vulnerable or the topic is sensitive\n- Stakeholders are sceptical and you need to show the findings hold up\n\nIt matters less for quick usability checks, or when you are triangulating across several methods anyway. In those cases [triangulation](/docs/triangulation-in-research-guide) and peer review may give you more for the same effort.\n\n## How Koji helps\n\nA synthesized member check is a small follow-up study: you return findings to the same people and ask structured and open questions about each. That used to mean a second round of scheduling, emails and manual analysis. In Koji it is a second study on the same workflow as the first.\n\n- **Build the check as a short study.** Create a new study for the member check. You can attach your findings summary as a context document while you build the brief, so the assistant drafts questions from it. Put each finding into the brief as a question.\n- **Mix structured and open questions.** Use a **scale** question for \"How well does this match your experience?\" and an **open-ended** question for \"What is wrong or missing?\" Koji supports six question types (open-ended, scale, single choice, multiple choice, ranking and yes/no), and aggregates the structured answers into per-question charts automatically. See the [structured questions guide](/docs/structured-questions-guide).\n- **Probe disagreement automatically.** When a participant says a finding does not fit, the AI interviewer asks follow-up questions, up to three per question depending on the depth you set. This is the part a paper or survey member check cannot do: you learn _why_ someone disagrees, not just that they do.\n- **Go back to the same people.** Send each original participant a [personalized interview link](/docs/personalized-interview-links) so responses are tied to a known person, and you can see who has and has not replied. On Interviews and Enterprise plans you can also import a contact list.\n- **Let people respond when it suits them.** Interviews are asynchronous, by text on every plan or by voice on Interviews and Enterprise. This matches the asynchronous approach Schafer and Phillippi recommend.\n- **See patterns across responses.** Koji themes the open answers across all respondents, and you can ask questions of the full set of conversations with Ask AI. That shows which findings held up, which were challenged, and by whom.\n- **Pay only for useful responses.** Each interview gets a quality score, and only interviews scoring 3 or more use credits or enter the report. A text interview is 1 credit, a voice interview 3.\n\nCompared with a paper or email member check, you get structured ratings and probed open answers in one pass. Compared with follow-up interviews, you skip the scheduling. Neither replaces your judgement: deciding what a disagreement means is still the researcher's job.\n\n## Related Resources\n\n- [Qualitative Research Validity](/docs/qualitative-research-validity): Lincoln and Guba's trustworthiness criteria in practice\n- [Triangulation in Research](/docs/triangulation-in-research-guide): combining methods to strengthen credibility\n- [Thematic Analysis Guide](/docs/thematic-analysis-guide): building the themes you will member-check\n- [Inter-Rater Reliability in Qualitative Research](/docs/inter-rater-reliability-qualitative-research): checking coding consistency inside the team\n- [Structured Questions Guide](/docs/structured-questions-guide): scale and open-ended questions for your member-check study\n- [Personalized Interview Links](/docs/personalized-interview-links): inviting original participants back\n\n## Sources\n\n- Lincoln, Y. S., & Guba, E. G. (1985). _Naturalistic Inquiry_. Sage.\n- Thomas, D. R. (2017). Feedback from research participants: Are member checks useful in qualitative research? _Qualitative Research in Psychology_, 14(1), 23–41. https://doi.org/10.1080/14780887.2016.1219435\n- Birt, L., Scott, S., Cavers, D., Campbell, C., & Walter, F. (2016). Member checking: A tool to enhance trustworthiness or merely a nod to validation? _Qualitative Health Research_, 26(13), 1802–1811. https://doi.org/10.1177/1049732316654870\n- Schafer, R., & Phillippi, J. C. (2025). Updating and advancing member-checking methods: Use of video and asynchronous technology to optimize participant engagement. _International Journal of Qualitative Methods_, 24. https://doi.org/10.1177/16094069251315395\n","category":"Research Methods","lastModified":"2026-10-07T09:56:34.209011+00:00","metaTitle":"Member Checking in Qualitative Research: A Practical Guide","metaDescription":"Member checking (respondent validation) explained: types, a step-by-step process, what the evidence says, how to handle disagreement, and how to run it at scale.","keywords":["member checking","member checking qualitative research","respondent validation","participant validation","synthesized member checking","credibility qualitative research","trustworthiness","Lincoln and Guba"],"aiSummary":"Member checking, also called respondent validation, means returning data or findings to participants to test whether they recognise their experience in them. Lincoln and Guba (1985) called it \"the most crucial technique for establishing credibility\", while a review of 44 articles by Thomas (2017) found no evidence that member checks enhance research quality. The four main types are transcript review, interview summaries, synthesized member checking and follow-up interviews or groups. In Birt et al.'s synthesized member checking study (2016), 56% (n=28) of participants returned the findings document and younger participants were less likely to reply. A good member check returns five to eight plain-language findings, asks a rating and an open question about each, treats responses as data, and reports what changed. Koji runs a member check as a short follow-up study with scale and open-ended questions, AI follow-up probing on disagreement, personalized links back to original participants, and asynchronous text or voice responses.","aiPrerequisites":["Basic familiarity with qualitative interviews","Understanding of thematic analysis"],"aiLearningOutcomes":["Explain what member checking is and where it fits in Lincoln and Guba's credibility criteria","Choose between transcript review, summaries, synthesized member checking and follow-up interviews","Run a member check step by step, from consent to reporting","Handle participant disagreement without over- or under-correcting","Run a member check as a short asynchronous follow-up study"],"aiDifficulty":"intermediate","aiEstimatedTime":"12 min read"}],"pagination":{"total":1,"returned":1,"offset":0}}