{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-11-16T01:00:13.035Z"},"content":[{"type":"documentation","id":"c1e6faee-e533-4512-abb4-4d68e2dc0d31","slug":"qualitative-research-audit-trail","title":"Audit Trail in Qualitative Research: What to Keep and How to Show It","url":"https://www.koji.so/docs/qualitative-research-audit-trail","summary":"An audit trail in qualitative research is the record that lets someone follow how a study moved from raw data to findings, including the decisions made and why. Lincoln and Guba treat it as the main evidence for dependability and confirmability. The guide covers Halpern's six categories of audit records, Carcary's physical and intellectual trails, how much documentation light, standard and full studies need, how to keep a decision log, how a colleague can audit three findings, a ten-item checklist, and how Koji's transcripts, quote-linked findings and report history produce much of the physical trail.","content":"**Short answer:** An audit trail in qualitative research is the record that lets someone else follow how you got from raw data to findings: what you collected, how you coded it, which decisions you made along the way and why. Lincoln and Guba made it the main test of two of their four trustworthiness criteria, dependability and confirmability. In practice it is a folder and a decision log kept while you work, not a document written at the end. If a sceptical stakeholder can pick any finding in your report and trace it back to the quotes and the coding decisions behind it, you have one.\n\n**Start today:** open a plain document called \"Decision log\" next to your current study. Every time you change a question, drop a participant, merge two codes or reword a theme, add one line: the date, what changed, and why. That single habit covers most of what an auditor would ask for.\n\nThis guide explains what goes into an audit trail, the six kinds of records Lincoln and Guba recommend keeping, how much is enough for a product or UX study, and a checklist you can reuse. It's part of Koji's series on rigour, alongside [qualitative research validity](/docs/qualitative-research-validity), [reflexivity](/docs/reflexivity-qualitative-research) and [member checking](/docs/member-checking-qualitative-research).\n\n## Why an audit trail matters\n\nQualitative findings are interpretations. Two researchers can read the same transcripts and come away with different themes, and both can be defensible. What makes a finding trustworthy isn't that nobody could disagree with it. It's that anyone who does disagree can see exactly how you reached it and judge for themselves.\n\nYvonna Lincoln and Egon Guba set this out in _Naturalistic Inquiry_ (1985), which proposed four criteria for trustworthy qualitative work in place of the quantitative ideas of validity, reliability and objectivity.\n\n![Framework of the four qualitative trustworthiness criteria: credibility, transferability, dependability and confirmability, with the main technique for each.](/visuals/qualitative-research-trustworthiness-criteria-framework/qualitative-research-trustworthiness-criteria-framework.png \"The audit trail is the evidence for two of the four criteria. · Source: Yvonna Lincoln and Egon Guba, Naturalistic Inquiry (1985)\")\n\nThe audit trail serves two of them:\n\n- **Dependability** asks whether the process was consistent and well documented: could someone follow what you did, and would it hold up?\n- **Confirmability** asks whether the findings come from the data rather than from the researcher's assumptions: can each conclusion be traced to what participants actually said?\n\nLincoln and Guba's point was economical: \"a single audit, properly managed, can be used to determine dependability and confirmability simultaneously.\" One well-kept trail answers both questions.\n\nThe gap between knowing this and doing it is large. Aref and colleagues (2021) reviewed qualitative studies in community pharmacy against the Standards for Reporting Qualitative Research. Trustworthiness techniques were absent or only partly reported in 21 of the studies, 68%, and the research approach and reflexivity were missing or partial in 30, or 97%. Those were peer-reviewed papers. Internal research reports in product teams rarely do better.\n\n## What an audit trail contains\n\nMarian Carcary (2009) splits the trail in two. The **physical audit trail** documents the stages of the study and its key methodological decisions: who you recruited, which guide you used, how you coded. The **intellectual audit trail** shows how your thinking changed: the hunches you started with, the moments you changed your mind, and why.\n\nMost teams keep some of the first and almost none of the second. The second is what lets a reader tell a finding you discovered from a belief you brought in.\n\nLincoln and Guba drew on Edward Halpern's 1983 work to list six classes of records an auditor would want to see.\n\n![Framework of Halpern's six audit trail categories, from raw data and analysis products to process notes and instrument development.](/visuals/halpern-audit-trail-six-categories/halpern-audit-trail-six-categories.png \"You don't need every category for every study. Keep the ones a sceptical reader would ask for. · Source: Edward Halpern (1983), as set out in Lincoln and Guba, Naturalistic Inquiry (1985)\")\n\n1. **Raw data.** Recordings, transcripts, field notes, screenshots, survey exports. The untouched record of what people said and did.\n2. **Data reduction and analysis products.** Codes, memos, summaries, early tallies. Everything you made by breaking the data down.\n3. **Data reconstruction and synthesis products.** Themes, categories, the final findings and the report itself, along with how they relate to each other.\n4. **Process notes.** Methodological decisions and why you made them: changes to the guide, recruitment problems, why a session was excluded, what you did to check trustworthiness.\n5. **Materials relating to intentions and dispositions.** The research brief, your hypotheses, a [reflexive journal](/docs/reflexivity-qualitative-research) and what you expected to find. This is where the intellectual trail lives.\n6. **Instrument development information.** Drafts of the interview guide, pilot notes, screener versions and what changed between them.\n\nLincoln and Guba themselves added a caveat: not every category will apply to every study. A five-interview usability check doesn't need the same trail as a year-long ethnography. The test is whether the records let a reader follow the path from raw data to each claim.\n\n## How much audit trail is enough?\n\nMatch the trail to the stakes of the decision the research feeds.\n\n**Light (a quick product study).** Keep the brief, the guide, the transcripts, the codebook or theme list, and a decision log. If someone asks \"where did this finding come from?\", you can show the quotes in under a minute.\n\n**Standard (a study that shapes a roadmap or pricing decision).** Add memos written during analysis, a record of codebook changes with dates, the screener and recruitment numbers (invited, screened out, completed), and notes on anything excluded and why. A colleague who wasn't involved should be able to retrace the analysis.\n\n**Full (published, regulated or contested work).** Add a reflexive journal, pilot notes, every version of the instrument, and an external review: someone outside the team reads the trail and writes down whether the findings follow from it. If you plan to publish, check which items your target journal's reporting checklist asks for. COREQ has 32 items grouped in three domains, starting with the research team and reflexivity, and SRQR has 21. Our guide to [COREQ and SRQR](/docs/coreq-srqr-qualitative-reporting-checklists) maps them in detail.\n\nDon't over-collect. An audit trail nobody can navigate fails the test as badly as no trail at all. Name files consistently, date everything, and keep one index document that says where each kind of record lives.\n\n## Keeping a decision log people will actually maintain\n\nThe decision log is the heart of the process notes, and it's the part teams abandon first. Three rules keep it alive.\n\n**One line per decision, written at the time.** \"12 Mar: dropped P7, screened in as an admin but turned out to be a contractor with no buying role.\" Ten seconds now saves an hour of reconstruction later.\n\n**Log the why, not just the what.** \"Merged _setup pain_ into _onboarding friction_\" is half an entry. \"...because coders couldn't tell them apart on three transcripts\" is the whole one.\n\n**Include the decisions that went against you.** If a stakeholder pushed for a question you thought was leading and you kept it anyway, write it down. If a theme you expected didn't appear, write that down too. These are the entries that make a trail credible.\n\n## Running an audit: how a colleague reviews your trail\n\nAn audit doesn't need a formal auditor. For most product studies, a colleague who wasn't involved can do it in an hour or two.\n\n![Two colleagues talking through research notes together as one checks how the findings trace back to the data](https://images.unsplash.com/photo-1758876022473-d3d8513f15d3?crop=entropy&cs=tinysrgb&fit=max&fm=jpg&ixid=M3w5NDUzMDN8MHwxfHNlYXJjaHwyfHx0d28lMjBjb2xsZWFndWVzJTIwZGlzY3Vzc2luZyUyMG5vdGVzJTIwb2ZmaWNlfGVufDF8MHx8fDE3OTQ3MjU0MTF8MA&ixlib=rb-4.1.0&q=80&w=1080)\n\n_Photo by [Vitaly Gariev](https://unsplash.com/@silverkblack?utm_source=koji&utm_medium=referral) on [Unsplash](https://unsplash.com/?utm_source=koji&utm_medium=referral)_\n\nGive them the report and the index of records. Ask them to pick three findings, ideally one they find surprising and one they're sceptical of, and trace each back:\n\n- Which quotes support it? Are those quotes representative, or the two best lines from one enthusiastic participant?\n- Which codes or themes did those quotes come from, and how did those codes get defined?\n- Were there participants who said the opposite? Where are they in the analysis?\n- Did anything in the decision log, such as an exclusion or a mid-study change to the guide, shape this finding?\n\nThen ask for a short written note: which findings traced cleanly, which didn't, and what was missing. Keep that note in the trail. It's the strongest single piece of evidence that the work holds up.\n\nThis review is also a good moment for [negative case analysis](/docs/negative-case-analysis): actively looking for participants whose experience contradicts each finding.\n\n## A reusable audit trail checklist\n\n![Checklist of ten records to keep for an interview study audit trail, from the research brief to the decision log and a reviewer's note.](/visuals/audit-trail-checklist-interview-study/audit-trail-checklist-interview-study.png \"Tick these off as the study runs, not the week before the readout.\")\n\n- The research brief: questions, hypotheses and what you expected to find\n- Every version of the interview guide and screener, dated\n- Recruitment numbers: invited, screened out, completed, excluded and why\n- Recordings or transcripts for every session\n- Field notes or observer notes taken during sessions\n- The codebook, with a dated log of changes\n- Analytic memos written while coding\n- A decision log covering exclusions, merges and changes of direction\n- Each finding linked to the quotes that support it\n- A note from an external reviewer who traced at least three findings\n\n## How Koji helps\n\nA lot of the physical audit trail can be produced as a side effect of running the study, and that's where Koji helps most.\n\n**The raw data is complete and consistent.** Every Koji interview, voice or text, produces a full transcript organised by the study's questions, so you're not relying on notes taken mid-conversation. Every participant gets the same questions from the same research brief, which removes one of the biggest sources of undocumented drift: an interviewer who asks things a little differently each time.\n\n**Findings link to their evidence.** Each finding in a Koji report opens the participant responses behind it, and the quotes are highlighted in their transcripts. Koji's analysis attaches a verbatim quote to every code it writes, so a reviewer can check a theme against the exact words without searching. That covers the hardest part of a confirmability audit, tracing claims back to data, without building the links by hand.\n\n**Report versions are kept.** When you refresh a report as more interviews come in, Koji keeps the earlier versions in its report history, each with its date and interview count, and marks the current one. You can open an earlier version to see what the findings said at 10 interviews against what they say at 30.\n\n![Koji report history listing three versions with dates and interview counts, the latest published](/email/shots/shot-report-history.jpg \"Earlier report versions stay available, so you can show how the findings changed as interviews came in.\")\n\n**Exports for your archive.** The responses table exports to CSV, one row per participant with every answer, on every plan. Store it with the rest of the trail.\n\nWhat Koji doesn't do is keep your intellectual audit trail. The reasons you merged two themes, the hunch you started with, the stakeholder conversation that changed a question: those belong in your decision log and memos. Compared with running interviews by hand, where transcripts, recordings and notes end up spread across a calendar, a transcription tool and someone's laptop, the physical trail mostly assembles itself, and you can spend the time on the part only you can write. [Create a study](/docs/creating-your-first-study) to see what the trail looks like for a real one.\n\n## Frequently asked questions\n\n**What is an audit trail in qualitative research?**\nIt's the set of records that shows how a study moved from raw data to findings: data, codes, memos, themes, and a log of the decisions made along the way and why. It lets someone outside the study follow and judge the path. Lincoln and Guba treat it as the main evidence for dependability and confirmability.\n\n**What should an audit trail include?**\nLincoln and Guba, drawing on Halpern (1983), list six categories: raw data, data reduction and analysis products, data reconstruction and synthesis products, process notes, materials relating to intentions and dispositions, and instrument development information. Not every study needs all six. Keep what a sceptical reader would need to trace your main findings.\n\n**What is the difference between a physical and an intellectual audit trail?**\nCarcary (2009) describes the physical trail as the documentation of the study's stages and methodological decisions, and the intellectual trail as the record of how the researcher's thinking developed. The intellectual trail shows which conclusions you reached from the data and which you brought with you.\n\n**Is an audit trail the same as an audit log in software?**\nNo. A software audit log records who did what in a system, such as who exported data or changed a setting. A qualitative audit trail records research decisions and the path from data to findings. The two can overlap for data governance, but they answer different questions.\n\n**Who reviews an audit trail?**\nFormally, an external auditor: someone outside the study who checks whether the process was sound and the findings follow from the data. In product research, a colleague who wasn't involved can trace a few findings back through the trail and write a short note on what held up.\n\n**Do I need an audit trail for a small UX study?**\nA light one, yes. Keep the brief, the guide, the transcripts, your theme list and a one-line-per-decision log. It takes minutes and means you can answer \"where did that come from?\" when a finding is challenged.\n\n## Related Resources\n\n- [Qualitative Research Validity and Reliability](/docs/qualitative-research-validity)\n- [Reflexivity in Qualitative Research](/docs/reflexivity-qualitative-research)\n- [Analytic Memos in Qualitative Research](/docs/analytic-memos-qualitative-research)\n- [COREQ and SRQR Reporting Checklists](/docs/coreq-srqr-qualitative-reporting-checklists)\n- [Tracing Report Findings Back to the Evidence](/docs/tracing-report-findings-to-evidence)\n- [Structured Questions Guide](/docs/structured-questions-guide)\n\n## Sources\n\n- Lincoln, Y. S., & Guba, E. G. (1985). _Naturalistic Inquiry_. SAGE.\n- Halpern, E. S. (1983). _Auditing naturalistic inquiries: The development and application of a model_. Doctoral dissertation, Indiana University.\n- Carcary, M. (2009). The research audit trial: Enhancing trustworthiness in qualitative inquiry. _Electronic Journal of Business Research Methods_, 7(1), 11–24.\n- Aref, H. A. T., Witry, M., Olufemi-Yusuf, D., & Guirguis, L. M. (2021). Ensuring quality qualitative research reporting in community pharmacy: A systematic literature review. _International Journal of Pharmacy Practice_, 29(5), 416–427.\n- Tong, A., Sainsbury, P., & Craig, J. (2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. _International Journal for Quality in Health Care_, 19(6), 349–357.\n- O'Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. _Academic Medicine_, 89(9), 1245–1251.\n","category":"Research Methods","lastModified":"2026-11-15T06:50:11.176102+00:00","metaTitle":"Audit Trail in Qualitative Research: Guide and Checklist","metaDescription":"How to keep an audit trail in qualitative research: Halpern's six categories, physical vs intellectual trails, a decision log, a peer audit and a 10-item checklist.","keywords":["audit trail qualitative research","research audit trail","confirmability","dependability qualitative research","audit trail example","Lincoln and Guba trustworthiness","qualitative research rigour"],"aiSummary":"An audit trail in qualitative research is the record that lets someone follow how a study moved from raw data to findings, including the decisions made and why. Lincoln and Guba treat it as the main evidence for dependability and confirmability. The guide covers Halpern's six categories of audit records, Carcary's physical and intellectual trails, how much documentation light, standard and full studies need, how to keep a decision log, how a colleague can audit three findings, a ten-item checklist, and how Koji's transcripts, quote-linked findings and report history produce much of the physical trail.","aiPrerequisites":["Basic familiarity with qualitative interviews","Awareness of coding and thematic analysis"],"aiLearningOutcomes":["Explain how an audit trail supports dependability and confirmability","List Halpern's six categories of audit trail records","Size an audit trail to the stakes of a study","Keep a decision log that records the why behind each change","Run a peer audit that traces findings back to the data"],"aiDifficulty":"intermediate","aiEstimatedTime":"12 min read"}],"pagination":{"total":1,"returned":1,"offset":0}}