All frameworks and cheat sheets

Process

How to do content analysis in 7 steps

Process diagram of the seven steps of content analysis, from defining the research question and building a codebook to checking reliability and reporting.
The reliability check in step 5 is what makes the counts worth trusting.

A seven-step guide to content analysis of interview transcripts, survey answers, support tickets or reviews: define the question, sample the data, build a coding framework, apply codes, check agreement between coders, count and compare codes, then interpret what the patterns mean. It suits UX and product researchers who need findings they can count and repeat. Koji does the coding and counting across every interview in a study, so the team can spend its time on the last step.

Where this appears

What's in this process

  1. Define your research question: Be precise. Why users abandon onboarding is a question you can code for. What users think is not.
  2. Select and sample your data: Transcripts, open answers, tickets or reviews. 20 to 50 units of text usually reach saturation.
  3. Build your coding framework: Let codes emerge from a first read, or start from an existing framework and write a codebook.
  4. Apply codes to the data: Work through it in order. One passage can take several codes. Keep checking the codebook.
  5. Check inter-rater reliability: A second coder codes 10 to 20% of the data. Aim for a Cohen's kappa of 0.70 or higher.
  6. Analyze and quantify: Count each code, work out shares, and look at which codes appear together and which are missing.
  7. Interpret and report: Counts are raw material. Explain why the patterns exist and what the team should do next.

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/how-to-do-content-analysis-seven-steps"><img src="https://www.koji.so/visuals/how-to-do-content-analysis-seven-steps/how-to-do-content-analysis-seven-steps.png" alt="Process diagram of the seven steps of content analysis, from defining the research question and building a codebook to checking reliability and reporting." width="1080" height="1080" /></a>
<p>Source: <a href="https://www.koji.so/visuals/how-to-do-content-analysis-seven-steps">How to do content analysis in 7 steps</a>, Koji</p>