{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-05-18T14:02:02.115Z"},"content":[{"type":"documentation","id":"396a9912-a9d1-419a-af04-7c3f230ff4d1","slug":"training-needs-assessment-survey-guide","title":"How to Run Training Needs Assessments That Close Skill Gaps","url":"https://www.koji.so/docs/training-needs-assessment-survey-guide","summary":"Master training needs assessment surveys using competency mapping, skill gap analysis, the Kirkpatrick model, and training ROI measurement. Build L&D programs that deliver measurable business impact.","content":"# How to Run Training Needs Assessments That Close Skill Gaps\n\nOrganizations spend over $100 billion annually on corporate training in the US alone (Training Magazine Industry Report), yet 75% of managers report dissatisfaction with their company's learning and development function (McKinsey). The disconnect is not a lack of training. It is a lack of *targeted* training, programs that address the specific skill gaps that actually affect business performance.\n\nA training needs assessment (TNA) is the diagnostic step most organizations skip. Instead of surveying what skills teams need, they buy off-the-shelf courses, send everyone to the same conference, and hope for the best. The result is wasted budget, disengaged learners, and skill gaps that persist despite millions in L&D spending.\n\nThis guide shows you how to build training needs assessments that identify real skill gaps, prioritize investments, and measure whether training actually worked.\n\n---\n\n## What Is a Training Needs Assessment?\n\nA training needs assessment is a systematic process for identifying the gap between current skills and required skills within an organization. It answers three fundamental questions:\n\n1. **Where are we now?** What skills, knowledge, and capabilities does the workforce currently have?\n2. **Where do we need to be?** What skills are required to meet business objectives?\n3. **How do we close the gap?** What training, development, or hiring is needed?\n\n### The Three Levels of Needs Assessment\n\n**Organizational level:** What does the business strategy require? Are there new markets, technologies, or regulations that demand new capabilities?\n\n**Team/role level:** What competencies does each role require? Where do teams fall short of role requirements?\n\n**Individual level:** What are each employee's specific strengths and development areas?\n\nEffective TNAs operate at all three levels simultaneously. An organizational-level assessment might reveal that the company needs stronger data analytics capabilities. A role-level assessment identifies which teams need those skills. An individual-level assessment determines who needs what training.\n\n---\n\n## Building Your Competency Framework\n\nBefore you can assess gaps, you need to define what \"good\" looks like. This is your competency framework.\n\n### Step 1: Identify Core Competencies by Role\n\nFor each role or role family, define 8-12 competencies across three categories:\n\n**Technical competencies** (role-specific hard skills):\n- Software engineering: system design, code review, testing methodology, CI/CD\n- Marketing: SEO, content strategy, analytics, paid media\n- Sales: prospecting, discovery, negotiation, account management\n\n**Cross-functional competencies** (shared across roles):\n- Data analysis and interpretation\n- Project management\n- Communication (written and verbal)\n- Problem-solving and critical thinking\n\n**Leadership competencies** (for people managers):\n- Coaching and developing others\n- Strategic thinking\n- Change management\n- Stakeholder management\n\n### Step 2: Define Proficiency Levels\n\nFor each competency, define what each proficiency level looks like:\n\n| Level | Description | Behavioral Indicator |\n|---|---|---|\n| 1 - Foundational | Basic understanding, needs guidance | Can complete tasks with detailed instructions |\n| 2 - Developing | Working knowledge, occasional support needed | Can complete standard tasks independently |\n| 3 - Proficient | Solid skills, works independently | Handles complex situations, mentors others |\n| 4 - Advanced | Deep expertise, leads others | Innovates, solves novel problems, sets standards |\n| 5 - Expert | Industry-leading, strategic impact | Shapes organizational capability, thought leader |\n\n### Step 3: Set Target Proficiency by Role\n\nFor each role, set the expected proficiency level for each competency. A junior data analyst might need Level 2 in SQL and Level 1 in machine learning, while a senior data scientist needs Level 4 in both.\n\n---\n\n## Training Needs Assessment Survey Design\n\n### Self-Assessment Survey\n\nThe foundation of any TNA is a self-assessment where employees rate their own proficiency against the competency framework.\n\n**Skill proficiency questions (scale):**\n\n- *\"On a scale of 1-5, how would you rate your current proficiency in [competency]?\"* (1=Foundational, 5=Expert)\n- *\"On a scale of 1-5, how important is [competency] to your current role?\"* (1=Not important, 5=Critical)\n- *\"On a scale of 1-5, how confident are you in your ability to [specific skill behavior]?\"*\n\n**The importance-proficiency matrix:** By asking both proficiency and importance, you create a 2x2 matrix:\n\n| | Low Proficiency | High Proficiency |\n|---|---|---|\n| **High Importance** | Critical gap - train immediately | Strength - leverage and share |\n| **Low Importance** | Low priority | Over-invested - reallocate |\n\nThis matrix is your prioritization tool. Critical gaps (high importance, low proficiency) get addressed first.\n\n**Learning preference questions:**\n\n- *\"How do you prefer to learn new skills?\"* (ranking: instructor-led training, online courses, mentoring, on-the-job practice, reading/self-study, peer learning)\n- *\"How much time per week can you realistically dedicate to learning?\"* (single choice: less than 1 hour, 1-2 hours, 2-4 hours, 4+ hours)\n- *\"What has been your most effective learning experience at this company?\"* (open-ended)\n\n**Barrier identification questions:**\n\n- *\"What prevents you from developing new skills?\"* (multiple choice: lack of time, no relevant training available, not sure what to learn, manager does not support it, budget constraints, no clear career path)\n- *\"On a scale of 1-10, how supported do you feel by your manager in your professional development?\"* (scale)\n\n### Manager Assessment Survey\n\nManagers provide a complementary perspective on their team's capabilities.\n\n**Team gap questions:**\n\n- *\"For each team member, rate their proficiency in [competency]\"* (scale 1-5)\n- *\"What are the most critical skill gaps on your team?\"* (ranking of competency areas)\n- *\"Which skill gaps are most impacting your team's performance or business outcomes?\"* (open-ended)\n\n**Future needs questions:**\n\n- *\"What new skills will your team need in the next 12-18 months?\"* (open-ended)\n- *\"Are there projects or initiatives you cannot pursue due to skill gaps?\"* (yes/no + description)\n\n**Training effectiveness questions:**\n\n- *\"How effective has previous training been for your team?\"* (scale 1-5)\n- *\"What format of training has been most effective for your team?\"* (ranking)\n\n### Organizational Stakeholder Survey\n\nSenior leaders and HR business partners provide the strategic context.\n\n- *\"What business objectives in the next 1-3 years will require new workforce capabilities?\"* (open-ended)\n- *\"Where do you see the biggest capability gaps relative to our strategic plan?\"* (open-ended)\n- *\"Rank these development areas by strategic priority\"* (ranking of capability categories)\n\n---\n\n## Analyzing Training Needs Data\n\n### Gap Analysis\n\nFor each competency, calculate the gap: **Gap = Target Proficiency - Current Proficiency**\n\nAggregate gaps across the organization to identify:\n\n- **Universal gaps:** Skills where most employees fall below target (organization-wide training needed)\n- **Role-specific gaps:** Skills lacking within particular teams (targeted programs needed)\n- **Individual gaps:** Personal development needs (coaching or self-directed learning)\n\n### Calibrating Self-Assessment Data\n\nSelf-assessments have a well-documented accuracy problem. Research shows that the least competent individuals tend to overestimate their abilities (the Dunning-Kruger effect), while the most competent tend to underestimate.\n\nTo calibrate:\n\n1. **Compare self-assessments to manager assessments.** Gaps between the two highlight blind spots.\n2. **Use behavioral anchors.** Instead of asking \"How good are you at data analysis?\" ask \"Can you independently build a pivot table, create a regression model, or design an A/B test?\" Specific behaviors are harder to misjudge.\n3. **Include objective skill checks.** For technical skills, consider pairing surveys with practical assessments.\n\n### Prioritization Framework\n\nNot all gaps deserve training investment. Prioritize using:\n\n- **Business impact:** How much does this gap affect revenue, efficiency, or strategic goals?\n- **Prevalence:** How many people have this gap?\n- **Trainability:** Can this gap be closed through training, or is it better addressed through hiring?\n- **Urgency:** Is this needed now, or in 12-18 months?\n\n---\n\n## The Kirkpatrick Model: Measuring Training Effectiveness\n\nDonald Kirkpatrick's four-level evaluation model is the industry standard for measuring whether training actually works. Each level builds on the previous one.\n\n### Level 1: Reaction\n\n*Did participants find the training engaging and relevant?*\n\nSurvey questions (administered immediately after training):\n- *\"On a scale of 1-5, how relevant was this training to your role?\"* (scale)\n- *\"On a scale of 1-5, how engaging was the training delivery?\"* (scale)\n- *\"What was the most valuable takeaway?\"* (open-ended)\n- *\"What could be improved?\"* (open-ended)\n\n### Level 2: Learning\n\n*Did participants actually acquire the intended knowledge and skills?*\n\nMeasured through:\n- Pre/post knowledge assessments\n- Skill demonstrations\n- Self-assessed confidence change: *\"On a scale of 1-10, rate your confidence in [skill] before and after the training\"*\n\n### Level 3: Behavior\n\n*Are participants applying what they learned on the job?*\n\nSurvey questions (administered 30-90 days after training):\n- *\"How frequently are you applying what you learned in [training]?\"* (single choice: daily, weekly, occasionally, rarely, never)\n- *\"What barriers have you encountered in applying your new skills?\"* (multiple choice + open-ended)\n- *\"Can you describe a specific situation where you used what you learned?\"* (open-ended)\n\nManager follow-up:\n- *\"Have you observed behavior changes in [employee] since the training?\"* (yes/no + description)\n\n### Level 4: Results\n\n*Did the training produce measurable business outcomes?*\n\nThis requires connecting training to business metrics:\n- Productivity improvements\n- Error rate reductions\n- Customer satisfaction changes\n- Revenue impact\n- Time-to-competency for new hires\n\n---\n\n## Measuring Training ROI\n\n### The ROI Formula\n\n**Training ROI = (Benefits - Costs) / Costs x 100**\n\n**Costs include:**\n- Training development or purchase costs\n- Facilitator time\n- Employee time away from work (opportunity cost)\n- Technology and platform costs\n- Travel and logistics (for in-person)\n\n**Benefits include:**\n- Productivity gains (measured through output metrics)\n- Error/rework reduction (measured through quality metrics)\n- Reduced turnover (engagement surveys + retention data)\n- Revenue impact (for customer-facing skills)\n\n### Making ROI Measurable\n\nThe biggest challenge in training ROI is isolating the impact of training from other factors. Best practices:\n\n- **Control groups:** When possible, compare trained vs. untrained groups on performance metrics\n- **Pre/post measurement:** Measure the target metric before training and 3-6 months after\n- **Participant estimation:** Ask trained employees to estimate what percentage of their performance improvement is attributable to the training\n- **Manager validation:** Have managers confirm or adjust participant estimates\n\n---\n\n## Using Koji for Training Needs Assessments\n\nTraining needs assessments require depth that static surveys cannot deliver. When an employee rates their data analysis skills as a 3 out of 5, you need to understand: What specifically can they do? What can they not? Where did they learn what they know? What has prevented them from developing further?\n\n### How Koji Transforms TNAs\n\n**AI probes for specific skill gaps.** When an employee rates a competency, the AI does not just record the number. It asks behavioral follow-up questions: \"You rated your project management skills as a 3. Can you walk me through how you typically plan and track a project? What parts feel natural, and where do you feel less confident?\" This surfaces specific, actionable gaps rather than abstract ratings.\n\n**Learning preferences emerge naturally.** Instead of a multiple-choice question about learning preferences, the AI asks about their best and worst learning experiences. The conversation reveals not just *what* format they prefer, but *why*, and under what conditions they learn best.\n\n**Barrier exploration goes deeper.** When someone selects \"lack of time\" as a training barrier, the AI explores: Is it truly a time issue, or a prioritization issue? Does their manager support development time? Are there structural obstacles? This nuanced understanding is essential for designing solutions that actually get used.\n\n### Koji Structured + Conversational Approach for TNAs\n\nA typical Koji TNA interview might flow like this:\n\n1. **Scale:** \"On a scale of 1-5, how would you rate your proficiency in [competency]?\"\n2. **AI follow-up:** \"Tell me about a recent situation where you needed that skill. How did it go?\"\n3. **Scale:** \"How important is this skill to your current role?\" (1-5)\n4. **Ranking:** \"Rank these learning formats by preference: instructor-led, online course, mentoring, on-the-job, self-study\"\n5. **AI follow-up:** \"You ranked mentoring first. Have you had mentoring experiences that worked well? What made them effective?\"\n6. **Multiple choice:** \"What prevents you from developing new skills?\" (select all that apply)\n7. **AI follow-up:** Explores the top barrier in detail\n8. **Open-ended:** \"If you could develop one skill that would have the biggest impact on your career, what would it be and why?\"\n9. **AI explores** the career aspiration and connects it back to available development opportunities\n\n### Why This Approach Produces Better TNAs\n\n- **Calibrated data:** Conversational probing reveals actual proficiency more accurately than self-ratings alone\n- **Rich context:** You understand not just the gap, but the root cause and the best way to close it\n- **Higher engagement:** Employees feel heard and invested in, not surveyed\n- **Automatic theme extraction:** Koji aggregates across hundreds of conversations to identify organization-wide patterns\n\n---\n\n## Building a Continuous TNA Program\n\n### Annual Cycle\n\n| Quarter | Activity |\n|---|---|\n| Q1 | Full TNA survey deployment + analysis |\n| Q2 | Training program design and launch |\n| Q3 | Mid-year check-in (Kirkpatrick Levels 1-2) |\n| Q4 | Behavior and results evaluation (Kirkpatrick Levels 3-4) |\n\n### Integrating with Performance Management\n\nTNAs are most effective when connected to performance reviews, promotion criteria, and career development conversations. The competency framework used for assessment should be the same framework used for performance evaluation and career pathing.\n\n---\n\n## Conclusion\n\nTraining needs assessments are the difference between strategic L&D investment and expensive guesswork. By building a competency framework, assessing gaps systematically, prioritizing based on business impact, and measuring outcomes through the Kirkpatrick model, you transform L&D from a cost center into a performance driver.\n\nThe most important principle: start with the business need, not the training catalog. Identify what the organization needs to achieve, map the skills required, assess current capabilities, and only then design training to close the gaps that matter most.\n\n---\n\n## Related Survey Guides\n\n- [360 Feedback Guide](/docs/360-feedback-survey-guide) — Skill assessment from multiple perspectives\n- [Employee Engagement Guide](/docs/employee-engagement-survey-guide) — Development impact on engagement\n- [Change Management Guide](/docs/change-management-survey-guide) — Skills for change readiness\n- [Course Evaluation Guide](/docs/course-evaluation-survey-guide) — Training effectiveness measurement\n- [Pulse Survey Guide](/docs/pulse-survey-guide) — Track skill development progress\n\n*Use [structured questions](/docs/structured-questions-guide) to combine skill-gap scales with AI-powered career development interviews.*\n\n## Further reading on the blog\n\n- [Best Online Survey Software in 2026: The Complete Buyer's Guide](/blog/best-survey-software-2026) — From SurveyMonkey to Koji, we compare the top survey tools of 2026 across features, pricing, and use case fit — and explain when traditional\n- [Product-Market Fit Research: How to Go Beyond the 40% Survey (2026)](/blog/product-market-fit-research-guide-2026) — The Sean Ellis 40% survey tells you if you have product-market fit. AI-powered customer interviews tell you why — and what to do about it. H\n- [Best AI Market Research Tools in 2026: The Complete Buyer's Guide](/blog/ai-market-research-tools-2026) — AI has fundamentally changed market research. This guide compares the leading AI market research platforms—from AI-native interview tools li\n\n<!-- further-reading:blog -->\n","category":"Survey & Study Templates","lastModified":"2026-05-13T00:26:36.807295+00:00","metaTitle":"Training Needs Assessment Survey Guide: Close Skill Gaps with Data | Koji","metaDescription":"Learn how to run training needs assessments using competency mapping, skill gap analysis, and the Kirkpatrick model. Build L&D programs that deliver measurable ROI.","keywords":["training needs assessment","skill gap analysis","competency mapping","Kirkpatrick model","training ROI","learning and development survey","TNA survey","workforce development"]}],"pagination":{"total":1,"returned":1,"offset":0}}