Delivery Data Available
Assessment records and training outputs from Delivery phase can be imported for evaluation.
Not Started
In Progress
Complete
Data Ready
In this Assurance Phase there are 14 activities. You are not obliged to complete them all, you need only complete the activities you require to meet your needs. It will be stated in each of the activities whether it is a "MUST" or "SHOULD", this is for guidance only.
DSAT Question: "Is the training activity being delivered correctly and does it meet the requirement? Is the whole Training System fit for purpose?"
🔗
DTSM 5 - EVALUATION PLANNING
Stage 1: Evaluation Planning
0 / 2 complete | Output: Evaluation Strategy
MUST
📋
Evaluation Strategy (EStrat)
Long-term action plan for achieving successful training evaluation across all 4 Kirkpatrick stages.
EStrat Document
Evaluation Schedule
Data Collection Plan
MUST
🔍
Training Needs Evaluation (TNE)
Stage 3 of TNA - assess effectiveness of TNA process and ability of training solution to meet Defence requirement.
TNE Report
Process Assessment
Solution Validation
DTSM 5 - INTERNAL VALIDATION
Stage 2: Internal Validation (InVal)
0 / 4 complete | Output: InVal Reports
MUST
📝
InVal Planning
Configure data collection methods: questionnaires, interviews, observations, trainer monitoring, trainee logs.
Data Collection Plan
Questionnaire Templates
Interview Schedules
MUST
😊
InVal Stage 1: Reaction
Kirkpatrick Level 1 - Measure trainee perception of training effectiveness via end-of-course feedback.
Trainee Feedback
Course Critiques
Reaction Analysis
MUST
📚
InVal Stage 2: Learning
Kirkpatrick Level 2 - Measure KSA transfer via formative/summative assessments and test analysis.
Assessment Analysis
KSA Transfer Report
Pass/Fail Trends
MUST
📄
InVal Reporting
Compile InVal findings using triangulation. Confirm TOs met, training to LSpecs, standards achieved.
InVal Report
CEB Presentation
Improvement Recommendations
DTSM 5 - EXTERNAL VALIDATION
Stage 3: External Validation (ExVal)
0 / 4 complete | Output: ExVal Reports
MUST
📆
ExVal Planning
Plan workplace validation 6-18 months post-training. Design questionnaires for ex-trainees and line managers.
ExVal Schedule
Questionnaires
Sampling Strategy
MUST
🎯
ExVal Stage 3: Behaviour
Kirkpatrick Level 3 - Measure behaviour change in workplace. Are KSA being applied? Is Role still valid?
Behaviour Analysis
Workplace Performance
Role Validity Check
MUST
📈
ExVal Stage 4: Results
Kirkpatrick Level 4 - Measure business impact, Defence output contribution, and Value for Money (VfM).
Business Impact Report
VfM Assessment
Defence Output Link
MUST
📊
ExVal Reporting
Compile ExVal findings for CEB. Identify training improvements and feed back into Design phase.
ExVal Report
CEB Presentation
Design Feedback
DTSM 6 - AUDIT & COMPLIANCE
Stage 4: Audit & Compliance
0 / 4 complete | Output: Audit Reports
MUST
🔎
1st Party Audit (1PA)
Internal assurance against DTAF. CO/HoE confirmation of compliance with MTS and Defence policy.
1PA Report
NC/OBS Log
Good Practice
MUST
🔍
2nd Party Audit (2PA)
External Defence assurance against DTAF including Care & Welfare Framework. Higher-level stakeholder assurance.
2PA Report
Stakeholder Brief
Action Grid
MUST
📋
DTAF Compliance Tracker
Track compliance against 66 DTAF elements across 3 themes: Management, DSAT Process, Personnel & Pipeline.
Compliance Matrix
Gap Analysis
Evidence Log
SHOULD
🔄
Continuous Improvement
QIAP tracking, action plans from audits, follow-up monitoring, closedown reports.
QIAP
Action Plans
Follow-up Reports
Final Output: Assurance Package
Complete evaluation and audit documentation for CEB reporting and external inspection readiness
Assurance Package PRIMARY
Comprehensive assurance documentation demonstrating training effectiveness, compliance, and continuous improvement.
EStrat
TNE Report
InVal Reports
ExVal Reports
1PA Report
2PA Report
DTAF Compliance
QIAP
0/8 components complete