GM1 ORO.FC.231(a)(4) Evidence-based training

• ED Decision 2021/002/R found in: Air Operations (965/2012) Part-ARO Part-ORO Part-CAT Part-SPA Part-NCC Part-NCO Part-SPO (Feb 2025)

GM1 ORO.FC.231(a)(4) Evidence-based training ED Decision 2021/002/R INSTRUCTOR CONCORDANCE ASSURANCE PROGRAMME (ICAP) (a) Instructor concordance is a tool for continuous improvement of the EBT programme as data reliability results in a more accurate and effective training. (b) The operator may have a more frequent, or even a continuous, assessment of concordance as it provides more opportunities to improve. (c) Concordance standards are normally set by the operator; however, the competent authority may recommend criteria, as licences’ revalidation is performed under EBT. (d) Individual instructor concordance may be verified: (1) through uniform standardisation material where at least three different levels of performance are included and for all the competencies at a frequency of 72 months; (2) by reference to the analysis of the data produced by the instructor every 12 months; normalisation may be necessary as there is no homogeneity of all EBT modules and the pilots that the instructor assessed; and (e) Instructor-group assessment homogeneity (agreement) may be inferred from instructors who have observed the same content. (f) Instructor assessment accuracy (alignment) may be inferred from comparing instructor assessments with an ‘assessment standard’ consisting of correctly identified competency(-ies) and correctly identified grade levels. Neither the competency(-ies) nor the grade level(s) may be communicated in advance to the instructors. The assessment standards may be set by consensus of a standards group, in order to guard against individual biases. (g) When the operator uses a small group of instructors (e.g. 10), the data-driven concordance assurance programme may be directly integrated into the annual refresher training, removing the need for the above guidance. (h) Operators with a complex group of instructors (e.g. a big rotation of instructors, subcontracted instructors, big number of instructors, many different fleets, etc.) may need to implement a more extensive concordance assessment system. GM1 ORO.FC.231(a)(4) Evidence-based training ED Decision 2021/002/R INSTRUCTOR CONCORDANCE ASSURANCE PROGRAMME (ICAP) (a) Instructor concordance is a tool for continuous improvement of the EBT programme as data reliability results in a more accurate and effective training. (b) The operator may have a more frequent, or even a continuous, assessment of concordance as it provides more opportunities to improve. (c) Concordance standards are normally set by the operator; however, the competent authority may recommend criteria, as licences’ revalidation is performed under EBT. (d) Individual instructor concordance may be verified: (1) through uniform standardisation material where at least three different levels of performance are included and for all the competencies at a frequency of 72 months; (2) by reference to the analysis of the data produced by the instructor every 12 months; normalisation may be necessary as there is no homogeneity of all EBT modules and the pilots that the instructor assessed; and (e) Instructor-group assessment homogeneity (agreement) may be inferred from instructors who have observed the same content. (f) Instructor assessment accuracy (alignment) may be inferred from comparing instructor assessments with an ‘assessment standard’ consisting of correctly identified competency(-ies) and correctly identified grade levels. Neither the competency(-ies) nor the grade level(s) may be communicated in advance to the instructors. The assessment standards may be set by consensus of a standards group, in order to guard against individual biases. (g) When the operator uses a small group of instructors (e.g. 10), the data-driven concordance assurance programme may be directly integrated into the annual refresher training, removing the need for the above guidance. (h) Operators with a complex group of instructors (e.g. a big rotation of instructors, subcontracted instructors, big number of instructors, many different fleets, etc.) may need to implement a more extensive concordance assessment system. ##### GM1 ORO.FC.231(a)(4) Evidence-based training *ED Decision 2021/002/R* **INSTRUCTOR CONCORDANCE ASSURANCE PROGRAMME (ICAP)** (a) Instructor concordance is a tool for continuous improvement of the EBT programme as data reliability results in a more accurate and effective training. (b) The operator may have a more frequent, or even a continuous, assessment of concordance as it provides more opportunities to improve. (c) Concordance standards are normally set by the operator; however, the competent authority may recommend criteria, as licences’ revalidation is performed under EBT. (d) Individual instructor concordance may be verified: (1) through uniform standardisation material where at least three different levels of performance are included and for all the competencies at a frequency of 72 months; (2) by reference to the analysis of the data produced by the instructor every 12 months; normalisation may be necessary as there is no homogeneity of all EBT modules and the pilots that the instructor assessed; and (e) Instructor-group assessment homogeneity (agreement) may be inferred from instructors who have observed the same content. (f) Instructor assessment accuracy (alignment) may be inferred from comparing instructor assessments with an ‘assessment standard’ consisting of correctly identified competency(-ies) and correctly identified grade levels. Neither the competency(-ies) nor the grade level(s) may be communicated in advance to the instructors. The assessment standards may be set by consensus of a standards group, in order to guard against individual biases. (g) When the operator uses a small group of instructors (e.g. 10), the data-driven concordance assurance programme may be directly integrated into the annual refresher training, removing the need for the above guidance. (h) Operators with a complex group of instructors (e.g. a big rotation of instructors, subcontracted instructors, big number of instructors, many different fleets, etc.) may need to implement a more extensive concordance assessment system.