Evidence-Based Training

Viktor Robeck, Assistant Director, Training

and Qualification, IATA
 Background

 EBT is an initiative to improve safety in flying

operations
 To further reduce airline accident rate a review of
recurrent and type-rating training was necessary
 So far – event based training, … including lessons
learned from past accidents/incidents into training
sessions, leading to a systematic form of training, -
checking off tick boxes

Evidence-Based Training 2 16 July 2014

Lima, Peru
 Data research process

 Flight ops and training data from the past 20 years has
been reviewed (i.e. LOSA programs, air safety reports,
flight data analysis)
 Examination of threats, errors, undesired aircraft states
and their relationship to unwanted consequences.
 These findings were compared with current training
practices with the outcome, that the current training
schema does not factor in the differences of the four
aircraft generations in use today.
 One size training does NOT fit all aircraft types
Evidence-Based Training 3 16 July 2014
Lima, Peru
Fatal accidents per million departures
2nd generation: 3rd generation: 4th generation:
2nd jet generation Glass-cockpit FBW
Nav display Flight Envelope
FMS Protection

4Q 2011
2nd generation
All aircraft

4th generation
3rd generation
 Aircraft by Generation

Aircraft Generations A318/A319/A320/A321,

A330, A340-200/300, A340-
500/600, B777, A380, B787,
Generation 4 Jet
A350, Bombardier C Series,
Embraer
E170/E175/E190/E195

A310/A300-600, B737-
300/400/500, B737-
600/700/800 (NG), B757,
B767, B747-400, B747-8,
Generation 3 Jet
B717, BAE 146, MD11,
MD80, MD90, F70, F100,
Bombardier CRJ Series,
Embraer ERJ 135/145

Generation 3 ATR 42-600, ATR 72-600,

Turboprop Bombardier Dash 8 Q Series

A300 (except A300-600),

BAC111, B727, B737-
Generation 2 Jet
100/200, B747-100/200/300,
DC9, DC10, F28, L1011

ATR 42, ATR 72 (all series

Generation 2
except -600), Embraer EMB-
Turboprop
120

Generation 1 Jet DC8, B707

Evidence-Based Training 5 16 July 2014

Lima, Peru
 Implementing EBT

Evidence-Based Training 6 16 July 2014

Lima, Peru
 Publications

EBT was developed with

industry over 6 years, under
ITQI, and jointly agreed by
ICAO, IATA, and IFALPA.
ICAO doc 9995 was published
in May 2013

augmented by IATA ITQI doc

‘EBT Implementation Guide’

Evidence-Based Training 7 16 July 2014

Lima, Peru
 EBT Source Data

 LOSA reports
 Flight Data Analysis studies
 Accident/Incident analyses
 Studies-AQP/ATQP Airline results
 Studies-Skill Decay & Retention
 Flight deck Automation studies
 STEADES
 Airbus Special FDA Reports
 Pilot Survey

Evidence-Based Training 8 16 July 2014

Lima, Peru
 Evidence from Data

 Data from over 3 million flights over

multiple aircraft types over multiple airlines
over several regions
 Use of standardized event set
 Analyzed for event frequency rate and
clusters (drill down)
 LOSA data:
- Over 9,000 observed flights
- 50+ airlines
- 90 page report from LOSA Archive
- Subsidiary follow up report

Evidence-Based Training 9 16 July 2014

Lima, Peru
 LOSA:

 4% of all approaches were unstable

 97% of unstable approaches are continued to landing
 10% result in abnormal landings
 Only 3% of unstable approaches lead to a Go-Around
 When a GA occurs – it almost always poorly performed
 Usually a surprise to the crew
 Very rarely occurs at (the briefed) missed approach height

Evidence-Based Training 10 16 July 2014

Lima, Peru
 Competencies to manage the unforeseen

Repetitive & Unique &

foreseeable Operation unforeseeable

Evidence System Environment No evidence

What we don’t
What we know
know

Evidence-Based Training 11 16 July 2014

Lima, Peru
8 Core Competencies
Application of Procedures
Communication
Flight path management - automation
Flight path management - manual
Leadership & teamwork
Problem solving & decision-making
Situation awareness
Workload management
 Competencies & related Knowledge, Skills
and Attitudes
➚Competency
➚Competency Description
➚Performance Criteria – observable behavior –
Situation Awareness
➚ Is aware of what the aircraft and its systems are doing
➚ Is aware of where the aircraft is and what its environment is
➚ Keeps track of time and fuel
➚ Is aware of the condition of people involved in the operation including
passengers
➚ Recognizes what is likely to happen, plans and stays ahead of the situation
➚ Develops “what if” scenarios and plans for contingencies
➚ Identifies threats to the safety of the aircraft and people, and takes
appropriate action
Evidence-Based Training Lima, Peru 13 16 July 2014
Competency Competency Description Behavioral indicator
Application of Identifies and applies Identifies the source of operating instructions
Procedures procedures in accordance with Follows SOP’s unless a higher degree of safety dictates an appropriate deviation
published operating Identifies and follows all operating instructions in a timely manner
instructions and applicable Correctly operates aircraft systems and associated equipment
regulations, using the Complies with applicable regulations.
appropriate knowledge. Applies relevant procedural knowledge
Communication Demonstrates effective oral, Ensures the recipient is ready and able to receive the information
non-verbal and written Selects appropriately what, when, how and with whom to communicate
communications, in normal and Conveys messages clearly, accurately and concisely
non-normal situations. Confirms that the recipient correctly understands important information
Listens actively and demonstrates understanding when receiving information
Asks relevant and effective questions
Adheres to standard radiotelephone phraseology and procedures
Accurately reads and interprets required company and flight documentation
Accurately reads, interprets, constructs and responds to datalink messages in English
Completes accurate reports as required by operating procedures
Correctly interprets non-verbal communication
Uses eye contact, body movement and gestures that are consistent with and support verbal messages
Aircraft Flight Path Controls the aircraft flight path Controls the aircraft using automation with accuracy and smoothness as appropriate to the situation
Management, through automation, including Detects deviations from the desired aircraft trajectory and takes appropriate action
automation appropriate use of flight Contains the aircraft within the normal flight envelope
management system(s) and Manages the flight path to achieve optimum operational performance
guidance. Maintains the desired flight path during flight using automation whilst managing other tasks and distractions
Selects appropriate level and mode of automation in a timely manner considering phase of flight and workload
Effectively monitors automation, including engagement and automatic mode transitions
Aircraft Flight Path Controls the aircraft flight path Controls the aircraft manually with accuracy and smoothness as appropriate to the situation
Management, through manual flight, including Detects deviations from the desired aircraft trajectory and takes appropriate action
manual control appropriate use of flight Contains the aircraft within the normal flight envelope
management system(s) and Controls the aircraft safely using only the relationship between aircraft attitude, speed and thrust
flight guidance systems. Manages the flight path to achieve optimum operational performance
Maintains the desired flight path during manual flight whilst managing other tasks and distractions
Selects appropriate level and mode of flight guidance systems in a timely manner considering phase of flight and
workload
Effectively monitors flight guidance systems including engagement and automatic mode transitions

Evidence-Based Training 14 16 July 2014

Lima, Peru
Leadership and Demonstrates effective Understands and agrees with the crew’s roles and objectives.
Teamwork leadership and team working. Creates an atmosphere of open communication and encourages team participation
Uses initiative and gives directions when required
Admits mistakes and takes responsibility
Anticipates and responds appropriately to other crew members’ needs
Carries out instructions when directed
Communicates relevant concerns and intentions
Gives and receives feedback constructively
Confidently intervenes when important for safety
Demonstrates empathy and shows respect and tolerance for other people.
Engages others in planning and allocates activities fairly and appropriately according to abilities
Addresses and resolves conflicts and disagreements in a constructive manner
Projects self-control in all situations
Problem Solving Accurately identifies risks and Seeks accurate and adequate information from appropriate sources
and Decision resolves problems. Uses the Identifies and verifies what and why things have gone wrong
Making appropriate decision-making Employ(s) proper problem-solving strategies
processes. Perseveres in working through problems without reducing safety
Uses appropriate and timely decision-making processes
Sets priorities appropriately
Identifies and considers options effectively.
Monitors, reviews, and adapts decisions as required
Identifies and manages risks effectively
Improvises when faced with unforeseeable circumstances to achieve the safest outcome
Situation Perceives and comprehends all Identifies and assesses accurately the state of the aircraft and its systems
Awareness of the relevant information Identifies and assesses accurately the aircraft’s vertical and lateral position, and its anticipated flight path.
available and anticipates what Identifies and assesses accurately the general environment as it may affect the operation
could happen that may affect Keeps track of time and fuel
the operation. Maintains awareness of the people involved in or affected by the operation and their capacity to perform as
expected
Anticipates accurately what could happen, plans and stays ahead of the situation
Develops effective contingency plans based upon potential threats
Identifies and manages threats to the safety of the aircraft and people.
Recognizes and effectively responds to indications of reduced situation awareness.
Workload Manages available resources Maintains self-control in all situations
Management efficiently to prioritize and Plans, prioritizes and schedules tasks effectively
perform tasks in a timely Manages time efficiently when carrying out tasks
manner under all Offers and accepts assistance, delegates when necessary and asks for help early
circumstances. Reviews, monitors and cross-checks actions conscientiously
Verifies that tasks are completed to the expected outcome
Manages and recovers from interruptions, distractions, variations and failures effectively

Evidence-Based Training 15 16 July 2014

Lima, Peru
 EBT - Baseline Program

Evidence-Based Training 16 16 July 2014

Lima, Peru
 Relative Importance of contributing factors in fatal accidents
(Source: Civil Aviation Safety Data, 1989-2003)

cockpit crew

aircraft

environment

powerplant

maintenance

air traffic control

airport

0% 10% 20% 30% 40% 50%

Evidence-Based Training 17 16 July 2014

Lima, Peru
 Deficient Competencies in Gen4 accidents over last 15 years

Evidence-Based Training 18 16 July 2014

Lima, Peru
 The problem

 By regulation flight crew training and checking is

based on events, which may be highly improbable in
modern aeroplanes

 Training programmes are consequently saturated

with items that may not necessarily mitigate the real
risks or enhance safety in modern air transport
operations

Evidence-Based Training 19 16 July 2014

Lima, Peru
 Mandatory Training Items

 Flight Preparation
 Before take-off checklist
 Engine failure between V1 and V2
 Rejected take-off before reaching V1
 Instrument departure and arrival procedures
 Engine-out Precision Approach to minima
 Non-Precision approach to MDA
 Go-Around 1 engine-out at DA
 Landing critical engine inoperative
Evidence-Based Training 20 16 July 2014
Lima, Peru
 Findings for 4th generation aircraft

 Adverse Weather Management

 Automation Management
 Go-Around Management
 Manual Aircraft Control
 Monitoring, cross checking, error detection
 Non – Compliance issues
 Unstable Approach (recognition and management)

Evidence-Based Training 21 16 July 2014

Lima, Peru
 EBT baseline program
Adverse weather Adverse wind ATC
Automation management Aircraft system malfunction Engine failure
Competencies non-technical (CRM) Aircraft System management Fire and smoke management
Gen4 Jet Training Topics

Compliance Approach, visibility close to minimum Loss of communications

Error management Landing Managing loading, fuel, performance errors
Go-Around management Runway or taxiway condition Navigation

A Manual aircraft control B Surprise C Operations or type specific

Mismanaged aircraft state Terrain Pilot incapcitation
Monitoring & cross-checking Workload, distraction, pressure Traffic
Unstable approach Upset recovery
Windshear recovery

Evidence-Based Training 22 16 July 2014

Lima, Peru
 Program Implementation

Evidence-Based Training 23 16 July 2014

Lima, Peru
 Example of recurrent training under EBT

2 3
Evaluation Maneuvers Scenario Based
Phase Training Phase Training Phase

• Train maneuver skills to • Manage the critical threats

Objective

• Assess competence
• Identify training needs proficiency. according to evidence
• Validate training • Validate system • Improve competency to
system performance performance and skill manage foreseen &
decay unforeseen threats

• Line orientated • Sequence of deliberate • Line orientated flight

Conduct

• One or more occurrence actions to achieve a scenarios

• Assessment of one or prescribed flight path • One or more predictable
more Competency • E.g. RTO, EF V1, OEI or unpredictable threats
Elements APP, OEI GA, Em..Descent

Evidence-Based Training 24 16 July 2014

Lima, Peru
 EBT Instructor qualities

Patient and has a positive attitude

Shows humility and admits mistakes
Encourages and is honest
Non-judgmental and shows empathy
Supportive, respectful and honest
Good knowledge

Evidence-Based Training 25 16 July 2014

Lima, Peru
 Summary Learn from the
positive

Examine the Learn by

evidence discovery

Measure Reinforce
effectively Key learning

Evidence-Based Training 26 16 July 2014

Lima, Peru
 Questions?
Thank you!
http://www.iata.org/whatwedo/ops-infra/itqi/Pages/index.aspx

Evidence-Based Training 27 16 July 2014

Lima, Peru