Scenario Based TrainingSBT vs MBT Maneuvers Based Training ERAU Results Task 1

1
Scenario Based TrainingSBT vs MBT Maneuvers Based
Training ERAU Results Task 12

• FITS Incorporates
• Technically Advanced Aircraft
• Scenario Based Training (SBT)
• Single Pilot Resource Management (SRM)
• Learner Centered Grading

Jon French Associate Professor Human Factors and
Systems Department Embry Riddle Aeronautical
University Daytona Beach, FL
2
Scenario Based Training

• This isnt a new idea. train the way you fly
  and fly the way you train is similar to an
  older idea called learning by doing
• DoD use, particularly in C2 training Red Flag
• Nuclear reactor training
• Medical training
• Its longevity suggests that SBT is successful
• GREAT FACE VALIDITY AND VERY WELL ACCEPTED BY
  TRAINERS but Peer Reviewed Data validating
  this approach was not unavailable

until now
FITS Brings Structured Scenario Based Training
to Aviation
3
Chelton on a Frasca Half-Shell
Our Study Simulators
Elite Simulator
FITS Task 1 2 Technologically Advanced
Aircraft/Performance (TAAP) Lab for Pilot Training
4
Equipment used added to realism
5
Displays for SR20 (Overhead projection,
traditional instruments) Instructor Station
(Wx,Failures, ATC) 3rd party -
Chelton Interface
- Data collection
- Flight
Instruments
6
PRE-TEST (4 hrs) POST-TEST (4 hrs)

• Statistical Paradigm
• Groups
• Mixed Design

Within Group Design
Between Group Design
(No-Training) (Maneuvers Based)
(Scenario Based)
Decision Making
7
Our Volunteers lt 500 hours total flight hours,
Current Instrument Rated, No TAA training or
experience, Not CFI

• ALL VOLUNTEERS
• Day 1 4 Hrs
• Proficiency training Cessna 172 and SR 20
• (Simple out and Back IMC)
• SALESMANs BRIEF
• PRE-TEST 2 hours
• Questionnaires Workload, SRM

8
GROUP 1 GROUP 2 GROUP 3 (No-Training)
(Maneuvers Based) (Scenario
Based) Day 2 0 Hours 4 Hours 4
Hours Day 3 0 Hours 4 Hours 4 Hours

• ALL VOLUNTEERS
• Day 4 4 Hrs
• POST-TEST 2 hours
• Questionnaires Workload, SRM,
• Decision Making

9

• Collaboration of Expertise Aviation
  Sciences, Education, Experimental Psychology
  to produce
• A New Standard in Pilot Performance
  Assessment Research
• Too many pilots currently learn TAA OYO
  (on your own)

• Objective and Subjective measures in a pre-test
  post test design
• MEASURES Workload, Decision Making Ability,
  Glass Instrument Piloting and Navigation Skills,
  Expert evaluation and Videotape Evaluation, SRM
  comparison with data collected from Industry
  Training Seminars

10
FITS Post-Test SME Rating Example Post test
Rating Sheet 1. Flight Planning  a) Subject asks
about Special Use Airspace (SUA) -Y N
Wrong  b) Subject asks for information about an
alternate - Y N Wrong . . 5. Distraction
. . e) Auto Pilot Use ----------------- Y N
W N/A
8 events each in Pre and Post tests when Auto
Pilot use is rated.
11
RATER EVALUATION RESULTS Pre-Test and Post Test
Scenarios Event 1 Flight Planning NS Event
2 Pre-Flight Preparation S Event
3 Pre-Takeoff NS Event 4 Takeoff
Departure T Event 5 Distraction S Event
6 En-route NS Event 7 Approach S Event
8 Missed Approach S Event A. Autopilot events
only S Event B. GPS events only T Event C.
MFD Events only NS
5 S 2 T 4 NS
Ssignificant plt0.05 Ttrend plt0.1 NS
nonsignificant
12
(No Transcript)
13
(No Transcript)
14

• SELF-EFFICACY, WORKLOAD AND SITUATIONAL
  ASSESSMENT
• Pre-Test and Post Test Questionnaires
•  
• SELF EFFICACY QUESTIONNAIRE - TECHNICALLY
  ADVANCED AIRCRAFT (SEQ-TAA) T
• SELF EFICACY QUESTIONNAIRE SINGLE PILOT
  RESOURCE MANAGEMENT (SEQ-SRM) NS
• SITUATIONAL AWARENESS RATING TECHNIQUE (SART) NS
• NASA TASK LOAD INDEX (TLX) NS
• VISUAL, COGNITIVE, AUDITORY, PSYCHOMOTOR (VCAP)
  WORKLOAD ASSESSMENT NS

15
(No Transcript)
16
Conclusions

• Fair comparison between MBT and SBT
• MBT successful, SBT more so in training TAA
  instrument flight (rater evaluations during most
  phases of flight, subjective workload assessment)
• Extends SBT to the aviation environment

17

• Strong laboratory findings Thousands of
  successful Flights
• Can SBT support get any better.
• ONE STUDY IS A GOOD START! Every Flight is
  Different!
• Research can provide strong scientific and PR
  support for
• ASSESS THE FIELD TRAINING OF SBT
• Validation of Key Syllabi which are necessary
• Validation of Instrument Configuration
• whats CRITICAL, Whats CLUTTER
• Add better Scan to SBT
• Determine how long SBT needs to last, in whom
• Discover other ideas along the ways Decision
  Making Assessment
• TECHNICALLY ADVANCED AIRCRAFT
• PERFORMANCE LAB IS READY!

18
Questions?
TAPP Technically Advanced PILOT PERFORMANCE
Jon French Assoc. Professor 352 Lehman
Bldg ERAU Daytona Beach, FL 386 226
6384 frenc70f_at_erau.edu