GENERALISABILITY OF THE PSYCHOMETRIC PROPERTIES OF A PILOT SELECTION BATTERY

1
GENERALISABILITY OF THE PSYCHOMETRIC PROPERTIES
OF A PILOT SELECTION BATTERY

• Agnès Kokorian
• PEOPLE TECHNOLOGIES, UK
• Colin Valsler
• PSYTECH LTD., UK

2
Overview of presentation

• Short history of PILAPT development
• Design philosophy
• Example of tests
• Evidence of construct validity
• PILAPT research evidence for reliability and
  generalisability

3
History of PILAPT development
4
PILAPT Design Cycle
Cycle of RD Events
5
Hunter Burke meta-analysis

• Went back over 50 years of pilot selection
  research
• Military civilian research
• Europe, USA, Australia, Canada
• Obtained 468 correlations and a total sample size
  of 437,258
• Tests classified using Fleishman categories

International Journal of Aviation Psychology,
1994
6
Hunter Burke meta-analysis
Hunter and Burke note that research on
personality and pilot training was subject to a
hit-and-miss approach
7
The PILAPT tests
8
The PILAPT tests
Total testing time is less than 1 hour
9
PILAPT research evidence
10
Development and validation roadmap
1997
1999
2000
2002
2003
1998
2000
2004
UK Commercial Pilot Training
NATO Airforce
NATO Airforce
Commercial Airline
NATO Airforce
The analyses reported in this presentation will
focus only on the results for military pilot
applicants and trainees
UK Commercial Pilot Training
Military Pilot South America
NATO Airforce
11
Reliability
12
PILAPT Reliability
Reliabilities for other tests include -
Test-retest for DI of 0.80 (N109, RAF UAS) -
Test-retest for Trax of 0.84 (N109, RAF UAS)
13
Internal consistency effect size displays
14
Construct validity
15
NATO Airforce 2002 (N 632)
Construct validity with other selection measures
Reasoning and problem solving
Note There were no other psychomotor tests.
Results also show a small reasoning component to
the Trax test.
Math
g
0.44
0.57
PILAPT
0.35
0.53
0.27
Spatial
Memory
Speed and accuracy
Information processing
16
Conclusions
17
Summary

• The design of PILAPT tests has shown consistent
  levels of reliability across
• languages
• selection contexts
• types of applicants
• Construct validation results also show that
  PILAPT tests are measuring factors identified as
  critical for success in military pilot training