Navy Advancement Center

1
Advancements at Sea/Shore/Overseas
Kiwanis Short Darlene Barrow

• Navy Advancement Center
• NETPDTC, Pensacola, FL

2
Navy Enlisted Advancement System (NEAS)

• NEAS provides the orderly progression of
  qualified enlisted personnel to higher levels of
  responsibility throughout their Navy careers.
• Advancement is based on the manning levels
  required (vacancies) for Navy ships and stations,
  per CNO policy.

3
Navy Enlisted Advancement System

• Quotas are issued by CNO/COMNAVPERSCOM and
  executed by NETPDTC based on Final Multiple Score
  (FMS) ranking of qualified personnel.
• Final Multiple Score (FMS) is based on many
  factors.

E-4/E-5 example
4
Norm-Referenced Exam
Discriminating Exam
Average Sailors
Least Quailfied
Most Quailfied
RAW 0 RS AVG 100
200 STD 20
AVG P 50
80
5
Sea/Shore/Overseas
The effect of Advancements Examination Results
for U.S. Navy Sailors stationed at various
locations sea, shore, and overseas duty
stations.
6
Sea/Shore/Overseas
Sea Duty Stationed on a ship Shore Duty
Stationed in the Continental United
States Overseas Duty Stationed in another
country
7
Sea/Shore/Overseas
Population of potential candidates for
advancement
8
Sea/Shore/Overseas
Examined Advancees Those who were advanced.
Opportunity candidates Anyone who was
eligible to advance and did not fail the
advancement examination.
9
Aggregate Results
Sea/Shore/Overseas
10
Sea/Shore/Overseas
AGGREGATE
Note SS is Standard Score and FMS is Final
Multiple Score
11
Sea Intensive Ratings

• Quartermaster
• Sonar Technican (Surface)
• Cryptologic Technician
• Hull Maintenance Technician

12
Sea/Shore/Overseas
QUARTERMASTER
Note SS is Standard Score and FMS is Final
Multiple Score
13
Sea/Shore/Overseas
SONAR TECHNICIAN (SURFACE)
Note SS is Standard Score and FMS is Final
Multiple Score
14
Sea/Shore/Overseas
CRYPTOLOGIC TECHNICIAN (TECHNICAL)
Note SS is Standard Score and FMS is Final
Multiple Score
15
Sea/Shore/Overseas
HULL MAINTENANCE TECHNICIAN
No difference?
Note SS is Standard Score and FMS is Final
Multiple Score
16
Neutral Ratings

• Yeoman
• Master-At-Arms
• Information Systems Technician

17
Sea/Shore/Overseas
YEOMAN
Note SS is Standard Score and FMS is Final
Multiple Score
18
Sea/Shore/Overseas
MASTER-AT-ARMS
Note SS is Standard Score and FMS is Final
Multiple Score
19
Sea/Shore/Overseas
INFORMATION SYSTEMS TECHNICIAN
Note SS is Standard Score and FMS is Final
Multiple Score
20
Sea/Shore/Overseas

• Results
• Overall
• No significant difference exists for advancement
  opportunities,
  
• which includes TIR, evaluations, exam scores,
  etc.
• No significant difference exists for examination
  scores between
• sea, shore, and overseas duty stations
• Sea Intensive ratings
• Some differences exists for advancement
  opportunities of sea
  intensive ratings for advancements and exam
  scores.
• Neutral ratings
• Opportunities remain equal regardless of duty
  station.

21
Sea/Shore/Overseas

• Implied results
• Equitable system exists
• Data shows examination is performing well.
• Those with highest standard scores also have a
  greater chance of advancement.
• Sea intensive rating advantage
• Implies that those performing the job actually
  score better on examinations and have a greater
  chance of advancement.
• (Note Sole purpose of examinations/FMS to
  discriminate and advance already qualified
  candidates.)

22
Sea/Shore/Overseas
Future actions

• Protect the system.
• Publish results and use as a baseline for the
  future.
• Implement report system for exam developers and
  Fleet management for analysis purposes.
• For example, ratings that do show a significant
  difference in higher evaluations scores, higher
  award points, and higher exam scores can be
  analyzed for anomalies and corrected if needed.

23
Effect of the Exam on Personnel Selection

• Provides equal opportunity to all sailors to
  demonstrate their knowledge under like conditions
• Provides objective measurement among sailors
• Legally sound
• Provides variance/dispersion needed for selection

24
Sea/Shore/Overseas
Additional Information Exam construction
25
Critical Exam Process Steps

• Chief Petty Officers with Fleet experience write
  questions based on test plan and test outline
• Professional testing experts analyze questions
  and construct the exam
• SMEs and personnel testing psychologists work
  closely with subject matter experts ensuring a
  quality product

26
Examination Success Measurement

• Based on Fleet job performance
• Questions that are unclear, trivial, or require
  the recall of basic job qualifications cannot be
  used.
• Must meet statistical requirements
• The ideal question is correctly answered by
  approximately 50 of the population
• The group that correctly answered the question is
  composed mainly of those who scored well on the
  exam

27
Validity of Exam Questions

• Face validity assured by in-house SME
• Predictive validity assured by use of control
  items--items that meet statistical model

28
Norm-Referenced Testing
Creating a discriminating exam with Category 3,
control items
Least Quailfied
Most Quailfied
P-Values 80 AVG P 28
50
Easy items Hard items
R-Values 1.0 to .11
Control items
P54 Exam Writer Target
New items
29
Exam Scoring and Notification Process

• Exam writers take exams about a month ahead of
  fleet to ensure validity and answer key
• Answer keys are scored (first time) when most
  answer sheets are received
• Statistics are computed on basis of Fleet
  performance and returned to exam teams (used to
  gage question and test performance)
• Selectees identified based on quotas assigned by
  CNO N132 - exam is vacancy driven

30
Sea/Shore/Overseas
31
Sea/Shore/Overseas
32
Advancement Examinations

• Final Multiple Score (FMS) distributes qualified
  candidates without bias or favoritism
• Role of Advancement Examinations
• Exams (and evaluations) are top contributors to
  FMS distribution
• Exams provide variance (ability to spread
  candidates for selection)
• Exams are based on occupational and professional
  military knowledge