When the Tail Wags the Dog: Perceptions of Learning and Grade Orientations, in and by, Contemporary College Students and Faculty Howard R. Pollio University of Tennessee-Knoxville Hall P. Beck Appalachian State University

1
Automation Usage Decisions Controlling Intent
and Appraisal Erros in a Target Detection Task
Hall P. Beck Appalachian State University Mary T.
Dzindolet Cameron University Linda G. Pierce Army
Research Laboratory
Perform the actions necessary to accomplish the
objective via automated or manual control.
2
Automation Usage Decisions (AUDs)
AUDs Operator must choose between automated
and/or a manual control or less technologically
sophisticated means of control. Misuse The
overutilization of automation Disuse The
underutilzation of automation Purpose To
determine if feedback and scenario training
mitigate misuse and/or disuse.
Perform the actions necessary to accomplish the
objective via automated or manual control.
3
Two Causes of Suboptimal AUDs
Appraisal Errors Operators are unable to
determine if automation or a non-automated
alternative maximizes the likelihood of task
success. Intent Errors Operators know the
relative utilities of the options but disregard
this information when deciding whether to use or
not use automation.
Perform the actions necessary to accomplish the
objective via automated or manual control.
4
Design and Procedure
A 2 (Feedback, No Feedback) x 2 (Scenario
Training, No Scenario Training) x 2 (Superior,
Inferior Machine) between-subjects in which an
AUD is the dependent variable
5
Design and Procedure

• Receive scenario training or control information
• Perform 280 target detection trials
• Feedback group is told how many errors that they
  and the machine made. No feedback group does not
  receive this information.
• Operator either makes twice (superior machine
  condition) or half (inferior machine condition)
  as the machine.

Perform the actions necessary to accomplish the
objective via automated or manual control.
6
High Noon
Ten trials will be replayed from the
preceding 280. Extra credit depends on the number
of these trials which are correct. Operator
bases credit on their own or the machines
performance.
Perform the actions necessary to accomplish the
objective via automated or manual control.
7
Underlying Logic
Suboptimal AUDs in the no feedback conditions
could be due to appraisal and/or intent
errors. Suboptimal AUDs in the feedback
condition should only be due to intent
errors. Feedback should reduce or eliminate
appraisal errors. Scenario Training should
decrease intent errors.
8
Disuse Scenario Training x Feedback
9
Conclusions
Results suggest that operators AUDs were
determined by multiple contingencies. Operator
training programs should include procedures
should as scenario training to reduce intent
errors. Advances in the reliability of decision
aids and other automated devices will be a hollow
achievement unless our knowlege of hardware and
software is matched by an equally sophisticiated
comprehension of the causes of misuse and disuse.
10
John Henry Effect
Results suggest that operators AUDs were
determined by multiple contingencies. John
Henry Effect Operators regard automation as a
challenge or a threat to their self-esteem.
Perform the actions necessary to accomplish the
objective via automated or manual control.