TOWARD MORE EFFECTIVE

1
TOWARD MORE EFFECTIVE MULTI-MEDIA
INTERFACES FOR HUMAN INTERACTION
WITH COMPUTER/COMMUNICATION SYSTEMS Professor
W. J. Karplus Human Computer Interface Project -
http//www.cs.ucla.edu/hcip
2
MISSION CRITICAL INTERFACES A human must make
time-critical decisions on the basis of many
simultaneous conflicting inputs,
under risk and in the face of uncertainty. Proble
ms Design
Goals Information overload Optimize info.
transfer Vigilance -- boredom Minimize
errors fatigue
Minimize response time Cognitive illusions
Flexibility/robustness
new requirements
new
technology

3
MISSION-CRITICAL INTERFACES Some
Examples Medical -- surgery ,
telemedicine Nuclear reactor control room Air
traffic control -- FAA, pilots NASA flight
tests NASA/Dryden Flight Research Center
4
NASA/DRYDEN FLIGHT RESEARCH CTR.

Ten or more simultaneous voice channels
Six Computer Monitors
Several Video Displays
Pilot Copilot Chase Pls Radar Observers Engineers
Test Flight Controller NASA-1
5
AN IMPROVED MISSION-CRITICAL INTERFACE Virtual
Audio Each speech channel appears to come
from a different location in 3-D.

Future Features Automatic keyword and voice
recognition Protection from cognitive illusions
6
Designing the Virtual Audio Digital Signal
Processors
7
PROGRAM INPUT I/O Mappings Critical
Channels Priorities Preferences Icons/Earcons Co
gnitive Science
DISPLAYS Audio Mono Virtual Video TV
Terminals Alarms Records
DATA INPUTS Speech Pilots Engineers
Observers Video Text Graphics Video (TV)
INTERFACE UNIT
8
THE NASA / DRYDEN TEST BED
Simulation of the Test Flight Environment Up
to eight simultaneous sound sources DSP filters
to position each source in virtual 3-D Video
display of simulated flight paths for
distraction Automatic monitoring of test
subjects performance accuracy
response time
9
THE TEST SUITES Each
test is 45-minutes long Four voice channels --
four different speakers Texts consist of series
of random messages Some messages start with
key-words Subject must react to key-words

identify word source Subject must monitor
screen and use mouse to cope with realistic
distractions
10
TYPICAL TEST SOUND TRACK 1 Long
Beach radio, centurian six niner delta is ten
miles south, 2000 feet. Request
advisory. 2 Edwards, traffic Apache two two five
zulu clear of runway on seven, Edwards, over
3 Denver International information Sierra
... 4 LAX traffic, cessna eight zero one,
landing LAX ... 5 Edwards traffic, NASA one
niner three bravo use runway one eight right,
clear to land, over .. .. .. .. .. ..
11
.. .. .. .. 11 Low Altitude Alert, NASA one niner
three bravo check your altitude
immediately 12 Traffic Alert, American three
five niner foxtrot advise you turn right,
heading three three one, 13 Aviation Broadcast,
weather advisory, Delta three three bravo, from
LAX to DIA, severe turbulence 14 Attention All
Aircraft, fuel dumping in progress over devils
triangle at one hundred feet by American five one
15 Mayday, Mayday, Mayday, LAX control,
American five five seven, left engine down,
heading eight zero at 17000 ...
12
HEMISPHERIC SPECIALIZATION Left Brain
Sequential Reasoning Right Brain Pattern
Recognition Reading text is a left brain
task Recognizing symbols is a right brain
task ---------------------------------------------
------------------ Understanding speech is a
left-brain tasks Key-word identification is a
right-brain task
13
(No Transcript)
14
(No Transcript)
15
(No Transcript)
16
Example of Hemispheric Specialization Please
examine the statement below and count the number
of times that the letter F appears
FINISHED FILES ARE THE RE- SULT OF YEARS
OF SCIENTIF- IC STUDY COMBINED WITH
THE EXPERIENCE OF YEARS.
17
Please examine the statement below and count the
number of times that the symbol _at_ appears
_at_INISHED _at_ILES ARE THE RE- SULT O_at_ YEARS
O_at_ SCIENTI_at_- IC STUDY COMBINED WITH THE
EXPERIENCE O_at_ YEARS.
18
APPLICATION OF AUTOMATIC SPEECH
RECOGNITION Identify key words Channel
key-words to left ear Attach earcons to
messages with key-words Identify
speakers Channel each speaker to different
point in 3-D
19
COGNITIVE ILLUSIONS
A large majority of individuals are
subject to very predictable and consistent
errors in judgement, in certain situations.
These errors or illusions are the result of
using incorrect or invalid heuristics instead
of rationality. Most people, including experts
are subject to illusions. The effect of
illusions is most pronounced when the individual
is hurried or subjected to stress.
20
TYPES OF COGNITIVE ILLUSION Studied
by psychologists over the past 30 years
anchoring
availability conjunctive fallacy
disjunctive fallacy framing
stereotyping typicality effect
and many more
21
PSYCHOLOGICAL DISJUNCTION
You have taken an important exam in October,
but you wont know the outcome until November
25. You learn about a bargain offer for a
Christmas vacation in Hawaii. It requires an
immediate non- refundable deposit of 200. As
you think about it, you decide that if you pass
the exam, you will take the trip to celebrate if
you fail the exam, you will take the trip to
console yourself. However, since you dont know
whether you have passed or failed, you dont
make the deposit.
22
Relevance of Psychological Disjunction You
are monitoring two critical sub-systems. For
each system there is a light that is green for
system ok and red for failure If either system
fails you must push a panic button.
23
SYSTEM 1 SYSTEM 2
24
SYSTEM 1 SYSTEM 2 RESPONSE
TIME
X ms
25
SYSTEM 1 SYSTEM 2
26
SYSTEM 1 SYSTEM 2 RESPONSE
TIME
X ms
27
SYSTEM 1 SYSTEM 2
28
SYSTEM 1 SYSTEM 2 RESPONSE
TIME
X ms
29
SYSTEM 1 SYSTEM 2
30
SYSTEM 1 SYSTEM 2 RESPONSE

TIME
3 X ms
31
PSYCHOLOGICAL CONJUNCTION A normal die
has four green faces and two red faces. After
being shaken repeatedly, one of the following
sequences is observed. On which would you bet?
If you win you get 30. If you lose, you pay me
10. 1. R G R R R 2. G R G R R R 3. G R R
R R R
32
AVAILABILITY ILLUSIONS A person is
said to employ the availability heuristic
whenever he estimates a probability or frequency
by the ease with which instances of association
come to mind. Example Select a word, in an
English book, at random. Is it more likely that
the word starts with a K or that the third
letter is a K?
33
THE SCENARIO AVAILABILITY ILLUSION Scenario A
sequence of events leading to an
outcome The scenario availability heuristic An
event is judged more likely to the extent that
it is easy to bring to mind a scenario resulting
in the events occurrence. It has been
demonstrated that judgements can be improved by
getting people to explicitly consider scenarios
different from the one they imagined initially.
34
POSSIBLE APPLICATION TO THE INTERFACE The
interface should present alternative
scenarios Given A set of input data
suggesting a crisis Use
intelligent agents to generate and
display alternative scenarios. Sources of
Scenarios history of past crises
pre-stored suggestions by experts
decision trees
simulation models of subsystems

35
PREMISES The many
and diverse studies in the cognitive sciences are
potentially relevant to the design of
mission-critical interfaces. It is possible to
develop a normative methodology to apply
cognitive science concepts to design
More Effective
Human - Computer/ Communication
Interfaces.