Hands and Feet in user interfaces New Interaction Techniques 5.2.2001 Roope Raisamo rrcs.uta.fi Toni

1
Hands and Feet in user interfaces New
Interaction Techniques 5.2.2001 Roope Raisamo
(rr_at_cs.uta.fi) Toni Pakkanen (toni_at_cs.uta.fi)Dep
artment of Computer and Information
SciencesUniversity of Tampere, Finland
2
Hands and Feet

• This lecture contains issues on using devices
  that rely on human motor systems, like hands and
  feet.
• The basic issues related to keyboards and mice
  are not discussed here. The lecture explains two
  novel ways of input
• two-handed interaction, aka bimanual interaction
  (Roope Raisamo)
• feet interaction (Toni Pakkanen)
• More information on this subject can be found in
  Chapter 3 of Raisamo, 1999e, http//granum.uta.f
  i/pdf/951-44-4702-6.pdf

3
Two-handed Interaction

• Two-handed interfaces are based on using both
  hands in parallel, or sequentally in a combined
  task.
• Two-handed interfaces use two parallel input
  channels, and therefore are a form of multimodal
  user interfaces.
• Many potential benefits and problems that are
  related to multimodal interaction also apply to
  two-handed interfaces

4
Two-handed Interaction

• One major research problem is to find out the
  tasks that can benefit of bimanual interaction.
• In everyday life these tasks include eating and
  tying ones shoelaces.
• What would they be in a user interface?
• The design of interaction techniques used in
  two-handed interaction is very important
• The functions of both hands should support each
  other.

5
The history of two-handed user interfaces

• the non-preferred (non-dominant) hand used as a
  modifier already in Sketchpad Sutherland, 1963
• The first system to use both hands in more useful
  way was Kruegers 1983 VIDEOPLACE
• The first evaluation of two-handed interfaces for
  desktop systems was done by Buxton and Myers
  1986

6
The history oftwo-handed user interfaces

• ToolGlasses Bier et al., 1993
• Two-handed techniques in graspable user
  interfaces Fitzmaurice and Buxton, 1997
  Fitzmaurice et al., 1995
• A GUI Paradigm Using Tablets, Two Hands and
  Transparency (T3) Kurtenbach et al., 1997
• Bimanual interface to control neurosurgical
  visualization Hinckley et al., 1997a 1997b
  1998a

7
The history of two-handed user interfaces

• Guidelines for two-handed interaction Chatty,
  1994.
• Ways of using both hands Nigay and Coutaz, 1993
• independent interaction
• sequential tasks
• parallel interaction
• non-related tasks
• combined interaction
• related tasks

8
Benefits

• Two hands are natural
• Buxton and Myers, 1986
• Two hands are efficient
• Buxton and Myers, 1986
• Two hands are less moded
• Zhai et al. 1997

9
Benefits

• Using both hands is natural they are used
  together in many everyday tasks, for example
• when tying ones shoelaces
• when the non-preferred hand holds a nail and the
  preferred hand uses a hammer
• when the non-preferred hand supports the
  preferred hand by providing additional strength
  or steadiness, as when driving a car, holding a
  full coffee mug, or playing golf.

10
R2-Draw

• R2-Draw is an object-oriented drawing program
  prototype that implements new kinds of drawing
  and manipulating tools Raisamo and Räihä, 1996
  Raisamo, 1999a
• the alignment stick
• the carving stick
• the shrinking stick
• the rotating stick
• the cutting stick
• R2-Draw has one- and two-handed input methods
• UIST96 Video

11
The stick tools

• The tools are based on a stick metaphor (ruler)
• All the new tools have similar controls
• an example of using the alignment stick

12
The alignment stick
13
The sculpting tools
14
Mapping the controls of the tools
15
Modeling bimanual input

• Two-handed interaction requires new kind of
  modeling techniques
• most current models do not take into account
  parallel use of hands and different devices
• A solution is to extend Buxtons Three-State
  Model with notations that suit for two-handed
  interaction
• Hinckley et al. 1998 have presented such an
  extended model.

16
Buxtons Three-state model
Hinckley et al., 1998b
17
Additional properties
Hinckley et al., 1998b
18
Modeling bimanual input
Hinckley et al., 1998b
19
Modeling of bimanual input
Hinckley et al., 1998b
20
Examples

• UIST96 Video Proceedings A New Direct
  Manipulation Technique for Aligning Objects in
  Drawing Programs (422)
• UIST98 Video Proceedings Interaction and
  Modeling Techniques for Desktop Two-handed Input
  (250)