Distance from the user is controlled by arm extension. Line

1
Virtual Environment Interaction Techniques

• CS4473
• 7 March 2000

2
Agenda

• Introduction
• Realms
• 2D Window to 3D
• 3D Virtual Workbench
• 3D Immersive Environments
• Conclusion

3
Introduction

• Why worry about interaction?
• Square peg in a round hole
• Specialized applications require specialized
  interaction

4
Bran Ferran

• There has never been a high performance
• task done in the history of this planet,
• to the best of my knowledge, that has ever
• been done well with an intuitive interface.

5
Realms

• 2D Window to a 3D World
• 3D Virtual Desktop
• 3D Immersive Environment

6
2D Window to a 3D WorldThe Usual Suspects

• Keyboard
• Mouse
• Joystick

7
2D Window to a 3D WorldOther Approaches

• Two Pointer Input
• 4 Button Mouse
• 3 Button Stylus
• Fish Tank Visual Reality
• Head Tracked Perspective
• Scene Just Behind the Screen
• Navigation with Head Movements and Mouse

8
2D Window to a 3D WorldOther Approaches

• Sketch
• 3D Extrapolation of Lines
• Mouse Driven Input
• Teddy
• teddy.bat
• Bend and Twist Input Strip

9
3D Virtual DesktopThe Usual Suspects

• Two-Handed Direct Manipulation
• Pinch Glove and Pen-like 6 DOF Stylus
• 2 Pinch Gloves
• More Symmetric Action
• Menu of Tools

10
3D Virtual DesktopBran Ferran Techniques

• Transparent Props for Virtual Desktop
• Polhemus Tracked Transparent Tablet
• Tracked Stylus
• Virtual Menus

11
3D Immersive Environment

• The Usual Suspects
• 3D Mouse
• Gestures w/ Gloves
• Voice Recognition

12
3D Immersive Environment

• CHIMP (Chapel Hill Immersive Modeling Program)
• One or two handed interaction
• Bats with 6DOF and several buttons
• Action at a distance - Selection using a
  spotlight
  
• Look-at Menus (Pop-up)

13
3D Immersive EnvironmentCHIMP
14
3D Immersive Environment

• Head Crusher
• Pinch Gloves
• Easy to select and manipulate objects
• Sticky Finger
• Framing hands
• Lifting Palm

15
3D Immersive Environment
Head Crusher
Sticky Finger
Lifting Palm
Framing Hands
16
3D Immersive Environment

• Voodoo Dolls
• Pair of Pinch Gloves
• Selection with non-dominant hand
• Manipulation with dominant hand
• Over the shoulder deletion

17
3D Immersive Environment

• Arm Extension
• Virtual Arm grows at non-linear rate
• Finite distance
• Hard to control position
• Stretch Go-Go Technique
• Virtual Arm extends at linear rate
• Infinite extension
• Arm length more difficult to control

18
3D Immersive Environment

• Indirect Stretching
• Less physical fatigue
• Extend/Retract arm with mouse buttons
• Basic Ray-Casting
• Selection is simple
• Position/Orientation is very difficult
• Cant control distance from user

19
3D Immersive Environment

• Ray-Casting w/Reel-in Feature
• Mouse buttons control distance from user
• Orientation difficult, if not impossible
• HOMER - Hand-centered Object Manipulation
  Extending Ray-casting
  
• Combination of ray-casting selection and arm
  extension

20
3D Immersive Environment

• Indirect HOMER
• Changing the range of the object from the user is
  done with mouse buttons
  
• Direct HOMER
• Distance from the user is controlled by arm
  extension
  
• Linear mappingMoving the arm 1/2 way closer to
  the body moves the object 1/2 the distance to the
  user.

21
Summary

• There is no standard interface that works for
  every application
  
• Specific applications often require unique
  interaction techniques
  
• Dont try to force an interaction technique
  when it doesnt work

22
Conclusion

• There cannot be only one
• In time, people will develop and explore many
  more strange, new interfaces
  
• Just because its popular, doesnt mean its the
  best interface.
  
• If it aint broke, break it!

23
References

• Mine, Mark R.(1996), Working in a Virtual
  World Interaction Techniques Used in the Chapel
  Hill Immersive Modeling Program. TR96-029
  
• Pierce, Jeffrey S., A. Forsberg, M. J. Conway,
  S. Hong, R. Zeleznik, M. R. Mine (1997), Image
  Plane Interaction Techniques In 3D Immersive
  Environments. 1997 Symposium on Interactive 3D
  Graphics, April 1997
• Bowman, Doug A. and Larry F. Hodges(1997), An
  Evaluation of Techniques for Grabbing and
  Manipulating Remote Objects in Immersive Virtual
  Environments. 1997 Symposium on Interactive 3D
  Graphics, April 1997
• Cutler, Laurence D., B Froehlich, and P
  Hanrahan(1997), Two-Handed Direct Manipulation
  on the Responsive Workbench. 1997 Symposium on
  Interactive 3D Graphics, April 1997
• Ware, Colin and Daniel Fleet(1997), Context
  Sensitive Flying Interface. 1997 Symposium on
  Interactive 3D Graphics, April 1997

24
References

• Zeleznik, Robert C., A. S. Forsberg, Brown
  University, and P. S. Strauss(1997), Two Pointer
  Input for 3D Interaction. 1997 Symposium on
  Interactive 3D Graphics, April 1997
• Pierce, J., B.C. Stearns, and R. Pausch(1999),
  VooDoo Dolls Seamless Interaction at Multiple
  Scales in Virtual Environment 1999 Symposium on
  Interactive 3D Graphics, April 1999
• Schmalstieg, D., and L. M. Encarnacao(1999),
  Using Transparent Props for Interaction with the
  Virtual Table. 1999 Symposium on Interactive 3D
  Graphics, April 1999
• Balakrishman, R., G. Fitzmaurice, G. Kurtenbach,
  K. Singh(1999), Exploring Interactive curve and
  Surface Manipulation Using a Bend and Twist
  Sensitive Input Strip. 1999 Symposium on
  Interactive 3D Graphics, April 1999
• Silas Entertainment (1999), The Story of
  Computer Graphics., Virtual Worlds segments, 10
  May 1999

25
Questions??