Interaction Techniques for Immersive CAD Virtual Piping

1
Interaction Techniques forImmersive CAD
(Virtual Piping)

• ? ? ?
• (Namgyu Kim)
• ngkim_at_postech.ac.kr

2
Immersive CAD

• Properties of CAD operations
• intuitive and interactive visual feedback
• many interaction tasks
• selection object selection menu selection
• manipulation size, position, orientation, etc
• navigation object/view
• trial and error
• Ideas
• introduce from 2D CAD environments VE is not
  accurate
• use interaction techniques in VE
• provide natural interaction tasks
• follow coupled ? Interaction paradigm
• Testbed system Virtual Piping

3
Approach (1)

• Classification of tasks
• primitive tasks basic 3D interaction
• menu selection
• object selection
• object manipulation size, position, orientation
• composite tasks piping environment-dependent
• pipe creation/type selection menu selection
• pipe selection object selection
• pipe manipulation
• position and orientation
• object selection, menu selection, object
  manipulation
• size
• object selection, menu selection

4
Approach (2)

• Interaction techniques for primitive tasks
• menu selection
• gesture, voice, simple hand, gaze-directed
• object selection
• ray-casting, gaze-directed, simple hand
• object manipulation
• simple hand, 3D widget manipulation

5
Result (Not complete)

• Multimodal interface for interaction techniques
• more important combination of best interface than
  consistent interface
• cannot induce usability and usefulness in each
  cases
• why?
• inter-dependency on each interface
• less discussion for composite tasks
• cannot resolve relationships between interaction
  techniques for primitive tasks and interaction
  techniques for composite tasks
• Our Approach
• focus on one interaction technique menu
  selection
• menu selection most frequent interaction tasks
• re-examine existing techniques for emerging I/O
  devices

6
Menu Selection (Input Devices)

• Positioning (for selecting operations)
  continuous event
• tracking (T) magnetic tracker
• gesture/posture (G) data glove
• voice (V) voice recognition
• Input Command (for doing operations) discrete
  event
• button (B) wand-like
• gesture/posture (G) data glove
• voice (V) voice recognition

7
Combinations (Inter-dependency)

• Reject hypothesis
• physical interference
• G and T
• require unnatural interaction sequences
• B and G
• B and V
• G and V
• More hypothesis and Ideas ?

Position
T
V
G
Input
B
V
G
may be possible
possible
impossible / not useful
8
Menu Selection (Output Devices)

• Output devices for VE
• Projection-based large screen
• High-resolution stereo monitor
• Low-resolution immersion HMD
• Menu display techniques
• eye point/direction and menu position fixed and
  toggle
• menu shape
• object or 2D menu
• vertical or horizontal
• display method by selection
• popup
• stack
• More considerations ?

Item 1
Item 1
Item 2
Item 3
Item 2
Item 3
Item 1
Item 3
Item 4
Item 2
Item 4
Item 5
Item 3
Item 4
Item 5
Item 6
Item 5
Item 6
Item 6
9
Discussion

• Still on-going
• Research directions
• investigate previous work in menu selection or
  related interaction tasks
• design experimental system
• basic 3D VE (HMD, tracker, glove, speech, mouse)
• evaluation techniques for menu selection tasks
• completion time
• affordance
• Our goals
• design guideline for menu selection interaction
  techniques
• design generic menu for VE(ADIT ? GIT ? ADIT ?
  ...)
• apply similar development approach to other
  interaction technique design