Manipulation of 3D objects with gestures and voice

1
Manipulation of 3D objects with gestures and voice

• Research issues
• 3D Sketching
• Input devices mouse, bird
• Gesture recognition
• Voice recognition

2
3D Sketching

• Goal Space Modelling (by 3D object creation)
• Traditional sketching is inherently 2D floor
  plan, cross section, perspective
• Adaptation of Kais Inner world

3
Input Devices

• Controlled space modelling requires high
  accuracy
• 6 DOF Input devices show best performance with
  positioning and deforming

4
Gesture Recognition

• Hand movement gt command
• Sketch gt object

5
Voice Recognition

• Speech interpretation
• Command recognition

6
3D Sketch application

• Creation of rectangular shapes and spaces
• Drag Copy box
• Delete box
• Navigate
• Rotate viewpoint

7
3D Sketch application

• Creation of rectangular shapes with specific
  orientation
• Orient box
• Drag Copy box

8
3D Sketch application

• Set/change color of box by voice command
• Select box
• Say red, green, blue

9
3D Sketch application

• Creation of curves shapes and spaces
• Drag Copy box along curve
• -45 lt angle lt 45 degr.

10
Improvements Extensions

• Scale box size
• Uniformly / non-uniformly
• Surface profile

11
Improvements Extensions

• Group Objects
• Sketch gesture group
• Add/remove object

12
Improvements Extensions

• Change dimensions
• By box
• By group

13
Improvements Extensions

• Interpret Sketch
• Parameterized geometry
• Change position and dimensions of shapes and
  openings
• Geometrical constraints

14
Improvements Extensions

• Interpret operations
• Representation Box mesh or Param. Geom.
• Design intend Level, aspect

15
Improvements Extensions

• Deformation of box meshes
• Geometric representation ?
• To which extend ?
• Transformation to Param. Geom. ?

16
Improvements Extensions

• Connection to Feature Database
• database element sketch
• attributes position, color,
• specialization into Param. Geom.
• attributes parameters, textures, ...

17
Improvements Extensions

• User environment
• LCD sketchpad with pencil
• Bird positioning and deforming
• Large screen projection
• Command input pointing, speech
• Cross section box

18
Improvements Extensions

• Modify utilities
• Move
• Copy
• etc.

19
Goodbye and Thanks
20
(No Transcript)