Praktikum Augmented Reality Introduction Gudrun Klinker Oct' 25, 2000

1
Praktikum Augmented Reality- Introduction -
Gudrun KlinkerOct. 25, 2000
2
1. Goals

• Teach basic AR skills learn by doing
• Satisfy customer requirements
• Help build the AR infrastructure for future
  research/teaching activities

3
2. Administrative Issues

• Tutorial Wednesdays 1430 - 1600
• Praktikum Freely selectable (coordinated with
  other students as needed)
• Office hoursBy appointment (email to
  klinker_at_in.tum.de)
• Information www12.in.tum.de/teaching/ws00/AR-Prak
  tikum
• Related Software Engineering class (thursdays,
  1430 - 1600) Software Engineering tutorial
  (fridays, 1115 - 1200) STARS UI-Team meeting
  (wednesdays, 1015) STARS Device-Team meeting
  () Joint reviews with STARS (mondays, 1415 -
  1545)

4
3. Scenario

• Repair procedures in nuclear power plants
• Here (initially)
• A specific physical mockup to demonstrate
  concepts and algorithms.
• One particular procedure to check the helium
  flushing system (present instructions and
  highlight relevant physical parts in order).
• Other procedures (time permitting)
• Attach sticky notes
• Navigate in the environment to find objects

5
3.1 Maintenance Procedure
Work order received
3.1 replace He-bottle at V2000 3.2 open
V2000 3.3 wait until PI2082 shows constant
pressure
2.1 close V2000 2.2 turn on P5001/1 2.3 turn on
P5001/2 2.4 open V2003/1 2.5 open V5003/2 2.6
open V2056 2.7 wait until PI5009 shows 100
mbar 2.8 close V2056
Sufficient Helium in system?
no
close V2000
yes
End of Procedure
6
3.2 Physical Setup
(by Friday, November)
7
4. AR-System
Mobile Sensor(s)
Local Tracking Sensor Fusion
3D Scene Model
Rendering Augmentation
Virtual Objects
Mobile Display(s)
8
4. AR-System
Mobile Sensor(s)
STARS Info-Team
Local Tracking Sensor Fusion
3D Scene User Model
Wireless Communication
Dynamic Information Access Visualization
Rendering Augmentation
Local Cache
Mobile Display(s)
9
4. AR-System
Mobile Sensor(s)
Wearable User Input
Multi-modal Input Interpretation
STARS Info-Team
Local Tracking Sensor Fusion
STARS UI-Team
3D Scene User Model
Wireless Communication
Dynamic Information Access Visualization
Rendering Augmentation
Local Cache
Mobile Display(s)
10
4. AR-System
Virtual objects - Procedural representation -
Declarative representation - Remote access -
Dynamic changes
Real objects Optical tracking - Initialization -
Tracking
Basic layer Open GL Quicktime / Open GL Video
for Windows Mac OS 10 / Windows xx
TUM DWARF Project
STARS Device-Team
11
5. Virtual Objects

• Drawing as OpenGL routines (hardwired)
• On a black screen
• Within the real environment (tracked)
• Virtual objects in external representations
• Which ones? (VRML?)anchored animation
  externally controlled data
• Data input/parsing procedures

12
6. User Tracking

• Special image/scene markers
• Initial identification
• Fast tracking
• 3D calibration
• 3D tracking
• Model-based object recognition

13
7. Steps

• Discuss / plan / build a demonstration scenario
  (by Nov. 3).
• In parallel (November)
• Work on / familiarize yourself with the base
  system (Mac OS X, Camera, Quicktime).
• Generate a 3D model of the demostration scenario
  (virtual AND real objects) (OpenGL), show a
  dynamic visualization on a black screen.

14
7. Steps (cont.)

• In parallel (December)
• Consider 3D-modeling tools/file formats, explore
  options data input routines
• Start tracking work (2D image features, initially
  selected by mouse) sticky notes
• In parallel (January)
• Continue 3D modeling work (dynamic behav.?)
• Automatically detect image features, calibrate
  and track in 3D