Image-processing

1
Image-processing Technologies for Digital
Content Creation
Luc.robert_at_autodesk.com
2
CORPORATE INFORMATION

• REALVIZ Founded March 98
• Exclusive technology from INRIA Sophia-Antipolis
• Technology from the Robotvis group
• Headquarters and RD in Sophia Antipolis,
  Southern France
• 90 of revenue outside France, 50 in the USA
• Just acquired by Autodesk (PSEB division)

3
MISSION
Image-based technologies empower designers and
graphic artists to efficiently create the most
effective visual content based on digital
photographs and videos.
Post-production
Multimedia
Digital Imaging
Architecture
CAD
Video Games
Dinotopia - Courtesy of Framestore CFC Monkey
Courtesy of Quiet Man
4
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
5
PANORAMIC PHOTOGRAPHY
Panoramic Photography
6
IMAGE STITCHING

• Creation of panoramic images up to full spheres
  (360 horizontal by 180 vertical) fully
  automatic
• Thousands users professional photographers,
  digital imaging hobbyists, multimedia web
  designers, architects, post-production artists

7
FULL SPHERICAL PANORAMAS
Click inside to see the full screen, full
spherical QuickTime VR Panorama Courtesy of VR Way
8
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
9
IMAGE BASED MODELING
Bridging the gap between 2D and 3D
Image Based Modeling
10
IMAGE BASED MODELING

• Creation of 3D photo-textured objects from
  photographs
• (1 to many)
• Applications
• Virtual reality 3D Simulation/Storytelling
• Urban planning perspective matching for 3D CAD
  models
• Photogrammetry
• Video games
• 3D animation special effects

11
IMAGE BASED MODELING
12
IMAGE BASED MODELING
more demos
13
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
14
SPECIAL EFFECTS
SFX Solutions
15
CAMERA TRACKING
Before
After
Camera path 3D points extracted with
MatchMover
3D content Rendered in 3D animation software
Click inside to see the movie.
Click inside to see the movie.
Click inside to see the movie. Courtesy of
Platige Image 2005
Click inside to see the movie. Courtesy of
Platige Image 2005
16
CAPTURING 3D RIGID MOTION

• Feature points are extracted and tracked across
  sequences
• Based on parallax and rigidity (epipolar
  geometry), the algorithm extracts
• Camera path and parameters (zoom, distortion)
  over time
• 3D point coordinates

• Ready for 2D/3D video-montage all in one click!

17
SOME MOVIES
18
USE CASES
Panoramic Photography
Image Based Modeling
SFX Solutions
Motion Capture
19
MOTION CAPTURE
Motion Capture
20
VIDEO-BASED MOCAP
Capture non-rigid 3D motion from several videos
21
VIDEO-BASED MOCAP

• Video-based motion capture solution
• Applications animation, bio-medical,
  ergonomyetc
• Covering facial, full body, and on-set mocap
• Total flexibility
• From 2 cameras to as many as needed
• Cameras can fixed or moving.
• Cameras can be of different frame rate and
  different definitions.
• No need for a motion capture studio
• Computed data
• Tracked 3D points
• Camera data

22
VIDEO-BASED MOCAP
23
MATCHMOVING
FROM RIGID MOTION
One moving camera observing a rigid scene
Parallax (i.e relative 2D image motion) allows
recovering 3D camera motion and scene structure
N
1
..t..
24
TO NON-RIGID MOTION

• Several synchronous cameras are used
• Same geometric problem as matchmoving at each
  time

25
VIDEO-BASED MOCAP
Result
26
ON-SET MOCAP

• All sequences shot with
• - 2 fixed cameras HD digital (1920x1080)
• 1 mobile camera (the main shooting cam) film,
  scanned at 2048x1536

Result
27
QA