Tour Into the Picture and Tour Into the Panoramic Picture

1
Tour Into the Picture andTour Into the
Panoramic Picture

• Hyung Woo Kang
• CS Dept., KAIST

2
Contents

• Introduction
• Overview
• Tour Into the Picture (TIP)
• Tour Into the Panoramic Picture (TIPP)
• Results
• Conclusions and Future work

• H. Kang, S. Pyo, K. Anjyo, and S. Shin
• Tour Into the Picture using a Vanishing Line and
  its extension to Panoramic Images,
• to appear in Eurographics 2001 conference
  proceedings

3
Introduction (1/3)

• Tour Into the Picture (TIP) Horry97
• Input A single image
• Output Walk-through image sequence

Input
Output
4
Introduction (2/3)

• Spidery Mesh Horry97

5
Introduction (3/3)

• Limitations
• Spidery Mesh is not suitable for
• Image with multiple vanishing points
• Image with no clear vanishing points
• Panoramic images

6
Overview

• Process flow diagram

Scene model
Vanishing line specification
Background model
Foreground model
Output images
Camera positioning Rendering
Input image
Foreground objects segmentation
Background image
Foreground images
Texture images
7
Background model (1/3)

• Vanishing point vs. Vanishing line

8
Background model (2/3)

• Vanishing-line-based background model

Vanishing line
Vanishing point
1
3
3
1
Back plane
5
5
6
6
Ground plane
2
2
4
4
Input image
Background model
9
Background model (3/3)

• Vertex coordinates computation

Back plane (at infinity)
Zd
3
1
Image
3
y
6
1
Background model
6
x
z
5
O (camera)
5
4(4)
Ground plane
2(2)
10
Foreground model (1/2)

• Vertex coordinates computation

Background model
Image
O
11
Foreground model (2/2)

• Hierarchical structure
• Multi-layered foreground objects
• Separate foreground image for each object
• Inpainting techniques Efros99Bertalmio2000

1
0
FG3
FG2
FG1
FG1
FG2
FG3
12
Rendering

• Obtaining color for each output pixel
• Avoid double perspective correction

Scene model
Projection
Output image
Camera
Reference image
Color
13
TIPP (1/4)

• Conventional Panoramic image viewers
• QuickTime VR, Real VR, SmoothMove, iPic, etc.
• Provides camera rotation only

Base sphere
Base cylinder
14
TIPP (2/4)

• Vanishing circle

Base sphere
Vanishing circle
Vanishing point
Horizon plane
Eye
B
A
B
A
Ground plane
15
TIPP (3/4)

• Background model

z
Back hemisphere
Base sphere
Vanishing circle
O
x
y
Ground plane
16
TIPP (4/4)

• Foreground model

Back hemisphere
Base sphere
A
B
B
A
O
Ground plane
17
Results (1/6)

• Image with a clear vanishing line

18
Results (2/6)

• Image with a clear vanishing point

19
Results (3/6)

• Image with multiple vanishing points

20
Results (4/6)

• Image with no clear vanishing points or lines

21
Results (5/6)

• Spherical panoramic image

22
Results (6/6)

• Cylindrical panoramic image

23
Conclusions and Future work

• General modeling scheme for TIP
• Based on a Vanishing line
• Covers a broader class of input images
• Extension to Panoramic Images
• Based on a Vanishing circle
• Provides camera translation as well as rotation
• Future work
• Extension to Video sequence