Projector with Radiometric Screen Compensation

1
Projector with Radiometric Screen Compensation

• Shree K. Nayar, Harish Peri
• Michael Grossberg, Peter Belhumeur

Computer Science Columbia University Procams
Workshop ICCV 2003, Nice, France
Support National Science Foundation
2
(No Transcript)
3
Projecting on Any Surface ?
4
(No Transcript)
5
Projector-Camera System
Textured Screen
Camera
Computer
Projector
6
Geometric Calibration
Projector Input
Camera Output
7
Projector-Camera Pipeline Radiometry
Screen
I
D
P
Display Device
Projector
E
What Display Image (I) will produce a Desired
Captured Image (M) ?
8
Radiometric Model (for each pixel)
I
D
Screen
P
Display Device
Projector
E
M
B
C
L
Capture Device
Camera
9
Finding the Model Parameters (at each pixel)
I
D
Screen
P
Display Device
Projector
E
M
B
C
L
Capture Device
Camera
10
Finding the Color Mixing Matrix
11
Color Mixing V Matrices
12
Radiometric Calibration Color
Projector Input
Camera Output
13
Color Experiment
Texture of Screen
14
Face Image on Checkerboard Screen
Original (desired) image (I)
Uncompensated output (M)
15
Face Video on Brick Texture
Normal Projector
Projector With Compensation
16
Scene Video on Brick Texture
Normal Projector
Projector With Compensation
17
Face Video on Butterfly Poster
Normal Projector
Projector With Compensation
18
Summary

• Radiometric Model for Projector-Camera System

• Off-Line Method for Radiometric Calibration

• On-Line Algorithm for Screen Compensation

• Refinement using Continuous Feedback