Image Formation: Optics and Imagers

1
Image FormationOptics and Imagers
Real world
Optics
Sensor
Acknowledgment some figures by B. Curless, E.
Hecht, W.J. Smith, B.K.P. Horn, and A. Theuwissen
2
Optics

• Pinhole camera
• Lenses
• Focus, aperture, distortion

3
Pinhole Camera

• Camera obscura known since antiquity

4
Pinhole Camera

• Camera obscura known since antiquity
• First recording in 1826 onto a pewterplate (by
  Joseph Nicéphore Niepce)

Pinhole camera
5
Pinhole Camera Limitations

• Aperture too big blurry image
• Aperture too small requires long exposure or
  high intensity
• Aperture much too small diffraction through
  pinhole ? blurry image

6
Lenses

• Focus a bundle of rays from a scene point onto a
  single point on the imager
• Result can make aperture bigger

7
Ideal Lenses

• Thin-lens approximation
• Gaussian lens law
• Real lenses and systems of lenses may be
  approximated by thin lenses if only paraxial rays
  (near the optical axis) are considered

1/do 1/di 1/f
8
Camera Adjustments

• Focus?
• Changes di
• Zoom?
• Changes f
• Iris?
• Changes aperture

9
Focus and Depth of Field

• For a given di, perfect focus at only one do
• In practice, focus is OK for somerange of depths
• Circle of confusion smaller than a pixel
• Better depth of field with smaller apertures
• Better approximation to pinhole camera

10
Field of View

• Q What does field of view of camera depend on?
• Focal length of lens
• Size of imager
• Object distance?

11
Computing Field of View
1/do 1/di 1/f
tan ? /2 ½ xo / do
xo / do xi / di
? 2 tan-1 ½ xi (1/f?1/do)
? ? xi / f
12
Aperture

• Controls amount of light
• Affects depth of field
• Affects distortion (since thin-lens approximation
  is better near center of lens)

13
Aperture

• Aperture typically given as f-number(also
  f-stops or just stops)
• What is f /4?
• Aperture is ¼ the focal length

14
Monochromatic Aberrations

• Real lenses do not follow thin lens approximation
  because surfaces are spherical (manufacturing
  constraints)
• Result thin-lens approximation only valid iff
  sin ? ? ?

15
Distortion

• Pincushion or barrel radial distortion
• Varies with placement of aperture

16
Distortion

• Varies with placement of aperture

17
Distortion

• Varies with placement of aperture

18
Distortion

• Varies with placement of aperture

19
First-Order Radial Distortion

• Goal mathematical formula for distortion
• If distortion is small, can be approximated by
  first-order formula
• Why (1 ? r2) and not (1 ? r)?

r r (1 ? r2) r ideal distance to center
of image r distorted distance to center of
image
20
Chromatic Aberration

• Due to dispersion in glass (focal length varies
  with the wavelength of light)
• Result color fringes near edges of image
• Correct by building lens systems with multiple
  kinds of glass

21
Correcting for Aberrations

• High-qualitycompound lensesuse multiplelens
  elements tocancel outdistortion
  andaberration
• Often 5-10 elements, more for extreme wide angle

22
Sensors

• Film
• Vidicon
• CCD
• CMOS

23
Vidicon

• Best-known in family of photoconductive video
  cameras
• Basically television in reverse

? ? ? ?
Scanning Electron Beam
Electron Gun
Lens System
Photoconductive Plate
24
MOS Capacitors

• MOS Metal Oxide Semiconductor

Gate (wire)
SiO2 (insulator)
p-type silicon
25
MOS Capacitors

• Voltage applied to gate repels positive holes
  in the semiconductor

10V

Depletion region (electron bucket)
26
MOS Capacitors

• Photon striking the material createselectron-hole
  pair

10V
Photon

?
?
?
?
?
?
?

27
Charge Transfer

• Can move charge from one bucket to another by
  manipulating voltages

28
CCD Architectures

• Linear arrays
• 2D arrays

29
Linear CCD

• Accumulate photons, then clock them out
• To prevent smear first move charge to opaque
  region, then clock it out

30
Full-Frame CCD

• Other arrangements to minimize smear

31
CMOS Imagers

• Recently, can manufacture chips that combine
  photosensitive elements and processing elements
• Benefits
• Partial readout
• Signal processing
• Eliminate some supporting chips ? low cost

32
Color

• 3-chip vs. 1-chip quality vs. cost

33
Video

• Depending on the scene, pictures updatedat 1570
  Hz. perceived as continuous
• Most video cameras use a shutter, so they are
  capturing for only part of a frame
• Short shutter less light, have to open aperture
• Long shutter more light, but motion blur
• Television uses interlaced video

34
Interlacing
These rows transmitted first
These rows transmitted 1/60 sec later
35
Television

• US NTSC standard
• Fields are 1/60 sec.
• 2 fields 1 frame ? frames are 1/30 sec.
• Each frame has 525 scanlines, of which
  approximately 480 are visible
• No discrete pixels along scanlines, but if pixels
  were square, there would be about 640 visible

36
Television

• NTSC standard
• Thus, an NTSC frame is about 640?480
• Color at lower resolution than intensity
• PAL standard
• Lower rate fields at 50 Hz. (frames at 25 Hz.)
• Higher resolution about 768?576