image formation and camera design - university of …djacobs/cmsc426/slides/cameradesign.pdffall...
TRANSCRIPT
![Page 1: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/1.jpg)
Fall 2002 CMSC 828Z
Image Formation andCamera Design
Spring 2003 CMSC 426Jan Neumann
2/20/03
![Page 2: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/2.jpg)
Fall 2002 CMSC 828Z
Light is all around us!
From London & Upton, “Photography”
![Page 3: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/3.jpg)
Fall 2002 CMSC 828Z
Conventional camera design ...
Ken Kay, 1969 in “Light & Film”, TimeLife Publ.
![Page 4: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/4.jpg)
Fall 2002 CMSC 828Z
... is copying from human eyes!
From I.Rock,“Perception”
![Page 5: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/5.jpg)
Fall 2002 CMSC 828Z
Model: Pinhole Camera! Infinitely small
aperture ! infinite field of depth! Image is dim! Projection Equation:
![Page 6: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/6.jpg)
Fall 2002 CMSC 828Z
Sensor Response
! The response of a sensor is proportional to the radiance visible to the sensor.
![Page 7: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/7.jpg)
Fall 2002 CMSC 828Z
Measurement Equation
! Scene Radiance L(x,ω,t,λ)! Optics (x0,ω0) = T(x,ω,λ)! Pixel Response P(x,λ)! Shutter S(x,ω,t)
![Page 8: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/8.jpg)
Fall 2002 CMSC 828Z
Collection
! For a camera to be efficient, the pinhole is replaced by a lens.
! The lens redirectslight rays emanating from the object.
![Page 9: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/9.jpg)
Fall 2002 CMSC 828Z
Refraction
! Light slows down in materials.! Imagine a line of marching Girl Scouts . . .
Direction of travel
![Page 10: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/10.jpg)
Fall 2002 CMSC 828Z
“Girl Scouts in the Mud”
Mud
! As the marching line steps into the mud, they will slow down, depending on how thick the mud is.
![Page 11: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/11.jpg)
Fall 2002 CMSC 828Z
Wavefronts at Normal Angle of Incidence
![Page 12: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/12.jpg)
Fall 2002 CMSC 828Z
“Girl Scouts in Mud” at an Angle
! The direction of travel changes when the marching line hits the mud at a non-normal angle.
![Page 13: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/13.jpg)
Fall 2002 CMSC 828Z
Wavefront at Non-Normal Angle of Incidence
![Page 14: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/14.jpg)
Fall 2002 CMSC 828Z
Index of Refraction! Index of Refraction (n) is the ratio between the speed of
light in vacuum (c) and the speed of light in the medium (v).
n = c/v
Medium Index of RefractionVacuum 1 (exactly)Air 1.0003Water 1.33Glass 1.5Diamond 2.4
![Page 15: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/15.jpg)
Fall 2002 CMSC 828Z
Snell’s Law
AIRGLASS
normal
GLASS
AIR
! This change in direction is described by Snell’s Law
![Page 16: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/16.jpg)
Fall 2002 CMSC 828Z
Trigonometry Review
RULES THAT DEFINE SIN, COS, TAN of an ANGLE:
θAdjacentSide (x)
OppositeSide (y)
Hypotenuse (r)! sin(θ) = y/r (opp/hyp)! cos(θ) = x/r (adj/hyp)! tan(θ) = y/x (opp/adj)
![Page 17: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/17.jpg)
Fall 2002 CMSC 828Z
Snell’s Law
Snell’s Law: n1sinθ1= n2sinθ2
θ1
θ2
n2
n1
If θ1 and θ2 are small use 1st order approximation n1θ1= n2θ2 (known as paraxial raytracing)
![Page 18: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/18.jpg)
Fall 2002 CMSC 828Z
Refraction for Different Materials
45°
light
AIR
WATER
GLASS
DIAMOND32°
28°16°
![Page 19: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/19.jpg)
Fall 2002 CMSC 828Z
Convex LensImage sideObject side
! Image focal point, F’, is half the distance to the effective center of curvature of the lens.
! Object focal point, F, is exactly the same distance on the object side of the lens.
Axis of symmetry
F’
Light Rays
F
Lens
![Page 20: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/20.jpg)
Fall 2002 CMSC 828Z
Convex Lens
! Image focal length, f’, is the distance from the lens to the image focal point.
! Object focal length, f, is the distance from the lens to the object focal point.
F’
f’f
F
![Page 21: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/21.jpg)
Fall 2002 CMSC 828Z
Camera Parameters
! Field of view (film size, stops and pupils)
! Depth of field (aperture, focal length)
! Motion blur (shutter)! Exposure (film speed,
aperture, shutter)
![Page 22: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/22.jpg)
Fall 2002 CMSC 828Z
Depth of Field
! From London and Upton
![Page 23: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/23.jpg)
Fall 2002 CMSC 828Z
Circle of Confusion
![Page 24: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/24.jpg)
Fall 2002 CMSC 828Z
Thin Lens Camera
! Use lens to capture more light
! Limited Depth of Field
! Thin Lens Eq.:
! Circle of Confusion:
![Page 25: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/25.jpg)
Fall 2002 CMSC 828Z
Thin Lens Camera
! Thin Lens Eq.:
! Projection Eq.:
![Page 26: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/26.jpg)
Fall 2002 CMSC 828Z
Model: Pinhole Camera! Infinitely small
aperture ! infinite field of depth! Image is dim! Projection Equation:
![Page 27: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/27.jpg)
Fall 2002 CMSC 828Z
Thick Lens
! Cutaway section of a Vivitar Series 1 90 mm f 1/2.5 lensCover photo, Kingslake, Optics in Photography
![Page 28: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/28.jpg)
Fall 2002 CMSC 828Z
Thick Lens
Focal lengths are measured with respect to principal planes
![Page 29: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/29.jpg)
Fall 2002 CMSC 828Z
Thick Lens Camera
! A real lens has thickness
![Page 30: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/30.jpg)
Fall 2002 CMSC 828Z
Field of View
! From London and Upton
![Page 31: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/31.jpg)
Fall 2002 CMSC 828Z
Field of View
! From London and Upton
![Page 32: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/32.jpg)
Fall 2002 CMSC 828Z
Illuminance
! Illuminance is the rate of light falling on a given area (i.e. energy per unit time).
! Illuminance is controlled by aperture: a larger aperture brings more light to the focus.
Small aperture Large aperture
![Page 33: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/33.jpg)
Fall 2002 CMSC 828Z
Aperture
! Stops – physical limits! Pupils – logical limits for entering and exiting rays
![Page 34: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/34.jpg)
Fall 2002 CMSC 828Z
Aperture
![Page 35: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/35.jpg)
Fall 2002 CMSC 828Z
Exposure
cameraLens
Aperture Shutter
! Exposure is defined as the total amount of light falling on the film.
! Exposure = Illuminance * Time
![Page 36: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/36.jpg)
Fall 2002 CMSC 828Z
Exposure Time
! Exposure time is controlled by the shutter: when closed, the film is not exposed to light.
! Exposure time is simply the time interval between opening and closing the shutter.
Shutter Closed Shutter Open
![Page 37: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/37.jpg)
Fall 2002 CMSC 828Z
Types of Shutters
Focal Plane Shutter
Simplified Camera
Between the Lens (BTL) Or
Leaf Shutter
![Page 38: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/38.jpg)
Fall 2002 CMSC 828Z
BTL or Leaf Shutter
! Made of overlapping “leaves” that slide out of the way when shutter opens.
! Located between the imaging lens elements.CLOSED
OPEN
![Page 39: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/39.jpg)
Fall 2002 CMSC 828Z
BTL or Leaf Shutter
! Advantages! Uniform illumination independent of film size.! Entire film frame illuminated at once.
! Disadvantages! Illumination of frame not constant over time.! Limitations on shutter speed.
![Page 40: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/40.jpg)
Fall 2002 CMSC 828Z
Focal Plane Shutter
! Metal or fabric with a narrow slit opening which traverses the area to be exposed.
! Located just before the detector (film) at the focal plane.
![Page 41: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/41.jpg)
Fall 2002 CMSC 828Z
Focal Plane Shutter
! Advantages! Cost effective (one shutter needed for all lenses -
great for interchangeable lens systems)! Can achieve very fast shutter speeds (~1/10000
sec)! Disadvantages
! May cause time distortion if the film size is large (since the shutter slit must traverse the film)
![Page 42: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/42.jpg)
Fall 2002 CMSC 828Z
Why control exposure with aperture and shutter?! Flexibility!
! Fast shutter speed for freezing action (e.g. sports photography).
! Slow shutter speed for low light levels (e.g. sunsets).! Small aperture for bright scenes or to enable longer
exposures.! Large aperture for low light conditions (taking candle
lit or moon lit pictures).
![Page 43: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/43.jpg)
Fall 2002 CMSC 828Z
Aperture vs Shutter
! From London and Upton
![Page 44: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/44.jpg)
Fall 2002 CMSC 828Z
Image Irradiance and Exposure
! 1 stop doubles exposure ! interacts with depth of field
! Double shutter time doubles exposure! interacts with motion blur
![Page 45: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/45.jpg)
Fall 2002 CMSC 828Z
High Dynamic Range Imaging
! 16 photographs of stanfords memorial cathedral at 1 stop increments from 30s to 1/1000s
! From Debevec and Malik, High Dynamic Range Imaging
![Page 46: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/46.jpg)
Fall 2002 CMSC 828Z
Simulated HDR Image
![Page 47: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/47.jpg)
Fall 2002 CMSC 828Z
Dispersion
! Dispersion - Index of refraction, n, depends on the frequency (wavelength) of light.
Dispersion is responsible for the colors produced by a prism:red light “bends” less within the prism, while blue light “bends” more.
![Page 48: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/48.jpg)
Fall 2002 CMSC 828Z
Chromatic Aberration
! Dispersion results in a lens having different focal points for different wavelengths -this effect is called chromatic aberration.
! Results in a “halo” of colors.! Solution: Use 2 lenses of
different shape and material (“achromatic doublet”).
F’Red
.
Object (small dot) Image with chromatic aberration
F’Blue
White light
![Page 49: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/49.jpg)
Fall 2002 CMSC 828Z
Spherical Aberration
! All the rays do not bend toward the focal point, resulting in a blurred spot.
! Solution: use lenses with aspherical curvature, or use a compound lens.F’
.
Object (small dot) Image with spherical aberration
![Page 50: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/50.jpg)
Fall 2002 CMSC 828Z
Other Aberrations! Coma
! Off axis blur which looks like the “coma” of a comet.
! Astigmatism! Different focal lengths for
different planes.
! Distortion! Images formed out of
shape.
.
.
![Page 51: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/51.jpg)
Fall 2002 CMSC 828Z
So Far . . .
! AgX photographic film captures image formed by the optical elements (lens).
! Unfortunately, the processing for film is slow (among other disadvantages).
processing
image
cameraAgX film
image
camera
! Can we use something else to capture the image?
![Page 52: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/52.jpg)
Fall 2002 CMSC 828Z
Charge Coupled Device (CCD)
! CCD replaces AgX film
! Based on silicon chip
! Disadvantages vs. AgX:! Difficulty/cost of CCD manufacture; large
arrays are VERY expensive
! “Young” technology; rapidly changingLight Sensitive Area
![Page 53: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/53.jpg)
Fall 2002 CMSC 828Z
Basic structure of CCD
Image Image Capture Capture AreaArea
Rows
Divided into small elements called pixels (picture elements).
Shift Register
Voltageout
Columns preamplifier
![Page 54: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/54.jpg)
Fall 2002 CMSC 828Z
Magnified View of a CCD Array
Individual pixel element
CCD
CloseClose--up of a CCD Imaging Arrayup of a CCD Imaging Array
![Page 55: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/55.jpg)
Fall 2002 CMSC 828Z
Spatial Sampling
Scene Grid over scene Spatially sampled scene
! When a continuous scene is imaged on the array (grid) formed by a CCD , the continuous image is divided into discrete elements.
! The picture elements (pixels) thus captured represent a spatially sampled version of the image.
![Page 56: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/56.jpg)
Fall 2002 CMSC 828Z
Quantization
000000
000
000
002540
00
25
4040
25 252540 40
40 40 40
25 2540 40 4040 40 25
404040
64
6464
64
6464
64 64 64
64 64 64
97
9797
97
97150
97
9797
0 0 0 0 0 0
0 0 0 0 0 0
0000
0 00
0
Spatially sampled scene Numerical representation
! Spatially sampled image can now be turned into numbers according to the brightness of each pixel.
![Page 57: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/57.jpg)
Fall 2002 CMSC 828Z
Response of CCD
! The response of CCD is linear (i.e., if 1000 captured photons corresponds to a digital count of 4, then 2000 photons captured yields a digital count of 8)
! Linearity is critical for scientific uses of CCD
Log H
Den
sity
Response of photographicnegative
Exposure
Dig
ital C
ount
Response of CCD
![Page 58: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/58.jpg)
Fall 2002 CMSC 828Z
Image quality factors
! Two major factors which determine image quality are:! Spatial resolution -- controlled by spatial sampling.! Color depth -- controlled by number of colors or grey levels
allocated for each pixel ! Increasing either of these factors results in a larger
image file size, which requires more storage space and more processing/display time.
![Page 59: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/59.jpg)
Fall 2002 CMSC 828Z
CCDs as Semiconductors
! Conductors allow electricity to pass through. (Metals like copper and gold are conductors.)
! Insulators do not allow electricity to pass through. (Plastic, wood, and paper are insulators.)
! Some materials are halfway in between, called semiconductors.
Insulator Conductor
![Page 60: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/60.jpg)
Fall 2002 CMSC 828Z
Basic structure of a pixel in a CCD
! Silicon is a semiconductor.! Oxide layer is an insulator.! Metal gates are conductors.! Made with microlithographic process.! One pixel may be made up of two or more metal gates.
Silicon baseSilicon base
Metal gate
Oxide Layer
One pixel
![Page 61: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/61.jpg)
Fall 2002 CMSC 828Z
Photon/Silicon Interaction
e-e- Silicon
! Photon knocks off one of the electrons from the silicon matrix.! Electron “wanders around” randomly through the matrix.
! Electron gets absorbed into the silicon matrix after some period.
![Page 62: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/62.jpg)
Fall 2002 CMSC 828Z
Spectral Response (sensitivity) of a typical CCD
UV Visible Light IR
RelativeResponse
300 400 500 600 700 900800 1000Incident Wavelength [nm]
! Response is large in visible region, falls off for ultraviolet (UV) and infrared (IR)
![Page 63: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/63.jpg)
Fall 2002 CMSC 828Z
Goal of CCD
! Capture electrons formed by interaction of photons with the silicon
! Measure the electrons from each picture element as a voltage
CCDPhotons Electronic Signal
![Page 64: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/64.jpg)
Fall 2002 CMSC 828Z
Collection stage
! Voltage applied to the metal gates produces a depletion region in the silicon. (depleted of electrons)
! Depletion region is the “light sensitive” area where electrons formed from the photon interacting with the silicon base are collected.
Voltage
![Page 65: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/65.jpg)
Fall 2002 CMSC 828Z
Collection stage
! Electron formed in the silicon matrix by a photon.
e-e-e-
Voltage
! Electron wanders around the matrix.
! If the electron wanders into the depletion region, the electron is captured, never recombining with the silicon matrix.
![Page 66: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/66.jpg)
Fall 2002 CMSC 828Z
Collection
Light
! The number of electrons accumulated is proportional to the amount of light that hit the pixel.
! There is a maximum number of electron that these “wells” can hold.
e-e-e- e-e- e-e-e- e- e- e-
![Page 67: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/67.jpg)
Fall 2002 CMSC 828Z
Readout
! Now that the electrons are collected in the individual pixels, how do we get the information out?
Alright! How do weget the electrons out?!
![Page 68: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/68.jpg)
Fall 2002 CMSC 828Z
Readout
! How do you access so much data efficiently? (i.e. a 1024 x 1024 CCD has 1,048,576 pixels!)! Possible solutions:
! 1. Have output for individual pixels.! Too many “wires”
! 2. Somehow move the charges across the CCD array and read out one by one.
! Bucket Brigade
![Page 69: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/69.jpg)
Fall 2002 CMSC 828Z
Bucket Brigade
! By alternating the voltage applied to the metal gates, collected electrons may be moved across the columns.
e-e-e- e-e- e-e-e- e- e- e-e-
e-e- e-e-e-e- e-e- e- e-e-e-e- e-e-e- e-e- e-e- e-e- e-e-e-e-e- e-e- e-e- e-e- e- e-e-e-e-e-e- e-e- e-e- e- e-e-e-e-e-e- e-e- e-
![Page 70: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/70.jpg)
Fall 2002 CMSC 828Z
Bucket Brigade
! Charge is marched across the columns into the shift register, then read out 1 pixel at a time.
100 pixels
100 transfers200 transfers
Shift Register
100 pixels
100 transfers 1 transfer
![Page 71: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/71.jpg)
Fall 2002 CMSC 828Z
Converting Analog Voltages to Digital
! Analog voltage is converted to a digital count using an Analog-to-Digital Converter (ADC)! Also called a digitizer
! The input voltage is quantized:! Assigned to one of a set of discrete steps
! Steps are labeled by integers! Number of steps determined by the number of available bits
! Decimal Integer is converted to a binary number for computation
6.18 volts 01100101 (117)ADC
![Page 72: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/72.jpg)
Fall 2002 CMSC 828Z
Biological camera design is purposive camera design
“Landscape of Eye Evolution”from R. Dawkins’ “Climbing Mount Improbable”
![Page 73: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/73.jpg)
Fall 2002 CMSC 828Z
A biological camera
![Page 74: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/74.jpg)
Fall 2002 CMSC 828Z
A biological camera
![Page 75: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/75.jpg)
Fall 2002 CMSC 828Z
Omni-directional vision
![Page 76: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/76.jpg)
Fall 2002 CMSC 828Z
Light field cameras
Wilburn et al., ‘02From Levoy & Hanrahan “Light FieldRendering”, SIGGRAPH96
![Page 77: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/77.jpg)
Fall 2002 CMSC 828Z
Integral photography
! Integral photography(Lippman ’08, Ives ’30, Naemura `01)
![Page 78: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/78.jpg)
Fall 2002 CMSC 828Z
Plenoptic cameras
Adelson & Wang ’92 Farid & Simoncelli ’97
![Page 79: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/79.jpg)
Fall 2002 CMSC 828Z
Does a computer need to see the world with our eyes?
Example: Epipolar Image Volume
![Page 80: Image Formation and Camera Design - University Of …djacobs/CMSC426/Slides/CameraDesign.pdfFall 2002 CMSC 828Z Image quality factors! Two major factors which determine image quality](https://reader034.vdocuments.us/reader034/viewer/2022042116/5e9330eb4c864a39a20feb79/html5/thumbnails/80.jpg)
Fall 2002 CMSC 828Z
Does a computer need to see the world with our eyes?
Picture madeusing theVideoCubeprogramby M. Cohen