the generic sensor each photosite converts lightwave energy into photo- electrons pixels in the...
TRANSCRIPT
![Page 1: The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons](https://reader036.vdocuments.us/reader036/viewer/2022082816/56649cd95503460f949a379c/html5/thumbnails/1.jpg)
The Generic Sensor
Each photosite converts lightwave energy into photo-electrons
Pixels in the output image are a measure of the number of photo-electrons recorded at each photo site
Light wells
Sensors
Problem:
Since the sensor only records light intensity, we can’t differentiate between colors!
Thus, digital cameras only record in black and white
Solution:
Color filtering, the most common form being the Bayer filter
![Page 2: The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons](https://reader036.vdocuments.us/reader036/viewer/2022082816/56649cd95503460f949a379c/html5/thumbnails/2.jpg)
1) Designates individual photosites to be either red, green, or blue (RGB)
2) Respective color filters are placed over each photosite
3) Thus, only the light energy corresponding to that color’s wavelength reaches the sensor
4) Thus the sensor can interpret the energy recorded at that photosite to be a measure of that certain color
![Page 3: The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons](https://reader036.vdocuments.us/reader036/viewer/2022082816/56649cd95503460f949a379c/html5/thumbnails/3.jpg)
The Bayer Sensor
Light wells
Sensors
![Page 4: The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons](https://reader036.vdocuments.us/reader036/viewer/2022082816/56649cd95503460f949a379c/html5/thumbnails/4.jpg)
• Color offset- light not recorded at the same spot-Demosaic algorithms required to interpolate missing data
• Discards 2/3 of light information-3x longer shutter speed, 3x larger aperture, 3x higher ISO
Drawback
s of…
Actual Image
Raw Bayer Output
Demosiaced Bayer Output
![Page 5: The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons](https://reader036.vdocuments.us/reader036/viewer/2022082816/56649cd95503460f949a379c/html5/thumbnails/5.jpg)
Linear Scanning
Scans a scene with RGB linear sensors
Gets full light information
Slow, only works for static subjecs
Alternative Color Filtering Technologies
Bayer-like filters with different colors
RGBC
CYGM
Same problems as Bayer filter
Multi-shot approach
Take three shots, each with different color filter
Gets full light information
Only works for static subjects, since a moving scene would change between filter switches
![Page 6: The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons](https://reader036.vdocuments.us/reader036/viewer/2022082816/56649cd95503460f949a379c/html5/thumbnails/6.jpg)
Alternative Color Filtering Technologies in DevelopmentFoveon sensor
Uses vertically stacked RGB sensors
Collects all light at each location
Three-sensor
Commonly known as “3CCD”
Prism splits light, 3 sensors to record R,G,B
![Page 7: The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons](https://reader036.vdocuments.us/reader036/viewer/2022082816/56649cd95503460f949a379c/html5/thumbnails/7.jpg)
Color Temperature
Light sources can be approximated as “black bodies” of a certain temperature
Daylight: similar to 5000K black body (even light across the spectrum)Incandescent light: lower temperature (more red light, less blue)Shade/daylight: higher temperature (more blue light, less red)
Human vision system makes corrections for different light sourcesCameras aren’t so good at this
![Page 8: The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons](https://reader036.vdocuments.us/reader036/viewer/2022082816/56649cd95503460f949a379c/html5/thumbnails/8.jpg)
<- What we see
What cameras see ->(interpreting all wavelengths equally)
![Page 9: The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons](https://reader036.vdocuments.us/reader036/viewer/2022082816/56649cd95503460f949a379c/html5/thumbnails/9.jpg)
White Balancing
Auto-white balanceWhite balance presetColor temperatureCustom white balanceRAW adjustment
Last resort: color balance the JPEG