cpsc 641: computer graphics image formation jinxiang chai
TRANSCRIPT
![Page 1: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/1.jpg)
CPSC 641: Computer GraphicsImage Formation
Jinxiang Chai
![Page 2: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/2.jpg)
Are They Images?
![Page 3: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/3.jpg)
Outline
• Color representation• Image representation• Pin-hole Camera• Projection matrix• Plenoptic function
![Page 4: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/4.jpg)
Outline
• Color representation• Image representation• Pin-hole Camera• Projection matrix• Plenoptic function
![Page 5: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/5.jpg)
Color Representation
• Why do we use RGB to encode pixel color?
• Can we use RGB to represent all colors?
• What are other color representations?
![Page 6: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/6.jpg)
Human Vision
Model of human vision
![Page 7: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/7.jpg)
Human Vision
Model of human vision
Vision components:
• Incoming light
• Human eye
![Page 8: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/8.jpg)
Electromagnetic Spectrum
Visible light frequencies range between:– Red: 4.3X1014 hertz (700nm)– Violet: 7.5X1014 hertz (400nm)
![Page 9: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/9.jpg)
Visible Light
The human eye can see “visible” light in the frequency between 400nm-700nm
![Page 10: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/10.jpg)
Visible Light
The human eye can see “visible” light in the frequency between 400nm-700nm
400nm 700nm
![Page 11: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/11.jpg)
Visible Light
The human eye can see “visible” light in the frequency between 400nm-700nm
400nm 700nm
- Not strict boundary
- Some colors are absent (brown, pink)
![Page 12: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/12.jpg)
Spectral Energy Distribution
Three different types of lights
![Page 13: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/13.jpg)
Spectral Energy DistributionThe six spectra below look the same purple to
normal color-vision people
![Page 14: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/14.jpg)
Color Representation?
Why not all ranges of light spectrum are perceived?
So how to represent color?
- unique
- compact
- work for as many visible lights as possible
400nm 700nm
![Page 15: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/15.jpg)
Human Vision
Photoreceptor cells in the retina:
- Rods
- Cones
![Page 16: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/16.jpg)
Light Detection: Rods and Cones
Rods: -120 million rods in retina -1000X more light sensitive than Cones - Discriminate B/W brightness in low illumination - Short wave-length sensitive
Cons: - 6-7 million Cones in the retina - Responsible for high-resolution vision - Discriminate Colors - Three types of color sensors (64% red, 32%, 2% blue) - Sensitive to any combination of three colors
![Page 17: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/17.jpg)
Tristimulus of Color Theory
Spectral-response functions of each of the three types of cones
![Page 18: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/18.jpg)
Tristimulus of Color Theory
Spectral-response functions of each of the three types of cones
Can we use them to match any spectral color?
![Page 19: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/19.jpg)
Tristimulus of Color Theory
Spectral-response functions of each of the three types of cones
Color matching function based on RGB - any spectral color can be represented as a linear combination of
these primary colors
![Page 20: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/20.jpg)
Tristimulus of Color Theory
Spectral-response functions of each of the three types of cones
Color matching function based on RGB - any spectral color can be represented as a linear combination of
these primary colors
![Page 21: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/21.jpg)
Tristimulus of Color Theory
Spectral-response functions of each of the three types of cones
Color matching function based on RGB - any spectral color can be represented as a linear combination of
these primary colors
![Page 22: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/22.jpg)
Tristimulus Color Theory
So, color is psychological- Representing color as a linear combination of red, green, and
blue is related to cones, not physics
- Most people have the same cones, but there are some people who don’t – the sky might not look blue to them (although they will call it “blue” nonetheless)
- But many people (mostly men) are colorblind, missing 1,2 or 3 cones (can buy cheaper TVs)
![Page 23: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/23.jpg)
Additive and Subtractive Color
RGB color model CMY color model
Complementary color models: R=1-C; G = 1-M; B=1-Y;
White: [1 1 1]T
Green: [0 1 0];
White: [0 0 0]T
Green: [1 0 1];
![Page 24: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/24.jpg)
RGB Color Space
RGB cube– Easy for devices– Can represent all the colors?– But not perceptual– Where is brightness, hue and saturation?
red
green
blue
![Page 25: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/25.jpg)
Tristimulus
• Since 3 different cones, the space of colors is 3-dimensional.
• We need a way to describe color within this 3 dimensional space.
• We want something that will let us describe any visible color with additive combination…
![Page 26: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/26.jpg)
The CIE XYZ system
• CIE – Comission Internationale de l’Eclairage- International Commission on Illumination- Sets international standards related to light
• Defined the XYZ color system as an international standard in 1931
• X, Y, and Z are three Primary colors. - imaginary colors - all visible colors can be defined as an additive combination of
these three colors. - defines the 3 dimensional color space
![Page 27: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/27.jpg)
Chromaticity Diagram
• Project the X+Y+Z=1 slice along the Z-axis
• Chromaticity is given by the x, y coordinates
![Page 28: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/28.jpg)
CIE Perceptual Space
Which colors can RGB monitor displays?
![Page 29: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/29.jpg)
Monitor/Print/Scanner Gamut
![Page 30: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/30.jpg)
HSV Color Model
Perceptually appropriate:- Hue: the color type (0-360 deg)
- Saturation: the intensity of the color (0-100%)
- Brightness: the brightness of color (0-100%)
Nonlinear transform between the HSV and RGB space
![Page 31: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/31.jpg)
Outline
• Color representation• Image representation• Pin-hole Camera• Projection matrix• Plenoptic function
![Page 32: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/32.jpg)
Image Representation
An image is a 2D rectilinear array of Pixels
- A width X height array where each entry of the array stores a single pixel
![Page 33: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/33.jpg)
Image Representation
A pixel stores color information
Luminance pixels - gray-scale images (intensity images) - 0-1.0 or 0-255 - 8 bits per pixel
Red, green, blue pixels (RGB) - Color images - Each channel: 0-1.0 or 0-255 - 24 bits per pixel
![Page 34: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/34.jpg)
Image Representation
An image is a 2D rectilinear array of Pixels
- A width X height array where each entry of the array stores a single pixel
- Each pixel stores color information
(255,255,255)
![Page 35: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/35.jpg)
Outline
• Color representation• Image representation• Pin-hole Camera• Projection matrix• Plenoptic Function
![Page 36: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/36.jpg)
How Do We See the World?
Let’s design a camera: idea 1: put a piece of film in front of camera
Do we get a reasonable picture?
![Page 37: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/37.jpg)
Pin-hole Camera
• Add a barrier to block off most of the rays– This reduces blurring– The opening known as the aperture– How does this transform the image?
![Page 38: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/38.jpg)
Camera Obscura
• The first camera– Known to Aristotle– Depth of the room is the focal length– Pencil of rays – all rays through a point
![Page 39: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/39.jpg)
Camera Obscura
How does the aperture size affect the image?
![Page 40: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/40.jpg)
Shrinking the Aperture
• Why not make the aperture as small as possible?– Less light gets through– Diffraction effects…
![Page 41: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/41.jpg)
Shrink the Aperture: Diffraction
A diffuse circular disc appears!
![Page 42: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/42.jpg)
Shrink the Aperture
![Page 43: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/43.jpg)
The Reason of Lenses
![Page 44: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/44.jpg)
Adding A Lens
• A lens focuses light onto the film– There is a specific distance at which objects are “in
focus”• other points project to a “circle of confusion” in the
image– Changing the shape of the lens changes this distance
“circle of confusion”
![Page 45: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/45.jpg)
Changing Lenses
28 mm 50 mm
210 mm70 mm
![Page 46: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/46.jpg)
Outline
• Color representation• Image representation• Pin-hole Camera• Projection matrix• Plenoptic Function
![Page 47: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/47.jpg)
Projection Matrix
• What’s the geometric relationship between 3D objects and 2D images?
![Page 48: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/48.jpg)
Modeling Projection: 3D->2D
The coordinate system– We will use the pin-hole model as an approximation– Put the optical center (Center Of Projection) at the origin– Put the image plane (Projection Plane) in front of the COP– The camera looks down the negative z axis
![Page 49: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/49.jpg)
Modeling Projection: 3D->2D
Projection equations– Compute intersection with PP of ray from (x,y,z) to
COP– Derived using similar triangles (on board)
![Page 50: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/50.jpg)
Modeling Projection: 3D->2D
Projection equations– Compute intersection with PP of ray from (x,y,z) to
COP– Derived using similar triangles (on board)
– We get the projection by throwing out the last coordinate:
![Page 51: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/51.jpg)
Homogeneous Coordinates
Is this a linear transformation?– no—division by z is nonlinear
![Page 52: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/52.jpg)
Homogeneous Coordinates
Is this a linear transformation?
Trick: add one more coordinate:
homogeneous image coordinates
homogeneous scene coordinates
– no—division by z is nonlinear
![Page 53: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/53.jpg)
Homogeneous Coordinates
Is this a linear transformation?
Trick: add one more coordinate:
homogeneous image coordinates
homogeneous scene coordinates
Converting from homogeneous coordinates
– no—division by z is nonlinear
![Page 54: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/54.jpg)
Perspective Projection
divide by third coordinate
Projection is a matrix multiply using homogeneous coordinates:
![Page 55: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/55.jpg)
Perspective Projection
divide by third coordinate
This is known as perspective projection– The matrix is the projection matrix– Can also formulate as a 4x4
Projection is a matrix multiply using homogeneous coordinates:
divide by fourth coordinate
![Page 56: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/56.jpg)
Perspective Effects
Distant object becomes small
The distortion of items when viewed at an angle (spatial foreshortening)
![Page 57: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/57.jpg)
Perspective Effects
Distant object becomes small
The distortion of items when viewed at an angle (spatial foreshortening)
![Page 58: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/58.jpg)
Perspective Effects
Distant object becomes small
The distortion of items when viewed at an angle (spatial foreshortening)
![Page 59: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/59.jpg)
Parallel ProjectionSpecial case of perspective projection
– Distance from the COP to the PP is infinite
– Also called “parallel projection”– What’s the projection matrix?
Image World
![Page 60: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/60.jpg)
Weak-perspective Projection
Scaled orthographic projection
- object size is small as compared to the average distance from the camera z0 (e.g.σz < z0/20)
- d/z ≈ d/z0 (constant)
![Page 61: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/61.jpg)
Weak-perspective Projection
Scaled orthographic projection
- object size is small as compared to the average distance from the camera z0 (e.g.σz < z0/20)
- d/z ≈ d/z0 (constant)
Projection matrix: λ
λ
d z0
![Page 62: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/62.jpg)
Spherical Projection
What if PP is spherical with center at COP?
In spherical coordinates, projection is trivial:
Note: it doesn’t depend on focal length d!
![Page 63: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/63.jpg)
View Transformation
From world coordinate to camera coordinate
P
![Page 64: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/64.jpg)
View Transformation
From world coordinate to camera coordinate
P
![Page 65: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/65.jpg)
Viewport Transformation
x
y
u
vu0, v0
From projection coordinate to image coordinate
![Page 66: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/66.jpg)
Viewport Transformation
x
y
u
vu0, v0
u0
v0
100
-sy0
sx 0u
v
1
x
y
1
From projection coordinate to image coordinate
![Page 67: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/67.jpg)
Putting It Together
From world coordinate to image coordinate
u0
v0
100
-sy0
sx 0u
v
1
Perspective projection
View transformation
Viewport projection
![Page 68: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/68.jpg)
Putting It Together
From world coordinate to image coordinate
u0
v0
100
-sy0
sx 0u
v
1
Perspective projection
View transformation
Viewport projection
Image resolution, aspect ratio
Focal length The relative position & orientation between camera and objects
![Page 69: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/69.jpg)
Camera Parameters
Totally 11 parameters,
u0
v0
100
-sy0
sx 0u
v
1
![Page 70: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/70.jpg)
Camera Parameters
Totally 11 parameters,
u0
v0
100
-sy0
sx 0u
v
1
Intrinsic camera parameters
extrinsic camera parameters
![Page 71: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/71.jpg)
How about this image?
![Page 72: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/72.jpg)
Outline
• Color representation• Image representation• Pin-hole Camera• Projection matrix• Plenoptic function
![Page 73: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/73.jpg)
Plenoptic Function
What is the set of all things that we can ever see?
- The Plenoptic Function (Adelson & Bergen)
![Page 74: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/74.jpg)
Plenoptic Function
What is the set of all things that we can ever see?
- The Plenoptic Function (Adelson & Bergen)
Let’s start with a stationary person and try to parameterize everything that he can see…
![Page 75: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/75.jpg)
Plenoptic Function
Any ray seen from a single view point can be parameterized by (θ,φ).
![Page 76: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/76.jpg)
Color Image
is intensity of light – Seen from a single view point (θ,φ)– At a single time t– As a function of wavelength λ
P(θ,φ,λ)
![Page 77: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/77.jpg)
Dynamic Scene
is intensity of light – Seen from a single view point (θ,φ)– Over time t– As a function of wavelength λ
P(θ,φ,λ,t)
![Page 78: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/78.jpg)
Moving around A Static Scene
is intensity of light – Seen from an arbitrary view point (θ,φ)– At an arbitrary location (x,y,z)– At a single time t– As a function of wavelength λ
P(x,y,z,θ,φ,λ)
![Page 79: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/79.jpg)
Moving around A Dynamic Scene
is intensity of light – Seen from an arbitrary view point (θ,φ)– At an arbitrary location (x,y,z)– Over time t– As a function of wavelength λ
P(x,y,z,θ,φ,λ,t)
![Page 80: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/80.jpg)
Plenoptic Function
Can reconstruct every possible view, at every moment, from every position, at every wavelength
Contains every photograph, every movie, everything that anyone has ever seen! it completely captures our visual reality!
An image is a 2D sample of plenoptic function!
P(x,y,z,θ,φ,λ,t)
![Page 81: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/81.jpg)
How to “Capture” Orthographic Images
Rebinning rays forms orthographic images
![Page 82: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/82.jpg)
How to “Capture” Orthographic Images
Rebinning rays forms orthographic images
![Page 83: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/83.jpg)
How to “Capture” Orthographic Images
Rebinning rays forms orthographic images
![Page 84: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/84.jpg)
How to “Capture” Orthographic Images
Rebinning rays forms orthographic images
![Page 85: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/85.jpg)
How to “Capture” Orthographic Images
Rebinning rays forms orthographic images
![Page 86: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/86.jpg)
Multi-perspective ImagesRebinning rays forms multiperspective
images
![Page 87: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/87.jpg)
Multi-perspective ImagesRebinning rays forms multiperspective
images
……
![Page 88: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/88.jpg)
Multi-perspective Images
![Page 89: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/89.jpg)
Outline
• Color representation• Image representation• Pin-hole Camera• Projection matrix• Plenoptic Function
![Page 90: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/90.jpg)
They Are All Images
![Page 91: CPSC 641: Computer Graphics Image Formation Jinxiang Chai](https://reader030.vdocuments.us/reader030/viewer/2022032708/56649e7a5503460f94b7ac3a/html5/thumbnails/91.jpg)
Next lecture
Image sampling theory
Fourier Analysis