exploiting temporal coherence for incremental all-frequency relighting ryan overbeckravi ramamoorthi...
Post on 15-Jan-2016
219 views
TRANSCRIPT
![Page 1: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/1.jpg)
Exploiting Temporal Coherence for Incremental All-Frequency Relighting
Ryan Overbeck Ravi Ramamoorthi
Aner Ben-Artzi Eitan Grinspun
Columbia University
Ng et al. 2003 Our Method
30 Wavelet lights per frame
![Page 2: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/2.jpg)
CG Lighting Design
Doom 3 2004 (
www.doom3.com)
Unreal Championship 2 2004 (
www.unrealchampionship2.com)
The Lord of the Rings: The Two Towers 2002 (www.lordoftherings.net)
Star Wars Episode I 1999 (
thecia.com.au/reviews/s/star-wars-1.shtml)
Video Games Movies
![Page 3: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/3.jpg)
CG Lighting Design: Why is it hard?
Complex Lighting
Complex Materials
Takes Hours to Render
Need Interactivity
PRT
Sloan et al. 2002
Ng et al. 2003
Hard Shadows
Soft Shadows
Specularities
/ Reflections
Caustics
![Page 4: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/4.jpg)
PRT Relighting: Matrix-Vector Multiply
1
2
3
N
P
P
P
P
11 12 11
21 22 22
31 32 3
1 2
M
M
M
NN N NM
T T TL
T T TL
T T T
LT T T
Slides from Ng et al. SIGGRAPH 2003
![Page 5: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/5.jpg)
PRT Relighting: Matrix-Vector Multiply
1
2
3
N
P
P
P
P
11 12 11
21 22 22
31 32 3
1 2
M
M
M
NN N NM
T T TL
T T TL
T T T
LT T T
Input Lighting(Cubemap Vector)
Output Image(Pixel Vector)
TransportMatrix
Slides from Ng et al. SIGGRAPH 2003
![Page 6: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/6.jpg)
Light-Transport Matrix Columns
11 12 1
21 22 2
31 32 3
1 2
M
M
M
N N NM
T T T
T T T
T T T
T T T
Slides from Ng et al. SIGGRAPH 2003
![Page 7: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/7.jpg)
Light-Transport Matrix Columns
11 12 1
21 22 2
31 32 3
1 2
M
M
M
N N NM
T T T
T T T
T T T
T T T
11 12 1
21 22 2
31 32 3
1 2
M
M
M
N N NM
T T T
T T T
T T T
T T T
11 12 1
21 22 2
31 32 3
1 2
M
M
M
N N NM
T T T
T T T
T T T
T T T
Slides from Ng et al. SIGGRAPH 2003
![Page 8: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/8.jpg)
Matrix Multiplication is Enormous
Dimension
512 x 512 pixel images ( )
6 x 64 x 64 cubemap ( )
Full matrix-vector multiplication is intractable
On the order of 1010 operations per frame
PRT exploits coherence to enable real-time rendering
B T L
LB
Slides from Ng et al. SIGGRAPH 2003
![Page 9: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/9.jpg)
L~
Signal / Spatial Coherence[Sloan et al. 2003]
[Liu et al. 2004]
PRT: Exploiting Coherence
Image / Vertex Colors
Transport Matrix Lighting Vector
Angular Coherence[Ng et al. 2003]
30 – 100 Wavelet Lights
Temporal Coherence[Our Contribution]B T L
![Page 10: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/10.jpg)
Previous Work: PRT
Dorsey, J., Arvo, J., and Greenberg, D. 1995. Interactive Design of Complex Time-Dependent Lighting. In IEEE Computer Graphics and Applications, 15(2): 26-36.
Ng R., Ramamoorthi R., Hanrahan P. All-frequency shadows using non-linear wavelet lighting approximation. ACM TOG(SIGGRAPH 03) 22, 3 (2003), 376-381.
Sloan, P., Kautz, J., Snyder, J. Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Environments. In Proceedings of SIGGRAPH 2002
Ng R., Ramamoorthi R., Hanrahan P. Triple product wavelet integrals for all-frequency relighting. ACM TOG (SIGGRAPH 04) 23, 3 (2004), 475-485.
Sloan P., Hall J., Hart. J, Snyder J. Clustered principal components for precomputed radiance transfer. ACM TOG (SIGGRAPH 03) 22, 3 (2003), 382-391.
Sloan P., Luna B., Snyder J. Local, deformable precomputed radiance transfer. ACM TOG (SIGGRAPH 05) 24, 4 (2005), 1216-1224.
Wang R., Tran J., Luebke D. All-frequency relighting of non-diffuse objects using separable BRDF approximation. In EGSR (2004), pp.345-354.
Wang R., Tran J., Luebke D. All-frequency interactive relighting of translucent objects with single and multiple scattering. ACM TOG (SIGGRAPH 05) 24, 3 (2005), 1202-1207.
Zhou K., Hu Y., Lin S., Guo B., Shum H. Precomputed shadow fields for dynamic scenes. ACM TOG (SIGGRAPH 05) 25, 3 (2005).
Ben-Artzi A., Overbeck R., Ramamoorthi R. Real-time BRDF editing in complex lighting. ACM TOG (SIGGRAPH 06) (2006).
Wang R., Luebke D., Humphreys G., Ng R. Efficient wavelet rotation for environment map rendering. In EGSR (2006).
Kontkanen J., Turquin E., Holzschuch N., Sillion F. Wavelet radiance transport for real-time indirect lighting. In EGSR (2006)
Einarsson P., Chabert C., Jones A., Lamond B., Ma A., Hawkins T., Sylwan S., Debevec P. Relighting human locomotion with flowed
reflectance fields. In EGSR (2006)
This Session
![Page 11: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/11.jpg)
Previous Work: PRT
Dorsey, J., Sillion, F., and Greenberg, D. 1991. Design and simulation of opera lighting and projection effects. In Computer Graphics (Proceedings of SIGGRAPH 91), vol. 25, 41-50.
Ng R., Ramamoorthi R., Hanrahan P. All-frequency shadows using non-linear wavelet lighting approximation. ACM TOG(SIGGRAPH 03) 22, 3 (2003), 376-381.
Sloan, P., Kautz, J., Snyder, J. Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Environments. In Proceedings of SIGGRAPH 2002
Ng R., Ramamoorthi R., Hanrahan P. Triple product wavelet integrals for all-frequency relighting. ACM TOG (SIGGRAPH 04) 23, 3 (2004), 475-485.
Sloan P., Hall J., Hart. J, Snyder J. Clustered principal components for precomputed radiance transfer. ACM TOG (SIGGRAPH 03) 22, 3 (2003), 382-391.
Sloan P., Luna B., Snyder J. Local, deformable precomputed radiance transfer. ACM TOG (SIGGRAPH 05) 24, 4 (2005), 1216-1224.
Wang R., Tran J., Luebke D. All-frequency relighting of non-diffuse objects using separable BRDF approximation. In EGSR (2004), pp.345-354.
Wang R., Tran J., Luebke D. All-frequency interactive relighting of translucent objects with single and multiple scattering. ACM TOG (SIGGRAPH 05) 24, 3 (2005), 1202-1207.
Zhou K., Hu Y., Lin S., Guo B., Shum H. Precomputed shadow fields for dynamic scenes. ACM TOG (SIGGRAPH 05) 25, 3 (2005).
Ben-Artzi A., Overbeck R., Ramamoorthi R. Real-time BRDF editing in complex lighting. ACM TOG (SIGGRAPH 06) (2006).
Wang R., Luebke D., Humphreys G., Ng R. Efficient wavelet rotation for environment map rendering. In EGSR (2006).
Kontkanen J., Turquin E., Holzschuch N., Sillion F. Wavelet radiance transport for real-time indirect lighting. In EGSR (2006)
Einarsson P., Chabert C., Jones A., Lamond B., Ma A., Hawkins T., Sylwan S., Debevec P. Relighting human locomotion with flowed
reflectance fields. In EGSR (2006)
This Session
L~ Temporal Coherence
[Our Contribution]B T
![Page 12: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/12.jpg)
Our Method
![Page 13: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/13.jpg)
Outline
Motivation / Previous Work
Basic Approach to Incremental Relighting
Analysis of Temporal Coherence in Lighting
Per-Band Incremental
Results
![Page 14: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/14.jpg)
ΔB ΔL
Basic Incremental Algorithm
B T LtB T tL
1tB T 1tL
![Page 15: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/15.jpg)
B
Basic Incremental Algorithm
ΔB ΔL TT L
![Page 16: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/16.jpg)
B
Basic Incremental Algorithm
ΔLTΔL tL 1tL~More
Compressible
![Page 17: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/17.jpg)
(Approx
B
Basic Incremental Algorithm
ΔLTΔL tL 1tL~ )~
~
![Page 18: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/18.jpg)
Basic Incremental
B T ΔL~
![Page 19: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/19.jpg)
Basic Incremental: Problems
Reference Incremental
Frame 0
![Page 20: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/20.jpg)
Basic Incremental: Problems
Reference Incremental
Frame 30
![Page 21: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/21.jpg)
Basic Incremental: Problems
Reference Incremental
Frame 75
Ghost Shadows
![Page 22: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/22.jpg)
Basic Incremental: Problems
Reference Incremental
Frame 125
![Page 23: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/23.jpg)
Basic Incremental: Problems
Reference Incremental
Frame 400
![Page 24: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/24.jpg)
Outline
Motivation / Previous Work
Basic Approach for Incremental Relighting
Analysis of Temporal Coherence in Lighting
Per-Band Incremental
Results
![Page 25: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/25.jpg)
Medium FrequencyLow Frequency
2tL
Frequency Analysis of Temporal Coherence
1tL
3tL
High Frequency
![Page 26: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/26.jpg)
Medium FrequencyLow Frequency
2tL
Frequency Analysis of Temporal Coherence
1tL
3tL
High Frequency
![Page 27: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/27.jpg)
Medium FrequencyLow Frequency
Frequency Analysis of Temporal Coherence
High Frequency
1t
2t
3t
![Page 28: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/28.jpg)
Low Frequency Medium Frequency
Frequency Analysis of Temporal Coherence
High Frequency
1t
2t
3t
2t 1t
![Page 29: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/29.jpg)
Low Frequency Medium Frequency
Frequency Analysis of Temporal Coherence
High Frequency
1t
2t
3t
2t 1t
![Page 30: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/30.jpg)
Frequency Analysis of Temporal Coherence
Medium FrequencyLow Frequency High Frequency
Tem
pora
l W
avele
t Tra
nsfo
rm
![Page 31: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/31.jpg)
Frequency Analysis of Temporal Coherence
Medium FrequencyLow Frequency High Frequency
Tem
pora
l W
avele
t Tra
nsfo
rm
![Page 32: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/32.jpg)
Frequency Analysis of Temporal Coherence
Angular Frequency
Tem
pora
l Fre
qu
en
cy
100 %
0 %
ENERGY
![Page 33: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/33.jpg)
Outline
Motivation / Previous Work
Basic Approach for Incremental Relighting
Analysis of Temporal Coherence in Lighting
Per-Band Incremental
Results
![Page 34: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/34.jpg)
B = + +
Non-Incremental
B = T L1 1
B = T L22
B = T L3 3
B = T LIncremental+
Incremental+
1B 2B 3B
Per-Band Incremental (PBI)
. . ....
![Page 35: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/35.jpg)
Exhaustive
Try all combinations over all wavelet bands.
Very Slow.
Simple
Compare L1 Error in each band individually.
Oracle (Incremental or Not)
![Page 36: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/36.jpg)
Exhaustive
Try all combinations over all wavelet bands.
Very Slow.
Simple
Compare L1 Error in each band individually.
Oracle (Incremental or Not)
L1 DistanceL1 Distance
IncrementalNon-Incremental
![Page 37: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/37.jpg)
Oracle (Incremental or Not)
L1 DistanceL1 Distance
< or >
IncrementalNon-Incremental
Exhaustive
Try all combinations over all wavelet bands.
Very Slow.
Simple
Compare L1 Error in each band individually.
Almost zero overhead.
Comparable results to Exhaustive.
![Page 38: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/38.jpg)
PBI vs. Basic Incremental
![Page 39: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/39.jpg)
Outline
Motivation / Previous Work
Basic Approach for Incremental Relighting
Analysis of Temporal Coherence in Lighting
Per-Band Incremental
Results
![Page 40: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/40.jpg)
Results
![Page 41: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/41.jpg)
Results
![Page 42: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/42.jpg)
Results
Per-Band Incremental 30 Wavelets16
14
13
12
15
55 70 85Frame
Perc
en
tag
e L
1 E
rror
Simple
Exhaustive
![Page 43: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/43.jpg)
Results
![Page 44: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/44.jpg)
Results
![Page 45: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/45.jpg)
Results
![Page 46: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/46.jpg)
Results
![Page 47: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/47.jpg)
Per-Band Incremental
3x – 4x Speed / Quality Improvement
Progressively Convergent
Minimal Overhead
![Page 48: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/48.jpg)
Minimal Overhead
~ 100 Lines of Code (Pseudo-code in paper).
< 10 % Memory Overheads
Speed:
Average case (30 wavelets): 5 % Overhead
![Page 49: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/49.jpg)
Applies to All (?) Wavelet PRT Frameworks
Old PRT
Standard All-Frequency PRT [Ng et al. 2003]
Current PRT
Clustered PCA [Liu et al. 2004]
Changing View with Separable BRDF Approximation [Wang et al. 2004]
Future PRT
Real-time BRDF Editing [Ben-Artzi et al. SIGGRAPH 2006]
![Page 50: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/50.jpg)
PBI: CPCA and Complex BRDFs
![Page 51: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/51.jpg)
Future
Temporal Coherence
PRT Animation.
Beyond PRT.
B T L
![Page 52: Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649d5e5503460f94a3d0fa/html5/thumbnails/52.jpg)
Acknowledgments
Ren Ng for wavelet relighting framework code and slides from SIGGRAPH 2003.
Microsoft / Sloan et al. for Spherical Harmonics relighting framework in DirectX SDK.
This research was funded in part by a Sloan Research Fellowship and NSF grants #0305322 and #0446916.
Londa Fiorella for getting me here.
Thank you!