poisson image editing & terrain synthesis howard zhou jie sun...
TRANSCRIPT
![Page 1: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/1.jpg)
Poisson Image Editing& Terrain Synthesis
Howard Zhou Jie [email protected] [email protected]
2003 . 4.29
![Page 2: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/2.jpg)
Table of Contents
1. Introduction / motivation2. Poisson Image Editing3. Terrain Synthesis (Texture based methods)
4. Future work5. Conclusion
![Page 3: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/3.jpg)
Table of Contents
1. Introduction / motivation2. Poisson Image Editing3. Terrain Synthesis (Texture based methods)
4. Future work5. Conclusion
![Page 4: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/4.jpg)
Introduction / motivation
Poisson Image Editing Seamless
Texture based terrain synthesis Current method based on fractals Very limited control Terrain style adjusted by parameter tuning What if the user draws a rough sketch and
supply a height map and says: “I want this to be like this”
![Page 5: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/5.jpg)
Poisson Image Editing
Review
![Page 6: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/6.jpg)
Our implmentation
Matlab Sparse matrix PDF solver Use conjugate gradient solver
supplied by Matlab Can be faster if …
![Page 7: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/7.jpg)
Seamless insertion
![Page 8: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/8.jpg)
Inserting objects with holes
![Page 9: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/9.jpg)
Inserting transparent objects
![Page 10: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/10.jpg)
Texture flattening
Result directly related to Edge detection result
![Page 11: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/11.jpg)
Local illumination changes
alpha = 0.05beta = 0.2
alpha = 0.05beta = 0.4
![Page 12: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/12.jpg)
Seamless tiling
Good when seam is not significant Often needs to increase the contrast of
the result but don’t an automatic way, maybe use
histogram of the original image
![Page 13: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/13.jpg)
Seamless tiling
Good when the seam is not significant
![Page 14: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/14.jpg)
Seamless tiling
Show some more
![Page 15: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/15.jpg)
Seamless tiling
![Page 16: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/16.jpg)
Seamless tiling
![Page 17: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/17.jpg)
Seamless tiling
Contrast can be globally fixed
But how?
![Page 18: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/18.jpg)
Seamless tiling
Seams not good
Cannot be fixed
![Page 19: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/19.jpg)
Table of Contents
1. Introduction / motivation2. Poisson Image Editing3. Terrain Synthesis (Texture based methods)
4. Future work5. Conclusion
![Page 20: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/20.jpg)
Previous approachTexture based terrain synthesis
Current method based on fractals Very limited control Terrain style adjusted by parameter
tuning What if the user draws a rough
sketch and supply a height map and says: “I want this to be like this”
![Page 21: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/21.jpg)
Texture based terrain synthesis
1. Image analogy2. Texture synthesis on laplacian +
piecewise seamless tiling3. Graph cut / seamless tiling4. Separating the details
![Page 22: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/22.jpg)
Data: height map
![Page 23: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/23.jpg)
Display height map
![Page 24: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/24.jpg)
Image analogy
:
::
:
A A' B B'
A. Hertzmann, C. Jacobs, N. Oliver, B. Curless, D. Salesin.SIGGRAPH 2001
![Page 25: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/25.jpg)
Texture by number
![Page 26: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/26.jpg)
Texture by number
![Page 27: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/27.jpg)
How do we get (A) automatically
Blurring (filtering) Texture flattening using edge
detection result or contour
![Page 28: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/28.jpg)
Image analogy + (texture flattening + blurring)
![Page 29: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/29.jpg)
Laplacian Synthesis
Regard laplacian as a particular texture
Texture synthesisIntegrate
![Page 30: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/30.jpg)
Results
![Page 31: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/31.jpg)
Terrain
![Page 32: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/32.jpg)
Terrain
![Page 33: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/33.jpg)
Problems & possible solutions
Depend on the boundary conditionsUse the boundary attached to the
Laplacian
There is only one unique solution of this linear system
Lost the power of Poisson editingShould use a non-conservative
gradient field
![Page 34: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/34.jpg)
Graph cut + seamless tiling
![Page 35: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/35.jpg)
Laplacian removing boundary(since the boundary is known)
![Page 36: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/36.jpg)
Image smoothing edge (1 D)
![Page 37: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/37.jpg)
Using Poisson Solver
![Page 38: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/38.jpg)
Terrain Analysis
The detail of the terrain differs at different altitude
Terrain = f ( altitude )Altitude = g ( style )
![Page 39: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/39.jpg)
Example: Terrain map
![Page 40: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/40.jpg)
Low Frequency - Altitude
![Page 41: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/41.jpg)
High Frequency – as a function of Altitude
![Page 42: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/42.jpg)
Proposed Algorithm
Use “Copy & Paste” methods to generate an altitude map
Add high frequency probabilistically as indexed by the altitude map
Graph cuts/Image Quilting to make it seamless
![Page 43: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/43.jpg)
Table of Contents
1. Introduction (motivation)2. Re-illumination3. Changing viewpoint4. Future work5. Conclusion
![Page 44: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/44.jpg)
Future Work
Other texture methods (Graph cut, stocastic?)
Stylized map generation from real map Real map from stylized map
![Page 45: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/45.jpg)
Map vs. terrain
![Page 46: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/46.jpg)
Conclusion
Implemented poisson image editingTried several texture based terrain
synthesis methodsLots to be done!
![Page 47: Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun howardz@cc.gatech.eduhowardz@cc.gatech.edu sun@cc.gatech.edusun@cc.gatech.edu 2003. 4.29](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649edd5503460f94bee3cd/html5/thumbnails/47.jpg)
Questions ?