relief: a modeling by drawing tool
DESCRIPTION
This paper presents a modeling system which takes advantage of two-dimensional drawing knowledge to design three-dimensional free-form shapes. A set of mouse or tablet strokes is interpreted by the system as defining both a two-dimensional shape boundary and a displacement map. This information is used for pushing or pulling vertices of existing surfaces, or for creating vertices of new surface patches. To relieve the burden of 3D manipulation from the user, patches are automatically positioned in space. The iterative design process alternates a modeling by drawing sequence and a viewpoint change. To stay as close as possible to the traditional drawing experience, the system imposes the minimum number of constraints on the topology of either the strokes set or the resulting surface.TRANSCRIPT
![Page 1: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/1.jpg)
Relief: A Modeling by Drawing Tool
David Bourguignon1 Raphaëlle Chaine2
Marie-Paule Cani3 George Drettakis4
1Princeton University / INRIA Rocquencourt 2LIRIS / CNRS / UCBL3GRAVIR / INP Grenoble 4REVES / INRIA Sophia-Antipolis
![Page 2: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/2.jpg)
Outline
• Motivation• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 3: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/3.jpg)
On Users
• Most people draw– Writing alternative
• Few people sculpt– Play-Doh days long gone– Materials difficult to handle
![Page 4: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/4.jpg)
Goals
• Use 2D tools to perform 3D operations
![Page 5: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/5.jpg)
Goals
• Use 2D tools to perform 3D operations• Model global and local surface
![Page 6: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/6.jpg)
Goals
• Use 2D tools to perform 3D operations• Model global and local surface• Input: just plain strokes
![Page 7: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/7.jpg)
Goals
• Use 2D tools to perform 3D operations• Model global and local surface• Input: just plain strokes• Output: triangle mesh
![Page 8: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/8.jpg)
Outline
• Motivations• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 9: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/9.jpg)
Previous Work
• Depth painting [Williams, 1990]
+
![Page 10: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/10.jpg)
Previous Work
• Gradient editing [van Overveld, 1996]
![Page 11: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/11.jpg)
Previous Work
• Maya 6.0 Artisan [Alias, 2004]
![Page 12: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/12.jpg)
Outline
• Motivations• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 13: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/13.jpg)
Tool Workflow
• First step: drawing input– Displacement map
• mid-grey = 0• white > 0• black < 0
Model of 3D sphere
Pencil
Brush
![Page 14: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/14.jpg)
Tool Workflow
• First step: drawing– Displacement map– 2D shape boundary
(in green)• defines drawing mask
![Page 15: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/15.jpg)
Tool Workflow
• First step: drawing– Displacement map– 2D shape boundary– Displacement regions (from 2 maps)
![Page 16: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/16.jpg)
Tool Workflow
• Second step: modeling– Displace existing vertices
![Page 17: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/17.jpg)
Tool Workflow
• Second step: modeling– Displace existing vertices– Create new surface patch
![Page 18: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/18.jpg)
Tool Workflow
• Changing viewpoint
Modeling by drawing
Changing viewpoint
![Page 19: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/19.jpg)
Reconstruction
• Based on evolving pseudo-manifold [Chaine, 2003]
![Page 20: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/20.jpg)
Reconstruction
• Based on evolving pseudo-manifold [Chaine, 2003]
• Satisfy our requirements– Arbitrary number of connected components
![Page 21: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/21.jpg)
Reconstruction
• Based on evolving pseudo-manifold [Chaine, 2003]
• Satisfy our requirements– Arbitrary number of connected components– Handle points off shape boundary
![Page 22: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/22.jpg)
Reconstruction
• Based on evolving pseudo-manifold [Chaine, 2003]
• Satisfy our requirements– Arbitrary number of connected components– Handle points off shape boundary– Interactive (5k points per second)
![Page 23: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/23.jpg)
2D reconstruction
• Start: pseudo-curve lies on oriented edges of Delaunay triangulation
![Page 24: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/24.jpg)
2D reconstruction
• During: pseudo-curve evolves as long as oriented Gabriel criterion is not met
![Page 25: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/25.jpg)
2D reconstruction
• Stop: topologically consistent set of oriented edges
![Page 26: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/26.jpg)
Sampling and Depth
• Adaptive sampling– Displacement map
• Pencil and brush datain color buffer
Color buffer
![Page 27: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/27.jpg)
Sampling and Depth
• Adaptive sampling– Displacement map– Approximate disp. map
sampled at existing vertices
![Page 28: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/28.jpg)
Sampling and Depth
• Adaptive sampling– Displacement map (D)– Vertex-Sampled disp.
map (V)– Error map
E = 1 – ABS(D – V)– Arbitrary error value
![Page 29: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/29.jpg)
Sampling and Depth
• Adaptive sampling– Displacement map– Approximate disp. map– Error map– Sampling [Alliez, 2002]
![Page 30: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/30.jpg)
Sampling and Depth
• Adaptive sampling• Depth inference
– Identify surface vertices
Vertices ID buffer
![Page 31: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/31.jpg)
Sampling and Depth
• Adaptive sampling• Depth inference
– Identify surface vertices– Assign depth values
Depth buffer
![Page 32: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/32.jpg)
Sampling and Depth
• Adaptive sampling• Depth inference
– Identify surface vertices– Assign depth values– Infer depth values
• from existing surface• by depth propagation
![Page 33: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/33.jpg)
Outline
• Motivations• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 34: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/34.jpg)
Tool Interface
• Hole marks– Comic books production
Hole marks
Stone #3 (Avalon Studios)
![Page 35: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/35.jpg)
Tool Interface
• Hole marks– Comic books production– Our system
Hole mark
![Page 36: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/36.jpg)
Tool Interface
• Video: Basic interface
![Page 37: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/37.jpg)
Tool Interface
• Blobbing
Drawing White shadingDistance field Height field Surface
![Page 38: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/38.jpg)
Tool Interface
• Depth modes (chosen by menu)
Modeling “at depth”Depth inference Frisket mode
![Page 39: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/39.jpg)
Video
• Modeling a tree
Paper sketch 3D model obtained with Relief
![Page 40: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/40.jpg)
Outline
• Motivations• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 41: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/41.jpg)
Results
• Models (1k to 4k points)
![Page 42: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/42.jpg)
Discussion
• Intuitive shading convention
![Page 43: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/43.jpg)
Discussion
• Intuitive shading convention• Problems with drawing metaphor
– No continuous visual feedback• Provide two modes
![Page 44: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/44.jpg)
Discussion
• Intuitive shading convention• Problems with drawing metaphor
– No continuous visual feedback– Difficult to obtain continuous shading
• Provide higher-level drawing tools
![Page 45: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/45.jpg)
Conclusion
• Modeling by drawing, but imprecise
![Page 46: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/46.jpg)
Conclusion
• Modeling by drawing, but imprecise• Future work
– Speedup with local 3D reconstruction
![Page 47: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/47.jpg)
Conclusion
• Modeling by drawing, but imprecise• Future work
– Speedup with local 3D reconstruction– Improve depth inference
![Page 48: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/48.jpg)
Conclusion
• Modeling by drawing, but imprecise• Future work
– Speedup with local 3D reconstruction– Improve depth inference– Image-space and object-space sampling
![Page 49: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/49.jpg)
Acknowledgements
This work has been performed while the first author was a visiting research fellow at Princeton University, supported by an INRIA post-doctoral fellowship.
Many people have indirectly contributed to it. We would like to thank: Adam Finkelstein, Szymon Rusinkiewicz, Jason Lawrence, Pierre Alliez, Mariette Yvinec, Laurence Boissieux, Laure Heïgéas, Laks Raghupathi, Olivier Cuisenaire, Bingfeng Zhou.
![Page 50: Relief: A Modeling By Drawing Tool](https://reader036.vdocuments.us/reader036/viewer/2022062514/559bb6a61a28ab90538b46a3/html5/thumbnails/50.jpg)