illustrative visualization and volume rendering
DESCRIPTION
Illustrative Visualization and Volume Rendering. Peter Sikachev. Institute of Computer Graphics and Algorithms Vienna University of Technology. Outline. About TUVienna and vis-group Rendering and visualization Volume rendering - PowerPoint PPT PresentationTRANSCRIPT
Illustrative Visualization andVolume Rendering
Peter Sikachev
Institute of Computer Graphics and Algorithms
Vienna University of Technology
Peter Sikachev 2
Outline
About TUVienna and vis-group
Rendering and visualization
Volume rendering
VolumeShop: an interactive system for direct volume illustration
Recent group work overview
Peter Sikachev 3
Outline
About TUVienna and vis-group
Rendering and visualization
Volume rendering
VolumeShop: an interactive system for direct volume illustration
Recent group work overview
Peter Sikachev 4
TUVienna
Urban campus
~17,600 students
~4,000 staff (1,800 – academic)
19% foreign students
No tuition fees for EU/EEA/Switzerland students
Peter Sikachev 5
ICGA
Institute of computer graphics and algorithms
Occupies a complete floor + smth
3 groups Algorithms and Data Structures Group
Computer Graphics Group
Pattern Recognition and Image Processing Group
Peter Sikachev 6
Computer Graphics Group
1 full professor
2 associate professors
25 scientific staff people (PhD students, postdocs, exchange students etc)
Peter Sikachev 7
Visualization Sub-Group
PHILIPS PHILIPS Medical Systems Medical Systems
GWI ResearchGWI Research
Virtual Reality und Virtual Reality und Visualisierung Forschungs-Visualisierung Forschungs-
gmbhgmbh
AKH WienAKH Wien
ÖsterreichischeÖsterreichischeAkademie derAkademie der
WissenschaftenWissenschaften
University of BergenUniversity of BergenNorwayNorway
Upper Austria University of Upper Austria University of Applied SciencesApplied Sciences
Peter Sikachev 8
Outline
About TUVienna and vis-group
Rendering and visualization
Volume rendering
VolumeShop: an interactive system for direct volume illustration
Recent group work overview
Peter Sikachev 9
Computer Graphics
ComputerGraphics
Rendering Visualization
Real-TimeRendering
OfflineRendering
InformationVisualization
VolumeVisualization
……
Peter Sikachev 10
Computer Graphics
ComputerGraphics
Rendering Visualization
Real-TimeRendering
OfflineRendering
InformationVisualization
VolumeVisualization
……
How? What?
Peter Sikachev 11
Computer Graphics
ComputerGraphics
Rendering Visualization
Real-TimeRendering
OfflineRendering
InformationVisualization
VolumeVisualization
……
Peter Sikachev 12
Offline Rendering
Cinema
Advertisement
Peter Sikachev 13
Computer Graphics
ComputerGraphics
Rendering Visualization
Real-TimeRendering
OfflineRendering
InformationVisualization
VolumeVisualization
……
Peter Sikachev 14
Real-Time Rendering
Games
3D interactive applications[Zeller]
Peter Sikachev 15
Computer Graphics
ComputerGraphics
Rendering Visualization
Real-TimeRendering
OfflineRendering
InformationVisualization
VolumeVisualization
……
Peter Sikachev 16
Volume Visualization
Healthcare
Industry
Geology
Forecast[Bruckner05]
Peter Sikachev 17
Computer Graphics
ComputerGraphics
Rendering Visualization
Real-TimeRendering
OfflineRendering
InformationVisualization
VolumeVisualization
……
Peter Sikachev 18
Information Visualization
Databases
Networks
Software engineering
[Wonka]
Peter Sikachev 19
Outline
About TUVienna and vis-group
Rendering and visualization
Volume rendering
VolumeShop: an interactive system for direct volume illustration
Recent group work overview
Peter Sikachev 20
3D Texture
Example for a histological dataset
Convert a set of 2D scalar functions to a 3D scalar function
Consider as a regular grid
Peter Sikachev 21
Volume Ray Casting
Ray Casting
Sampling
Shading
Compositing
Peter Sikachev 22
Volume Ray Casting
Ray Casting
Sampling
Shading
Compositing
Peter Sikachev 23
Shading
Needed for a shape perception
Does not usually use a correct physical model
No shading
With shading
Peter Sikachev 24
Transfer Function
3D function is not equivalent to the importance value
Mapping to optical properties is neededDirect
mapping Using transfer function
Peter Sikachev 25
Transfer Function
Transfer function may depend on different parameters:
function value
gradient magnitude
segmentation
shape
size
,,,
),,(
},,,{),...},,({
bgr
zyxf
bgrzyxf functiontransfer
where
3D function
optical properties
Peter Sikachev 26
Transfer Function
Peter Sikachev 27
Volume Ray Casting
Ray Casting
Sampling
Shading
Compositing
Peter Sikachev 28
Compositing
Several voxels projects onto one pixel – compositing is needed
Different compositing rules might be used:
Alpha-blending (DVR)
Maximum intensity projection (MIP)
Hybrid (MIDA)
…[Bruckner09]
Peter Sikachev 29
Outline
About TUVienna and vis-group
Rendering and visualization
Volume rendering
VolumeShop: an interactive system for direct volume illustration
Recent group work overview
What is VolumeShop?
VolumeShop is not …… an extensive general-purpose visualization class library
try VTK, VisIt, ..
… a medical image processing and visualization toolkit
try MeVisLab, Amira, …
… a scene-graph API and rendering framework
try OpenInventor, Orge, …
Stefan Bruckner 30
What is VolumeShop?
What does it do then?VolumeShop is a prototyping platform for visualization research
Goal is to provide maximum flexibility to the developer
Provide easy-to-use facilities for common cumbersome tasks
Give developers the freedom of choice not to use them at all
Ease the transition from research prototypes to actual applications
Stefan Bruckner 31
Overview
Stefan Bruckner 32
VolumeShop application
VolumeShop core
VolumeShop plugins
base classes, serialization, resource management, plugin
mechanism, …
base classes, serialization, resource management, plugin
mechanism, …
import, export, compositing, interaction, rendering, scripting, …
import, export, compositing, interaction, rendering, scripting, …
graphical front-end, project setup, property
management, …
graphical front-end, project setup, property
management, …
Peter Sikachev 33
Use Case
Peter Sikachev 34
Outline
About TUVienna and vis-group
Rendering and visualization
Volume rendering
VolumeShop: an interactive system for direct volume illustration
Recent group work overview
Peter Sikachev 35
Importance-Driven Visualization [Viola]
Motivation: show important features inside the volume, preserving context
Cut-aways
Ghosted views
Level of sparseness
Peter Sikachev 36
Motivation
Peter Sikachev 37
Maximum Importance Projection
cylindrical conical
Peter Sikachev 38
Maximum Importance Projection
cylindrical conical
Peter Sikachev 39
Average Importance Compositing
image-space object space
Peter Sikachev 40
Visibility Preserving Compositing
Peter Sikachev 41
Levels of Sparseness
opacity modulation & color saturation
screen-door transparency
volume thinning
Peter Sikachev 42
Exploded Views [Bruckner06]
Peter Sikachev 43
Exploded Views [Bruckner06]
Peter Sikachev 44
Context-Preserving Volume Rendering
Motivation: large flat surface areas are unimportant
These surfaces are highly lit
[CVPR]
Peter Sikachev 45
Context-Preserving Volume Rendering
Peter Sikachev 46
Style Transfer Function [Bruckner07]
Motivation: integrate multiple NPR techniques in one framework
Peter Sikachev 47
Style Transfer Function: Concept
regular transfer function
style transfer function
Peter Sikachev 48
Style Transfer Function: Results
Peter Sikachev 49
Style Transfer Function: Results
Peter Sikachev 50
[LiveSync]
A framework for combining 2D/3D views
Automatic viewpoint finding
Transfer function update
Region of interest growing
Importance-driven clipping
Peter Sikachev 51
[LiveSync]
Peter Sikachev 52
Announcement: 2 PhD Positions
ViMaLvisualization mapping
methods for incorporating
domain semantics
SCALE-VSscalable algorithms
for visualization petascale
volume data
http://www.cg.tuwien.ac.at/jobs/
Peter Sikachev 53
References[Fedkiw] Irving, G., Guendelman, E., Losasso, F. and Fedkiw, R., "Efficient Simulation of Large Bodies of Water by Coupling Two and Three Dimensional Techniques", SIGGRAPH 2006, ACM TOG 25, 805-811 (2006).
[Zeller] Cyril Zeller, “Cloth Simulation“, White Paper for nVidia Direct3D SDK 10, 2007.
[Bruckner05] S. Bruckner, S. Grimm, A. Kanitsar, and E. Groeller. Illustrative context-preserving
volume rendering. In EuroVis, pages 69–76, 2005.
[Wonka] Pushpak Karnick, David Cline, Stefan Jeschke, Anshuman Razdan, Peter Wonka, "Route Visualization Using Detail Lenses," IEEE Transactions on Visualization and Computer Graphics, 04 Jun. 2009.
[Bruckner09] Stefan Bruckner, Meister Eduard Gröller. Instant Volume Visualization using Maximum Intensity Difference Accumulation. Computer Graphics Forum, 28(3):775-782, June 2009.
[Viola] Viola I., Kanitsar A., Groeller M. E.: Importance-driven feature enhancement in volume visualization. IEEE Transactions on Visualization and Computer Graphics 11, 4 (2005), 408–418.
[Bruckner06] Stefan Bruckner, Meister Eduard Gröller. Exploded Views for Volume DataIEEE Transactions on Visualization and Computer Graphics, 12(5):1077-1084, September 2006.
[CVPR] Stefan Bruckner, Sören Grimm, Armin Kanitsar, Meister Eduard Gröller. Illustrative Context-Preserving Volume Rendering. In Proceedings of EuroVis 2005, pages 69-76. May 2005.
[Bruckner07] Stefan Bruckner, Meister Eduard Gröller. Style Transfer Functions for Illustrative Volume Rendering. Computer Graphics Forum, 26(3):715-724, September 2007.
[LiveSync] Peter Kohlmann, Stefan Bruckner, Armin Kanitsar, Meister Eduard Gröller. LiveSync++: Enhancements of an Interaction Metaphor. In Proceedings of Graphics Interface 2008, pages 81-88. May 2008.
[RTVG] Christof Rezk-Salama, Daniel Weiskopf, Joe Kniss, Klaus Engel, Markus Hadwiger. Real-time Volume Graphics. Published by A K Peters, 2006.