![Page 1: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/1.jpg)
Scientific Visualization: The Modern Oscilloscope for "Seeing the Unseeable"
Scientific Visualization: The Modern Oscilloscope for "Seeing the Unseeable"
E. Wes BethelE. Wes BethelLawrence Berkeley National LaboratoryLawrence Berkeley National Laboratory
24 June 200824 June 2008
![Page 2: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/2.jpg)
Seeing the Unseeable - AnatomySeeing the Unseeable - Anatomy
![Page 3: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/3.jpg)
Seeing the Unseeable – Whale Swim PathSeeing the Unseeable – Whale Swim Path
![Page 4: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/4.jpg)
Seeing the Unseeable – CyberattackSeeing the Unseeable – Cyberattack
![Page 5: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/5.jpg)
Seeing the Unseeable – Protein FoldingSeeing the Unseeable – Protein Folding
![Page 6: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/6.jpg)
Today’s Discussion TopicsToday’s Discussion Topics
•• Objective: familiarize you with an Objective: familiarize you with an interesting, probleminteresting, problem--rich science domain.rich science domain.
•• How?How?• Intro to CG and Visualization
• Ray Tracing and the Shading Equation.
• Graphics APIs and the Graphics Pipeline.
• Visualization: Examples, Challenges, Future.
![Page 7: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/7.jpg)
Introduction to CG and VisualizationIntroduction to CG and Visualization
![Page 8: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/8.jpg)
What is Computer Graphics and Visualization?What is Computer Graphics and Visualization?
•• Graphics: Graphics: • Transformation of data into images.
• Pen plotters (60’s, 70’s), storage tubes (70’s), electrostatic plotters and raster displays (80’s and beyond).
•• Visualization:Visualization:• Transformation of data into images.
•• Computer Graphics and Visualization are an Computer Graphics and Visualization are an alloy comprised of:alloy comprised of:• Computer science, cognitive science, mathematics, industrial
engineering, etc.
![Page 9: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/9.jpg)
What are Computer Graphics and Visualization?What are Computer Graphics and Visualization?
•• If both graphics and visualization are If both graphics and visualization are “transformation of data into images,” what is the “transformation of data into images,” what is the difference?difference?• Graphics tends to focus on the process of rendering
• Transformation of primitives into pixels• Shading, photorealism, etc.
• Visualization tends to focus on the mapping of abstract data (e.g., velocity) into constructs that can be rendered (e.g., triangles).
• The distinction occasionally becomes blurry.
![Page 10: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/10.jpg)
Why Computer Graphics and Visualization?Why Computer Graphics and Visualization?
•• The visual cortex and associated machinery The visual cortex and associated machinery occupy more than half our brains occupy more than half our brains –– we are we are innately visual creatures.innately visual creatures.
•• Vision is our principal means for Vision is our principal means for understanding and interacting with the world.understanding and interacting with the world.
•• The best connection between humans and The best connection between humans and computers is through the highcomputers is through the high--bandwidth bandwidth connection of our highly evolved visual connection of our highly evolved visual system.system.
![Page 11: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/11.jpg)
The Path Towards Graphics and VisualizationThe Path Towards Graphics and Visualization
Art and painting
Geometry,Perspective and models
Photography
Computers
![Page 12: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/12.jpg)
The Invention of DrawingThe Invention of Drawing
•• Painting based on mythical tale as told by Pliny the Elder: Painting based on mythical tale as told by Pliny the Elder: Corinthian man traces shadow of departing lover. DCorinthian man traces shadow of departing lover. Detail from etail from The Invention of DrawingThe Invention of Drawing, 1830: Karl Friedrich, 1830: Karl Friedrich SchinkleSchinkle (Mitchell (Mitchell p.1)p.1)
![Page 13: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/13.jpg)
Understanding PerspectiveUnderstanding Perspective
Correct perspective,Last Supper, Da Vinci, 1495
Alberti’sAlberti’s 1435 treatise, 1435 treatise, Della Della PitturaPittura, , explained perspective for the first explained perspective for the first timetime
Incorrect perspective, Giotto, c.1295-1300
![Page 14: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/14.jpg)
ProjectionsProjections
Planar geometricprojections
Frontelevation
Sideelevation
Top(plan)
Parallel Perspective
Orthographic Oblique One-point
Cabinet
Cavalier
Other
Two-point
Three-pointAxonometric
Isometric
Other
Ender, c. 1855(detail of clockwork)
![Page 15: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/15.jpg)
Color and PerceptionColor and Perception
![Page 16: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/16.jpg)
Uses of ColorUses of Color
•• To label, to indicate To label, to indicate set membership.set membership.
•• To indicate a value To indicate a value or magnitude.or magnitude.
•• To represent reality.To represent reality.•• To decorate. To decorate.
![Page 17: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/17.jpg)
Graphics vs. VisualizationGraphics vs. Visualization
•• Top row: information Top row: information encoded/presented encoded/presented using color (using color (visvis).).
•• Bottom row: color Bottom row: color used decoratively or used decoratively or to represent reality.to represent reality.
![Page 18: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/18.jpg)
The Quest for PhotorealismThe Quest for Photorealism
![Page 19: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/19.jpg)
Visualization – Enable InsightVisualization – Enable InsightData
VisRender
Display
![Page 20: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/20.jpg)
Visualization – Good Use of ColorVisualization – Good Use of Color
•• Use “background Use “background colors from nature” colors from nature” for background for background elements.elements.
•• Use colors that Use colors that produce a strong, produce a strong, innate biological innate biological response for features response for features of interest.of interest.
![Page 21: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/21.jpg)
Visualization – Bad Use of ColorVisualization – Bad Use of Color
•• The “hue ramp” The “hue ramp” color tablecolor table
•• Induces 1+1=3 Induces 1+1=3 effect: eyes perceive effect: eyes perceive a contour that a contour that doesn’t really existdoesn’t really exist
•• What are What are “important” aspects “important” aspects of a given of a given visualization?visualization?
![Page 22: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/22.jpg)
Visualization – Use of ColorVisualization – Use of Color
![Page 23: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/23.jpg)
Central Problem in Computer Graphics: The Shading EquationCentral Problem in Computer Graphics: The Shading Equation
•• Given a collection of objects and scene Given a collection of objects and scene parameters, compute the color of each pixel on parameters, compute the color of each pixel on the screen.the screen.
•• Two broad approaches:Two broad approaches:• Object order: for each triangle (object), compute which
screen pixels each one covers, compute color for all covered pixels.
• Image order: for each image pixel, compute which objects contribute to the pixel color.
![Page 24: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/24.jpg)
Ray Tracing and the Rendering Equation – Image-Order CGRay Tracing and the Rendering Equation – Image-Order CG
![Page 25: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/25.jpg)
Ray TracingRay Tracing
•• An Improved Illumination Model for Shaded An Improved Illumination Model for Shaded DisplayDisplay,, WhittedWhitted, SIGGRAPH 1980. , SIGGRAPH 1980.
•• The role of the illumination model is to determine The role of the illumination model is to determine how much light is reflected to the viewer from a how much light is reflected to the viewer from a visible point on a surface as a function of light visible point on a surface as a function of light source direction and strength, viewer position, source direction and strength, viewer position, surface orientation, and surface propertiessurface orientation, and surface properties.
![Page 26: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/26.jpg)
Phong’s Illumination Equation (Not Ray Tracing – Yet)Phong’s Phong’s Illumination Equation (Not Ray Illumination Equation (Not Ray Tracing Tracing –– Yet)Yet)
![Page 27: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/27.jpg)
Whitted’s Improvement (Ray Tracing)Whitted’s Whitted’s Improvement (Ray Tracing)Improvement (Ray Tracing)
•• Retain diffuse term (computationally Retain diffuse term (computationally overwhelming to account for scene objects as overwhelming to account for scene objects as light sources) from light sources) from PhongPhong Model.Model.
•• “Refine” “Refine” specular specular term, add term, add transmissive transmissive term.term.
![Page 28: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/28.jpg)
Whitted’s Improvement, ctd.Whitted’s Whitted’s Improvement, Improvement, ctdctd..
![Page 29: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/29.jpg)
Example Rays – Simple IntersectionsExample Rays Example Rays –– Simple IntersectionsSimple Intersections
•• (See (See http://www.siggraph.org/education/materials/HyperGraph/raytrace/rtrace1.htm))
![Page 30: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/30.jpg)
Shadow RaysShadow RaysShadow Rays
![Page 31: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/31.jpg)
Reflected RaysReflected RaysReflected Rays
![Page 32: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/32.jpg)
More Reflected RaysMore Reflected RaysMore Reflected Rays
Zero bounces One bounce
Two bounces
![Page 33: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/33.jpg)
Refracted RaysRefracted RaysRefracted Rays
![Page 34: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/34.jpg)
Parallelizing Ray TracingParallelizingParallelizing Ray TracingRay Tracing
•• Computation of color at each pixel is Computation of color at each pixel is relatively independent. relatively independent. •• ImageImage--order order parallelization parallelization (data parallelism).(data parallelism).
•• Requires (potential) duplication of the scene on each Requires (potential) duplication of the scene on each node.node.
•• ChallengesChallenges•• Load balancing.Load balancing.
•• Data distribution.Data distribution.
![Page 35: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/35.jpg)
Graphics APIs and the Graphics Pipeline – Object-Order CGGraphics APIs and the Graphics Pipeline – Object-Order CG
(Images from Doom3)(Images from Doom3)
![Page 36: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/36.jpg)
What is a Graphics API?What is a Graphics API?
•• Declarative: what, not how.Declarative: what, not how.• Scene description: viewer here, trees there, lights just so.
• Can use a variety of rendering systems: Renderman, POVRay, Performer, OpenRM Scene Graph, etc.
•• Imperative: how, not what.Imperative: how, not what.• A series of draw commands.
• OpenGL, DirectX, D3D, Xlib, etc.
![Page 37: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/37.jpg)
OpenGLOpenGL
•• IndustryIndustry--standard graphics API.standard graphics API.• Supported on all major platforms.
• Relationship between OpenGL and window system.
•• Basic primitives: lines, triangles, points.Basic primitives: lines, triangles, points.• Higher level primitives (NURBS, quadrics) built using
fundamental geometry.
•• Phong Phong lighting model, but lighting model, but Gouroud Gouroud shading.shading.
![Page 38: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/38.jpg)
Example OpenGL CodeExample OpenGL Code
![Page 39: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/39.jpg)
General: Graphics PipelineGeneral: Graphics Pipeline
•• Application issues “draw” Application issues “draw” commands.commands.
•• Each command dispatches Each command dispatches objects (e.g., geometry).objects (e.g., geometry).
•• Each object is scanEach object is scan--converted into pixel converted into pixel fragments.fragments.
•• Each fragment is textured, Each fragment is textured, etc.etc.
•• And finally displayed.And finally displayed.
![Page 40: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/40.jpg)
The Graphics ApplicationThe Graphics Application
•• ApplicationApplication• Simulation
• Visualization
• Database Traversal
• User interaction (games!)
![Page 41: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/41.jpg)
Commands and GeometryCommands and Geometry
•• CommandCommand• (What kinds of commands?)
• Buffering, parsing.
•• GeometryGeometry• Transform, light.
• Automatic operations.
• Culling, clipping.
![Page 42: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/42.jpg)
RasterizationRasterization
•• Setup, sampling (produces Setup, sampling (produces “fragments”, interpolation “fragments”, interpolation (color, depth).(color, depth).
![Page 43: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/43.jpg)
TexturingTexturing
•• Texture transformation and Texture transformation and projection.projection.
•• Texture address calculation.Texture address calculation.•• Texture filtering.Texture filtering.
![Page 44: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/44.jpg)
Fragment OperationsFragment Operations
![Page 45: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/45.jpg)
DisplayDisplay
![Page 46: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/46.jpg)
Parallelism in GraphicsParallelism in Graphics
![Page 47: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/47.jpg)
Sources of ParallelismSources of ParallelismSources of Parallelism
•• Task parallelismTask parallelism•• Graphics PipelineGraphics Pipeline
•• ParallelizingParallelizing operations within a single pipe.operations within a single pipe.•• Pipelining operations within a single pipe.Pipelining operations within a single pipe.
•• Data ParallelismData Parallelism•• Frame & image parallel (image order).Frame & image parallel (image order).
•• Object/geometry parallel (object order).Object/geometry parallel (object order).
![Page 48: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/48.jpg)
Parallelism and GPUsParallelism and GPUs
•• NVIDIA 8800 GTX UltraNVIDIA 8800 GTX Ultra• 16 processors, 768 threads each.
• 12K simultaneous threads!
•• These threads are simultaneously working on:These threads are simultaneously working on:• Transform and light (vertex operations)
• Rasterization
• Texturing/fogging/alpha blending/stencil (fragment ops)
![Page 49: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/49.jpg)
Programming GPUsProgramming GPUs
•• “Old Way”“Old Way”• Vertex and fragment programs.
• “Assembly language” programming
•• New Way: Compute Unified Device Architecture New Way: Compute Unified Device Architecture –– CUDA CUDA • C language with extensions for multithreading
• Lots of promise/interest for high performance computing.
• Teraflop GPUs vs. Gigaflop CPUs
![Page 50: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/50.jpg)
VisualizationVisualizationVisualization
![Page 51: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/51.jpg)
VisualizationVisualizationVisualization
•• Visualization is the art/science of Visualization is the art/science of transforming abstract data into transforming abstract data into images.images.
•• Visualization algorithms:Visualization algorithms:•• Produce data that can be then processed by a Produce data that can be then processed by a
traditional graphics pipeline, ortraditional graphics pipeline, or
•• Are rendering algorithms that produce images.Are rendering algorithms that produce images.
•• Are highly data intensive (opportunity for Are highly data intensive (opportunity for performance gain through parallelism!!)performance gain through parallelism!!)
Data
![Page 52: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/52.jpg)
Visualization Research ExamplesVisualization Research Examples
•• Petroleum Reservoir ModelingPetroleum Reservoir Modeling•• Protein structure predictionProtein structure prediction•• Quantitative analysis/comparison of Quantitative analysis/comparison of
RayleighRayleigh--Taylor instabilityTaylor instability
![Page 53: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/53.jpg)
Petroleum Reservoir ModelingPetroleum Reservoir Modeling
•• Problem:Problem:• Find optimal location of injection
and production wells.
• No direct solution
•• ApproachApproach• Leverage human intuition
• Couple simulation and visualization
![Page 54: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/54.jpg)
Protein Structure PredictionProtein Structure Prediction
Problem: Problem: what is the minimalwhat is the minimal--energy energy structure of a sequence structure of a sequence of amino acids?of amino acids?
Solution: Solution: Nature knows, but Nature knows, but computing an answer is NPcomputing an answer is NP--hard hard (not solvable).(not solvable).
Approach: Approach: HumanHuman--guided setup, guided setup, computercomputer--aided energy aided energy optimization and minimization.optimization and minimization.
Conf: 99999999999999999999999999999999999 Pred: HHHHHHHCCCEEEEEEECCCEEEEEEEECCCCCCC AA: FKQYANDNGVDGVWTYDDATKTFTVTEMVTEVPVA
![Page 55: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/55.jpg)
Rayleigh-Taylor InstabilityRayleigh-Taylor Instability
•• Problem: understand impact of various Problem: understand impact of various parameters on mixing.parameters on mixing.• Want to compare results of different simulations.
•• Solution: topological analysis to identify, Solution: topological analysis to identify, count, and track mixing regions.count, and track mixing regions.
![Page 56: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/56.jpg)
Rayleigh-Taylor Instability, ctd.Rayleigh-Taylor Instability, ctd.
![Page 57: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/57.jpg)
Rayleigh-Taylor Instability, ctd.Rayleigh-Taylor Instability, ctd.
•• Bubble count: quantitative basis for Bubble count: quantitative basis for comparison (comparison (simsim--simsim, in this case), in this case)
![Page 58: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/58.jpg)
Map of the Problem SpaceMap of the Problem Space
Experiment
SimulationData Analysis Results
Filter, feature detection,
search, subset,
transform, visualize.
Images, movies, data,
decisions, knowledge.
Raw data files,
metadata, location
transparency, single project,
community repositories.
Workflow
High Performance I/O Libraries, Data Models
![Page 59: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/59.jpg)
Challenges in Visualization/GraphicsChallenges in Visualization/Graphics
•• Primary problemsPrimary problems•• Computing platforms machines becoming more powerful and Computing platforms machines becoming more powerful and
complex: increased parallelism, heterogeneous architectures.complex: increased parallelism, heterogeneous architectures.
•• Data becoming larger and more complex: increased spatial Data becoming larger and more complex: increased spatial resolution, more variables, moreresolution, more variables, more timestepstimesteps..
•• Secondary problemsSecondary problems•• Comparing datasets: Comparing datasets: simsim--simsim, experiment, experiment--simsim..
•• Analysis to find/confirm correlations.Analysis to find/confirm correlations.
•• Really big problemReally big problem• Too much information!
![Page 60: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/60.jpg)
Big Problem – Information OverloadBig Problem – Information Overload
•• Our ability to create and store information Our ability to create and store information exceeds our capacity to understand it.exceeds our capacity to understand it.
•• Information requires attention to process:Information requires attention to process:• “A wealth of information creates a poverty of
attention.” – Hebert Simon, Nobel Prize, 1971.
•• Major challenge: gain insight from data.Major challenge: gain insight from data.
![Page 61: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/61.jpg)
Moore’s LawMoore’s Law
![Page 62: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/62.jpg)
Moore’s Law – PC Hard Drive CapacityMoore’s Law – PC Hard Drive Capacity
![Page 63: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/63.jpg)
Moore’s Law – Digital Camera ResolutionMoore’s Law – Digital Camera Resolution
![Page 64: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/64.jpg)
ESnet: Shatters PB barrierESnet: Shatters PB barrier
0
500
1000
1500
2000
2500
3000
Jan,
00
Jan,
01
Jan,
02
Jan,
03
Jan,
04
Jan,
05
Jan,
06
Jan,
07
ESnet Monthly Data (TB)
![Page 65: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/65.jpg)
Human Cognitive LimitHuman Cognitive Limit
0
500
1000
1500
2000
2500
3000
Jan,
00
Jan,
01
Jan,
02
Jan,
03
Jan,
04
Jan,
05
Jan,
06
Jan,
07
ESnet Monthly Data (TB)
Data Vis RenderExperiment
Simulation
Analysis,Filter
Graph courtesy C. Aragon, LBNLGraph courtesy C. Aragon, LBNL
![Page 66: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/66.jpg)
How is Cognitive Bandwidth Abused?How is Cognitive Bandwidth Abused?
•• The “meat grinder” syndromeThe “meat grinder” syndrome• Can’t “see” a TB, much less a PB
• Depth complexity– 1k^3 grid O(2-20)
» Can’t see it– 4k^3 grid O(20-200)
» Can’t store it
• Spatial complexity– Mesh cells map to sub-pixels
![Page 67: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/67.jpg)
LBNL Visualization ProgramLBNL Visualization Program
•• DOE’sDOE’s SciDACSciDAC Visualization and Analytics Visualization and Analytics Center for Enabling Technologies Center for Enabling Technologies (VACET).(VACET).
•• NERSC Analytics.NERSC Analytics.•• High performance visualization research.High performance visualization research.
Data Vis RenderExperiment
Simulation
Analysis,Filter
![Page 68: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/68.jpg)
The Road Ahead (< 5-10 years)The Road Ahead (< 5-10 years)
•• Effectively leverage emerging Effectively leverage emerging computational platforms for visual computational platforms for visual data analysis.data analysis.• MPP systems, hybrid/hierarchical parallelism.
• “Exotic systems”: • CellBE, GPU, etc.
![Page 69: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/69.jpg)
The Road Ahead (< 5-10 years)The Road Ahead (< 5-10 years)
•• Increasing efficiency of data Increasing efficiency of data understanding techniques and understanding techniques and methodologies.methodologies.• Combining visualization and traditional data
analysis.
![Page 70: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/70.jpg)
The Road Ahead (< 5-10 years)The Road Ahead (< 5-10 years)
•• Usability engineering.Usability engineering.• Objective: simplify ease-of-use of complex machinery.
• Factors: parallel machines, distributed teams, large and complex data, diverse software, …
•• A very difficult set of problems!A very difficult set of problems!• Data formats “Tower of Babel” problem.
• Interface standards non-existent: • Programming interfaces• Data and “execution” interfaces• User interfaces
![Page 71: E. Wes Bethel - News Center · 2017-10-05 · Understanding PerspectiveUnderstanding Perspective Correct perspective, Last Supper, Da Vinci, 1495 Alberti’s 1435 treatise, Della](https://reader035.vdocuments.us/reader035/viewer/2022062916/5ebf024581230970fa2155da/html5/thumbnails/71.jpg)
The EndThe End