perspectives on visualization and science: communication ... · remote visualization faiz abidi,...

43
Perspectives on Visualization and Science: Communication and Discovery June 11, 2019 Nicholas F. Polys, Ph.D.

Upload: others

Post on 14-Jul-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Perspectives on Visualization and Science: Communication and DiscoveryJune 11, 2019

Nicholas F. Polys, Ph.D.

Page 2: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Topic Overview

• Visualization and Scientific Discovery

• What?

• Why?

• Big Data Paradigms

• Where?

• How?

• Access

• Who?

Page 3: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Visualization and Scientific Discovery

What?

Why?

Page 4: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Human Vision

Highest bandwidth sense

• Fast, parallel

• Pattern recognition

• Pre-attentive

• Extends memory and cognitive capacity

• (Multiplication test)

• People think visually

• Brain = 8 lbs, vision = 3 lbs

Page 5: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Visual Thinking

• Many of the great scientists were good at visual thinking:

– Leonardo da Vinci– James Clerk Maxwell– Michael Faraday– Albert Einstein

• This was often at the expense of verbal skills

• Tom West : “In the Mind’s Eye”– See also

http://www.krasnow.gmu.edu/twest/maxwell_visual.html Maxwell’s clay model now in

New Cavendish Laboratory, Cambridge

(picture by Tom West)

Page 6: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Visualization: A Definition

Generally:

“The use of computer-supported, interactive, visual representations of data to amplify cognition “

Card, McKinlay and Schneiderman

• Scientific Visualization

• Information Visualization

• Virtual Environments

Page 7: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Visualization as a Scientific Instrument

• Making the invisible visible:

• Tele-scope

• Micro-scope

• Digi-scope

• …

• Femto-scope

Page 8: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Which state has highest income?

Relationship between income and education?

Outliers?

Page 9: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Per Capita Income

Colle

ge D

egre

e %

Page 10: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Page 11: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Order these Chips

?

?

Page 12: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

?

?

Page 13: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Features: Color

The rainbow spectrum is not a

perceptually linear sequence

(not pre-attentive)!

(Keller 1993; Ware, )

Page 14: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Spatial Contrast Sensitivity

3x accuity in grayscale:

Page 15: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Edward Tufte

Page 16: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Les Mis characters (Jeff Heer)

Page 17: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Page 18: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Belle II VR

For desktop and Steam VR: VT ICAT

Duer, Upthergrove, Piilonen, Polys, Glasson, et al

Page 19: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

http://www1.phys.vt.edu/~piilonen/VR/

SteamVR

Page 20: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Visualization: Big Data Paradigms

Where?

How?

Page 21: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Approaches to Exa-Scalability

Numerous, highly-dimensional observations require special, pragmatic attention:

• Algorithmic Elegance:

• Sampling & Aggregation Strategies

• Data Compression (including POD)

• Brute Force:

• Remote Rendering

• Domain Relevance:

• In-Situ methods

• Human-in-the-Loop Machine Learning (Semantic Interaction)

Page 22: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Scaling to Interaction

• Frame-rates are essential for throughput & Usability

• Using HPC clusters for Rendering:

• Parallel IO

• Fast network

• Fast GPUs

• Load balancing software like Paraview, Visit

• Experiment: VT’s Blue Ridge

Page 23: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Visualization Where?

• Remote Rendering

• In-Situ methods

Page 24: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

HPC cluster rendering for Interactive frame rates on big data

12.8 million cells, total 11 GB

Page 25: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

HPC cluster rendering for Interactive frame rates on big data

9600 files total 28 GB

Page 26: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Remote Visualization

Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and AyatMohammed. 2018. Remote high performance visualization of big data for immersive science. In Proceedings of the High Performance Computing Symposium (HPC '18). Society for Computer Simulation International, San Diego, CA, USA, Article 5, 12 pages.

Master's Thesis, Spring 2017 Faiz AbidiRemote High Performance Visualization of Big Data for Immersive Science URI : http://hdl.handle.net/10919/78210

●TurboVNC scaling study on 10 GB line (VTRNet) to●HyperCube w/ Head tacking and wand

Page 27: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu6/13/2019

Paraview HyperCube remote rendering from BlueRidge (interactive head & wand tracking)

Page 28: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Remote VisualizationCluster Rendering

5.5 Billion points (w/ intensity) of Goodwin Hall via FARO laser scan

With P. Tarazaga & T. Tucker

Interactively

explored in immersive

HyperCube

Page 29: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

In Situ Methods

… Can be sampling strategies, but essentially

Visualization is done at same time as the computation or data capture.

(-) Must know what features you are looking for

(+) saves disk space

(+) Cinema approach by LANL can be used for analysis of ensembles

Page 30: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Cinema Databases

Structured collections for image-based rendering

• More efficient for storage and visualization at petaand exa –scales

• New interactions to explore between 2 and 3 D !

• Cinema:

• Sciencehttps://cinemascience.github.io/

• Viewer https://cinemaviewer.org/

Page 31: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Visualization Access

Who?

… For all

• WWW + ISO-IEC X3D:

• Desktops

• Mobiles

• VR

• AR

• 3D Printing

Page 32: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

The Web Is the Interface

Page 33: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

3D Everywhere

• Workstations

• High-Resolution projection

• WWW

• Web3D

• Mobile

• WebVR (HMDs)

• Device-specific interaction

Page 34: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Display Bandwidth

Metric for Total Display Bandwidth

Page 35: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Industry Standards unify communities

Page 36: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Open Standards make it work

www.web3d.org• Portability

• Durability

• IP independence

• International recognition and support

Page 37: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

3dprint.nih.gov

• Molecules

• Cells & tissues

• Anatomical models

• Prosthetics

• Labware

• …

Page 38: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Take Aways

1. Visualization is a key component of interdisciplinary science

2. Remote rendering, in situ methods, and semantic interaction are key approaches to scaling discovery to big data

3. For reproducibility, broad access, and interoperability, invest in Standards leadership

Contact : Nicholas Polys [email protected]

Page 39: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Contact!

Nicholas Polys

[email protected]

Page 40: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Appendix

More info~!

Page 41: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

Virginia Tech (VT): Ut Prosim

• A land-grant University serving the Public Good

• Science and the Reproducibility of Research is a core mission

• Investments in a broad spectrum of digital content and access:

• Simulation

• Analytics

• Capture (i.e. scanning)

• Design

• Archival and sharing

• International Standards provide: interoperability, accessibility, and durability

- the basis for a long-term strategy

Page 42: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

VT Advanced Research Computing

Page 43: Perspectives on Visualization and Science: Communication ... · Remote Visualization Faiz Abidi, Nicholas Polys, Srijith Rajamohan, Lance Arsenault, and Ayat Mohammed. 2018. Remote

Advanced Research Computing: arc.vt.edu

VT Dept. of Computer Science

• www.cs.vt.edu