decal-lenses: interactive lenses on surfaces for multivariate...

46
Decal-Lenses: Interactive Lenses on Surfaces for Multivariate Visualization Allan Rocha, Julio Daniel Silva, Usman Alim, Sheelagh Carpendale, and Mario Costa Sousa

Upload: others

Post on 11-Apr-2020

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Decal-Lenses: Interactive Lenses on Surfaces

for Multivariate Visualization

Allan Rocha, Julio Daniel Silva, Usman Alim, Sheelagh Carpendale, and Mario Costa Sousa

Page 2: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Multivariate Surface Data

• Common in several domains: Medicine, Geology, Engineering

• Experts require to interpret and correlate multiple attributes

• Problem of how to visualize multivariate data

Introduction

Page 3: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Multivariate Layered (Superimposed) Visualization on Surfaces

Introduction

[Rocha et al., 2017]

[Meuschke et al., 2018]

[Carnecky et al., 2012]

[Chen et al., 2011]

Page 4: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Multivariate Layered (Superimposed) Visualization on Surfaces

Introduction

[Rocha et al., 2017]

[Meuschke et al., 2018]

[Carnecky et al., 2012]

[Chen et al., 2011]

Clutter problem

Page 5: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

How to augment and manage multivariate

visualizations on surfaces?

Interaction Techniques

Page 6: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Interactive Lenses in Visualization

Introduction

Lenses applied to surface/3D data

[ Tominski et al., 2014, 2017 ]

Page 7: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Interactive Lenses in Visualization

Introduction

FlowLens

[ Tominski et al., 2014, 2017 ]

[Gasteiger et al., 2011]

Page 8: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Interactive Lenses in Visualization

Introduction

FlowLens

Magic Volume Lens

[ Tominski et al., 2014, 2017 ]

[Gasteiger et al., 2011]

[ Wang et al., 2005 ]

Page 9: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Interactive Lenses in Visualization

Introduction

TrajectoryLenses

FlowLens

Magic Volume Lens

[ Tominski et al., 2014, 2017 ]

[ Wang et al., 2005 ]

[Gasteiger et al., 2011]

[Krüger et al., 2013]

Page 10: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Lenses Dimensionality

• 2D – defined in image space

• 2.5 – 2D objects placed in object space

• 3D – volumetric shapes placed in object space

Interactive Lenses for Surface Data

Page 11: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Lenses Dimensionality - Limitations

• 2D – defined in image space

• Lack correlation between the 2D screen position and 3D dataset

• 2.5 – 2D objects placed in object space

• 3D – volumetric shapes placed in object space

Interactive Lenses for Surface Data

Page 12: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Lenses Dimensionality - Limitations

• 2D – defined in image space

• Lack correlation between the 2D screen position and 3D dataset

• 2.5 – 2D objects placed in object space

• 3D – volumetric shapes placed in object space

• Require a high interaction effort

– proper placement and

– alignment within the 3D object

• Do not allow for compositing operations

Interactive Lenses for Surface Data

Page 13: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Interactive Lenses for Surface Data

• Example: Aneurysm Data

• 2.5D Lenses displaying pressure

Page 14: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Our approach

Page 15: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• DG1 – Consider spatial correlation

• DG2 – Facilitate placement

• DG3 – Support scalability

• DG4 – Provide fluid interaction

• DG5 – Consider depth disambiguation cues

Design Goals

Page 16: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Patches of 2D manifolds built to attach smoothly to non-flat surfaces.

• Resemble 2D decals drawn over a surface

• Fundamentally different

• Decals – textures stamped onto surfaces

• Decal-Lenses – F+C interaction technique

Decal-Lenses Concept

Page 17: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Patches of 2D manifolds built to attach smoothly to non-flat surfaces.

• Construction

• May not be a disk

Decal-Lenses Concept

Lens region

Lens boundary

Page 18: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Patches of 2D manifolds built to attach smoothly to non-flat surfaces.

• Construction

• May not be a disk

• Local parametrization

• Blending

• Composition

Decal-Lenses Concept

Page 19: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Demonstration Example

• Aneurysm Data

• Decal-Lenses displaying pressure

Lens comparison: 2.5D Lens vs Decal-Lens

Page 20: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Patches of 2D manifolds built to attach smoothly to non-flat surfaces.

• Construction

• May not be a disk

• Local parametrization

• Blending

• Composition

Decal-Lenses Concept

Page 21: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Patches of 2D manifolds built to attach smoothly to non-flat surfaces.

• Construction

• May not be a disk

• Local parametrization

• Blending

• Composition

• Widgets: Wheel

Decal-Lenses Concept

Page 22: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Earth Data

• Sphere

• computed exactly

• Attributes

Decal-Lenses

Page 23: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Operations over Multiple Decal-Lenses

Page 24: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Lens-regions of arbitrary shapes

• Operations

• Brushing

• Lassoing

• Other operations could be defined

• Decal-lenses are amenable to composition

Operation Over Multiple Decal-Lenses

Page 25: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Brushing

Operation Over Multiple Decal-Lenses

user sketch

sampled positions

Lens-region

decal-lenses

Page 26: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Brushing

Operation Over Multiple Decal-Lenses

Decal-Lens

Page 27: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Lassoing

Operation Over Multiple Decal-Lenses

user sketch

sampled positions

decal-lenses

Lens-region

Page 28: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Lassoing

Decal-Lenses

Page 29: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

GPU Implementation

Page 30: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Decal-Lenses GPU Implementation

Page 31: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Decal-Lenses GPU Implementation

Page 32: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Extensions

Page 33: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Decal-Lenses on Complex Geometry

Brain data

Depth cues

Page 34: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Decal-Lenses on Complex Geometry

Brain data

Depth cues

Page 35: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Decal-Lenses on Complex Geometry

Brain data

See-through window

metaphor

Support Surface

Page 36: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Several ways to define such surfaces

• Related work

• Outer envelopes [Cohen, et al. 2006]

• Text scaffolds [Cipriano & Gleicher, 2008]

• Bounding proxies [Calderon & Boubekeur, 2017]

• Our approach focuses on support surfaces for interaction

Support Surfaces

Page 37: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Support Surface Implementation

Refer to our paper for more details

Page 38: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Decal-Lenses on Complex Geometry

Brain data

See-through window

metaphor

Support Surface

Page 39: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Conclusions

Page 40: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Survey on Interactive Lenses [Tominski et al. 2016]

• Emphasize the need to develop lens techniques

• Simple placement, interaction, and parametrization

• Flexibility of combining lenses

• Reuse of lenses for other datasets in other domains

• Decal-Lenses address the aforementioned requirements

Remarks

Page 41: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Decal-Lenses, a new category of lenses for multivariate visualization

• Possibility to create lens-regions by operating over multiple lenses

• Simple GPU implementation

• Concept of support surfaces for designing interaction techniques

Contributions

Page 42: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Decal-Lenses: Interactive Lenses on Surfaces

for Multivariate Visualization

Allan Rocha, Julio Daniel Silva, Usman Alim, Sheelagh Carpendale, and Mario Costa Sousa

THANK YOU!

contact: [email protected]

Page 43: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

Decal-Lenses: Interactive Lenses on Surfaces

for Multivariate Visualization

Allan Rocha, Julio Daniel Silva, Usman Alim, Sheelagh Carpendale, and Mario Costa Sousa

THANK YOU!

contact: [email protected]

Page 44: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Real-time

• Test up to 5000 lenses

• Limitations

• Multiple rendering calls (one for each decal-lens)

Performance

Page 45: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Local Cameras

• Visualize multiple points of view

• Facilitate data

comparison/correlation

Decal-Lenses

Page 46: Decal-Lenses: Interactive Lenses on Surfaces for Multivariate …visagg.cpsc.ucalgary.ca/.../files/PresentationVIS2018DecalLenses.pdf · Survey on Interactive Lenses [Tominski et

• Qualitative

Evaluation