Real-Time Multi Resolution

Labeling in 3D GISDamien Saunder

Overview

• Why labeling is important?

• 3D scene examples

• The popularity of 3D

• 12 important 3D labeling challenges

• Inspiration

• Wrap up

Why is labeling important?

• Labels are a critical part of any map.

• They drive cognitive association between

abstract symbols and real-world objects

and places.

Mount Everest, National Geographic, 1988

Labels serve other functions

• Help focus attention

• Aid spatial orientation

• Denote measurements and quantities

• Establish overall look-and-feel of a map

• Serve as both a functional and aesthetic

role

AZ London Atlas

Traditional labeling

• Labeling has been largely a manual

process (pre early 2000’s).

• Automated text labeling has been on the

research agenda for several decades.

• Maplex introduced in 2003 (AcrGIS 9)

• ArcGIS Pro supports 3D labeling*

Today

• The internet and mobile devices are

driving a new wave of automated

real-time labeling challenges.

• 3D is now common place in GIS.

• Users expect the same experience in

3D that they have in 2D (inc. labeling)

A collection of 3D scenes/maps

3D Cartography

Apple Maps

Here Maps

3D – New labeling problems

• 3D scenes present a surprisingly large

set of new labeling problems.

• And, these remain largely unexplored.

12 common issues

3D labeling challenges

Extremely dynamic views

• Moving observer, fixed target

• Moving observer, moving target

• Fixed observer, moving target

Observer(camera)

Target(on map)

Projections

Oblique Axonometric Globe

(view from space)

Interaction - Swiping

• User interactions change the view of the

map in rapid time.

• How do labels transition from the current

view to the new view?

Interaction - Sensitivity

• The goal is to add context to the map, we

must not distract the user in doing so.

• How sensitive should the labeling be to

user interaction?

Priority ranking

• Important features should get labeled

first. They should trump insignificant

features.

• What are the rules?

- Theme based

- Where space permits

- Does foreground always trump

background?

- Closest to camera

- Tallest features, largest features

- Occlusions

Near realism v models of reality

• Two very different types of 3D scenes

may require different labeling logic.

• Do we apply the same rules?

Near realism Grayscale Model

Billboarding

• Traditionally 3D labeling has relied

heavily on billboading.

• But when should we use it?

• How do we transition between

billboarded labels and surface labels?

Drape or detach

• Labeling can applied to 3D features in a

number of ways.

• Do we drape (apply labels directly to

features)?

• OR, detach labels from features either

using leader lines or floating nearby?

J. Dollner

Drape

Detach

Distance from camera

• 3D scenes have an infinite number of

zones through the scene.

• How do we deal with this?

- Size reduction

- Reduce density of features

- Use leader lines on the horizon

- Apply transparency

Peripheral vision

• Extremely important for orientation and

contextual awareness.

• How do we handle labels outside of our

primary field of view?

Department of Transport

Performance

• We think in milliseconds. Users expect

instantaneous responses to their

actions.

• The last thing we want to do is kill their

3D experience with slow labeling.

• What are the performance

bottlenecks/trade-offs and how might

this influence the approaches we take?

Inspiration

• Other industries are leading the way.

• What can we learn from them?

- Motion design

- Augmented reality

- Advertising

- Animation

JApple Perspective video, iPhone 6 Keynote

Augmented reality (source unknown)

Conclusion

• 3D GIS and cartography is here to stay.

• Labels are extremely important to further

understand 3D scenes*

• We’re holding unbelievable CPU and

GPU power in our pockets.

• Real-time 3D multi-resolution labeling is

expected, and is fast becoming the norm.

Damien Saunder

dsaunder@esri.com