focus plus context screens patrick baudisch. hardware –at least one hi-res display –at least one...

Focus plus context screens

Patrick Baudisch

• Hardware– At least one hi-res display– At least one larger low-res display

• Software– scaling of the display content is preserved– resolution varies

• <Show video segment>

Focus plus context screens• What it is

• How it works– How to build one– Application scenarios (video)– The software

• Evaluation– What we learned from practitioners (field study)– How much faster, how much more accurate

(lab experiment)

• Conclusions

How to build it?

Setup

Seamless integration of displays

a b

Context

No reflections on focus screen

Focus

Application scenarios

• <Show video here>

How does it work?

The scaling software

• Display image on two display units of different resolution– Similar to two-headed display– but display units are overlapping– and one of them has to be scaled down

• (Related work “Flux capacitor”[Dr. Emmett Brown, 1985])

Linux/VNC

app

focus

contextinput

server

clip

scale

viewer

viewer

Image viewer

context

Photoshop

scale

ACDsee

ACDsee

.gif

.gif

mousefork

input

focus

Evaluation

Field study• Who are the potential users?• Do they lack display space?• What do they currently use?• What tasks should we simulate?

Field study

Subject’s task Document/view

Sta

tic do

cum

en

ts

Web designer Page: 800 pixel

Mechanical engineer Polybot segment: 5cm

Graphic designer Poster: 1m

Architect in remodeling Building: 50m

Photogrammetry (2) Highway 2 miles

Geographic info. system County: 80km

Chip designers (2) Wafer: 12cm

Dyn

am

ic

Air traffic ctrl. tool builder Zone: 50km

Ego shooter gamer Surrounding: 360º

Submarine ROV op. Surrounding: 360º

Strategy gamers (2) Map: 30k pixel

Smallest object

Text: 10 pixel

Pin: 1mm

Text: 1cm

Wall: 10cm

Curb: 6 inches

Trees: 5m

Conductive path: 3m

Airplane: 50m

Distant opponent: 1º

Small fish: 1cm/0.5º

Missile: 3 pixel

Smallest detail Ratio

Table detail: 1 pixel 800

Clearance: 0.03mm 2,000

Align: 0.5mm 2,000

Accuracy: 1cm 5,000

Accuracy: 1 inch 100,000

Land boundaries: 0.5m 160,000

Grid: 0.5m 240,000

Plane distance in 25m steps 2,000

Aiming: 0.1º 3,000

Use arms: 1mm/0.05º 8,000

Aiming: 1 pixel 30,000

?

focus plus context screen VisualizationSame # of pixels

fisheye

55

overview plus detail

44

Display technology

homogeneous resolution

44wall-size, hi-res display

44

What participants

used

What participants

used

Available to½ of participants

Available to½ of participants

Lab experiment• how much faster?• how much more accurate?• how much more satisfying?

Experiment 1:“static documents”

• 3 interfaces:– focus plus context screen– overview + detail– homogeneous

• 2 tasks• 12 subjects from Xerox PARC• Within subjects, counter-balanced• Same number of pixels

Task 1: Closest hotel

8 maps per interface

F+C screen and O+D use same magnification factor

Task 2: Verify connections

Verify a different set of 24 connections on the board

Results

Map task Board task

z+p (N=12) 453.3 (236.6) 568.3 (187.1)

f+c (N=12) 325.0 (176.4) 378.8 (71.2)

o+d (N=12) 414.0 (199.9) 593.5 (232.0)

Average task completion times in seconds (standard dev.)

21% faster21% faster 36% faster36% faster

manually zooming

takes time

manually zooming

takes time

visually switching between

views is ok

visually switching between

views is ok

but reorientation takes time

but reorientation takes time

visually more ambiguous

visually more ambiguous

Experiment 2:Driving simulation

120 sec sequence100 fields of nails; 30 rocks; tradeoff

Results

o+d f+c

Run-over nails 20.9 (10.3) 9.5 (4.1)

Rocks hit 6.6 (3.1) 1.9 (1.9)

Mean number of collisions subjects caused in the car task (and standard deviation).

Error rate only 1/3 of two-

monitor setup

Error rate only 1/3 of two-

monitor setup

Subjects preferred thef+c interface

Subjects preferred thef+c interface

What we learned

• We thought: Chip designers need it

• We learned: Real strength is dynamic content– Have unexpected context information– Two monitoring tasks at the same time

If I had to commercialize today…

• Build all-analog immersive video link– Immersive telepresence,– Remote operated vehicles, drones– Immersive VR– Remote medicine

Publications on f+c screens

[Baudisch, Good, & Stewart, 2001, UIST]

[Baudisch, Good, Bellotti, & Schraedley, 2002, CHI]

[Baudisch & Good, 2002, CHI extended abstracts]

[Baudisch & Good, 2002, CHI video proceedings]

[Baudisch & Good, 2002, SIGGRAPH Emerging Tech.]

[Bhattacharjee, March 14, 2002, New York Times]

Future work: ContextWall

Thanks to:

• Michael Brueckner & Nathaniel Good• Paul Stewart, Victoria Bellotti, Pam Schraedley

• Mark Stefik, Dale McDonald, Rich Gold, RED

• Sacramento Department of Transportation, Monterey Bay Aquarium, NASA

• Our subjects

• Many people at PARC

ENDhttp://www.PatrickBaudisch.com

Extra slides

3D3D

Research in user interfaces

personalizationpersonalization

screen spacescreen space

dynamic information filtering (Ph.D. thesis) paintable interfaces…………………………………… TV program recommender system TV Scout………. user-configurable advertising banners

drag-and-pop…………………………………………. focus plus context screens………………………….. peripheral awareness on handhelds automatic text reduction

3D alignment tool ‘the CAGE’……………………….. virtual TV studio and virtual actors “four pointer” antialiasing method (Masters)

3D3D

Research in user interfaces

personalizationpersonalization

screen spacescreen space

dynamic information filtering (Ph.D. thesis) paintable interfaces…………………………………… TV program recommender system TV Scout………. user-configurable advertising banners

drag-and-pop…………………………………………. focus plus context screens……………………….. peripheral awareness on handhelds automatic text reduction

3D alignment tool ‘the CAGE’……………………….. virtual TV studio and virtual actors “four pointer” antialiasing method (Masters)

Further reading on f+c screens

[1] P. Baudisch, N. Good, and P. Stewart. Focus Plus Context Screens: Combining Display Technology with Visualization Techniques. In Proceedings of UIST ‘01, Orlando, FL, November 2001, pp.31-40.

[2] P. Baudisch, N. Good, V. Bellotti, and P. Schraedley. Keeping Things in Context: A Comparative Evaluation of Focus Plus Context Screens, Overviews, and Zooming. To appear in Proceedings of CHI 2002, Minneapolis, MN, April 2002.

[3] P. Baudisch and N. Good. Focus Plus Context Screens: Displays for Users Working with Large Visual Documents. In CHI 2002 Extended Abstracts (Demo paper), Minneapolis, MN, April 2002.

[4] P. Baudisch. Focus Plus Context Screens. In CHI 2002 Video Summaries, Minneapolis, MN, April 2002.

[5] P. Baudisch and N. Good. Focus Plus Context Screens: Visual Context and Immersion on the Desktop. To appear at SIGGRAPH 2002 (Demo paper), San Antonio, TX, July 2002.

[6] Y. Bhattacharjee. In a Seamless Image, the Great and Small. In The New York Times, Thursday, March 14, 2002.

[7] Baudisch, Good, & Stewart, 2001, 4 patents pending