a multiple device approach for supporting whiteboard-based interactions (rekimoto, chi98)

A Multiple Device ApproachA Multiple Device Approachfor Supportingfor Supporting

Whiteboard-based InteractionsWhiteboard-based Interactions

Jun RekimotoJun Rekimoto

Sony Computer Science Laboratory IncSony Computer Science Laboratory Inc

April. 23, 1998April. 23, 1998

Copyright (C) 1998 Jun Rekimoto CHI 98

IntroductionIntroduction

WhiteboardWhiteboard - A Shared Idea Space - A Shared Idea Space Important communication media for Important communication media for

informal meetings, collaborative workinformal meetings, collaborative work

Digital WhiteboardDigital Whiteboard Copy & Paste, Rotation, ZoomingCopy & Paste, Rotation, Zooming Picture, MoviePicture, Movie Dynamic SimulationDynamic Simulation Record & Retrieve interaction logsRecord & Retrieve interaction logs

Copyright (C) 1998 Jun Rekimoto CHI 98

Problems with current digital Problems with current digital whiteboard (whiteboard (wall displaywall display) Design) Design

File Edit View Label Special

Menubar and Toolbox areMenubar and Toolbox arephysicallyphysicallyout of reachout of reach

Text entry isText entry isdifficultdifficult

Handling ofHandling ofexisting dataexisting datais difficultis difficult

Multiple UsersMultiple Users

Copyright (C) 1998 Jun Rekimoto CHI 98

Copyright (C) 1998 Jun Rekimoto CHI 98

Traditional ApproachesTraditional Approaches

Modify screen layoutsModify screen layoutse.g., Move Menubar to the bottome.g., Move Menubar to the bottom

Design new widgetsDesign new widgets Use other Interaction techniquesUse other Interaction techniques

gestures, voice, etc.gestures, voice, etc.

Copyright (C) 1998 Jun Rekimoto CHI 98

GUI-based solution…GUI-based solution…

File Edit View Label Special

Copyright (C) 1998 Jun Rekimoto CHI 98

A Multi-device SolutionA Multi-device Solution

Text

Palmtop Computers

Pick-and-Drop

Copyright (C) 1998 Jun Rekimoto CHI 98

Wall-sized Display + Palmtop ComputerWall-sized Display + Palmtop Computer

Copyright (C) 1998 Jun Rekimoto CHI 98

Wireless network

Tool palette

Personalwork buffer

Copyright (C) 1998 Jun Rekimoto CHI 98

Pick&Drop, Dip&DrawPick&Drop, Dip&Draw

DropDrop

PickPick

Copyright (C) 1998 Jun Rekimoto CHI 98

Collaborative DrawingCollaborative Drawing

Copyright (C) 1998 Jun Rekimoto CHI 98

Position sensor

Buttons for itemselection

Copyright (C) 1998 Jun Rekimoto CHI 98

Physical ToolglassPhysical Toolglass

Change the attribute of digital objects Change the attribute of digital objects by by clicking-throughclicking-through the physical the physical palette.palette.

Copyright (C) 1998 Jun Rekimoto CHI 98

Selecting & PastingSelecting & Pasting Digital DataDigital Data Free-hand DrawingFree-hand Drawing

Copyright (C) 1998 Jun Rekimoto CHI 98

Video (4min)

Copyright (C) 1998 Jun Rekimoto CHI 98

System ConfigurationSystem Configuration

NetworkNetwork

Wall Size Display

PDAPDA(Palmtop PCs)(Palmtop PCs)

ID Data1 xx.gif

Pen ID = 1Pen ID = 1

Pen ID = 2Pen ID = 2

Pen Manager

Copyright (C) 1998 Jun Rekimoto CHI 98

Pen IDsPen IDs

Copyright (C) 1998 Jun Rekimoto CHI 98

Collaborative DrawingCollaborative DrawingUser Activity PatternsUser Activity Patterns

Palmtop1

Palmtop2

Time

Pen Taps Pick&Drop OverlappingPick&Drop

User1’sActivities

User2’sActivities

Whiteboard

Copyright (C) 1998 Jun Rekimoto CHI 98

ExperiencesExperiences

Dynamic transition of personal and Dynamic transition of personal and shared work styles.shared work styles.

Remaining IssuesRemaining Issues Weight of the palette devicesWeight of the palette devices Gaze contactsGaze contacts

Copyright (C) 1998 Jun Rekimoto CHI 98

SummarySummary

A Multi-Device ApproachA Multi-Device Approachnew way of designing wall-sized new way of designing wall-sized

computer interfacescomputer interfaces Inter-device Interaction TechniquesInter-device Interaction Techniques

Pick&Drop, Dip&DrawPick&Drop, Dip&DrawPhysical Clicking-throughPhysical Clicking-through