a multiple device approach for supporting whiteboard-based interactions (rekimoto, chi98)

20
A Multiple Device A Multiple Device Approach Approach for Supporting for Supporting Whiteboard-based Whiteboard-based Interactions Interactions Jun Rekimoto Jun Rekimoto Sony Computer Science Sony Computer Science Laboratory Inc Laboratory Inc April. 23, 1998 April. 23, 1998

Upload: jun-rekimoto

Post on 04-Jun-2015

957 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

A Multiple Device ApproachA Multiple Device Approachfor Supportingfor Supporting

Whiteboard-based InteractionsWhiteboard-based Interactions

Jun RekimotoJun Rekimoto

Sony Computer Science Laboratory IncSony Computer Science Laboratory Inc

April. 23, 1998April. 23, 1998

Page 2: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

IntroductionIntroduction

WhiteboardWhiteboard - A Shared Idea Space - A Shared Idea Space Important communication media for Important communication media for

informal meetings, collaborative workinformal meetings, collaborative work

Digital WhiteboardDigital Whiteboard Copy & Paste, Rotation, ZoomingCopy & Paste, Rotation, Zooming Picture, MoviePicture, Movie Dynamic SimulationDynamic Simulation Record & Retrieve interaction logsRecord & Retrieve interaction logs

Page 3: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Problems with current digital Problems with current digital whiteboard (whiteboard (wall displaywall display) Design) Design

File Edit View Label Special

Menubar and Toolbox areMenubar and Toolbox arephysicallyphysicallyout of reachout of reach

Text entry isText entry isdifficultdifficult

Handling ofHandling ofexisting dataexisting datais difficultis difficult

Multiple UsersMultiple Users

Page 4: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Page 5: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Traditional ApproachesTraditional Approaches

Modify screen layoutsModify screen layoutse.g., Move Menubar to the bottome.g., Move Menubar to the bottom

Design new widgetsDesign new widgets Use other Interaction techniquesUse other Interaction techniques

gestures, voice, etc.gestures, voice, etc.

Page 6: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

GUI-based solution…GUI-based solution…

File Edit View Label Special

Page 7: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

A Multi-device SolutionA Multi-device Solution

Text

Palmtop Computers

Pick-and-Drop

Page 8: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Wall-sized Display + Palmtop ComputerWall-sized Display + Palmtop Computer

Page 9: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Wireless network

Tool palette

Personalwork buffer

Page 10: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Pick&Drop, Dip&DrawPick&Drop, Dip&Draw

DropDrop

PickPick

Page 11: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Collaborative DrawingCollaborative Drawing

Page 12: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Position sensor

Buttons for itemselection

Page 13: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Physical ToolglassPhysical Toolglass

Change the attribute of digital objects Change the attribute of digital objects by by clicking-throughclicking-through the physical the physical palette.palette.

Page 14: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Selecting & PastingSelecting & Pasting Digital DataDigital Data Free-hand DrawingFree-hand Drawing

Page 15: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Video (4min)

Page 16: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

System ConfigurationSystem Configuration

NetworkNetwork

Wall Size Display

PDAPDA(Palmtop PCs)(Palmtop PCs)

ID Data1 xx.gif

Pen ID = 1Pen ID = 1

Pen ID = 2Pen ID = 2

Pen Manager

Page 17: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Pen IDsPen IDs

Page 18: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

Collaborative DrawingCollaborative DrawingUser Activity PatternsUser Activity Patterns

Palmtop1

Palmtop2

Time

Pen Taps Pick&Drop OverlappingPick&Drop

User1’sActivities

User2’sActivities

Whiteboard

Page 19: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

ExperiencesExperiences

Dynamic transition of personal and Dynamic transition of personal and shared work styles.shared work styles.

Remaining IssuesRemaining Issues Weight of the palette devicesWeight of the palette devices Gaze contactsGaze contacts

Page 20: A multiple device approach for Supporting Whiteboard-based Interactions (Rekimoto, CHI98)

Copyright (C) 1998 Jun Rekimoto CHI 98

SummarySummary

A Multi-Device ApproachA Multi-Device Approachnew way of designing wall-sized new way of designing wall-sized

computer interfacescomputer interfaces Inter-device Interaction TechniquesInter-device Interaction Techniques

Pick&Drop, Dip&DrawPick&Drop, Dip&DrawPhysical Clicking-throughPhysical Clicking-through