automatically generating interfaces for multi-device environments jeffrey nichols carnegie mellon...

10
Automatically Generating Interfaces for Multi- Device Environments Jeffrey Nichols Carnegie Mellon University • Intel Research Seattle Workshop #5: Multi-Device Interfaces for Peripheral Interaction The Fifth International Conference on Ubiquitous Computing Seattle, Washington USA

Upload: michelle-maynard

Post on 26-Mar-2015

214 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

Automatically Generating Interfaces for Multi-Device Environments

Jeffrey NicholsCarnegie Mellon University • Intel Research Seattle

Workshop #5: Multi-Device Interfaces for Peripheral InteractionThe Fifth International Conference on Ubiquitous ComputingSeattle, Washington USA

Page 2: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

2

My Problem

Appliances are too complex

Page 3: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

3

Interfaces

Control

Feedback

Specifications

My Solution

Separate the interface from the appliance!

Several ways to separate interfaces• Pre-programmed interfaces on mobile device• Downloadable pre-designed interfaces• Automatic interface generation

Page 4: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

4

1. Single UI device controlling one or more appliances

Three Multi-Device Interactions

Page 5: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

5

Three Multi-Device Interactions1. Single UI device controlling one or more

appliances2. Multiple users controlling an appliance

Page 6: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

6

Three Multi-Device Interactions1. Single UI device controlling one or more

appliances2. Multiple users controlling an appliance3. One user using multiple UI devices to control an

appliance

Page 7: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

7

Personal Universal Controller (PUC)

We have built an automatic interface generation system

• Abstract specification language

• Interface generators for multiple platforms

• PocketPC• TabletPC (Desktop)• Smartphone• Speech (with “Speech Graffiti”

platform)

• Architecture for controlling real appliances

• Windows Media Player (shown)

• Sony DV Camcorder• Axis UPnP Pan-Tilt Camera• Lutron and X10 Lighting• Many others…

Page 8: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

8

Multi-Device UI and the PUC

PUC supports all three multi-device interactions

Third interaction could be improved however• Support for a fluid user experience

Controllers need to know what others are doing

E.g. When light controls are used on one device, other devices also display light controls

• SpecializationCurrently each controller provides access to all appliance functionality with roughly the same structure

Each controller should specialize; provide better access to features that will be accessed from its type of interface

Access to all features should be maintained

Page 9: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

9

AcknowledgementsFunding

• National Science Foundation• Microsoft• General Motors• Pittsburgh Digital

Greenhouse

Equipment Grants• Mitsubishi (MERL)• VividLogic• Symbol Technologies• Hewlett-Packard• Lucent• Lutron• Lantronix

PUC Project Members• Brad A. Myers• Kevin Litwack• Thomas K. Harris• Roni Rosenfeld• Michael Higgins• Joseph Hughes• Rajesh Seenichamy• Mathilde Pignol• Stefanie Shriver• Pegeen Shen• Jeffrey Stylos• Suporn Pongnumkul• Peter Lucas

Page 10: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device

Thanks for listening!

For more information…http://www.cs.cmu.edu/~pebbles/puc/http://www.cs.cmu.edu/~jeffreyn/