![Page 1: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/1.jpg)
IBM Research
June 14, 2007
An IP Continuum forAdaptive Interface Design
Jeff [email protected]
© 2007 IBM Corporation
![Page 2: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/2.jpg)
2
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Two preliminary comments
Unindicted co-conspirator: Charles Isbell– Assistant Professor in College of Computing @ Georgia Tech
– AI researcher, primarily machine learning
– Co-director of APIE lab
– Adaptive Personalized Information Environments
Questions, few answers– Primarily work done at Georgia Tech
![Page 3: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/3.jpg)
3
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Design of Adaptive (“Intelligent”) Interfaces
Common goal: “right” information / action at the “right” time in the “right” way
Traditional approaches:– Provide people with access to information / commands
– Use AI to present information / act automatically
Challenges:– People
– AI
![Page 4: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/4.jpg)
4
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
People are…
Forgetful Easily distracted Idiosyncratic Inconsistent Short-sighted
… but still surprisingly good at many tasks
![Page 5: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/5.jpg)
5
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Artificial Intelligence is…
Short on intelligence Easily mistaken Slow to learn Limited by available information Dependent on feedback
…but surprisingly good at finding patterns given sufficient data
![Page 6: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/6.jpg)
6
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Challenge
Draw on the strengths of people and AI while mitigating their weaknesses
– Combine HCI + Machine Learning
Obvious questions: how?
![Page 7: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/7.jpg)
7
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
One answer
Mixed-initiative user interfaces– No Action – Dialog – Action
Horvitz ’99
![Page 8: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/8.jpg)
8
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Example Case: Helping users make better decisions in the morning
Hunt ‘02Wesveen et al ‘01
Approach: next-generation alarm clock No Action – Dialog – Action doesn’t work particularly
well here
![Page 9: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/9.jpg)
9
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
An Alternative: The IP Continuum
![Page 10: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/10.jpg)
10
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Night Before
Decisions: alarm time, what to wear Displays unusual: schedule, weather
Unusual Usual
![Page 11: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/11.jpg)
11
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
During Alarm
Decisions: when to get up Displays unusual: schedule, weather, traffic
Unusual Usual
![Page 12: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/12.jpg)
12
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
After Alarm
Decisions: what to wear, when to leave Displays unusual: schedule, weather, traffic
Unusual Usual
![Page 13: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/13.jpg)
13
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
IP Continuum
Who is responsible for accomplishing a particular task?
HCI AIAdaptive / Intelligent User Interfaces
![Page 14: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/14.jpg)
14
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
IP Continuum
Particular labels (content and position) not important; relative responsibility is
Tool for inspiring and comparing alternative designs
Not really intended to be prescriptive (at least not yet)
![Page 15: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/15.jpg)
15
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
IP Continuum
Associated metrics– Benefit to user (when right)
– Cost to user (when wrong)
– Attention requirement
– Likelihood of success
– Frequency of action
– Quantity and quality of data required
– Quantity and quality of feedback required
– Cost of gathering data
– Resource costs (e.g. storage, processing)
![Page 16: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/16.jpg)
16
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
IP Continuum
Benefit to user (when right)vs.
Cost to user (when wrong)
No benefit,no cost
Much benefit,much cost
![Page 17: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/17.jpg)
17
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
IP Continuum
– Attention requirement
– Likelihood of success
– Frequency of (user) action
Higher Lower
![Page 18: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/18.jpg)
18
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
IP Continuum
– Quantity and quality of data required
– Quantity and quality of feedback required
– Cost of gathering data
– Resource costs (e.g. storage, processing)
Lower Higher
![Page 19: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/19.jpg)
19
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Deployed examples: simple assistance
![Page 20: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/20.jpg)
20
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Deployed examples: independent action
![Page 21: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/21.jpg)
21
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Deployed example: act with recovery
![Page 22: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/22.jpg)
22
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Research project examples
Alarm ClockNext-generation calendarEmail attachments reminderNext-generation remoteSWIMM: personalized “radio stations”
![Page 23: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/23.jpg)
23
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Next-Generation Calendar
Draw attention to infrequent, uncommon meetings
![Page 24: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/24.jpg)
24
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Attachments Reminder
Help user remember to add attachments
Problem: 85% accuracy
Small study: 19 participants
Most popular:
Highlight attach button (D)
Two-step send (E)
![Page 25: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/25.jpg)
25
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Next-Generation Remote
Allow a single remoteto control multiple devices
![Page 26: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/26.jpg)
26
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Next-Generation Remote
![Page 27: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/27.jpg)
27
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
SWIMM
Provides, in essence, personal radio stations
![Page 28: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/28.jpg)
28
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Some open questions
What determines where an application fits?– Where a particular feature of an application fits?
How much variation is there between users?– Spam filters
How much variation is there over time?– In most cases probably shift from left to right, but how much?
Can we be more rigorous about the relative positions of potential interface designs?
![Page 29: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/29.jpg)
29
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Comment: care and feeding of learning systems
![Page 30: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/30.jpg)
30
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Explicit vs. implicit feedback
Explicit– Intentional, high quality
– Costly (to user), low quantity
Implicit– Side effect, low(er) quality
– Free, high quantity
![Page 31: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/31.jpg)
31
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Designing interfaces for feedback
Alternate focus for interface design– Instead of “usability”, “efficiency”
Maximize the quality and quantity of feedback you extract
– Use feedback to drive improvements in usability, efficiency
![Page 32: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/32.jpg)
32
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
SWIMM
Explicit– Never
– Not now
– Not here
– Rating
Implicit– Song completion
– Song reordering
– Change volume
![Page 33: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/33.jpg)
33
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Current work: Personal Information Environments
![Page 34: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/34.jpg)
34
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Personal Information Environments
![Page 35: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/35.jpg)
35
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Examples Services
![Page 36: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/36.jpg)
36
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Information, commands, activities
How can your devices collaborate to improve your interaction experience?
![Page 37: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/37.jpg)
37
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Conclusions & Future Work
The IP continuum is a tool to inform / guide the design of adaptive / intelligent UIs
Possible next steps:– Amass experience from a variety of application domains
– Distill design principles
– How to guide choice of region for particular application– …and possibly user(s)
– Quantify trade-offs along continuum (?)
– Explore approaches to designing for feedback
![Page 38: IBM Research June 14, 2007 An IP Continuum for Adaptive Interface Design Jeff Pierce jspierce@us.ibm.com © 2007 IBM Corporation](https://reader036.vdocuments.us/reader036/viewer/2022070410/56649eac5503460f94bb278b/html5/thumbnails/38.jpg)
38
IBM Research
An IP Continuum for Adaptive Interface Design | Jeff Pierce © 2007 IBM Corporation
Questions?