the companion metaphor
DESCRIPTION
The Companion Metaphor. Where has attention been focused?. Six Killer Apps. 1. The Travel Companion. 2. The Attention Mediator. 3. The Virtual Roommate. 4. Possession Finder. 5. Emergency Manager. 6. Telephone!. Five Technology Innovations. 1. Voice Interface. 1. Voice Interface. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/1.jpg)
The Companion Metaphor
![Page 2: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/2.jpg)
Where has attention been focused?
Constraints
Location
Platforms
Personal
Connectivity
Coexistence
Social
Global
![Page 3: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/3.jpg)
Six Killer Apps
![Page 4: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/4.jpg)
1. The Travel Companion
![Page 5: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/5.jpg)
2. The Attention Mediator
![Page 6: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/6.jpg)
3. The Virtual Roommate
![Page 7: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/7.jpg)
4. Possession Finder
![Page 8: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/8.jpg)
5. Emergency Manager
![Page 9: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/9.jpg)
6. Telephone!
![Page 10: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/10.jpg)
Five Technology Innovations
![Page 11: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/11.jpg)
1. Voice Interface
![Page 12: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/12.jpg)
1. Voice Interface
• State of Technology– Voice recognition and generation are good enough. – Phone response systems are good but clueless.
• Research– Speaker-dependent dialog– Make agent “natural”.– Support sub-vocalization.
• Experts: Cassell, ML, Rudnicky, Waibel, Zhang
![Page 13: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/13.jpg)
2. Vision Interface
![Page 14: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/14.jpg)
2. Vision Interface
• State of Technology– iPhoto face-recognition trick is startling.– The Army must know a lot….– Local company, Pittpat.com
• Research– Machine learning for recognition.– Acceptable devices.
• Experts: Efros, ML, RI
![Page 15: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/15.jpg)
3. Location and Mapping
• State of Technology– GPS-based systems for drivers are generally successful. – Tom-tom uses crowd sourcing to collect traffic data– Nokia/Berkeley experiment has done the same.– Foursquare, Places, etc. are succeeding. – Point Inside navigates malls.
• Missing Research– The last mile is a problem. Wifi and Bluetooth (Redpin) are not very
dependable (but check recent paper by Biswas & Veloso).– Maps can be difficult to obtain (but see paper by Rosenthal, Biswas, and
Veloso). – Accumulating traveler experience using crowd sourcing might be better, if
owners can be induced to contribute.– Furthermore, maps are not the most cognitively aligned tools for way finding;
learning local landmarks and other methods need to be tried.• Experts: von Ahn, Bareiss, Biswas, Cassell, Forlizzi, Griss, Veloso, Zhang
![Page 16: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/16.jpg)
4. Disposition & Priority Sensing• State of Technology
– Interruptibility. Research on interruptibility needs to be adapted to mobile situations. There is interesting work based on EEG readings.
– Prioritization. There has been extensive research on email filtering, learning from owners’ actions what messages to show them. Gmail represents the start of the art.
– What did Aura and Radar learn?– SenSay, successful student project– Recent work by Stephanie Rosenthal
• Missing Research– Both interruptibility and prioritization need to be conditioned on here and
now. – Develop new owner/device interaction modes using attachments to the
owner’s body. Biometric monitors, sold as a health enhancers, can be used.• Experts: Dabbish, Dey, Griss, Hudson, Pomerleau, Siewiorek, Smailagic
![Page 17: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/17.jpg)
4. Brain Interface?!
Also see John Brockman’s This Will Change Everything
![Page 18: The Companion Metaphor](https://reader035.vdocuments.us/reader035/viewer/2022081502/5681667a550346895dda1b1e/html5/thumbnails/18.jpg)
End