living with tableau machine - ubicomp 2008 talk

Living with Tableau Machine: A longitudinal

investigation of a curious domestic intelligence

Zachary Pousman, Georgia Tech

Mario Romero, Georgia Tech

Adam Smith, UC Santa Cruz

Michael Mateas, UC Santa Cruz

Living with Tableau Machine: A longitudinal

investigation of a curious domestic intelligence

Zachary Pousman, Georgia Tech

Mario Romero, Georgia Tech

Adam Smith, UC Santa Cruz

Michael Mateas, UC Santa Cruz

Everyday domestic lifeCapture it (Computer vision)

Interpret it (Artificial Intelligence)

Represent it (Generative Graphic Design, HCI)

Conversation, reflection

A social ‘actor’

&

A mirror of life

Say hello to Tableau Machine

Tableau MachineSystem Implementation Overview

Tableau MachineSystem Implementation Overview

Energy

Density

Flow

Tableau MachineSystem Implementation Overview

Quiet times(watching TV, reading...)

Active times alone(vacuuming, exercising...)

Social times(family meals, homework, games...)

Wild times(play, fighting, parties...)

Investigating

Tableau MachineLongitudinal Investigation

• Three households in Atlanta GA

• 6-8 weeks

• Elicitation techniques:

• Interviews

• Feltboard

• Wordgame

• Print outs

• Broken (misconfigured) TM

Household A

Household B

Household C

The Broken TM Household A

The Broken TMTrajectory of Appreciation, Gaver et al. 2005

Household A

The Broken TMTrajectory of Appreciation, Gaver et al. 2005

“Natural Experiment”

Household A

Experiments

Household AAndrew: No pictures are ever two the same. I’ve already tried to do that.

Interviewer: Is that right? You tried to do that? How did that work?

Andrew: ... So yeah, no, there was no one else in the house. So I just sat right here and I was just [he mimes holding still],

and I was looking at it and looking at it and...

But I could never get it, the same exact image. ... Well that’s what I’m trying to figure out, if it’s taking numbers, images, from [the cameras], then why is it not the same picture every time? You know?

Household A

Waving at the cameras (kids)

Turning off and on lights

Household C

Waving at the cameras (kids)

Wailing on the floor while momwatched from the dining room

‘NIKO’

Household C

Printing

Household B

Printing

Household A

Household C

Household B

Average 1.46 / day

Average 3.16 / day

Average 12.64 / day

Deepening of Reflection

Household C

(Hints of) Personality

Household C

Feelings of being watched

Charlie: [pointing up] his spies...

Carla: Yeah, he calls it Niko and his spies.

Interviewer: Really, ‘Niko and his spies’?

Carla: Yeah.

Household A

Household C

Household B

Household C

- All 3 Mothers changed behaviors

- Aloneness as privacy

Implications for Ubicomp designCo-interpretation

Implications for Ubicomp designActivity Recognition + Activity Characterization

Household Management

Outdoor ActivitiesIndoor Activities

Household life

Cooking

Cleaning Yard work

Att

ribute

you c

are

about

Attribute you care about

Exterior maintenance

Implications for Ubicomp designActivity Recognition + Activity Characterization

Household Management

Outdoor ActivitiesIndoor Activities

Household life

Cooking

Cleaning Yard work

Exterior maintenance

Att

ribute

you c

are

about

Attribute you care about

Implications for Ubicomp designCameras in the home

Thanks! Questions?

We acknowledge the support of NSF IIS-0752684. We also want to thank our participant families, our advisors (John Stasko and Gregory Abowd), draft readers, reviewers and shepherd.

Zach Pousman : zach@cc.gatech.edu

Mario Romero : mromero@cc.gatech.edu