overview of emerging technologies to define, enhance, and measure health literacy. professor judy...

chai:: Computer human adapted interac1on research group

Overview of emerging technologies to define, enhance, and measure health

literacy

Judy Kay

Human Centred Technology Group, Engineering and IT, University of Sydney SyReNs: Science and Technology of Learning

SyReNs: PLANET… Physical Ac;vity


About me (and CHAI) … HCI-‐techo

•  Inven1ng future technology to tackle important problems

•  Personalisa1on •  Personal data and its management •  PuLng people in control •  Interac1ve surfaces… walls, tables…


Mental models


Mental models

A set of beliefs that the user holds


Mental models

A set of beliefs that the user holds eg. It is healthier not to take medica1ons


Mental models

A set of beliefs that the user holds eg. It is healthier not to take medica1ons

Vaccina1ons are dangerous Sta1ns are dangerous and useless


Ra1onality?


“Be able to keep two completely contradictory ideas alive and well inside

your heart and head at all 1mes”.

Bruce Springsteen (on 37signals)


“Four out of five voices in my head say-‐ "Eat the Chocolate”.

PhD Student T-‐shirt


Complexity?


“I know that you should eat a lot of the Indian spice turmeric, as it fights cancer.

Also that you should avoid the Indian spice turmeric, as it might contain dangerous

levels of lead.

One or the other.”. A.J. Jacobs,

Drop Dead Healthy: One Man's Humble Quest for Bodily PerfecFon


Mental models come from: •  Formal educa1on •  And so much else

–  Experience –  Cultural expecta1ons –  Context –  Emo1onal state –  ….

•  Determining what the user –  Believes to be true –  Trusts –  Feels permiZed to consider and do –  Feeling of competence


Why do mental models maZer for interface designers?


Why do mental models maZer for interface designers?

They define •  what a user can “see” and “hear” •  How they interpret informa;on Clashes between user, programmer, expert MMs


Mental models for Health literacy so\ware and systems

•  Design based on each user’s mental models – Q: Will this user be able to find the informa1on that is relevant to them (given their mental model)?

– Q: Will they understand that informa1on (given their mental model)?

•  Systems that help people – Build awareness of their own mental model – And of alternate views – Be sa1sfied with their interac1on experience


User models

And personalisa1on


User model

•  Computer systems “beliefs” about the user – eg User cannot read graphs – eg. User believes vaccina1on is dangerous

•  Data about a person … big personal data •  Drives personalisa1on

– Personalisa1on is pervasive in search engines and web sites

– can be dangerous …“filter bubbles” … confirma1on and valida1on of personal beliefs


Example… dangerous filter bubbles

User belief: vaccina1on is dangerous


But personalisa1on is everywhere

And does help cope with complexity


Accountable personalisa1on?

PuLng users in control…


User models, personal data, exploi1ng digital footprints….

Open user/learner models (OLMs)


Visible digital footprints so I can compare myself with others


Patina: Dynamic Heatmaps for Visualizing Application Usage (CHI2013) Justin Matejka, Tovi Grossman, and George Fitzmaurice

This user’s footprints

Overall population footprints


Platforms that will give excellent foundations for individuals to learn

Community forma1on

MOOCs

Can create many… Different strokes for different folks

SPOCS

Lots of learning data so we can learn to improve learning

Self-‐paced simula1ons Discussion board

New online learning tools

Kahn Academy, what a student sees after the pre-test

Model of learner

Gamification element

Short video + self-test


Learning Analy1cs and Educa1onal Data Mining

Popula1on level Classroom Teacher Individual


SIV Lots of green means

learner doing well

Weak aspects visible as red

Overview visualisation

Little detail


Technologies to help track and discover personal “reality”

Sensors in our home – like Withings scales

Sensors we wear – like Fitbit, Nike FuelBand,....

Desktop sensors like slife, RSI-prevention sensors,.......


Pervasive displays that help us see “reality”

Lots of displays, some calmer than others

Opportunity

39

Ubiquitous Devices: personal, wearable, portable, pervasive.


Example: pill taking aid

Ambient displays, with subtle meaning, perhaps known only to the owner

Red glow – time to take medication

Green glow .. All on track


Also has mobile-‐phone reminder


The inac1vity problem

Too much siLng For too long without breaks

Blue… active

Inactive > 30 mins


Sharing data

Peers to support each other And compete


The power of peers

Reality is relative!!!


Some new ways to learn

Interactive walls for engaging health education

T. Apted, J. Kay, and A. Quigley. Tabletop sharing of digital photographs for the elderly. In CHI '06: SIGCHI Conf on Human Factors in Computing Systems, pp 781-790, New York, NY, USA, 2006. ACM Press

Older users too


P. Dillenbourg. What do you mean by 'collabora1ve learning'?

discussion?

externalisa1on

diverse exper1se

affec1on

Two hands are beZer than one

building on others argumenta1on

Collabora1ve learning


Summary from an HCI-‐techo

•  User-‐centred design – Understanding users’ mental models – Crea1ng personalised so\ware to aid communica1on, based on user models

– Exploi1ng user models: OLMs, gamifica1on – Learning analy1cs and data mining

•  Pervasive sensing and displays – Capturing “reality” – New learning contexts


Acknowledgements


Interac1ve surfaces

So\ware infrastructure user control, scrutability

Interfaces to user model

Acknowledgements Data mining


Influences…

•  Human-‐Computer Interac1on – Mental models – User models –  Explicit assump1ons

•  Open Learner Models (OLMs)

•  Technology for learning –  Pervasive devices for lifelong awareness, self-‐monitoring

– New places to learn, embedded everywhere –  Personalisa1on, Learning Analy1cs, Data Mining

Learning dashboards: an overview and future research opportunities Katrien Verbert • Sten Govaerts • Erik Duval • Jose Luis Santos • Frans Van Assche •

Gonzalo Parra • Joris Klerkx Pers Ubiquit Comput, 2013

overview of emerging technologies to define, enhance, and measure health literacy. professor judy...

Health & Medicine