wearable computing: healthcare, human factors and privacy

WearableCompu-ngHealthcare,HumanFactorsandPrivacy

VivianGenaroMo9AssistantProfessor

DepartmentofInforma?onSciencesandTechnologyVolgenauSchoolofEngineering

UniversidadCatólicadeSanPablo

Arequipa–PeruMarch29th,2016

AboutMe

I2016

I2014

I2010

I2007

I2003

MainResearchInterests

HCI

UbiComp

HealthInforma?cs Privacy

3

Goal

•  Bringtechnologicalsolu?onsclosertousers’lives–  Tosupport,facilitate,help,enhancedailyac?vi?es–  Educa?on– Healthcare

•  Understandusers’perspec?ves–  Theirneeds,interests,requirements,wishes,expecta?ons

4

WearableCompu?ng

•  Largepoten?al

– Numerousapplica?ondomains

–  Versa?leSolu?ons

•  Con?nuoususage

•  Accessible[MOTTI, V. G.; KOHN, S.; CAINE, K. WearableCompu?ng:AHuman-centeredViewofKeyConcepts,Applica?on Domains, and Quality Factors. 2014. InMobileHCI'2014.] 6

FormFactors•  Anklet•  Armband•  Backband•  Belt•  Bra•  Bracelet•  ContactLenses•  ChestMounted•  Earring •  Earpiece •  Glasses

•  Glove •  Headphones•  Headmounted•  Helmet •  Jacket•  Necklace •  Pajamas•  Pendant•  Ring•  Shirt•  Shoes

•  Watch•  Wristmounted

theconnec?vist.com 7

Sensors�  Accelerometer

�  Altimeter

�  Bio-acoustic

�  Blood Pressure (BP)

�  Brightness

�  Camera

�  Compass

�  ECG (Electrocardiogram)

�  EDA (Electro dermal Activity)

�  EEG (Electroencephalogram)

�  Electrodes

�  EMG (Electromyogram)

�  EOG (Electrooculogram)

�  Fiber Optic Sensors

�  Fiber Sensors

�  Glucometer

�  GPS

�  GSR

�  Gyroscope

�  Humidity

�  Inductive Wires

�  Inertial Measurement Units (IMU)

�  IR LED + IR photodiode

�  IR photo reflective

�  IR proximity

�  IR temperature

�  LED + Photodiode

�  Magnetic Coils

�  Microphone

�  Optical Sensor

�  Oximeter

�  Piezoelectric/resistive

�  Pressure

�  PSG (Polysomnogram)

�  Respiration

�  RFID

�  Spectrometer

�  Thermometer

�  Textile Sensors

�  Ultra-sound (US)

�  Ultra-violet (UV)

�  Weight

8

Poten?alBeneficiaries

Owlet

[Kunze, et al. 2014. Wearablecompu?ng for older adults: ini?alinsights into head-mounted displayusage.InUbiComp'14]

10

LargePoten?alandUse

11

Challenges

•  Costs

•  Mo?va?ons– TechnologyandUX

•  Engagement– Learningandhabit:wear,charge,sync

Users’Engagement

•  MorethanhalfofU.S.consumerswhohaveownedanac?vitytrackernolongeruseit

•  AthirdofU.S.consumerswhohaveownedonestoppedusingthedevicewithin6monthsofreceivingit

[Ledger,D.,&McCaffrey,D.(2014).InsideWearables:HowtheScienceof

HumanBehaviorChangeOfferstheSecrettoLong-TermEngagement]

15

Why?

•  Wearabledeviceshavealowwearability–  sensor,baqeryandon-bodyhardwaresizetendstobetoobulky

[Pantelopoulos,A.,&Bourbakis,N.(2008).ASurveyonWearableBiosensorSystems

forHealthMonitoring,4887–4890.]

16

•  Simplyshrinkingdowncompu?ngtoolsfromthedesktopparadigmtoamoreportablescaleonlymakesthemintominiPC’s

•  Itdoesnottakeadvantageoftheopportuni?espresentedbyawholenewcontextofuse

•  Itdoesnotregardthehumanbodyasacontext

[Gemperle,F.,etal.(1998).Designforwearability.

2ndISWC]

Paradigma?cShir

17

HumanintheLoop

•  Designprocessfocusedontheuser– Heterogeneousprofiles– Differentneeds,wishes,requirements,preferences

– Dynamiccontextsofuse

•  Iden?fyandconsidertheirperspec?ves

18

Goal

•  Iden?fyhuman-centereddesignprinciplesrelevantforwearablecompu?ng

•  Integratehumanfactorssinceearlydesignstagesofwearableapplica?ons

•  Impactusers’acceptance,sa?sfac?on,sustainedengagement

19

BridgingtheGap

•  Tounderstandusersperspec?ve–  Iden?fytheirkeyconcerns– Analyzetheirinterac?on–  Iden?fytheirpreferencesandexpecta?ons– Translateintodesignrequirements

20

LatestResearch

OngoingWork

FutureDirec?ons

Wearables•  LiteratureReview– MobileHCI’14:StateoftheArtInWearableCompu?ng–  ASGA4Health’15:WearableHealth:Opportuni?esandChallenges

–  HFES’14:Human-CenteredDesignPrinciples–  HFES’15:Interac?onParadigms

•  OnlineReviews+UserStudies–  ISWC’14:WearabilityFactorsofHeadMountedDevices– WearableSecurity&Privacy’15:KeyUsers’Concerns– WristSense’15:DesignRecommenda?onsforWristWornDevices

–  SigDoc’16:SmartwearablesorDumbwearables?

22

DesignPrinciples•  Systema?cLiteratureReview

–  Keydesignprinciplesforsuccessfulwearableapplica?ons–  Retrospec?veapproach

•  Wearabledevices–  18formfactors:“anklet”,“armband”,“belt”,“bra”,“bracelet”,“contactlenses”,“chestmounted”,“earring”,“earpiece”,“glasses”,“glove”,“headphone”,“headmounted”,“necklace”,“ring”,“shirt”,“shoe”and“watch”

–  4digitallibraries:ACMDL,IEEEXplore,Springer,GoogleScholar

•  Human-centeredprinciplesandqualityfactors

23

PhysicalAspects

•  Aesthe?cs

•  Fashion

•  Affordance

•  Comfort

•  Obtrusiveness

•  Subtlety

SonyHMz-T1

Polarband

24

HumanFactors

•  EaseofUse

•  Ergonomic

•  Intui?veness

•  User-friendliness

•  Simplicity

•  Cogni?veload

•  Sa?sfac?on

UVRing

Smartwatch

25

QualityFactors

•  Privacy

•  Reliability

•  Resistance

•  Responsiveness

•  Contextual-awareness

•  Customiza?on

Glucometer

Glass

26

WearabilityPrinciples

[MOTTI, V. G. & CAINE, K. E. (2014). Human FactorsConsidera?ons in the Design of Wearable Devices.Proceedings of the Human Factors and ErgonomicsSociety 2014 Annual Mee?ng. Chicago, IL: HumanFactorsandErgonomicsSociety.September2014vol.5 8 n o . 1 p g . 2 0 5 - 2 0 9 d o i :10.1177/1541931214581381]

27

OnlineReviews

•  Onlinecommentaries– Sources– 33devices– Users:endusersandprospec?ve

•  Quan?ta?veandQualita?veanalysis– Coding– Quan?fying– Wordtrees

28

HeadMountedDevices

29

WordTrees

30

Qualita?veAnalysis

•  Keywords:whatusers–  Like– Dislike– Hate– Wish–  Expect– Wonder– …

32

[MOTTI, V. G. & CAINE, K. E. (2014). Understandingthe Wearability of Head-mounted Devices from aHuman-Centered Perspec?ve. In Proceedings of the2014 ACM Interna?onal Symposium on WearableComputers (ISWC '14). ACM, New York, NY, USA,83-86. DOI=10.1145/2634317.2634340 hqp://doi.acm.org/10.1145/2634317.2634340] 34

WristSense:DesignRecommenda?ons

[Lowens, B.; Mo9, V. G.; Caine, K. 2015. DesignRecommenda?ons to Improve the User Interac?onwithWristWorn Devices.WristSense:Workshop onSensing Systems and Applica?ons UsingWristWornSmartDevices.St.Louis,MS.]

Graphic DurabilityReadability

‘[thedevice]scratcheseasily’‘Isuggestwearingitwiththedisplayinsideyourwrist,notontheoutside.It'smucheasiertoreadthatway.’

Gesture AccuracyContext-sensi-veness

‘toomanyerrorsinthedevicetryingtofigureoutwhatisastep&whatisahandmovement’‘ifyousweattoomuchIguess,thewatchloosescontactwithyourskin’

Tac-le EaseofUse ‘Don'tneed--orwant--touchforsuchasmallscreen.Thetouchtargetswouldbetoosmall,andtouchfunc?onalitywouldaddunwantedbulk’

35

WearablePrivacy

[MOTTI,V.G.;CAINE,K.E.(2015).Users'PrivacyConcernsAbout Wearables: Impact of Form Factor, Sensors andType of Data Collected. In 1st Workshop on WearableSecurity and Privacy in associa?onwith Financial Crypto2015.]

36

Surrep??ousVideoRecording

–  ‘Idobelievethereisadifferencebetweensnappingpictureswithsomethingwhichisobviouslyacamera,andrecordingvideosurrep::ously…’

37

SocialImplica?ons

•  ‘peoplewhodon'tliketobecontrolledandsupervised.Remember,itdoesnotjustrecordyourac/vi/es,butalsoac/vi/esofpeoplearoundyou’

38

RighttoForget

•  ‘itgivesarecordofeverythingyou’vedone,dayinanddayout,possiblyevensomethingsyoudon’twanttoberemindedof’

39

Loca?onDisclosure

•  ‘…stalkersknowwhereyouareatall/mesoftheday,knowwhenyougotosleep,ridingacar,orclimbingamountain’

40

Users’ConcernsonPrivacy

•  ‘Ireallyneverthoughtaboutitthatdeeply’

•  ‘...I’vekindofacceptedthat’s,youknow,pickyourpoison,andthat’sjustsomethingIruntheriskoftousetheseapplica:ons...Idon’ttrustthembutIgoaheadandusetheirproductsanyways.[GoogleGlassuser]’

41

Privacy

•  Authen?ca?on

•  Access

•  Storage

•  Confiden?alitylevels– Datatypevs.users’group

•  Policies

42

Implica?onsonWearablePrivacy•  Whatdataarecollected?

–  Howisitshared?–  Howisitstored?

•  Privacypolicies–  Confiden?alitylevelsvs.sharing–  Socialimplica?ons(third-par?es)

•  Keyrequirements–  Accessibleprivacyse9ngs–  Abilitytocontrol,visualize,andmodifytheprivacyse9ngs–  Leveragetheburden:nudging

43

WearableHealth

GoogleTrends-2010to2015

•  Domains:cardiology,pediatrics,obstetrics,neonatology,oncology,neurology,psychiatry

•  Stages:preven?on,diagnose,treatment,rehabilita?on

•  Beneficiaries:babies,kids,teens,adults,olderadults,pa?ents,medicalprac??onersandcaregivers

WearableHealthLandscape

DomainsMedicalPrac??oners

Caregivers

StagesUVring:Skincancer

SunSprite:Seasonaldepression

BeneficiariesOlderAdultsinAmbientAssistedLiving

Baby–monitoringofvitalsigns:Owletsocks

[Source:Kunzeetal.,2014]

WearableHealthLandscape

• Alcoholism• PregnancyMonitoring• EmergencyResponse• Cancer• ObesityandOverweight• SmokingCessa?on

• Panicaqacks• Bipolardisorder• Au?smspectrum• Depression• StressManagement• ObsessiveCompulsiveB.

• Diabetes• Alzheimer• Epilepsy• Parkinson• Crohn’sdisease

• Blindness• Color-blindness• Hearingimpairments• Motorimpairments

Assis?veTechnology

ChronicDiseases

MedicalCondi?ons

MentalHealth

Assis?veTechnologies

ChronicDiseases

•  Diabetes•  Alzheimer•  Parkinson•  Epilepsy•  Chron’s

MentalHealth

MoodnoteApphqp://www.wired.com/2015/08/moodnotes-app-like-personal-trainer-for-mental-health/

MedicalCondi?ons

[Tempdrop]

[Lumo]

hqp://www.tnooz.com/wp-content/uploads/2015/08/1a-wearable-tech-FULL.jpg

Preven?onUVring:Skincancer

SunSprite:Seasonaldepression

Diagnose•  Trauma?cBrainInjuries

[Source:Ning,K.Smartunderwearandfemalehealth,2013]

Monitoring

[Source:Pohetal.CardiovascularMonitoringUsingEarphonesandaMobileDevice,2012]

[OMSignal]

[Moodnotes]

Treatment

Glucometer+

Insulinepump

Rehabilita?on

[Source:Edgar,S.etal.Wearableshoe-baseddeviceforrehabilita?onofstrokepa?ents,2010]

BehaviorChange

•  Largepoten?alforlifestylechanges

–  Improvingposture– Monitoringstresslevels– Smokingcessa?on–  Increasingac?vitylevels–  Improvingea?nghabits

SmokingCessa?on

StopSmoking!!ForWearhqps://play.google.com/store/apps/details?id=org.chrjs.wearsmoking

MovesApp

Humana’sCueApp

•  Drinkwater•  Stretch•  Breath•  Straightenup•  Gooutside

CommonRequirements

•  Datacollec-on– Accurate,flawlessly,con?nuous

•  Dataprocessing–  Interpreta?on,es?ma?on,filtering

•  Datavisualiza-on– Progressalong?me,amongpeers,easytoaccess,lightweightsolu?on

•  Interven-on

Benefits

KeyChallenges

•  InterfacesandInterac?on– Transientrequirements,contextchanges,limitedresources

•  Self-diagnose– Shirhealthcaretoapa?ent-centricparadigm

•  Valida?on– Precision,personaliza?on,calibra?on,error

•  Risks– Es?ma?on,assump?on

Accuracy

[Source:YangBai,etal.,ComparisonofConsumerandResearchMonitorsunderSemistructuredSe9ngs,2015]

Opportuni?es

•  Behaviorchange– Monitoring,visualizing,assis?ng

•  Dataanalysis•  Epidemiologicaltrends•  Peerhealth•  Precisionmedicine

Trends•  Microrobots

Conclusion

•  Wearablehealthhasapromisingpoten?alforpromo?ngandimprovingmedicalcare,butcurrentsolu?onsares?llintheirinfancy

•  Furthereffortsareneededun?lwearabletechnologiesbecomeaccessible,safe,andpopular

Acknowledgments

ThismaterialisbaseduponworksupportedbytheNa?onalScienceFounda?onunderGrantNo.1314342.Anyopinions,findings,andconclusionsorrecommenda?onsexpressedinthismaterialarethoseoftheauthor(s)anddonotnecessarilyreflecttheviewsoftheNa?onalScienceFounda?on.

Q+A

•  [email protected]

References•  YangBai,GregoryJ.Welk,YoonHoNam,JoeyA.Lee,Jung-MinLee,

YoungwonKim,NathanFMeier,PhilipM.Dixon.ComparisonofConsumerandResearchMonitorsunderSemistructuredSe9ngs.Medicine&ScienceinSports&Exercise,2015;1DOI:10.1249/MSS.0000000000000727

•  BoujarwahF.Aetal.2010.UnderstandingtheChallengesandOpportuni?esforRicherDescrip?onsofStereotypicalBehaviorsofChildrenwithASDAConceptExplora?onandValida?on.ASSETS’10,2010,

•  Carrington,P.,Hurst,A.,Kane,S.WearablesandChairables:InclusiveDesignofMobileInputandOutputTechniquesforPowerWheelchairUsers.CHI´14,(2014),3103–3112.

•  Dong,Y.,Hoover,A.,Scisco,J.,&Muth,E.2012.Anewmethodformeasuringmealintakeinhumansviaautomatedwristmo?ontracking.AppliedPsychophysiologyandBiofeedback,37(3),205–215.doi:10.1007/s10484-012-9194-1

•  Fujiki,Y.,Kazakos,K.,Puri,C.,Buddharaju,P.,Pavlidis,I.2008.NEAT-o-Games:BlendingPhysicalAc?vityandFunintheDailyRou?ne,6(2).

•  GrönvallE,VerdezotoN(2013)Beyondselfmonitoring:understandingnon-func?onalaspectsofhome-basedhealthcaretechnology.ProceedingsoftheUbiComp’13,587–596.

Links

•  hqp://www.sciencemag.org/news/2015/12/feature-can-your-mobile-phone-make-you-healthier

•  hqps://www.wareable.com/saves-the-day/wearables-vs-killer-diseases-is-technology-winning-the-fight