supporting bodily communication in video consultations of physiotherapy
TRANSCRIPT
![Page 1: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/1.jpg)
Supporting Bodily Communication in Video Consultations of PhysiotherapyDeepti Aggarwal
Friday, 10 March 17
![Page 2: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/2.jpg)
Video Consultationsvan Dyk 2014; Yellowlees 2005
Friday, 10 March 17
![Page 3: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/3.jpg)
Bodily CommunicationArgyle 2013; Heath 1986, 2002
Friday, 10 March 17
![Page 4: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/4.jpg)
Bodily Communication in Physiotherapy
Friday, 10 March 17
![Page 5: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/5.jpg)
Research Gaps
Friday, 10 March 17
![Page 6: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/6.jpg)
Main Research Question
How can interactive technologies support physiotherapists in
understanding bodily information during video consultations?
Friday, 10 March 17
![Page 7: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/7.jpg)
Research Phases
#1 Observations
#2 Designing & Lab study
#3 Field Deployments
Friday, 10 March 17
![Page 8: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/8.jpg)
Research Phases
#1 Observations
#2 Designing & Lab study
#3 Field Deployments
Friday, 10 March 17
![Page 9: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/9.jpg)
Research Question
How do physiotherapists interpret bodily information in
current practices of video consultations?
Friday, 10 March 17
![Page 10: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/10.jpg)
#1 Observations
Face-to-Face (3) Video (7)
2 physiotherapists & 5 patients with chronic pain Prescribed exercises: tip-toes, squats
Friday, 10 March 17
![Page 11: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/11.jpg)
ACM DIS 2016 (full paper)
Friday, 10 March 17
![Page 12: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/12.jpg)
Face-to-Face Video
1. Opening
2. History taking
3. Examination
4. Diagnosis
5. Treatment
6. Closing
Byrne & Long 1976
Friday, 10 March 17
![Page 13: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/13.jpg)
Face-to-Face Video
Appearance(Full body)
Posture
Movement(Walking)
Orientation
Appearance(Upper Torso)
Posture
Movement
Orientation
1. Opening
Friday, 10 March 17
![Page 14: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/14.jpg)
Face-to-Face Video
Facial Expressions(Tears, red cheeks, tensed
eyes)
Quality of Movements
(Depth, range, smoothness)
Eye Contacts(for encouragement,
willingness to engage)
2. History Taking
Eye Contacts(encouragement,
willingness to engage)
Quality of Movements
(depth, range, smoothness)
Facial Expressions(Tears, red cheeks, tensed
eyes)
Friday, 10 March 17
![Page 15: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/15.jpg)
Face-to-Face Video
Tactile feedback(Tightness, inflammation,
temperature)
Response to touch(Fear, protective spasm,
facial expression)
Touch on patient’s body
3 & 4. Examination & Diagnosis
Response to touch(Fear, protective spasm,
facial expression)
Tactile feedback(Tightness, inflammation,
temperature)
Touch on own body
Friday, 10 March 17
![Page 16: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/16.jpg)
Face-to-Face Video
Touch on patient’s body
5. Treatment
Touch on own body
Body posture
Tone of speech(pitch)
Efforts(fatigue, tremor)
Body posture
Tone of speech(pitch)
Efforts(fatigue, tremor)
Friday, 10 March 17
![Page 17: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/17.jpg)
Face-to-Face Video6. Closing
Body language
Facial expressions
Body language
Facial expressions
Friday, 10 March 17
![Page 18: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/18.jpg)
Key Takeaways
Lower limb movements are difficult to observe
Less specific treatment
Video limits a wide range of bodily cues
Friday, 10 March 17
![Page 19: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/19.jpg)
Research Phases
#1 Observations
#2 Designing & Lab study
#3 Field Deployments
Friday, 10 March 17
![Page 20: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/20.jpg)
Key aspects of lower body movements
Weight Distribution
Range of Movements
Foot Orientation
Friday, 10 March 17
![Page 21: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/21.jpg)
Research Question
How can we collect and visualize lower body movements to support
physiotherapists during video consultations?
Friday, 10 March 17
![Page 22: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/22.jpg)
Wii-Fit boardMcGough et al. 2012
Friday, 10 March 17
![Page 23: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/23.jpg)
Sensoria socksSarnow et al. 1994
Friday, 10 March 17
![Page 24: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/24.jpg)
SoPhy
SOcks for PHYsiotherapy
Socks with sensors Web interface
Friday, 10 March 17
![Page 25: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/25.jpg)
SoPhy socks
IMU
Pressure Sensors
Bluetooth Shield
Arduino Pro Mini
Friday, 10 March 17
![Page 26: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/26.jpg)
SoPhy web-interface
Friday, 10 March 17
![Page 27: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/27.jpg)
Friday, 10 March 17
![Page 28: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/28.jpg)
Research Question
How does SoPhy help physiotherapists in assessing
lower body movements during video consultations?
Friday, 10 March 17
![Page 29: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/29.jpg)
#2 Lab study
Clinician’s room
10 physiotherapists & 1 actor (patient)
Patient’s room
Friday, 10 March 17
![Page 30: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/30.jpg)
Study Design (2x2)
Extreme pain Low pain
Friday, 10 March 17
![Page 31: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/31.jpg)
Tasks for Participants
Assess the patient’s exercises
Organize 4 video sessions
Report confidence in a questionnaire
Friday, 10 March 17
![Page 32: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/32.jpg)
Tasks for Actor
Dorsiflexion & Plantarflexion
1-leg tip-toes & 2-leg tip-toes
Squats
Friday, 10 March 17
![Page 33: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/33.jpg)
Increase in Confidence
Without SoPhy, I may not be able to pick up things just from video. Like I thought, ‘Ooh!
that foot looks tilted outside’, but then whether it has any relation with their weight distribution or not, I can’t tell just from the
video. (P2)
Exercises with SoPhy without SoPhy
SquatsF(1,36) = 10.97, p<.01
M = 5.75,
SD = 1.06M = 4.17,SD = 1.13
Friday, 10 March 17
![Page 34: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/34.jpg)
Fewer Repetitions of Exercises
Exercises with SoPhy without SoPhy
DorsiflexionF(1,36) = 6.99, p<.05
M = 8.10,
SD = 3.21M = 11.25,SD = 4.54
PlantarflexionF(1,36) = 6.14, p<.05
M = 7.45,
SD = 3.88M = 10.60,SD = 4.24
SquatsF(1,36) = 8.36, p<.01
M = 6.05,
SD = 2.48
M = 8.05,
SD = 3.18
Friday, 10 March 17
![Page 35: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/35.jpg)
Fewer Repetitions of Exercises
Over video, I can see the person only from one direction. [...] The sock system provides me this detailed information irrespective of
how the person is standing or sitting. I did not ask the patient to turn backwards or sideways
when I had the sock data - the system was already doing it for me. (P3)
Friday, 10 March 17
![Page 36: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/36.jpg)
Deeper Insights on Weight Distribution
It’s always challenging to understand weight bearing because the pressure points are not visible. It’s easy in cases when the person is putting more weight on one foot than other.
But it is difficult to understand how the pressure is distributed across the foot, is it on
the heels, or on the balls. (P8)
Friday, 10 March 17
![Page 37: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/37.jpg)
Challenges
Interference to visual observation
Alignment with clinical practice
Friday, 10 March 17
![Page 38: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/38.jpg)
ACM CHI 2017 (full paper)
Friday, 10 March 17
![Page 39: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/39.jpg)
Limitations
Controlled lab study
Focus on assessment
Friday, 10 March 17
![Page 40: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/40.jpg)
Research Phases
#1 Observations
#2 Designing & Lab study
#3 Field Deployments
Friday, 10 March 17
![Page 41: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/41.jpg)
Research Question
How does SoPhy support physiotherapists in assessing
and treating patients, with lower limb issues, during naturally
occurring video consultations?
Friday, 10 March 17
![Page 42: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/42.jpg)
Revised SoPhy socks
Use of bright colored socks to support visual observations
Friday, 10 March 17
![Page 43: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/43.jpg)
Revised SoPhy web-interface
To align with clinical practice
Friday, 10 March 17
![Page 44: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/44.jpg)
Study Design
2 physiotherapists & 5-7 patients with lower limb issuesSimulated video sessions at Royal Children’s Hospital
Hospital Room #1 Hospital Room #2
Friday, 10 March 17
![Page 45: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/45.jpg)
Study Design
Face-to-Face (60 mins)
Video Consultation
(45 - 50 mins)
Face-to-Face follow up (15 - 10 mins)
First session Second session
Participant Observations & Interviews
Friday, 10 March 17
![Page 46: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/46.jpg)
Study Setup
Friday, 10 March 17
![Page 47: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/47.jpg)
Session in Action
Friday, 10 March 17
![Page 48: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/48.jpg)
Video without SoPhy (study 1)
1. Opening
2. History taking
3. Examination
4. Diagnosis
5. Treatment
6. Closing
Video with SoPhy (study 3)
Friday, 10 March 17
![Page 49: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/49.jpg)
Study 1Video with
SoPhy
Appearance(Upper Torso)
Posture(Upper Torso)
Movement(sitting)
Orientation
Appearance(Upper Torso)
Posture(upper torso + feet)
Movement(walking, sitting)
Orientation
1. Opening
Friday, 10 March 17
![Page 50: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/50.jpg)
Thesis Contributions
Conceptual understanding of bodily communication in video consultations of physiotherapy
Designed and studied a technology to support physiotherapists during video consultations
Friday, 10 March 17
![Page 51: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/51.jpg)
Dissertation Status
Commenced study 3
Finished study 1, 2
Thesis Chapters 4 & 6 - first draft finished
Friday, 10 March 17
![Page 52: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/52.jpg)
Completion Plan
Time Tasks
March - April 2017
Continue study 3Finish Chapters 2, 3 & 5Revise Chapters 2 to 6
May - June 2017
Attend CHI 2017Finish Study 3Finish Chapters 7, 8, 9
July - August 2017
Finish Chapter 1Revise complete thesisThesis Submission
Friday, 10 March 17
![Page 53: Supporting Bodily Communication in Video Consultations of Physiotherapy](https://reader033.vdocuments.us/reader033/viewer/2022042907/58d1b0281a28ab98278b49b1/html5/thumbnails/53.jpg)
Thank you
Friday, 10 March 17