robot-assisted rehabilitation, surgery and therapy · 3 enabling technologies objective: •...
TRANSCRIPT
![Page 1: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/1.jpg)
1
Robot-assisted
Rehabilitation, Surgery and Therapy
Mahdi Tavakoli, PhD, PEng
Associate Professor, University of Alberta
Edmonton, Alberta, Canada
![Page 2: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/2.jpg)
2
• Currently, seniors make up about
12% of Canada’s population.
• In 2036, 25% of the Canadian
population will be 65 or over.
Total Fertility Rate
• Fertility rose sharply in both
Canada and the US in the
immediate post-war period.
Source: Statistics Canada
Canada’s changing demographics
Result: Increased load on the healthcare system
![Page 3: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/3.jpg)
3
Enabling technologies
Objective:
• Develop new technologies that reduce the burden on the healthcare
system by making interventions
– available to remote areas
– more efficient (i.e., better accuracy and reliability)
– less traumatic (i.e., faster recovery and shorter hospital stay)
Case studies:
– Post-stroke rehabilitation
– Beating-heart surgery
– Prostate brachytherapy
![Page 4: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/4.jpg)
4
Therapist’s Skills
Capabilities of Haptic Systems
Therapist-in-the-loop Telerobotic
Rehabilitation
Fu
se
+ =
Rehabilitation therapy paradigms
![Page 5: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/5.jpg)
Assistive/resistive tele-rehabilitation
The feeling of hand-over-hand therapy is created if the patient and
the therapist are at the two ends of a haptic teleoperation system.
![Page 6: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/6.jpg)
Po
se
Pose
Master haptic device
Patient
Force
Slave haptic device
Therapist
Mo
nito
ring U
nit
Advantages:
• Remote therapy services enabled
• Therapist-in-the-loop architecture
• Possible amplification of the therapist’s efforts
Control architecture:
Assistive/resistive tele-rehabilitation
![Page 7: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/7.jpg)
Assistive/resistive tele-rehabilitation
![Page 8: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/8.jpg)
Functional task based tele-rehabilitation 8
Learn phase: Therapist-in-loop (TIL) Replay phase: Therapist-
out-of-loop (TOOL)
Therapist’s arm impedance measurement; learning and imitating therapist’s behavior
Completion of many collaborative therapy tasks; no need for robot re-programming
Therapist’s time sharing among several patients
![Page 9: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/9.jpg)
Learn-and-replay tele-rehabilitation 9
Direct interaction Patient-side robot Therapist-side robot
2-DOF Task
1-DOF Task
![Page 10: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/10.jpg)
10
Learn-and-replay tele-rehabilitation
![Page 11: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/11.jpg)
11
Enabling technologies
Objective:
• Develop new technologies that reduce the burden on the healthcare
system by making interventions
– available to remote areas
– more efficient (i.e., better accuracy and reliability)
– less traumatic (i.e., faster recovery and shorter hospital stay)
Case studies:
– Post-stroke rehabilitation
– Beating-heart surgery
– Prostate brachytherapy
![Page 12: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/12.jpg)
Beating-heart surgery
Is it possible to operate
on the heart without
stopping it?
• Extracardiac procedures
• Pericardiocentesis
• Intracardiac procedures
• Mitral valve repair
http://www.youtube.com/watch?v=0NmWOHuy-o8
12
Heart motions are very hard to follow:
• Max velocity 210 mm/s, acceleration 3800 mm/s2
• Quickly recoils 10-15 mm after contraction
![Page 13: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/13.jpg)
Current surgical practice
From www.ctsnet.org From health.allrefer.com
13
Heart Stabilizer
• Cannot completely cancel
heart motion
Heart-lung Machine
• Increased risk of stroke
• Possible long-term cognitive loss
![Page 14: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/14.jpg)
14
Robotic beating-heart surgery system
End goal: Robot-heart distance should
be under the Surgeon’s command
![Page 15: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/15.jpg)
15
Challenges
• Delayed
measurements
• Multi-rate system
• Unknown heart
motion
• Precise tracking (< 2
mm error) required
Slow sampling 20 - 34 Hz
Fast sampling 100 - 1000 Hz
![Page 16: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/16.jpg)
16
Block diagram of the system
• Physical System cannot change
• Same configuration regardless of the controller
Possible
Measurements
• Software System changes depending on the controller
End goal: Robot-heart distance to follow Surgeon’s motion
![Page 17: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/17.jpg)
17
Pericardiocentesis
• Build up of fluid in the pericardial sac surrounding the heart
• Needle is inserted under ultrasound guidance or blind
• Guide wire is inserted through needle
• Drainage tube inserted around guide wire
• Coronary vessels cannot be punctured
![Page 18: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/18.jpg)
Predictive control of robot for pericardiocentesis 18
![Page 19: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/19.jpg)
Annuloplasty for mitral valve repair
From health.msn.com From www.heartl-valve-surgery.com
19
• Mitral valve does not close
• Regurgitation
• Reshape mitral valve with
annuloplasty ring
Thus, let us consider a stapling task.
![Page 20: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/20.jpg)
20
Ultrasound-guided staple-insertion task
• 10 participants tried the task with and without motion compensation.
![Page 21: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/21.jpg)
21
Results: No motion compensation
Use of excessive force
![Page 22: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/22.jpg)
22
Results: Motion compensation
A correctly deployed staple
![Page 23: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/23.jpg)
23
Results: Staple Insertion Task
0%
20%
40%
60%
80%
100%
1 2 3 4 5 6 7 8 9 10
Su
cc
es
s R
ate
Participant
WithCompensation
WithoutCompensation
0%
20%
40%
1 2 3 4 5 6 7 8 9 10
Ex
ce
ss
Fo
rce
Participant
WithCompensation
WithoutCompensation
64%
28%
12%
24.5%
![Page 24: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/24.jpg)
24
Enabling technologies
Objective:
• Develop new technologies that reduce the burden on the healthcare
system by making interventions
– available to remote areas
– more efficient (i.e., better accuracy and reliability)
– less traumatic (i.e., faster recovery and shorter hospital stay)
Case studies:
– Post-stroke rehabilitation
– Beating-heart surgery
– Prostate brachytherapy
![Page 25: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/25.jpg)
Prostate brachytherapy
• Long, hollow needles carrying radioactive
seeds are inserted into the perineum.
• Seeds are deposited within the prostate to
destroy cancerous tissue, assuming no
needle bending and no tissue movement.
• Challenge: Needle deflection and tissue
deformation during needle insertion.
25
![Page 26: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/26.jpg)
Manual prostate brachytherapy
Ultrasound Probe Template
26
Challenges:
• Poor needle
visibility in US
images.
• Inadequate
control over the
needle.
Solutions:
• Estimation,
prediction and
feedback
control.
![Page 27: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/27.jpg)
Model-based needle deflection estimation
• Accounts for bevel
angle, grid template,
tissue deformation,
friction, and cutting
force.
• Computationally efficient
and appropriate for real-
time control of needle tip
position.
• The model uses both
insertion velocity and
bevel rotation as control
commands for needle
steering.
![Page 28: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/28.jpg)
A virtual sensor for needle deflection estimation
![Page 29: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/29.jpg)
A virtual sensor for needle deflection estimation
![Page 30: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/30.jpg)
Needle steering through 180° needle rotations
![Page 31: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/31.jpg)
Haptic feedback on the wrist for manual needle steering
31
• Using haptic stimuli to inform the surgeon about a necessary needle
steering maneuver.
• Eight mini vibrating motors are placed around the wrist.
![Page 32: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/32.jpg)
32
Haptic feedback on the wrist for manual needle steering
![Page 33: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/33.jpg)
Augmented reality for manual needle steering 33
• Reconstructed images of the prostate are displayed in
real time using a semi-transparent mirror.
• Predicted future needle deflection informs the user
about required steering actions.
The augmented reality system User’s perspective
Phantom tissue
![Page 34: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/34.jpg)
34
Augmented reality for manual needle steering
![Page 35: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/35.jpg)
35
Conclusions
• Robots can make surgeries and therapies available to remote
areas, more accurate and less traumatic.
• Tele-rehabilitation
• Beating-heart surgery
• Brachytherapy
• The goal is not to replace the surgeon/therapist, but to extend his/her
capabilities.
• Other possible advantages include creating new treatment options,
increasing safety, enhancing documentation and follow-up, and
saving on operating room times and costs.
![Page 36: Robot-assisted Rehabilitation, Surgery and Therapy · 3 Enabling technologies Objective: • Develop new technologies that reduce the burden on the healthcare system by making interventions](https://reader033.vdocuments.us/reader033/viewer/2022043013/5fad3819ad63d46bdd12b7fe/html5/thumbnails/36.jpg)
36
http://www.ece.ualberta.ca/~tbs
Special thanks to