human interface technology lab medical applications of vr suzanne weghorst human interface...
TRANSCRIPT
![Page 1: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/1.jpg)
human interface technology lab
Medical Applications of VR
Suzanne Weghorst
Human Interface Technology Lab
University of Washington
![Page 2: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/2.jpg)
human interface technology lab
HIT Lab Medical Projects
• broad spectrum of medical applications• tools for clinical practice• medical informatics• therapeutic VR/AR• surgical simulation
• www.hitl.washington.edu
• Medicine Meets VR (www.amainc.com)
![Page 3: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/3.jpg)
human interface technology lab
Virtual Retinal Display
• high resolution• bright enough for see-
through display• small “exit pupil”
produces long depth of focus
![Page 4: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/4.jpg)
human interface technology lab
Optical Tools for Medicine
• True 3D display (Furness/Seibel)
• scanned fiber endoscope (Seibel)
• optical tomography (Seibel)
![Page 5: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/5.jpg)
human interface technology lab
![Page 6: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/6.jpg)
human interface technology lab
Medical Informatics
• virtual ER• distributed tumor
board• virtual anatomy
browser (Campbell)
![Page 7: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/7.jpg)
human interface technology lab
Therapeutic Uses of VR
• pain distraction• phobia desensitization• perceptual prosthesis
(e.g. Parkinson’s Disease)
Meredith Bricken, 1990
![Page 8: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/8.jpg)
human interface technology lab
Parkinson’s Disease
Kinesia Paradoxa• objects/lines in the
subject’s path• transverse lines spaced
about one stride-length apart work best
• learning/imagining cues doesn’t work
![Page 9: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/9.jpg)
human interface technology lab
Virtual Vision Sport
![Page 10: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/10.jpg)
human interface technology lab
![Page 11: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/11.jpg)
human interface technology lab
Surgical Simulation
• suturing simulation using FFE (fast finite element) methods
• ESS (endoscopic sinus surgery) simulator
• TURP (trans-urethral resection of the prostate) simulator
![Page 12: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/12.jpg)
human interface technology lab
Why Surgical Simulation?
• training• credentialing• planning and rehearsal• telesurgery/OR of the future
![Page 13: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/13.jpg)
human interface technology lab
See One, Do One, Teach one
![Page 14: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/14.jpg)
human interface technology lab
Once is Not Enough
![Page 15: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/15.jpg)
human interface technology lab
Big Questions
• What is the objective of the simulation?
• What do you need to simulate to achieve the objective?
![Page 16: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/16.jpg)
human interface technology lab
Core Design Issues
• anatomical detail• graphical realism• haptic realism• instrumental realism• bells and whistles• user (proctor) interface• validation
![Page 17: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/17.jpg)
human interface technology lab
Anatomical Detail
![Page 18: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/18.jpg)
human interface technology lab
Graphical Realism
Type 1
in-vivo
in-vitro
Type 2 Type 3
![Page 19: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/19.jpg)
human interface technology lab
Haptic Realism
![Page 20: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/20.jpg)
human interface technology lab
Instrumental Realism
![Page 21: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/21.jpg)
human interface technology lab
Bells and Whistles
• OR sounds • speech input• intelligent agents• training aids
![Page 22: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/22.jpg)
human interface technology lab
System Integration
![Page 23: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/23.jpg)
human interface technology lab
Proctor Interface
![Page 24: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/24.jpg)
human interface technology lab
Simulator Validation
3.65
3.27
5.2
4.46
3.32
4.93
4.23
0
1
2
3
4
5
6
Visual Realism Tactile Realism Auditory Realism Bleeding/Bubbles Chips Instrumentation Overall
![Page 25: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/25.jpg)
human interface technology lab
Simulator Validation
Non-MD Junior Resident
Senior Resident Staff ENT
![Page 26: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/26.jpg)
human interface technology lab
Collaborators HIT Lab
• Peter Oppenheimer• Jeff Berkley• Chris Airola• Duff Hendrickson• Tim Kowalewsky
UW School of Medicine• Rob Sweet, Jim Porter (Urology)• Dan Berg, Greg Raugi (Dermatological Surgery)• Mika Sinanan (Surgery/CVES)
Others• Chuck Edmond (Madigan Army Hospital - ENT)• Marvin Fried (Montefiore Hospital - ENT)• Rick Satava (Yale Medical School - Surgery)• George Turkiyyah (Civil Engineering)• Mark Ganter (Mechanical Engineering)
![Page 27: Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington](https://reader031.vdocuments.us/reader031/viewer/2022032723/56649d015503460f949d40f9/html5/thumbnails/27.jpg)
human interface technology lab
Thank You