artificial intelligence and robots in the or - still room ... 19_neumuth_künstliche...
TRANSCRIPT
![Page 1: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/1.jpg)
Artificial intelligence and robots in the OR- Still room for ebM?
Thomas Neumuth
![Page 2: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/2.jpg)
Innovation Center Computer Assisted Surgery (ICCAS)
• Affiliated to Medical School of Universität Leipzig • ~85 engineering and computer science researchers
![Page 3: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/3.jpg)
Medicine Biomedical and informationtechnology
PersonalizedPredictivePreventiveParticatory
Hood and Friend 2011
4P m
edic
ine
Technology is integral part of medicine
![Page 4: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/4.jpg)
Technology has a different evolution speed
• Information retrieval from distant monitors and devices• Vendor dependent device operation• Technical obstacles for advanced workflow management • Limited flexibility in the selection and combination of systems
4
[Quelle: Bulitta, 2006]
![Page 5: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/5.jpg)
5
acquire
analyze
act
![Page 6: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/6.jpg)
6
acquire
analyze
act
![Page 7: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/7.jpg)
Robotic systems for surgery
• Master-slave systems
7
• (Semi-) autonomous systems
© Intuitive, Transenterix, Avatera, Stryker, Smith & Nephews
![Page 8: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/8.jpg)
Current evidence for robotic systems
• Operation times• Operative costs
• Blood loss• Complication rates• Hospital stay length• Transfusion rate
8
FDA, Feb 28, 2019
![Page 9: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/9.jpg)
Imaging and cooperative robots
9
© Siemens Artis Zeego
![Page 10: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/10.jpg)
Imaging and cooperative robots
10
Bieck et al. 2017
![Page 11: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/11.jpg)
11
acquire
analyze
act
![Page 13: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/13.jpg)
Current research areas
• Anaesthesia management• Risk for postoperative pain, nausea, and respiratory depression• Predict hypotension, hypoxemia
• Surgery• Prediction of procedure times and anticipation of risk situations• Decrease human-technology interaction, Automatic documentation
• Administration• Decrease non-value-adding activities• Provide KPIs
13
![Page 14: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/14.jpg)
Situation aware biomedical technologies
14Neumuth et al. 2009, Franke et al. 2015
![Page 15: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/15.jpg)
Situation aware biomedical technologies
15Neumuth 2012
![Page 16: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/16.jpg)
SDC – Service oriented device connectivity
Navigation
© Aesculap
HIS, PACS
© Ch. Toulon
Dokumentation
© Oehm & Rehbein
3D-Rekonstruktion
© Medstation
© OrthoMit
US-Regis-trierung
Planung
© Aesculap © SurgiTAIX
Tools Displays MMI
© Philips© Maquet
OP-Tisch
© Trumpf
Tracking
© NDI
Roboter
© meditec HIA
SDCOne Language
ISO/IEEE 11073-10207IEEE 11073-20701
ISO/IEEE 11073-20702Medical device interoperability
![Page 17: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/17.jpg)
17
acquire
analyze
act
![Page 18: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/18.jpg)
Hyperspectral Imaging
18
![Page 19: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/19.jpg)
Hyperspectral imagung for tissue perfusion
19
Pathological bowel
Perfusion state ?
anastomosis
Perfusion state ?
a) Patient with postop. perfusion insufficiency
b) and c) Patients without postop. perfusion insufficiency
Jansen-Winkeln et al. Chirurg 2018
© Universitätsklinikum Leipzig AöR (2009): Thema, Autor
![Page 20: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/20.jpg)
Total number of spectra: nthyroid = 3128, nparathyroid = 383
HSI-based discrimination of thyroid and parathyroid
Barberio et al. 2018
![Page 21: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/21.jpg)
But surgery is just one option …
21
acquire
analyze
act
![Page 22: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/22.jpg)
Digital patient models for decision-making
22
ENT-Tumorboard at the University Hospital Leipzig, Germany Cypko et al. 2017
![Page 23: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/23.jpg)
Prediction and clinical decision support
![Page 24: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/24.jpg)
Artificial intelligence and robots in the OR- Still room for ebM?
![Page 25: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/25.jpg)
The digital footprint
25
acquire
analyze
act
![Page 26: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/26.jpg)
The digital footprint
26
acquire
analyze
act
![Page 27: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/27.jpg)
Numeric vs. symbolic process models
27
SurgicalWorkflow
Numericalmodels
(digital footprint)
Symbolicmodels
![Page 28: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/28.jpg)
Model generalization
T. Neumuth: Process modeling strategies
…
A B A C
A B C
A B C DD
START
END
A
B
C
Single cases Merged model
![Page 29: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/29.jpg)
Model analysis: workflow assessment
29
END
paracentesisparacentesis knife
cornea
injecthealon
chamber ant
capsulorhexisrhexis cannulacapsula lentis
cutlancet clear cut
cornea
excision materialutrata‘s tweezers
capsula lentis
100% 93% 81%
92%
94%
10%
86%
START
Preparation Capsulorhexis Lens Removal LensImplantation
Removal of Healon Completion
(model filtered with threshold 5%)
Neumuth et al. 2011
![Page 30: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/30.jpg)
Model analysis: workflow assessment
30
END
paracentesisparacentesis knife
cornea
injecthealon
chamber ant
capsulorhexisrhexis cannulacapsula lentis
cutlancet clear cut
cornea
excision materialutrata‘s tweezers
capsula lentis
injectvision blue
chamber ant
irrigatesauter cannulachamber ant
100%
100%
19%
93%
51%
81%
83%
5%
84%
99%
94%
12%
18%
34%
6%
92%
94%
10%
86%
START
Phase Capsulorhexis or Cataract interventions: Generic process models
for outpatient (n=51) and inpatient cases (n=54)
(model filtered with threshold 5%)
Preparation Capsulorhexis Lens Removal LensImplantation
Removal of Healon Completion
Neumuth et al. 2011
![Page 31: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/31.jpg)
Model analysis: resource impact estimation
Nissen fundoplication, animal studylaparoscopic cases vs. telemanipulator-assisted cases (each n=12)
31Krauss et al. 2012
![Page 32: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/32.jpg)
Model analysis: technology requirements
Opening ofthe skin
Preparation of muscle tissue
Bone removal Removal of intervertebral disc
Completion
Neumuth et al. 2009 32
n=14 Unit AVG Min Max SDEV
Time Frame hh:mm:ss 00:45:08 00:22:23 01:13:43 00:13:08
Iterations activity 15.2 7 27 6.3
Cumulated Duration hh:mm:ss 00:19:55 00:12:40 00:32:11 00:06:52
![Page 33: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/33.jpg)
Objective: Development of an eco system for data acquisition and AI-based analysis for post market surveillance of medical devices
33
![Page 34: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/34.jpg)
Summary
• Robots have arrived in ORs• AI in the OR has not yet arrived
• Technologies have digital footprints that enable continuous ebMwithout cognitive biases
If you can't measure it, you can't improve it.(Peter F. Drucker)
34
![Page 35: Artificial intelligence and robots in the OR - Still room ... 19_Neumuth_Künstliche Intellige… · Artificial intelligence and robots in the OR - Still room for ebM? Thomas Neumuth](https://reader034.vdocuments.us/reader034/viewer/2022042318/5f075a0a7e708231d41c8e3c/html5/thumbnails/35.jpg)
35
Prof. Dr. Thomas NeumuthInnovation Center Computer Assisted Surgery (ICCAS)[email protected], Twitter: @iccasLeipzig
CCL Advisory Board Meeting, Mar 12 2019
Thank you.