clinical-grade computational...
TRANSCRIPT
![Page 1: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/1.jpg)
Clinical-grade Computational Pathology:
Hype or Hope for Cancer Care
ECP 2019, Nice
Thomas J. FuchsMemorial Sloan Kettering Cancer Center
Weill Cornell Graduate School of Medical Sciences
Computational Pathology and Medical Machine Learning Lab
Department of Pathology
[email protected] thomasfuchslab.org
Paige.AI@ThomasFuchsAI
![Page 2: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/2.jpg)
Fuchs Lab @ MSKCC + Weill Cornell
![Page 3: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/3.jpg)
2
MSKCC is the largest
and oldest private cancer center in the world
![Page 4: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/4.jpg)
The Warren Alpert Center for Digital and
Computational Pathology at MSK est 2017
![Page 5: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/5.jpg)
Disclosure:TF is Founder and CSO of Paige.AI
![Page 6: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/6.jpg)
![Page 7: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/7.jpg)
Pathology Today
![Page 8: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/8.jpg)
![Page 9: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/9.jpg)
![Page 10: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/10.jpg)
![Page 11: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/11.jpg)
![Page 12: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/12.jpg)
![Page 13: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/13.jpg)
![Page 14: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/14.jpg)
![Page 15: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/15.jpg)
![Page 16: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/16.jpg)
Pathology workload for one week at Memorial
Sloan Kettering
![Page 17: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/17.jpg)
![Page 18: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/18.jpg)
1,000,000 new glass slides per year @ MSKCC
![Page 19: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/19.jpg)
1,000,000 new glass slides per year @ MSKCC
![Page 20: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/20.jpg)
1,000,000 new glass slides per year @ MSKCC
![Page 21: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/21.jpg)
![Page 22: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/22.jpg)
15
0 0
00
pixel
![Page 23: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/23.jpg)
![Page 24: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/24.jpg)
![Page 25: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/25.jpg)
![Page 26: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/26.jpg)
25
CT
MRI
Lab
Sono
Derm
…
CTC
TissuePathologySurgical PathologyHematopathologyDermatopathology
Molecular Pathology
Diagnosis
Testing
Sequencing
Pharma
Studies
Insurance
…
Follow-up
Screening& Detection
Treatment& Research
Clinical Workflow
The whole edifice of medicine rests on the pathologist’s diagnosis
![Page 27: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/27.jpg)
Pathologist under stress
![Page 28: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/28.jpg)
Copyright © 2018 PAIGE.ai, Inc.
All rights reserved
Pathology is headed for a crisis
Almost half of cancers are “rare cancers”Source: World Health OrganizationCredit: Michaeleen Doucleff/NPR
Source: World Health Organization
0
2
4
6
US WesternEurope
Americas(non US)
Asia
Pathologists per 100,000 People
Source: Metter et al, JAMA 2019
Source: Metter et al, JAMA 2019
![Page 29: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/29.jpg)
Copyright © 2018 PAIGE.ai, Inc.
All rights reserved
Pathologist quality decreases with workload
The percentage of pathologists experiencing adverse events increases significantly with a workload greater than 39 hours per week.
Source: Australian Government Department of Health, “Impact of Workload of anatomic Pathologists on Quality and Safety” 2011
![Page 30: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/30.jpg)
Computational Pathology
![Page 31: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/31.jpg)
Computer Vis ion Tasks in Pathology
Nuclei Detection and ClassificationSub-cellular level
Segmentation
Structure EstimationMorphology
![Page 32: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/32.jpg)
CIFAR-10(32*32)*60K= 61.44 million pixels
1 Whole Slide= 100,000 x 60,000 = 6 billion pixels
All 60,000 CIFAR images fit into this box
Dataset Sizes: Computer Vision vs. Computational Pathology
![Page 33: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/33.jpg)
All of ImageNet 482 x 415 * 14,197,122 = 2.8 trillion pixels
n=1
n=474
474 Whole Slides100,000 x 60,000 *474= 2.8 trillion pixels
Dataset Sizes: Computer Vision vs. Computational Pathology
![Page 34: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/34.jpg)
Why is Computational Pathologyso chal lenging?
![Page 35: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/35.jpg)
Diagnosis
Fuchs Lab Projects 2019
![Page 36: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/36.jpg)
Diagnosis Prognosis
Fuchs Lab Projects 2019
![Page 37: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/37.jpg)
Diagnosis Prognosis
Large-Scale Machine Learning Framework
Fuchs Lab Projects 2019
![Page 38: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/38.jpg)
The State-of-the-Art
![Page 39: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/39.jpg)
Dataset sizes in Computational Pathology over time
2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2019
First Computational Pathology Paper
[Fuchs et al. 2008]
1 slide (Tissue Microarray)
1
[Liu et al. 2017]
509 slides
Camelyon
Challenge
400 slidesGLASS
challenge
200 slides
20200
400 500
Dataset sizes in published articles over time
Equivalent to
![Page 40: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/40.jpg)
State-of-the-art vs. Reality in clinical practice
State-of-the art datasets in pathology:• tiny (~400 slides)• very well curated
Like training your autonomous car only on an empty parking lot.It has never seen rain, snow or a dirt road.
![Page 41: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/41.jpg)
State-of-the-art vs. Reality in clinical practice
State-of-the art datasets in pathology:• tiny (~400 slides)• very well curated
Like training your autonomous car only on an empty parking lot.It has never seen rain, snow or a dirt road.
Clinical reality:• messy• diverse• surprising
How can we ever hope to
train clinical-grade models?
![Page 42: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/42.jpg)
What would it take to go
beyond the State-of-the-Art
![Page 43: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/43.jpg)
Machine Learning:New ways to learn from data at petabyte scale
Data:Real-world, clinically relevant datasets at scale
Domain Experts:Pathologists and computer scientist working in tandem
Computation:HPC for efficient deep learning at scale
What does it take to go beyond:
![Page 44: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/44.jpg)
0
50000
100000
150000
200000
250000
Clinical Slide Scanning @ Memorial Sloan Kettering
Nu
mb
er o
f D
igit
ized
Wh
ole
Slid
es
2015 2016 2017
![Page 45: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/45.jpg)
Nu
mb
er o
f D
igit
ized
Wh
ole
Slid
es
2015 2016 2017
0
200000
400000
600000
800000
1000000
1200000
2018
Clinical Slide Scanning @ Memorial Sloan Kettering
Projection with current ramp-up to40,000 slides / month
~ 1 petabyte of compressed image data
![Page 46: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/46.jpg)
Dataset sizes in Computational Pathology over time
2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2019
First Computational Pathology Paper
[Fuchs et al. 2008]
1 slide (Tissue Microarray)
1
[Liu et al. 2017]
509 slides
Camelyon
Challenge
400 slidesGLASS
challenge
200 slides
20200
400 500
Dataset sizes in published articles over time
![Page 47: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/47.jpg)
Dataset sizes in Computational Pathology over time
2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2019
First Computational Pathology Paper
[Fuchs et al. 2008]
1 slide (Tissue Microarray)
1
[Liu et al. 2017]
509 slides
Camelyon
Challenge
400 slidesGLASS
challenge
200 slides
20200
400 500
Dataset sizes in published articles over time
![Page 48: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/48.jpg)
AperioScanner
cBioPortal
ConsultationPortal
...
AperioViewer
HamamatsuViewer
PhilipsViewer
cBio PortalViewer
ConsultationViewer
...
PhilipsScanner
HamamatsuScanner
ImageScope Nanozoomer IntelliSite Cancer Digital Slide Archive PathXL ....
![Page 49: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/49.jpg)
AperioScanner
cBioPortal
ConsultationPortal
... PhilipsScanner
HamamatsuScanner
slides.mskcc.org
![Page 50: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/50.jpg)
![Page 51: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/51.jpg)
![Page 52: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/52.jpg)
H i g h P e r f o r m a n c e C o m p u t i n g f o r P a t h o l o g y
Awarded “Center of Excellence for GPU Computing” fromfor our work in Pathology and csBio.
320 GPUs in totalPascal TitanX and 1080 (Ti) GPUs dedicated to Computational Pathology
MSKCC’s HPC Cluster
![Page 53: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/53.jpg)
Deep Learning Cluster for Computational Pathology @MSKCC
![Page 54: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/54.jpg)
Deep Learning at Scale
DGX-1 Cluster for Computational Pathology
![Page 55: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/55.jpg)
Beyond Manual Image Annotation
![Page 56: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/56.jpg)
56
Strongly Supervised LearningPixel-level Annotation
“Classical” supervised model.
Weakly Supervised LearningImage-level Annotation
Multiple Instance learningDictionary Learning, etc.
Binary label for the whole slide from the pathology report.
0 | 1
![Page 57: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/57.jpg)
57
Cancerous lesions can be tinyProstate Cancer Biopsies
![Page 58: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/58.jpg)
Multiple Instance Learning
![Page 59: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/59.jpg)
![Page 60: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/60.jpg)
![Page 61: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/61.jpg)
![Page 62: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/62.jpg)
![Page 63: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/63.jpg)
![Page 64: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/64.jpg)
Multiple Instance Learning vs. Fully Supervised Learning
![Page 65: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/65.jpg)
Global Test Set> 800 Institutions
![Page 66: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/66.jpg)
Paige Prostate Cancer System
![Page 67: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/67.jpg)
![Page 68: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/68.jpg)
Potential Impact on Clinical Practice: Detection / Quantification
![Page 69: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/69.jpg)
Potential Impact on Clinical Practice: Prioritization / Triaging
![Page 70: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/70.jpg)
Are we done yet?
One AI to rule them all?
![Page 71: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/71.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 72: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/72.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 73: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/73.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 74: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/74.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 75: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/75.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 76: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/76.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 77: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/77.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 78: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/78.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 79: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/79.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 80: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/80.jpg)
Frozen H&E IHC Fluorescent Single Cell FNA
Bone & Soft Tissue
Breast
Dermatopathology
Gastrointestinal
Genitourinary
Gynecologic
Head and Neck
Neuropathology
Thoracic
Hematopathology
Cytology
![Page 81: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/81.jpg)
MSKCC & Paige Teams
![Page 82: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/82.jpg)
MSKCC Col laborators
David Klimstra Meera Hameed Victor Reuter Malcolm Pike
Joe Sirintrapun Hikmat Al-Ahmadie Edi Brogi Jinru Shia
Klaus Busam
Oscar Lin
Jung Hun Oh HariniVeeraraghavan
Adity Apte John L. HummJoseph O. Deasy
![Page 83: Clinical-grade Computational Pathologycpo-media.net/ECP/2019/Congress-Presentations/121/2019-09-07_E… · Clinical-grade Computational Pathology: Hype or Hope for Cancer Care ECP](https://reader035.vdocuments.us/reader035/viewer/2022070719/5edea439ad6a402d6669f8a0/html5/thumbnails/83.jpg)
Thank you for your attention!
Questions welcomed!
Thomas J. Fuchs
thomasfuchslab.org
Open ML and CS positions in Manhattan
@ThomasFuchsAI