AIIN IMAGING

DanielL.Rubin,MD,MSAssociate Professor of Biomedical Data Science, Radiology, and Medicine (Biomedical Informatics)

Matthew Lungren MD MPHAssistantProfessorofRadiology

@mattlungrenMD

Department of RadiologyStanford University

AIinMedicalImagingOpportunities� Efficientimagecreation� Imagequalitycontrol� Imagingtriage� Computer-aideddetection� Computer-aidedclassification� Automaticreportdrafting

http://aimi.stanford.edu

ImageinterpretationtasksforAI1. Diseasedetection2. Lesionsegmentation3. Diagnosis

DiseaseDetection:Retinalhemorrhages

224x224inputCNNslidingwindow:DetectinganyabnormalfeatureRed=P~.99 Green=P~0.5 Blue=~0.01

Predicted Physician

Carson Lam, et al, in preparationCopyright © Daniel Rubin 2017

Segmentation:Bonetumors

Darvin Yi, et al, in preparation

Copyright © Daniel Rubin 2017

Diagnosis:Real-timediagnosisofcancerusingdeeplearningComputerized interpretation during confocal endomicroscopyexamination of the bladder permits localization of tumors in heterogeneous bladder lesions

Copyright © Daniel Rubin 2017

Cancer region Normal region

Darvin Yi, et al, in preparation

https://doi.org/10.1148/radiol.2017171115

https://doi.org/10.1148/radiol.2017170236

CheXNet:121-layerCNN

Matt Lungren, MD, MPH and Andrew Ng, PhD. https://arxiv.org/abs/1711.05225

http://aimi.stanford.edu

AffiliatedFacultyFrom8DepartmentsAcross3SchoolsRadiology

� CurtisLanglotz,MD,PhDProfessorofRadiologyandMedicine(BiomedicalInformaticsResearch)

� SandyNapel,PhDProfessorofRadiology,and,bycourtesy,Medicine(MedicalInformatics)andElectricalEngineering

� MatthewLungren,MD,MPHAssistantProfessorofRadiology

� DavidLarson,MD,MBAAssociateProfessorofRadiology

� SafwanHalabi,MDClinicalAssistantProfessorofRadiology

� KristinYeom,MD,PhDAssociateProfessorofRadiology

� ChristopherBeaulieu,MD,PhDProfessorofRadiologyand,bycourtesy,OrthopedicSurgery

� LawrenceHofmann,MDProfessorofRadiology

� GregZaharchuk,MD,PhDAssociateProfessorofRadiology

� GuidoDavidzon,MDClinicalAssistantProfessorofRadiology

� ShreyasVasanawal,MD,PhDAssociateProfessorofRadiology

� BrianHargreaves,PhDAssociateProfessorofRadiologyand,bycourtesy,ElectricalEngineering

� GarryGold,MDProfessorofRadiologyand,bycourtesy,Bioengineering

Medicine(BiomedicalInformaticsResearch)andBiomedicalDataScience

� NigamShah,MBBS,PhDAssociateProfessorofMedicine(BiomedicalInformatics)

� OlivierGevaert,PhDAssistantProfessorofMedicine(BiomedicalInformaticsResearch)andBiomedicalDataScience

� ManishaDesai,PhDProfessorofMedicine(BiomedicalInformaticsResearch),BiomedicalDataScience,and,bycourtesy,ofHealthResearchandPolicy

� DanielRubin,MD,MSAssociateProfessorofBiomedicalDataScience,Radiology,Medicine(BiomedicalInformaticsResearch),and,bycourtesy,Ophthalmology

ComputerScience

� Fei Fei Li,PhDAssociateProfessorofComputerScience

� AndrewNg,PhDAdjunctProfessorofComputerScience

� ChristopherRe’,PhDAssociateProfessorofComputerScience

� RussellPoldrack,PhDAlbertRayLangProfessorofPsychologyandProfessor,bycourtesy,ofComputerScience

Pathology

� RobertWest,MDProfessorofPathology

� SaurabhGombar,MD,PhDClinicalInstructorinPathology

� JeanneShen,MDAssistantProfessorofPathology

� RobertoNovoa,MDClinicalAssistantProfessorofPathologyandDermatology

Ophthalmology

� DavidMyung,MD,PhDAssistantProfessorofOphthalmology

� JoyceLiao,MD,PhDAssociateProfessorofOphthalmologyandNeurology

� RobertChang,MDAssistantProfessorofOphthalmology

Dermatology

� JustinKo,MD,MBAClinicalAssociateProfessorofDermatology

Anesthesia

� SeanMackey,MD,PhDRedlichProfessorofAnesthesiology,PerioperativeandPainMedicine,Neurosciences,andNeurology

Computer Science• Fei Fei Li, PhD

Associate Professor of Computer Science

• Andrew Ng, PhDAdjunct Professor of Computer Science

• Christopher Re’, PhDAssociate Professor of Computer Science

Supporting Departments:• Radiology• Pathology• Medicine• Ophthalmology• Dermatology• Computer Science• Biomedical Data Science• Anesthesia

AcknowledgementsStudents,Post-docs,Residents,Staff,andCollaborators

– BaoDo

– Assaf Hoogi

– Selen Bozkurt

– Emel Alkim

– Sheryl John

Funding Support– NCI QIN grants

U01CA142555,1U01CA190214, 1U01CA187947

– ECOG-ACRIN– Stanford-AstraZeneca Collaboration Grant– NVIDIA Academic Hardware Grant Program

– Alfiia Galimzianova

– ImonBanerjee – Niranjan Balachandar

– SandyNapel

– CurtLanglotz

– ChristopherRe

– ChrisBeaulieu

– CarsonLam

– DarvinYi

– Xuerong Xiao

– BlaineRister

– HershSagreiya

– MatthewLungren

– AnnLeung

– Jocelyn Barker

Issuesfordiscussion1. Howdoyougetlabelsinpractice?Whatdothey

mean?2. Issuesaboutlabelquality

a) Animageannotationisnotgroundtruthb) Impactofqualityofimagelabelsonmodelsc) Uncertaintyinthelabels;inter-annotatordisagreement

3. Confoundingvariables4. Integratingdomainexpertiseintomodels5. Leveragingun-annotatedimages,weaksupervision6. Deploymentandevaluationofmodels(“post-

marketingsurveillance”)7. Structuresforsharinglabelsandannotations