from qualitative to quantitative radiological reports...

36
Quantitative Imaging Biomarkers in Medicine www.quibim.com Ana Jiménez Pastor Image Analysis Scientist [email protected] From Qualitative to Quantitative Radiological Reports through AI and Automated Analysis

Upload: others

Post on 07-Jun-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

Quantitative Imaging Biomarkers in Medicine

www.quibim.com

Ana Jiménez PastorImage Analysis Scientist

[email protected]

From Qualitative to Quantitative Radiological

Reports through AI and Automated Analysis

Page 2: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

ANALOGIC MEDICAL IMAGE DIGITAL MEDICAL IMAGE

Thanks to digitalization, medical imaging is one of the medical sectors which has

experienced a huge technological revolution in the last 50 years

Page 3: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

0 0 0 0 0 0 0 0 0 0

0 0 2 5 7 9 14 7 0 0

0 4 25 15 9 78 48 32 15 0

0 12 35 14 14 23 85 41 89 0

0 38 75 16 16 41 20 79 54 0

0 8 58 20 64 67 58 65 0

0 0 25 36 59 82 45 37 91 0

0 2 10 64 58 87 32 10 2 0

0 0 67 49 37 28 4 1 0 0

0 0 0 0 0 0 0 0 0 0

0 0 0 0 0 0 0 0 0 0

0 0 2 5 7 9 14 7 0 0

0 4 25 15 9 78 48 32 15 0

0 12 35 14 14 23 85 41 89 0

0 38 75 16 16 41 20 79 54 0

0 8 58 20 64 67 58 65 0

0 0 25 36 59 82 45 37 91 0

0 2 10 64 58 87 32 10 2 0

0 0 67 49 37 28 4 1 0 0

0 0 0 0 0 0 0 0 0 0

0 0 0 0 0 0 0 0 0 0

0 0 2 5 7 9 14 7 0 0

0 4 25 15 9 78 48 32 15 0

0 12 35 14 14 23 85 41 89 0

0 38 75 16 16 41 20 79 54 0

0 8 58 20 64 67 58 65 0

0 0 25 36 59 82 45 37 91 0

0 2 10 64 58 87 32 10 2 0

0 0 67 49 37 28 4 1 0 0

0 0 0 0 0 0 0 0 0 0

0 0 0 0 0 0 0 0 0 0

0 0 2 5 7 9 14 7 0 0

0 4 25 15 9 78 48 32 15 0

0 12 35 14 14 23 85 41 89 0

0 38 75 16 16 41 20 79 54 0

0 8 25 58 20 64 67 58 65 0

0 0 25 36 59 82 45 37 91 0

0 2 10 64 58 87 32 10 2 0

0 0 67 49 37 28 4 1 0 0

0 0 0 0 0 0 0 0 0 0

Moderate Lung Emphysema 20% Lung Emphysema

Page 4: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

DISEASE

vs.

HUMAN EYE

Page 5: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

1896. William Morton

First Radiological Report: RX Abdomen

“… there is no stone of appreciable size in the kidney…”

Page 6: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

2018. Radreport. RSNA

Modern Radiological Report: CT kidney stones

“… adenopathy is not observed…”

Page 7: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

“There are not observed alterations”

Page 8: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

The need: TO MEASURE

Steatohepatitis Alzheimer Articular degeneration Vertebral fractures Prostate cancer

Chondral degeneration Rectal cancer Emphysema Multiple SclerosisOsteoporosis

Page 9: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

“When you can measure what you are

speaking about, and express it in

numbers, you know something about it”

Lord Kelvin

Page 10: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

What is an Imaging Biomarker?

It is a parameter obtained objectively from medical images which represents and quantifies a tissue property (structural,

functional or biological) extracted after applying computational models and artificial intelligence,

to measure is to know

Page 11: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

Imaging Biomarkers Development

Value

Proof of concept Proof of mechanism Image acquisition Image processing Image analysis

Measurements Proof of principleProof of efficacy

and effectivenessStructured report

Idea

Martí-Bonmati ́ L, Alberich-Bayarri A, et al. Imaging biomarkers, quantitative imaging, and bioengineering. Radiologia. 2012;54:269-278.

Page 12: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

ONCOLOGYSolid tumors, hematology

Diffusion (IVIM, DKI),

Pharmacokinetics, bone

narrow infiltration,

multiparametric analysis

MSKOsteoporosis, arthrosis

Trabecular morphology,

fractal irregularity,

anisotropy, mechanical

resistence and elasticity

LUNGCOPD, RX

Classification, volumes,

emphysema, low functional

densities

NEUROAlzheimer, ALS, ME, ictus

Brain volumetry, cortical

thickness, White matter

lesions, tractography

LIVERSteatohepatitis, fibrosis,

hemochromatosis

Fat fraction, iron

concentration, fibrosis

Page 13: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

Why do we need HPC?

Page 14: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

HIGH DIMENSIONALITY!

2688x2672

512x512x1000

192x192x1300

Page 15: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

COMPLEXITY IN AI ARCHITECTURES!

Page 16: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

HIGH COMPUTATIONAL COST!

Page 17: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

We need HPC integrated in

healthcare and medical imaging!

Page 18: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

vs.

Which HPC installation does fit the best in the

healthcare sector?

Page 19: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

AI IN MEDICAL IMAGING

Page 20: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

LIVER FAT & IRON QUANTIFICATION

Nowadays, liver biopsy is the gold standard:

• Invasive

• Heterogeneous distribution – Biased sample

• Intra- and inter- observer variability

• Difficulties on patients follow-up

SOLUTION: Virtual biopsies through MRI

Page 21: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

• Requires the delineation of the liver.

• Time consuming, exhausting and not

rewarding task.

• Requires radiologists’ expert

knowledge, therefore it is very

expensive.

LIVER FAT & IRON QUANTIFICATION

SOLUTION: Automatic liver segmentation using a CNN

Page 22: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

SEGMENTATION. LIVER

Page 23: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

AI VS HUMAN SEGMENTATION

AI SEGMENTATION HUMAN SEGMENTATION

Page 24: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

DETECTION. VERTEBRAE

• Vertebra localization and identification are essential for

diagnosis, surgical planning and patients follow-up on spine

pathologies.

• Nowadays, this identification is done manually, hindering

radiologists’ workflow.

• SOLUTION: Automatic vertebrae detection through AI.

Page 25: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

DETECTION. VERTEBRAE

DETECTION IDENTIFICATION

Page 26: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

DETECTION. VERTEBRAE

Page 27: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

DETECTION. PNEUMONIA

• Pneumonia accounts for over 15% of all deaths of children

under 5 years old internationally.

• The diagnosis on chest x-ray is complicated because of the

presence of other conditions in the lungs.

• SOLUTION: Pneumonia detection to improve efficiency and

reach of diagnostic services.

Page 28: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

DETECTION. PNEUMONIA

Ground truth

AI Predictions

Page 29: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

CLASSIFICATION. CHEST X-RAY

• X-ray is the most performed examination.

• Radiology departments have limitations in reporting all x-rays

generated due to the limited resources available.

• SOLUTION: Automatic chest x-ray classification to prioritize

those with abnormal findings.

Page 30: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

CLASSIFICATION. CHEST X-RAY

Atelectasis

Cardiomegaly

Effusion

Infiltration

Mass

Nodule

Pneumonia

Pneumothorax

Consolidation

Edema

Emphysema

Fibrosis

Pleural

Thickening

Hernia

Abnormal Probability:

0.87

Weigthing

Fully Connected

Network

CNN Classifiers

Page 31: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

RADIOMICS

Page 32: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

• Multivariate analysis of large datasets of imaging

biomarkers with the goal of finding diagnostic, prognostic

or therapeutic relations.

• It is based on the analysis of large populations

characteristics to extract correlations that can be applied

to an individual patient.

RADIOMICS

Page 33: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

Powerful GPUs are a must to develop

AI because of their high parallel

computing requirements

Page 34: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

OUR

TEAM

Raúl Yébana

Huertas

Image Analysis

Technician

Andrew Tasker

Business

Development

Human Resources

Management

Inma López

Image Analysis

Scientist

Fabio García

Castro

CTO

Rafael

Hernández

Navarro

Alejandro Mañas

García

Full Stack

Senior Developer

Image Analysis

Scientist

Eduardo

Camacho

Irene Mayorga

Ruiz

Clinical Trials

Coordinator

Ana Jiménez

Pastor

Image Analysis

Scientist

Image Analysis

Scientist

Ismael González

Belén Fos

Guarinos

Quality Engineer

ManagerCOO

Encarna

Sánchez

Bernabé

Marketing

Manager

Katherine

WilischRamírez

Data Scientist

Rafael López

Inma Segarra

Business

DevelopmentFounder & CEO

Ángel

Alberich-Bayarri

Chief Strategy

Officer

Kabir Mahajan

Team Coordinator

Paula Moreno

Page 35: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

AI

Page 36: From Qualitative to Quantitative Radiological Reports ...quibim.com/wp-content/uploads/2018/11/4_21-09-2018_HPC_Jimene… · From Qualitative to Quantitative Radiological Reports

Quantitative Imaging Biomarkers in Medicine

www.quibim.com

Ana Jiménez PastorImage Analysis Scientist

[email protected]

From Qualitative to Quantitative Radiological

Reports through AI and Automated Analysis