kyle j. myers, ph.d. nibib/cdrh laboratory for the assessment of medical imaging systems
DESCRIPTION
Image Acquisition Issues in Quantitation Tasks. Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems. Knowledge of the is critical for solving an. forward problem. Description of the data for a known object. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/1.jpg)
![Page 2: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/2.jpg)
Knowledge of the
is critical for solving an
Description of the data for a known object
Inference about an underlying object from an image
![Page 3: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/3.jpg)
Knowledge of the
Description of the data for a known object
Provides a description of images/data Noise, resolution, artifacts,…
Optimal classification and estimation depend on likelihood of data given underlying object
![Page 4: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/4.jpg)
Object property being imaged
Acoustic reflectance Medical ultrasound
Concentration Nuclear medicine MRI (spin density) MRS
Field strength Biomagnetic imaging
Attenuation Film densitometry Transmission x-ray
Scattering properties Medical ultrasound
Electric, magnetic properties
Impedance tomography MRI (magnetization MRI (spin relaxation)
Source strength Fluorescence microscopy
Index of refraction Phase-contrast microscopy
Gene expression DNA chips, microarrays
![Page 5: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/5.jpg)
Image acquisition: a mapping from object space to data space
g = data ( )
H = the imaging process (mapping)
f = tumor/object/patient (what we want to )
Which H is best? What more can we do with possible improvements in H ?
![Page 6: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/6.jpg)
Need models/measures of
H
to characterize the data
![Page 7: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/7.jpg)
Singular Value Decomposition (SVD): Tool for understanding the forward problem
Basis functions are found by eigenanalysis of HtH
Continuous-Continuous (CC) system Linear, shift-invariant (LSIV)
Fourier theory: Basis functions are wavefunctions MTF describes resolution NPS describes noise
Continuous-Discrete (CD) system H is shift-variant
Resolution and noise depend on location Basis functions may be “natural pixels,”
tubes or cones (projection imaging)
![Page 8: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/8.jpg)
Measure the mapping…
When the object is a point source f (r) = (r - r0) ,
The image is the detector sensitivity function
= a component of the mapping H.
![Page 9: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/9.jpg)
Measuring H on FASTSPECT II at U. of AZ
![Page 10: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/10.jpg)
Eigenfunctions of anoctagonal SPECT system
Barrett et al., IPMI (1991).
![Page 11: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/11.jpg)
Null space: H fnull = 0 If f1 and f2 differ by a null function: H f1 – H f2 =
0 no difference in the image
CC system: where MTF has zeros
CD system examples: finite sampling Limited-angle tomography Temporal sampling Spatial sampling (pixel binning)
All digital systems have null functions Can’t recover object uniquely from image
![Page 12: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/12.jpg)
Null functions cause artifacts
Reconstruction of a brain phantom by filtered backprojection. (Courtesy of C.K. Abbey)
![Page 13: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/13.jpg)
Image reconstruction Regularization can reduce objectionable artifacts
Can’t put back what’s lost due to null functions Makes noise nonlocal – contributions from entire
image
Sequence of reconstructions of a brain phantom by the MLEM algorithm after 10, 20, 50, 100, 200, and 400 iterations. (Courtesy of D.W. Wilson.)
![Page 14: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/14.jpg)
Knowing the forward problem means knowing the null space
Barrett et al., IPMI (1991).
![Page 15: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/15.jpg)
Classification tasks: Ideal (Bayesian) observer
Optimal classifier is based on the likelihood ratio:
Performance is determined by statistics of the likelihood ratio
ROC analysis
)|(pr
)|(pr)(
1
2
H
H
g
gg
Disease present)Disease present)
![Page 16: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/16.jpg)
Estimation
Tumor volume Requires delineation of
border
Tracer uptake Total or specific activity
Angiogenesis
Vessel tortuosity
Bullitt et al., IEEE TMI (2003).
![Page 17: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/17.jpg)
Estimation: Basic concepts
is P –D vector of object parameters
pris prior probability density; describes underlying randomness in the parameters
pr(g|) = mapping from parameters to data = likelihood of data given
(g)= estimate of parameter vector^
![Page 18: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/18.jpg)
Estimability pr(g|1) = pr(g|2) implies 1=2
Closely linked to null functions
Estimates of pixel values run into problems of estimability See Barrett and Myers, 2004
![Page 19: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/19.jpg)
Figures of merit
Bias, variance
Mean-square error
Overall fluctuation in the estimate for particular
Requires gold standard = true value of parameter
Only meaningful for estimable parameters
Limited by measurement noise, anatomical variation, form of the estimator
![Page 20: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/20.jpg)
Figures of merit – cont’d
Ensemble MSE (EMSE)
Need to know prior on Prior information can be statistical or model-
based Makes problem well-posed
![Page 21: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/21.jpg)
Family of possible tumors
Tumor = t(t) Location Size Shape Density
Some unknowns are nuisance parameters Estimate or marginalize
Key to tractability is knowledge of pr(t)
Courtesy Miguel Eckstein, UCSB
![Page 22: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/22.jpg)
Inhomogeneous backgrounds can mask tumor/margins
Additional source of variability in the data
Degrades tumor detectability, estimation of tumor parameters
Reduced noise, increased resolution may not improvetask performance
Many models for pr(b) to describe random
backgrounds
![Page 23: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/23.jpg)
No-gold standard estimation
Use at least 2 modalities to estimate
OR Use at least 2 estimators
for same data
Regress the estimates from all sources
Requires model for parameter , knowledge of pr(g|)
Hoppin et al., IEEE TMI (2002).
![Page 24: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/24.jpg)
Estimation results
Detection results
Kupinski et al., SPIE 2003
Optimal acquisition system is task-dependent
![Page 25: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/25.jpg)
Drug response studies using clinical (human) readers Beware of reader variability
0 .0
0 .0
0 .0
0 .0
0 .1
0 .1
0 .1
0 .1
0 .2
0 .2
0 .2
0 .2
0 .3
0 .3
0 .3
0 .3
0 .4
0 .4
0 .4
0 .4
0 .5
0 .5
0 .5 0 .5
0 .6
0 .6
0 .6
0 .6
0 .7
0 .7
0 .7
0 .7
0 .8
0 .8
0 .8
0 .8
0 .9
0 .9
0 .9
0 .9
1 .0
1 .01 .0
1 .0
F a lse P ositive F raction
Tru e N egativ e F raction
Tru
e P
osit
ive
Fra
ctio
n
Fal
se N
egat
ive
Fra
ctio
n
TPF vs FPF for 108 US radiologists in studyby Beam et al., (1996).
![Page 26: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/26.jpg)
Drug response studies using clinical (human) readers
Adds to sources of variability in the study Need more cases to power the study
Analyzed via random-effects or multivariate ROC analysis
Multi-reader multi-case (MRMC) ROC methodology is commonly used in CDRH for determining contribution of variability due to range of reader skill, reader threshold, and case difficulty
![Page 27: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/27.jpg)
Why consider display image quality?
Image Processing
PACS
The diagnostic imaging chain is as effective as its weakest
component! Poor display quality can:
reduce effectiveness of diagnostic or screening test lead to misdiagnosis cause inconsistent clinical decisions
Display Processing
X-raygenerati
on
Object Digital detector (indirect)
Filtration
IMAGE ACQUISITION
Courtesy Aldo Badano, CDRH
![Page 28: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/28.jpg)
Choice of image acquisition system and settings will depend on the answers to these questions:
What information about the object is desired from the image?
How will that information be extracted?
What objects/patients will be imaged?
What measure of performance will be used?
![Page 29: Kyle J. Myers, Ph.D. NIBIB/CDRH Laboratory for the Assessment of Medical Imaging Systems](https://reader034.vdocuments.us/reader034/viewer/2022052702/5681481f550346895db54a28/html5/thumbnails/29.jpg)
Summary The future: Knowledge of the forward
problem will enable well-characterized, patient-specific image-acquisition choices and processing/estimation methods
For now: Make sure the problem is well-posed and the
parameters are estimable Avoid pixel-based techniques Use model-based (low-dimensional) methods Try to keep the human out of the loop Validate, validate, validate!