image analysis and cv in med - sonu iqbal

Upload: raina-rahim

Post on 09-Apr-2018

217 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    1/43

    Image Analysis and Computer Vision in Medicine

    Sonu Iqbal

    S7 CSE B

    Guide: Mr. Anil Jacob

    MESCE

    November 13, 2010

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    2/43

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    3/43

    Outline

    Background

    Digital Imaging and Computer Vision

    Why Computer Vision

    Examples

    Medical Imaging

    PipelinePreprocessing

    Segmentation

    Recognition

    2 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    4/43

    Outline

    Background

    Digital Imaging and Computer Vision

    Why Computer Vision

    Examples

    Medical Imaging

    PipelinePreprocessing

    Segmentation

    Recognition

    Trends

    Techniques

    Tools

    2 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    5/43

    Outline

    Background

    Digital Imaging and Computer Vision

    Why Computer Vision

    Examples

    Medical Imaging

    PipelinePreprocessing

    Segmentation

    Recognition

    Trends

    Techniques

    Tools

    Summary

    2 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    6/43

    Outline

    Background

    Digital Imaging and Computer Vision

    Why Computer Vision

    Examples

    Medical Imaging

    PipelinePreprocessing

    Segmentation

    Recognition

    Trends

    Techniques

    Tools

    Summary

    References2 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    7/43

    Digital Imaging and Computer Vision

    All types of image processing techniques are collectively known as

    digital imaging.

    3 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    8/43

    Digital Imaging and Computer Vision

    All types of image processing techniques are collectively known as

    digital imaging.

    3 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    9/43

    Digital Imaging and Computer Vision

    All types of image processing techniques are collectively known as

    digital imaging.

    Computer Vision aims at designing computer systems mimicking the

    human sense of sight.

    3 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    10/43

    Why Computer Vision?

    Computer Vision is concerned with the theory behind artificialsystems that extract information from images.

    4 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    11/43

    Why Computer Vision?

    Computer Vision is concerned with the theory behind artificialsystems that extract information from images.

    Computer Vision can

    1. Organize information.

    4 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    12/43

    Why Computer Vision?

    Computer Vision is concerned with the theory behind artificial

    systems that extract information from images.

    Computer Vision can

    1. Organize information.

    2. Model objects or

    environments.

    4 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    13/43

    Why Computer Vision?

    Computer Vision is concerned with the theory behind artificial

    systems that extract information from images.

    Computer Vision can

    1. Organize information.

    2. Model objects or

    environments.

    3. Estimate Pose.

    4 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    14/43

    Why Computer Vision?

    Computer Vision is concerned with the theory behind artificial

    systems that extract information from images.

    Computer Vision can

    1. Organize information.

    2. Model objects or

    environments.

    3. Estimate Pose.4. Morphometry.

    4 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    15/43

    Why Computer Vision?

    Computer Vision is concerned with the theory behind artificial

    systems that extract information from images.

    Computer Vision can

    1. Organize information.

    2. Model objects or

    environments.

    3. Estimate Pose.4. Morphometry.

    5. Accurate interpretation

    and prediction.

    4 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    16/43

    Examples

    5 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    17/43

    Medical Imaging

    Technique and process used to create images of the human body to

    reveal and diagnose diseases.

    6 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    18/43

    Pipeline

    The image analysis and computer vision pipeline is composed of the

    following steps:

    1. Image Acquisition.

    2. Preprocessing.

    3. Segmentation.

    4. Reconstruction of data.

    5. Matching.

    6. Recognition.

    7 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    19/43

    Preprocessing

    Preprocessing aims at enhancing the image for visualization from:

    High-frequency acquisition noise

    Background luminance variations

    Camera geometrical distorsions.

    8 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    20/43

    Preprocessing

    1. Photogrammetric methods

    Known spatial or luminance characteristics.

    Real time in the display memory for visualization purpose.

    9 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    21/43

    Preprocessing

    1. Photogrammetric methods

    Known spatial or luminance characteristics.

    Real time in the display memory for visualization purpose.

    2. Filtering methods

    Known spectral characteristics.

    Low-pass filters are used for decreasing noise,

    Band-pass filters to eliminate periodical perturbations,

    High-pass filters to enhance and sharpen edges

    9 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    22/43

    Preprocessing

    1. Photogrammetric methods

    Known spatial or luminance characteristics.

    Real time in the display memory for visualization purpose.

    2. Filtering methods

    Known spectral characteristics.

    Low-pass filters are used for decreasing noise,

    Band-pass filters to eliminate periodical perturbations,

    High-pass filters to enhance and sharpen edges

    3. Geometric corrections

    Required when images are geometrically distorted.

    9 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    23/43

    Segmentation

    Segmentation involves extracting primitive elements that will then be

    approximated by some models.

    Isolating regions.

    Contours.

    10 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    24/43

    Segmentation

    1. Thresholding methods.

    Simplest method of image segmentation.

    Used to create binary images from grayscale.

    11 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    25/43

    Segmentation

    1. Thresholding methods.

    Simplest method of image segmentation.

    Used to create binary images from grayscale.

    2. Edge extraction.

    Delineation of regions by locating their contours.

    Extracted using first derivative operators, Laplacian Masks, etc.

    11 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    26/43

    Segmentation

    1. Thresholding methods.

    Simplest method of image segmentation.

    Used to create binary images from grayscale.

    2. Edge extraction.

    Delineation of regions by locating their contours.

    Extracted using first derivative operators, Laplacian Masks, etc.3. Region extraction.

    Yields parts of the image that satisfy a given uniformity criterion.

    11 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    27/43

    Segmentation

    12 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    28/43

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    29/43

    Recognition

    Involves two phases:

    1. Learning

    Typical characteristics of the objects to be recognized

    are determined.

    Supervised, the user identifies which are the relevant.

    2. Exploitation

    Unknown objects are passed through the same pipeline

    The object characteristics are measured.

    14 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    30/43

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    31/43

    Recognition

    The most classical recognition paradigm is statistical. Techniques

    includes:

    Neural networks

    Advocated as excellent

    classifiers. Ability to define

    non-linear decision

    surfaces. Back-propagation

    learning mechanism. Need for large training

    sets.

    16 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    32/43

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    33/43

    Trends

    18 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    34/43

    Techniques

    Several medical imaging techniques are employed today.

    Medical Ultrasonography.

    Radiology.

    Thermography.

    And more.

    19 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    35/43

    Medical Ultrasonography

    20 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    36/43

    Radiology

    21 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    37/43

    Radiology

    Brain CT Scan, MRI of Knee

    22 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    38/43

    Thermography

    23 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    39/43

    Thermography

    Multiple sclerosis detection. A Dog

    24 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    40/43

    Tomography

    Is the basic technique of imaging deployed in above methods. It is the

    method of imaging a single plane, or slice.

    25 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    41/43

    Open Source Tools

    ImageJ

    Java-based image processing program developed at the NationalInstitutes of Health

    3DSlicer

    Used in a variety of medical applications, including autism,

    multiple sclerosis etc. MicroDicom

    Free DICOM viewer for Windows. OsiriX

    Image processing application dedicated to DICOM images.

    26 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    42/43

    Summary

    Is there any motivation for incorporating computer vision algorithms

    for physicians?

    In order to help the physician interpret, predict and plan.

    They provide tools and methods for extracting the necessary pieces

    of knowledge.

    Recent progress in computer vision has improved new models inmedical imaging.

    Fast. Easy. Efficient.

    27 of 28

  • 8/8/2019 Image Analysis and CV in Med - Sonu Iqbal

    43/43

    References

    Image Analysis and Computer Vision in Medicine, Thierry Pun,

    Guido Gerig and Osman Ratib.

    IEEE Transactions on Medical Imaging. Journal. 2008.

    Tomographic Reconstruction in the 21st Century, Clackdoyle, R.;

    Defrise, M.; IEEE.

    Medical Imaging on Wikipedia.

    28 of 28