region of interest extraction
DESCRIPTION
TRANSCRIPT
![Page 1: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/1.jpg)
REGION OF INTEREST EXTRACTION
Guide Prof. Shylaja. S. S Varun Kamath B
HOD, ISE Gopi Krishnan Nambiar
![Page 2: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/2.jpg)
INTRODUCTION
Content Based Image Retrieval(CBIR)
Object Based Image Retrieval (OBIR)
Perception Based Image Retrieval (PBIR)
Region Of Interest
Saliency Map
Visual Attention Map
Itti – Koch Model
Stentiford Model
![Page 3: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/3.jpg)
CONTENT BASED IMAGE RETRIEVAL (CBIR)
CBIR refers to retrieval of images according to the content.
The purpose is to retrieve all the images which are relevant to user query.
![Page 4: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/4.jpg)
CBIR Despite the large number of CBIR prototypes developed over
the past 15 years, very few prototypes have experienced success or become popular commercial products.
Most of the CBIR solutions is based on addressing the problem using a biological approach i.e. the way human perceives the image.
The proposed models are applicable to image retrieval scenarios where one or few Regions of interest are present in each image.
![Page 5: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/5.jpg)
OBJECT BASED IMAGE RETRIEVAL (OBIR) AND PERCEPTION BASED IMAGE RETRIEVAL (PBIR)
OBIR refers to retrieval of regions or objects of interest within an image but not the image as a whole.
PBIR is one of the most successful CBIR solutions which addresses the problem from a perceptual perspective and doing so using psychophysical approach i.e. towards stimulus and sensation of the image on the human eye.
![Page 6: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/6.jpg)
REGION OF INTEREST (ROI) The region of interest is that part of the image which catches
our attention instantly than the other parts of the image.
In the examples shown below,
Region of interest
![Page 7: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/7.jpg)
SALIENCY MAP (S)
It is a map which contains the most salient points of the image.
For example if one wants to find a red object in an image, then saliency map will be biased to consider red more than other features.
Salient points
![Page 8: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/8.jpg)
VISUAL ATTENTION MAP (VA)
This map tends to identify larger and smoother salient regions of an image as opposed to identifying the most salient points in Saliency map.
This map is very much dependent on the salient regions of the image.
Areas of Attention
![Page 9: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/9.jpg)
ITTI – KOCH MODEL (I-K MODEL)
This model is used to identify the most salient points in an image.
It works with three low level dimension of images Colour. Orientation. Intensity.
The I-K model outputs a list of image coordinates, each one corresponding to a point of attention (POA)
![Page 10: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/10.jpg)
GENERAL ALGORITHM
![Page 11: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/11.jpg)
SAMPLE OUTPUTS FROM ITTI – KOCH MODEL
Original Image
SaliencyMap
![Page 12: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/12.jpg)
STENTIFORD MODEL
This captures the image regions which have distinctive and uncommon features.
It suppresses the areas of the image with repetitive colour patterns and enhances the salient ones.
This is done by measuring colour dissimilarities between random neighbourhoods in the image and assigning high scores to the most dissimilar pixels in the entire image.
![Page 13: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/13.jpg)
STENTIFORD MODEL
Matching neighborhoods x and y
![Page 14: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/14.jpg)
SAMPLE OUTPUTS FROM STENTIFORD MODEL
Original Image
Visual Attention Map
![Page 15: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/15.jpg)
COMPARISON BETWEEN ITTI-KOCH AND STENTIFORD MODEL OUTPUTS
Original Image Saliency Map VA Map
![Page 16: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/16.jpg)
A general view of the proposed VA-based ROI extraction method.
Proposed ROI Extraction
IndexIndexPOA - Point of Attention AOA - Area of Attention VA – Visual Attention
![Page 17: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/17.jpg)
GAUSSIAN PYRAMIDGAUSSIAN PYRAMID
A powerful and conceptually simple structure for representing images at more than one resolution
![Page 18: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/18.jpg)
EXAMPLE OF GAUSSIAN PYRAMIDING
Figure 6: The Gaussian pyramid. The original image is repeatedly filtered and sub sampled to generate the sequence of reduced resolution images
![Page 19: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/19.jpg)
CONCLUSIONS
Since the models produce their own ROIs, which may or may not match with each others’ maps (here referring to Itti-Koch and Stentiford models), better output can be derived i.e. by combining both the common ROIs of the respective maps.
This procedure can be used for effective Thumbnail Cropping and indexing.
![Page 20: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/20.jpg)
DRAWBACKS
Both the models are still incomplete (still under development) and hence not completely accurate.
If there are many ROIs in an image, all of them may still not be recognized because the models are not completely perfect in recognizing every ROI.
If the images are of poor quality and still ROIs are recognized by the human eye, the proposed models may not recognize them.
![Page 21: Region Of Interest Extraction](https://reader036.vdocuments.us/reader036/viewer/2022081414/54b4d07a4a7959be0f8b45f6/html5/thumbnails/21.jpg)
REFERENCES Extraction of Salient Regions of Interest Using Visual Attention
Models Gustavo B. Borba and Humberto R. Gamba, Oge Marques and
Liam M. Mayron
An Attention-Driven Model for Grouping Similar Images with Image Retrieval Applications Oge Marques, Liam M. Mayron, Gustavo B. Borba and Humberto
R. Gamba
A Model of Saliency-Based Visual Attention for Rapid Scene Analysis Laurent Itti, Christof Koch, and Ernst Niebur
An attention based similarity measure with application to content based information retrieval Fred W M Stentiford