relevance feedback-based image retrieval interface incorporating region and feature saliency...
Post on 21-Dec-2015
215 views
TRANSCRIPT
![Page 1: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/1.jpg)
Relevance Feedback-Based Image Retrieval InterfaceIncorporating Region and Feature Saliency Patterns
as Visualizable Image Similarity Criteria
Speaker: Kun Hsiang
![Page 2: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/2.jpg)
Outline
RFSP Image Similarity Model
• GA-Based Relevance Feedback Mechanism Using RFSP
• Experimental Evaluation of RFSP Method
![Page 3: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/3.jpg)
RFSP Image Similarity Model
• Set of images I represents the image database.
• The area of each image is partitioned into nR regions, defined by the set of regions R .
• From each region, nF features are extracted, based on the set of features F.
• The set of weights W contains nW real-valued region and feature weights.
![Page 4: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/4.jpg)
RFSP Image Similarity Model
![Page 5: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/5.jpg)
RFSP Image Similarity Model
• Region is defined as a rectangular array of image pixels, and all image regions are of equal size, obtained by uniformly partitioning the image area into NxN (=nR) blocks.
• Feature denotes an arbitrary image feature , e.g., color or texture ,based on which the similarity of a pair of image regions is computed.
• Weight denotes the relative importance of a region or a feature.
![Page 6: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/6.jpg)
RFSP Image Similarity Model
![Page 7: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/7.jpg)
RFSP Image Similarity Model
![Page 8: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/8.jpg)
RFSP Image Similarity Model
![Page 9: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/9.jpg)
RFSP Image Similarity Model
![Page 10: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/10.jpg)
RFSP Image Similarity Model
• Thanks to the relevance feedback, all the user has to do is to specify the query image and a couple of relevant images, without worrying about the region and feature weights, or at all being aware of the existence of the RFSP structure.
![Page 11: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/11.jpg)
RFSP Image Similarity Model
![Page 12: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/12.jpg)
RFSP Image Similarity Model
![Page 13: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/13.jpg)
GA-Based Relevance Feedback Mechanism Using RFSP
• GA for inferring RFSP:– We employed five weight levels:minimal (0),
low(0.25), medium(0.5), high(0.75), maximal (1)
– W={w1,w2,w3,w4,w5}
![Page 14: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/14.jpg)
GA-Based Relevance Feedback Mechanism Using RFSP
• GA for inferring RFSP:– An important difference between the proposed
RFSP model and all of the surveyed relevance feedback methods is that the proposed model uses a discrete set of (region and feature) weights, rather than arbitrary weights from interval [0, 1].
![Page 15: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/15.jpg)
GA-Based Relevance Feedback Mechanism Using RFSP
• GA for inferring RFSP:– Using a discrete set of weights:
• While theoretically decreasing the expressive power of the model
• Also contributes to the faster convergence of the GA, and does not have practical implications on the retrieval performance, as confirmed through the preliminary experiments.
• Increasing the number of weight levels only made the convergence slower, without improving the retrieval performance.
• In the preliminary experiments, five weight levels resulted in the optimal balance between the speed of GA convergence and the retrieval performance.
![Page 16: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/16.jpg)
GA-Based Relevance Feedback Mechanism Using RFSP
• Chromosome coding:– Gene
![Page 17: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/17.jpg)
GA-Based Relevance Feedback Mechanism Using RFSP
• Chromosome coding:– Chromosome
![Page 18: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/18.jpg)
GA-Based Relevance Feedback Mechanism Using RFSP
• Fitness measure
![Page 19: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/19.jpg)
GA-Based Relevance Feedback Mechanism Using RFSP
![Page 20: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/20.jpg)
GA-Based Relevance Feedback Mechanism Using RFSP
• Evolution parameters:– Regarding the parameters of the GA evolution,
selection is a standard proportional selection incorporating elitist model.
– Crossover probability is 0.6– Mutation probability is 0.1– Population size is 50 chromosomes– Evolution length is 250 generations.
![Page 21: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/21.jpg)
Experimental Evaluation of RFSP Method
• Test Databases:– Vistex-60 database– Vistex-167 database– Brodatz-208 database– Corel-1000-A database– Corel-1000-B database
![Page 22: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/22.jpg)
Experimental Evaluation of RFSP Method
![Page 23: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/23.jpg)
Experimental Evaluation of RFSP Method
![Page 24: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/24.jpg)
Experimental Evaluation of RFSP Method
![Page 25: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/25.jpg)
Experimental Evaluation of RFSP Method
![Page 26: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/26.jpg)
Experimental Evaluation of RFSP Method
GA
![Page 27: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/27.jpg)
Experimental Evaluation of RFSP Method
LSP
![Page 28: Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker](https://reader035.vdocuments.us/reader035/viewer/2022062714/56649d5f5503460f94a3ff1a/html5/thumbnails/28.jpg)
Experimental Evaluation of RFSP Method
RFSP