auto-context and its application to high-level vision tasks

18
Auto-Context and Its Application to High- level Vision Tasks Zhuowen Tu CVPR 2008 Presented by Vladimir Reilly

Upload: mufutau-allen

Post on 03-Jan-2016

39 views

Category:

Documents


0 download

DESCRIPTION

Auto-Context and Its Application to High-level Vision Tasks. Zhuowen Tu CVPR 2008 Presented by Vladimir Reilly. Problems Tackled in Paper. Horse Segmentation Label Every pixel in image as horse or background. Problems Tackled in Paper. Image labeling More complex segmentation. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Auto-Context and Its Application to High-level Vision Tasks

Auto-Context and Its Application to High-level Vision Tasks

Zhuowen Tu CVPR 2008Presented by Vladimir Reilly

Page 2: Auto-Context and Its Application to High-level Vision Tasks

Problems Tackled in Paper Horse Segmentation

Label Every pixel in image as horse or background

Page 3: Auto-Context and Its Application to High-level Vision Tasks

Problems Tackled in Paper Image labeling

More complex segmentation

Page 4: Auto-Context and Its Application to High-level Vision Tasks

Problems Tackled in Paper Human body Segmentation

Label Body Parts

Page 5: Auto-Context and Its Application to High-level Vision Tasks

Solution Context ADABOOST

Cool Idea Contextual information is integrated directly into

ADABOOST Context not limited by spatial proximity Fast General

Page 6: Auto-Context and Its Application to High-level Vision Tasks

Context

Appearance Context

Label Context

?

Tree?

Grass?

Sky?

Human?

Grass

Page 7: Auto-Context and Its Application to High-level Vision Tasks

Previous Work CRFs

Page 8: Auto-Context and Its Application to High-level Vision Tasks

Previous Work Spatial Boost

In addition to appearance InformationLook at labels of neighbor pixels

Derive weak Spatial Learner

Page 9: Auto-Context and Its Application to High-level Vision Tasks

The Algorithm Iteration 1

Train Image Label Map

Extract 21x21patch

Generate Weak Appearance

Learners8000 possible features

Train Strong Classifier

Page 10: Auto-Context and Its Application to High-level Vision Tasks

The Algorithm Iteration > 1

Train Image Label Map

Segment Images

Probability Map

Extract 21x21patch

Generate Weak Appearance

Learners8000 possible features

Generate Weak Context Learners

Shoot RaysSample Along RaysCompute Statistics

4000 possible features

Page 11: Auto-Context and Its Application to High-level Vision Tasks

Probability out of adaboost

Page 12: Auto-Context and Its Application to High-level Vision Tasks

PBT

Page 13: Auto-Context and Its Application to High-level Vision Tasks

Results

Page 14: Auto-Context and Its Application to High-level Vision Tasks

Results

Google Images

Page 15: Auto-Context and Its Application to High-level Vision Tasks

Interesting Observations Starting with second classifier

90% of selected learners are context learners Label Context improves results Appearance Context worsens results

Probability Map

Train Image

Page 16: Auto-Context and Its Application to High-level Vision Tasks

Results

Page 17: Auto-Context and Its Application to High-level Vision Tasks

Results

Page 18: Auto-Context and Its Application to High-level Vision Tasks

Results