![Page 1: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/1.jpg)
GrabCutInteractive Foreground Extraction
Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet
![Page 2: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/2.jpg)
GrabCut – Patchworks – Blender Three complementary Tools
GrabCut
Patchworks
Compose
![Page 3: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/3.jpg)
The Goal
User friendly tool for extracting objects in images
![Page 4: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/4.jpg)
Basic Idea
GrabCut - better Quality in less Time
User Input
Result
Magic Wand Magnetic Lasso GrabCut
Colour Contrast Colour & Contrast
![Page 5: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/5.jpg)
How does it work?
Energy minimization based on a novel “MinCut” algorithm
Foreground &Background
Background
Foreground
Background
Colour Space Colour Space
?
![Page 6: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/6.jpg)
User Interface
User Input
User Edit
Result
Rectangle Lasso First Result
Brushes Magnetic Lasso
![Page 7: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/7.jpg)
Energy Minimization
User Edit: Fore- and Background brush
User Interface
![Page 8: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/8.jpg)
Evaluation – Moderately Difficult Images
Initially 100% correct Initially 83% correctInitially 91% correct
GrabCut is superior to Magnetic Lasso if more than 50% of the initial boundary is correct
FirstUser Input
FirstResult
FinalResult
![Page 9: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/9.jpg)
Evaluation - Difficult Images
Camouflage &
Low ContrastAmbiguous colours Thin structure
Initially 75% correct Initially 45% correct Initially 5% correct
GrabCut is superior to Magnetic Lasso if more than 50% of the initial boundary is correct
First User Input
InitialResult
![Page 10: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/10.jpg)
Hard & Soft Extraction
Hard Extraction Soft ExtractionInput
Alpha Matting: Boundary pixels are a combination of Foregroundand Background
![Page 11: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/11.jpg)
Basic IdeaRegularized Transition
“Skin”-Colour Profile
GrabCut
Foreground Mixed Background
Energy minimization with regularization
![Page 12: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/12.jpg)
Soft Extraction Comparison
Input
Bayes Matte
Research
Knockout 2
Photoshop Plug InGrabCut
![Page 13: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/13.jpg)
Comparison
GrabCut - better Quality in less Time
Magic Wand
Photoshop 7
Magnetic Lasso
Photoshop 7
Knockout 2
Photoshop Plug-In
BJ-GraphCut
Research
GrabCut
![Page 14: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/14.jpg)
Application – Home UsersEdit your holiday photos
![Page 15: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/15.jpg)
Application – Home UsersDigital Photomontage
![Page 16: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/16.jpg)
Application – Home UsersDigital Photomontage
![Page 17: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/17.jpg)
Application – Home UsersSell objects on eBay
![Page 18: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/18.jpg)
Application – ProfessionalsAdvertisement
![Page 19: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/19.jpg)
Summary
• GrabCut is a user friendly method for extracting objects in images
• Two major steps - Hard & Soft extraction
• For moderately difficult images GrabCut gives better Quality in less Time
• GrabCut will be presented at SIGGRAPH ‘04
![Page 20: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/20.jpg)
Future Ideas
Fully automatic system using object recognition
GrabCut Foreground
FaceRecognition
![Page 21: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/21.jpg)
Carsten Rother
GrabCut Team
Andrew BlakeVladimir Kolmogorov
![Page 22: GrabCut Interactive Foreground Extraction Carsten Rother – Vladimir Kolmogorov – Andrew Blake – Michel Gangnet](https://reader033.vdocuments.us/reader033/viewer/2022051001/5697bf7b1a28abf838c83622/html5/thumbnails/22.jpg)