illumination independent color-based face detection “15 seconds of fame” jure kovač, peter...
TRANSCRIPT
Illumination Independent Color-
Based Face Detection
“15 Seconds of Fame”
Jure Kovač, Peter Peer, Franc Solina
Computer Vision LaboratoryFaculty of Computer and Information ScienceUniversity of Ljubljana, Slovenia
“In the future everybody will be famous for 15 minutes.”
Andy Warhol
Marilyn Monroe (Andy Warhol, 1964)
Application Contribution Illum. compensation Tested using our
algorithm Purpose
An interactive art installation 15 second of fame
Hardware
Digital camera LCD monitor
computer
USB
Software
input photo
finding faces
transformation color filter
pop-art portrait
illumination compensation learning
15 second loop
Roadmap
Face detection algorithm Illumination compensation
approaches Pop-art color transformations Summary
Face detection method #1Our original face detection method
Face detection method #2Simplified face detection method
Eliminating the influence of non-standard illumination
Color descriptor Color
constancy/compensation Problem solving Method outline:
Estimate the present illumination
Reconstruct the image under standard illumination
Close to standard illumination
Grey World Average surface color in the image is achromatic Illumination estimation: average color Mean gray value
Modified Grey World Illumination estimation: each color is count only
once
White-Patch Retinex On each image white surface is present Illumination estimation: maximal color
Far from standard illumination
Color by Correlation Initial step: learning Illumination detection using correlation Illumination reconstruction using SPD data
(effective idea: use Macbeth color checker)
Influence of methods #1
NO GW
MGW RET
NO – original
GW – Gray World
MGW – Modified GW
RET – White-Patch Retinex
Influence of methods #2
NO GW MGW
RET COR
NO – original
GW – Gray World
MGW – Modified GW
RET – White-Patch Retinex
COR – Color by Correlation
Face detection results #1
0
20
40
60
80
100
standard incandescent flashlight neon
Without preprocessing GW MGW RET
Face detection results #2
0
20
40
60
80
100
white yellow green blue red
Without preprocessing Color by Correlation
Effectiveness illustration #1
GW
Effectiveness illustration #2
COR
Color transformations
+ color-balance
+ random coloring
+ posterize+ hue-saturation
+ color-balance+ posterize+ hue-saturation
= 17 universal filters
Conclusions
Very well accepted by the audience Accurate face detection method Robust face detection algorithm
(due to illumination compensation methods) Color transformations generate a pop-art effect Portrait can be ordered by e-mail
Different graphic effect according to the mood Additional filters (negative image, b&w
technique, highlighted edges,…) Extension to 3D?
The gallery of famous people
from the project web page: black.fri.uni-lj.si/15sec
The first public showing
Illumination reconstruction