color matching of image sequences with combined gamma and linear corrections
DESCRIPTION
Color Matching of Image Sequences with Combined Gamma and Linear Corrections. Yingen Xiong and Kari Pulli. Download our panorama software : http://store.ovi.com/content/51491. Outline. Introduction What is the problem? Why do we need color correction? Related work - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/1.jpg)
Nokia Research Center
Color Matching of Image Sequences with Combined Gamma and Linear CorrectionsYingen Xiong and Kari Pulli
Download our panorama software :
http://store.ovi.com/content/51491
![Page 2: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/2.jpg)
Nokia Research Center2
Outline• Introduction
• What is the problem? Why do we need color correction?• Related work
• Color correction with color matching• Problem expression• Color matching by gamma correction• Color mean matching by gamma correction• Combination of gamma and linear corrections
• Applications and results• Conclusions
![Page 3: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/3.jpg)
Nokia Research Center
Introduction: Mobile Panorama System
3
Image registration
Image warping
or Image blending
Image capturing
camera
Color correction
Image labeling
Object editing
Panorama viewing
Download our panorama software: http://store.ovi.com/content/51491
![Page 4: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/4.jpg)
Nokia Research Center4
What is the Problem?• Image parameters (focus, exposure, WB) change for each image
• Changes in illumination lead to different exposure levels • The same objects in different frames may have different apparent
colors
![Page 5: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/5.jpg)
Nokia Research Center5
Panorama Stitching without Color Correction• Stitching artifacts ; visible seams; bad color transitions
![Page 6: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/6.jpg)
Nokia Research Center
Color Correction to Reduce Color Differences • Perform color correction before panorama stitching
6
![Page 7: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/7.jpg)
Nokia Research Center7
Related Work• Linear-model-based color correction
• Color correction
• Luminance correction
• Polynomial mapping and others
sRGB color space
Tian et al. 2002
YCbCr color space
Ha et al. 2007
Linearized RGB color space
Xiong and Pulli 2009
Histogram mapping
Zhang et al. 2001
Linearized RGB color space
Meunier and Borgmann 2000
sRGB color space
Brown and Lowe 2007
Pham and Pringle 1995
Polynomial mapping
![Page 8: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/8.jpg)
Nokia Research Center8
Color Correction using Linear Model• Original source images with different colors
• Simple, fast, color saturation, low quality
![Page 9: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/9.jpg)
Nokia Research Center9
Efficient Color Correction is Needed • Avoid saturation problems• Reduce color differences
![Page 10: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/10.jpg)
Nokia Research Center10
Color Matching with Gamma Correction
pii
iipii
ii
ii pCN
pCN
)(1)(11,
,1,1
,1
1
pii
iiii
ipCN
U 1)(1,1
,1,1
p
iiii
iiipC
NU )(1
1,,1
1,
n
igi
n
iNiiii UU
E
1
22
2
221,,1
1
/)1(/)(
min
i
pCpC ii )()(
![Page 11: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/11.jpg)
Nokia Research Center11
Color Matching with Gamma Correction
![Page 12: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/12.jpg)
Nokia Research Center12
Color Mean Matching with Gamma Correction
pii
iiii pC
NB )(1ln ,1
,1,1
pii
iiii pC
NB )(1ln 1,
,11,
n
igi
n
iNiiiiii BB
E
1
22
2
221,,11
2
/)1(/)(
min
i
pCpC ii )()(
1,,11 iiiiii BB
![Page 13: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/13.jpg)
Nokia Research Center13
Color Mean Matching with Gamma Correction
![Page 14: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/14.jpg)
Nokia Research Center14
Combination of Gamma and Linear Correction
n
igi
n
iNiiiiii BBE
1
22
2
221,,112 /)1(/)(min
n
igi
n
iNiiiiii SSE
1
22
2
221,,113 /)1(/)(min
i
pYpY ii )()( )()( pCpC iii
pii
iiii pY
NB )(1ln ,1
,1,1
p
iiii
ii pCN
S )(1,1
,1,1
pii
iiii pY
NB )(1ln 1,
,11,
p
iiii
ii pCN
S )(11,
,11,
1,,11 iiiiii BB 1,,11 iiiiii SS
![Page 15: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/15.jpg)
Nokia Research Center15
Combination of Gamma and Linear Correction
![Page 16: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/16.jpg)
Nokia Research Center16
Comparison of the Results
![Page 17: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/17.jpg)
Nokia Research Center17
Applications and Result Analysis• Application environment
• Implemented in a mobile panorama imaging system
• Runs on several mobile devices• Nokia N900, N8, N95, …
Nokia N95 8GARM 11 332 MHz
processor128MB RAM
ARM Cortex A8 600 MHz processor256MB RAM768MB virtual memory3.5 inch touch display
Nokia N900
Nokia N8
![Page 18: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/18.jpg)
Nokia Research Center18
Computation Time
Computational time for color correction:• 5 images: 0.37, 1.08, 1.86 seconds• 10 images: 0.97, 1.56, 4.12 seconds
Resolution
Time for 5 Images (sec.) Time for 10 Images (sec.)
A B C D A B C D1280x960 0.37 3.30 2.48 6.15 0.97 6.96 5.44 13.372048x1536 1.08 6.72 4.70 12.50 1.56 14.44 10.46 26.462576x1936 1.86 15.98 12.25 30.09 4.12 35.63 29.34 69.09
A: color correction, B image labeling, C: image blending, D: image stitching
![Page 19: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/19.jpg)
Nokia Research Center
Color and Color Mean matching
![Page 20: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/20.jpg)
Nokia Research Center
Gamma Correction in Different Color Spaces
![Page 21: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/21.jpg)
Nokia Research Center21
Different Color Correction
Local linear correction in sRGB
Local linear correction in YCbCr
Global linear correction in sRGB
Color matching with gamma correction
Color matching with gamma mean correction
![Page 22: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/22.jpg)
Nokia Research Center22
Different Color Correction
Local linear correction in sRGB
Local linear correction in YCbCr
Global linear correction in sRGB
Color matching with gamma correction
Color matching with gamma mean correction
![Page 23: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/23.jpg)
Nokia Research Center23
Image Sequences with Random Order
![Page 24: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/24.jpg)
Nokia Research Center24
More Examples
![Page 25: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/25.jpg)
Nokia Research Center25
Conclusions• Color correction with color matching
• Gamma correction for luminance• Linear correction for chrominance
• Implementation• Runs on mobile phones, high quality
• download from http://store.ovi.com to your N8 / N900
• Advantages• No color saturation problems during color correction• Good color transitions for the whole image sequence• Efficient (fast) execution
![Page 26: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/26.jpg)
Nokia Research Center
Thank You
26
![Page 27: Color Matching of Image Sequences with Combined Gamma and Linear Corrections](https://reader035.vdocuments.us/reader035/viewer/2022062400/5681692b550346895de06b9c/html5/thumbnails/27.jpg)
Nokia Research Center27
Questions?
Download our mobile panorama software at http://store.ovi.com/content/51491