adding motion blur to still images - tu delft · 2019. 5. 29. · motion blur adding motion blur to...
TRANSCRIPT
Xuejiao Luo1,2, Nestor Salamon1, Elmar Eisemann1
Adding Motion Blur to Still Images
1Delft University of Technology 2Telecom ParisTech
Introduction
Adding Motion Blur to Still Images
Motion Blur
Adding Motion Blur to Still Images 3
blasing by, by mitchell haindfield (CC BY 2.0) DSC04627, by Lewin Bormann (CC BY-SA 2.0)
Motion Blur
Adding Motion Blur to Still Images 4
Cambridge Circus, by Stig Nygaard (CC BY 2.0)
mountainbike downhill contest motion, by Markus Spiske (CC0)
Motion Blur
Adding Motion Blur to Still Images 5
• Shutter Speed
• Object Motion
• Camera Motion
• Illumination, lens, filter..
• Long Exposure, slow motion
Le Mans 2013, by Surreal Name Given (CC BY 2.0)
• Depth of field – Stereo defocus [Barron et al.] – Light Field1, special sensors [Nagahara et al.]
• Image sequence – Virtual Exposure [Telleen et al.] – Reelsmart2
• Photoshop, GIMP
Related Work
Adding Motion Blur to Still Images 6
1) https://www.lytro.com/ 2) http://revisionfx.com/products/rsmb/
Adding Motion Blur to Still Images 7
BLUR
Our Approach
Adding Motion Blur to Still Images
Our Approach
Adding Motion Blur to Still Images 9
BLUR
* Original image from pixabay.com (CC0)
Foreground Motion Blur
Background Motion Blur
Segmentation
Input Image
Our Approach
Adding Motion Blur to Still Images 10
BLUR
* Original image from pixabay.com (CC0)
Foreground Motion Blur
Background Motion Blur
Segmentation
Input Image
GrabCut Segmentation [Rother et al.]
Segmentation
Adding Motion Blur to Still Images 11
Segmentation
Adding Motion Blur to Still Images 12
GrabCut Segmentation [Rother et al.]
Our Approach
Adding Motion Blur to Still Images 13
BLUR
* Original image from pixabay.com (CC0)
Foreground Motion Blur
Background Motion Blur
Segmentation
Input Image
Adding Motion Blur to Still Images 14
Blur Kernel
A
B
|AB| = 3
α = -45⁰
0.030 0.050 0 0 00.050 0.177 0.051 0 0
0 0.051 0.177 0.051 00 0 0.051 0.177 0.0500 0 0 0.050 0.030
Given motion length and angle: 1) Create a matrix length+2 2) Set to 1 the pixels belonging the motion vector 3) For each position, calculate one minus the distance to the motion vector 4) Normalize
Motion Vector Motion Blur Kernel
Naive Convolution, foreground
Adding Motion Blur to Still Images 15
Foreground
BLUR
Naive Convolution, background
Adding Motion Blur to Still Images 16
BLUR
Background
BLUR
Our Approach
Adding Motion Blur to Still Images 17
BLUR
* Original image from pixabay.com (CC0)
Foreground Motion Blur
Background Motion Blur
Segmentation
Input Image
Compositing Fore- and Background
Adding Motion Blur to Still Images 18
BLUR
• Back to front compositing • Bk+1= psf*(Mk Ik) + (1-psf*Mk) Bk
Compositing Fore- and Background
Adding Motion Blur to Still Images 19
Handling Disocclusions
Adding Motion Blur to Still Images 20
For an object Ok, check if there is a Oj in front: • No Oj > Ok, no inpaint • There is Oj > Ok, inpaint
– Mirror content Ok into Oj
Handling Disocclusions
Adding Motion Blur to Still Images 21
Mirror Padding
Handling Disocclusions
Adding Motion Blur to Still Images 22
Motion Blur
Adding Motion Blur to Still Images 23
Comparison
Adding Motion Blur to Still Images 24
Photoshop Masked Motion Blur
Photoshop Masked Path Blur
Photoshop Inpaint, Composition Our Result
• Non Linear Motion Kernel
• Mirrored Blur
• HDR Motion Blur
Extensions
Adding Motion Blur to Still Images 25
Non Linear Motion Kernel
Adding Motion Blur to Still Images 26
Non Linear Motion:
Mirrored Motion Blur
Adding Motion Blur to Still Images 27
Adding Mirror Line
HDR Motion Blur
Adding Motion Blur to Still Images 28
Saturated values create light trails Motion Blur, dull light sources
Adding Motion Blur to Still Images 29
HDR Motion Blur Original Values: [t, 1] Our HDR Approach: [t, 2T] New value: t ∗ pow(1+(x−t)/(1−t),T)
HDR Motion Blur
Adding Motion Blur to Still Images 30
Results
Adding Motion Blur to Still Images
Adding Motion Blur to Still Images
Foreground Motion Blur
Adding Motion Blur to Still Images
Background Motion Blur
Adding Motion Blur to Still Images
Timelapse
Adding Motion Blur to Still Images
Multiple objects, different motions
Adding Motion Blur to Still Images
Changing scene impression
Conclusion
Adding Motion Blur to Still Images
• Simple and effective solution to add motion-blur to a single image
• Easy user interaction, transparent composition and artifact handling
• Convincing results in seconds
Future: • Multi directional motion blur
Conclusion & Future Work
Adding Motion Blur to Still Images 38
Adding Motion Blur to Still Images 39
• This work was partially funded by the Brazilian agency CNPq.
• Thanks to unsplash.com, pexels.com, maxpixel.freegreatpicture.com and pixabay.com for the copyright-free (CC0) images
Acknowledgments
Xuejiao Luo1,2, Nestor Salamon1, Elmar Eisemann1
Adding Motion Blur to Still Images
1Delft University of Technology 2Telecom ParisTech
[Nagahara et al.] H. Nagahara, S. Kuthirummal, C. Zhou, and S. K. Nayar. Flexible depth of field photography. In European Conference on Computer Vision, pp. 60–73. Springer, 2008 [Barron et al.] J. T. Barron, A. Adams, Y. Shih, and C. Hernandez. Fast bilateral-space stereo for synthetic defocus. In Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2015. [Telleen et al.] J. Telleen, A. Sullivan, J. Yee, O. Wang, P. Gunawardane, I. Collins, and J. Davis. Synthetic shutter speed imaging. Computer Graphics Forum, 26(3):591–598, 2007. [Rother et al.] C. Rother, V. Kolmogorov, and A. Blake. Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. (TOG), 23(3):309–314, 2004.
Bibliography
Adding Motion Blur to Still Images 41