adding motion blur to still images - tu delft · 2019. 5. 29. · motion blur adding motion blur to...

Xuejiao Luo1,2, Nestor Salamon1, Elmar Eisemann1

Adding Motion Blur to Still Images

1Delft University of Technology 2Telecom ParisTech

Introduction

Adding Motion Blur to Still Images

Motion Blur

Adding Motion Blur to Still Images 3

blasing by, by mitchell haindfield (CC BY 2.0) DSC04627, by Lewin Bormann (CC BY-SA 2.0)

Motion Blur

Adding Motion Blur to Still Images 4

Cambridge Circus, by Stig Nygaard (CC BY 2.0)

mountainbike downhill contest motion, by Markus Spiske (CC0)

Motion Blur

Adding Motion Blur to Still Images 5

• Shutter Speed

• Object Motion

• Camera Motion

• Illumination, lens, filter..

• Long Exposure, slow motion

Le Mans 2013, by Surreal Name Given (CC BY 2.0)

• Depth of field – Stereo defocus [Barron et al.] – Light Field1, special sensors [Nagahara et al.]

• Image sequence – Virtual Exposure [Telleen et al.] – Reelsmart2

• Photoshop, GIMP

Related Work

Adding Motion Blur to Still Images 6

1) https://www.lytro.com/ 2) http://revisionfx.com/products/rsmb/

Adding Motion Blur to Still Images 7

BLUR

Our Approach

Adding Motion Blur to Still Images

Our Approach

Adding Motion Blur to Still Images 9

BLUR

* Original image from pixabay.com (CC0)

Foreground Motion Blur

Background Motion Blur

Segmentation

Input Image

Our Approach

Adding Motion Blur to Still Images 10

BLUR

* Original image from pixabay.com (CC0)

Foreground Motion Blur

Background Motion Blur

Segmentation

Input Image

GrabCut Segmentation [Rother et al.]

Segmentation

Adding Motion Blur to Still Images 11

Segmentation

Adding Motion Blur to Still Images 12

GrabCut Segmentation [Rother et al.]

Our Approach

Adding Motion Blur to Still Images 13

BLUR

* Original image from pixabay.com (CC0)

Foreground Motion Blur

Background Motion Blur

Segmentation

Input Image

Adding Motion Blur to Still Images 14

Blur Kernel

A

B

|AB| = 3

α = -45⁰

0.030 0.050 0 0 00.050 0.177 0.051 0 0

0 0.051 0.177 0.051 00 0 0.051 0.177 0.0500 0 0 0.050 0.030

Given motion length and angle: 1) Create a matrix length+2 2) Set to 1 the pixels belonging the motion vector 3) For each position, calculate one minus the distance to the motion vector 4) Normalize

Motion Vector Motion Blur Kernel

Naive Convolution, foreground

Adding Motion Blur to Still Images 15

Foreground

BLUR

Naive Convolution, background

Adding Motion Blur to Still Images 16

BLUR

Background

BLUR

Our Approach

Adding Motion Blur to Still Images 17

BLUR

* Original image from pixabay.com (CC0)

Foreground Motion Blur

Background Motion Blur

Segmentation

Input Image

Compositing Fore- and Background

Adding Motion Blur to Still Images 18

BLUR

• Back to front compositing • Bk+1= psf*(Mk Ik) + (1-psf*Mk) Bk

Compositing Fore- and Background

Adding Motion Blur to Still Images 19

Handling Disocclusions

Adding Motion Blur to Still Images 20

For an object Ok, check if there is a Oj in front: • No Oj > Ok, no inpaint • There is Oj > Ok, inpaint

– Mirror content Ok into Oj

Handling Disocclusions

Adding Motion Blur to Still Images 21

Mirror Padding

Handling Disocclusions

Adding Motion Blur to Still Images 22

Motion Blur

Adding Motion Blur to Still Images 23

Comparison

Adding Motion Blur to Still Images 24

Photoshop Masked Motion Blur

Photoshop Masked Path Blur

Photoshop Inpaint, Composition Our Result

• Non Linear Motion Kernel

• Mirrored Blur

• HDR Motion Blur

Extensions

Adding Motion Blur to Still Images 25

Non Linear Motion Kernel

Adding Motion Blur to Still Images 26

Non Linear Motion:

Mirrored Motion Blur

Adding Motion Blur to Still Images 27

Adding Mirror Line

HDR Motion Blur

Adding Motion Blur to Still Images 28

Saturated values create light trails Motion Blur, dull light sources

Adding Motion Blur to Still Images 29

HDR Motion Blur Original Values: [t, 1] Our HDR Approach: [t, 2T] New value: t ∗ pow(1+(x−t)/(1−t),T)

HDR Motion Blur

Adding Motion Blur to Still Images 30

Results

Adding Motion Blur to Still Images

Adding Motion Blur to Still Images

Foreground Motion Blur

Adding Motion Blur to Still Images

Background Motion Blur

Adding Motion Blur to Still Images

Timelapse

Adding Motion Blur to Still Images

Multiple objects, different motions

Adding Motion Blur to Still Images

Changing scene impression

Conclusion

Adding Motion Blur to Still Images

• Simple and effective solution to add motion-blur to a single image

• Easy user interaction, transparent composition and artifact handling

• Convincing results in seconds

Future: • Multi directional motion blur

Conclusion & Future Work

Adding Motion Blur to Still Images 38

Adding Motion Blur to Still Images 39

• This work was partially funded by the Brazilian agency CNPq.

• Thanks to unsplash.com, pexels.com, maxpixel.freegreatpicture.com and pixabay.com for the copyright-free (CC0) images

Acknowledgments

Xuejiao Luo1,2, Nestor Salamon1, Elmar Eisemann1

Adding Motion Blur to Still Images

1Delft University of Technology 2Telecom ParisTech

[Nagahara et al.] H. Nagahara, S. Kuthirummal, C. Zhou, and S. K. Nayar. Flexible depth of field photography. In European Conference on Computer Vision, pp. 60–73. Springer, 2008 [Barron et al.] J. T. Barron, A. Adams, Y. Shih, and C. Hernandez. Fast bilateral-space stereo for synthetic defocus. In Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2015. [Telleen et al.] J. Telleen, A. Sullivan, J. Yee, O. Wang, P. Gunawardane, I. Collins, and J. Davis. Synthetic shutter speed imaging. Computer Graphics Forum, 26(3):591–598, 2007. [Rother et al.] C. Rother, V. Kolmogorov, and A. Blake. Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. (TOG), 23(3):309–314, 2004.

Bibliography

Adding Motion Blur to Still Images 41