image quilting for texture synthesis and transfer alexei a. efros1,2 william t. freeman2

Image Quilting for Image Quilting for Texture Synthesis and Texture Synthesis and

TransferTransfer

Alexei A. Efros1,2 William T. Freeman2

OutlineOutline

IntroductionIntroduction QuiltingQuilting Texture TransferTexture Transfer

IntroductionIntroduction

Image quiltingImage quilting

Motivation Motivation ：： one pixel at a time synthesis is mostone pixel at a time synthesis is most complexcomplex

QuiltingQuilting Bi Bi ：： a square blocksa square blocks SB SB ：： all such overlapping blocks in the input texture all such overlapping blocks in the input texture First stepFirst step simply tile it with blocks taken randomly from simply tile it with blocks taken randomly from SBSB

Second stepSecond step• introduce some overlap in the placement of blocks introduce some overlap in the placement of blocks

onto the new imageonto the new image• search search SB SB for such a block that by some measure for such a block that by some measure

agrees with its neighbors along the region of agrees with its neighbors along the region of overlap.overlap.

Finally stepFinally step• blocks have ragged edges which will allow them to blocks have ragged edges which will allow them to

better approximate the features in the texture.better approximate the features in the texture.• find a minimum cost path through that error surface find a minimum cost path through that error surface

and declare that to be the boundary of the new and declare that to be the boundary of the new blockblock.

Minimum Error Boundary CutMinimum Error Boundary Cut• error surface is defined as error surface is defined as e e ==• compute the cumulative minimum error compute the cumulative minimum error E E for all for all

pathspaths

• trace back and find the path of the best cuttrace back and find the path of the best cut• both a vertical and a horizontal overlap, the minimal both a vertical and a horizontal overlap, the minimal

paths meet in the middle and the overall minimum paths meet in the middle and the overall minimum is chosen for the cut.is chosen for the cut.

AlgorithmAlgorithm

Synthesis ResultsSynthesis Results

Texture TransferTexture Transfer correspondence map is a spatial map of correspondence map is a spatial map of

corresponding quantity over both the texture source corresponding quantity over both the texture source image and a controlling target image.image and a controlling target image.

quantity could include imagequantity could include image

intensity, blurred image intensityintensity, blurred image intensity

, local image orientation angles, local image orientation angles

ENDEND

THANKS EVERYONETHANKS EVERYONE