![Page 1: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/1.jpg)
Perceptual Organization as a Foundation for
Intelligent Sketch Editing
Eric SaundJames Mahoney
David FleetDaniel LarnerEdward Lank
Palo Alto Research Center
![Page 2: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/2.jpg)
Goal: Intelligent Sketch Editing
![Page 3: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/3.jpg)
Central Problem: Selection
Goal: Simple, easy user actions to select desired image material (e.g. tap, click, crude gesture).
WYPIWYG: What You Perceive is What You Get
![Page 4: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/4.jpg)
Motivation
Prior Domain Knowledge
high
low "paint" editors
domain structureeditors
Choice: What degree of prior domain knowledge?
!
Perceptual Organization
•make available generic visual structure
•foundation for domain-specific recognition
![Page 5: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/5.jpg)
Gestalt Rules of Perceptual Organization
?
•ClosureWhich dot is on an object?
•Smooth ContinuationWhat are the objects?
•ProximityIdentify the text groups
•Symmetry
•Similarity
•Coherent Motion
Although algorithms are empirically moretop level, the level of
Me gustaria aprovecharsaludarlos y darles la
information de interes
and mechanismsaccessible, it is the
computational theoryesta oportunidad parabienvenida a ofrecer
en espanol, Nicaragua
![Page 6: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/6.jpg)
Perceptual Structure in Sketches
![Page 7: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/7.jpg)
The ScanScribe Document Image Editor
I. GUI substrate•convenient encircling gestures•implicit creation of image objects•management of grouping structure
![Page 8: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/8.jpg)
The ScanScribe Document Image Editor
I. GUI substrate•convenient encircling gestures•implicit creation of image objects•management of grouping structure
II. Automatic structure detection•grouping/P.O.
Image/StrokeData
Primitives Groups
prime
composite
![Page 9: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/9.jpg)
Image
PrimeObjects
image processingcontour tracing
thinningjunction detection
line followingcorner detection
shape classification
Extracting Primitives
![Page 10: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/10.jpg)
Perceptual Grouping
analyze localspatial relations
form links
assemble larger structures:
CompositeObjects
C C
C A
Closed_Path
Text_Run
TextLine Art
![Page 11: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/11.jpg)
Curvilinear Continuity
clear ambiguous
potential combinatorial explosion
![Page 12: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/12.jpg)
Curvilinear Closure
smooth-continuation
maximally-turning
![Page 13: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/13.jpg)
Text Layout
![Page 14: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/14.jpg)
Key Problem: Ambiguity
Local evidence is insufficient.
Research problem: effectiveuse of spatially extended context.
![Page 15: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/15.jpg)
Conclusion
Intelligent Sketch Editing
•Easy selection of visually-salient material
•Recognition at the level of Perceptual Organization
•Research-prototype: the ScanScribe image editor
![Page 16: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/16.jpg)
![Page 17: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/17.jpg)
P.O. Level Structuring
Image/StrokeData
Primitives Groups
![Page 18: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/18.jpg)
Line-art and Text
Prime objects can servemultiple roles.
![Page 19: Perceptual Organization as a Foundation for Intelligent Sketch Editing](https://reader036.vdocuments.us/reader036/viewer/2022062315/568150c4550346895dbee273/html5/thumbnails/19.jpg)
Goal: Intelligent Sketch Editing