Perceiving and Representing Structured Information

using Objects

Organization

Image based theories Structural 3D theories Object perception: Object displays

Image Based vs Structure Theories

Template theories based on 2D image processing

In structural theories we extract the structure of a scene in terms of 3D primitives

Template theories

A template with simple morphing operations

Objects as patterns of (2D) patterns

Scenes (gist in 100 msec)

Torralba and Oliva Patterns of patterns

Properties of Image Recognition

Remarkable image recognition memory Up to 5 images for second in object

identification Applications in image searching interfaces RSVP Rapid serial visual presentation

Perception of object structure

Geon Theory (Irving Biederman)

3D Primitives “Geons”Structural skeleton

Shape from shading is also primitive

How Does the Brain Find Geons?

a

Contourgenerator

Canonical Views

To make things clear both component parts and the critical joints must be clear

Processing stages for recognition

The Geon Diagram (Irani)

3D shape primitives for architecture - entities and relationships

Surface texture and color for attributes

Pattern finding& Recognition

13% errors: 4.3 secsub-structure

26% errors 7.1 secsub-structure

42% memoryerrors

22% memoryerrors

Semantics

On top of - relies on Underneath – support, foundation Inside – containment (private code) Attachment points (external interfaces; part_of

relationships) more than topology mid Upper Lower

Natural semanticsInstances Dependency

Strength of Relationship Multiplicity

The object file: Triesman and Kaheman

2 ½ D design

Use 3D objects to represent entities Layout to make structure clear in 2D.

-Connections, basic shapes Use canonical views

The Object Display (Wickens)

Use complex objects to fuse variables Map entities to object parts Map structure to object structure Can be pictorial (simplified) – an engine +

fuel tank Map attributes to object attributes

- color, size, motion etc.

Object Display

100 L

45 L

Solids: 23%

45 deg 0.2/1.0

Vol : 45 LTemp: 45 degFlow: 20%Solids: 23%

Approx 1/3 errors with anesthesiologists Dr George Blike

A medical ventilator

Such displays Must be custom

The concrete/abstraction tradeoff Object displays may lead to lower errors Lend themselves to overly literal interpretation.

They are not general purpose. Object displays must be custom designed

More abstract representations leave more room for interpretation (better support the creative process)

Chart Junk (ducks) Tufteor Effective Communication

1990 2000 2010 1990 2000 2010

A Duck? (Tufte)

Holding attention-Object scene conflict

Used in advertising

Emotional and motivational effects

There is a great future in 3D object icons and object structures

It is happening anyway, but nice to know that it is not always “chart junk”.

Conclusion

Conclusions

Visual space is non-homogenous The plane orthogonal to the line of sight

and the forward direction are very different.

A 21/2D design attitude recognizes the cost of actions.