Pixie Dust: Graphics Generated by Levitated and Animated Objects

in a Computational Acoustic-Potential Field Yoichi Ochiai, Takayuki Hoshi, Jun Rekimoto

The University of Tokyo, Nagoya Institute of Technology, Sony CSL

Pixie Dust Beyond the “Pixels”, like a “Magic”

Small “Pixies” are Animated and Levitated in the air.

Pixie Dust: Graphics Generated by Levitated and Animated Objects

in a Computational Acoustic-Potential Field

!Yoichi Ochiai

Media Artist PhD candidate at

The University of Tokyo Microsoft Research

Colloidal Display: BRDF Bubble Screen

Spinning Top Display

Pixie Dust: Graphical Levitation

Also you can see my work in this year’s SIGGRAPH Art Gallery.

Research InterestDynamic physicalization of Computer Graphics “What would happen?” “If the real world things had the characteristics like computer graphics model ”

As an independent Media Artist

SIGGRAPH 2014

SIGGRAPH 2011

SIGGRAPH 20142

SIGGRAPH2013,2012

Rendering Real Circuit

SIGGRAPH 2010

Introduction“Computational Field”

Pixie Dust: Graphics Generated by Levitated and Animated Objects

in a Computational Acoustic-Potential Field

Graphics in the Art.

Oil painting is rendered by Artist and Oil paint

Graphics on a LCD screen

Rendered by !LCD and Photons

Graphics in the digital fabrication

Rendered by !xyz plotter and ABS resin

Is it Graphics?

Rendered by small particles (Styrofoam) and!“Computational Acoustic Potential Field”

Animation (Screen)

Animation is rendered by the difference of display images

Animation (kinetic expression)

Animation is rendered by the robot motions (servo motors)

Animation is rendered by movement of!“Computational Acoustic Potential Field”

Is it the kind of Animation?

Contribution Summery: !Graphics generated by the Acoustic Potential Field

1. Provide theoretical description of 3D acoustic manipulation technology in detail and Evaluation. !

2. Expanding the 3D acoustic levitation technology to the graphics applications.!

3. Introduction of the concept: “Computational Potential Field” which is the environmental actuation between “atom” and “bit”.

We believe these are contribution!to “Graphics” communities.

Related Work“Levitation and Programable matter”

Pixie Dust: Graphics Generated by Levitated and Animated Objects

in a Computational Acoustic-Potential Field

Related Work:

Lev i t a t ion

In te rac t ion w i th l ev i t a ted Ob jec t s

De fo rmab le D i sp lay

3D D isp lay

Programab le Ma t te r

I nc lud ing Va r ious Areas

Levitation in Physics et al. 1981

Radical AtomsProgramable Matter

Computational Potential Field

Concept

Our Approach

Implementation Concept

Self Actuation Interface

Ishii et al. 2012Hawkes et al. 2010 Poupyrev et al. 2007

Self Actuated

Environmental Actuation

Physical quantity Material parameters Mechanism Spatial resolution

Sound Density and volume Phased arrays Wave length

Airflow [Iwaki et al., 2011] Density and area Air jets Spread of air jets

Magnetism [Lee et al., 2011] Weight and magnetism Electromagnet and XY stage Size of magnet

Whymark 1975 Foresti et al 2013Ochiai et al 2013 Our ApproachKono et al 2013

1D 2D 3D 3D APF

Object

StandingWaves

RefrectorPlate

RefrectorPlate

Transducer Array

Focus

Transducer

Levitation

Method

Acoustic

Levitation

Cont r i bu t ion

Water layered Display Plasma Based 3D spatial display

Spatial 3D Display Technology

Barnum et al. 2010 Kimura et al. 2006HolodustPerlin et al.

Theory and Implementation“APF generated by Phased Arrays”

Pixie Dust: Graphics Generated by Levitated and Animated Objects

in a Computational Acoustic-Potential Field

19

Acoustic Potential Energy Distribution in standing waves

https://www.youtube.com/watch?v=669AcEBpdsY

Simple Acoustic Levitation (Whymark et al 1975)

Kinetic Energy Densities Potential Energy Densities

Potential Energy U from Gorkov (1962) and Niborg (1967)

Densities of MediumDensities of Small Sphere

Compression ratios of the small sphere and the medium,

20

Acoustic Potential Energy Distribution in standing waves(Novelty)

Densities of MediumDensities of Small Sphere

Compression ratios of the small sphere and the medium,

the root mean square (RMS) amplitude,,

the normalized cross-sectional distribution of the ultrasonic beam

Our Approach: Employ Phased Array as Transducers

Related Work

21

Potential Distribution in standing waves (1:beam)

23

Animation is described by the movement of focal points

Focal Points

Movement

Ultrasonic waves

Ultrasonic waves

Potential Distribution in standing waves (2:plane sheet beam)

Sheet beam

Implementation: Acoustic Potential Field Generator (Opposed Phased Arrays/ 40kHz and 25kHz)

Evaluation: Speed, Allowable Weight, and Workspace

0.6mm particles

manipulated up to 72cm/s

2.0mm particlesmanipulated up to 48cm/s

Evaluation: Speed, Allowable Weight, and Workspace

Work space is 600mm x 600mm x 600mm

For the stable manipulation,

work space is should be within 150mm x 150mm x 150mm

29

Evaluation: Speed, Allowable Weight, and Workspace

tested with nut.

up to 1g.

and 7.8g/cm^3

Appication and Discussions“APF generated by Phased Arrays”

Pixie Dust: Graphics Generated by Levitated and Animated Objects

in a Computational Acoustic-Potential Field

Application Space

Use as Projection Screen.

Interaction with object in the environmental actuation ways.

Spatial Display or Vector Graphics Display

Application Space

34

Floating Screen (also it is possible to be manipulated in 3D)

nopotential field With potential field

You can see our demo

in E-tech

Raster Graphics

Shooting off the particle using 5th phased array or air blow

36

Floating Manipulation Interactions (at Laval Virtual in April)

Leapmotion

Particles

Discussion & Limitation

Particle size is essential Limitation (limited by the wavelength)

CAPF, itself is manipulated and generated precisely, however accuracy of object

manipulation is still low quality. (We have to improve our circuit design)

Accuracy of accuracy is still low level. (We have to improve our circuit design)

Combine with digital fabrication is very interesting (adjust the balance).

Setup Variations

Conclusion and Future Work“Computational field”between atom and bits

Pixie Dust: Graphics Generated by Levitated and Animated Objects

in a Computational Acoustic-Potential Field

Conclusion

We proposed the concept “Computational Potential Field”

We implemented as the expansion of Acoustic Levitation Technology.

We evaluated the workspace, manipulation speed and stability.

We explored application space with this technology

Future Work

Wave synthesis Volumetric

Multi-layers

Future Work: Production Process

Production Process

FAQ

1. What is the limitation? - it is on the size of objects.

2. What is the maximum weight. - now it is up to 1g.

3. Can you hold string or liquid? - Yes.

4. What is your next step with CPF - now we work on magnetic field

5. Multiple Layers or Volumetric Display - it is theoretically possible.

6. What is the resolution? - 4.25 mm intervals (1/2 of wave length)

7. Why particle fall down? - Heats affects the balance of APF

8. Can I fly? - No.

Yoichi Ochiai

Takayuki Hoshi

Jun Rekimoto

People worked with Pixie Dust

Pixie Dust: Graphics Generated by Levitated and Animated Objects in a Computational Acoustic-Potential Field

010110101010101010101101010101101010101010101011010101011010101010101010110101010110101010101010101101010101101010101010101011010101011010101010101010110101010110101010101010101101010101101010101010101011010101011010101010101010110101010110101010101010101101010101101010101010101011010101011010101010101010110101

Pixie Dust: Graphics Generated by Levitated and Animated Objects in a Computational Acoustic-Potential Field

We are at start lines of long winding road. What would you expect in the future.

Pixie Dust: Graphics Generated by Levitated and Animated Objects

in a Computational Acoustic-Potential Field Yoichi Ochiai, Takayuki Hoshi, Jun Rekimoto

The University of Tokyo, Nagoya Institute of Technology, Sony CSL

SIGGRAPH 2013

3

Non-digital materials

Atoms Bits

Non-digital materials in “Computational Field”

Digital materials

Reflection

Transformation

3D position

Soap Bubbles

Tiny Object

Material Sheet

Image

Path

Texture

Programable Things

E U R O H A P T I C S 2 0 1 4

Haptic Transformation bySqueeze films

51

Non-digital materials

Atoms Bits

Non-digital materials in “Computational Field”

Digital materials

Reflection

Transformation

3D position

Soap Bubbles

Tiny Object

Material Sheet

Image

Path

Texture

Programable Things