claytronics, audio synthetic reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. ·...

15
RI IC '04 1 Seth Goldstein & Todd Mowry Carnegie Mellon University 8/30/04 Robotics IC www.cs.cmu.edu/~claytronics Joint work with Sitti, Hoburg, Lee, Aldrich, Seshan, Pfenning, Veloso, Sukthankar, Baker, Kirby, Rister, Reshko, Bowers Claytronics, Synthetic Reality, And Robotics RI IC '04 © 2001-4 Goldstein&Mowry 2 audio …01110010… Encoding mp3 video …01110010… Encoding mpeg RI IC '04 © 2001-4 Goldstein&Mowry 3 pario Latin: to bear, bring forth, produce; create, make, get …01110010… Encoding RI IC '04 © 2001-4 Goldstein&Mowry 4 Telepario San Francisco Pittsburgh Seattle

Upload: others

Post on 06-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 1

Seth Goldstein & Todd MowryCarnegie Mellon University

8/30/04Robotics IC

www.cs.cmu.edu/~claytronics

Joint work with Sitti, Hoburg, Lee, Aldrich, Seshan, Pfenning, Veloso, Sukthankar, Baker,

Kirby, Rister, Reshko, Bowers

Claytronics,Synthetic Reality,

And Robotics

RI IC '04 © 2001-4 Goldstein&Mowry 2

audio

…01110010…

Encoding

mp3

video…01110010…Encoding

mpeg

RI IC '04 © 2001-4 Goldstein&Mowry 3

pario

Latin: to bear, bring forth, produce;create, make, get

…01110010…Encoding

RI IC '04 © 2001-4 Goldstein&Mowry 4

Telepario

San Francisco

Pittsburgh

Seattle

Page 2: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 5

IndirectFires

pariomodeling

parioconferencing

pariopresence

RI IC '04 © 2001-4 Goldstein&Mowry 6

Science fiction?

RI IC '04 © 2001-4 Goldstein&Mowry 7

Science fiction?

Flynn/SRI

Flynn/SRIRabinett&BBC

IRobot

MEMS/Nanotech

Modular Robots

Veloso/CMU

Materials

Amorphous Computing/Emergent Behavior

Amorphous Computing/MIT

Multi-RobotTeams

Fearing/UCB

Yim/Parc

Sensor Nets

Sitt

i/CM

U

RI IC '04 © 2001-4 Goldstein&Mowry 8

Programmable matter

• An ensemble of material that contains sufficient– local computation– actuation– storage– energy– sensing & communication

• Which can be programmed to form interesting dynamic shapes and configurations.

Page 3: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 9

Claytronics• Bring matter under computer control

i.e., programmable matter• Path to the future

– 1 micron cubed catom– Creation of useful artifacts

• Create a enticing system that explores ALL the computer science issues of programmable matter

• Basis for Synthetic Reality/Future RobotsRI IC '04 © 2001-4 Goldstein&Mowry 10

Synthetic Reality - Capture

1. Capture 3D Object2. Encode 3D model3. Transmit data

RI IC '04 © 2001-4 Goldstein&Mowry 11

Synthetic Reality - Reproduce

3-5 years 5+ years

RI IC '04 © 2001-4 Goldstein&Mowry 12

A Claytronic Atom: Catom

Page 4: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 13

The outside is studded with contacts

A Claytronic Atom: Catom

RI IC '04 © 2001-4 Goldstein&Mowry 14

The outside is coated with organic LEDs• Low power• Conforms to shape

A Claytronic Atom: Catom

RI IC '04 © 2001-4 Goldstein&Mowry 15

Inside the Catom

RI IC '04 © 2001-4 Goldstein&Mowry 16

Inside the Catom

Page 5: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 17

Inside the Catom

RI IC '04 © 2001-4 Goldstein&Mowry 18

Inside the Catom

RI IC '04 © 2001-4 Goldstein&Mowry 19

Inside the Catom

Computer

SuperCap

AntennaCommunication

Programmable Magnets

We can buy these today!RI IC '04 © 2001-4 Goldstein&Mowry 20

Moving the Catom

Page 6: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 21

Moving the Catom

RI IC '04 © 2001-4 Goldstein&Mowry 22

Moving the Catom

RI IC '04 © 2001-4 Goldstein&Mowry 23

Moving the Catom

RI IC '04 © 2001-4 Goldstein&Mowry 24

Moving the Catom

Page 7: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 25

Moving the Catom

RI IC '04 © 2001-4 Goldstein&Mowry 26

Moving the Catom

RI IC '04 © 2001-4 Goldstein&Mowry 27

Moving the Catom

RI IC '04 © 2001-4 Goldstein&Mowry 28

Moving the Catom

Page 8: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 29

Claytronics Today• 2D system• Modular design

RI IC '04 © 2001-4 Goldstein&Mowry 30

Complete Catoms

SwitchingCoil

SteelSleeve

Display

900MhzRadio

PICController

Drivers

PowerInterface Power

Grid

AlNiCoMagnet

SwitchingCoil

SteelSleeve

Display

900MhzRadio

PICController

Drivers

PowerInterface Power

Grid

AlNiCoMagnet

RI IC '04 © 2001-4 Goldstein&Mowry 31

Magnets For Locomotion

RI IC '04 © 2001-4 Goldstein&Mowry 32

Next Generation 2D catom

Power

Controller

WirelessMagnetDrivers

Sensors

Display

ETA: November 15, 2004

Page 9: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 33

First Step, Find and localize

RI IC '04 © 2001-4 Goldstein&Mowry 34

Distributed Localization

RI IC '04 © 2001-4 Goldstein&Mowry 35

Handling Grain Boundaries

RI IC '04 © 2001-4 Goldstein&Mowry 36

Next Step, Create Network• Use simple local rules to form

hierarchy• 10 line program does this!• Local only decisions → Global effect

time

Page 10: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 37

Simulation of Future Catoms

RI IC '04 © 2001-4 Goldstein&Mowry 38

And Localization

RI IC '04 © 2001-4 Goldstein&Mowry 39

Multiple Networks

Unlike current systems, we can only createa single electrical contact between devices,so cooperation is needed to form circuits

An external source provides Vddand ground lines, and separate pathways are formed through the object to power each catom

We have developed an algorithm that keeps basic static shapes powered.

Future work includes leveraging the hierarchy and powering dynamic structures.

RI IC '04 © 2001-4 Goldstein&Mowry 40

Getting There From Here• Goal: Robust ensemble of millions

of catoms

• Claytronics Design Principles– No Moving Parts– Local Control– No Static Power

Page 11: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 41

HappyB’dayHappyB ‘ Day

HappyB’Day

Moore’s Law

RI IC '04 © 2001-4 Goldstein&Mowry 42

Where are we in 50 years?

1 nm3?? (1 µm3)1 cm3450 M3Volume

16KB4KB<800BStorage

2 attowatts20mW200KWPower

20 µg1 oz30 tonsWeight

2 picosec25ns>200µsCycle time

1 millicent1$5M-23M (2002 $)

Cost

2050Programmable matter

2003 greeting card

1949Eniac

Cogent arguments for both sooner and later exist

RI IC '04 © 2001-4 Goldstein&Mowry 43

Millicents/catom$/catom$$$/catomCost

Chemically directed self-assembly and fabrication

Micro/Nano-fabrication and micro-assembly

Conventional manufacturing and assembly

Manufacturing methods

HighHighLowResolution

10’s nW10’s mW<2 Wattspower

Molecular surface adhesion and covalent bonds

Programmable nanofiberadhesives

Nanofiberadhesives

Magnets

Adhesion mechanism

AerosolElectrostaticsProgrammable magnets

Electromagnets

Locomotive mechanism

<1 mg100’s mg10’s grWeight<10 microns>1 mm>1 cmDimensionsNanoMicroMacro

Millicents/catom$/catom$$$/catomCost

Chemically directed self-assembly and fabrication

Micro/Nano-fabrication and micro-assembly

Conventional manufacturing and assembly

Manufacturing methods

HighHighLowResolution

10’s nW10’s mW<2 Wattspower

Molecular surface adhesion and covalent bonds

Programmable nanofiberadhesives

Nanofiberadhesives

Magnets

Adhesion mechanism

AerosolElectrostaticsProgrammable magnets

Electromagnets

Locomotive mechanism

<1 mg100’s mg10’s grWeight<10 microns>1 mm>1 cmDimensionsNanoMicroMacro

Scaling of Claytronics

RI IC '04 © 2001-4 Goldstein&Mowry 44

3D Catom Proposal• Three die

– Compute die– Sense/actuate die– Power die

• Connect back-to-back use through die vias

Page 12: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 45

Power

Power

Antenna

Caps Caps

RI IC '04 © 2001-4 Goldstein&Mowry 46

Processing

Memory

CPU

RI IC '04 © 2001-4 Goldstein&Mowry 47

Sensors and Actuators

Radio Antenna

Radio

Up/Down Sensor

Light Sensor

Camera?Mic?

Pressure?

LED

RI IC '04 © 2001-4 Goldstein&Mowry 48

The Case/Motion

Capacitor formed across two catoms

V

Capacitor formed across two catoms

V

Page 13: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 49

What about the software?• Distributed Planning• Programming Models• Networking• …

RI IC '04 © 2001-4 Goldstein&Mowry 50

Networking: Naming & Routing

• Granularity: Individual, multicast, anycast• Identity: Geographic, based on shape (e.g.

arm catoms)• Our approach

– Driven by application needs – Support multiple naming schemes (at

higher cost) until application needs are clear

• Traditional ad hoc routing (DSR, AODV, etc.)

– Relies on flooding not scalable to Claytronic network sizes

• Geographic (GPSR)– Requires planar network interconnect

cannot support arbitrary 3d structures• Our approach

– Use programs to control 3d structure such that GPSR-like routing is possible

– Develop localization techniques

When greedy geographic routing fails, GPSR walks perimeter

3D No obvious perimeter!Need to prevent or limit voids

to x?

NamingHow will programs address catoms?

RoutingHow to identify path to destination catoms?

Multicast/Anycast*.hand.arm.body?(x=4..6, y=2..4, z=15..20)?

UnicastNode10.hand.arm.body?(x=4, y=2, z=15)?

RI IC '04 © 2001-4 Goldstein&Mowry 51

Programming Language/Software Engineering Research

Wood Sculpture

Snapshot Sequence

Physical Model

Gradient Descent

Networking,

Concurrency,

Resources,

Timing, etc…

PlanningModelsSpecification Runtime

3-D Moving Model

Force Propagation

Chiseling

RI IC '04 © 2001-4 Goldstein&Mowry 52

Claytronics & Pario• Open up an entire new application space

– Entertainment (interactive clay)– Training (live-fire exercises)– Design (100x protein model)– Interaction (telepario)– Rescue (paramedic on demand)– Metal Man (fault tolerant robotics)

• Vehicle for studying CS problem of the future:

How do you design, program, maintain,and use a billion component system?

Page 14: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 53

Claytronics & Pario• Open up an entire new application space• Vehicle for studying CS problem of the

future:How do you design, program, maintain,and use a billion component system?

• Vehicle for creating robot of the futureHow to design and program a collectionof micro/nanorobots to create a usefulmacroscale robot?

RI IC '04 © 2001-4 Goldstein&Mowry 54

Claytronics & Pario• Open up an entire new application space• Vehicle for studying CS problem of the

future.• Vehicle for creating robot of the future

How to design and program a collectionof micro/nanorobots to create a usefulmacroscale robot?

RI IC '04 © 2001-4 Goldstein&Mowry 55

Claytronics & Pario• Open up an entire new application space• Vehicle for studying CS problem of the

future.• Vehicle for creating robot of the future

How to design and program a collectionof micro/nanorobots to create a usefulmacroscale robot?

• Our Approach:– Make scaling work for us– Exploit scale invariance– Design for scalability in both number & size RI IC '04 © 2001-4 Goldstein&Mowry 56

Software Systems• Distributed Computing

– how to write a program for 1M+ machines? what is the programming model?

• Robot planning, distributed robotics– how to plan the coordinated movement,

communication and sensing?• Networking and sensor nets

– how to geolocate, communicate?• Emergent Behavior

– how to self-organize and operate in uncertain environments with unreliable components?

• Many others…

Page 15: Claytronics, audio Synthetic Reality,claytronics/talks/ic-ri-2004.pdf · 2004. 8. 30. · Claytronics & Pario • Open up an entire new application space • Vehicle for studying

RI IC '04 © 2001-4 Goldstein&Mowry 57

Hardware Systems• Microrobots, modular robots

– what is the design of the elements?• MEMS/nanotech materials

– how to achieve small scale economically?• Magnetics and other actuation

– how to do locomotion, actuation?• High voltage silicon processing

– how to achieve manufacturing economies of scale?

• Power systems– how to distribute power?

• …