ubiquitous computing – - the distributed systems group … ·  · 2003-12-30part of the european...

Sophia Antipolis Nov. 2001

Friedemann MatternETH Zurich

EEEETTTTHHHH EidgenössischeTechnische HochschuleZürich

Ubiquitous Computing –From Smart Devices to

Smart Everyday Objects

© F. Ma. 3

From Smart Devices...

Electronic devices such as mobile phones, cameras, or CD players have become "smart" in recent years

They offer new functionsto the user that have been impossible previously

image source: IBM

© F. Ma. 4

Coffee gets cold!

Water!

Message for Paddy!

Hug me!

Breakingnews!

Batteries low!

Lending period

expired!

Time for lunch!

...to Smart Everyday Objects?

© F. Ma. 5

Outline

Visions and Trends of Ubiquitous Computing

Everything Smart

Implications

Friedemann Mattern, ETH Zurich

© F. Ma. 6

Computing: A Clear Trend

One computer(PC) foreveryone

Manycomputersfor everyone

One computer(mainframe)for many people

Size Number

© F. Ma. 7

The Trend… What‘s Next?

Manycomputersfor everyone Size

Number

smartdust?

© F. Ma. 8image source: “Die Zeit”

Ubiquitous Computing

Tomorrow everyday objects will become smart

embedded processors

...and they will all be interconnected

wireless communication

Today, the Internet connects all computers

© F. Ma. 9

Processing speed and storage capacity double every 18 months

„cheaper, smaller, faster“

Exponential increasewill probably go on for the next 15 years at same rate

First Trend: Moore‘s Law

© F. Ma. 10

Bit Storage Density

© F. Ma. 11

Generalized Moore‘s Law

Most important technology parametersdouble every 1 – 3 years:

computation cyclesmemory, magnetic disksbandwidth

Problems:• increasing cost• energy

Consequence: scaling down

© F. Ma. 12

Whole eras named after materialse.g., „Stone Age“

More recently: semiconductors, fibersinformation and communication technology

Organic semiconductorschange the external appearance

of computers„Plastic“ laser

opto electronics, flexible displays,…...

2nd Trend: New Materials

first transistor, 1947

© F. Ma. 13

Electronic inkmicro capsules, white on one side and black on the otheroriented by electrical fieldsubstrate could be an array of plastic transistors

Potentially high contrast, low energy, flexible

Interactive: writable with magnetic pen

Example:Smart Paper, Electronic Ink

© F. Ma. 14

Smart Paper, Electronic Ink

An electronically charged pencil rotates the “pixels”

Detailed view of the micro capsules

© F. Ma. 15

Another Example:Soft Fabric User Interfaces

e.g., textiles that change conductivity when stretched

© F. Ma. 16

3rd Trend: Progress in Communication Technologies

Bandwidth of single fibers ~ 10 Gbit/s2002: ~ 10 Tbit/s with wavelength multiplex

Powerline techniquecoffee maker „auto-matically“ connected to the Internet

Wirelessmobile phone: GSM, UMTS wireless LAN (> 10 Mbit/s)

Room networks , body area networks

A bluetoothmodule

Nostalgia

© F. Ma. 17

Ubiquitous Information with Tomorrow‘s Wearables?

Headsets of mobile phones as jewellery?

© F. Ma. 18

Ubiquitous Information –a Vision from 1895

© F. Ma. 19

4th Trend: New Sensors

Miniaturized cameras, microphones,...

Fingerprint sensor

Radio sensorswithout power supply

Location sensorse.g., GPS

...POSITION N 047°

23’17’’E 008°

34’26’’

© F. Ma. 20

All This Together Will Enable„Cooperating Smart Things“

Embedded processorsin everyday objectssmallcheaplightweight

Wireless communicationspontaneous networks

Sensors

Real world objects are enriched with information processing capabilities

© F. Ma. 21

All This Together Will Enable„Cooperating Smart Things“

Embedded processorsin everyday objectssmallcheaplightweight

Wireless communicationspontaneous networks

Sensors

Real world objects are enriched with information processing capabilities

© F. Ma. 22

Smart Objects

Can remember pertinent eventsthey have a memory

Show context-sensitive behaviorthey may have sensors

location / situation awareness

I‘msmart!

Are responsivecommunicate with their environmentnetworked with other smart objects

hello!

© F. Ma. 23

Outline

Visions and Trends of Ubiquitous Computing

Everything Smart

Implications

Friedemann Mattern, ETH Zurich

© F. Ma. 24

Smart-Its projectVision: enable everyday objects as smart interconnected information artifacts

by attaching „Smart-Its“ to them

Next generation of smart labelsprocessor & memory wireless communicationvarious sensors to perceive the environmentcheap, small, compact, autonomous

Part of the European „Disappearing Computer“ Initiative

Making Things Smart with Attached Components www.smart-its.org

© F. Ma. 25

Smart-Its Prototype

Smart-Its module with Bluetooth-based communication

Prototype from ETH Zurich

Bluetooth

Atmelprocessor

Atmel microcontroller, 4 MIPS, 128 kB flash

Connection to sensors

© F. Ma. 26

Interacting with Disappearing Computers?

Hold two artifacts (with attached Smart-Its) together –and shake!

image: TecO

© F. Ma. 27

The shaking motion establishes a shared context (i.e., acceleration pattern) that no other devices will have

Shaking Two Objects Together Establishes a ”Friendship”

image: TecO

After the shared context has been established, the two devices can open a direct communication link

© F. Ma. 28

A Possible Application:Child Watch

If the two objects are too far apart (e.g., radio communication breaks down), the user is notified with an audible ”beep”

Beep! Beep!

image: TecO

© F. Ma. 29

Making Things Smart with Virtual Counterparts

Virtual world(Internet,Cyberspace)

Real world

virtual counterparts

pure virt. object(e.g. email)

© F. Ma. 30

Virtual Counterparts asArtifact Memories

1) Aug. 3rd, 2001: ….2) Aug. 5th, 2001 10:34 …..3) Aug. 5th, 2001 10:37 ...4) ...

Virtual counterpartsact as memories for their real artifacts

Updates triggered by events

Arrived in room 564 Bayview Hotel

10:34, Sue K.opens bag

Sensors generate eventswho? where?when?

Queries from the real world return memory content

© F. Ma. 31

Outline

Visions and Trends of Ubiquitous Computing

Everything Smart

Implications

Friedemann Mattern, ETH Zurich

© F. Ma. 32

Responsive Objects

An objects tellssomething about itself

e.g., by displaying a dynamically generated homepage

Contentdepends on cirmumstances such as context and privileges

Cf. Cooltown project (HP)

© F. Ma. 33

The Power of Directories

WWW server

Internet

Direc-tory

Label

Location

Context

DirectoryDirectory

Who operates directories?Who controls information and interpretation?Economic / legal / political issue?

Cf. Cooltown project (HP)

© F. Ma. 35

How to Bridge the Gap Between the Real and the Virtual World?

?

© F. Ma. 36

RFIDs („Smart Labels“)

Identify objects from distancesmall IC with RF-transponder

Wireless energy supply ~ 1 m magnetic field (induction)

ROM or EEPROM (writeable) ~ 100 Byte

Cost ~ € 0.1 ... € 1consumable and disposable

Flexible tagslaminated with paper

Chip (without antenna): ~ 2 mm x 2 mm x 10 µm (fits into 80 µm thick paper!)

© F. Ma. 37

Advanced RFID Chips

image source: Hitachi

© F. Ma. 38

A Context Sensitive Cookbook

Groceries are wrapped and equipped with RFID tags

© F. Ma. 39

A Context Sensitive Cookbook

Place grocery items on the kitchen counter

Nearby display shows dishes that can be prepared with available ingredients

© F. Ma. 40

Imagine an „Internet of Things“

„Silent commerce“ (Intershop)the ability of machines to conduct business transactions directly with other machines

„Imagine that...your products, your inventory or any of your physical assets could sense the characteristics of their environment, know their location and tell you about ityour products were self monitoring and could tell you when they were about to go outside of acceptable boundaries for temperatureyou could identify and track every product as it moves along your value chain, from the factory all the way to the consumer...“ (Accenture)

objects

objects

© F. Ma. 41

Economic Impact of Ubicomp?(„Couple E-business with Star Trek Technology“)

Products that are fully integrated in information systemse.g., supply chain optimization

New digitally enhanced productse.g., networked weather-sensitive umbrellas, cooperating toys,...

New services („e-utilities“)e.g., management of smart devices at home, management of personal privacy,...

Detailed and timely knowledge of product location and life cycles, individual and dynamic prices for goods,...

e.g., milk bottle reduces its price with its age,higher taxes if product is transported by plane,...

© F. Ma. 42

The M-Lab

„Mobility and Ubiquitous Computing Lab“

founded in July 2001

A common institution of ETH Zurich (polytechnical) and University of St. Gallen (business school) in Switzerland

collaboration with MIT Auto-ID Center (electronic product code,...)

Projects, industrial cooperations, and consultingbuild up a critical mass of highly qualified Ubicomp researchersidentifying and designing effective business applications based on Ubicomp technologies in life sciences, automotive, retail and logisticsfrom ideas to prototypes

www.m-lab.ch

© F. Ma. 43

M-Lab Industrial Partners & Some Example Projects

Currently 7 partners, open to others, 200k CHF / year eachEx.: Automotive

how can spare parts of a car automatically determine the car‘s configuration?deliver spare parts that match the current configuration

Ex.: Pharmaceuticalswhat are the benefits from putting RFIDs on blisters?

www.m-lab.ch

© F. Ma. 44

historically: industrialization, electricity, trains and automo-biles, electronic mass media

implies therefore eventually also ethical questions

social adaptation to technical impacts needs some time since this is an evolutionary process(willingness to learn, generational aspects,…)

General Impact of Ubicomp: Evolution vs. Revolution

Performance

Time

„revolutio-nary“ new applicationdomains

Technology and science have a major impact on our society and the world we live

Impact

© F. Ma. 45

Privacy in a Ubicomp World?

Privacy is already a concern with the WWWwhat do they do with my personal data?are my page visits and mouse clicks analyzed?

Much more dramatic in a ubicomp world!many events of very elementary actions are registeredcould be assembled to perfect profiles

Bought on 20 Aug 2001; last travel: to London Sep 2003; contained shirt no. 1342 and 1349; was in Hotel Atlantic, room 317 on 17 Nov 2002 ...

- information fusion- data mining- search engines

How do we address these privacy issues?technical solutions, laws, social processes,…?more questions than answers!

© F. Ma. 46

Conclusions

Ubiquitous computing technologies will have a major impact on our society and the world we live

Challengestechnical infrastructuresecurity, trust, dependability

Economic, social, cultural consequences?

whole new industry to build and manage an intelligent infrastructure?

The Internet only connected computers, now we begin to network all things

image: EUDisappearingComputerInitiative

© F. Ma. 47

ETH Zürich & IBM Research www.pervasive2002.org

System architectures and platforms for pervasive computing Middleware and pervasive computing infrastructures Mobile, wireless, and wearable technologies Innovative small computing and intelligent devices Emerging applications and mobile business issues Scenarios for information appliances Service discovery protocols Content distribution and delivery User interfaces for invisible and embedded computing Context awareness Security and privacy issues

Paper submissions due February 22, 2002

© F. Ma. 48

General ChairMahmoud Naghshineh, IBM Res.

Program ChairFriedemann Mattern, ETH Zurich

Program CommitteeEmile Aarts, Philips ResearchArndt Bode, TU MunichGaetano Borriello, Univ. of Washington and Intel Seattle Research LabDave DeRoure, University of SouthamptonOliver Haase, Bell Labs ResearchStefan Hild, IBM ResearchDirk Husemann, IBM ResearchPertti Huuskonen, NokiaAlan Jones, AT&T Laboratories Cambridge

Kazuhiko Kato, University of Tsukuba Tim Kindberg, HP LaboratoriesKazushi Kuse, IBM ResearchGerald Maguire, KTH StockholmJoachim Posegga, SAP Corporate ResearchApratim Purakayastha, IBM ResearchJun Rekimoto, SonyKurt Rothermel, University of StuttgartLarry Rudolph, MITBernt Schiele, ETH ZurichBill Schilit, Xerox Palo Alto Research CenterRoy Want, Intel Research

www.pervasive2002.org

© F. Ma. 49

Contact

Friedemann Mattern ETH Zürich

www.inf.ethz.ch/vsmattern@inf.ethz.ch