ubiquitous computing – - the distributed systems group … ·  · 2003-12-30part of the european...

47
Sophia Antipolis Nov. 2001 Friedemann Mattern ETH Zurich E E ET T T H H H Eidgenössische Technische Hochschule Zürich Ubiquitous Computing – From Smart Devices to Smart Everyday Objects

Upload: doantu

Post on 11-Apr-2018

218 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

Sophia Antipolis Nov. 2001

Friedemann MatternETH Zurich

EEEETTTTHHHH EidgenössischeTechnische HochschuleZürich

Ubiquitous Computing –From Smart Devices to

Smart Everyday Objects

Page 2: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 3

From Smart Devices...

Electronic devices such as mobile phones, cameras, or CD players have become "smart" in recent years

They offer new functionsto the user that have been impossible previously

image source: IBM

Page 3: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 4

Coffee gets cold!

Water!

Message for Paddy!

Hug me!

Breakingnews!

Batteries low!

Lending period

expired!

Time for lunch!

...to Smart Everyday Objects?

Page 4: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 5

Outline

Visions and Trends of Ubiquitous Computing

Everything Smart

Implications

Friedemann Mattern, ETH Zurich

Page 5: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 6

Computing: A Clear Trend

One computer(PC) foreveryone

Manycomputersfor everyone

One computer(mainframe)for many people

Size Number

Page 6: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 7

The Trend… What‘s Next?

Manycomputersfor everyone Size

Number

smartdust?

Page 7: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 8image source: “Die Zeit”

Ubiquitous Computing

Tomorrow everyday objects will become smart

embedded processors

...and they will all be interconnected

wireless communication

Today, the Internet connects all computers

Page 8: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 9

Processing speed and storage capacity double every 18 months

„cheaper, smaller, faster“

Exponential increasewill probably go on for the next 15 years at same rate

First Trend: Moore‘s Law

Page 9: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 10

Bit Storage Density

Page 10: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 11

Generalized Moore‘s Law

Most important technology parametersdouble every 1 – 3 years:

computation cyclesmemory, magnetic disksbandwidth

Problems:• increasing cost• energy

Consequence: scaling down

Page 11: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 12

Whole eras named after materialse.g., „Stone Age“

More recently: semiconductors, fibersinformation and communication technology

Organic semiconductorschange the external appearance

of computers„Plastic“ laser

opto electronics, flexible displays,…...

2nd Trend: New Materials

first transistor, 1947

Page 12: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 13

Electronic inkmicro capsules, white on one side and black on the otheroriented by electrical fieldsubstrate could be an array of plastic transistors

Potentially high contrast, low energy, flexible

Interactive: writable with magnetic pen

Example:Smart Paper, Electronic Ink

Page 13: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 14

Smart Paper, Electronic Ink

An electronically charged pencil rotates the “pixels”

Detailed view of the micro capsules

Page 14: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 15

Another Example:Soft Fabric User Interfaces

e.g., textiles that change conductivity when stretched

Page 15: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 16

3rd Trend: Progress in Communication Technologies

Bandwidth of single fibers ~ 10 Gbit/s2002: ~ 10 Tbit/s with wavelength multiplex

Powerline techniquecoffee maker „auto-matically“ connected to the Internet

Wirelessmobile phone: GSM, UMTS wireless LAN (> 10 Mbit/s)

Room networks , body area networks

A bluetoothmodule

Nostalgia

Page 16: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 17

Ubiquitous Information with Tomorrow‘s Wearables?

Headsets of mobile phones as jewellery?

Page 17: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 18

Ubiquitous Information –a Vision from 1895

Page 18: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 19

4th Trend: New Sensors

Miniaturized cameras, microphones,...

Fingerprint sensor

Radio sensorswithout power supply

Location sensorse.g., GPS

...POSITION N 047°

23’17’’E 008°

34’26’’

Page 19: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 20

All This Together Will Enable„Cooperating Smart Things“

Embedded processorsin everyday objectssmallcheaplightweight

Wireless communicationspontaneous networks

Sensors

Real world objects are enriched with information processing capabilities

Page 20: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 21

All This Together Will Enable„Cooperating Smart Things“

Embedded processorsin everyday objectssmallcheaplightweight

Wireless communicationspontaneous networks

Sensors

Real world objects are enriched with information processing capabilities

Page 21: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 22

Smart Objects

Can remember pertinent eventsthey have a memory

Show context-sensitive behaviorthey may have sensors

location / situation awareness

I‘msmart!

Are responsivecommunicate with their environmentnetworked with other smart objects

hello!

Page 22: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 23

Outline

Visions and Trends of Ubiquitous Computing

Everything Smart

Implications

Friedemann Mattern, ETH Zurich

Page 23: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 24

Smart-Its projectVision: enable everyday objects as smart interconnected information artifacts

by attaching „Smart-Its“ to them

Next generation of smart labelsprocessor & memory wireless communicationvarious sensors to perceive the environmentcheap, small, compact, autonomous

Part of the European „Disappearing Computer“ Initiative

Making Things Smart with Attached Components www.smart-its.org

Page 24: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 25

Smart-Its Prototype

Smart-Its module with Bluetooth-based communication

Prototype from ETH Zurich

Bluetooth

Atmelprocessor

Atmel microcontroller, 4 MIPS, 128 kB flash

Connection to sensors

Page 25: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 26

Interacting with Disappearing Computers?

Hold two artifacts (with attached Smart-Its) together –and shake!

image: TecO

Page 26: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 27

The shaking motion establishes a shared context (i.e., acceleration pattern) that no other devices will have

Shaking Two Objects Together Establishes a ”Friendship”

image: TecO

After the shared context has been established, the two devices can open a direct communication link

Page 27: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 28

A Possible Application:Child Watch

If the two objects are too far apart (e.g., radio communication breaks down), the user is notified with an audible ”beep”

Beep! Beep!

image: TecO

Page 28: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 29

Making Things Smart with Virtual Counterparts

Virtual world(Internet,Cyberspace)

Real world

virtual counterparts

pure virt. object(e.g. email)

Page 29: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 30

Virtual Counterparts asArtifact Memories

1) Aug. 3rd, 2001: ….2) Aug. 5th, 2001 10:34 …..3) Aug. 5th, 2001 10:37 ...4) ...

Virtual counterpartsact as memories for their real artifacts

Updates triggered by events

Arrived in room 564 Bayview Hotel

10:34, Sue K.opens bag

Sensors generate eventswho? where?when?

Queries from the real world return memory content

Page 30: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 31

Outline

Visions and Trends of Ubiquitous Computing

Everything Smart

Implications

Friedemann Mattern, ETH Zurich

Page 31: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 32

Responsive Objects

An objects tellssomething about itself

e.g., by displaying a dynamically generated homepage

Contentdepends on cirmumstances such as context and privileges

Cf. Cooltown project (HP)

Page 32: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 33

The Power of Directories

WWW server

Internet

Direc-tory

Label

Location

Context

DirectoryDirectory

Who operates directories?Who controls information and interpretation?Economic / legal / political issue?

Cf. Cooltown project (HP)

Page 33: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 35

How to Bridge the Gap Between the Real and the Virtual World?

?

Page 34: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 36

RFIDs („Smart Labels“)

Identify objects from distancesmall IC with RF-transponder

Wireless energy supply ~ 1 m magnetic field (induction)

ROM or EEPROM (writeable) ~ 100 Byte

Cost ~ € 0.1 ... € 1consumable and disposable

Flexible tagslaminated with paper

Chip (without antenna): ~ 2 mm x 2 mm x 10 µm (fits into 80 µm thick paper!)

Page 35: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 37

Advanced RFID Chips

image source: Hitachi

Page 36: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 38

A Context Sensitive Cookbook

Groceries are wrapped and equipped with RFID tags

Page 37: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 39

A Context Sensitive Cookbook

Place grocery items on the kitchen counter

Nearby display shows dishes that can be prepared with available ingredients

Page 38: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 40

Imagine an „Internet of Things“

„Silent commerce“ (Intershop)the ability of machines to conduct business transactions directly with other machines

„Imagine that...your products, your inventory or any of your physical assets could sense the characteristics of their environment, know their location and tell you about ityour products were self monitoring and could tell you when they were about to go outside of acceptable boundaries for temperatureyou could identify and track every product as it moves along your value chain, from the factory all the way to the consumer...“ (Accenture)

objects

objects

Page 39: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 41

Economic Impact of Ubicomp?(„Couple E-business with Star Trek Technology“)

Products that are fully integrated in information systemse.g., supply chain optimization

New digitally enhanced productse.g., networked weather-sensitive umbrellas, cooperating toys,...

New services („e-utilities“)e.g., management of smart devices at home, management of personal privacy,...

Detailed and timely knowledge of product location and life cycles, individual and dynamic prices for goods,...

e.g., milk bottle reduces its price with its age,higher taxes if product is transported by plane,...

Page 40: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 42

The M-Lab

„Mobility and Ubiquitous Computing Lab“

founded in July 2001

A common institution of ETH Zurich (polytechnical) and University of St. Gallen (business school) in Switzerland

collaboration with MIT Auto-ID Center (electronic product code,...)

Projects, industrial cooperations, and consultingbuild up a critical mass of highly qualified Ubicomp researchersidentifying and designing effective business applications based on Ubicomp technologies in life sciences, automotive, retail and logisticsfrom ideas to prototypes

www.m-lab.ch

Page 41: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 43

M-Lab Industrial Partners & Some Example Projects

Currently 7 partners, open to others, 200k CHF / year eachEx.: Automotive

how can spare parts of a car automatically determine the car‘s configuration?deliver spare parts that match the current configuration

Ex.: Pharmaceuticalswhat are the benefits from putting RFIDs on blisters?

www.m-lab.ch

Page 42: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 44

historically: industrialization, electricity, trains and automo-biles, electronic mass media

implies therefore eventually also ethical questions

social adaptation to technical impacts needs some time since this is an evolutionary process(willingness to learn, generational aspects,…)

General Impact of Ubicomp: Evolution vs. Revolution

Performance

Time

„revolutio-nary“ new applicationdomains

Technology and science have a major impact on our society and the world we live

Impact

Page 43: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 45

Privacy in a Ubicomp World?

Privacy is already a concern with the WWWwhat do they do with my personal data?are my page visits and mouse clicks analyzed?

Much more dramatic in a ubicomp world!many events of very elementary actions are registeredcould be assembled to perfect profiles

Bought on 20 Aug 2001; last travel: to London Sep 2003; contained shirt no. 1342 and 1349; was in Hotel Atlantic, room 317 on 17 Nov 2002 ...

- information fusion- data mining- search engines

How do we address these privacy issues?technical solutions, laws, social processes,…?more questions than answers!

Page 44: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 46

Conclusions

Ubiquitous computing technologies will have a major impact on our society and the world we live

Challengestechnical infrastructuresecurity, trust, dependability

Economic, social, cultural consequences?

whole new industry to build and manage an intelligent infrastructure?

The Internet only connected computers, now we begin to network all things

image: EUDisappearingComputerInitiative

Page 45: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 47

ETH Zürich & IBM Research www.pervasive2002.org

System architectures and platforms for pervasive computing Middleware and pervasive computing infrastructures Mobile, wireless, and wearable technologies Innovative small computing and intelligent devices Emerging applications and mobile business issues Scenarios for information appliances Service discovery protocols Content distribution and delivery User interfaces for invisible and embedded computing Context awareness Security and privacy issues

Paper submissions due February 22, 2002

Page 46: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 48

General ChairMahmoud Naghshineh, IBM Res.

Program ChairFriedemann Mattern, ETH Zurich

Program CommitteeEmile Aarts, Philips ResearchArndt Bode, TU MunichGaetano Borriello, Univ. of Washington and Intel Seattle Research LabDave DeRoure, University of SouthamptonOliver Haase, Bell Labs ResearchStefan Hild, IBM ResearchDirk Husemann, IBM ResearchPertti Huuskonen, NokiaAlan Jones, AT&T Laboratories Cambridge

Kazuhiko Kato, University of Tsukuba Tim Kindberg, HP LaboratoriesKazushi Kuse, IBM ResearchGerald Maguire, KTH StockholmJoachim Posegga, SAP Corporate ResearchApratim Purakayastha, IBM ResearchJun Rekimoto, SonyKurt Rothermel, University of StuttgartLarry Rudolph, MITBernt Schiele, ETH ZurichBill Schilit, Xerox Palo Alto Research CenterRoy Want, Intel Research

www.pervasive2002.org

Page 47: Ubiquitous Computing – - The Distributed Systems Group … ·  · 2003-12-30Part of the European „Disappearing Computer“ Initiative ... small IC with RF-transponder Wireless

© F. Ma. 49

Contact

Friedemann Mattern ETH Zürich

www.inf.ethz.ch/[email protected]