lcc, miersi sm 14/15 – t6 sensing technology miguel tavares coimbra

50
LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Upload: alexia-jennings

Post on 11-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

LCC, MIERSI

SM 14/15 – T6Sensing Technology

Miguel Tavares Coimbra

Page 2: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

References

• Slides from Edward A. Lee & Sanjit Seshia, UC Berkeley, EECS 149 Fall 2013– Copyright © 2008-date, Edward A. Lee &

SanjitA. Seshia, All rights reserved

• Pedro Brandão, Sistemas Embutidos, DCC/FCUP– https://moodle.up.pt/course/view.php?id=3162

SM 14/15 – T5 – Sensing Technology

Page 3: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Reality

SM 14/15 – T5 – Sensing Technology

Page 4: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Quantifying RealityRain

Ball Speed

Stress

Fatigue

Heart Rate

Emotions

Muscle strength

Wind

Body posture

SM 14/15 – T5 – Sensing Technology

Page 5: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Into a Digital World

Page 6: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

I want to transform real variables into digital ones

Real-time, unobtrusively, in real situations, for long periods of time,

with very high accuracy

Page 7: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Cyber-Physical Systems

SM 14/15 – T5 – Sensing Technology

Page 8: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

(More) Pieces of the Puzzle

• Input– Reality (cameras, microphones, sensors, mocap,

controllers,…)– Synthetic (computer graphics, sound synthesis,

…)

• Processing – Digital, Analogue– Transform data, generate new data

• Output– Video, audio, actuators

SM 14/15 – T5 – Sensing Technology

Just a bit…

Page 9: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 10: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 11: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 12: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Sensor Components

Page 13: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 14: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 15: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 16: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 17: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 18: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

CCD (charge coupled device)Higher dynamic range High uniformityLower noise

CMOS (complementary metal Oxide semiconductor)

Lower voltageHigher speedLower system complexity

Light Sensors

• Convert light into an electric charge

SM 14/15 – T5 – Sensing Technology

Page 19: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Environmental Sensors

– Temperature– Humidity

– Air quality

SM 14/15 – T5 – Sensing Technology

Page 21: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Case Study: UrbanSense @ Porto

SM 14/15 – T5 – Sensing Technology

Page 22: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Wearable Sensors

Page 23: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Erik Topol, 2009

SM 14/15 – T5 – Sensing Technology

Page 24: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 25: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 26: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Case Study: Vital ResponderMonitoring Stress Among First Responder Professionals

SM 14/15 – T5 – Sensing Technology

Page 27: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 28: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Electrocardiogram

Page 29: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Electrocardiogram

Page 30: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

RR Variability

Page 31: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

EEG

https://www.youtube.com/watch?t=55&v=T7CiiWBwMgw

Page 32: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

EMG

SM 14/15 – T5 – Sensing Technology

Wearable EMG

Very FamousPerson

Page 33: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Smartphone Sensing

Samsung S4•Accelerometer•Gyroscope•Light•Magnetic Field•Atmospheric Pressure•Proximity•Temperature•Humidity•Sound Levels•GPS

SM 14/15 – T5 – Sensing Technology

Page 34: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Smartwatch Sensing

SM 14/15 – T5 – Sensing Technology

Page 35: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Some fundamental concepts

Page 36: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Page 37: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Analog to Digital

SM 14/15 – T5 – Sensing Technology

Page 38: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Sampling

Continuous signal:

Shah function (Impulse train):

xf

x

Sampled function:

n

s nxxxfxsxfxf 0

xs

x0x

n

nxxxs 0

Page 39: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Aliasing

Picket fence recedinginto the distance willproduce aliasing…

Input signal:

x = 0:.05:5; imagesc(sin((2.^x).*x))

Matlab output:

WHY?

Sampling frequency must be greater than max2u

Page 40: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Quantization

• G - number of levels• m – storage bits• Round each value to

its nearest level

mG 2

Page 41: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Noise

• Noise is a distortion of the measured signal

• Every physical system has noise

• Various strategies:– Better sensors– Digital Filters– Restoration models

Page 42: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Processing

• Signal Processing– Analysis,

interpretation, transformation of a signal

• Example– In order to measure

temperature I ‘process’ the length of a volume of mercury

I am processing a signal

Page 43: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

So what do I do with all this?

You do cool stuff of course…

Page 44: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Videogames that change with your heart signals

Page 45: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Sounds controlled by gestures

Page 46: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

EEG Generated Art

SM 14/15 – T5 – Sensing Technology

Page 47: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Dating using GPS trajectories

Page 48: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

SM 14/15 – T5 – Sensing Technology

Use CG to replay the coolest goal from your football match

Page 49: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

Get Creative

SM 14/15 – T5 – Sensing Technology

Page 50: LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

What will you quantify?Rain

Ball Speed

Stress

Fatigue

Heart Rate

Emotions

Muscle strength

Wind

Body posture

SM 14/15 – T5 – Sensing Technology