mems engineer’s forum, mef 2017 rajashree ‘raji’ baskaran ... · sensory innovation: the next...

29
MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran, Ph.D., Principal Engineer and Director, Sensor solutions, New Devices Group

Upload: others

Post on 22-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

MEMS Engineer’s Forum, MEF 2017

Rajashree ‘Raji’ Baskaran, Ph.D.,

Principal Engineer and Director, Sensor solutions, New Devices Group

Page 2: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Today's Wearables Landscape

Sensory Innovation: The Next Frontier

Capitalizing on the Opportunities

Page 3: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

wearables 1.0

Page 4: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

We’re entering wearables 2.0

Integrated into all sorts of

things

Solving real problems

Unlocking the power of big data

Unobtrusive or hidden

Attractive enough to show off

Page 5: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

We’re entering wearables 2.0

Integrated into all sorts of

things

Unobtrusive or hidden

https://www.youtube.com/watch?v=5fbbDR3813I

Page 6: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

We’re entering wearables 2.0

Attractive enough to show off

https://www.tagheuer.com/en-us/watches/tag-heuer-connected

Page 7: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

We’re entering wearables 2.0

Solving real problems

Unlocking the power of

big data

Page 8: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

librariesIntel® MKL & MKL-DNN

Intel® Deep Learning SDKtools

Frameworks

Intel® DAAL

hardwareMemory & Storage NetworkingCompute

Intel Dist

Mlib BigDL

Intel® Nervana™ Graph

intel AI portfolio

experiences

MvTensorLibrary

Associative Memory Base

Lake Crest

Intel® MLSL

Vision/ Drones/Wearables

Page 9: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Today's Wearables Landscape

Sensory Innovation: The Next Frontier

Capitalizing on the Opportunities

Page 10: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Sensory Inputs and OutputsSensory InputVISUALCamera, IR sensor*

AUDIOMicrophones, Ultrasonic*

TOUCHCapacitive touch, force, buttons, knobs…

SMELL & TASTEVOC, alcohol, CO, CO2, SOX/NOX *

Device OutputDisplay

Speakers

Haptics, Tactile keys

Digital release of chemicals

* Super human capabilities

INERTIAL SENSORS: Internal body map

Page 11: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Today’s sensory innovation is in audio

Page 12: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

The Fusion of Audio and Vision

Page 13: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

“No, the other left…”

Page 14: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Touch and vision sensor fusion

Page 15: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

The next sensory front: smell and taste

Page 16: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Today's Wearables Landscape

Sensory Innovation: The Next Frontier

Capitalizing on the Opportunities

Page 17: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Gesture Control / Natural interactions

Page 18: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

NEEDS VS CApabilities: Natural gesture recognition technology

Metric Target Range Today’s Technologies (readiness for wearable applications)

Active infraredPassive infrared

UltrasonicRadio frequency

Capacitive

DistanceA few mm to ~10 cm

Resolution Fine finger control

Line of SightCover large solidangle

Power ~10s of uW

Integration & Cost

Available today Not optimized1 -2 years

Not ready (3-5 years) ordoesn’t scale

Page 19: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

50-250HZ Frequency of operation

1-3mm lateral footprint<1mm tall

~100um stroke with applied forces(skin stiffness ~.1mN/um)

Integration feasible with soft and hard material

Low power(reasonable voltage ranges)

Arrays of individual addressable elements

Distributed Haptic Wish List

50-250HZ frequency of

operation

1-3mm lateral footprint

<1mm tall

~100um stroke with applied forces(skin stiffness

~.1mN/um)

Integration feasible with soft and hard material

Low power(reasonable

voltage ranges)

Arrays of individual addressable

elements

Page 20: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

NEEDs Vs CAPABILITIES: Tactile motor technologies

Metric Target Range Today’s Technologies (readiness for wearable applications)

Eccentric Rotating Mass

Linear Resonance Actuator

Piezo Polymer Fluidic

Size ~A few mm3

Frequency 50-250Hz

Reliability 1M+ cycles

Stroke~10-100um against skin

Power

Integration & Cost

Available today Not optimized(1-2 years)

Not ready (3-5 years)Or doesn’t scale well

Page 21: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Wearables for the way we live…

NEXT GEN BIOSENSING SECURITY & ID

Enter

Page 22: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Opportunity Areas : Bio sensingNEXT GEN BIOSENSING

Various sensors to enable dynamic understanding of

vitals

A vast library of ‘body IQ’

http://fortune.com/2015/09/16/intel-ny-fashion-week/

Page 23: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Opportunity Areas : Authentication

Next generation sensors including

• Low power/size fingerprint, iris & other biometric ID

Page 24: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Wearables wish list from MEMS experts

• Natural Gesture Control /user input with context awareness• Sensor fusion with other input methods

• Haptics – distributed and localized

• Advanced bio sensing• Next generation security/biometric

Page 25: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Conclusion: MEMS & sensors can differentiate and ADD value to wearables

Page 26: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. No computer system can be absolutely secure. Check with your system manufacturer or retailer or learn more at intel.com.

All information provided here is subject to change without notice. Contact your Intel

representative to obtain the latest Intel product specifications and roadmaps.

Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or

its subsidiaries in the United States and other countries

*Other names and brands may be claimed as the property of others.

Copyright © 2016 Intel Corporation, All Rights Reserved

Page 27: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

I would like thank the following colleagues for their inputs: Brian Girvin, Zach Brand, Alberto Vidal, Indira Negi, Georgios Dogiamis, Ramune Nagisetty and Ken Foust

Many of the examples in the sensory fusion discussions were taken from published

academic and industry literature and news sources and citations within

https://doi.org/10.1109/IEDM.2016.7838449

Page 28: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables
Page 29: MEMS Engineer’s Forum, MEF 2017 Rajashree ‘Raji’ Baskaran ... · Sensory Innovation: The Next Frontier Capitalizing on the Opportunities. wearables 1.0. We’re entering wearables

Wearables wish list from MEMS experts• Natural Gesture Control /user input with context awareness

• Sensor fusion with other input methods• Haptics – distributed and localized

• Advanced bio sensing• Next generation security/biometric

Questions? Comments?