![Page 1: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/1.jpg)
MITSHUBISHI ELECTRIC RESEARCH LABORATORIESCambridge, Massachusetts
Toward Scalable Activity Recognition for Sensor Networks
Christopher R. WrenMERL Research
Emmanuel Munguia TapiaMIT House_n
![Page 2: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/2.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 3: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/3.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 4: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/4.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
t
Office
![Page 5: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/5.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
t
t
Office
Hall
![Page 6: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/6.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
t
t
Office
Hall
![Page 7: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/7.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
A sensor network for building context.
![Page 8: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/8.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Second Implementation
Emmanuel’s MERL internship Summer 2005
Wireless Motion DetectorWires for Power
155 installed and operational
![Page 9: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/9.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Why Smarter Buildings?
• Safety & Security– Unusual Activity Detection– Economical Context Sensing– Tuned Escape Routes
• Eldercare – Activity Monitoring– Awareness
• Energy Efficient Buildings– Lighting– HVAC– Integrated building systems
• Socially–Aware Buildings– Presence– Availability– Awareness
• Entertainment• Elevator Demand Prediction• Retail
– Predict densities– monitor reaction to displays
• Industrial Process– Ergonomics– Safety– Efficiency
![Page 10: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/10.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
How do you build a sensor network?
![Page 11: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/11.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 12: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/12.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 13: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/13.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 14: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/14.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 15: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/15.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 16: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/16.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 17: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/17.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 18: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/18.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Ka
Photo courtesy of Kathy Ryall
![Page 19: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/19.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
LoCA27 nodes1 receiver
![Page 20: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/20.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
today155 nodes7 receivers
![Page 21: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/21.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
How do you use a sensor network?
![Page 22: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/22.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
SARSEN: Scalable Activity Recognition for Sensor Networks
•Locality of processing–Abstract information early–Reduce communication–Small data means small CPU
•Locality of Context–Build form small components–Small areas are more portable–Independent of context–A hallway is a hallway
•Build understanding–Tracking is not possible–Find consistent explanations–Abstractions reduce space
![Page 23: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/23.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Behavior Hierarchy
Action
Activity
Movement
Motion no context, no temporal information
limited local context, no temporal information
more context,significant temporal structure
activities in global context
![Page 24: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/24.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Behavior Hierarchy
Action
Activity
Movement
Motion
![Page 25: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/25.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Hardware
• 155 sensors, public spaces of a 2000m2 office building floor.• 7 weeks of data and counting• 3x106 observed motion events• ~90-150 people• Collaborative environment• Many kinds of spaces:
– laboratories – cubicles – offices – meeting rooms
• frequent visitors
![Page 26: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/26.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Behavior Hierarchy
Action
Activity
Movement
Motiontopology
![Page 27: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/27.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Automatically Recovered Topology
TR2005-003: “Similarity-based Analysis for Large Networks of Ultra-Low Resolution Sensors.” To Appear Pattern Recognition Special Issue on Similarity-Based Pattern Recognition
![Page 28: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/28.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Behavior Hierarchy
Action
Activity
Movement
Motion
![Page 29: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/29.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Movement
![Page 30: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/30.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 31: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/31.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Turn Movement
![Page 32: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/32.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Walk Movement
![Page 33: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/33.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Still Movement
![Page 34: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/34.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Behavior Hierarchy
Action
Activity
Movement
Motion
![Page 35: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/35.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Activities
• Temporal Structure: Markov Chains• Trained from hand-written examples
– Visit: stop, stand around, start– Meet: exit, exit, exit.
![Page 36: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/36.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Meet Activity
![Page 37: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/37.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Visit Activity
![Page 38: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/38.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Behavior Hierarchy
Action
Activity
Movement
Motion
![Page 39: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/39.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Next Generation
>3 years on AA!802.15.4 radio
Easy to manufacture
Jonathan WesthuesDarren Leigh
![Page 40: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/40.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Summary
•Buildings as experts in themselves!
•Cheap to install and operate•Potentially cheap…
…also in terms of privacy
•Aware buildings can be safer, more efficient, richer.
•Hierarchical Behavior Elements…not Tracks
SARSEN
![Page 41: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/41.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 42: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/42.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 43: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/43.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 44: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/44.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 45: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/45.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Thank You!
Christopher R. [email protected]
Emmanuel Munguia [email protected]
![Page 46: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/46.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
![Page 47: Toward Scalable Activity Recognition for Sensor Networks](https://reader036.vdocuments.us/reader036/viewer/2022071602/613d65cc736caf36b75cda61/html5/thumbnails/47.jpg)
MITSUBISHIELECTRIC
Changes for the better
MITSUBISHI ELECTRIC RESEARCH LABORATORIES
Why Motion Detectors?
They’re cheaper, require less bandwidth, less computation, less memory, but also….
Cameras provide a greater potential for abuse when you vary the intentionality of the person in control of the technology.
Dimensional Metaethics, Carson ReynoldsAnalytic framework for ethical comparison
TR2006-005: Worse is Better for Ambient Sensing, Pervasive 2006 Workshop on Privacy, Trust and
Identity Issues for Ambient Intelligence