internet of things and big data
TRANSCRIPT
Outline• IOT• Why Bigdata?• A reference
Architecture• Technologies• Usecases
Photo by John Trainoron Flickr http://www.flickr.com/photos/trainor/2902023575/, Licensed under CC
Internet of Things• Currently physical world
and software worlds are detached
• Internet of things promises to bridge this– It is about sensors and
actuators everywhere – In your fridge, in your
blanket, in your chair, in your carpet.. Yes even in your socks
– Google IO pressure mats
A day in your life Think about a day in your life?
– What is the best road to take?– Would there be any bad weather?– How to invest my money?– How is my health?
There are many decisions that you can do better if only you can access the data and process them.
http://www.flickr.com/photos/kcolwell/5512461652/ CC licence
Analytics• Useful information
about your organization/ system
• E.g. Min, Max, mean, historical trends, grouping etc.
• Technical term is KPIs (Key performance Indicators )
Real Time Analytics• Most first usecases were of
batch processing, which take minutes if not hours to run
• Many insights you rather have sooner– Tomorrows weather – Heart condition – Traffic congestion – Natural disaster – Stockmarket Crash
Making Sense of Data• To know (what happened?)
– Basic analytics + visualizations (min, max, average, histogram, distributions … )
– Interactive drill down• To explain (why)
– Data mining, classifications, building models, clustering
• To forecast – Neural networks, decision
models
Usecase 1: Travel• Collect traffic data +
transportation data from sensors
• Build a model (e.g. Car Following Models)
• Predict the traffic .. Possibilities on congestion
• E.g. divert traffic, adjust troll, adjust traffic lights
Usecase 2: Football Game• Event Processing
challenge • Real football game,
sensors in player shoes + ball
• Events in 15k Hz • Event format
– Sensor ID, TS, x, y, z, v, a• Queries
– Running Stats– Ball Possession– Heat Map of Activity – Shots at Goal
Conclusions
• IOT and Bigdata• Case for analytics • Data processing architecture • Overall architecture • Conclusion