![Page 1: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/1.jpg)
A Tale of Two Technologies
A Story of the IoT “revolution”
![Page 2: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/2.jpg)
It was the age of connectedness
![Page 3: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/3.jpg)
It was the age of disconnectedness
Failure tolerance is not optional
![Page 4: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/4.jpg)
It was the age of wisdom
![Page 5: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/5.jpg)
It was the age of foolishness
![Page 6: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/6.jpg)
It was the epoch of complexity
![Page 7: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/7.jpg)
It was the epoch of simplicity
![Page 8: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/8.jpg)
What is the Internet of Things?
“The Internet of Things (IoT) refers to uniquely identifiable objects and their virtual representations in an Internet-like structure.”-Wikipedia
![Page 9: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/9.jpg)
No really what is IoT?
● It’s literally the act of connecting “things” to the Internet
● It predates the World Wide Web● It shouldn’t be surprising to anybody
![Page 10: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/10.jpg)
So IoT is old news?
Most definitely
![Page 11: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/11.jpg)
So IoT is just hype?
Home security and automation
Fitness trackers
Your (driverless?) car
Medical devicesSensors
Industrial equipment
NO!
![Page 12: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/12.jpg)
Been there done that.
● DataStax and Cassandra have been dealing with event streams (time series) information at scale for years.
● But Cassandra is relatively dumb storage.● Put data in. Get data out.
![Page 13: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/13.jpg)
What is Cassandra?
● A massively scalable distributed database● Chooses availability over strong consistency
(yes, that really is a fundamental tradeoff)● With its wide partitions it is able to take
advantage of data locality even at “web scale”
Chocolate!
![Page 14: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/14.jpg)
What is Spark?
● DAG is a logical superset of M/R● Adopts much of the Hadoop ecosystem,
without being bound by it● Intelligent use of caching (RDDs) for
massive performance gains● Incorporate Streaming to make ingestion-
time processing a first class citizen
Peanut butter!
![Page 15: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/15.jpg)
What does IoT need from big data?
● Log time-series events -- at scale● Gather meaning from that data -- at scale● Report on that data -- at scale● Take action on that data -- at scale
![Page 16: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/16.jpg)
Logging events at scale
![Page 17: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/17.jpg)
Gathering meaning at scale
![Page 18: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/18.jpg)
Reporting at scale
● Canned reports● Ad-hoc querying and reporting● Drill down / exploratory ● Alerting● Aggregation● Clustering (K-means, et al)● Generalized machine learning
![Page 19: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/19.jpg)
Take action at scale
● Stateless application servers● Horizontally scaled and co-located with
Cassandra and Spark in each DC● Any platform with a CQL driver
![Page 20: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/20.jpg)
The architecture...
![Page 21: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/21.jpg)
Spark to Cassandra
![Page 22: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/22.jpg)
Cassandra to Spark
![Page 23: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/23.jpg)
Multi-DC
DC1 DC2
Write anywhere.
![Page 24: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/24.jpg)
Things that go together
![Page 25: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/25.jpg)
Things that go together
![Page 26: A Tale of Two Technologies A Story of the IoT “revolution”](https://reader035.vdocuments.us/reader035/viewer/2022070413/5697bfef1a28abf838cba039/html5/thumbnails/26.jpg)
A Tale of Two Summits