the destiny of data
TRANSCRIPT
![Page 1: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/1.jpg)
![Page 2: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/2.jpg)
![Page 3: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/3.jpg)
2006 2016
My Hadoop Journey
1 ° ° °
° ° ° N
HDFS
MapReduce
YARN.NEXT 2010
YARN1 ° ° ° °
° ° ° ° N
HDFS (redundant, reliable storage)
OthersISV Engines
MapReduceV2
SQLHive
NoSQLHBase
AccumuloPhoenix
StreamStorm
In-memory
Spark
2011
![Page 4: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/4.jpg)
What is the Destiny of Data?
![Page 5: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/5.jpg)
4ZBDATA
MOBILE DEVICES
HUMANCONTENT
INTERNET OF
THINGS
44ZBDATA
Page 5 © Hortonworks Inc. 2011 – 2015. All Rights Reserved
Data Trends
![Page 6: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/6.jpg)
Data Trends
Internet of Anything
Aggregate any and all IoAT data from sensors, machines, geolocation, clicks, files, social
Mediate secure point-to-point and bi-directional data flows
![Page 7: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/7.jpg)
7
Data Trends
It is cheap to create, collect and curate all data
![Page 8: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/8.jpg)
8
Data Trends
ContainerizationVirtualization
![Page 9: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/9.jpg)
9
Data TrendsModern Applications Are Data Applications
Ease of consume & Operate
Secure Repeatable
![Page 10: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/10.jpg)
The Menu of a Data First Application
YARN.NEXT
Assemble
Select Engines & Services
Wire Secure & OperateApp Data
Service
Engine
Engine Data
Security Admin
Service
![Page 11: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/11.jpg)
The Future of Hadoop
YARN.next
DATA ACCESS APPS
Docker Docker Docker
SQLHive
NoSQLHBase
AccumuloPhoenix
StreamStorm
In-memory
Spark
OthersISV Engines
MapReduce
V2
MySQL Tomcat Other
![Page 12: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/12.jpg)
10 Years of Hadoop!
2006 20162011
![Page 13: The Destiny of Data](https://reader034.vdocuments.us/reader034/viewer/2022051300/58eb443f1a28ab6b298b46db/html5/thumbnails/13.jpg)
Thank You!Arun Murthy @acmurthy