big data streaming analytics for engineers
DESCRIPTION
Overview of Big Data Streaming Analytics for EngineersTRANSCRIPT
BIG DATA STREAMING ANALYTICS
Naunidh Singh Chadha
Agenda
• Overview of the space• Components• Business Cases• Technologies• What can you do!
BIG FAST FUSION PERISHABLE
Images source: Guavus Inc.
Data Collection
Storage and Aggregation
Data Science/M
achine Learning
Visualization
DATA
PERSIST
EXPERTISE
CONTEXT
Where is the money !
Platform• Storm
(Twitter)• Spark
(Berkley)• Apache
Hadoop/YARN
• Splunk
Message Q• Kafka
(LinkedIN)• Rabid MQ• Zero MQ
Databases• Spark
Caching• HBASE• Cassandra• MongoDB• InfiniDB• Membase
Analysis• Apache Drill• Apache
Mahout• MATLAB• R• OpenCV• Shark• Hive
Visualization• MicroStrategy• Visualization• R• D3S• JqPlot
What Powers Big Data Streaming Analytics?
What can you do !