trends in big data

23
Trends in Big Data Selvaraaju Murugesan https://www.linkedin.com/in/selvaraaju/

Upload: selvaraaju

Post on 11-Apr-2017

47 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Trends in big data

Trends in Big Data Selvaraaju Murugesan

https://www.linkedin.com/in/selvaraaju/

Page 2: Trends in big data

Overview• Big data evolution and role of data• Big data ecosystem and tools• Demo of MapR cluster• Trends in next 5 years• My personal recommendations• Conclusion

Page 3: Trends in big data

When big data was small ?• Most of the transactional data was/(is) stored in

databases• Social media was getting some traction• Mobile phone penetration was very low• Managers made decision on reports that is based on

static data (there is no live feed of data that influences their decision at right time)

Page 4: Trends in big data

Big data landscape has changed !

Page 5: Trends in big data
Page 6: Trends in big data

Old Vs New Paradigm

Page 7: Trends in big data

Distributed Storage

Page 8: Trends in big data

Big data ≠ Hadoop

Page 9: Trends in big data

Main players

Page 10: Trends in big data

MapR Converged Data Platform

Page 11: Trends in big data

David vs Goliath

https://www.dezyre.com/article/cloudera-vs-hortonworks-vs-mapr-hadoop-distribution-comparison-/190

Page 12: Trends in big data

Ecosystem tools

Page 13: Trends in big data

Big data process

Ingestion Storage Analysis Presentation

Page 14: Trends in big data

Data Ingestion : Flume / Streamsets / Impala

Page 15: Trends in big data

Hive / Hue

Page 16: Trends in big data

Self-Service Data Exploration

Data Agility with Less IT Required

Single SQL Interface for Structured and Semi-Structured Data

Data Exploration

Page 17: Trends in big data

Data Analytics – R / Spark R

Page 18: Trends in big data

Operationalise – Spark

Page 19: Trends in big data
Page 20: Trends in big data

Trends in next 5 years• Every home will not have super computers but powerful nodes that

can do distributed computing and storage• Analysing data and decision making will be performed by 5 year old

using standard AI libraries and cheap hardware• Big data will empower deep learning• Bots will try to mimic human services

Page 21: Trends in big data

What is after big data ?

Page 22: Trends in big data

Recommendation• Big data platform can be implemented in many ways ; Hadoop is not

the only option !• Analyse important data bytes that is relevant to make business

decisions• Beware of cloud providers and their traps• Data driven decision making but hunch is very important

Creativity > big data

Page 23: Trends in big data