big data and beyond
TRANSCRIPT
Sastry PenumarthyJune 12, 2016
Agenda•You and big data, closer than you think!•What is it? The 4 V’s•How did we get here? Evolution•What are the components?•Who are the leaders?•Trends?
You and Big Data, closer than you think! Tool usage/ Sites & Apps Activities on these Time spent doing them Data created (Volume and context)
▫Work Email / IM Collateral / Artefact creation Meetings Other
▫Non-work Social Mobile – Chat, Video Other (Gadgets etc.,)
• What do you see?
4 V’s of Big Data
Data
Variety
Volume
Velocity
Veracity
Evolution•Computing Technologies -
▫Storage (Punch cards, Floppies, Disks, SSD …)▫Processor speed (Moore’s law ++)▫Network (Wired / wireless / Mobile)▫Data Center, Cloud (Private / Public / Hybrid)
•Software▫Custom written▫Packages▫Web-based▫Apps
•Social / Local / Mobile Phenomenon!
Components
Data storage and management• Storage and Resiliency• Process management• Processing
• Map / Reduce, Spark
Data processing and intelligence• Data science• Analytics
• R, Python, Scala
Data visualization• Presentation
• Tableau, Google, HTML
Leaders (FANG+) -
Facebook Amazon
Netflix Google
Trends•Hadoop is going mainstream in
enterprises•Cloud-based applications are growing
phenomenally (PaaS, SaaS, XaaS)•IOT + Cloud + Big data – coming together
During the time you spent here …What Happened? How much (Approx)?
New Mobile Web users added 20+ K
New posts on Facebook 40+ M
Searches on Google 240+ M
Video Hours loaded to Youtube 18+ K Hours
Downloads from App Store 4+ MMoney spent online (Shopping) in USD 22+ M $
Number of tweets on Twitter 21+ M
Total data volume added per day (2012) – 2.5 Quintillion Bytes (2.3 Trillion Gigabytes!)
Backup Slides
What’s cooking…•Augmented Reality / Virtual reality
▫MagicLeap, HoloLens, Oculus Rift•Artificial Intelligence and Robotics•Deep Learning•Internet Of Things•Drones•3D Printing•Wearables, Implants, Exoskeletons
What does it take?Persistence
Real time processing
Enable the right insights
Simple UI / UX
Secure and reliable