future of data - big data

13
Future of Data : Future of Data : Big Data Big Data Shankar Radhakrishnan Cognizant

Upload: shankarradhakrishnan

Post on 12-May-2015

2.836 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Future of Data - Big Data

Future of Data : Future of Data : Big Big DataData

Shankar RadhakrishnanCognizant

Page 2: Future of Data - Big Data

TopicsTopics

How did we get here ? Data Explosion Big Data Big Data in an Enterprise Big Data Platform - Hadoop Big Data Adoption Q & A

Page 3: Future of Data - Big Data

How did we get here?How did we get here?Familiar World

EDW Datamarts Familiar Problems

New World Newer type of data to integrate Increase in volume Newer analytical requirements

Data warehouse

Data warehouse

Data Integration ProblemsData Integration Problems

Data Processing ProblemsData Processing Problems

Storage ManagementStorage Management

Performance ProblemsPerformance Problems

Limitations out of ComplexityLimitations out of Complexity

Page 4: Future of Data - Big Data

Data ExplosionData Explosion

Page 5: Future of Data - Big Data

Newer InterestsNewer Interests Social Intelligence

DBIM, Sentiment Analysis, Social Customer Care

Predictive Analytics

Propensity, Price Elasticity, Anti-Fraud Analytics

Segmentation Insights

Funnel Analysis, Behavioral Patterns, Cohort Analysis

Mobile Analytics

Ad-Targeting, Geo-spatial Analytics

Page 6: Future of Data - Big Data

CategoriesCategories Structured Data

Enterprise Data (CRM, ERP, Data Stores, Reference Data)

Semi-structured Data

Machine Generated Data (Sensor Data, RFIDs)

Unstructured Data

Social Data (Comments, Tweets), Blog posts

Page 7: Future of Data - Big Data

Big DataBig Data

“Big Data” refers to high volume, velocity, variety and complex information assets that demand cost-effective, innovative forms of information processing for enhanced insightand decision making

Page 8: Future of Data - Big Data

Big Data PlatformsBig Data Platforms• Data Integration

o Informatica, Infosphereo talenD, Pentaho, Karmasphere, Apache Sqoop, Apache Flume

• Database Frameworko Hadoop (Distributions: Cloudera, Hortonworks, MapR)o Hbaseo Hive

• NoSQL Databaseso MongoDB, CouchDB

• Machine Data Processingo Splunk, Mahout

• Text Analyticso Clarabridge, Lexanalytics

Page 9: Future of Data - Big Data

Big Data in an Big Data in an EnterpriseEnterprise

Data warehouse

Data warehouse

Data Source

s

Data Source

sETLETL

Big Data

Sources

Big Data

Sources

ETLETL Big Data PlatformBig Data Platform

ETLETLDatamartsDatamarts

DatamartsDatamarts

DatamartsDatamarts

Analytical Application

s

Analytical Application

s

Page 10: Future of Data - Big Data

Hadoop - EcosystemHadoop - Ecosystem

Page 11: Future of Data - Big Data

Big Data : Adoption Big Data : Adoption DriversDrivers

Page 12: Future of Data - Big Data

Big Data – Adoption Big Data – Adoption ScenariosScenarios

Replatforming to Big Data (Hadoop, MapR) Archival Solution (Hadoop) Offloading Data warehouse, EDW (Hadoop, Hive) Social Media Integration Machine Data Analysis (Splunk, Mahout) Complex Analytical Requirements (Hbase)

Page 13: Future of Data - Big Data

Q & A