engage 2013 - big data
DESCRIPTION
Learn the true definition of big data and how to leverage it for organizational value.TRANSCRIPT
![Page 1: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/1.jpg)
What is Big Data?
Gordon D’SouzaBI Team Lead, Avtex
PJ JohnsonArchitect, Microsoft
![Page 2: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/2.jpg)
WHAT IS BIG DATA?
Data Complexity: Variety and Velocity
Terabytes
Gigabytes
Megabytes
Petabytes Big
DataLog files
Spatial & GPS coordinates
Data market feeds
eGov feeds
Weather
Text/image
Click stream
Wikis/blogs
Sensors/RFID/devices
Social sentiment
Audio/video
Web 2.0
Web Logs
Digital Marketing
Search Marketing
Recommendations
Advertising
Mobile
Collaboration
eCommerce
ERP/CRM
Payables
Payroll
Inventory
Contacts
Deal Tracking
Sales Pipeline
![Page 3: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/3.jpg)
3
20%Structured Data
80%Unstructured Data
Click StreamSocial
GeolocationMachine Data
LogsVideos
ImagesText
Sensors
Big Data is about building new analytic applications based on new types of data, in order to better serve your customers and drive a better competitive advantage
David McJannet, Hortonworks
http://www.informationweek.com/big-data/news/big-data-analytics/big-data-a-practical-definition/240160412#disqus_thread
![Page 4: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/4.jpg)
Info
rmati
on P
rod
uct
ion
From Data to Value
GPS Telemetry
Log Files
Recorded Voice
Satellite Images
Ambient Data
Ambulance Response Times
Disease Diagnosis
Pothole Detection
Customer Sentiment
New Business Insight
![Page 5: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/5.jpg)
How do I optimize my fleet based on weather and traffic patterns?
SOCIAL & WEB ANALYTICS
LIVE DATA FEEDS
ADVANCED ANALYTICS
What’s the social sentiment for my brand or products
How do I better predict future outcomes?
A NEW SET OF QUESTIONS
![Page 6: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/6.jpg)
COMMON BIG DATA CUSTOMER SCENARIOSGAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN YOUR INDUSTRY
Web app optimization
Smart meter monitoring
Equipment monitoring
Advertising analysis
Life sciences research
Fraud detection
Healthcare outcomes
Weather forecasting
Natural resource exploration
Social network analysis
Churn analysis
Traffic flow optimization
IT infrastructure optimization
Legal discovery
![Page 7: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/7.jpg)
Data RefinementAggregation/Compression/Transformation/Extraction
Data ConsumptionAnalysis/Modeling/Query/Reporting/
Visualization
Data AcquisitionStreaming/Trickle/Bulk Transfer
![Page 8: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/8.jpg)
Discover data with Data Explorer
Combine with information from other sources via Azure Marketplace
Refine with advanced analytics
Connecting with the World’s Data
Microsoft Big Data
Immersive insights for all users
Insights on any data
Embedded insights with simplified programming
Immersive Insight, Wherever you are
Enterprise-ready Hadoop
Windows simplicity and Manageability for Hadoop
Extend data warehouse with Hadoop
Scale & elasticity of the cloud
Open Big Data Platform
Any Data, Any Size Anywhere
![Page 9: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/9.jpg)
MICROSOFT BIG DATA
Parallel Data Warehouse PowerPivot/Power View
PowerPivot/Power View
InsightManage Enrich
Hortonworks Server
HDInsight Service
Power Query Excel Add-in
![Page 10: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/10.jpg)
Example: Yahoo!
24TB MOLAP Cube
Adhoc Query/Visualization
Optimization Application
464B rows of event level
data/qtr• Dimensions: 24• Attributes: 247• Measures: 207
Avg Query Time:6 secs
Avg Query Time:2 secs
![Page 11: Engage 2013 - Big Data](https://reader033.vdocuments.us/reader033/viewer/2022061223/54c6b4db4a79597d178b45df/html5/thumbnails/11.jpg)
Next StepsRead a bitHDInsight Documentation and TutorialsProgramming Hive Book http://blogs.msdn.com/cindygross
Sign up: Windows Azure HDInsight Service http://www.windowsazure.com/en-us/home/features/preview/
Download Microsoft HDInsight Developer Preview http://www.microsoft.com/web/gallery/install.aspx?appid=HDINSIGHT-PREVIEW
Download Power Queryhttp://www.microsoft.com/en-us/download/details.aspx?id=36803
Download Power Maphttp://www.microsoft.com/en-us/download/details.aspx?id=38395