roger breu sql server pdw solution sales microsoft western europe [email protected] microsoft...
TRANSCRIPT
Roger Breu
SQL Server PDW Solution SalesMicrosoft Western [email protected]
Microsoft Solutions for Big Data | Oct 17th 2013
From Numbers And Data To Insights And Value
The world of data has changed
By 2015, organizations integrating high-value, diverse, new information types and sources into a coherent information management infrastructure will outperform their industry peers financially by more than 20%.
– Gartner, Regina Casonato et al., “Information Management in the 21st Century”
Consumerization of IT
10x increase every five years
85% from new data types
Dataexplosion
4.3 connected devices per adult
27%using social media input
The Large Hadron Collider produces 1 PB/sec
But, my customer isn’t CERN and doesn’t have a Large Hadron Collider…
But your customers do have…
Sensors Clicks Logs
Transactional records
Call centers Images
DocumentsSignals
from social media
Simulations
Big Data is Any Data That Can’t Be Managed by Traditional Means
or is beyond the current ability of the enterprise to manage
Big Data is All This and More:
volume, variety, velocity(and volatility & variability)
Traditional Data is Highly Structuredtraditional databases are
organized around planned queries
A Definition
Web app optimization
Smart meter monitoring
Equipment monitoring
Advertising analysis
Life sciences research
Fraud detection
Healthcare outcomes
Weather forecasting
Social network analysis
Churn analysis
Traffic flow optimization
IT infrastructure optimization
Legal discovery
Natural resource exploration
GAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN THEIR
INDUSTRY
Common Big Data Customer Scenarios
DemoTwitter Analytics Demo with Microsoft Excel
Is this Big Data?Is this Enterprise Ready?
Big Data is more than just new BI!Big Data is more than just Hadoop!
Fast
L
oad
Source Systems
Historical Data(Beyond Active Window)
Summarize & Load
Big Data Sources (Raw, Unstructured)
Alerts, Notifications
Data & Compute Intensive Application
ERP CRM LOB APPS
Integrate/Enrich
SQL Server StreamInsight
Enterprise ETL with SSIS, DQS, MDS
HDInsight on Windows Azure
HDInsight on Windows Server
SQL Server FTDW Data Marts
SQL Server Reporting Services
SQL Server Analysis Server
Business Insights
Interactive Reports
Performance Scorecards
Crawlers
Bots
Devices
Sensors
SQL Server Parallel Data Warehouse
Data Insights Value
Azure Market Place
4. Business Analytics:
Interactionwith data
2. Map Reduce:
Storing and processing of unstructured
data
3. Streaming:
Real-time data processing
1. Data
Warehousing:
Storing and analysis of
structured data
The Big (Data) Picture, 4 main topics:
The Traditional Data Warehouse
14
… data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing.
– Gartner, “The State of Data Warehousing in 2012”
Data sources
OLTP ERP CRM LOB
ETL
Data warehouse
BI and analytics
The Traditional Data Warehouse
15
Data sources
OLTP ERP CRM LOB
Increasing data volumes
1
Real-time data
2
Non-Relational Data
Devices
Web Sensors
Social
New data sources & types
3
Cloud-born data
4
ETL
Data warehouse
BI and analytics
INFRASTRUCTURE
DATA MANAGEMENT & PROCESSING
DATA ENRICHMENT AND FEDERATED QUERY
BI & ANALYTICS
Self-service CollaborationCorporate PredictiveMobile
Extract, transform, load
Single query model Data quality
Master data management
Non-relationalRelational Analytical StreamingInternal & External
Data sources
OLTP ERP CRM LOB
Non-Relational Data
Devices
Web Sensors
Social
The Modern Data Warehouse
DemoCombining Structured and Semistructured Data with SQL Server PDW and Polybase
DemoCombining Structured and Semistructured Data with SQL Server PDW and Polybase
And remember, it’s not just working with Twitter
data
SQL Server PDW
APPL
ICAT
ION
SD
ATA
SYST
EMS
Microsoft Applications
DAT
A SO
URC
ES
Traditional Sources (RDBMS, OLTP, OLAP)
New Sources (web logs, email, sensor data,
social media)
HDInsight
PolybaseFeature in SQL PDW
CREATE TABLE Customers ([user_id] INT, name NVARCHAR(50)…
CREATE EXTERNAL TABLE ClickEvent (url varchar(50), event_date date, user_ID varchar(50) )WITH LOCATION =‘hdfs://MyHadoop:5000/clickstream/click.txt’;
SELECT COUNT(*) FROM Customers c JOIN ClickEvent e ONc.[user_ID] = e.[user_ID]WHERE c.Name = 'Jones';
Socket for Big Data: Hadoop Access Made Simple
Simplicity & Manageability
ENTERPRISE READYANALYTICS FOR
EVERYONE
Broaden accessibility of Big Data Analytics to all
users
CONNECTED TO THE WORLDS DATA
Combine internal and external data
OPEN & FLEXIBLE
Develop once, deploy on-premises or in the cloud
Pillars of Microsoft’s Big Data Strategy
Data Platform market is estimated to grow 9% YoYBusiness Intelligence market growing 16.4% YoYData Warehousing growing 13.5% YoYBig Data market estimated to grow 39.4% YoY
Source: IDC
Whats in it for you as Partner?
Software
HardwareConsult-ing
Leverage pre-engineered Data Warehouse and Hadoop Appliance solutions from Microsoft (and it’s hardware partners)• De-risk your projects• Streamline deployments• Modernize your customers Data Warehouse/BI
Environments >> Make them Big Data Ready!Leverage and connect the cloud• Streamline deployments• Decommission fast if smaller hadoop (HDInsight)
cluster is sufficient
Whats in it for you as Partner?
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentations. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Thank you
• SQL Server Parallel Data Warehouse (PDW) Landing Page:
• www.microsoft.com/PDW
• Microsoft Big Data Landing Page:• www.microsoft.com/bigdata
• Introduction to Polybase:• http://
www.microsoft.com/en-us/sqlserver/solutions-technologies/data-warehousing/polybase.aspx
• Twitter Analytics for Excel:• http://extendedresults.com/products/twitteranalytics/
Additional Resources