A Closer Look at SQL Data
Warehouse/Big Data
Faisal Hajazi
Solutions Architect – Data Platform
Microsoft Malaysia
Embracing data transforms businessIt is central to outperforming competitors
Agriculture EducationManufacturing Aerospace FinancialAutomotive GovernmentRetailHealthcare
Manage data
variety and
volume across all
data repositories
Modern
Maintain
historical data
from varied
sources
Traditional
Gain real-time
insights without
impacting
performance
Operational
Fragmented systems and processes
Multiple tools and skillsets
Siloed insights on disconnected data
High cost of ownership
Manage data variety
and volume across
all data repositories
Modern
Maintain historical
data from varied
sources
Traditional
Gain real-time
insights without
impacting
performance
Operational
Manage data
variety and
volume across all
data repositories
Modern
Maintain
historical data
from varied
sources
Traditional
Gain real-time
insights without
impacting
performance
Operational
SQL Server 2016 + Reference Architectures
Analytics Platform System
Azure SQL Data Warehouse
Azure Data Lake
Manage data variety
and volume across
all data repositories
Modern
Maintain historical
data from varied
sources
Traditional
Gain real-time
insights without
impacting
performance
Operational
Fragmented systems and processes
Multiple tools and skillsets
Siloed insights on disconnected data
High cost of ownership
SQL Server 2016
Azure SQL DW
Azure Data Lake
Analytics Platform System
SMP MPP
Azure SQL Database
On
-pre
mis
es
Clo
ud
Business intelligence
Machine learning
analytics
Insights
A full portfolio across on-premises + cloudOptimized for analytics: built-in or 3rd-party
Elastic scale from gigabytes to
petabytes across on-premises and cloud.
Fast time-to-value with reference
architectures, appliance, or cloud.
Low TCO ½ the cost of Exadata; pause
cloud compute for added savings.
Flexibility & choice without
tradeoffs, common technology, tools and
languages.
Cortana Analytics SuiteTransform data into intelligent action
DATA
Business apps
Custom apps
Sensors and devices
INTELLIGENCE ACTION
People
Automated Systems
SQL Server 2016Flexible, high-performance database
Real-time operational analytics and up to 100x performance gains on DW queries
ETL built-in for data integration and cleansing across data sources
Multiple levels of security andanalytics built-in or supports 3rd-party tools
Fast time to market with Reference Architecture
Scales from 1TB to 80TB
ETLbuilt-in
SQL Server
Operational DW
SQL Server
Traditional DW
App
Real-timeanalytics w/o perf impact100X
query
performance
gains
SecurityManage data
access
A complete solution; built-in
Oracle SAP Hadoop
SMP data
warehouse
SQL Server 2016Flexible, high-performance database
In-memory Columnstoreperformance and data compression
Reduced query time by 75%
Cut transactional performance down to 10 seconds
ETLbuilt-in
SQL Server
Operational DW
SQL Server
Traditional DW
App
Real-timeanalytics w/o perf impact100X
query
performance
gains
SecurityManage data
access
A complete solution; built-in
Oracle SAP Hadoop
SMP data
warehouse
Analytics Platform SystemSoftware + hardware pre-optimized for data warehousing performance
Massive parallel processing (MPP) for breakthrough performance
Query across relational and non-relational data
Scales from 1TB to 6PB of data
½ the cost of Exadata*
SQL Server
Massive Parallel
Processing
PolyBase
Choice of
Hadoop Region
Select… Result set
Plug-and-play DW appliance
Traditional &
operational DW
Analytics Platform SystemSoftware + hardware pre-optimized for data warehousing performance
SQL Server
Massive Parallel
Processing
PolyBase
Choice of
Hadoop Region
Select… Result set
Plug-and-play DW appliance
Traditional &
operational DW
Handles TBs of data
Query complexity
Near-real-time insights
Cut a 4-hour query to less
than 15 seconds
Azure SQL Data WarehouseA true elastic DW service with enterprise-class features
Create a DW in minutes
Only vendor to separate storage & compute with compute pause
Query across relational and non-relational data
Scales from a few KBs to 1PB
Fastest time to market;
start today, query today
Traditional,
operational, &
modern DW
Azure SQL
Data Warehouse
Analytics
Apps
Control
node
Azure SQL Data WarehouseA true elastic DW service with enterprise-class features
Fastest time to market;
start today, query today
Traditional,
operational, &
modern DW
Azure SQL
Data Warehouse
Analytics
Apps
Control
node
Ingests big data
Scaled workload to 100x in
minutes
Drives business insights to
improve customer satisfaction
Azure Data Lake StoreA cost-effective cloud repository for big data
Designed for multiple analytics frameworks & data durability
Offers enterprise-grade security for even the most sensitive data
Scales from few KBs to PBs
ADL Analytics
Spark
Azure Machine
Learning
HDInsight
R
Azure Data Lake StoreLOB Applications
Social
Clickstream
Sensors
Video
Web
Relational
Devices
Gather and store the widest variety of
data indefinitely—analyze as needed
Operational &
modern DW
Only true hybrid solutionData warehousing your way
On-premises, cloud, or hybrid
SQL Serverin Azure VM
Azure SQL Data Warehouse
SMP MPP
Petabyte-scale
Data warehouse
SMP
Analytics Platform System
MPP
SQL Server
Data warehouse
Petabyte-scale
Common development tools
Familiar T-SQL
Common management tools
Hybrid scenarios which work well
Both Analytics Platform System and Azure SQL Data Warehouse have a massively parallel processing (MPP) engine. Here are a few scenarios where they can be leveraged together.
Dev/testTest new ideas in Azure SQL DW before rolling out to production in APS
ArchiveArchive cold data to blob storage for any workload execution
GovernanceStore data in APS that company policy prohibits being in the cloud
DisasterRecoveryAzure SQL DW or APS as disaster recovery solution