data culture series - keynote - 27th jan, london
TRANSCRIPT
DATA CULTURE SERIES – 27th Jan 2015
? Who is using Data to drive the future of their business?
? Who is using Predictive Analytics / Machine Learning yet?
It Started with
Data Culture
Core to Vision
Start Justin
Digital Work & LifeExperiences
Data…Driving the Experience
UK Economy - data dividend
Data Culture Series
Data Culture Exec
Session
Data Culture
Summit
Data Culture
Un-Conference
4 events; 60 customersCXO Level
10 events; 800-1000 customersPower User, Analyst, Architect, Developer, DBA
Data Scientist
6 events; 300 customersPower User, Analyst
Data Culture
Deep-Dive2 events; 100 customersPower User, Analyst
NEW
NEW
Data Culture Summit
Date Location
24 February LEEDS Data Culture series
24 March EDINBURGH Data Culture series
8 April BIRMINGHAM Data Culture series
12 May READING Data Culture series
19 May LONDON Data Culture series
More dates added shortly…..
#DataCulture
Interact & Post questions for the Panel
UK Business Lead for Data Insights
13
Jon Woodward : Connect & Follow
13
@JLWoodward
www.linkedin.com/in/jonathanwoodward
#DataCulture
PowerBI
APS
AzureML
DocumentDB
Search
EventHub
Stream Analytics
Hadoop
Time Location
10:30 – 11:30 KeynoteAnthony Saxby – Data PlatformSteve Dunbar – IOT
11:30 – 12:30 Big Data - CARDIFF
Data Science - PARIS
Business Intelligence - BRUSSELS
Data Insights - AMSTERDAM
Azure Data Services - PRAQUE
Immersion Tracks - Overview
12:30 – 13:15 Lunch & Expo
13:15 – 16:30 Immersion (as above) Immersion Hands on
15:00 - 15:15 Break & Expo
15:15 - 16:30 Immersion (as above) Immersion Hands on
16:30 – 17:00 Panel and Close
17:00 Finish
Steve Dunbar
IoT Commercial Director
From the Edge to Analytics
Create the Internet
of Your Things
Customer perspective: the Internet of Things is complex
It’s bigSo many devices and so much data
It’s noisy
So many opinions
It’s confusing
So many possible decisions
Should we
wait?
How (where)
do we get
started?
Who can
really help
us?
Do we need
to start over?
What
technology
do we need?
B5075212
“ ”
The network of physical
objects that contain
embedded technology to
communicate and interact
with their internal states or
the external environment.
Source: Gartner
Components
and devices are
inexpensive
Connectivity is
pervasive
Development is
easy
Economic
benefits are
enormous
New scenarios
fuel demand
Forward-leaning businesses and individuals are
connecting their things today to create new kinds of value
Industry Type of Savings Savings over 15 Years (USD)
Commercial Aviation 1% Fuel Consumption $ 30B
Internet of Things Opportunities
GE, Industrial Internet, A European Perspective, Pushing the Boundaries of Minds and Machines
GE, Industrial Internet: Pushing the Boundaries of Minds and Machines
Energy (Gas) 1% Plant efficiency gain $ 66BHealthcare 1% System efficiency gain $ 63B Freight Transport (Rail) 1% System efficiency gain $ 27BOil and Gas 1% Improvement in Capital Utilization (Exploration and Development)
$ 90B
What are “your things”?
These are things that
empower and enable
your people.
They allow you to
connect with customers
and business partners.
They are critical
components that help
power your business.
23
You have DATAYou have THINGS
Transactional
data
ERP
data
CRM
data
Document/
meta data
Public
data
Social
data
Devices
Analytics and business
intelligence tools
Cloud and network-
enabled infrastructure
Sensors
Other Enterprise
“Things”
…And connect to
other “things”
across your
Enterprise
Microsoft Services for IoT
Services that allow you to easily
connect and manage all your
devices and data; and transform
insights into action
Industry Devices
The devices and services you need
Connected Windows
devices that enable your
people with consistent,
compelling, and intuitive
experiences
Point of
Service Devices
Specialized
Devices
Thin
Clients
Handhelds
Self Checkout
Stations
Kiosks
Digital
Signs
Automation
Devices
Smart
Phones
Slates/
Tablets
PCs/
Laptops
Vending
Machines
Kinect
Servers
Diagnostic
Equipment
Remote Medical
Monitors
Logic
Controllers
Security
POS
Terminals
ATM
Chips
Applications
and Portals
Sensors
Other Devices
Power BI
for Office 365
Line-of-Business
Services
M2M
Services
Cloud
Services
Intelligent Systems Service
Data and BI Services
HDInsight
The right strategy
Generate new
insights to
create new
business value
Combine the
data you
already collect
Expand by adding new devices, assets, services, and data
Utilize services
and the cloud
to jumpstart
your efforts
Start by
connecting the
devices and LoB
assets you
already have
IoT represents a big opportunity
Transportation Utilities Government Other
$92 B $472 B $160 B $132 B $156 B $100 B $301 B $877 B
Transportation Utilities Government Other
$154 B $913 B $326 B $313 B $325 B $201 B $570 B $1.79 T
$4.59T
$2.29T
CHALLENGE SOLUTIONS BENEFITS
Royal Caribbean International, the second-
largest cruise company in the world with 22
ships that sail to more than 270 destinations,
wanted to improve food safety and insight
into customer behavior on its innovative new
Oasis-class ships.
Royal Caribbean deployed a solution from
Agilysys and ParTech that connects Windows
Embedded devices including 325 POS
terminals, 50 tablets, and 300 digital signs
with back-end servers running Microsoft SQL
Server and Windows Server. Thirty-five
handheld devices connect to existing
equipment to increase efficiency in food
inspection processes.
• Integrates data from POS, tablets, signage,
TV, photo gallery, and ticketing systems
• Automates alerts for cooler malfunction
• Reduces time to complete checklist and
generate temperature compliance reports
• Cuts temperature check times by 60%
The Internet of Your ThingsIntelligent Systems in action - Retail
ROYAL CARIBBEAN CRUISE LINE
www.InternetofYourThings.com
Microsoft’s View
V
The Microsoft cloud supports any device
. . .
datadeveloper
Vehicle Tracking Device Cameras Power Meter Load Meter Smoke Fire Alarms Humidity Sensor Flow Meter Occupancy Sensor Temperature Sensor
INTELLIGENT DEVICES Machine Controller
Vehicle Tracking Smart Grid General Equipment Retail Kiosk Fire Detection Healthcare Smart Building Automation Digital Advertising Smart Home Automation
Automotive Retail Industrial Healthcare Security & Surveillance Energy Smart Home Smart Cities
Collect
Instrument apps
Deliver events to analytics service
Receive and store many live data streams
Analyze
Real-time and historical analysis of event streams
Aggregations, pivots and patterns
Consume
Publish analytics in a consumable format
Inform and Influence
Make better decisions
Microsoft Azure IoT services
M2M GatewayNETWORK
Azure services for IoT
Producers Event Ingestion Storage Transformation Presentation & action
Event Hubs
(Service Bus)SQL Database Azure ML Azure Websites
Heterogeneous
client agents
Table/Blob
StorageHD Insight Mobile Services
Intelligent
Systems ServiceDocumentDB Stream Analytics Power BI
External Data
Source
External Data
SourceCloud Services External Services
{ }
Predictive
Maintenance
that enable you to
change your
business…
HDInsight Power BI
Machine Learning
Command and Control
You have devices
on the network
edge…
Plant Floor
Things
Supply Chain
ThingsBack Office
Things
Basic Sensors Intelligent Devices
that provide you
data…
SQL Databases
Blob Storage
Table Storage
External Storage
DocumentDB
that you
understand, apply
rules, models and
more…
Command and
Control
Event Hubs (Service Bus)
Process
Efficiency
Cost
Reduction
IoT is all about
providing INSIGHTS
Develop
New Business
Models
Recommenda-
tion engines
Advertising
analysis
Weather
forecasting for
business planning
Social network
analysis
IT infrastructure
and web app
optimization
Legal
discovery and
document
archiving
Pricing analysis
Fraud
detection
Churn
analysis
Equipment
monitoring
Location-based
tracking and
services
Personalized
Insurance
Predictive analytics should address the likelihood of something happening in the future, even if it is just an instant later…
Connect new and existing
devices using open-source
agents or gateway
technologies
Store machine-generated
data with data from other
sources in the cloud
View data, administer
devices, and configure
rules, alerts, and other
actions using out-of-box
or custom portals
Mine insights from your
data to find gaps and
opportunities to make
better decisions and realize
new business value
Drive InsightsAnalytics ToolsCloud and infrastructure
Devices and
assets
10101010011000110101010111010011010101010100110111011110111001010100001101010101110100110101010111010011101010101011010011010101010101001101100010101111010011101010101011011110100111
10101010011000110101010111010011010101010100110111011110111001010100001101010101110100110101010111010011101010101011010011010101010101001101100010101111010011101010101011011110100111User
input
AlertsSensors Gateway
Agent
ADevices
Value
StreamInsights
Power BI
HDInsight
Azure Machine
Learning
Customer
portal
• Read about Microsoft’s commitment to IoT on the IoT blog, at http://blogs.microsoft.com/iot/
• Learn about Microsoft’s point of view, the Internet of Your Things, at www.Microsoft.com/Internetofyourthings
• Learn about some of the Azure IoT Services available today, such as Machine Learning and HDInsights
• Stay informed by signing up for the Internet of Your Things newsletter at www.InternetofYourThings.com
• Attain the Intelligent Systems competency to take advantage of specific partner benefits
• Sign up for a free Microsoft Azure trial at www.Microsoft.com/Azure
Modernising your Data Platform
Anthony Saxby
Cloud Data Platform Lead
Microsoft UK
Big data
26BBy 2020, IoT will include 26B units, creating large quantities of data & generating >$300B in revenue for IoT suppliers
Mobility Apps Cloud
>50% More than half of information workers across 17 countries report using 3+ devices for work
25%one quarter of external app implementation spending will be on mobility, cloud, analytics, & social, by 2016
~50%nearly half of total IT spend will be cloud-related by 2020
Devices: “Info Workers Will Erase Boundary Between enterprise And Consumer Technologies.” Forrester Research. August 30, 2012
Apps: Gartner: “Predicts 2013: Business Impact of Technology Drives the Futures Application Services Market.” Nov. 21, 2012
Big data: Paraphrased from "The Impact of the Internet of Things on Data Centers." Gartner Research, Feb 27, 2014
Cloud: “Prepare For 2020: Transform Your IT Infrastructure And Operations Practice.” Forrester Research. Oct. 24, 2012
Cost Agility
Service Levels
Performance
CPU Performance Flattening OutDecreasing Cost of Memory$/GB of Memory
1
10
100
1,000
10,000
100,000
1,000,000
19
90
19
91
19
92
19
93
19
94
19
94
19
95
19
96
19
97
19
98
19
99
20
00
20
00
20
01
20
02
20
04
20
05
20
07
20
08
20
09
20
11
US$
/GB
0
1
10
100
1,000
10,000
100,000
1,000,000
10,000,000
1970 1975 1980 1985 1990 1995 2000 2005 2010
46
Drive Real-Time Business with Real-Time Insights
Over 100x query speed and
significant data compression with
In-Memory ColumnStore
Up to 30x faster transaction
processing with In-Memory OLTP
Greater
performance
with In-Memory
Analysis Services
Billions of rows
per second with
PowerPivot
In-Memory for
Excel
47
Faster InsightsIN-MEMORY ANALYTICS
Faster QueriesIN-MEMORY DW
Faster TransactionsIN-MEMORY OLTP
The entire DB doesn’t need to be In-Memory
10xFaster performance
In-Memory FlexibilityKey Benefits
Minimize capex as
data volumes grow
Access In-Memory and
on-disk with a single query
Don’t need to rewrite
entire appwith
scalability and
reduced
operating
costs
Exponential
growth
On-Disk
Application
Warm and
hot data
Cold DataSingle Query
49
In-Memory
OLTP
35x faster
performanceGames
No locks
and latches
“SQL Server 2014 has no
lock and latch problem,
meaning it can increase
CPU usage up to 90 percent.
What was even more
surprising was that it
ensured seamless handling
of all requests without an
error, even when CPU usage
exceeds 90 percent.”
- Lee Sangbong, Deputy Chief,
CJ E&M Database Team
Key Benefits
Quickly explore massive
data volumes
Dramatically compress data
Over 100x faster query
performance
Accelerated Analytics with In-Memory
“It can take up to 3 hours to aggregate
data from billions of table rows….
(Now) it takes 45 minutes to update
the index, and then reports can be run
on-demand with sub-second response.”
- Kevin Cornett, Stein Mart
Faster time to insights
Advanced data
compression
In-Memory
ColumnStore Advanced Analytics
with InMemory
51
10,800xfaster queries
340x faster queries
2,400xfaster queries
PH
YS
ICA
L H
AR
DW
AR
E L
AY
ER
DATACENTRE A
PH
YS
ICA
L H
AR
DW
AR
E L
AY
ER
SQL 2000
SQL 2000
SQL 2005SQL 2005 ClusterSQL 2008r2
SAN (High I/O Capacity)
DATACENTRE B
SQL 2005 Cluster SQL 2000 SQL 2000
SAN (High I/O Capacity)
SQL 2005
SQL 2005
SQL 2008r2 SQL 2008r2
SQL 2012 BI
Timeline
2004200520062008200920102012
SQL 2000OracleSQL 2012 BISQL 2012 Enterprise
SQL 2012 BISQL 2012 Enterprise
Virtualisation Overhead ReducingProven SQL Server performance on an enterprise-class hypervisor
0
0.2
0.4
0.6
0.8
1
0
200
400
600
800
1000
4 8 16 32 64
Avera
ge T
ran
sacti
on
Resp
on
se T
ime (
Sec)
Tra
nsa
cti
on
s/S
ec
Virtual Processors Per VM
Hyper-V Virtual CPU Scalability
with OLTP Workloads
Enterprise Strategy Group
Tested an existing SQL Server 2012 OLTP workload that was previously vCPU limited
Increased Scale & Performance
With Hyper-V’s support for 64 vCPUs per VM, testing showed a 6x performance increase, with a 5x improvement in transaction response time.
2,870 SQL Server batch requests per second were recorded during the 64 vCPUtest. Microsoft documentation states “over 1,000 batch requests per second indicate a very busy SQL Server”
0
500
1000
1500
2000
2500
3000
3500
4 8 16 32 64Batc
h R
eq
uest
s/S
ec
Virtual Processors Per VM
Hyper-V Enabled SQL
Batch Request Scalability
0
200
400
600
800
1000
1200
1400
1600
Physical Virtual
Tra
nsa
cti
on
s/S
ec
Hyper-V OLTP Workload Analysis
The 2 tests showed just a 6% difference between the brokerage application running on physical vs. virtual
APPAPP APP
VM IO
Random IO
But… HDD-based system are
optimized for sequential IO
VM VM VM
“IO Blender” effect
Virtualizing/consolidating
randomizes IO
Flash Storage removes this
constraint allowing greater
density levels and
guaranteed performance
Virtualisation Use Case
• Performance problems due to slow SAN
• Wanted to use Always-on replication with Private Cloud
Hybrid Cloud Data Platforms
57
Migrate Existing SQL Server Apps
58
Key Benefits
Low TCO for existing apps
New Migration Wizard
Familiar development tools
“We could just pick up our SQL
installs, move them over to Azure
VMs, and pick up where we left off."
Adam Salvo, Trek O
PT
ION
1
OP
TIO
N 2
VH
D
Data
base
P2V
V2V
Fast, easy
scalability
Cut IT hosting costs by
$15Kper month
SQL Server Develop & Test in the Cloud
59
Key Benefits
Reduce project overhead
Speed time to market
Secure, redundant source
code
“Telenor saved 70% on test,
development and demo that could be
turned off when finished to minimize
their capital outlays,”
Marius Pedersen, Telenor Group
70% savings
Ready in hours, not weeks
Noresource
limits
SQL Server Dev Tools On-Premises
Development Work Stations
SQL Server
On-Premises
Deploy
SQL Server in a
Windows Azure
Virtual Machine
Test
TFS in Windows Azure
On-premise network
Backup and DR in the Cloud
60
Key Benefits
Reduce CAPEX & OPEX
Low RTO disaster recovery
Speed global BI reporting
“Recovery times have dropped from
minutes to seconds… We’re seeing
almost no data loss.”
Recover in
seconds
Significant
costreductions
Windows Azure
Secondary replica
Run backups
Domain controller
Primaryreplica
Asynchronous commit
Run BI reports
VPN tunnel (Windows Azure Virtual Network)
Secondary replica
Synchronous commit
Create Hybrid Apps
61
Key Benefits
Reduce CAPEX & OPEX
Improve isolation of
internal assets
Greater global reach
“We now have the capacity to add a
lot more players and operators while
not losing any application
responsiveness”
Thomas Pullen, BetOnSoft
Improved availability & scalability
10xthe workload
with real-time
analytics
In-House Data Center
Azure-Hosted
Marketing Apps
Offloaded
BI Workloads
Metrics &
Monitoring Apps
Metrics
Databases
Viral Marketing
Databases
OLTP DB
AlwaysOn Primary
AlwaysOn Synchronous Replicas
Readable Secondaries
Windows Azure
Azure-Hosted
Marketing Apps
SQL Server 2012 AlwaysOn Cluster
Complete and consistent data platform
Explore the latest in SQL ServerVisit www.microsoft.com/sql to learn more about our latest innovations
Evaluate SQL Server 2014Get hands on – visit Microsoft’s TechNet evaluation center and
evaluate SQL Server 2014 today!
Evaluate Windows Server 2012 R2Get hands on – visit Microsoft’s TechNet evaluation center and
evaluate Windows Server 2102 R2 today!Microsoft Azure