4th industrial revolution

Rolando Rangel, DPSA, MCSEData Platform Solution ArchitectTwitter @[email protected]

Cortana Intelligence in the

4th Industrial Revolution

Some innovations fundamentallydisrupt the economic landscape1st Industrial Revolution

1760-1840 1870-1940 1950+

2nd Industrial Revolution 3rd Industrial Revolution

WATCH VIDEO

https://www.youtube.com/watch?v=YxmAEMmwXYU

In the 4th IR Global Businesses are being transformed by three trends

IntelligenceCloudBig Data

We now face a world of connected data

1985 1990 1995 2000 2005 2010 2015 2020

CLOUD/IOT

MOBILE

CONNECTEDDIGITALANALOG

Data is a key strategic asset

$1.7TAdditional business value captured by companies that are leaders in using data assets to their advantageSource: IDC, 2014

10%Percent of organizations expectedto have a highly profitable business unit specifically for productizing and commercializing their data by 2020Source: Gartner, 2016

The cloud offers limitless computing power

Speed EconomicsScale

Differentiate with intelligent solutions

• See and identify objects, people and actions

• Hear and recognize language

• Learn and develop greater understanding over time

• Perceive emotions and reactions

Cognitive Understanding

Intelligent Bots

• Complete tasks• Predict outcomes and make

adjustments

• Monitor and alert automatically

• Get things done in proactive, natural ways

1920 1930 1940 1950 1960 1970 1980 1990 2000 2010's 2020's

67Years25Years

15Years

The time to adapt to disruptions is shrinking

Source: BBC

A hundred years ago, the average lifespan of a company listed on the S&P 500 index was 67 years

75% of the S&P 500 will be new (not on the index today)25% of the S&P 500 willbe ones on the index today

In the 2020s…

Video

Hyper scale Infrastructure is the enabler100+ Datacenters across 34 Regions (22 Generally Available) Worldwide

Top 3 networks in the world 2.5x AWS, 7x Google DC Regions G Series – Largest VM in World, 32 cores, 448GB Ram, SSD…

OperationalAnnounced/Not Operational

Central US

Iowa

West USCaliforni

a

East USVirginia

US GovVirginia

North Central US

Illinois

US GovIowa

South Central US

Texas

Brazil SouthSao Paulo

State

West Europe

Netherlands

China North *

BeijingChina

South *Shanghai

Japan EastTokyo,

Saitama

Japan West

OsakaIndia South

Chennai East AsiaHong Kong

SE AsiaSingapo

re

Australia South East

Victoria

Australia EastNew South

Wales

India CentralPune

Canada EastQuebec City

Canada CentralToronto

India West

Mumbai

Germany North East **

Magdeburg

Germany Central **Frankfurt

North EuropeIreland

East US 2

Virginia

United KingdomRegions

United KingdomRegions

US DoD EastTBD

US DoD WestTBD

* Operated by 21Vianet ** Data Stewardship by Deutsche Telekom

2.2million kilometers offiber in our DCsDatacenter

Internet ExchangeTerrestrial NetworkSubsea Network

Edge Node

CDN Locations

Microsoft’s network is one of the two largest in the world(the other one is the US Government)

Platform Services

Infrastructure ServicesOS/Server Compute Storage

Datacenter Infrastructure (34 Regions, 22 Online)

Web and Mobile

Web AppsInfrastructure

Mobile AppsBackends

APIManagement

API AppsInfrastructure

Business ProcessAutomation-Logic Apps

Push Notifications-NotificationHubs

Media & CDNContent DeliveryNetwork (CDN)

Live & ODMedia Streaming–Media Services

IntegrationB2BIntegration-BizTalkServices

HybridConnections

Pub/SubQueuing-Service Bus

SimpleQueuing–StorageQueues

HybridOperations

Server DataBackup

Hybrid/IntelligentData Backup –StorSimple

DisasterRecovery–Azure Site Recovery

Bulk Data ImportAnd Export

Networking

Data

RelationalSQL Database

DocumentDatabase Service–DocumentDB

DistributedIn-MemoryCache–Redis Cache

AzureSearch

SimpleKey/Value Store–Storage Tables

DataWarehouse Azure AD

Health Monitoring

Virtual Network

DirectNetworkConnections

Disk based Object/File Storage

SharedStorage

SSD basedObject/File Storage

Virtual Servers

AD PrivilegedIdentity Management

Traffic Distribution

HTTP LoadBalancer

OperationalAnalytics

Services ComputeStatelessCompute–Cloud Services

ScheduledCompute Jobs –Batch

Virtual AppStreaming–RemoteApp

DistributedCompute–Service Fabric

Developer ServicesDevelopmentTools–Visual Studio

ApplicationInstrumentation–App Insight

Software DevelopmentKits –Azure SDK

Software LifecycleManagement–Visual StudioOnline

Containers DNS VPN Gateway

VM Load Balancer

Domain Join &Policy Management –Domain Services

Analytics & IoTBig DataAnalytics–HDInsight

PredictiveAnalytics–MachineLearning

Data StreamAnalytics

Data Pipelines–DataFactory

Device DataCollection–Event Hubs

MobileAnalytics–Mobile Engagement

Big Data Storage–DataLake

IoT DeviceManagement–IoT Hub

Data SourceManagement–Data Catalog

Security & Manageme

nt

User/Group Directory Store –Azure Active Directory

Multi-FactorAuthentication

Scheduled ServiceManagement –Automation

Service Creation& Configuration–Portal

Encryption KeyStore–Key Vault

Software/SolutionMarketplace

Pre-Build VM Images–VM Image Gallery& VM Depot

Identity Sign-Up and sign-in–Azure AD B2C

TaskScheduler

–App Gateway

–Traffic Manager

–Express Route

–Premium Storage

–Azure Files –BLOB Storage

–Virtual Machines

–Container Service

WATCH VIDEO

Cortana Intelligence Vehicle Telemetry

Demo

WATCH VIDEO

Cortana Intelligence SuiteTransform data into intelligent action

DataSources

Apps

Sensors & Devices

People

Data Intelligence

Cortana Intelligence

Action

Apps

Automated systems

Intelligence

Cortana

Cognitive ServicesBot Framework

Preconfigured Solutions

Dashboards and Visualizations

Machine Learning and Analytics

Big Data Store

Information Management

Cortana Intelligence SuiteTransform data into intelligent action

Easily turn data into intelligent action

Action

People

Automated Systems

Apps

Web

Mobile

Bots

Intelligence

Dashboards & Visualizations

Cortana

Bot Framework

Cognitive Services

Power BI


Event Hubs

Data Catalog

Data Factory


HDInsight (Hadoop and Spark)

Stream Analytics

Intelligence

Data Lake Analytics

Machine Learning

Big Data Stores

SQL Data Warehouse

Data Lake Store

Data Sources

Apps

Sensors and devices

Data

Easily turn data into intelligent action

Action

People

Automated Systems

Apps

Web

Mobile

Bots


Cortana

Bot Framework

Cognitive Services

Power BI


Event Hubs

Data Factory


Stream Analytics

Intelligence

Machine Learning

Big Data Stores

SQL Data Warehouse

Sensors and devices

Data

Opportunities exist across functional areas

Pay for performance

Operational efficiency

Smart buildings

Predictive maintenance

Supply chain management

Lifetime customer value

Personalized offers

Product recommendation

Fraud detection

Credit risk management

Customer Acquisition

Cross-sell and upsell

Loyalty programs

Marketing mix optimization

EXAMPLE SOLUTIONS

Sales and marketing

Finance and risk

Customer and channel

Operations and workforce

Dartmouth-Hitchcock Demo + Video

https://youtu.be/x1XARd8Xo7M

Compose and orchestrate data services at scale

INGESTSQL

<>

SQL

DATA SOURCES

{ }

SQL

• Create, schedule, orchestrate, and manage data pipelines• Visualize data lineage• Connect to on-premises and cloud data sources• Monitor data pipeline health

• Automate cloud resource management• Move relational data for Hadoop processing• Transform with Hive, Pig, or custom code


Event Hubs

Data Catalog

Data Factory

Get more value from your enterprise data assets


Event Hubs

Data Catalog

Data Factory

• Spend less time looking for data, and more time getting value from it

• Register enterprise data sources, discover data assets and unlock their potential, and capture tribal knowledge to make data understandable

• Bridge the gap between IT and the business, allowing everyone to contribute their insights, tags, and descriptions

• Intuitive search and filtering to understand the data sources and their purpose

• Let your data live where you want; connect using tools you choose

• Integrate into existing tools and processes with open REST APIs

Ingest events from websites, apps and devices at cloud scale

• Log millions of events per second in near real time• Connect devices using flexible authorization and throttling• Use time-based event buffering• Get a managed service with elastic scale

• Get a managed service with elastic scale• Reach a broad set of platforms using native client

libraries• Pluggable adapters for other cloud services

AzureAPI

Management

Backend Services

Data


Event Hubs

Data Catalog

Data Factory

Data sources

Apps

Sensors and devices

Event Hubs

SQL Database Machine Learning

HDInsightStorage

Power BIStream Analytics

Big Data Stores

Big Data Stores

SQL Data Warehouse

Data Lake Store

Data Sources

Apps

Sensors and devices

Data


Event Hubs

Data Catalog

Data Factory

A hyper-scale repository for big data analytics workloads

• A Hadoop Distributed File System for the cloud• No fixed limits on file size• No fixed limits on account size• Unstructured and structured data in their native format

• Massive throughput to increase analytic performance

• High durability, availability, and reliability• Azure Active Directory access control

LOB Applications

SocialDevices

Clickstream

Sensors

Video

Web

Relational

HDInsight

ADL Analytics

Machine Learning

Spark

RADL Store

Big Data Stores

SQL Data Warehouse

Data Lake Store

Elastic data warehouse as a service with enterprise-class features

• Petabyte scale with massively parallel processing• Independent scaling of compute and storage—in seconds• Transact-SQL queries across relational and non-relational

data

• Full enterprise-class SQL Server experience• Works seamlessly with Power BI, Machine Learning,

HDInsight, and Data Factory

Power BI

App Service SQL DatabaseSQL Data Warehouse

Machine Learning

Hadoop

Intelligent App

Big Data Stores

SQL Data Warehouse

Data Lake Store


Big Data Stores

SQL Data Warehouse

Data Lake Store

Data Sources

Apps

Sensors and devices

Data Intelligence


Event Hubs

Data Catalog

Data Factory



Stream Analytics

Data Lake Analytics

Machine Learning

Easily build, deploy, and share predictive analytics solutions

• Simple, scalable, cutting edge. A fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions.

• Deploy in minutes. Azure Machine Learning means business. You can deploy your model into production as a web service that can be called from any device, anywhere and that can use any data source.

• Publish, share, monetize. Share your solution with the world in the Gallery or on the Azure Marketplace.



Stream Analytics

Data Lake Analytics

Machine Learning

Big data analytics made easy

• Analyze data of any kind and size• Develop faster, debug and optimize smarter• Interactively explore patterns in your data• No learning curve—use U-SQL, Spark, Hive, HBase and

Storm

• Managed and supported with an enterprise-grade SLA• Dynamically scales to match your business priorities• Enterprise-grade security with Azure Active Directory• Built on YARN, designed for the cloud

Data Lake Analytics

SQL DW SQL DB Storage BlobsData Lake Store SQL DB in a VM



Stream Analytics

Data Lake Analytics

Machine Learning

Comprehensive set of managed Apache big data projects

• Scale to petabytes on demand• Process unstructured and semi-structured data• Develop in Java, .NET, and more• Skip buying and maintaining hardware

• Deploy in Windows or Linux• Spin up an Apache Hadoop cluster in minutes• Visualize your Hadoop data in Excel• Easily integrate on-premises Hadoop clusters

Core Engine

BatchMap Reduce

ScriptPig

SQLHive

NoSQLHBase

StreamingStorm

In-MemorySpark



Stream Analytics

Data Lake Analytics

Machine Learning



Stream Analytics

Data Lake Analytics

Machine Learning

Real-time stream processing in the cloud

• Perform real-time analytics for your Internet of Things solutions

• Stream millions of events per second• Get mission-critical reliability and performance with

predictable results

• Create real-time dashboards and alerts over data from devices and applications

• Correlate across multiple streams of data• Use familiar SQL-based language for rapid

development

Event Hubs

Blob Storage

Stream Analytics

SQL Database

Event Hubs

Power BI

Blob Storage

Table Storage

Intelligence

Intelligence

Cortana

Bot Framework

Cognitive Services

Big Data Stores

SQL Data Warehouse

Data Lake Store

Data Sources

Apps

Sensors and devices

Data


Event Hubs

Data Catalog

Data Factory



Stream Analytics

Data Lake Analytics

Machine Learning

Build applications that understand people

SpeechVision KnowledgeLanguage Search

• Faces, images, emotion recognition and video intelligence• Spoken language processing, speaker recognition, custom speech

recognition• Natural language processing, sentiment and topics analysis, spelling

errors

• Complex tasks processing, knowledge exploration, intelligent recommendations

• Bing engine capabilities for Web, Autosuggest, Image, Video and News

Intelligence

Cortana

Bot Framework

Cognitive Services

Language Understanding Intelligent Service

Bing Auto Suggest API

Speaker Recognition

Speech

CRIS

Text Analytics

Bing Speller

Web Language Model

Linguistic Analysis

Academic Knowledge

Entity Linking Service

Knowledge Exploration Service

Recommendations

Bing Search API

Bing Image Search API

Bing Video Search API

Bing News Search API

Computer Vision

Face

Emotion

Video

Your bots – wherever your users converse

Intelligence

Cortana

Bot Framework

Cognitive Services

• Bot Connector Service: A service to register your bot, configure channels and publish to the Bot Directory. Connect your bot(s) seamlessly to text/sms, Office 365 mail, Skype, Slack, Twitter, and more.

• Bot Builder SDK: An open source SDK hosted on GitHub. Everything you need to build great dialogs within your Node.js or C# bot

• Bot Directory: A public directory of bots registered through the Bot Connector Service. Discover, try, and add bots to conversation experiences

Get things done in more helpful, proactive and natural ways

Here are some of the things I can help you with…

Cortana forConsumers (today)

With the CortanaIntelligence Suite

Answers Public reference data answers – “How far is it from Los Angeles to San Francisco?”

Answers from organizational data in Power BI“What were our biggest deals that closed

last month?”

Predictions Event predictions – “Who do you think is going to win the Germany Italy game?”

Integration with prediction solutions“Which of our customers are most likely to churn in the next quarter?”

Monitoring & Alerts Flight status, traffic conditions, changes in weather, …

Monitoring KPIs and preemptive alerting“Alert me if this customer ever has a 90% chance of churn in the next 30 days”

Task Completion Setting reminders, scheduling meetings, getting directions, …

Line of business process integrationAssistance with expense report submission on-time within policy

Intelligence

Cortana

Bot Framework

Cognitive Services



Power BI

IntelligenceInformation Management

Big Data Stores Machine Learning and Analytics

CortanaEvent HubsHDInsight (Hadoop and Spark)

Stream Analytics

Data Intelligence

Bot Framework

SQL Data WarehouseData Catalog Data Lake

Analytics

Data Factory Machine LearningData Lake

StoreCognitive Services

Data Sources

Apps

Sensors and devices

Data

Keep a pulse on your business with live, interactive dashboards

Event Hubs

Stream Analytics

Machine Learning

Storage

SQL databaseHDInsight

Power BI

Power BI

• Analytics for everyone, even non-data experts • Your whole business on one dashboard• Create stunning, interactive reports

• Drive consistent analysis across your organization• Embed visuals in your applications• Get real-time alerts when things change

Power BI


Power BI

Transform data into intelligent actionIntelligence



Big Data Stores Machine Learning and Analytics

CortanaEvent HubsHDInsight (Hadoop and Spark)

Stream Analytics

Data Intelligence Action

People

Automated

Systems

Apps

Web

Mobile

Bots

Bot Framework

SQL Data WarehouseData Catalog Data Lake

Analytics

Data Factory Machine LearningData Lake

StoreCognitive Services

Power BI

Data Sources

Apps

Sensors and devices

Data

Demo: Vehicle health and driving behavior patterns

Turning telemetry data from vehicles into insight75%of the cars shipped globally

by 2020 will be built with the necessary hardware to connect to the Internet

So what can we do with that data? Vehicle diagnosticWhat parts need maintenance first on all Ford F-150’s sold?

Usage-based insuranceAre there any vehicles below the insurance price break threshold?

Fleet managementShow me the location of all vehicles within 50mi of my location

Roadside assistance

Eco-drivingHow does the reported MPG compare to actual MPG?

Engine performance remappingWhat parts of the engine are not meeting requirements?

Engine emission controlWhat is the emissions status of vehicle B204?

Example of Cortana Intelligence Suite in actionData Sources Ingest Prepare Analyze Publish Consume

Sensors and devices

StreamAnalytics Machine

LearningCortana

Businessapps

SQL Data Warehouse

DiagnosticStreaming

Power BI

Enterprise data sources

Azure Blob storage

Data Factory: Move data, orchestrate, schedule and monitor

Data Catalog: Register, annotate, understand, discover data sets

HDInsight

EventHubs

HDInsight

MachineLearning

StreamAnalytics

With Cortana Intelligence, better predict needs and trends

Vehicle diagnosticThe front brakes are needing to be serviced sooner than expected

Usage-based insurance3 vehicles have daily mileagethat qualify them for reduced rates

Fleet management24 vehicles are shown on a map, showing status

Roadside assistanceTow truck is on its way to vehicle B204

Eco-driving14/15 vehicles meet standards and 1 is scheduledfor maintenance

Engine performanceTemperature is beyond the ideal range for 13 vehicles

Engine emission controlVehicle B204 is driving in eco-mode 78% of the time

Customer stories

Explore new business opportunitiesThyssenKrupp Elevator develops newservices capabilities

“We wanted to go beyond the industry standard of preventative maintenance, to offer predictive

andeven preemptive maintenance.”

Andreas SchierenbeckCEO, ThyssenKrupp Elevator

Scenario Variable elevator uptime | The need for competitive differentiation

SolutionSeveral Azure technologies, including Machine Learning, that enable monitoring via a real-time dashboard and that instruct technicians on optimal maintenance activities through dynamic predictive models

Result

• Increased elevator uptime• Reduced costs for ThyssenKrupp and its

customers• Rich, real-time data visualization and awareness

of issues• The ability offer predictive maintenance services

for customers around the globe

Appendix

4th industrial revolution

Documents