Microsoft’s IoT Platform….. why it matters to the data platform
Gary Hope Data Platform Technologist Microsoft South Africa
Large datavolumes
Multiple data types
Real-time data creation
User expectations
MobilityHardware and storage economics
Data Platform Tipping Points
Is IoT even a new thing?
Command and control scenarios have much in common with some parts of IoT
But falling hardware costs, cloud services and relatively ubiquitous communications do enable new approaches and applications
Depending on who you ask, IoT is either:
Nothing new
A unicorn
1
2
Magic, and will soon change everything.
We’ve been doing this for 40 years
Cloud Based IoT Solutions
Three parts of an IoT solution
1 Device connectivity & management
2 Analytics & operationalized insights
3 Presentation & business connectivity
Easy to provision, use and manage
Pay as you go, scale as you need
Global reach, hyper scale
End to end security & privacy
Azure IoT
Windows 10 IoT Core preview available for Minnowboard Max and Raspberry Pi 2
www.windowsondevices.com
Field Gateway
Device Connectivity & Management
IoT Device & Cloud PatternsD
evi
ces
RTO
S, L
inux,
Win
dow
s, A
ndro
id, i
OS
Cloud Gateway
Event Hubs
Field Gateway
Protocol Adaptation
Event Hubs• High scale telemetry ingestion
service• HTTP/AMQP protocol support• Each Event Hub supports
• 1 million publishers• 1GB/s ingress
• Generally available worldwide• 18 Billion messages per day• 60+ TB ingested per day
Field Gateway
Device Connectivity & Management
IoT Device & Cloud PatternsD
evi
ces
RTO
S, L
inux,
Win
dow
s, A
ndro
id, i
OS
Cloud Gateway
Event Hubs
Field Gateway
Protocol Adaptation
Additional IoT Needs• Command & control• Device identity• Device registry• Device management
Coming with the Azure IoT Suite…
Field Gateway
Device Connectivity & Management
IoT Device & Cloud PatternsD
evi
ces
RTO
S, L
inux,
Win
dow
s, A
ndro
id, i
OS
Protocol Adaptation
Cloud Gateway
Event Hubs&IoT Hub
Field Gateway
Protocol Adaptation
IoT Hub• Capability of the Azure IoT Suite• Bi-directional device <-> cloud • Up to 10 million devices• Telemetry ingestion• Command & control• Device registry & identity• Device Management• HTTP/AMQP• Extensible protocol support / MQTT
Field Gateway
Device Connectivity & Management
IoT Device & Cloud PatternsD
evi
ces
RTO
S, L
inux,
Win
dow
s, A
ndro
id, i
OS
Protocol Adaptation
Cloud Gateway
Event Hubs&IoT Hub
Field Gateway
Protocol Adaptation
Cross-Platform Device Support• Open source “agent” framework• Simple, secure device <-> cloud
connectivity & management• RTOS, Linux, Windows, Android, iOS• Easy to use, not required
Cross Platform C Code
OS Abstraction Layer / OS Bindings
C API .NET API Java API Javascript API
Field Gateway
Device Connectivity & Management
Analytics & Operationalized Insights
IoT Device & Cloud PatternsD
evi
ces
RTO
S, L
inux,
Win
dow
s, A
ndro
id, i
OS
Protocol Adaptation
Cloud Gateway
Event Hubs&IoT Hub
Field Gateway
Protocol Adaptation
Operationalize your insightsSQL
Field Gateway
Device Connectivity & Management
Analytics & Operationalized Insights
IoT Device & Cloud PatternsD
evi
ces
RTO
S, L
inux,
Win
dow
s, A
ndro
id, i
OS
Protocol Adaptation
Batch Analytics & Visualizations
Azure HDInsight, AzureML, Power BI,
Azure Data Factory
Hot Path Analytics
Azure Stream Analytics, Azure HDInsight Storm
Hot Path Business Logic
Service Fabric & Actor Framework
Cloud Gateway
Event Hubs&IoT Hub
Field Gateway
Protocol Adaptation
Find insights to• Power new services• Improve your
“things”
Operationalize your insights in real timeIoT Scale Object Models & Business Logic
PresentTime of interest
Web Analytics – Ad placement,Financial Services, Smart Grids,
Monitoring – Systems mgmt, Health Care, Manufacturing, etc.
years months days hrs min sec
$ value of analytics
Forecasting in Enterprises
Historical Trend Analysis
The Value of Timely Analytics
Current Products for Analytics
Traditional DW Analytics
Active DW analytics
Present
Time of interest
100000
10000
1000
100
Custom-built solutions that carry huge development and customization costs
Facts/sec.
years months days hrs min sec
Load time in ETLET time in ETL
Field Gateway
Device Connectivity & Management
Analytics & Operationalized Insights
Presentation & Business Connectivity
IoT Device & Cloud PatternsD
evi
ces
RTO
S, L
inux,
Win
dow
s, A
ndro
id, i
OS
Protocol Adaptation
Batch Analytics & Visualizations
Azure HDInsight, AzureML, Power BI,
Azure Data Factory
Hot Path Analytics
Azure Stream Analytics, Azure HDInsight Storm
Presentation &
Business Connectivity
App Service, Websites
Dynamics, BizTalk Services, Notification Hubs
Hot Path Business Logic
Service Fabric & Actor Framework
Cloud Gateway
Event Hubs&IoT Hub
Field Gateway
Protocol Adaptation
Microsoft Azure IoT services
Devices Device Connectivity Storage Analytics Presentation & Action
Event Hubs SQL Database Machine Learning App Service
Service Bus Table/Blob Storage Stream Analytics Power BI
External Data Sources DocumentDB HDInsight Notification Hubs
External Data Sources Data Factory Mobile Services
BizTalk Services
{ }