Microsoft Developer Day

Microsoft Developer Day

Dr Graham Williams

Director of Data Science, Pacific Asia,Data Group, Cloud and Enterprise

Data Scientists

Transform Data into Information

Data Scientists

Information into Knowledge using Machine Learning

Data Scientists

Through Wisdom turn that Knowledge into Intelligent Action

Source: http://prlab.tudelft.nl/content/pattern-recognition

X2

X1

Class A

Class BClassifier

Training set Representation Generalization

Feature space

Machine Learning: Data to Knowledge

RegressionClassification AnomalyDetection

Recommenders

-0.5 -0.4 -0.3 -0.2 -0.1 0 0.1 0.2

-0.6

-0.4

-0.2

0

0.2

0.4

error

error

3210-1-2-3-4

-3

-2

-1

0

1

2

3

4

Machine Learning

From collections of historic data we extract knowledge and represent it as models used to describe, predict and to prescribe actions.

Data Scientist: Skills and Process

Source: Dataconomy

DomainKnowledge

Communications

Presentation

Inquisitiveness

ProblemSolving

BusinessAnalysis

BusinessStrategy

BusinessValue

Free software environment and language for statistical computing and graphics

Available on UNIX platforms, Windows and MacOS.

R-Core team of 20 leading international computational statisticians

Over 7000 packages from users/statisticians world wide.

Vendor independent and future proof.

Data Scientist’s Toolkit: R Language

• “I think it addresses a niche market for high-end data analysts that want free, readily available code. We have customers who build engines for aircraft. I am happy they are not using freeware when I get on a jet.”

The New York Times, January 2009 quoting marketing director of a data science vendor on competition from Open Source R.

Data Scientist’s Toolkit: R Language

Traditional Vendor View of Open Source R

Data Scientist’s Toolkit: R LanguageAustralian Department of Immigration: Data Scientists deliver sophisticated risk models to protect Australia's borders. McCairns says “the department bought $15million worth of software---but it's gathering dust.'‘

Vendor responded: “R in a productionsystem, it can be scary … has severelimitations …”

Every Australian Tax Returnlodged is risk scored by an R model to decide on what action is to be taken or what advise to provide to the tax payer.

http://www.itnews.com.au/news/what-immigration-did-with-just-1m-and-open-source-software-390687

Data Science Platform – End to End

Transform your data into intelligent action

• Any Data - relational, non-relational, text, images, video, audio, time series

• Any Analytics – ETL, transactions, big data, machine learning, visualization

• Any Scale – small data, big data

• Any Speed – batch, streaming, interactive

• Any Location – on-premise, cloud, hybrid

• Any Source – best of open source, best in class enterprise grade software

SQL 2016

ServerAzure DBAzure DW

SQL server R servicesOn-prem and cloud(Windows, Linux)

Cortana Intelligence Suite

Azure Big Data and Analytics Hadoop, Data Lake, Machine

learning, PowerBI, Data Factory, Streaming,

Perceptual IntelligenceOn-prem connectivity

Microsoft R server

Analytics Hadoop Teradata

On-prem and cloud(Windows, Linux)

Data and Analytics – 3 PillarsDelivering our vision of an end-to-end platform for the data scientists to develop intelligent applications driven by data analytics.

Cortana Intelligence Suite

Continuous enhancements

SQL Server 2016the first cloud-born release

Incorporating R forin database advanced analytics

Hybrid cloud

Mission critical OLTP

Cloud-first approach

Code Portability Across Platforms

Azure VMAzure HDI, SparkAzure MLPowerBIOffice 365…

LinuxWindows

Teradata, SQL Server

HortonworksClouderaMapR

In the Cloud

Workstations & Servers

EDW

Hadoop

DistributedR

ScaleR

ConnectR

DevelopR

Microsoft R Server: Write Once, Deploy Anywhere

• Microsoft R Open• Microsoft R Server• SQL Server 2016 R Services• R Tools for Visual Studio (RTVS)• Data Ingestion to Cortana Intelligence Suite• Azure Machine Learning and R• Data Visualization using Power BI Dashboard

Demonstration

Visit:https://azure.microsoft.com/en-us/services/machine-learning/

Empowered for Data ScienceBegin a journey to turn Data into Intelligent Action

Cortana Intelligence Resources and Competition

The Cortana Intelligence Gallery enables our growing community of developers and data scientists to share their analytics solutions.

Join a competition to help advance the state of the art in interpreting brain signals and to help patients to have a chance at a healthier life using real data from patients undergoing neurosurgery.

Cortana Intelligence Galleryhttps://gallery.cortanaintelligence.com/

Cortana Intelligence Competitionhttp://aka.ms/decodesignals

Azure Portalhttp://azure.microsoft.com

Azure Updateshttp://azure.microsoft.com/blog/

Thank youBlog:

https://blogs.technet.microsoft.com/machinelearning

Follow us online

Microsoft Developer Day