The Revenge of the Helmholtz Machines

Advances in Machine LearningMax Welling

Overview

Deep Learning

Causality

Reinforcement Learning

Privacy

Examples AI

Conclusion

DeepDream

From Computer Science to Deep Learning

Computer ScienceData Science

Artificial Intelligence

Machine Learning

Deep Learning

3econometry, mathematics

Explosive Growth

Moore's LawBig DataDeep Learning

4

Types of LearningSupervised learningLearning from labeled dataUnsupervised learningLearning from unlabeled dataReinforcement learningLearning from interactions and rewards from the world.

5

Important New ML Developments6Deep Learning:powerful supervised predictors for high sampling rate signals.examples: speech recognition, image analysis.

Causal discovery:prediciting causal relations between variables from observational data.examples: predictive maintenance, genomics

Reinforcement learning:learning from interacting with the worldexamples: robotics, search engines, alphaGO

Privacy preserving machine learning:learning from data such the privacy of individuals is guaranteed.examples: patient records, customer intelligence data

Deep Learning

GPUs

Databillions of parameters7

Convolutional Neural Nets

Visual Object Classification

Annual "Image Net Challenge"human performance9

CNN in Action10

(Andreiy Karpathy's blog)

Example in Healthcare:Detection, segmentation, classification

Quality Control

criticalminor12Detect, segment and classify steel defects

Deep Learning & Art13

Gatys, Ecker, Bethge (arXiv 2015)Extract style form paining and render a photo in that style

Fooling Neural Networks20

This is bad news when you need to make life or death decisions

Know when you don't know: uncertainty quantification!

Interpretation & Visualization

L. Zintgraf, T. Cohen & Welling 2016

HIV induced dimentia predictionpenguin predictionHow do we explain a prediction to a human? how do we anaylize an accident made by a self-driving car?How do we explain the diagnosis of Alzheimer's disease from an deep net?

Caption Generation

(Andrej Karpathy & Li Fei-Fei @ Stanford)Upload a pictureAlgorithm synthesises caption

Causality

23

Example:Insurance fees for black cars are higherMental disabilities in babies cause difficults births...

Challenge: discovering causal relations without interventions

Predictive Maintenance"Predictive maintenance" : Predict if and when a part will fail.To fix the problem: predict what is the cause of the failure.

24

Interacting with the World

Recommenders

The Argument For Private DataData is becoming increasingly important as the "oil of our economy".The Googles and Facebooks are becoming "data-oligarchies" Private data in the hands of a few large corporations can be dangerous

How can we democratize data, so everyone can benefit from it?How can we make sure data science is privacy preserving?

Re-Identifying Anonymized Data

MIT graduate student Latanya Sweeney was able to re-identify Massachusetts Governor William Weld using some simple tactics and a voter list.

28

Re-Identifying Anonymized DataA five-digit zip code, date of birth, and gender are sufficient to identify an individual uniquely about 87% of the time.

NameZipcodeAgeSexAlice4767729FBob4798365MCarol4767722FDan4753223MEllen4678943F

Voter registration data

QIDSAZipcodeAgeSexDisease4767729FOvarian Cancer4760222FOvarian Cancer4767827MProstate Cancer4790543MFlu4790952FHeart Disease4790647MHeart Disease

IDNameAliceBettyCharlesDavidEmilyFred

Microdata(Table by Vitaly Shmatikov)29

Differential PrivacyDifferential privacy guarantees that any answer to a query will be only slightly different for any individual if his/her data is in or out of the database

Cynthia Dwork

DP adds just the right amount of noise to a query to obfuscate private information.

Machine Translation

(Microsoft)31Understand speechtranslate languagesynthesize speech

Transport

32In 10 years nobody will need a driver's license.In 10 years we will not need any (physical) shops anymore.

Expert Systems

Natural Language UnderstandingDigital customer service assistent (Q&A)Digital doctors (AskADoctor)Digital lawyers Digital priestDigital professor ?

Machine Learning

33Information from InternetBusiness value: expensive employer is replaced by cheap AI system

Customer Intelligence

Google SearchGoogle ChromeGoogle+ Google MapsGoogle MailGoogle Now.Google PicasaGoogle Health?Google Car ?

User Profile (Mark Zuckerberg: "theory of mind")

34DATA

Conclusions35Big Data, Big Brother?

smart cityprofiling

autonomous weaponsLet's use Data & AI Responsibly!