s e e d / / s e a r c h f o r e x t r a o r d i n a r y e ... · s e e d / / s e a r c h f o r e x...

65
S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N

Upload: others

Post on 18-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N

Page 2: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

Deep Learning in Games

Martin Singh-Blom@singhblom

Page 3: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

What is Machine Learning?

S E E D // Introduction

Page 4: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Introduction

What is Artificial Intelligence?

Page 5: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

or ...

S E E D // Introduction

Page 6: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

Guess the function!

S E E D // Introduction

Page 7: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f (2) = 4

S E E D // Introduction

Page 8: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f (8) = 16

S E E D // Introduction

Page 9: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f (x) = 2x

S E E D // Introduction

Page 10: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

How does the machine guess?

S E E D // Middle

Page 11: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

It learns from the data.

S E E D // Middle

Page 12: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Middle

(That’s why we call it machine learning!)

It learns from the data.

Page 13: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // How do the machines learn?

x

y

Guess a straight line!

Page 14: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // How do the machines learn?

x

y

Guess a straight line!

f (x) = 9.5 – 0.3x

Page 15: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // How do the machines learn?

x

y

Guess a straight line!

f (x) = 9.5 – 0.3x

Page 16: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // How do the machines learn?

x

y

Guess a straight line!

f (x) = 0.3 + 0.6x

Page 17: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // How do the machines learn?

x

y

Guess a straight line!

f (x) = 0.3 + 0.6x

Page 18: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // How do the machines learn?

Guess a straight line!

f (x) = 0.3 + 0.6x

f (x) = 9.5 – 0.3x

Page 19: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // How do the machines learn?

1. Data – f ( x ) = y pairs.2. A way to tell the machine how bad a guess is.3. Some idea of what kind of function the machine is allowed to guess –

straight line? Curve? Something stranger?

That is all there is to it!

Page 20: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // How do the machines learn?

x

y

Guess a straight line!

Page 21: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // How do the machines learn?

Guess a straight line!

Page 22: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

What is Deep Learning?

S E E D // Deep Learning

Page 23: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

What are Artificial Neural Networks?

S E E D // Deep Learning

Page 24: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f

S E E D // Deep learning

Page 25: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Deep Learning

Page 26: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Deep learning

Page 27: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) = 8

S E E D // Deep learning

Page 28: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) = 8

S E E D // Deep learning

Page 29: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) = 5

S E E D // Deep learning

Page 30: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) = 0

S E E D // Deep learning

Page 31: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) = 6

S E E D // Deep learning

Page 32: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Deep learning

Page 33: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Deep learning

Page 34: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( )

S E E D // Deep learning

Page 35: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) = cat

S E E D // Deep learning

Page 36: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

”I saw it in a theater once and

it was great.

It was very… I don’t know,

a little dark.

I like the psychological

effects and the way it

portrays the characters.”

f ( ) =”Have you seen

Suicide Squad?”

S E E D // Deep learning

Page 37: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) = ”A person flying a kite

on a beach”

S E E D // Deep learning

Page 38: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) =”A coffee, please.”

S E E D // Deep learning

Page 39: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) =”A coffee, please.”

S E E D // Deep learning

Page 40: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

f ( ) =

S E E D // Deep learning

Page 41: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

Agents in Games

S E E D // Agents in Games

Page 42: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Agents in Games

Page 43: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Agents in Games

Page 44: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Agents in Games

f ( ) =

Page 45: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games
Page 46: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // TOPIC

Page 47: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games
Page 48: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Deep learning

Page 49: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

AlphaGo

Page 50: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

Animation

S E E D // Animation

Page 51: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Animation

Page 52: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Animation

f ( ) =

Page 53: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion, Karras et al., 2017, NVIDIA

Page 54: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

Learn all the things!

S E E D // All the things!

Page 55: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // All the things!

f ( ) =

Page 56: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

Physics

Physics Forests: Real-time Fluid Simulation using Machine Learning, Ladicky et al., 2015, www.physicsforests.com

Page 57: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // All the things!

Page 58: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // All the things!

f ( ) =

Page 59: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

Realtime Multi-Person 2D Human Pose Estimation using Part Affinity Fields, Cao et al., 2017

Page 60: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // All the things!

f ( ) =

Page 61: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

Phase-Functioned Neural Networks for Character Control, Holden, 2017

Page 62: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // All the things!

f ( ) =

f ( ) = 8

f ( ) =

f ( ) =f ( ) =

f ( ) = cat

f ( ) =

”I saw it in a theater once and

it was great.

It was very… I don’t know,

a little dark.

I like the psychological

effects and the way it

portrays the characters.”

”Have you seen

Suicide Squad?”

f ( ) = ”A coffee, please.”

f ( ) =”A coffee, please.”

Page 63: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Final remark

Instead of programming – showing

Same method for every problem

Greatest paradigm change in computing since transistors

It’s all just function guessing – or – A new paradigm for computing

Page 64: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

FIN

Page 65: S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E ... · S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N. Deep Learning in Games

S E E D // Thank you

StockholmHector Anadon Leon

Jorge del Val Santos

Mattias Teye

Anastasia Opara

Camilo Gordillo

Joakim Bergdahl

Jack Harmer

Linus Gisslén

Henrik Johansson

Paul Greveson

Niklas Nummelin

Ken Brown

Mark Kyobe

Effeli Holst

Jenna Frisk

Ida Winterhaven

Tomasz Stachowiak

Colin Barré-Brisebois

Graham Wihlidal

Lars Sjöström

Daniel Lundin

MontrealMathieu Lamarre

Etienne Danvoye

Los AngelesCarlos Ochoa

JP Lewis

Binh Le

Henrik Halen

John Courte

Special thank you toMagnus Nordin

Johan Andersson