deep learning – part ii - anyline · deep learning – part ii . title: 20160224 computer vision...

Visual Computing – Data Analysis – Consulting rene@radiology-explorer.com

René Donner

Deep Learning – Part II

René Donner Deep Learning

Overview

2

Deep Learning recap

How to classify images

Convolutional Neural Networks (CNNs)

Classifying MNIST with CNNs

René Donner Deep Learning

Image recognition

3

Google Research Blog

René Donner Deep Learning

Scene labeling

4

http://www.purdue.edu/newsroom/releases/2014/Q1/smartphone-to-become-smarter-with-deep-learning-innovation.html

René Donner Deep Learning

Text recognition

5

http://www.pyimagesearch.com/2014/09/22/getting-started-deep-learning-python/

Large-Scale Deep Learning for Intelligent Computer Systems, Jeff Dean, Google, BayLearn 2015

How does it work?

René Donner Deep Learning

Deep learning

7

http://theanalyticsstore.ie/deep-learning/

René Donner Deep Learning

Visualization

8

1. Layer

higher Layers

Emergence of Object-Selective Features in Unsupervised Feature Learning, Adam Coates, NIPS 2012

René Donner Deep Learning

Deep learning

9

How does it work?

http://theanalyticsstore.ie/deep-learning/ http://stats.stackexchange.com/questions/114385/what-is-the-difference-between-convolutional-neural-networks-restricted-boltzma

Getting started with DL

René Donner Deep Learning

Frameworks

11

Caffehttp://caffe.berkeleyvision.org/Plain text filesFastest CNN, GPU

Kerashttps://github.com/fchollet/kerasPython, on top of Theano

TensorFlowhttp://tensorflow.org/Python, by Google

MXNethttps://github.com/dmlc/mxnetPython, R, Julia

Slid

e fro

m c

affe

tuto

rial

René Donner Deep Learning

Tensorflow

12

General optimization framework

C++ / PythonCPU / GPU / (Multi-GPU)

Construct / Execution

René Donner Deep Learning

MNIST

13

René Donner Deep Learning

MNIST

14

https://www.tensorflow.org/versions/r0.7/tutorials/mnist/beginners/index.html#mnist-for-ml-beginners

René Donner Deep Learning

Activation functions

15

http://gforge.se/2015/06/benchmarking-relu-and-prelu/

Rectified linear unit

Tanh

http://blog.otoro.net/2015/03/28/neural-slime-volleyball/

René Donner Deep Learning

MNIST - Demo

16

René Donner Deep Learning

MNIST

17

http://deeplearning4j.org/rbm-mnist-tutorial.html

Accuracy: 91%

Convolutional NN

René Donner Deep Learning

Convolution

20

https://devblogs.nvidia.com/parallelforall/accelerate-machine-learning-cudnn-deep-neural-network-library/https://developer.apple.com/library/ios/documentation/Performance/Conceptual/vImage/ConvolutionOperations/ConvolutionOperations.html

René Donner Deep Learning

Convolution

21

https://sites.google.com/site/shahriarinia/home/ai/machine-learning/neural-networks/deep-learning/theano-mnist/3-convolutional-neural-network-lenet

Accuracy: ~99.2%

Visual Computing – Data Analysis – Consulting rene@radiology-explorer.com

René Donner

Deep Learning – Part II