Upload File

convolutional neural networks in matlabsanum.github.io/2019/img/cnntalkmatlab.pdf · convolutional...

  • Home
  • Documents
  • Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application
26
Convolutional Neural Networks in MATLAB 28 March 2019

Upload: others

Post on 16-Oct-2020

7 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Convolutional Neural Networks in MATLAB

28 March 2019

Page 2: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Welcome

• Danielle Winter

Application Engineer – AI and Data Science in Engineering

• Adri van Nieuwkerk

Business Development Consultant - Education

Copyright 2018 Opti-Num Solutions (Pty) Ltd 2

Page 3: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Why are we here today?

Copyright 2018 Opti-Num Solutions (Pty) Ltd 3

Shell

Musashi Seimitsu Industry Co.,Ltd.

Page 4: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Why are we here today?

• Feature extraction is painful

Copyright 2018 Opti-Num Solutions (Pty) Ltd 4

Page 5: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Why are we here today?

Copyright 2018 Opti-Num Solutions (Pty) Ltd 5

• Deep learning is getting more accurate

Page 6: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Why are we here today?

Copyright 2018 Opti-Num Solutions (Pty) Ltd 6

• Deep Learning is Cool!

Page 7: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Agenda

• Introduction to concepts

– Deep Learning checklist

– Convolutional Neural Networks and layer architecture

• CNNs for non-image applications

• Some challenges and how to mitigate them

• Take Aways

Copyright 2018 Opti-Num Solutions (Pty) Ltd 7

Page 8: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Agenda

• Introduction to concepts

– Deep Learning checklist

– Convolutional Neural Networks and layer architecture

• CNNs for non-image applications

• Some challenges and how to mitigate them

• Take Aways

Copyright 2018 Opti-Num Solutions (Pty) Ltd 8

Page 9: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Deep Learning Workflow

Copyright 2018 Opti-Num Solutions (Pty) Ltd 9

validation data

testing data

DataNetwork Architecture• Pretrained• Transfer Learning• From Scratch

Training Options• Algorithm• Learning Rate• Mini-Batch• Validation• Environment

Data

Training options

Network Layers

Deep Learning Checklist

Car Tree Dog Cat Bus Duck

Page 10: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Deep Learning Workflow

Copyright 2018 Opti-Num Solutions (Pty) Ltd 10

validation data testing data

Page 11: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Convolutional Neural Networks

Copyright 2018 Opti-Num Solutions (Pty) Ltd 11

Page 12: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

CNN Architecture – Input Layer

Copyright 2018 Opti-Num Solutions (Pty) Ltd 12

imageInputLayer([5,5])Image size: m*n*a

Colour image: a = 3Multispectral image: a = many

Page 13: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

CNN Architecture – Middle Layers

• Convolution of spatial filters with input image

Copyright 2018 Opti-Num Solutions (Pty) Ltd 13

convolution2dLayer([2,2],50)

Page 14: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

CNN Architecture – Middle Layers

• Convolution of spatial filters with input image

Copyright 2018 Opti-Num Solutions (Pty) Ltd 14

convolution2dLayer([2,2],50) activations(net, X, layer)

Page 15: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

CNN Architecture – Middle Layers

Copyright 2018 Opti-Num Solutions (Pty) Ltd 15

reluLayer maxPooling2dLayer([3,3])

𝑓 𝑥 = ቊ𝑥, 𝑥 ≥ 00, 𝑥 < 0

Page 16: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

CNN Architecture – Final Layers

Copyright 2018 Opti-Num Solutions (Pty) Ltd 16

fullyConnectedLayer(2) softmaxLayer()

classificationLayer()

Page 17: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Agenda

• Introduction to concepts

– Deep Learning checklist

– Convolutional Neural Networks and layer architecture

• CNNs for non-image applications

• Some challenges and how to mitigate them

• Take Aways

Copyright 2018 Opti-Num Solutions (Pty) Ltd 17

Page 18: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

CNNs for Non-Image Applications

Copyright 2018 Opti-Num Solutions (Pty) Ltd 18

Page 19: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

CNNs for Non-Image Applications

Copyright 2018 Opti-Num Solutions (Pty) Ltd 19

Page 20: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Agenda

• Introduction to concepts

– Deep Learning checklist

– Convolutional Neural Networks and layer architecture

• CNNs for non-image applications

• Some challenges and how to mitigate them

• Take Aways

Copyright 2018 Opti-Num Solutions (Pty) Ltd 20

Page 21: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Some Challenges

• Building layer architecture

Copyright 2018 Opti-Num Solutions (Pty) Ltd 21

Page 22: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Some Challenges

• Building layer architecture

• Training Time

– Use GPU

Copyright 2018 Opti-Num Solutions (Pty) Ltd 22

Page 23: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Some Challenges

• Building layer architecture

• Training Time

– Use GPU

• Getting better performance

– Learning rate

– Epochs

– Amount of data

Copyright 2018 Opti-Num Solutions (Pty) Ltd 23

NaNs/ spike in

loss?

↑

learn rate

↓ learn rate

Loss ↓ at end of

training?

↑ Epochs↓ learn rate at plateau

Training loss >

validation loss?Augment data,

↓ epochs

YN

Y

Y

N

Page 24: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Agenda

• Introduction to concepts

– Deep Learning checklist

– Convolutional Neural Networks and layer architecture

• CNNs for non-image applications

• Some challenges and how to mitigate them

• Take Aways

Copyright 2018 Opti-Num Solutions (Pty) Ltd 24

Page 25: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Take-Aways

• Growing the Deep Learning Community in South Africa

– Application-based research

• Deep Learning in MATLAB

– Deep Learning Onramp Tutorial

– MATLAB Onramp Tutorial

Copyright 2018 Opti-Num Solutions (Pty) Ltd 25

Page 26: Convolutional Neural Networks in MATLABsanum.github.io/2019/img/CNNTalkMATLAB.pdf · Convolutional Neural Networks in MATLAB 28 March 2019. Welcome • Danielle Winter Application

Q&A

Copyright 2018 Opti-Num Solutions (Pty) Ltd 26

Questions & Answers


Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Convolutional Neural Networks Analyzed via Convolutional ... · PDF fileConvolutional Neural Networks Analyzed via Convolutional Sparse Coding ... Deep Learning, Convolutional Neural

Convolutional neural networks deepa

O-CNN: Octree-based Convolutional Neural Networks for … · O-CNN: Octree-based Convolutional Neural Networks for 3D ... object classification, ... Octree-based Convolutional Neural

Structure-Aware Convolutional Neural Networks › paper › 7287-structure-aware-convolutional-ne… · Structure-Aware Convolutional Neural Networks (SACNNs) are readily estab-lished

Understanding Convolutional Neural Networks

Convolutional Neural Networks

Convolutional Neural Networks - Virginia Techjbhuang/teaching/ece5554-4554/fa17/... · Convolutional Neural Networks Computer Vision ... ImageNet Classification with Deep Convolutional

Convolutional Neural Networks · 2017-10-10 · Convolutional? –Pruning Convolutional Neural Networks for Resource Efficient Inference –FILTER SHAPING FOR CONVOLUTIONAL NEURAL

Intro To Convolutional Neural Networks

Deep Convolutional Neural Networks - Overview

Accelerating Convolutional Neural Network Systemshgrg1/publications/honours.pdf · 2015-07-29 · Accelerating Convolutional Neural Network Systems ... Convolutional Neural Networks

Convolutional Neural Networks (CNNs) Deconvolutions …aisociety.kr/prml/PRMLSS_2015_deconvolution.pdf · deconvolutions in convolutional neural networks. ... Making the stride of

Convolutional Neural Networks - TJ Machine Learning Clubtjmachinelearning.com/lectures/cnn/cnn.pdf · 2018-05-23 · Convolutional Neural Networks Mihir Patel ... Traditional neural

Convolutional neural networks for direct inference of ...eprints.whiterose.ac.uk/142937/1/Convolutional Neural Networks for... · This is a repository copy of Convolutional neural

SUPERRESOLUTION RECURRENT CONVOLUTIONAL NEURAL NETWORKS

Convolutional Neural Networks - tjmachinelearning.com · Convolutional Neural Networks Mihir Patel November 2017 1 Introduction Neural networks are a very robust machine learning

Convolutional Neural Networks for Deep Learning: An Introduction · 2017-10-05 · Introduction: Convolutional Neural Networks (CNN) Convolutional Neural Networks: A deep learning

Convolutional Neural Networks (Part II)lvelho.impa.br/ip17/proj/slides/1110GoingDeeperConv.pdf · Convolutional Neural Networks 1 Convolutional Neural Networks (Part II) 08, 10 &

Shepard Convolutional Neural Networks - Neural Information …papers.nips.cc/paper/5774-shepard-convolutional-neural... · 2016-02-16 · Shepard Convolutional Neural Networks (ShCNN)

Neural Network Part 3: Convolutional Neural Networkspages.cs.wisc.edu/.../lecture12-neural-networks-3.pdf · Convolutional neural networks •Strong empirical application performance

Lecture 5 Convolutional Neural Networks

Convolutional Neural Networks: Epic Fails

Convolutional Neural Networks Arise From Ising Models …sunilpai/convolutional-neural-networks.pdf · Convolutional Neural Networks Arise From Ising Models and Restricted Boltzmann

Convolutional Neural Networks (CNNs / ConvNets)web.stanford.edu/class/cs379c/archive/2018/class...Convolutional Neural Networks (CNNs / ConvNets) Convolutional Neu ral Networks are

Introduction to Convolutional Neural Networks

Deep Convolutional Neural Networks - Cjoint.com

Introduction: Convolutional Neural Networks for Visual ...courses.cs.tau.ac.il/Caffe_workshop/Bootcamp/pdf_lectures/Lecture 1... · Introduction: Convolutional Neural Networks for

CONVOLUTIONAL NEURAL NETWORKS: MOTIVATION, …

Convolutional Neural Networks (CNN)

Lecture 10: Convolutional Neural Networks · CS231n: Convolutional Neural Networks K. Simonyan and A. Zisserman, Very Deep Convolutional Networks for Large -Scale Image Recognition,

Constrained Convolutional Neural Networks for …vgg/rg/slides/ccnn1.pdf · Constrained Convolutional Neural Networks for Weakly Supervised Segmentation ... [CCNN] Convolutional Neural

Lecture 17 Convolutional Neural Networks

Convolutional Neural Networks for No-Reference Image Quality Assessmentopenaccess.thecvf.com/...Convolutional_Neural_Networks_2014_CVPR_paper.pdf · Convolutional Neural Networks

VIP Cheatsheet: Convolutional Neural Networks