applications of deep learning 25-04-2019...deep learning methods employ multiple processing layers...
TRANSCRIPT
![Page 1: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/1.jpg)
Deep Learning: Theory and Practice
25-04-2019Applications of Deep Learning
![Page 3: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/3.jpg)
Natural Language Processing
![Page 4: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/4.jpg)
Word Embeddings
Learn a vector representation for each word
![Page 5: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/5.jpg)
Language Modeling
![Page 6: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/6.jpg)
Sentiment Analysis/Summarization
![Page 7: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/7.jpg)
Machine Translation
![Page 8: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/8.jpg)
Architectures
Recurrent Neural Networks
Attention Based Models
![Page 9: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/9.jpg)
Speech Processing
https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/HintonDengYuEtAl-SPM2012.pdf
![Page 10: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/10.jpg)
Speech Recognition
2018
5.3%
Claims of human parity !!!
![Page 11: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/11.jpg)
Speaker Recognition Embedding
Embeddings used for verificationtask.
![Page 12: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/12.jpg)
Speech Enhancement
Removing Noise Using a Supervised Training Mechanism
![Page 13: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/13.jpg)
Architectures
Deep neural networks
Bidirectional LSTM Networks
![Page 14: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/14.jpg)
Image Processing
![Page 15: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/15.jpg)
Object Identification
![Page 16: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/16.jpg)
Object Segmentation
![Page 17: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/17.jpg)
Face Detection
![Page 18: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/18.jpg)
Architectures Commonly Used
Convolutional networks
Resnet Architectures
![Page 19: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/19.jpg)
Future DirectionsUnsupervised and Semi-supervised learning
• How little of labelled data is good enough ? • Transfer Learning Principles
Understanding And Insights Into Deep Networks • Understanding parameters and representations.
Deep Generative Models • Using deep learning for generative modeling
![Page 20: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art](https://reader034.vdocuments.us/reader034/viewer/2022050122/5f52277434a87911a64e7dfb/html5/thumbnails/20.jpg)
Software ToolsTheano
http://deeplearning.net/software/theano/
PyTorch https://pytorch.org/
TensorFlow https://www.tensorflow.org/
Kaldi http://kaldi-asr.org/