deep learning for everyone season ii (deep nlp!) · nlp applications •applications range...
TRANSCRIPT
![Page 1: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/1.jpg)
Deep Learning for Everyone Season II (Deep NLP!)
Sung Kim <[email protected]>
https://hunkim.github.io/ml/https://www.facebook.com/groups/TensorFlowKR/
![Page 2: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/2.jpg)
NLP: Natural Language Processing
• Understanding what you are saying/writing
• Several levels of understandings- Syntactic- Semantic
- Meaning (thinking)
• Perfect language understanding is AI-complete
http://cs224d.stanford.edu/
![Page 3: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/3.jpg)
NLP levels
http://cs224d.stanford.edu/
![Page 4: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/4.jpg)
NLP Applications
• Applications range from simple to complex:- Spell checking, keyword search, finding synonyms- Extracting information from websites such as product price, dates, location, people
or company names
• Classifying, reading level of school texts, positive/negative, sentiment oflonger documents
• Machine translation
• Spoken dialog systems
• Complex question answeringhttp://cs224d.stanford.edu/
![Page 5: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/5.jpg)
(Tentative) topics
• Chatbots
• NLP vs Deep NLP
• Word2Vec
• NN for NLP
• Recurrent Neural Network
• Recursive Neural Network
• Attention and Memory
![Page 6: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/6.jpg)
Chatbots
https://techcrunch.com/2016/05/10/facebook-chatbot-analytics/
![Page 7: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/7.jpg)
Chatbots
http://www.zdnet.co.kr/news/news_view.asp?artice_id=20160523095336
![Page 8: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/8.jpg)
Chatbot - NLP application
• Extracting information from given text/speech
• Simple dialog systems
• Three simple platforms- Api.ai: Conversational UX Platform
- Wit.ai: Facebook bot NLP processing engine- Amazon Echo (Alexa) skill set
![Page 9: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/9.jpg)
Prerequisite
• Deep Learning Session 1
• https://hunkim.github.io/ml/
![Page 10: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, finding synonyms-Extracting information](https://reader034.vdocuments.us/reader034/viewer/2022051601/5acd6e217f8b9a6a678d8203/html5/thumbnails/10.jpg)
Next
chatbot: Api.ai