video activity recognition and nlp q&a model example
TRANSCRIPT
Video
Applications
Internet Video
Security
Medical Imaging
Challenges
Storage
Bandwidth
Processing
neon
UCF-101
Field Hockey Penalty
Convolutional Neural Networks
Input Hidden Hidden Output
Fully Connected
3D Volumes
Local Connectivity
3D Volumes
Local Connectivity
Demo
github.com/NervanaSystems/neon
Question Answering
Applications
Personal Assistants
Connected Devices
Challenges
Ambiguity
John went to the bank.
Sarcasm
Sarcasm
Can I help you?
Sarcasm
Can I help you?
No, I just waited in line for 30 minutes to say “hi”.
bAbI
bAbI
Stories
bAbI
Stories Questions
bAbI
Stories Questions Answers
Mary journeyed to Texas. John went to Maryland.
Mary went to Iowa. John travelled to Florida.
Mary journeyed to Texas. John went to Maryland.
Mary went to Iowa. John travelled to Florida.
Where is John located?
Recurrent Neural Networks
Sequences
Variable Length Inputs
Where is John located?
Where is John located?
Word Sequence
Where is John located?
Variable Length
Where is John located?
isWhere John located?
Where
Where is
Where is John
Where is John
Parameter Sharing
Where is John Located
Mary journeyed to Texas. John went to Maryland.
Mary went to Iowa. John travelled to Florida.
Where is John located?
Mary journeyed to Texas. John went to Maryland.
Mary went to Iowa. John travelled to Florida.
Where is John located?
Florida
Mary journeyed to Texas. John went to Maryland.
Mary went to Iowa. John travelled to Florida.
Where is Mary located?
Mary journeyed to Texas. John went to Maryland.
Mary went to Iowa. John travelled to Florida.
Where is Mary located?
Florida
github.com/NervanaSystems/neon