artificial intelligence in huawei technologies
Post on 31-Dec-2016
227 Views
Preview:
TRANSCRIPT
Hang Li
Noah’s Ark Lab
Huawei Technologies
Vision: Intelligent Information Assistant
Products
Huawei AppStore Recommendation and Search
Intelligent Help on Huawei Phone
Research Demos
Image Retrieval
Machine Translation
Natural Language Dialogue
Technologies
Deep Learning for Natural Language Processing
Intelligent
Telecommunication
Networks
Speech and Language
Big Data Analytics Intelligent Mobile Devices
SDN Network
Maintenance
Network Optimization and Planning
Huawei Big Data
Telco Big Data
Speech Recognition
Dialogue Machine
Translation
Recommendation Search
Noah Lab’s Research Areas
Vision: Intelligent Information Assistant
Products
Huawei AppStore Recommendation and Search
Intelligent Help on Huawei Phone
Research Demos
Image Retrieval
Machine Translation
Natural Language Dialogue
Technologies
Deep Learning for Natural Language Processing
• Accurate recommendation model • Efficient online learning algorithm
• Big data: billions of features and billions of instances
• Accurate recommendation is still
challenging, particularly for long tail and cold start
• 300 million registered users • 30 million users login every day • 100 million downloads every day
Noah’s Ark Lab is responsible for the development of algorithms
• Learning to rank and learning to match technologies
• Recognize more than 90% of the questions
• Accuracy of answer is over 92% • Currently processes 100K questions a day
• Mismatch between question and answer • “How can I access the Internet?” vs “ways
of connecting to the web”
• User can ask questions about usage of Huawei phones features in natural language
Noah’s Ark Lab is responsible for the development of system
Vision: Intelligent Information Assistant
Products
Huawei AppStore Recommendation and Search
Intelligent Help on Huawei Phone
Research Demos
Image Retrieval
Machine Translation
Natural Language Dialogue
Technologies
Deep Learning for Natural Language Processing
Research Demo
Research Demo
Research Demo
Vision: Intelligent Information Assistant
Products
Huawei AppStore Recommendation and Search
Intelligent Help on Huawei Phone
Research Demos
Image Retrieval
Machine Translation
Natural Language Dialogue
Technologies
Deep Learning for Natural Language Processing
Recommendation
Question Answering
Speech Recognition
Natural Language Dialogue
Machine Translation
Image Retrieval
Information Extraction
Deep Learning
Multimodal CNN
Neural Responding Machine
Augmented Attention-based Neural Machine Translation
Multimodal CNN
……
CNN
MLP
a dog is catching a ball
• One Convolutional Neural Network represents image • One Convolutional Neural Network represents text • Multi Layer Perceptron conducts matching
Experimental Results
• Experiment
– Trained with 30K Flickr data
– Outperforming other state-of-the-art models
1x1tx tx
Tx
1h 1th th Th
… …
1c1tc tc
'Tc
1s 1ts ts'Ts
1y 1ty ty'Ty
… …
Sequence to Sequence Learning with Attention Mechanism
A cat is sitting on the mat
一只 猫 坐 在 垫子 上
• Attention mechanism can make better alignment between source and target sentences
Neural Responding Machine
1x1tx tx
Tx
1h 1th th Th
… …
1c1tc tc
'Tc
1s 1ts ts'Ts
1y 1ty ty'Ty
… …
c
太 羡慕 你 了 祝 旅行 愉快
每年 冬天 都 来 海南 度假
• Using both local and global attention mechanisms
Experimental Results
• Experiment
– Trained with 4.4 million Weibo data (Chinese)
– 95% of responses are natural, 76% of responses are appropriate as replies
Message Response
Occupy Central is finally over Will Lujiazui (finance district in Shanghai) be the next?
I want to buy a Samsung phone Let us support our national brand.
Neural Machine Translation
1x1tx tx
Tx
1h 1th th Th
… …
1c1tc tc
'Tc
1s 1ts ts'Ts
1y 1ty ty'Ty
… …
一只 猫 坐 在 那张 垫子 上
A cat is sitting on the mat
• Using context vectors to avoid over-translation and under-translation • Using context gates to dynamically control the impact of attention
Experimental Results • Experiment
– Trained with 1.25 million LDC data (Chinese-English)
C-E Translation
有一些恐怖袭击会愈演愈烈。
NMT There will be some terrorist attacks.
+Both Some terrorist attacks will become more and more intense.
28.3
30.1 30.6
31.7
26
27
28
29
30
31
32
33
BLEU
NMT
+Coverage
+Context Gate
Vision: Intelligent Information Assistant
Products:
Huawei AppStore Recommendation and Search
Intelligent Help on Huawei Phone
Research Demos:
Image Retrieval
Machine Translation
Natural Language Dialogue
Advanced technologies in Deep Learning for Natural Language Processing
top related