research poster presentation design © 2012 end-to-end morph decoding morph entity analysis morph:...

1
RESEARCH POSTER PRESENTATION DESIGN © 2012 www.PosterPresentations. com End-to-End Morph Decoding Morph Entity Analysis Morph: Morphs refer to the fake alternative names created by social media users to entertain readers or evade censors. Morph Decoding: Challenges: - Large-scope candidates Only a very small percentage of terms can be used as morphs - Ambiguity, Implicitness, Informality Compared to regular entities, many morphs con- tain informal terms with hidden information - Lack of labeled data No sufficient mention-level morph annotations exist for training an end- to-end decoder. 2. Morph Decoding Step 1: Mention Extraction 4. Experiments Morph Mention Extraction Morph Mention Resolution 1 Rensselaer Polytechnic Institute, 2 Peking University, 3 Microsoft Research Asia, 4 University of Southern California, 5 IBM T. J. Watson Research Center, 6 Northeastern University, 7 Univerisity of Illinois at Urbana-Champaign Boliang Zhang 1 , Hongzhao Huang 1 , Xiaoman Pan 1 , Sujian Li2 , Chin-Yew Lin 3 Heng Ji 1 , Kevin Knight 4 , Zhen Wen 5 , Yizhou Sun 6 , Jiawei Han 7 , Bulent Yener 1 Context-aware Entity Morph Decoding 1. Task Introduction 3. Morph Decoding Step 2: Mention Resolution 苏苏 (Su-tooth) 苏苏苏苏 (Luis Suárez) 苏苏 西 (Red West City) 苏苏 (Chongqing) 西 苏苏苏苏苏 苏苏苏苏苏苏苏苏 ,? (Conquer West King from Chongqing fell from power, do we still need to sing red songs?) 苏苏平平平 (Buhou and Little Brother Ma.) 苏苏 苏苏 西 苏苏苏 !! 苏苏(Attention! Chongqing Conquer West King! Attention! Brother Jun!) 苏苏苏苏苏苏苏苏 苏苏苏苏苏苏苏苏苏苏苏 苏苏苏苏苏 ,, 西 (Wu Sangui met Wei Xiaobao, and led the army of Qing dynasty into China, and then became Conquer West King.) 苏苏苏 (Bo Xilai) 苏苏苏 (Ma Ying-jeou) 苏苏苏 (Wang Lijun) Figure 1: An Illustration of Morph Decoding Task 苏苏苏苏苏苏苏苏 苏苏苏苏苏苏苏苏苏苏苏 苏苏苏苏苏 ,, 西 (Wu Sangui met Wei Xiaobao, and led the army of Qing dynasty into China, and then became Conquer West King .) 西 a. Potential morph discovery b. Morph mention verification Figure 2: Pairwise Cross- genre Supervised Learning 平平 (Eight Beauties) 平平 (Surrender to Qing Dynasty) 平平 (Qinhuai) 平平 (Army of Qing) 1644 平 (Year 1644) 平平 (Break the Defense) 平平 (Fall of Qin Dynasty) 平平平 (Chen Yuanyuan) 平平平 (Wu Sangui) 平平 (Entitled as) (Bo Yibo) 平平 (Manchuria) BXL (Bo Xilai) 平平平 (Wang Lijun) 平平 (Wen Qiang) 平平 (Fall of Qin Dynasty) 平平平 (Zhang Dejiang) 平平 (King of Han) (Bo) 平平平 (Wu Sangui) 平平 (Violation of Rules) 平平平 (Be Distinguished) BXL (Bo Xilai) 平平 (Suppress Gangster) 平平平 (Wang Lijun) 平平平 (Murdering Case) 平平平 (Zhang Dejiang) 平平 · 平平 (Neil Heywood) 平平平 (Huang Qifan) 平平 (Introduce Investment) “苏 西 (Conquer West King)” in Wikipedia “苏 西 (Conquer West King)” in tweets “ 苏苏苏 (Bo Xilai)” in tweets/web docs Table 2: End-to-End Morph Decoding (%) Figure 5: Top 10 closest entities to morph and target in different genres Figure 4: Resolution Acc@K for Perfect Morph Mentions Potential Morph Discovery Basic (surface form, pos tags and etc.) Dictionary Phonetic Language Modeling Morph Mention Verification Graph-based semi-supervised method 苏苏 西 (Tomato) Pairwise Cross-genre Supervised Learning Within-genre Unsupervised Learning Figure 3: Continuous Bag-of-Words Architecture Table 1: Morph Mention Verification (%) Method Precision Recall F1 Naive 58.0 83.1 68.3 SVMs 61.3 80.7 69.7 Our Approach 88.2 77.2 82.3 1 5 10 20 0 10 20 30 40 50 60 70 80 90 Cross-Genre Learning Within-Genre Learning K Accuracy(%) Model Precisio n Recall F1 Huang et al., 2013 40.2 33.3 36.4 Our Approach 41.1 35.9 38.3 Real “Conquer West King” in history

Upload: rolf-wells

Post on 29-Dec-2015

219 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: RESEARCH POSTER PRESENTATION DESIGN © 2012  End-to-End Morph Decoding Morph Entity Analysis Morph: Morphs refer to the fake

RESEARCH POSTER PRESENTATION DESIGN © 2012

www.PosterPresentations.com

• End-to-End Morph Decoding

• Morph Entity Analysis

• Morph: Morphs refer to the fake alternative names created by social media users to entertain readers or evade censors.

• Morph Decoding:

• Challenges:- Large-scope candidates

Only a very small percentage of terms can be used as morphs

- Ambiguity, Implicitness, InformalityCompared to regular entities, many morphs con- tain informal terms with hidden information

- Lack of labeled dataNo sufficient mention-level morph annotations exist for training an end-to-end decoder.

2. Morph Decoding Step 1: Mention Extraction

4. Experiments• Morph Mention Extraction

• Morph Mention Resolution

1Rensselaer Polytechnic Institute, 2Peking University, 3Microsoft Research Asia, 4University of Southern California, 5IBM T. J. Watson Research Center, 6Northeastern University, 7Univerisity of Illinois at Urbana-Champaign

Boliang Zhang1, Hongzhao Huang1, Xiaoman Pan1, Sujian Li2, Chin-Yew Lin3 Heng Ji1, Kevin Knight4, Zhen Wen5, Yizhou Sun6, Jiawei Han7, Bulent Yener1

Context-aware Entity Morph Decoding

1. Task Introduction

3. Morph Decoding Step 2: Mention Resolution

苏牙 (Su-tooth)苏亚雷斯 (Luis Suárez)

西红市 (Red West City)重庆 (Chongqing)

平西王已经倒台了,还需要唱红歌吗?(Conquer West King from Chongqing fell from power, do we still need to sing red songs?)

不厚与小马哥(Buhou and Little Brother Ma.)

专注!重庆平西王!专注!军哥!(Attention! Chongqing Conquer West King! Attention! Brother Jun!)

吴三桂碰到韦小宝,然后带领清军入侵中国,然后变成了平西王。(Wu Sangui met Wei Xiaobao, and led the army of Qing dynasty into China, and then became Conquer West King.)

薄熙来(Bo Xilai)

马英九(Ma Ying-jeou)

王立军(Wang Lijun)

Figure 1: An Illustration of Morph Decoding Task

吴三桂碰到韦小宝,然后带领清军入侵中国,然后变成了平西王。(Wu Sangui met Wei Xiaobao, and led the army of Qing dynasty into China, and then became Conquer West King.)

平西王

a. Potential morph discovery

b. Morph mention verification

Figure 2: Pairwise Cross- genre Supervised Learning

八艳(Eight Beauties)

降清(Surrender to Qing Dynasty)

秦淮(Qinhuai)

清军(Army of Qing)

1644年(Year 1644)

入关(Break the Defense)

秦亡(Fall of Qin Dynasty)

陈圆圆(Chen Yuanyuan)

吴三桂(Wu Sangui)

封为(Entitled as)

薄一波(Bo Yibo)

满洲(Manchuria)

BXL(Bo Xilai)

王立军(Wang Lijun)

文强(Wen Qiang)

秦亡(Fall of Qin Dynasty)

张德江(Zhang Dejiang)

汉王(King of Han)

薄(Bo)

吴三桂(Wu Sangui)

违纪(Violation of Rules)

区分开(Be Distinguished)

BXL(Bo Xilai)

打黑(Suppress Gangster)

王立军(Wang Lijun)

死亡案(Murdering Case)

张德江(Zhang Dejiang)

尼尔 ·伍德(Neil Heywood)

黄奇帆(Huang Qifan)

引资(Introduce Investment)

“平西王 (Conquer West King)” in Wikipedia

“平西王 (Conquer West King)” in tweets

“薄熙来 (Bo Xilai)” in tweets/web docs

Table 2: End-to-End Morph Decoding (%)

Figure 5: Top 10 closest entities to morph and target in different genresFigure 4: Resolution Acc@K for Perfect Morph Mentions

Potential Morph Discovery• Basic (surface form, pos tags and etc.)• Dictionary• Phonetic• Language Modeling

Morph Mention Verification• Graph-based semi-supervised method

西红柿 (Tomato)

• Pairwise Cross-genre Supervised Learning • Within-genre Unsupervised Learning

Figure 3: Continuous Bag-of-Words Architecture

Table 1: Morph Mention Verification (%)

Method Precision Recall F1 Naive 58.0 83.1 68.3 SVMs 61.3 80.7 69.7

Our Approach 88.2 77.2 82.3

1 5 10 200

10

20

30

40

50

60

70

80

90

Cross-Genre Learning Within-Genre Learning Bag-of-WordsHuang el al., 2013

K

Acc

urac

y(%

)

Model Precision Recall F1 Huang et al., 2013 40.2 33.3 36.4

Our Approach 41.1 35.9 38.3 Real “Conquer West King” in history