natural language processing sose 2016 · pdf filenatural language processing sose 2016 ... for...
TRANSCRIPT
![Page 1: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/1.jpg)
Natural Language ProcessingSoSe 2016
Lexical Semantics
Dr. Mariana Neves May 30th, 2016
![Page 2: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/2.jpg)
Outline
● Lexical Semantics
● Word Sense Disambiguation
● Word Similarity
● Semantic Role Labeling
2
![Page 3: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/3.jpg)
Outline
● Lexical Semantics
● Word Sense Disambiguation
● Word Similarity
● Semantic Role Labeling
3
![Page 4: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/4.jpg)
Word Meaning
● Considering the meaning(s) of a word in addition to its written form
● Word Sense
– A discrete representation of an aspect of the meaning of a word
4
![Page 5: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/5.jpg)
Lexeme
● An entry in a lexicon consisting of a pair: a form with a single meaning representation
● band (music group)● band (material)● band (wavelength)
5
(http://www.nict.go.jp/en/press/2011/12/26-01.html) (http://www.weiku.com/products/12426189/Polyester_Elastic_band_for_garment_underwear_shoe_bags.html) (http://clipart.me/band-material-with-the-enthusiasm-of-the-audience-silhouette-19222)
![Page 6: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/6.jpg)
Lemma
● The grammatical form that is used to represent a lexeme
– Berlin
– band
6
![Page 7: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/7.jpg)
Homonymy
● Words which have similar form but different meanings
– Homographs:
● Berlin (Germany's capital); Berlin (music band)● band (music group); band (material); band
(wavelength)
7
![Page 8: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/8.jpg)
Homophones
● Word which have similar pronunciation but different writing and meaning
– write
– right
8
![Page 9: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/9.jpg)
Semantics Relations
● Lexical relations among words (senses)
– Hyponymy (is a) {parent: hypernym, child: hyponym}
● dog & animal
9
(http://animalia-life.com/dogs.html) (http://pic-zoom.com/pictures-animals.html)
![Page 10: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/10.jpg)
Semantics Relations
● Lexical relations among words (senses)
– Meronymy (part of)
● arm & body
10
(http://www.oxfordlearnersdictionaries.com/definition/american_english/arm_1)
![Page 11: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/11.jpg)
Semantics Relations
● Lexical relations among words (senses)
– Synonymy
● fall & autumn
11
(http://pinitgallery.com/photo/f/fall-background/7/)
![Page 12: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/12.jpg)
Semantics Relations
● Lexical relations among words (senses)
– Antonymy
● tall & short
12 (http://pixgood.com/tall-short.html)
![Page 13: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/13.jpg)
WordNet
● A hierarchical database of lexical relations
● Three Separate sub-databases
– Nouns
– Verbs
– Adjectives and Adverbs
● Each word is annotated with a set of senses
● Available online or for download
– http://wordnetweb.princeton.edu/perl/webwn
13
![Page 14: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/14.jpg)
Word sense
● Synset (synonym set)
14
![Page 15: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/15.jpg)
Word Relations (Hypernym)
15
![Page 16: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/16.jpg)
Outline
● Lexical Semantics
● Word Sense Disambiguation
● Word Similarity
● Semantic Role Labeling
16
![Page 17: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/17.jpg)
Motivation: Information retrieval
17
![Page 18: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/18.jpg)
Motivation: Machine translation
18
(http://translate.google.de)
![Page 19: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/19.jpg)
Motivation: Speech recognition
● You have to process it write.
● You have to process it right.
19
![Page 20: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/20.jpg)
Motivation: Speech synthesis
● Eggs have a high protein content.
● She was content to step down after four years as chief executive.
20
![Page 21: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/21.jpg)
Word Sense Disambiguation
● Input
– A word
– The context of the word
– Set of potential senses for the word
● Output
– The best sense of the word for this context
21
bank
The bank of the river was nice.
Ufer Bank
![Page 22: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/22.jpg)
Approaches
● Thesaurus-based
● Supervised learning
● Semi-supervised learning
22
![Page 23: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/23.jpg)
Thesaurus-based
● Extracting sense definitions from existing sources
– Dictionaries
– Thesauri
– Wikipedia
23
![Page 24: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/24.jpg)
The Lesk Algorithm
● Selecting the sense whose definition shares the most words with the word’s context
24
(http://en.wikipedia.org/wiki/Lesk_algorithm)
![Page 25: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/25.jpg)
The Lesk Algorithm
● Simple to implement
● No training data needed, „only“ a lexicon
● Relatively bad results
25
![Page 26: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/26.jpg)
Supervised Learning
● Training data:
– A corpus in which each occurrence of the ambiguous word „w“ is annotated with its correct sense
● SemCor : 234,000 sense-tagged from Brown corpus● SENSEVAL-1: 34 target words● SENSEVAL-2: 73 target words● SENSEVAL-3: 57 target words (2081 sense-tagged)
26
![Page 27: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/27.jpg)
SemCor corpus
27(http://web.eecs.umich.edu/~mihalcea/downloads/semcor/semcor3.0.tar.gz)
![Page 28: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/28.jpg)
Feature Selection
● Using the words in the context with a specific window size
– Collocation
● Considering all words in a window (as well as their POS) and their position:
28
{Wn−3,Pn−3,Wn−2,Pn−2 ,Wn−1,Pn−1,Wn+1,Pn+1 ,Wn+2 ,Pn+2 ,Wn+3,Pn+3}
![Page 29: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/29.jpg)
Collocation: example
● band:
„There would be equal access to all currencies financial instruments and financial services dash and no major constitutional change. As realignments become more rare and exchange rates waver in narrower bands the system could evolve into one of fixed exchange rates.“
● Window size: +/- 3
● Context: waver in narrower bands the system could
● {Wn−3,Pn−3,Wn−2,Pn−2 ,Wn−1,Pn−1,Wn+1,Pn+1 ,Wn+2 ,Pn+2 ,Wn+3,Pn+3}
● {waver, NN, in , IN , narrower, JJ, the, DT, system, NN , could, MD}
29
![Page 30: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/30.jpg)
Feature Selection
● Using the words in the context with a specific window size
– Bag-of-word
● Considering the frequent words regardless their position
● Deriving a set of k most frequent words in the window from the training corpus
● Representing each word in the data as a k-dimension vector
● Finding the frequency of the selected words in the context of the current observation
30
{ 0 , 0 , 0 , 0 , 0 , 1 , 0 , 0 , 1 , …. }
![Page 31: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/31.jpg)
Bag-of-words: example
● band:
„There would be equal access to all currencies financial instruments and financial services dash and no major constitutional change. As realignments become more rare and exchange rates waver in narrower bands the system could evolve into one of fixed exchange rates.“
● Window size: +/- 3
● Context: waver in narrower bands the system could
● k frequent words for „band“:
– {circle, dance, group, jewelery, music, narrow, ring, rubber, wave}
– { 0 , 0 , 0 , 0 , 0 , 1 , 0 , 0 , 1 }
31
![Page 32: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/32.jpg)
Naïve Bayes Classification
● Choosing the best sense ŝ out of all possible senses si for a feature vector f of the word w
32
s=argmax siP (s i∣ f )
s=argmax si
P ( f ∣si)P (si)
P ( f )
P ( f )has noeffect
s=argmax siP ( f ∣s i)P ( si)
![Page 33: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/33.jpg)
Naïve Bayes Classification
33
s=argmax siP ( f ∣si)P ( si)
Prior probabilityLikelihood probability
s=argmax siP (si)∏ j=1
mP ( f j∣si)
P (si)=#(si)
#(w)
#(si): number of times the sense si is used for the word w in the training data#(w): the total number of samples for the word w
![Page 34: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/34.jpg)
Naïve Bayes Classification
34
s=argmax siP ( f ∣si)P ( si)
Prior probabilityLikelihood probability
s=argmax siP (si)∏ j=1
mP ( f j∣si)
#(fj,si): the number of times the feature fj occurred for the sense si of word w#(si): the total number of samples of w with the sense si in the training data
P ( f j∣si)=#( f j , si)
# si
![Page 35: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/35.jpg)
Semi-supervised Learning
35
● A small amount of labeled data
● A large amount of unlabeled data
● Solution:
● Finding the similarity between the labeled and unlabeled data
● Predicting the labels of the unlabeled data
![Page 36: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/36.jpg)
Semi-supervised Learning
● For each sense of „band“:
– Select the most important word which frequently co-occurs with the target word only for this particular sense
● „play“ (music)● „elastic“ (rubber)● „spectrum“ (range)
36
![Page 37: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/37.jpg)
Semi-supervised Learning
● For each sense of „band“:
– Find the sentences from unlabeled data which contain the target word and the selected word
37
For example the Jamaican reggae musician Bob Marley and his band The Wailers were known to play the concerts ….
A rubber band, also known as a binder, elastic band, lackey band, laggy band, "gum band", or elastic, is a short length of rubber and latex, elastic in nature and formed ...
The band spectrum is the combination of many different spectral lines
(http://en.wikipedia.org/wiki/Encore_(concert)) (http://en.wikipedia.org/wiki/Rubber_band) (http://en.wikipedia.org/wiki/Spectral_bands)
![Page 38: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/38.jpg)
Semi-supervised Learning
● For each sense,
– Label the sentence with the corresponding sense
– Add the new labeled sentences to the training data
38
![Page 39: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/39.jpg)
Outline
● Lexical Semantics
● Word Sense Disambiguation
● Word Similarity
● Semantic Role Labeling
39
![Page 40: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/40.jpg)
Word similarity
● Task
– Finding the similarity between two words in a wide range of relations (e.g., relatedness)
– Different of synonymy
– Being defined with a score (degree of similarity)
40
![Page 41: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/41.jpg)
Word similarity
41
bank fund0.8
car bicycle0.5
car gasoline0.2
![Page 42: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/42.jpg)
Motivation: Information retrieval & Question Answering
42
![Page 43: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/43.jpg)
Motivation: Document categorization
43
![Page 44: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/44.jpg)
Motivation: Machine translation, summarization, text generation
● Substitution of one word for other in some contexts
– „The bank is on the left bank of the river“
● „The financial institution is on the left bank of the river“
44
![Page 45: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/45.jpg)
Motivation: Language modeling
● Cluster words for class-based models
– „to London“, „to Beijing“, „to Denver“
– Classes: CITY_NAME, AIRLINE, DAY_OF_WEEK, MONTH, etc.
45
![Page 46: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/46.jpg)
Motivation: Word clustering
46 (http://neoformix.com/2009/WorldNewsClusteredWordCloud.html)
![Page 47: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/47.jpg)
Approaches
● Thesaurus-based
– Based on their distance in a thesaurus
– Based on their definition in a thesaurus (gloss)
● Distributional
– Based on the similarity between their contexts
47
![Page 48: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/48.jpg)
Thesaurus-based Methods
● Two concepts (sense) are similar if they are “nearby” (short path in the hypernym hierarchy)
48
nickel dime
coin
coinage
currency
medium of exchange
standard
scale
Richter scalemoney
fund
budget
12
57
![Page 49: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/49.jpg)
Path-base Similarity
● pathlen(c1,c2) = 1 + number of edges in the shortest path between the sense nodes c1 and c2
● simpath(c1,c2) = − log pathlen(c1,c2)
● wordsim(w1,w2) = max c1 senses(w1), ∈ c2 senses(w2)∈ sim(c1,c2)
when we have no knowledge about the exact sense
(which is the case when processing general text)
49
![Page 50: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/50.jpg)
Path-base Similarity
● Shortcoming
– Assumes that each link represents a uniform distance
● „nickel“ to „money“ seems closer than „nickel“ to „standard“
50
nickel dime
coin
coinage
currency
medium of exchange
standard
scale
Richter scalemoney
fund
budget
5
5
![Page 51: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/51.jpg)
Path-base Similarity
● Solution
– Using a metric which represents the cost of each edge independently
⇒ Words connected only through abstract nodes are less similar
51
nickel dime
coin
coinage
currency
medium of exchange
standard
scale
Richter scalemoney
fund
budget
5
4.5
![Page 52: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/52.jpg)
Information Content Similarity
● Assigning a probability P(c) to each node of thesaurus
– P(c) is the probability that a randomly selected word in a corpus is an instance of concept c
⇒ P(root) = 1, since all words are subsumed by the root concept
– The probability is trained by counting the words in a corpus
– The lower a concept in the hierarchy, the lower its probability
52
P (c)=∑w∈words (c)
#w
N
- words(c) is the set of words subsumed by concept c- N is the total number of words in the corpus that are available in thesaurus
![Page 53: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/53.jpg)
Information Content Similarity
53
nickel dime
coin
coinage
currency
medium of exchange
standard
scale
Richter scalemoney
fund
budget
words(coin) = {nickel, dime}words(coinage) = {nickel, dime, coin}words(money) = {budget, fund}words(medium of exchange) = {nickel, dime, coin, coinage, currency, budget, fund, money}
![Page 54: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/54.jpg)
Information Content Similarity
● Augmenting each concept in the hierarchy with a probability P(c)
54
nickel dime
coin
coinage
currency
medium of exchange
standard
scale
Richter scalemoney
fund
budget
1.0
0.8 0.2
0.050.6 0.2
0.1
0.08
0.4
0.010.02
0.05
![Page 55: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/55.jpg)
Information Content Similarity
● Information Content (self-information):
IC(c) = − log P(c)
55
nickel dime
coin
coinage
currency
medium of exchange
standard
scale
Richter scalemoney
fund
budget
1.0
0.8 0.2
0.050.6 0.2
0.1
0.08
0.4
0.010.02
0.05
![Page 56: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/56.jpg)
Information Content Similarity
● Lowest common subsumer:
LCS(c1,c2) = the lowest node that subsumes c1 and c2
56
nickel dime
coin
coinage
currency
medium of exchange
standard
scale
Richter scalemoney
fund
budget
1.0
0.8 0.2
0.050.6 0.2
0.1
0.08
0.4
0.010.02
0.05
![Page 57: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/57.jpg)
Information Content Similarity
● Resnik similarity
– Measuring the common amount of information by the information content of the lowest common subsumer of the two concepts
57
simresnik(c1,c2) = − log P(LCS(c1,c2))
simresnik(dime,nickel) = − log P(coin)
![Page 58: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/58.jpg)
Information Content Similarity
● Lin similarity
– Measuring the difference between two concepts in addition to their commonality
58
similarityLIN (c1 , c2)=2 log P (LCS (c1 , c2))
log P (c1) log P (c2)
similarity LIN (dime ,nickel )=2 log P (coin)
log P (dime) log P (nickel )
![Page 59: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/59.jpg)
Information Content Similarity
● Jiang-Conrath similarity
59
similarity JC (c1 , c2)=1
log P (c1)+log P (c2)−2 log P (LCS (c1 , c2))
![Page 60: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/60.jpg)
Extended Lesk
● Looking at word definitions in thesaurus (gloss)
● Measuring the similarity base on the number of common words in their definition
● Adding a score of n2 for each n-word phrase that occurs in both glosses
60
similarityeLesk= ∑r , q∈RELSoverlap (gloss (r (c1)) , gloss (q(c2)))
![Page 61: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/61.jpg)
Extended Lesk
● Computing overlap for other relations as well (gloss of hypernyms and hyponyms)
– similarity(A,B) = overlap(gloss(A),gloss(B))
+ overlap(gloss(hypo(A)),gloss(hypo(B)))
+ overlap(gloss(A),gloss(hypo(B)))
+ overlap(gloss(hypo(A)),gloss(B))
61
![Page 62: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/62.jpg)
Extended Lesk
● Drawing paper
– paper that is specially prepared for use in drafting
● Decal
– the art of transferring designs from specially prepared paper to a wood or glass or metal surface
● common phrases: specially prepared and paper
62
similarityeLesk=12+22=1+4=5
![Page 63: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/63.jpg)
Available Libraries
● WordNet::Similarity
– Source:
● http://wn-similarity.sourceforge.net/
– Web-based interface:
● http://marimba.d.umn.edu/cgi-bin/similarity/similarity.cgi
21.05.201463
![Page 64: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/64.jpg)
Thesaurus-based Methods
● Shortcomings
– Many words are missing in thesaurus
– Only use hyponym info
● Might useful for nouns, but weak for adjectives, adverbs, and verbs
– Many languages have no thesaurus
● Alternative
– Using distributional methods for word similarity
64
![Page 65: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/65.jpg)
Distributional Methods
● Using context information to find the similarity between words
● Guessing the meaning of a word based on its context
65
![Page 66: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/66.jpg)
Distributional Methods
● tezgüino?
– A bottle of tezgüino is on the table
– Everybody likes tezgüino
– Tezgüino makes you drunk
– We make tezgüino out of corn
tezgüino = an alcoholic beverage
66
![Page 67: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/67.jpg)
Context Representations
● Considering a target term t
● Building a vocabulary of M words ({w1,w2,w3,...,wM})
● Creating a vector for t with M features (t = {f1,f2,f3,...,fM})
● fi means the number of times the word wi occurs in the context of t
67
![Page 68: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/68.jpg)
Context Representations
● tezgüino?
– A bottle of tezgüino is on the table
– Everybody likes tezgüino
– Tezgüino makes you drunk
– We make tezgüino out of corn
● t = tezgüino
vocab = {book, bottle, city, drunk, like, water,...}
t = { 0, 1 , 0 , 1 , 1 , 0 ,...}
68
![Page 69: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/69.jpg)
Context Representations
● Term-term matrix
– The number of times the context word „c“ appear close to the term „t“ within a window
69
term / word art boil data function large sugar summarize water
apricot 0 1 0 0 1 2 0 1
pineapple 0 1 0 0 1 1 0 1
digital 0 0 1 3 1 0 1 0
information 0 0 9 1 1 0 2 0
![Page 70: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/70.jpg)
Context Representations
● Goal: finding a good metric that based on the vectors of these four words shows
● [apricot, pineapple] and [digital, information] to be highly similar
● the other four pairs to be less similar
70
art boil data function large sugar summarize water
apricot 0 1 0 0 1 2 0 1
pineapple 0 1 0 0 1 1 0 1
digital 0 0 1 3 1 0 1 0
information 0 0 9 1 1 0 2 0
![Page 71: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/71.jpg)
Distributional similarity
● Size of the context:
– How the co-occurrence terms are defined? (What is a neighbor?)
● Window of k words● Sentence● Paragraph● Document
71
![Page 72: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/72.jpg)
Distributional similarity
● Weighting: How terms are weighted?
– Binary
● 1, if two words co-occur (no matter how often)● 0, otherwise
72
term / word art boil data function large sugar summarize water
apricot 0 1 0 0 1 1 0 1
pineapple 0 1 0 0 1 1 0 1
digital 0 0 1 1 1 0 1 0
information 0 0 1 1 1 0 1 0
![Page 73: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/73.jpg)
Distributional similarity
● Weighting: How terms are weighted?
– Frequency
● Number of times two words co-occur with respect to the total size of the corpus
73
P (t , c)=#(t , c)
N
![Page 74: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/74.jpg)
Distributional similarity
74
art boil data function large sugar summarize water
apricot 0 1 0 0 1 2 0 1
pineapple 0 1 0 0 1 1 0 1
digital 0 0 1 3 1 0 1 0
information 0 0 9 1 1 0 2 0
art boil data function large sugar summarize water
apricot 0 0.035 0 0 0.035 0.071 0 0.035
pineapple 0 0.035 0 0 0.035 0.035 0 0.035
digital 0 0 0.035 0.107 0.035 0 0.035 0
information 0 0 0.321 0.035 0.035 0 0.071 0
# (t,c)
P(t, c) {N = 28}
![Page 75: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/75.jpg)
Distributional similarity
● Weighting: How terms are weighted?
– Pointwise Mutual information
● Number of times two words co-occur, compared with what we would expect if they were independent
75
PMI (t , c)=logP (t , c)
P (t)P (c)
![Page 76: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/76.jpg)
76
art boil data function large sugar summarize water
apricot 0 0.035 0 0 0.035 0.071 0 0.035
pineapple 0 0.035 0 0 0.035 0.035 0 0.035
digital 0 0 0.035 0.107 0.035 0 0.035 0
information 0 0 0.321 0.035 0.035 0 0.071 0
P(digital, summarize) = 0.035P(information, function) = 0.035
P(digital, summarize) = P(information, function)
PMI(digital, summarize) =?PMI(information, function) =?
Pointwise Mutual Information
![Page 77: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/77.jpg)
Pointwise Mutual Information
77
art boil data function large sugar summarize water
apricot 0 0.035 0 0 0.035 0.071 0 0.035
pineapple 0 0.035 0 0 0.035 0.035 0 0.035
digital 0 0 0.035 0.107 0.035 0 0.035 0
information 0 0 0.321 0.035 0.035 0 0.071 0
P(digital, summarize) = 0.035P(information, function) = 0.035
P(digital) = 0.212 P(summarize) = 0.106P(function) = 0.142 P(information) = 0.462
PMI (digital , summarize )=P (digital , summarize )
P (digital ) · P ( summarize)=
0.0350.212 .0.106
=1.557
PMI (information , function)=P(information , function)
P (information) · P ( function)=
0.0350.462 .0.142
=0.533
P(digital, summarize) > P(information, function)
![Page 78: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/78.jpg)
Distributional similarity
● Weighting: How terms are weighted?
– t-test statistic
● How much more frequent the association is than chance
78
t−test (t , c)=P (t , c)−P (t)P (c)
√P (t )P (c)
![Page 79: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/79.jpg)
Distributional similarity
● Vector similarity: What vector distance metric should be used?
– Cosine
– Jaccard, Tanimoto, min/max
– Dice
79
similaritycosine( v , w)=∑i
v i×w i
√∑iv i2√∑i
w i2
similarity jaccard ( v , w)=∑i
min(v i , w i)
∑imax (v i ,w i)
similaritydice(v , w)=2⋅∑i
min(v i ,w i)
∑i(v i+w i)
![Page 80: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/80.jpg)
Outline
● Lexical Semantics
● Word Sense Disambiguation
● Word Similarity
● Semantic Role Labeling
80
![Page 81: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/81.jpg)
Semantic Role Labeling (SRL)
● Also called
– Thematic role labeling, case role assignment, shallow semantic parsing
● The task of automatic finding the semantic roles for each predicate in a sentence.
– Which constituents are semantic arguments for a given predicate?
81
Mary didn't slap the green witch with a frozen trout in the park.
predicate
agent theme instrument
![Page 82: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/82.jpg)
Semantic Role Labeling
● Can potentially improve any natural language understanding (NLU) task
● Applications:
– Question answering
– Information extraction
82
![Page 83: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/83.jpg)
PropBank/VerbNet
● Around 5,000 verb senses
● „slap“ verb:
– Roleset id: slap.01
– Role:
● Arg0-PAG: agent, hitter - animate only!● Arg1-PPT: thing hit● Arg2-MNR: instrument, thing hit by or with
83
(http://verbs.colorado.edu/verb-index/index.php http://verbs.colorado.edu/propbank/framesets-english/slap-v.html)
![Page 84: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/84.jpg)
Methods for SRL
● Usually based on supervised learning
– Annotated training data is necessary
– Also need to rely on syntactic parsing or chunking
● Simple algorithm:
– Parse the sentence
– For each predicate in the parse tree
● For each node in the parse tree
– Create a feature set– Classify node
84
![Page 85: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/85.jpg)
Features for SRL
● Predicate (verb): e.g., „slap“
● Phrase type: e.g., „NP“, „PP“
● Headword: e.g., „Mary“, „witch“, „trout“
● Path in parse tree: e.g., „VPVB“, „SVPVPVB“
● Voice: „active“ or „passive“
● Linear position: „before“ or „after“
● Verb subcategorization: e.g., whether it requires objects (VP NP PP)
● Named entities: e.g., „Mary [PERSON]“
85
(ROOT (S (NP (NNP Mary)) (VP (VBD did) (RB n't) (VP (VB slap) (NP (DT the) (JJ green) (NN witch)) (PP (IN with) (NP (NP (DT a) (JJ frozen) (NNS trout)) (PP (IN in) (NP (DT the) (NN park))))))) (. .)))
![Page 86: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/86.jpg)
Methods for SRL
● A classifier might include a pre-processing pruning step to eliminate some constituents
● Classification is taken place for each node and each argument (e..g, ARG1-PPT)
● A post-processing step is necessary to check if a constituent has been assigned to more than one argument
– Further, one argument is not independent of the others
86
![Page 87: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/87.jpg)
Summary
● Semantics
– Senses, relations
● Word disambiguation
– Thesaurus-based, (semi-) supervised learning
● Word similarity
– Thesaurus-based
– Distributional
● Features, weighting schemes and similarity algorithms● Semantic role labeling
87
![Page 88: Natural Language Processing SoSe 2016 · PDF fileNatural Language Processing SoSe 2016 ... For example the Jamaican reggae musician Bob Marley and his band ... – Being defined with](https://reader031.vdocuments.us/reader031/viewer/2022022420/5a7df5317f8b9a72118e0751/html5/thumbnails/88.jpg)
Further Reading
● Speech and Language Processing
– Chapters 19, 20
88