words and morphology - carnegie mellon school of …tbergkir/11711fa16/fa16_11711_lecture23.pdf ·...
TRANSCRIPT
![Page 1: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/1.jpg)
WordsandMorphology
11-711AlgorithmsforNLP15November2016– PartI
(SlidesmostlyborrowedfromLoriLevin)
![Page 2: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/2.jpg)
Words
• Tokenization• Input:rawtext• Output:sequenceoftokensnormalizedforfurtherprocessing
• Recognition• Input:astringofcharacters• Output:yesorno
• MorphologicalParsing• Input:aword• Output:astructureoranalysisoftheword
• MorphologicalGeneration• Input:astructureoranalysisofaword• Output:aword
![Page 3: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/3.jpg)
Whatisaword?• Thethingsthatareinthedictionary?
• Buthowdidthelexicographersdecidewhattoputinthedictionary?• Thesmallestunitthatcanbeutteredinisolation?
• Youcouldsaythiswordinisolation:Unimpressively• Thisonetoo: impress• Butyouprobablywouldn’tsaytheseinisolation,unlessyouweretalkingaboutmorphology:• un• ive• ly
• Thethingsbetweenspacesandpunctuation?
![Page 4: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/4.jpg)
Sowhatisaword?
• I’mnotgoingtoanswerthatquestion:• didn’t• would’ve• gonna• Ima• finna• blackboard• thepersonwholeft’s hat• acct.• LTI
![Page 5: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/5.jpg)
About1000pages.$139.99
Youdon’thavetoreadit.
Thepointisthatittakes1000pagesjusttosurveytheissuesrelatedtowhatwordsare.
![Page 6: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/6.jpg)
Sowhatisaword?
• Itisuptoyouorthesoftwareyouuseforprocessingwords.• Takelinguisticsclasses.• Makegooddecisionsinsoftwaredesignandengineering.
![Page 7: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/7.jpg)
TokenizationInput:rawtext
Dr. Smith said tokenization of English is “harder than you’ve thought.” When in New York, he paid $12.00 a day for lunch and wondered what it would be like to work for AT&T or Google, Inc.
OutputfromStanfordParser:http://nlp.stanford.edu:8080/parser/index.jspwithpart-of-speechtags:
Dr./NNP Smith/NNP said/VBD tokenization/NN of/IN English/NNP is/VBZ ``/`` harder/JJR than/IN you/PRP 've/VBP thought/VBN ./. ''/’’When/WRB in/IN New/NNP York/NNP ,/, he/PRP paid/VBD $/$ 12.00/CD a/DT day/NN for/IN lunch/NN and/CC wondered/VBD what/WP it/PRP would/MD be/VB like/JJ to/TO work/VB for/IN AT&T/NNP or/CC Google/NNP ,/, Inc./NNP ./.
![Page 8: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/8.jpg)
WhatisLinguisticMorphology?
• Morphologyisthestudyoftheinternalstructureofwords.• Derivationalmorphology. Hownewwordsarecreatedfromexistingwords.
• [grace]• [[grace]ful]• [un[grace]ful]]
• Inflectionalmorphology. Howfeaturesrelevanttothesyntacticcontextofawordaremarkedonthatword.• Thisexampleillustratesnumber(singularandplural)andtense(presentandpast).• Greenindicatesirregular.Blueindicateszeromarkingofinflection.Redindicatesregularinflection.
• This student walks.• These studentswalk.• These students walked.
• Compounding. Creatingnewwordsbycombiningexistingwords• Withorwithoutspaces:surfboard,golfball,blackboard
![Page 9: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/9.jpg)
Morphemes
• Avenerablewayoflookingatmorphology.• Morphemes.Minimalpairingsofformandmeaning.• Roots. The“core”ofawordthatcarriesitsbasicmeaning.
• apple :‘apple’• walk :‘walk’
• Affixes (prefixes,suffixes,infixes,andcircumfixes).Morphemesthatareaddedtoabase(arootorstem)toperformeitherderivationalorinflectionalfunctions.• un- :‘NEG’• -s :‘PLURAL’
![Page 10: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/10.jpg)
IsolatingLanguages:Littlemorphologyotherthancompounding
• Chinese inflection• fewaffixes(prefixesandsuffixes):
• 们: 我们,你们, 他们,。。。同志们mén:wǒmén,nǐmén,tāmén, tóngzhìménplural:we,you(pl.),theycomrades,LGBTpeople
• “suffixes”thatmarkaspect:着 -zhě ‘continuousaspect’
• Chinesederivation•艺术家 yìshùjiā ‘artist’• Chineseisachampionintherealmofcompounding—upto80%ofChinesewordsareactuallycompounds.毒 + 贩 → 毒贩
dú fàn dúfàn
‘poison,drug’ ‘vendor’ ‘drug trafficker’
![Page 11: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/11.jpg)
Fusional Languages:ANewWorldSpanish
Singular Plural
1st 2nd 3rdformal 2nd
1st 2nd 3rd
Present am-o am-as am-a am-a-mos am-áis am-an
Imperfect am-ab-a am-ab-as am-ab-a am-áb-a-mos am-ab-ais am-ab-an
Preterit am-é am-aste am-ó am-a-mos am-asteis am-aron
Future am-aré am-arás am-ará am-are-mos am-aréis am-arán
Conditional am-aría am-arías am-aría am-aría-mos am-aríais am-arían
![Page 12: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/12.jpg)
AgglutinativeLanguages:SwahiliVerbsinSwahilihaveanaverageof4-5morphemes,http://wals.info/valuesets/22A-swa
Swahili English
m-tu a-li-lala ‘Thepersonslept’
m-tu a-ta-lala ‘Thepersonwillsleep’
wa-tu wa-li-lala ‘Thepeopleslept’
wa-tu wa-ta-lala ‘Thepeople willsleep’
• Wordswrittenwithouthyphensorspacesbetweenmorphemes.• Orangeprefixesmarknounclass(likegender,exceptSwahili hasnineinsteadoftwoor
three).• Verbsagreewithnounsinnounclass.• Adjectivesalsoagreewithnouns.• Veryhelpfulinparsing.
• Blackprefixesindicatetense.
![Page 13: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/13.jpg)
TurkishExampleofextremeagglutinationButmostTurkishwordshavearoundthreemorphemes
uygarlaştıramadıklarımızdanmışsınızcasına“(behaving)asifyouareamongthosewhomwewerenotabletocivilize”
uygar “civilized”+laş “become”+tır “causeto”+ama “notable”+dık pastparticiple+larplural+ımız firstpersonpluralpossessive(“our”)+dan ablativecase(“from/among”)+mış past+sınız secondpersonplural(“y’all”)+casına finiteverb→adverb(“asif”)
![Page 14: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/14.jpg)
Operationalization
• operate(opus/opera+ate)• ion• al• ize• ate• ion
![Page 15: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/15.jpg)
PolysyntheticLanguages
• Polysyntheticmorphologiesallowthecreationoffull“sentences”bymorphologicalmeans.• Theyoftenallowtheincorporationofnounsintoverbs.• Theymayalsohaveaffixesthatattachtoverbsandtaketheplaceofnouns.• YupikEskimountu-ssur-qatar-ni-ksaite-ngqiggte-uqreindeer-hunt-FUT-say-NEG-again-3SG.INDIC‘Hehadnotyetsaidagainthathewasgoingtohuntreindeer.’
![Page 16: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/16.jpg)
Root-and-PatternMorphology
• Root-and-pattern.A specialkindoffusional morphologyfoundinArabic,Hebrew,andtheircousins.• Rootusuallyconsistsofasequenceofconsonants.• Wordsarederivedand,tosomeextent,inflectedbypatternsofvowelsintercalatedamongtherootconsonants.• kitaab ‘book’• kaatib ‘writer;writing’• maktab ‘office;desk’• maktaba ‘library’
![Page 17: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/17.jpg)
OtherNon-Concatenative MorphologicalProcesses• Non-concatenativemorphology involvesoperationsotherthantheconcatenationofaffixeswithbases.• Infixation.Amorphemeisinsertedinsideanothermorphemeinsteadofbeforeorafterit.
• Reduplication.Canbeprefixing,suffixing,andeveninfixing.
• Tagalog:• sulat (write,imperative)• susulat (reduplication)(write,future)• sumulat (infixing)(write,past)• sumusulat (infixingandreduplication)(write,present)
• Internalchange (tonechange;stressshift;apophony,suchasumlautandablaut).• Root-and-pattern morphology.• Andmore...
![Page 18: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/18.jpg)
Canyoumakealistofallthewordsinalanguage?ProductivityIntheOxfordEnglishDictionary(OED)(www.oed.com,accessibleforfreefromCMUmachines)
• drinkable• visitable
NotintheOED• mous(e)able• stapl(e)able
InNLP,youneedtobeabletoprocesswordsthatarenotinthedictionary.
Butcouldyoumakealistofallpossiblewords,takingproductivityintoaccount?
![Page 19: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/19.jpg)
Canyoumakealistofallthewordsinalanguage?
Atrie representingalistofwords(lexicon)
![Page 20: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/20.jpg)
Type-TokenCurvesFinnishisagglutinativeIñupiaq ispolysynthetic
0
1000
2000
3000
4000
5000
6000
0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000
Type
s
Tokens
Type-TokenCurves
English
Arabic
Hocąk
Inupiaq
Finnish
TypesandTokens:“Iliketowalk.Iamwalkingnow.Itookalongwalkearliertoo.”
Thetypewalk occurstwice.Sotherearetwotokensofthetypewalk.
Walking isadifferenttypethatoccursonce.
![Page 21: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/21.jpg)
Recognizingthewordsofalanguage
• Input:astring(fromsomealphabet)• Output:yesorno
![Page 22: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/22.jpg)
FSAforEnglishNouns
Lexicon:
Note:“fox”becomespluralbyadding“es”not“s”.Wewillgettothatlater.
![Page 23: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/23.jpg)
Finite-StateAutomaton
• Q:afinitesetofstates• q0∈ Q:aspecialstartstate• F⊆ Q:asetoffinalstates• Σ:afinitealphabet• Transitions:
• Encodesaset ofstringsthatcanberecognizedbyfollowingpathsfromq0 tosomestateinF.
qiqjs∈ Σ*
......
![Page 24: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/24.jpg)
FSAforEnglishAdjectives
Butnotethatthisacceptswordslike“unbig”.
Big,bigger,biggestHappy,happier,happiest,happilyUnhappy,unhappier,unhappiest,unhappilyClear,clearer,clearest,clearlyUnclear,unclearly
Cool,cooler,coolest,coollyRed,redder,reddestReal,unreal,really
![Page 25: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/25.jpg)
FSAforEnglishDerivationalMorphology
Howbigdotheseautomataget?Reasonablecoverageofalanguagetakesanexpertabouttwotofourmonths.
Whatdoesittaketobeanexpert?Studylinguisticstogetusedtoallthecommonandnot-so-commonthingsthathappen,andthenpractice.
![Page 26: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/26.jpg)
MorphologicalParsing
Input:awordOutput:theword’sstem(s)andfeaturesexpressedbyothermorphemes.
Example: geese→goose+N+Plgooses→goose+V+3P+Sgdog→{dog+N+Sg,dog+V}leaves→{leaf+N+Pl,leave+V+3P+Sg}
![Page 27: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/27.jpg)
UpperSide/LowerSide
talk+Past
talked
FST
uppersideorunderlyingform
lowersideorsurfaceform
![Page 28: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/28.jpg)
FiniteStateTransducers
• Q:afinitesetofstates• q0∈ Q:aspecialstartstate• F⊆ Q:asetoffinalstates• ΣandΔ:twofinitealphabets• Transitions:
qiqj
s :ts∈ Σ*andt∈ Δ*
......
![Page 29: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/29.jpg)
MorphologicalParsingwithFSTs
Note“samesymbol”shorthand.
^denotesamorphemeboundary.
#denotesawordboundary.
![Page 30: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/30.jpg)
EnglishSpellingGettingbacktofox+s =foxes
![Page 31: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/31.jpg)
TheEInsertionRuleasaFST
✏ ! e/
8<
:
s
x
z
9=
; ^ s#
Generateanormallyspelledwordfromanabstractrepresentationofthemorphemes:
Input:fox^s#(fox^εs#)Output:foxes#(foxεes#)
![Page 32: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/32.jpg)
TheEInsertionRuleasaFST
✏ ! e/
8<
:
s
x
z
9=
; ^ s#
Parseanormallyspelledwordintoanabstractrepresentationofthemorphemes:
Input:foxes#(foxεes#)Output:fox^s#(fox^εs#)
![Page 33: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/33.jpg)
CombiningFSTsparse
generate
![Page 34: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/34.jpg)
FSTOperations
Input:fox+N+plOutput:foxes#
![Page 35: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/35.jpg)
Stemming(“PoorMan’sMorphology”)
Input:awordOutput:theword’sstem(approximately)
ExamplesfromthePorterstemmer:•-sses→-ss•-ies→i•-ss→s
![Page 36: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/36.jpg)
nonoahnob
nobilitynobisnoble
noblemannoblemennobleness
noblernobles
noblessenoblestnobly
nobodynocesnod
noddednoddingnoddlenoddlesnoddynods
nonoahnobnobilnobinoblnoblemannoblemennoblnoblernoblnoblessnoblestnoblinobodinocenodnodnodnoddlnoddlnoddinod
![Page 37: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/37.jpg)
Conclusion
• Finitestatemethodsprovideasimpleandpowerfulmeansofgeneratingandanalyzingwords(aswellasthephonologicalalternationsthataccompanywordformation/inflection).• Straightforwardconcatenative morphologyiseasytoimplementusingfinitestatemethods.• Otherphenomenaareeasiesttocapturewithextensionstothefinitestateparadigm.• Co-occurrencerestrictions—flagdiacritics.• Non-concatenative morphology—compile-replace algorithm.Purefinitestate,butcomputedinanovelfashion.
![Page 38: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/38.jpg)
![Page 39: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/39.jpg)
Conclusion
• Finitestatemethodsprovideasimpleandpowerfulmeansofgeneratingandanalyzingwords(aswellasthephonologicalalternationsthataccompanywordformation/inflection).• Straightforwardconcatenative morphologyiseasytoimplementusingfinitestatemethods.• Otherphenomenaareeasiesttocapturewithextensionstothefinitestateparadigm.• Co-occurrencerestrictions—flagdiacritics.• Non-concatenative morphology—compile-replace algorithm.Purefinitestate,butcomputedinanovelfashion.
![Page 40: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/40.jpg)
LanguageComparisonwrt FSTs
• Morphologiesofalltypescanbeanalyzedusingfinitestatemethods.• Somepresentmorechallengesthanothers.• Analyticlanguages.Trivial,sincethereislittleornomorphology(otherthancompounding).• Agglutinatinglanguages.Straightforward—finitestatemorphologywas“made”forlanguageslikethis.• Polysyntheticlanguages.Similartoagglutinatinglanguages,butwithblurredlinesbetweenmorphologyandsyntax.• Fusional languages. Easyenoughtoanalyzeusingfinitestatemethodaslongasoneallows“morphemes”tohavelotsofsimultaneousmeaningsandoneiswillingtoemploysomeadditionaltricks.• Root-and-patternlanguages. Requiresomeveryclevertricks.
![Page 41: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/41.jpg)
TheGoodNews
• Morethanalmostanyotherproblemincomputationallinguistics,morphologyisasolvedproblem(aslongasyoucanaffordtowriterulesbyhand).• Finitestatemorphologyisoneofthegreatsuccessesofnaturallanguageprocessing.• OnebrilliantaspectofusingFSTsformorphology:thesamecode canhandlebothanalysis andgeneration.
![Page 42: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/42.jpg)
Tools
• Therearespecialfinitestatetoolkitsforbuildingmorphologicaltools(andotherlinguistictools).• Thebest-knownoftheseistheXeroxFiniteStateTool orXFST,whichoriginatedatXeroxPARC.• Thereareopensourcereimplementations ofXFSTcalledHFST(HelsinkiFiniteStateTechnology)andFoma,whicharenotasfullyoptimizedasXFSTbutwhicharesometimesmorepleasanttouse.• NoneofthesetoolsallowtheconstructionofweightedFSTs.
![Page 43: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/43.jpg)
MapudunguncomparedtoSpanishMapudungunispolysyntheticSpanishisfusional
0
20
40
60
80
100
120
140
0 500 1,000 1,500
Typ
es, i
n T
hous
ands
Tokens, in Thousands
Mapudungun Spanish
![Page 44: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/44.jpg)
Telugu,Tamil,Kannada,MalayalamDravidianlanguages
• AgglutinatinglikeTurkish,Finnish,andSwahili
![Page 45: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/45.jpg)
Hindi,Urdu,Bengali,Marathi,Punjabi,etc.Indo-european• AlittlericherthanEnglish• LikeEnglish,usesauxiliaryverbsandseparatewordstoexpressthingsthatareaffixesontheverbsinDravidianlanguages.• want,have,be,make,etc.
![Page 46: Words and Morphology - Carnegie Mellon School of …tbergkir/11711fa16/fa16_11711_lecture23.pdf · Words and Morphology ... • Verbs agree with nouns in noun class. ... Can you make](https://reader031.vdocuments.us/reader031/viewer/2022022602/5b5a29b27f8b9a01748b5cb9/html5/thumbnails/46.jpg)
MoreThanMereConcatenation
• Reduplication. Repeatingallorpartofawordasamorphologicaloperation.• Infixation. Insertinganaffix intoabase.• Root-and-patternmorphology. Interdigitation inSemiticanditsrelatives.• Others.Apophony,includingtheumlautinEnglishtooth→teeth;subtractivemorphology,includingthetruncation inEnglishnicknameformation(David→Dave);andsoon.