lecture 12: informa1on extrac1on

Lecture12:Informa1onExtrac1on

ThisLecture

‣ Howdowerepresentinforma1onforinforma1onextrac1on?

‣ OpenInforma1onExtrac1on

‣ Rela1onextrac1on

‣ Slotfilling

‣ Seman1crolelabeling/abstractmeaningrepresenta1on

Represen1ngInforma1on

Seman1cRepresenta1ons

Examplecredit:AsadSayeed

personBrutusCaesarObamaBush…

stabBrutus Caesar

‣ “World”isasetofen11esandpredicates

president

Bush…

stabBrutus Caesar

president

Bush…

‣ Statementsarelogicalexpressionsthatevaluatetotrueorfalse

stabBrutus Caesar

president

Bush…

BrutusstabsCaesar

stabBrutus Caesar

president

Bush…

BrutusstabsCaesar stab(Brutus,Caesar)=>true

stabBrutus Caesar

president

Bush…

Caesarwasstabbed

stabBrutus Caesar

president

Bush…

Caesarwasstabbed ∃xstab(x,Caesar)=>true

Neo-DavidsonianEvents

BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch

∃estabs(e,Brutus,Caesar)

∃estabs(e,Brutus,Caesar)∧with(e,knife)

∃estabs(e,Brutus,Caesar)∧with(e,knife) ∧loca1on(e,theater)

∧1me(e,IdesofMarch)

‣ Letsusdescribeeventsashavingproper1es

∧with(e,knife) ∧loca1on(e,theater)

‣ Letsusdescribeeventsashavingproper1es‣ Unifiedrepresenta1onofeventsanden11es:

somecleverdriverinAmerica

∃xdriver(x)∧clever(x)∧loca1on(x,America)

somecleverdriverinAmerica

RealText

BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw.

RealText

∃esign(e,BarackObama)∧pa1ent(e,ACA)∧1me(e,Tuesday)

RealText

BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw. whichTuesday?

RealText

who?whichaYernoon?

RealText

whichaYernoon?

RealText

‣ Needtoimputemissinginforma1on,resolvecoreference,etc.

whichaYernoon?

RealText

‣ Needtoimputemissinginforma1on,resolvecoreference,etc.

‣ S1llunclearhowtorepresentsomethingspreciselyorhowthatinforma1oncouldbeleveraged(severalprominentRepublicans)

whichaYernoon?

OtherChallenges

BobandAlicewerefriendsunGlhemovedawaytoaHendcollege

OtherChallenges

∃e1∃e2friends(e1,Bob,Alice)∧moved(e2,Bob)∧end_of(e1,e2)

OtherChallenges

‣ Howtorepresenttemporalinforma1on?

OtherChallenges

BobandAlicewerefriendsunGlaroundthe+mehemovedawaytoaHendcollege

OtherChallenges

‣ Represen1ngtrulyopen-domaininforma1onisverycomplicated!Wedon’thaveaformalrepresenta1onthatcancaptureeverything

BobandAlicewerefriendsunGlaroundthe+mehemovedawaytoaHendcollege

(Atleast)ThreeSolu1ons

(Atleast)ThreeSolu1ons‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…

‣ Slotfilling:specificontology,populateinforma1oninapredefinedway

(Atleast)ThreeSolu1ons‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…

(Earthquake:magnitude=8.0,epicenter=centralItaly,…)

‣ En1ty-rela1on-en1tytriples:focusonen11esandtheirrela1ons(notethatprominenteventscans1llbeen11es)

‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…

‣ En1ty-rela1on-en1tytriples:focusonen11esandtheirrela1ons(notethatprominenteventscans1llbeen11es)

(LadyGaga,singerOf,BadRomance)

‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…

OpenIE‣ En1ty-rela1on-en1tytriplesaren’tnecessarilygroundedinanontology

‣ Extractstringsandletadownstreamsystemfigureitout

(BarackObama,signed,theAffordableCareact)

(SeveralprominentRepublicans,denounce,thenewlaw)

IE:TheBigPicture

‣ Howdowerepresentinforma1on?Whatdoweextract?

‣ Slotfillers‣ En1ty-rela1on-en1tytriples(fixedontologyoropen)

‣ Seman1croles

‣ Abstractmeaningrepresenta1on

Seman1cRoleLabeling/ AbstractMeaningRepresenta1on

Seman1cRoleLabeling

FigurefromHeetal.(2017)

Seman1cRoleLabeling

‣ Iden1fypredicate,disambiguateit,iden1fythatpredicate’sarguments

Seman1cRoleLabeling

‣ VerbrolesfromPropbank(Palmeretal.,2005)

Seman1cRoleLabeling

‣ VerbrolesfromPropbank(Palmeretal.,2005)

quicken:

Seman1cRoleLabeling

‣ Iden1fypredicates(love)usingaclassifier(notshown)

Seman1cRoleLabeling

‣ Iden1fyARG0,ARG1,etc.asataggingtaskwithaBiLSTMcondi1onedonlove

Seman1cRoleLabeling

‣ Iden1fyARG0,ARG1,etc.asataggingtaskwithaBiLSTMcondi1onedonlove

‣ Othersystemsincorporatesyntax,jointpredicate-argumentfinding

SRLforQA

ShenandLapata(2007)

‣ Ques1onandseveralanswercandidates

Q:Whodiscoveredprions?

AC1:In1997,StanleyB.Prusiner,ascienGstintheUnitedStates,discoveredprions…

AC2:Prionswereresearchedby…

SRLforQA

ShenandLapata(2007)

SRLforQA

ShenandLapata(2007)

SRLforQA

ShenandLapata(2007)

Scorebymatchingexpectedanswerphrase(EAP)againstanswercandidate(AC)

AbstractMeaningRepresenta1on

‣ Graph-structuredannota1on

Theboywantstogo

Banarescuetal.(2014)

Theboywantstogo

‣ SupersetofSRL:fullsentenceanalyses,containscoreferenceandmul1-wordexpressionsaswell

Theboywantstogo

‣ F1scoresinthe60s:hard!

Theboywantstogo

‣ F1scoresinthe60s:hard!

‣ Socomprehensivethatit’shardtopredict,buts1lldoesn’thandletenseorsomeotherthings…

Summariza1onwithAMR

Liuetal.(2015)

Summariza1onwithAMR

Liuetal.(2015)

‣MergeAMRsacrossmul1plesentences

Summariza1onwithAMR

Liuetal.(2015)

‣ Summariza1on=subgraphextrac1on

Summariza1onwithAMR

Liuetal.(2015)

‣ Summariza1on=subgraphextrac1on

‣ Norealsystemsactuallyworkthisway(morewhenwetalkaboutsummariza1on)

SlotFilling

SlotFilling‣Mostconserva1ve,narrowformofIE

FreitagandMcCallum(2000)

IndianExpress—Amassiveearthquakeofmagnitude7.3struckIraqonSunday,103kms(64miles)southeastofthecityofAs-Sulaymaniyah,theUSGeologicalSurveysaid,reportsReuters.USGeologicalSurveyiniGallysaidthequakewasofamagnitude7.2,beforerevisingitto7.3.

magnitude time

epicenter

magnitude time

epicenter

Speaker:AlanClark

“GenderRolesintheHolyRomanEmpire”

AllagherCenterMainAuditorium

Thistalkwilldiscuss…

speakertitle

location

magnitude time

epicenter

Speaker:AlanClark

“GenderRolesintheHolyRomanEmpire”

AllagherCenterMainAuditorium

Thistalkwilldiscuss…

speakertitle

location

‣ Oldwork:HMMs,laterCRFstrainedperrole

SlotFilling:MUC

HaghighiandKlein(2010)

‣ Keyaspect:needtocombineinforma1onacrossmul1plemen1onsofanen1tyusingcoreference

SlotFilling:Forums

‣ Extractproductoccurrencesincybercrimeforums,butnoteverythingthatlookslikeaproductisaproduct

Portnoffetal.(2017),Durrenetal.(2017)Notaproductinthiscontext

Rela1onExtrac1on

Rela1onExtrac1on‣ Extracten1ty-rela1on-en1tytriplesfromafixedinventory

ACE(2003-2005)

DuringthewarinIraq,AmericanjournalistsweresomeGmescaughtinthelineoffire

ACE(2003-2005)

Located_In

Na1onality

ACE(2003-2005)

Located_In

Na1onality

‣ UseNER-likesystemtoiden1fyen1tyspans,classifyrela1onsbetweenen1typairswithaclassifier

ACE(2003-2005)

Located_In

‣ Systemscanbefeature-basedorneural,lookatsurfacewords,syntac1cfeatures(dependencypaths),seman1croles

Na1onality

ACE(2003-2005)

Located_In

‣ Systemscanbefeature-basedorneural,lookatsurfacewords,syntac1cfeatures(dependencypaths),seman1croles

Na1onality

‣ Problem:limiteddataforscalingtobigontologies

HearstPanerns

‣ Syntac1cpanernsespeciallyforfindinghypernym-hyponympairs(“isa”rela1ons)

HearstPanerns

Hearst(1992)

HearstPanerns

Hearst(1992)

BerlinisacityYisaX

HearstPanerns

Hearst(1992)

Xsuchas[list] ciGessuchasBerlin,Paris,andLondon.

BerlinisacityYisaX

HearstPanerns

Hearst(1992)

Berlinisacity

otherciGesincludingBerlin

otherXincludingY

HearstPanerns

Hearst(1992)

Berlinisacity

otherciGesincludingBerlin

otherXincludingY

‣ Totallyunsupervisedwayofharves1ngworldknowledgefortaskslikeparsingandcoreference(BansalandKlein,2011-2012)

DistantSupervision

Mintzetal.(2009)

DistantSupervision

Mintzetal.(2009)

‣ Lotsofrela1onsinourknowledgebasealready(e.g.,23,000film-directorrela1ons);usethesetobootstrapmoretrainingdata

DistantSupervision

Mintzetal.(2009)

‣ Iftwoen11esinarela1onappearinthesamesentence,assumethesentenceexpressestherela1on

DistantSupervision

Mintzetal.(2009)

[StevenSpielberg]’sfilm[SavingPrivateRyan]islooselybasedonthebrothers’story

Director

DistantSupervision

Mintzetal.(2009)

[StevenSpielberg]’sfilm[SavingPrivateRyan]islooselybasedonthebrothers’story

Allisonco-producedtheAcademyAward-winning[SavingPrivateRyan],directedby[StevenSpielberg]

Director

DistantSupervision

Mintzetal.(2009)

‣ Learndecentlyaccurateclassifiersfor~100Freebaserela1ons‣ Couldbeusedtocrawlthewebandexpandourknowledgebase

OpenIE

OpenInforma1onExtrac1on

‣ Typicallynofixedrela1oninventory

‣ “Open”ness—wanttobeabletoextractallkindsofinforma1onfromopen-domaintext

‣ Acquirecommonsenseknowledgejustfrom“reading”aboutit,butneedtoprocesslotsoftext(“machinereading”)

TextRunner‣ Extractposi1veexamplesof(e,r,e)triplesviaparsingandheuris1cs

‣ TrainaNaiveBayesclassifiertofiltertriplesfromrawtext:usesfeaturesonPOStags,lexicalfeatures,stopwords,etc.

Bankoetal.(2007)

BarackObama,44thpresidentoftheUnitedStates,wasbornonAugust4,1961inHonolulu

=>Barack_Obama,wasbornin,Honolulu

Bankoetal.(2007)

‣ 80xfasterthanrunningaparser(whichwasslowin2007…)

Bankoetal.(2007)

‣ 80xfasterthanrunningaparser(whichwasslowin2007…)

Bankoetal.(2007)

‣ Usemul1pleinstancesofextrac1onstoassignprobabilitytoarela1on

Exploi1ngRedundancy

Bankoetal.(2007)

Exploi1ngRedundancy

Bankoetal.(2007)

‣ 9Mwebpages/133Msentences

Exploi1ngRedundancy

Bankoetal.(2007)

‣ 2.2tuplesextractedpersentence,filterbasedonprobabili1es

Exploi1ngRedundancy

Bankoetal.(2007)

‣ Concrete:definitelytrueAbstract:possiblytruebutunderspecified

Exploi1ngRedundancy

Bankoetal.(2007)

‣ Concrete:definitelytrueAbstract:possiblytruebutunderspecified

‣ Hardtoevaluate:canassessprecision ofextractedfacts,buthowdoweknowrecall?

ReVerb

Faderetal.(2011)

‣Moreconstraints:openrela1onshavetobeginwithverb,endwithpreposi1on,becon1guous(e.g.,wasbornon)

ReVerb

Faderetal.(2011)

‣Moreconstraints:openrela1onshavetobeginwithverb,endwithpreposi1on,becon1guous(e.g.,wasbornon)

‣ Extractmoremeaningfulrela1ons,par1cularlywithlightverbs

ReVerb

Faderetal.(2011)

‣ Foreachverb,iden1fythelongestsequenceofwordsfollowingtheverbthatsa1sfyaPOSregex(V.*P)andwhichsa1sfyheuris1clexicalconstraintsonspecificity

‣ Findthenearestargumentsoneithersideoftherela1on

ReVerb

Faderetal.(2011)

‣ Foreachverb,iden1fythelongestsequenceofwordsfollowingtheverbthatsa1sfyaPOSregex(V.*P)andwhichsa1sfyheuris1clexicalconstraintsonspecificity

‣ Findthenearestargumentsoneithersideoftherela1on

‣ Annotatorslabeledrela1onsin500documentstoassessrecall

QAfromOpenIE

Choietal.(2015)

Takeaways

‣ Rela1onextrac1on:cancollectdatawithdistantsupervision,usethistoexpandknowledgebases

‣ Slotfilling:1edtoaspecificontology,butgivesfine-grainedinforma1on

‣ OpenIE:extractslotsofthings,buthardtoknowhowgoodorusefultheyare

‣ Cancombinewithstandardques1onanswering

‣ Addnewfactstoknowledgebases

‣ SRL/AMR:handleabunchofphenomena,butmoreorlesslikesyntax++intermsofwhattheyrepresent

‣Many,manyapplica1onsandtechniques

lecture 12: informa1on extrac1on

Documents

pathology, lecture 12 (lecture notes)

lecture 12 - chapter 12

lecture 12

lecture 12:

lecture #12

lecture 12

lecture 12

12 lecture