learning semantic correspondences with less...
TRANSCRIPT
![Page 1: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/1.jpg)
Learning Semantic Correspondenceswith Less Supervision
ACL 2009 – Singapore
Percy Liang Michael I. Jordan Dan Klein
![Page 2: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/2.jpg)
Grounded semantics
2
![Page 3: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/3.jpg)
Grounded semantics
temperature(time=17-30,min=43,mean=44,max=47)windChill(time=17-30,min=37,mean=38,max=42)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)windDir(time=17-30,mode=SE)gust(time=17-30,min=0,mean=0,max=0)skyCover(time=17-26,mode=50-75)skyCover(time=26-30,mode=75-100)precipPotential(time=17-30,min=5,mean=26,max=75)thunderChance(time=17-26,mode=--)thunderChance(time=26-30,mode=--)rainChance(time=17-26,mode=--)rainChance(time=26-30,mode=Chc)snowChance(time=17-26,mode=--)snowChance(time=26-30,mode=--)freezingRainChance(time=17-26,mode=--)freezingRainChance(time=26-30,mode=--)sleetChance(time=17-26,mode=--)sleetChance(time=26-30,mode=--). . .
Low around 43 .South wind between 10 and 14 mph .Chance of precipitation is 80 % .Occasional rain after 3am .
2
![Page 4: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/4.jpg)
Grounded semantics
temperature(time=17-30,min=43,mean=44,max=47)windChill(time=17-30,min=37,mean=38,max=42)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)windDir(time=17-30,mode=SE)gust(time=17-30,min=0,mean=0,max=0)skyCover(time=17-26,mode=50-75)skyCover(time=26-30,mode=75-100)precipPotential(time=17-30,min=5,mean=26,max=75)thunderChance(time=17-26,mode=--)thunderChance(time=26-30,mode=--)rainChance(time=17-26,mode=--)rainChance(time=26-30,mode=Chc)snowChance(time=17-26,mode=--)snowChance(time=26-30,mode=--)freezingRainChance(time=17-26,mode=--)freezingRainChance(time=26-30,mode=--)sleetChance(time=17-26,mode=--)sleetChance(time=26-30,mode=--). . .
Low around 43 .South wind between 10 and 14 mph .Chance of precipitation is 80 % .Occasional rain after 3am .
2
![Page 5: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/5.jpg)
Grounded semantics
temperature(time=17-30,min=43,mean=44,max=47)windChill(time=17-30,min=37,mean=38,max=42)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)windDir(time=17-30,mode=SE)gust(time=17-30,min=0,mean=0,max=0)skyCover(time=17-26,mode=50-75)skyCover(time=26-30,mode=75-100)precipPotential(time=17-30,min=5,mean=26,max=75)thunderChance(time=17-26,mode=--)thunderChance(time=26-30,mode=--)rainChance(time=17-26,mode=--)rainChance(time=26-30,mode=Chc)snowChance(time=17-26,mode=--)snowChance(time=26-30,mode=--)freezingRainChance(time=17-26,mode=--)freezingRainChance(time=26-30,mode=--)sleetChance(time=17-26,mode=--)sleetChance(time=26-30,mode=--). . .
Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % . ‖Occasional rain after 3am .
Big question:
Which (tiny) part of the world is referenced by the text?
2
![Page 6: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/6.jpg)
Related work
Supervised [Ge & Mooney, 2005; Zettlemoyer & Collins, 2005; Lu et al., 2008]
λx.flight(x) ∧ dest(x, Boston) Show me all flights to Boston
3
![Page 7: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/7.jpg)
Related work
Supervised [Ge & Mooney, 2005; Zettlemoyer & Collins, 2005; Lu et al., 2008]
λx.flight(x) ∧ dest(x, Boston) Show me all flights to Boston
Partially-supervised [Kate & Mooney, 2007; Chen & Mooney, 2008]
ballstopped()badPass(arg1=pink11,arg2=purple3)
kick(arg1=pink11)turnover(arg1=pink11,arg2=purple3)
pink11 makes a bad pass and was picked off by purple3
3
![Page 8: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/8.jpg)
Related work
Supervised [Ge & Mooney, 2005; Zettlemoyer & Collins, 2005; Lu et al., 2008]
λx.flight(x) ∧ dest(x, Boston) Show me all flights to Boston
Partially-supervised [Kate & Mooney, 2007; Chen & Mooney, 2008]
ballstopped()badPass(arg1=pink11,arg2=purple3)
kick(arg1=pink11)turnover(arg1=pink11,arg2=purple3)
pink11 makes a bad pass and was picked off by purple3
Language acquisition [Siskind, 1996; Yu & Ballard, 2007; Frank et al., 2009]
How do children connect language with perception?
3
![Page 9: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/9.jpg)
Related work
Supervised [Ge & Mooney, 2005; Zettlemoyer & Collins, 2005; Lu et al., 2008]
λx.flight(x) ∧ dest(x, Boston) Show me all flights to Boston
Partially-supervised [Kate & Mooney, 2007; Chen & Mooney, 2008]
ballstopped()badPass(arg1=pink11,arg2=purple3)
kick(arg1=pink11)turnover(arg1=pink11,arg2=purple3)
pink11 makes a bad pass and was picked off by purple3
Language acquisition [Siskind, 1996; Yu & Ballard, 2007; Frank et al., 2009]
How do children connect language with perception?
Reinforcement learning from rewards [Branavan et al., 2009]
Clustering-based [Poon & Domingos, 2009]
...
3
![Page 10: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/10.jpg)
Problem statement
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
s: world state
set of records;each record is a set of(field=value) pairs
4
![Page 11: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/11.jpg)
Problem statement
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
Occasional rain after 3am .Low around 43 .South wind between 10 and 14 mph .Chance of precipitation is 80 % .
s: world state
set of records;each record is a set of(field=value) pairs
w: text
sequence of words
4
![Page 12: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/12.jpg)
Problem statement
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
Occasional rain after 3am . ‖Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % .
s: world state
set of records;each record is a set of(field=value) pairs
a: correspondence
segmentation of w;for each segment,which record and fields
w: text
sequence of words
4
![Page 13: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/13.jpg)
Problem statement
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
Occasional rain after 3am . ‖Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % .
s: world state
set of records;each record is a set of(field=value) pairs
a: correspondence
segmentation of w;for each segment,which record and fields
w: text
sequence of words
The task (unsupervised induction):
scenarios {(s(i),w(i))}ni=1 correspondences {a(i)}n
i=1
4
![Page 14: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/14.jpg)
Data characteristics
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
s
w:Occasional rain after 3am . ‖Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % .
5
![Page 15: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/15.jpg)
Data characteristics
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
s
w:Occasional rain after 3am . ‖Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % .
Referential ambiguity: what is being talked about?(e.g., low is about temperature or wind speed?)
5
![Page 16: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/16.jpg)
Data characteristics
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
s
w:Occasional rain after 3am . ‖Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % .
Referential ambiguity: what is being talked about?(e.g., low is about temperature or wind speed?)
Lexical variety: a field value can be realized in multiple ways(e.g., SE maps to southeast or south or east)
5
![Page 17: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/17.jpg)
Data characteristics
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
s
w:Occasional rain after 3am . ‖Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % .
Referential ambiguity: what is being talked about?(e.g., low is about temperature or wind speed?)
Lexical variety: a field value can be realized in multiple ways(e.g., SE maps to southeast or south or east)
Segmentation: if start a new record, persist a while(e.g., low around 43 . references a single record)
5
![Page 18: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/18.jpg)
Data characteristics
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
s
w:Occasional rain after 3am . ‖Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % .
Referential ambiguity: what is being talked about?(e.g., low is about temperature or wind speed?)
Lexical variety: a field value can be realized in multiple ways(e.g., SE maps to southeast or south or east)
Segmentation: if start a new record, persist a while(e.g., low around 43 . references a single record)
Coherence: talk about records/fields in a certain order(e.g., windSpeed typically follows windDir)
5
![Page 19: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/19.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
6
![Page 20: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/20.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
6
![Page 21: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/21.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
mode=SSE
6
![Page 22: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/22.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
mode=SSE
south6
![Page 23: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/23.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
mode=SSE
south southeast6
![Page 24: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/24.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
mode=SSE
south southeast
∅
6
![Page 25: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/25.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
mode=SSE
south southeast
∅
wind6
![Page 26: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/26.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
mode=SSE
south southeast
∅
wind
R3
6
![Page 27: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/27.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
mode=SSE
south southeast
∅
wind
R3
∅
between6
![Page 28: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/28.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
mode=SSE
south southeast
∅
wind
R3
∅
between
min=11
10
∅
and
max=13
15
∅
mph6
![Page 29: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/29.jpg)
Proposed solution
Define a probabilistic model p(w,a | s)An example:
temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SSE)windSpeed(time=17-30,min=11,mean=12,max=13,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)...
s
R2
mode=SSE
south southeast
∅
wind
R3
∅
between
min=11
10
∅
and
max=13
15
∅
mph
...
6
![Page 30: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/30.jpg)
Lexical model
x
windSpeed.min=11
exact/round/geometric error
10
7
![Page 31: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/31.jpg)
Lexical model
x
windSpeed.min=11
exact/round/geometric error
10
x
skyCover.mode=0-25
unconstrained
clear
7
![Page 32: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/32.jpg)
Lexical model
x
windSpeed.min=11
exact/round/geometric error
10
x
skyCover.mode=0-25
unconstrained
clear
x
name=Moe Williams
splice out
Williams
7
![Page 33: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/33.jpg)
Lexical model
Integer
windSpeed.min=11
exact/round/geometric error
10 11 15 12
x
skyCover.mode=0-25
unconstrained
clear
x
name=Moe Williams
splice out
Williams
7
![Page 34: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/34.jpg)
Lexical model
Integer
windSpeed.min=11
exact/round/geometric error
10 11 15 12
x
skyCover.mode=0-25
unconstrained
clear
x
name=Moe Williams
splice out
Williams
Learned distributions:
windSpeed.min
6 7 8 9 10 11 12 13 14 15 16
w
0.1
0.2
0.3
0.4
0.6
p(w
|v=
11)
7
![Page 35: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/35.jpg)
Lexical model
Integer
windSpeed.min=11
exact/round/geometric error
10 11 15 12
Categorical
skyCover.mode=0-25
unconstrained
clear sunny
x
name=Moe Williams
splice out
Williams
Learned distributions:
windSpeed.min
6 7 8 9 10 11 12 13 14 15 16
w
0.1
0.2
0.3
0.4
0.6
p(w
|v=
11)
7
![Page 36: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/36.jpg)
Lexical model
Integer
windSpeed.min=11
exact/round/geometric error
10 11 15 12
Categorical
skyCover.mode=0-25
unconstrained
clear sunny
x
name=Moe Williams
splice out
Williams
Learned distributions:
windSpeed.min
6 7 8 9 10 11 12 13 14 15 16
w
0.1
0.2
0.3
0.4
0.6
p(w
|v=
11)
skyCover.mode0-25
,clear
mostlysunny
25-50partly
,cloudy
increasing
50-75mostlycloudy
,partly
75-100of
inchan
possiblenewa
rainfall
7
![Page 37: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/37.jpg)
Lexical model
Integer
windSpeed.min=11
exact/round/geometric error
10 11 15 12
Categorical
skyCover.mode=0-25
unconstrained
clear sunny
String
name=Moe Williams
splice out
Williams Moe
Learned distributions:
windSpeed.min
6 7 8 9 10 11 12 13 14 15 16
w
0.1
0.2
0.3
0.4
0.6
p(w
|v=
11)
skyCover.mode0-25
,clear
mostlysunny
25-50partly
,cloudy
increasing
50-75mostlycloudy
,partly
75-100of
inchan
possiblenewa
rainfall
7
![Page 38: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/38.jpg)
Generative model
Hierarchical semi-Markov model p(w, c, r, f | s; θ):s
r
f
c,w
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
Record choice
Field choice
Word choice
8
![Page 39: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/39.jpg)
Generative model
Hierarchical semi-Markov model p(w, c, r, f | s; θ):s
r
f
c,w
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
Record choice
Field choice
Word choice
Objective: maximize likelihood (marginalize out a = (c, r, f))
maxθ∑ni=1 log p(w(i) | s(i); θ)
8
![Page 40: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/40.jpg)
Generative model
Hierarchical semi-Markov model p(w, c, r, f | s; θ):s
r
f
c,w
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
Record choice
Field choice
Word choice
Objective: maximize likelihood (marginalize out a = (c, r, f))
maxθ∑ni=1 log p(w(i) | s(i); θ)
Why likelihood?
8
![Page 41: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/41.jpg)
Generative model
Hierarchical semi-Markov model p(w, c, r, f | s; θ):s
r
f
c,w
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
Record choice
Field choice
Word choice
Objective: maximize likelihood (marginalize out a = (c, r, f))
maxθ∑ni=1 log p(w(i) | s(i); θ)
Why likelihood?
• To make w likely, use a to correspond co-occurring things
8
![Page 42: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/42.jpg)
Generative model
Hierarchical semi-Markov model p(w, c, r, f | s; θ):s
r
f
c,w
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
Record choice
Field choice
Word choice
Objective: maximize likelihood (marginalize out a = (c, r, f))
maxθ∑ni=1 log p(w(i) | s(i); θ)
Why likelihood?
• To make w likely, use a to correspond co-occurring things
• w | s because text only mentions small part of world state8
![Page 43: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/43.jpg)
Alternate models
Model 3coherence:
segmentation:
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
9
![Page 44: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/44.jpg)
Alternate models
Model 3coherence:
segmentation:
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
Model 2coherence:
segmentation:
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
9
![Page 45: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/45.jpg)
Alternate models
Model 3coherence:
segmentation:
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
Model 2coherence:
segmentation:
s
r1
f11
w1 · · · w
c11
· · ·
· · · ri
fi1
w · · · w
ci1
· · · fi|fi|
w · · · w
ci|fi|
· · · rn
· · · fn|fn|
w · · · w|w|
cn|fn|
Model 1coherence:
segmentation:
s
r1
f1
w1
· · · ri
fi
w
· · · rn
fn
w|w|
9
![Page 46: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/46.jpg)
Experiments overview
Datasets:
• Weather forecasts [Liang et al., 2009]
• Robocup sportscasting [Chen & Mooney, 2008]
• NFL recaps [Barzilay & Lapata, 2005; Snyder & Barzilay, 2007]
10
![Page 47: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/47.jpg)
Experiments overview
Datasets:
• Weather forecasts [Liang et al., 2009]
• Robocup sportscasting [Chen & Mooney, 2008]
• NFL recaps [Barzilay & Lapata, 2005; Snyder & Barzilay, 2007]
Evaluation:
F1 on coarse record-level alignments
(although model produces finer correspondence)
10
![Page 48: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/48.jpg)
Experiments: weather forecasts
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
s
w:Occasional rain after 3am . ‖Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % .
Dataset (scraped weather.gov: 3 days, 3.7K US cities)
11
![Page 49: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/49.jpg)
Experiments: weather forecasts
rainChance(time=26-30,mode=Chc)temperature(time=17-30,min=43,mean=44,max=47)windDir(time=17-30,mode=SE)windSpeed(time=17-30,min=11,mean=12,max=14,mode=10-20)precipPotential(time=17-30,min=5,mean=26,max=75)windChill(time=17-30,min=37,mean=38,max=42)skyCover(time=17-30,mode=50-75). . .
s
w:Occasional rain after 3am . ‖Low around 43 . ‖South wind ‖ between 10 and 14 mph . ‖Chance of precipitation is 80 % .
Dataset (scraped weather.gov: 3 days, 3.7K US cities)
22K scenarios
Each scenario contains|s| = 36 records, |w| = 28.7 words/text, 5.8 gold alignments
11
![Page 50: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/50.jpg)
Experiments: weather forecasts (results)
[Model 1] segmentation: coherence: (60.0 F1)
12
![Page 51: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/51.jpg)
Experiments: weather forecasts (results)
[Model 1] segmentation: coherence: (60.0 F1)r:f :w: cloudy , with a
windDir
time=6-21high near
temperature
max=6363 .
windDir
mode=SEeast southeast wind between
windSpeed
min=55 and
windSpeed
mean=911 mph .
+ aligns many content words
12
![Page 52: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/52.jpg)
Experiments: weather forecasts (results)
[Model 1] segmentation: coherence: (60.0 F1)r:f :w: cloudy , with a
windDir
time=6-21high near
temperature
max=6363 .
windDir
mode=SEeast southeast wind between
windSpeed
min=55 and
windSpeed
mean=911 mph .
+ aligns many content words − misses wind, cloudy
12
![Page 53: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/53.jpg)
Experiments: weather forecasts (results)
[Model 1] segmentation: coherence: (60.0 F1)r:f :w: cloudy , with a
windDir
time=6-21high near
temperature
max=6363 .
windDir
mode=SEeast southeast wind between
windSpeed
min=55 and
windSpeed
mean=911 mph .
+ aligns many content words − misses wind, cloudy
[Model 2] segmentation: coherence: (68.8 F1)
12
![Page 54: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/54.jpg)
Experiments: weather forecasts (results)
[Model 1] segmentation: coherence: (60.0 F1)r:f :w: cloudy , with a
windDir
time=6-21high near
temperature
max=6363 .
windDir
mode=SEeast southeast wind between
windSpeed
min=55 and
windSpeed
mean=911 mph .
+ aligns many content words − misses wind, cloudy
[Model 2] segmentation: coherence: (68.8 F1)r:f :w:
rainChance
mode=–cloudy ,
temperature
xwith a
time=6-21high near
max=6363 .
windDir
mode=SEeast southeast wind
xbetween 5 and
windSpeed
mean=911 mph .
+ aligns more continuously
12
![Page 55: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/55.jpg)
Experiments: weather forecasts (results)
[Model 1] segmentation: coherence: (60.0 F1)r:
f :w: cloudy , with a
windDir
time=6-21high near
temperature
max=6363 .
windDir
mode=SEeast southeast wind between
windSpeed
min=55 and
windSpeed
mean=911 mph .
+ aligns many content words − misses wind, cloudy
[Model 2] segmentation: coherence: (68.8 F1)r:
f :w:
rainChance
mode=–cloudy ,
temperature
xwith a
time=6-21high near
max=6363 .
windDir
mode=SEeast southeast wind
xbetween 5 and
windSpeed
mean=911 mph .
+ aligns more continuously − wrong field structure for windSpeed
12
![Page 56: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/56.jpg)
Experiments: weather forecasts (results)
[Model 1] segmentation: coherence: (60.0 F1)r:
f :w: cloudy , with a
windDir
time=6-21high near
temperature
max=6363 .
windDir
mode=SEeast southeast wind between
windSpeed
min=55 and
windSpeed
mean=911 mph .
+ aligns many content words − misses wind, cloudy
[Model 2] segmentation: coherence: (68.8 F1)r:
f :w:
rainChance
mode=–cloudy ,
temperature
xwith a
time=6-21high near
max=6363 .
windDir
mode=SEeast southeast wind
xbetween 5 and
windSpeed
mean=911 mph .
+ aligns more continuously − wrong field structure for windSpeed
[Model 3] segmentation: coherence: (75.0 F1)
12
![Page 57: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/57.jpg)
Experiments: weather forecasts (results)
[Model 1] segmentation: coherence: (60.0 F1)r:
f :w: cloudy , with a
windDir
time=6-21high near
temperature
max=6363 .
windDir
mode=SEeast southeast wind between
windSpeed
min=55 and
windSpeed
mean=911 mph .
+ aligns many content words − misses wind, cloudy
[Model 2] segmentation: coherence: (68.8 F1)r:
f :w:
rainChance
mode=–cloudy ,
temperature
xwith a
time=6-21high near
max=6363 .
windDir
mode=SEeast southeast wind
xbetween 5 and
windSpeed
mean=911 mph .
+ aligns more continuously − wrong field structure for windSpeed
[Model 3] segmentation: coherence: (75.0 F1)r:
f :w:
skyCover
xcloudy ,
temperature
xwith a
time=6-21high near
max=6363
mean=56.
windDir
mode=SEeast southeast
xwind between
windSpeed
min=55
max=13and 11
xmph .
+ fixes field structure
12
![Page 58: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/58.jpg)
Experiments: weather forecasts (results)
[Model 1] segmentation: coherence: (60.0 F1)r:
f :w: cloudy , with a
windDir
time=6-21high near
temperature
max=6363 .
windDir
mode=SEeast southeast wind between
windSpeed
min=55 and
windSpeed
mean=911 mph .
+ aligns many content words − misses wind, cloudy
[Model 2] segmentation: coherence: (68.8 F1)r:
f :w:
rainChance
mode=–cloudy ,
temperature
xwith a
time=6-21high near
max=6363 .
windDir
mode=SEeast southeast wind
xbetween 5 and
windSpeed
mean=911 mph .
+ aligns more continuously − wrong field structure for windSpeed
[Model 3] segmentation: coherence: (75.0 F1)r:
f :w:
skyCover
xcloudy ,
temperature
xwith a
time=6-21high near
max=6363
mean=56.
windDir
mode=SEeast southeast
xwind between
windSpeed
min=55
max=13and 11
xmph .
+ fixes field structure − mean=56 garbage collects .− time=6-21 correlated with high
12
![Page 59: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/59.jpg)
Experiments: Robocup sportscasting
xbadPass(arg1=pink11,arg2=purple3)ballstopped()kick(arg1=pink11)turnover(arg1=pink11,arg2=purple3)
s
w:pink11 makes a bad pass and was picked off by purple3
Dataset [Chen & Mooney, 2008]
13
![Page 60: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/60.jpg)
Experiments: Robocup sportscasting
xbadPass(arg1=pink11,arg2=purple3)ballstopped()kick(arg1=pink11)turnover(arg1=pink11,arg2=purple3)
s
w:pink11 makes a bad pass and was picked off by purple3
Dataset [Chen & Mooney, 2008]
1.9K scenarios
Each scenario contains|s| = 2.4 records, |w| = 5.7 words/text, 0.8 gold alignments
13
![Page 61: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/61.jpg)
Experiments: Robocup sportscasting
xbadPass(arg1=pink11,arg2=purple3)ballstopped()kick(arg1=pink11)turnover(arg1=pink11,arg2=purple3)
s
w:pink11 makes a bad pass and was picked off by purple3
Dataset [Chen & Mooney, 2008]
1.9K scenarios
Each scenario contains|s| = 2.4 records, |w| = 5.7 words/text, 0.8 gold alignments
Method F1
Random 48.0Chen & Mooney (2008) 67.0Model 3 75.7
13
![Page 62: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/62.jpg)
Experiments: NFL recaps
. . .rushing(entity=richie anderson,att=5,yds=37,avg=7.4,lg=16,td=0)receiving(entity=richie anderson,rec=4,yds=46,avg=11.5,lg=20,td=0)play(quarter=1,description=richie anderson rushed left side for 13 yards .)defense(entity=eric ogbogu,tot=4,solo=3,ast=1,sck=0,yds=0). . .
s w:. . .Former Jets player Richie Anderson
finished with 37 yards on 5 carries ‖plus 4 receptions for 46 yards .
. . .
Dataset [Barzilay & Lapata, 2005; Snyder & Barzilay, 2007]
14
![Page 63: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/63.jpg)
Experiments: NFL recaps
. . .rushing(entity=richie anderson,att=5,yds=37,avg=7.4,lg=16,td=0)receiving(entity=richie anderson,rec=4,yds=46,avg=11.5,lg=20,td=0)play(quarter=1,description=richie anderson rushed left side for 13 yards .)defense(entity=eric ogbogu,tot=4,solo=3,ast=1,sck=0,yds=0). . .
s w:. . .Former Jets player Richie Anderson
finished with 37 yards on 5 carries ‖plus 4 receptions for 46 yards .
. . .
Dataset [Barzilay & Lapata, 2005; Snyder & Barzilay, 2007]
78 scenarios
Each scenario contains|s| = 329 records, |w| = 969 words/text, 24.3 gold alignments
14
![Page 64: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/64.jpg)
Experiments: NFL recaps
. . .rushing(entity=richie anderson,att=5,yds=37,avg=7.4,lg=16,td=0)receiving(entity=richie anderson,rec=4,yds=46,avg=11.5,lg=20,td=0)play(quarter=1,description=richie anderson rushed left side for 13 yards .)defense(entity=eric ogbogu,tot=4,solo=3,ast=1,sck=0,yds=0). . .
s w:. . .Former Jets player Richie Anderson
finished with 37 yards on 5 carries ‖plus 4 receptions for 46 yards .
. . .
Dataset [Barzilay & Lapata, 2005; Snyder & Barzilay, 2007]
78 scenarios
Each scenario contains|s| = 329 records, |w| = 969 words/text, 24.3 gold alignments
Method F1
Random 2.4Baseline 26.7Model 2∗ 53.2
} unsupervised
14
![Page 65: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/65.jpg)
Experiments: NFL recaps
. . .rushing(entity=richie anderson,att=5,yds=37,avg=7.4,lg=16,td=0)receiving(entity=richie anderson,rec=4,yds=46,avg=11.5,lg=20,td=0)play(quarter=1,description=richie anderson rushed left side for 13 yards .)defense(entity=eric ogbogu,tot=4,solo=3,ast=1,sck=0,yds=0). . .
s w:. . .Former Jets player Richie Anderson
finished with 37 yards on 5 carries ‖plus 4 receptions for 46 yards .
. . .
Dataset [Barzilay & Lapata, 2005; Snyder & Barzilay, 2007]
78 scenarios
Each scenario contains|s| = 329 records, |w| = 969 words/text, 24.3 gold alignments
Method F1
Random 2.4Baseline 26.7Model 2∗ 53.2Graph matching 68.6Multilabel global 80.3
} unsupervised
} supervised
14
![Page 66: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/66.jpg)
Summary
more supervision less supervision
15
![Page 67: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/67.jpg)
Summary
single fact
utterance
[Ge & Mooney, 2005][Zettlemoyer & Collins, 2005]
[Lu et al., 2008]
more supervision less supervision
15
![Page 68: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/68.jpg)
Summary
single fact
utterance
facts
utterance
[Ge & Mooney, 2005][Zettlemoyer & Collins, 2005]
[Lu et al., 2008]
[Kate & Mooney, 2007][Chen & Mooney, 2008]
more supervision less supervision
15
![Page 69: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/69.jpg)
Summary
single fact
utterance
facts
utterance
world state
unsegmented text stream[Ge & Mooney, 2005]
[Zettlemoyer & Collins, 2005][Lu et al., 2008]
[Kate & Mooney, 2007][Chen & Mooney, 2008]
[Liang et al., 2009]
more supervision less supervision
15
![Page 70: Learning Semantic Correspondences with Less Supervisionpliang/papers/semantics-acl2009-talk.pdfOccasional rain after 3am . k Low around 43 . k South wind k between 10 and 14 mph](https://reader034.vdocuments.us/reader034/viewer/2022042214/5eb953befc65707d1e51533f/html5/thumbnails/70.jpg)
Summary
single fact
utterance
facts
utterance
world state
unsegmented text stream[Ge & Mooney, 2005]
[Zettlemoyer & Collins, 2005][Lu et al., 2008]
[Kate & Mooney, 2007][Chen & Mooney, 2008]
[Liang et al., 2009]
more supervision less supervision
Our approach:
joint model capturing segmentation and coherence
15