cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidestuebingenagl.pdf ·...
TRANSCRIPT
![Page 1: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/1.jpg)
Cost-based pragmatic implicatures in an artificiallanguage experiment
Judith Degen, Michael Franke & Gerhard JagerRochester/Stanford
AmsterdamTubingen
July 27, 2013
Workshop on Artificial Grammar Learning Tubingen
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 1 / 42
![Page 2: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/2.jpg)
The Beauty Contest
each participant has to write down a number between 0 and 100
all numbers are collected
the person whose guess is closest to 2/3 of the arithmetic mean of allnumbers submitted is the winner
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 2 / 42
![Page 3: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/3.jpg)
The Beauty Contest
(data from Camerer 2003, Behavioral Game Theory)
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 3 / 42
![Page 4: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/4.jpg)
Signaling games
sequential game:1 nature chooses a world w
out of a pool of possible worlds Waccording to a certain probability distribution p∗
2 nature shows w to sender S3 S chooses a message m out of a set of possible signals M4 S transmits m to the receiver R5 R chooses an action a, based on the sent message.
Both S and R have preferences regarding R’s action, depending on w.
S might also have preferences regarding the choice of m (to minimizesignaling costs).
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 4 / 42
![Page 5: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/5.jpg)
The Iterated Best Response sequence
S0 R0
S1R1
S2 R2
......
sends any
true message
interprets mes-
sages literally
best response
to S0
best response
to R0
best responseto R1
...
best responseto S1
...
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 5 / 42
![Page 6: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/6.jpg)
Quantity implicatures
(1) a. Who came to the party?b. some: Some boys came to
the party.c. all: All boys came to the
party.
Game construction
ct = ∅W = {w∃¬∀, w∀}w∃¬∀ = {some}, w∀ ={some,all}p∗ = (1/2, 1/2)
interpretation function:
‖some‖ = {w∃¬∀, w∀}‖all‖ = {w∀}
utilities:
a∃¬∀ a∀w∃¬∀ 1, 1 0, 0w∀ 0, 0 1, 1
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 6 / 42
![Page 7: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/7.jpg)
Truth conditions
some all
w∃¬∀ 1 0
w∀ 1 1
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 7 / 42
![Page 8: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/8.jpg)
Example: Quantity implicatures
S0 some all
w∃¬∀ 1 0
w∀ 1/2 1/2
R0 w∃¬∀ w∀
some 1/2 1/2
all 0 1
R1 w∃¬∀ w∀
some 1 0
all 0 1
S1 some all
w∃¬∀ 1 0
w∀ 0 1
F = (R1, S1)
In the fixed point, some is interpreted as entailing ¬all, i.e. exhaustively.
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 8 / 42
![Page 9: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/9.jpg)
Lifted games
1 a. Ann or Bert showed up. (=or)
b. Ann showed up. (= a)c. Bert showed up. (= b)d. Ann and Bert showed up. (=
and)
wa: Only Ann showed up.
wb: Only Bert showed up.
wab: Both showed up.
Truth conditions
or a b and
{wa} 1 1 0 0{wb} 1 0 1 0{wab} 1 1 1 1{wa, wb} 1 0 0 0{wa, wab} 1 1 0 0{wb, wab} 1 0 1 0{wa, wb, wab} 1 0 0 0
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 9 / 42
![Page 10: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/10.jpg)
Lifted games
IBR sequence: 1
S0 or a b and
{wa} 1/2 1/2 0 0
{wb} 1/2 0 1/2 0
{wab} 1/4 1/4 1/4 1/4
{wa, wb} 1 0 0 0
{wa, wab} 1/2 1/2 0 0
{wb, wab} 1/2 0 1/2 0
{wa, wb, wab} 1 0 0 0
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 10 / 42
![Page 11: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/11.jpg)
Lifted games
IBR sequence: 2
R1 {wa} {wb} {wab} {wa, wb} {wa, wab} {wb, wab} {wa, wb, wab}
or 0 0 0 1 0 0 0
a 1 0 0 0 0 0 0
b 0 1 0 0 0 0 0
and 0 0 1 0 0 0 0
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 11 / 42
![Page 12: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/12.jpg)
Lifted games
IBR sequence: 3
S2 or a b and
{wa} 0 1 0 0
{wb} 0 0 1 0
{wab} 0 0 0 1
{wa, wb} 1 0 0 0
{wa, wab} 1/2 1/2 0 0
{wb, wab} 1/2 0 1/2 0
{wa, wb, wab} 1 0 0 0
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 12 / 42
![Page 13: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/13.jpg)
Lifted games
or is only used in {wa, wb} in the fixed point
this means that it carries two implicatures:
exhaustivity: Ann and Bert did not both show upignorance: Sally does not know which one of the two disjuncts is true
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 13 / 42
![Page 14: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/14.jpg)
Predicting behavioral data
Behavioral Game Theory: predict what real people do (inexperiments), rather what they ought to do if they were perfectlyrational
one implementation (Camerer, Ho & Chong, TechReport CalTech):
stochastic choice: people try to maximize their utility, but they makeerrorslevel-k thinking: every agent performs a fixed number of bestresponse iterations, and they assume that everybody else is less smart(i.e., has a lower strategic level)
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 14 / 42
![Page 15: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/15.jpg)
Stochastic choice
real people are not perfect utility maximizers
they make mistakes ; sub-optimal choices
still, high utility choices are more likely than low-utility ones
Rational choice: best response
P (ai) =
{1
| argj maxui| if ui = maxj uj
0 else
Stochastic choice: (logit) quantal response
P (ai) ∝ eλui
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 15 / 42
![Page 16: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/16.jpg)
Stochastic choice
λ measures degree of rationality
λ = 0:
completely irrational behaviorall actions are equally likely, regardless of expected utility
λ→ ∞convergence towards behavior of rational choiceprobability mass of sub-optimal actions converges to 0
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 16 / 42
![Page 17: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/17.jpg)
Iterated Quantal Response (IQR)
variant of IBR model
best response ist replaced by quantal response
predictions now depend on value for λ
no 0-probabilities
IQR converges gradually
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 17 / 42
![Page 18: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/18.jpg)
Level-k thinking
every player:
performs iterated quantal response alimited number k of times (where kmay differ between players),assumes that the other players have alevel < k, andassumes that the strategic levels aredistributed according to a Poissondistribution
P (k) ∝ τk/k!
τ , a free parameter of the model, is theaverage/expected level of the otherplayers
● ●
●
●
●
● ● ● ● ● ●
0 2 4 6 8 10
0.0
0.1
0.2
0.3
Poisson distribution
k
Pr(
k)
●
●
●
●
●
●
● ● ● ● ●
●
● ●
●
●
●
●● ● ● ●
●
●
●
●
●
●
●
●● ● ●
●
●
●
●
τ = 1.0τ = 1.5τ = 2.0τ = 2.5
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 18 / 42
![Page 19: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/19.jpg)
The experimental setup
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 19 / 42
![Page 20: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/20.jpg)
The experimental setup
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 19 / 42
![Page 21: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/21.jpg)
The experimental setup
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 20 / 42
![Page 22: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/22.jpg)
The experimental setup
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 21 / 42
![Page 23: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/23.jpg)
The experimental setup
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 22 / 42
![Page 24: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/24.jpg)
Simple condition: Literal meanings
S0
1/2 0 0 1/2
0 0 1 0
0 1/2 1/2 0
R0
1 0 0
0 0 1
0 1/2 1/2
1 0 0
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 23 / 42
![Page 25: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/25.jpg)
Simple condition: Iterated Best Response
R1
1 0 0
0 0 1
0 1 0
1 0 0
S1
1/2 0 0 1/2
0 0 1 0
0 1 0 0
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 24 / 42
![Page 26: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/26.jpg)
Complex condition: Literal meanings
S0
0 1/2 0 1/2
0 1/2 1/2 0
0 0 0 1
R0
1/3 1/3 1/3
1/2 1/2 0
0 1 0
1/2 0 1/2
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 25 / 42
![Page 27: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/27.jpg)
Complex condition: Iterated Best response
R1
1/3 1/3 1/3
1/2 1/2 0
0 1 0
0 0 1
S1
0 1/2 0 1/2
0 0 1 0
0 0 0 1
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 26 / 42
![Page 28: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/28.jpg)
Complex condition: Iterated Best response
S2
0 1 0 0
0 0 1 0
0 0 0 1
R2
1/3 1/3 1/3
1 0 0
0 1 0
0 0 1
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 27 / 42
![Page 29: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/29.jpg)
Experiment 1 - comprehension
test participants’ behavior in a comprehension task implementingpreviously described signaling games
48 participants on Amazon’s Mechanical Turk
two stages:
language learninginference
36 experimental trials
6 simple (one-step) implicature trials6 complex (two-step) implicature trials24 filler trials (entirely unambiguous/ entirely ambiguous target)
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 28 / 42
![Page 30: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/30.jpg)
Artificial language Zorx
XEK RAV ∅ ZUB KOR ∅
Three stages of language learning:
1 2 3
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 29 / 42
![Page 31: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/31.jpg)
Artificial language Zorx
XEK RAV ∅ ZUB KOR ∅
Three stages of language learning:
1 2 3
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 29 / 42
![Page 32: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/32.jpg)
Artificial language Zorx
XEK RAV ∅ ZUB KOR ∅
Three stages of language learning:
1 2 3
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 29 / 42
![Page 33: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/33.jpg)
Artificial language Zorx
XEK RAV ∅ ZUB KOR ∅
Three stages of language learning:
1 2 3
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 29 / 42
![Page 34: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/34.jpg)
Artificial language Zorx
XEK RAV ∅ ZUB KOR ∅
Three stages of language learning:
1 2 3
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 29 / 42
![Page 35: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/35.jpg)
Artificial language Zorx
XEK RAV ∅ ZUB KOR ∅
Three stages of language learning:
1 2 3
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 29 / 42
![Page 36: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/36.jpg)
Artificial language Zorx
XEK RAV ∅ ZUB KOR ∅
Three stages of language learning:
1 2 3
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 29 / 42
![Page 37: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/37.jpg)
Inference trial
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 30 / 42
![Page 38: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/38.jpg)
Results - proportion of responses by condition
0.0
0.2
0.4
0.6
0.8
1.0
ambiguous filler
complex implicature
simple implicature
unambiguous filler
Pro
port
ion
of c
hoic
es
Response
target
distractor
competitor
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 31 / 42
![Page 39: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/39.jpg)
Results - proportion of responses by condition
0.0
0.2
0.4
0.6
0.8
1.0
ambiguous filler
complex implicature
simple implicature
unambiguous filler
Pro
port
ion
of c
hoic
es
Response
target
distractor
competitor
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 31 / 42
![Page 40: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/40.jpg)
Results - proportion of responses by condition
0.0
0.2
0.4
0.6
0.8
1.0
ambiguous filler
complex implicature
simple implicature
unambiguous filler
Pro
port
ion
of c
hoic
es
Response
target
distractor
competitor
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 31 / 42
![Page 41: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/41.jpg)
Experiment 2 - production
test participants’ behavior in a production task implementingpreviously described signaling games
48 participants on Amazon’s Mechanical Turk
two stages:
language learninginference
36 experimental trials
6 simple (one-step) implicature trials6 complex (two-step) implicature trials24 filler trials (entirely unambiguous/ entirely ambiguous target)
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 32 / 42
![Page 42: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/42.jpg)
Results - proportion of responses by condition
0.0
0.2
0.4
0.6
0.8
1.0
ambiguous filler
complex implicature
simple implicature
unambiguous filler
Pro
port
ion
of c
hoic
es
Response
target
distractors
competitor
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 33 / 42
![Page 43: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/43.jpg)
Experiment 3 - varying message costs
Question 1: Are comprehenders aware of message costs?
Question 2: If a cheap ambiguous message competes with a costlyunambiguous one, do we find quantity implicatures, and if so, howdoes its likelihood depend on message costs?
240 participants on Amazon’s Mechanical Turk
three stages:
language learningcost estimationinference (18 trials, 6 inference and 12 filler trials)
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 34 / 42
![Page 44: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/44.jpg)
Extended Zorx
cheap messages costly messages
XEK RAV ZUB KOR XAB BAZ no costBAZU XABI low cost
BAZUZE XABIKO high cost
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 35 / 42
![Page 45: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/45.jpg)
Cost estimation
two cheap features
one cheap & one costly feature
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 36 / 42
![Page 46: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/46.jpg)
Results - proportion of costly messages
0.00.10.20.30.40.50.60.70.80.91.0
no cost
low cost
high cost
Pro
port
ion
of c
hoic
e
Sent word
cheap
costly
The use of costly messages decreases as the cost of that message increases.
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 37 / 42
![Page 47: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/47.jpg)
Simple condition: Literal meanings
S0
1/2 0 0 1/2
0 0 1 0
0 3/4 1/4 0
R0
1 0 0
0 0 1
0 1/2 1/2
1 0 0
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 38 / 42
![Page 48: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/48.jpg)
Inference results
0.00.10.20.30.40.50.60.70.80.91.0
no cost
low cost
high cost
Pro
port
ion
of c
hoic
es
Response
target
distractor
competitor
The Quantity inference becomes more likely as the cost of the ambiguousmessage increases.
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 39 / 42
![Page 49: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/49.jpg)
Model fitting
Fitted parameters
cost estimation: mixed effectslogistic regression on the datafrom experiment 3
reasoning parameters fitted vialeast squares regression:
comprehension (experiments1, 3)
λ = 4.825, τ = 0.625, r = 0.99
production (experiment 2)
λ = 8.853, τ = 0.818, r = 0.99
0.00
0.25
0.50
0.75
1.00
0.000.25
0.500.75
1.00
Prediction
Dat
a
Experiment
●
●
●
Exp. 1
Exp. 2
Exp. 3
Choice
competitor
distractor
target
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 40 / 42
![Page 50: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/50.jpg)
Conclusion
proof of concept: game theoretic model captures experimental dataquite well
both speakers and listeners routinely perform simple inference steps
likelihood of nested inferences is rather low
speakers behave more strategically than listeners
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 41 / 42
![Page 51: Cost-based pragmatic implicatures in an arti cial …gjaeger/slides/slidesTuebingenAGL.pdf · Cost-based pragmatic implicatures in an arti cial ... Amsterdam Tubingen July 27, 2013](https://reader031.vdocuments.us/reader031/viewer/2022030507/5ab5bea77f8b9ab47e8d30e4/html5/thumbnails/51.jpg)
Collaborators
Degen, Franke & Jager (AGL-Workshop) Cost-based implicatures 7/27/2013 42 / 42