a collaborative tool for the computational modelling of child language acquisition
DESCRIPTION
I gave this presentation at the Cognitive Aspects of Computational Language Acquisition workshop in the European Association of Computational Linguistics conference in 2009. It presents a freely available open source project written in Java for studying the computational modelling of child language acquisition. It supports plugging in different learning algorithms and evaluating them all within the same environment and with a standardised set of metrics.TRANSCRIPT
![Page 1: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/1.jpg)
Kris Jack
A Collaborative Tool for theComputational Modelling ofChild Language Acquisition
The LanguageAcquisition
Toolkit
CEA LIST, Laboratoire d'ingéneriede la connaissance multimédia multilingue,FontenayauxRoses, France
![Page 2: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/2.jpg)
Kris Jack
IntroductionBackgroundLATDiscussionFutureConclusion
Introduction
What is the Language Acquisition Toolkit (LAT)?
It's a program that helps you to model language acquisition. You can:
● create a miniature world in which your language learner lives;
● create comprehension and production tests for your learner; and
● judge your learner's development over time.
You provide the learner, the LAT provides the environment.
![Page 3: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/3.jpg)
Kris Jack
Background
IntroductionBackgroundLATDiscussionFutureConclusion
What motivated the creation of the LAT?
● Complicated problem numerous computational →models proposed.
● Useful to compare them but difficult due to different:
● assumptions;● training;● tests; and● goals.
What is there to gain?● Time saving benefits.● Standardisation.● Holistic models of longitudinal development.
![Page 4: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/4.jpg)
Kris Jack
LAT
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
Analysing
Training
comprehension
Testing
+
production
Language Learner
DevelopmentalData
www.langac.com
![Page 5: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/5.jpg)
Kris Jack
LAT
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
Analysing
Training
comprehension
Testing
+
production
Language Learner
DevelopmentalData
www.langac.com
Let's see one possible world...
![Page 6: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/6.jpg)
Kris Jack
LAT: Training (1/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
Your world's framework:
● miniature language acquisition paradigm (Feldman et al., 1990) – associate images with descriptions
● world of geometric objects in which actions occur and are described (action + description = event)
● objects (colours, shapes, sizes, 2D positions)● actions (moving, growing, shrinking, appearing,
disappearing, pushing another object and pulling another object, etc.)
● descriptions (defined by you)
321
1 2 3
321
1 2 3
![Page 7: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/7.jpg)
Kris Jack
LAT: Training (2/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
a ye llow cir cle to the u pper right of the blue square
You must teach your language to the LAT
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
![Page 8: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/8.jpg)
Kris Jack
LAT: Training (2/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
a ye llow cir cle to the u pper right of the blue square
You must teach your language to the LAT
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
![Page 9: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/9.jpg)
Kris Jack
LAT: Training (2/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
a ye llow cir cle to the u pper right of the blue square
You must teach your language to the LAT
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
![Page 10: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/10.jpg)
Kris Jack
LAT: Training (2/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
a ye llow cir cle to the u pper right of the blue square
You must teach your language to the LAT
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
![Page 11: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/11.jpg)
Kris Jack
LAT: Training (2/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
a ye llow cir cle to the u pper right of the blue square
You must teach your language to the LAT
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
![Page 12: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/12.jpg)
Kris Jack
LAT: Training (2/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
a ye llow cir cle to the u pper right of the blue square
You must teach your language to the LAT
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
det1
adj1
n1
prep
det2
adj2
n2
![Page 13: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/13.jpg)
Kris Jack
LAT: Training (2/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
a ye llow cir cle to the u pper right of the blue square
You must teach your language to the LAT
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
det1
adj1
n1
prep
det2
adj2
n2
adj1 = {“ye llow”, “blue”, “red”, “green”, “pink”...}
![Page 14: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/14.jpg)
Kris Jack
LAT: Testing
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
Analysing
Training
comprehension
Testing
+
production
Language Learner
DevelopmentalData
www.langac.com
![Page 15: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/15.jpg)
Kris Jack
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
LAT: Testing (1/2)
What do you want to test?
● Comprehension
● description in → meaning(s) out● Production
● meaning in → description(s) out
Teach the LAT:● what to test● what results are correct
![Page 16: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/16.jpg)
Kris Jack
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
LAT: Testing (2/2)
Define testing pairs (description + meaning)
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
a ye llow cir cle to the u pper right of the blue square
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
I want to test:● all actions
![Page 17: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/17.jpg)
Kris Jack
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
LAT: Testing (2/2)
Define testing pairs (description + meaning)
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
a ye llow cir cle to the u pper right of the blue square
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
I want to test:● all actions ● all shapes
● all colours
i.e. give the description square, it could be any object at any time
![Page 18: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/18.jpg)
Kris Jack
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
LAT: Testing (2/2)
Define testing pairs (description + meaning)
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
a ye llow cir cle to the u pper right of the blue square
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
I want to test:● all actions ● all shapes
● all colours● all NPs
![Page 19: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/19.jpg)
Kris Jack
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
LAT: Testing (2/2)
Define testing pairs (description + meaning)
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
a ye llow cir cle to the u pper right of the blue square
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
I want to test:● all actions ● all shapes
● all colours● all NPs ● all NP1s
● all NP2s
![Page 20: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/20.jpg)
Kris Jack
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
LAT: Testing (2/2)
Define testing pairs (description + meaning)
321
1 2 3
321
1 2 3
O1: square
O1: blue
O1: x2
O1: y2
O2: circle
O2: yellow
O2: x3
O2: y3
a ye llow cir cle to the u pper right of the blue square
Before action (t=1) After action (t=2)
O1: square
O1: blue
O1: x2
O1: y2
![Page 21: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/21.jpg)
Kris Jack
LAT: Analysing
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
Analysing
Training
comprehension
Testing
+
production
Language Learner
DevelopmentalData
www.langac.com
This is your job!
![Page 22: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/22.jpg)
Kris Jack
LAT: Analysing
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
Analysing
Training
comprehension
Testing
+
production
Language Learner
DevelopmentalData
www.langac.com
![Page 23: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/23.jpg)
Kris Jack
LAT: Analysing (1/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
What do you want to analyse?
![Page 24: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/24.jpg)
Kris Jack
LAT: Analysing (2/2)
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
How are the results presented?
● Roundbased (results from a single round)
● Trialbased (results from all rounds across a single trial)
● Modelbased (results across all trials)
Can take stages into account
6 12 18 24 30 360 42 48Time (months)
54
Prelinguistic
HolophrasticEarly
Multiword
Late Multiword PostAbstract
Abstract
Reflexivevocalisations,cooing,vocal play,babbling
Atomiclexicalunits
Multipleunits
Multiple unitswith syntacticmarkings (e.g. word order)
Multiple units with phrasal category membership
![Page 25: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/25.jpg)
Kris Jack
LAT: Analysing
IntroductionBackgroundLAT● Training● Testing● AnalysingDiscussionFutureConclusion
Analysing
Training
comprehension
Testing
+
production
Language Learner
DevelopmentalData
www.langac.com
![Page 26: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/26.jpg)
Kris Jack
Discussion
IntroductionBackgroundLATDiscussionFutureConclusion
What does the LAT give us?
● Time saving benefits.● Standardisation (let's play on fairly):
● training; ● testing; and● analysing.
● Analyses for longitudinal development.
![Page 27: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/27.jpg)
Kris Jack
Future
IntroductionBackgroundLATDiscussionFutureConclusion
What does the crystal ball show us?
● More complex miniature language
● More languages
● A richer language representation (e.g. tones)
● More realistic symbolic meanings
● Accessibility for nonprogrammers
● Can we integrate paradigms that do not use a miniature language?
● Wish list (www.langac.com)
It's collaborative so you can make these possible
![Page 28: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/28.jpg)
Kris Jack
Conclusion
IntroductionBackgroundLATDiscussionFutureConclusion
Key points
● The LAT allows you to:
● create training data;● create testing data; and● analyse your learning model's development
(comprehension and production).● Standardisation
● let's speak the same language● Work in progress● Collaboration
● I'll show you mine if you show me yours
![Page 29: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/29.jpg)
Kris Jack
Thank you
IntroductionBackgroundLATDiscussionFutureConclusion
Analysing
Training
comprehension
Testing
+
production
Language Learner
DevelopmentalData
www.langac.com
![Page 30: A Collaborative Tool for the Computational Modelling of Child Language Acquisition](https://reader034.vdocuments.us/reader034/viewer/2022051514/54826fbcb4af9f8c0d8b47d6/html5/thumbnails/30.jpg)
Kris Jack
Results (1/2)
0 15 30 45 60 75 90 105 120 135 1500.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
100.00%
Stages in Production
HoloEarlyLateAbstractEnd
Number of Events Observed
% o
f Req
uire
men
ts M
et Holophrastic
Early M
ultiword
Late Multiw
ord
Abstract
Postabstract
6 12 18 24 30 360 42 48Time (months)
54
IntroductionBackgroundLATDiscussionFutureConclusion