dialogue act coding and modalities
DESCRIPTION
Dialogue Act Coding and Modalities. GSLT: Dialogue Systems Leif Grönqvist – [email protected] 11. June 2002 15:30. Presentation Outline. Properties for dialogue act (in particular) coding schemes Mode – medium – modality Modality Theory The different coding schemes - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/1.jpg)
Dialogue Act Coding and ModalitiesGSLT: Dialogue Systems
Leif Grönqvist – [email protected]
11. June 2002 15:30
![Page 2: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/2.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 2
Presentation Outline
• Properties for dialogue act (in particular) coding schemes
• Mode – medium – modality
• Modality Theory
• The different coding schemes
• Some interesting differences between the coding schemes
• Conclusions
![Page 3: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/3.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 3
Properties for dialogue act coding schemes
• How general is it?• Is it powerful enough for natural
dialogue?• Does the scheme handle different
modalities?• Are the definitions precise enough to
make the scheme useful in dialogue systems?
![Page 4: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/4.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 4
More properties for coding schemes
• Multi functional codings
• Mutual exclusive categories
• Discontinuous codings
• Relational codings
• Hierarchical coding values
• Multi-layer scheme
![Page 5: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/5.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 5
Mode – medium – modality
• Some terms are used in different ways in different contexts
• Bretan and Bernsen use “modality” in the same way but psychologists do not.
• B & B do not agree on the term “medium”• Bernsen: “We should aim for a
terminology that is robust, conceptually clear and intuitively accepted.”
![Page 6: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/6.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 6
Modality Theory
• Niels Ole Bernsen’s theory: “A generative taxonomy of output modalities”
• Start with a set of basic features: Linguistic/non-linguistic(non-)analogue(non-)arbitrarystatic/dynamicgraphics/sound/touch
![Page 7: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/7.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 7
Modality Theory 2
• Combine them to get 48 distinct types
• Remove impossible combinations: 20 left
• One more feature:
Real world/diagrammic/graphs
resulting in 28 distinct modalities
![Page 8: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/8.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 8
![Page 9: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/9.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 9
![Page 10: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/10.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 10
• 28 unimodal modalities
• Use of more than one will result in multimodality
![Page 11: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/11.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 11
Selected Coding Schemes for Dialogue Acts
• LINLIN 1/2: Linköping, Ahrenberg et al, 1995• HCRC: Developed for the Map Task Corpus,
Andersson et al 1991• DAMSL: By Discourse Resource Initiative as
a standardized coding scheme, 1991• SWBD-DAMSL: Modified DAMSL by Stolcke
et al 2000• GBG: Communicative Acts by Allwood 2000
![Page 12: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/12.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 12
Why these
• They cover some different types
• And are developed for different purposes
• Some of them are widely spread and well known
• I know something about them
![Page 13: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/13.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 13
Interesting differences
• LINLIN and DAMSL are more general than GBG and HCRC
• GBG and DAMSL are the more powerful• DAMSL and HCRC do not handle non-
verbal dialogue acts as well as LINLIN and GBG
• GBG is the only one not directly useful in dialogue systems
![Page 14: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/14.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 14
Conclusions
• Some researchers does not seem to believe in non-verbal dialogue acts at all:
in SWBD-DAMSL the coding types are mutually exclusive and two of the most common are:
Backchannel/Acknowledge
Non-verbal
![Page 15: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/15.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 15
More conclusions• The linguists scheme (GBG) is very rich
but not useful I a dialogue system context• Modality should not be used to define
dialogue act categories – but in a second layer.
• Our intuition says that a nod or pointing at something could be an answer to a question
![Page 16: Dialogue Act Coding and Modalities](https://reader036.vdocuments.us/reader036/viewer/2022062519/56815567550346895dc33267/html5/thumbnails/16.jpg)
11 juni 2002 Dialogue Systems: Leif Grönqvist 16
We are done
And probably out of time