Download - School of Computing FACULTY OF ENGINEERING
![Page 1: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/1.jpg)
School of somethingFACULTY OF OTHER
School of ComputingFACULTY OF ENGINEERING
Augmenting the Knowledge Capture Process with Dialogue Agents
Vania Dimitrova
Intelligence Augmentation Forum @ Leeds14 June 2010
![Page 2: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/2.jpg)
Outline
Context
- Knowledge elicitation challenges
Dialogue agents
- Examples
- Key components
- Example architectures
Discussion
![Page 3: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/3.jpg)
Context: Terminology
Becerra-Fernandez, et al., Knowledge Management, Prentice Hall, 2004 / Additional material, Dekai Wu, 2007
Knowledge elicitation (elicit knowledge from humans)
Knowledge acquisition (broader sources – humans, documents)
Often used interchangeably
Becerra-Fernandez, et al., Knowledge Management, Prentice Hall, 2004Additional material, Dekai Wu, 2007.
![Page 4: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/4.jpg)
Knowledge Elicitation Challenges
• Most knowledge is in the heads of experts
• Experts have vast amounts of knowledge
• Experts have a lot of tacit knowledge
• Tacit knowledge is hard (impossible) to describe
• Experts are very busy and valuable people
• Each expert doesn't know everything
• People see the world from different and changing perspectives
• There is often no consensus what is wrong and what is right
Find a tractable, effective, and efficient way
to articulate some part of a person’s conceptualisation
and align to conceptualisations by other people.
Adapted from http://www.epistemics.co.uk/Notes/63-0-0.htm
![Page 5: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/5.jpg)
Dialogic Aproach
Exploit dialogue agents to facilitate the articulation and alignment of people’s conceptualisations
Scenario 1: Dialogue agent to help elicit a human’s knowledge
![Page 6: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/6.jpg)
Dialogic Aproach
Exploit dialogue agents to facilitate the articulation and alignment of people’s conceptualisations
Scenario 2: Dialogue agent to help align different conceptualisations
![Page 7: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/7.jpg)
Why Dialogue?
Dialogue is crucial when creating, merging and aligning ontologies - Communication stage present in most methodologies for creating ontologies
-Dialogue commonly used in ontology engineering studies
Dialogue is critical in multi-agent systems for sharing meaning- Do agents know the same concept, do different concepts actually have same meaning (Williams, 2004)
- Agents that do not share the same ontology negotiate meaning (Bailin & Truszkowski, 2002)
Williams, A., Learning to Share Meaning in a Multi-Agent System, Autonomous Agents and Multi-Agent Systems, Vol 8(2), 2004Bailin, S. & Truszkowski, W., Ontology Negotiation: How Agents Can Really Get to Know Each Other. WRAC 2002: 320-334.
![Page 8: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/8.jpg)
Dialogue Agents
Intelligent agents which can engage in a dialogue with a user
Types of dialogue:
• Task-based (help users complete tasks, e.g. buy a ticket, book a room)
• Tutoring (support learning – explanation, meta-cognition, motivation)
• Diagnostic (diagnose user’s state, e.g. medical diagnosis)
• Information seeking (provide answers to user’s questions)
• Negotiation (decision making agents)
• Interactive user modelling (extract a user model)
![Page 9: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/9.jpg)
Dialogue Agents: Examples
See demos:
• Roomline: task-based dialogue (booking a room)
• AUTOTUTOR: tutoring dialogue (learning basic computer skills)
• Gnututor: tutoring dialogue (learning basic concepts)
• RIA: information seeking (finding properties)
Earlier work @ Leeds:
• STyLE-OLM: user modelling (diagnosing user’s conceptual knowledge, conceptual graphs)
• OWL-OLM (SWALE): user modelling (diagnosing user’s conceptual knowledge, OWL)
STyLE-OLM reference: Dimitrova, V., Interactive Open Learner Modelling, International Journal of AI in Education, IJAIED, 2003OWL-OLM reference: Aroyo, L., Denaux, R., Dimitrova, V., Pye, M., Interactive Ontology-Based User Knowledge Acquisition: A Case Study. ESWC 2006: 560-574
![Page 10: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/10.jpg)
Learning technical terminology
![Page 11: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/11.jpg)
![Page 12: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/12.jpg)
![Page 13: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/13.jpg)
![Page 14: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/14.jpg)
![Page 15: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/15.jpg)
![Page 16: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/16.jpg)
![Page 17: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/17.jpg)
![Page 18: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/18.jpg)
![Page 19: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/19.jpg)
Main Components
User Utterance
Dialogue moves (intention & proposition)
Communicative acts
Dialogue Management
Focus maintenance (local & global)
Interpretation of user utterance
Management of dialogue commitments
Decide what to say next
Computer Utterance
Dialogue moves (intention & proposition)
Communicative acts
![Page 20: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/20.jpg)
Communication
Medium
Dialogue Games ModelUpdatIng
the
User
Model
STyLE-OLM
Commitment
Rules
Game
Rules
Tactics and
Strategies
Belief
Stores
Systemand
User’sReasoners
UserModelBeliefs
Misunder-standings
Miscon-ceptions
DomainOntology
![Page 21: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/21.jpg)
Example Dialogue Games in STyLE-OLM
![Page 22: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/22.jpg)
Eliciting a User Model from the Belief Stores in STyLE-OLM
User'sCommitment
Store
System'sCommitment
Store
Finding Agreements and Conflicts
CONFLICTS
A G R E E M E N T S
Updating the User Model
User’s Reasoners
Resultant UM
DomainOntology
System’s Reasoners
![Page 23: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/23.jpg)
Layered Information States (Traum et al., 2006)
Realization Rules
DialogueActs
InputUtterance
Recognition Rules
Update Rules
Output Utterance(verbal and nonverbal)
Selection Rules
Info StateComponents
Dialogue Manager
DialogueActs
David Traum, Interactive Dialogue for Simulation with Virtual Characters,http://graphics.usc.edu/~suyay/class/Slides/CS597-10-23-06.ppt
Layer consists of• Information State components (state of interaction)• Dialogue Acts (Packages of changes to information state)
OntologyLexicon
ParticipantsSocial state
Dialogue historyConversation model
![Page 24: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/24.jpg)
Modular Acrhitecture (Zinn et al., 2002)
Claus Zinn, Johanna D. Moore, Mark G. Core, A 3-tier Planning Acrhitecture for Managing Tutoring Dialogue, Proceedings of ITS2002, Springer, LNCS.
![Page 25: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/25.jpg)
3-tear response generation (Zinn et al., 2002)
Claus Zinn, Johanna D. Moore, Mark G. Core, A 3-tier Planning Acrhitecture for Managing Tutoring Dialogue, Proceedings of ITS2002, Springer, LNCS.
![Page 26: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/26.jpg)
Summary: Dialogic Approach
Dialogic Approach: Potential- Efficient
- Independent from the knowledge representation formalism
- Depth versus breath
Dialogic Approach: Challenges- Computationally expensive (fidelity vs tractability)
- Managing confusion (uncertainty)
- Multiple participants (perspectives)
![Page 27: School of Computing FACULTY OF ENGINEERING](https://reader035.vdocuments.us/reader035/viewer/2022062517/56813080550346895d965abd/html5/thumbnails/27.jpg)
Dialogue and Knowledge Capture
Scenario 1:- Dialogue to assist ontology engineering- Dialogue to capture user experience- Dialogue to capture user context
Scenario 2:- Dialogue to initiate clarification- Dialogue to point at similarities and differences- Argumentation strategies