slide 1rolf black, raate 2008, coventry, 1 december 2008v supporting personal narrative for school...
TRANSCRIPT
Slide 1Rolf Black, RAatE 2008, Coventry, 1 December 2008v
Supporting Personal Narrative for School Children with Communication Disorders
Rolf Black, Annalu Waller; University of DundeeEhud Reiter, Ross Turner; University of Aberdeen
RAatE 2008, Monday, 1st December 2008, 11.30am
The Development of a Prototype
Slide 2Rolf Black, RAatE 2008, Coventry, 1 December 2008
Outline
Personal Narrative, Stories & AAC
The Feasibility Study
Development of the Prototype User Centred Design
Observations: Current Systems
System Design: Backend & Frontend
Next Steps
Slide 3Rolf Black, RAatE 2008, Coventry, 1 December 2008
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Why stories are important (Waller, 2006)
relating and sharing experiences developing self image expressing personality provides form and meaning to life developing organisational skills working through problems entertainment (being interesting people)
Slide 4Rolf Black, RAatE 2008, Coventry, 1 December 2008
“The major bulk of interaction takes place through the medium of Story” (Cheepen, 1988)
But...
AAC* systems (light & hi tech) are designed to facilitate transactional communication.
* AAC - Augmentative and Alternative Communication
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 5Rolf Black, RAatE 2008, Coventry, 1 December 2008
How do children learn to tell stories?
Children's story structures develop initiallywith scaffolding (Bruner, 1975)
3-year-olds – initiation but seldom expansion(initiation may involve simply telling the punch-line)
4:6-year-olds – initiation & expansion.
6-year-olds - initiation, maintenance & conclusion (Peterson & McCabe, 1983).
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 6Rolf Black, RAatE 2008, Coventry, 1 December 2008
Scaffolding personal story telling:How was school today?
Feasibility/Pilot Study
Supporting narrative fornon-speaking children
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 7Rolf Black, RAatE 2008, Coventry, 1 December 2008
How was school today? – Pilot Study
What sorts of stories
Design an interface
How can we use sensor data to generate stories?(e.g. GPS sensors, RFID tags and barcode readers)
Build and evaluate a prototype
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 8Rolf Black, RAatE 2008, Coventry, 1 December 2008
How was school today? – Issues
EthicsWorking with Children in Schools: Curriculum Participants need to enjoy taking part in project Informed consent. Children: Informed ‘assent’
PrivacyCollecting private information: Data protection System design (Interface, database, etc.)
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 9Rolf Black, RAatE 2008, Coventry, 1 December 2008
Prototyping: User Centred Design
Story Generation
(Backend) Interface
(Frontend)
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 10Rolf Black, RAatE 2008, Coventry, 1 December 2008
Current Systems of Story Communication:School and Home Diaries
Home Diary; Oscar 12 May Our new headmaster is Mrs May. Donald and Anne
went out shopping to get a Wii for the school. Rolf is in school doing research with DynaVox
users. I am taking part and think it is cool.
Home Diary; Frederic 14 May The Wii was set up on the big screen at lunchtime.
I got a shot of the golf game. Sue was rubbish at it.
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 11Rolf Black, RAatE 2008, Coventry, 1 December 2008
Current Systems of Story Communication:Voice Recording Devices, SGDs
Voice recording: Step-by-step Step 1: “I had a visitor today in Speech and Language
Therapy.” – Step 2: “Rolf was here to show me his new prototype.” – Step 3: “I really enjoyed trying it out.”
Speech Generating Devices (SGDs) “Today we had a special presentation about the environment
project. We met all in the hall and discussed what we could do. I was in a group about fresh water preservation. We...”
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 12Rolf Black, RAatE 2008, Coventry, 1 December 2008
School Day Observations
Time Place Event People Interaction Comment9:20 Front
entranceArrives in
busMary, John
Picked up by
teaching assistant
teaching assistant
chat
10:45 Dining room
Snack time
assistant, Sam, Rolf
food Step-by-step recorded: “I met Rolf at Snack time”, “He is here for his new project”
11:00 Hall Eco-School
opening event
all staff and pupils
normally Jane has physio now, her class gets to discuss "Water" and "Global Citizenship" (Other subjects are "transport", "waste", etc.)
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 13Rolf Black, RAatE 2008, Coventry, 1 December 2008
Interface“Tell story” (PowerPoint)
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 14Rolf Black, RAatE 2008, Coventry, 1 December 2008
Prototyping: Data Collection
Sensor information: Time Location Interaction (person, object)
Data information Timetable (classes, activities, staff, location) Lunch menu
Additional information Recorded speech messages
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 15Rolf Black, RAatE 2008, Coventry, 1 December 2008
Data Collection with Sensors
RFID Simulator
(A. Alshahrani & D. Westwater, 2008)
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 16Rolf Black, RAatE 2008, Coventry, 1 December 2008
Interface “Tell story” (Clicker5)
Yesterday15th
January2009
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 17Rolf Black, RAatE 2008, Coventry, 1 December 2008
Next steps
Test run (December 2008) Shadowing one participant with working system
Setup (January 2009) Preparation of School, one week
Evaluation of the Prototype Two participants over one week
Feedback gathering and data analysis
Personal Narrative, Stories & AAC – The Feasibility Study – The Prototype – Next Steps
Slide 18Rolf Black, RAatE 2008, Coventry, 1 December 2008
Thank you!
http://HowWasSchoolToday.computing.dundee.ac.ukContact: [email protected]
Slide 19Rolf Black, RAatE 2008, Coventry, 1 December 2008
AAC Study Day
“Guess What Happened Today!”
Enabling Children withComplex Communication Needs to Tell Stories
27 January 2009at The Institute of Child Health, London
28 January 2009at The Together Trust, Cheadle, Manchester
3 February 2009at The City Chambers, Edinburgh
Slide 20Rolf Black, RAatE 2008, Coventry, 1 December 2008
References
http://www.computing.dundee.ac.uk/projects/writetalk/
J Bruner (1975). "From communication to language: A psychological perspective." Cognition 3: 255-289.
C Callaway and Lester J (2002). "Narrative Prose Generation." Artificial Intelligence 139: 213-252.
B Dawkins (2008). Multi-media profiling, MENCAP. B Dawkins, J. Cavet, et al. (2006). "Learning the value of multimedia: How profiling
supports self advocacy in people with severe intellectual disabilities." Journal of Applied Research in Intellectual Disabilities 19: 270–280.
A Druin (1999). Beginning a discussion about kids, technology, and design. San Francisco, Morgan Kaufmann.
L Ferres, Parush A, et al. (2006). Helping People with Visual Impairments Gain Access to Graphical Information Through Natural Language: The iGraph System. ICCHP 2006, Lecture Notes in Computer Science 4061. K. M. e. al.
Slide 21Rolf Black, RAatE 2008, Coventry, 1 December 2008
A Fitzgibbon and Reiter E (2003). Memories for life: Managing information over a human lifetime. G. C. proposal., UK Computing Research Committee (UKCRC).
N Grove (2005) Ways into Literature. London: David Fulton. 2nd Edition of Literature for All: London: David Fulton.
K McKeown, Kukich K, et al. (1994). Practical Issues in Automatic Document Generation. ANLP-1994.
R P y Péréz and Sharples M (2004). "Three Computer-Based Models of StoryTelling: BRUTUS, MINSTREL, and MEXICA." Knowledge-Based Systems 17: 15-29.
C Peterson and McCabe A (1983). Developmental psycholinguistics: Three ways of looking at a child’s narrative. New York, Plenum.
F Portet, Reiter E, et al. (2007). Automatic Generation of Textual Summaries from Neonatal Intensive Care Data. AIME 2007.
E Reiter (2007). An Architecture for Data-to-Text Systems. ENLG-2007. E Reiter and Dale R (2000). Building Natural-Language Generation Systems., Cambridge
University Press.
References (cont)
Slide 22Rolf Black, RAatE 2008, Coventry, 1 December 2008
E Reiter, Sripada S, et al. (2005). "Choosing Words in Computer-Generated Weather Forecasts." Artificial Intelligence 167: 137-169.
J Robertson and Cross B (2004). "Children’s perceptions about writing with their teacher and the StoryStation learning environment." International Journal of Continuing Engineering Education and Lifelong Learning. 14: 454-471.
G Soto, Hartmann E, et al. (2006). "Exploring the Elements of Narrative that Emerge in the Interactions between an 8-Year-Old Child who uses an AAC Device and her Teacher." Augmentative and Alternative Communication 22(4): pp. 231 - 241.
S Sripada, Reiter E, et al. (2005). Evaluating an NLG System using Post-Editing. . IJCAI-2005.
A Turner (1999). "Scaffolding the storytelling abilities of a group of pupils with learning disabilities using computers: A case study." British Journal of Learning Disabilities 27: 105-109.
R Turner, Sripada S, et al. (In Press). Selecting the Content of Textual Descriptions of Geographically Located Events in Spatio-Temporal Weather Data. ES-07.
References (cont)
Slide 23Rolf Black, RAatE 2008, Coventry, 1 December 2008
References (cont)
A Waller (In Press). Personal Narrative and AAC: From Transactional to Interactional Conversation. Ninth Biennial ISAAC Research Symposium - Theoretical and Methodological Challenges for Research and Practice in Augmentative and Alternative Communication (2006).
A Waller (2006). "Communication Access to Conversational Narrative." Topics in Language Disorders 26(3): 221-239.
A Waller, O'Mara D, et al. (2005). Facilitating user feedback in the design of a novel joke generation system for people with severe communication impairment. HCI International 5 (CD ROM). Las Vegas, Nevada, USA.
A Waller and O’Mara D (2003). Aided communication and the development of personal storytelling. Augmentative and Alternative Communication: Developmental Issues, 11. S. v. Tetzchner and N. Grove: pp 256-271.
References (cont)