simulation-based tutoring systems cpi 494/598, april 16 kurt vanlehn
Post on 22-Dec-2015
215 views
TRANSCRIPT
![Page 1: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/1.jpg)
Simulation-based tutoring systems
CPI 494/598, April 16Kurt VanLehn
![Page 2: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/2.jpg)
Classification of step-based tutors
User interface• Forms e.g., CTAT
• Canvas e.g., Andes
• Text e.g., Criterion
• Dialogue e.g., AutoTutor
• Simulation e.g., ???
Tutoring on• Process• During e.g., Cog Tutors
• After e.g., ???• Both e.g., Andes
• Product e.g., Criterion
• Both e.g., AutotTutor
![Page 3: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/3.jpg)
Prototypes (ill-defined classes) of simulation-based tutoring systems
• Equipment operation & maintenance– E.g., nuclear reactor operation
• Vehicle driving– E.g., flight simulator
• Tactical decision making– E.g., defend ship from possible aerial attack
• Negotiation, leadership, other soft skills– E.g., convince an NGO’s clinic to move
• Lab/field experimentation– E.g., discover cause of an epidemic
![Page 4: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/4.jpg)
What’s different between simulation-based interface vs. others?
• Time matters in the sim• Heavy reliance on delayed feedback• Game-based expectations of sim quality• Game-based technology e.g., game engines• Just making the sim work – huge!• Game-like expense e.g., $1M each!• Most research done outside universities– Mostly military
![Page 5: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/5.jpg)
Steamer – Very early example(Hollan, Hutchins, Weitzman 1984)
• Steam plant occupies 1/3 of space on Navy ships; miles of pipe;
• Engineer of the watch supervises 16 to 25 people who run it
• Years of experience required
![Page 6: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/6.jpg)
Operator’s screen:conceptual, not physical, fidelity of controls
![Page 7: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/7.jpg)
One actual operator’s consolephysical & conceptual fidelity
![Page 8: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/8.jpg)
First, build the simulation• Underlying mathematical model – huge!– Built before Steamer
• Objects for each gauge & control authored– Visual presentation– Hooked up to underlying math model
• Augment math model: models of faults/failures• Math may not be perfect– Especially in abnormal operating conditions or failures
• Validate the sim– check that standard operating procedures work– Compare real to sim behaviors; many conditions
![Page 9: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/9.jpg)
Sim is not an ITS but…
• Can be used for training anyway– Drill to memorize standard op procedures– Exercise in handling standard breakdowns
• Instructor(s) supervises trainees– Decides on exercise– Sets sim into initial state– Watches trainees– Gives immediate feedback occasionally– Gives delayed feedback: After Action Review (AAR)
![Page 10: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/10.jpg)
Problem: After training, still can’t handle non-routine situations
• Need a “mental model” of the whole steam plan– Helps to diagnose what is causing trouble– Helps to hypothesize & test (mentally) repairs
• This sim is a black box; need a “glass box”– Shows multiple levels of detail– Should it to be active; can manipulate & watch– Animation; real time?
![Page 11: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/11.jpg)
Top level view of the whole steam plant
![Page 12: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/12.jpg)
One of about 100 subsystem diagrams
![Page 13: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/13.jpg)
Controlling sim via the schematics
• Can click on schematics to e.g., open a valve• Can do “abstract” actions that are hard or
impossible to do in real world– Replace boiler– Raise chill-water temp to 100 degrees
![Page 14: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/14.jpg)
Problem: Can’t understand time courses
• Neg feedback loops in steam plant control e.g., fuel flow to boiler
• Need to see first and second derivatives as the sim is running– Add new “gauges” to the sim– Some were later added to the real steam plant
• Need to see graphs
![Page 15: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/15.jpg)
New gauges at bottom; graph at top
![Page 16: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/16.jpg)
Was Steamer ever an ITS?• Only for safety issues– Wired to give student immediate negative feedback if
certain safety conditions violated– E.g., starting a pump without first opening the input
and output values• Doesn’t know what student is attempting to do– Can’t offer immediate or delayed feedback– Can’t offer hints– Even if it knew goals, can’t connect goals to actions– Has no representation of knowledge-to-be-learned
• Except mental model of the plant itself, which is huge
![Page 17: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/17.jpg)
RIDES(Munro Johnson Pizzini Surmon Towne Wogulis, 1997)
• 15 years later• Like Steamer, has authoring system for
widgets• Has underlying language for implementing
Sim• Integrates widgets & sim
![Page 18: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/18.jpg)
Has panels with widgetssome are controls, some are gauges
![Page 19: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/19.jpg)
Has better tools for authoring instruction
![Page 20: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/20.jpg)
Instructional design procedure
• Specify objectives; specify scenes• Develop sim– Graphical objects– Behavior rules for each– Debug sim
• Develop lessons– Author procedures using the sim– Add texts– Debug lessons
![Page 21: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/21.jpg)
Object palette: Note how mouse controls rotation
![Page 22: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/22.jpg)
Authoring a procedure
• Put sim in an initial state; name the procedure• Do it• End it
![Page 23: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/23.jpg)
Put sim in an initial state
![Page 24: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/24.jpg)
Half done with the procedure
![Page 25: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/25.jpg)
Three modes for instructionProvided automatically
• Demo mode– Tutor executes procedure– Student controls pace
• Practice model– Student tries to execute– Gets immediate feedback before sim reacts– If authored hints exists, gets them
• Test mode– No feedback & no hints– Sim does whatever
![Page 26: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/26.jpg)
Practice mode
![Page 27: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/27.jpg)
Curriculum editor
![Page 28: Simulation-based tutoring systems CPI 494/598, April 16 Kurt VanLehn](https://reader030.vdocuments.us/reader030/viewer/2022032704/56649d795503460f94a5cd16/html5/thumbnails/28.jpg)
Is Rides an ITS Authoring tool?
• Procedural training = CTAT = ITS• Drill on identifying parts = tutor, but not so
intelligent?