BTL

Learning by Doing in the Context of Distance Learning

Allen Munro

University of Southern CaliforniaRossier School of Education

Behavioral Technology Laboratory

in collaboration withUCLA-CRESST

AERASan Diego, CAApril 13, 2004

BTLOverview

• Learning in simulation contexts requires assessment and instruction in those contexts.

• Cost-effective development of simulations for training requires a consistent set of services.

• iRides Author was used to develop a ‘simulation’ that provides a decision aiding application to advanced students.

• Student use of this decision aiding tool can be automatically recorded for analysis.

BTLHow Does Learning Happenin Simulation Contexts?

• Simulations ==> Learning ???

• Military simulations often require human teachers, frequently with one or two teachers per student.

• Fully exploiting the computer

• Not only simulation interactions

• But also pedagogical interactions

BTLThe Problem of Distance Learning in Simulation Contexts

• Simulation learning often requires human teachers/coaches; how to bring about learning without them?

• Provide an artificial tutor to handle the most frequently needed interventions!

BTLModes of Trainingin Simulation Contexts

• Demonstration

• Often with explanation

• Can be student-paced

• Monitored Practice

• Tight monitoring—e.g., single track

• Loose monitoring—a variety of measures can be utilized to assess progress and generate advice

BTLAssessmentin Simulation Contexts

• Summative assessments—Like practice, but without support features

• Micro-assessments• Used during monitored practice• Types

• Assessing actions• Assessing effects• Monitoring for special states

BTLUniversal Architecture for Teaching in Simulation Contexts

STUDENT

TUTOR

SIMULATION(or REAL SYSTEM)

USES

STUDENT

SIMULATION

SERVICES

ARTIFICIALTUTOR

Human Tutoring Machine Tutoring

BTLUniversal Service Set for Simulations that Teach

• Report Object Selection• Ignore Manipulations• Resume Manipulations• Draw Attention to• Set Value / Set Values• Perform Manipulation• Pause/Resume Manipulation• Require Manipulation• Require State

BTLOne Approach

• Authoring application• Generates data that

specify simulation behavior

• Delivery system• Incorporates the set of

services required

• Interprets data that specify simulation behavior

• Developers don’t have to figure out how to re-implement the services for every simulation

STUDENT

SIMULATION ENVIRONMENT

SERVICES

ARTIFICIALTUTOR

Machine Tutoring

UNIVERSAL SIMULATION ENGINE

BTLSimulation Behavior and Instruction Authored Separately

• Simulation author—Behavior accuracy

g

Parallel_FNormal_F

Normal_F = g * sin(20º)

Parallel_F = g * cos(20º)

BTLRelational Descriptions of Behavior

• Simulation author—Natural specifications

BTLComplex Decision Making:Learning in the Context of a Tool

• Support systematic evaluation

BTLComplex Decision Example: Dealing with a Refueling at Sea Subsystem Crisis

• Vendor plans to leave the business. But your project requires RAS!

• Evaluate alternatives

• List possible approaches / decisions

• Consider possible outcomes

• Evaluate the utility of each outcome in terms of several attributes

• Estimate the probability of each outcome

Tools support this process

BTLHuge Project

• Need to consider proximate & remote outcomes

FFS Variant 1 ACQ ScheduleFY04FY03 FY06FY05 FY08FY07 FY10FY09 FY12FY11 FY14 FY16FY13 FY15 FY17 FY19FY18

Milestones andPhases

BPhase B Phase C – Production & Deployment

Contract Awards

1 2 2 2 2

Lead Ship Events

Lead Ship Award

Lay Keel

AEGIS Light Off

Start Fabrication

Main Engine Light Off

Builder’s Trials

Acceptance Trials

Ship Deliveries Lead Ship Delivery

Follow Ship Delivery

DT&E

LFT&E

OT&E

DT-C2DT-C1DT-B1

DOT&ELFT&EReport

Follow Ships Awards

DT-C3TECHEVAL

OT-C1 DOT&EBLRIP Report

OT-C2

DT / OT-B2

OT-C3 OPEVAL

LFT&E

In-Service

DT / OT-B2

Shock Trials

Final Contract Trials

Delivery

Post Delivery Availability

Sail Away

Commissioning

IOC

1

C

1 1 1SY 1

SY 2

1

PSA

Degaussing

FOT&E

FY20 FY21

R&D EffortsIPS R&D

CDR

Test Ship Award

Test Ship Delivery 1 1 3 3 3 2 1

Aegis Integration R&D

18 years!

BTLUsing the Tool:Edit Node Labels

• Name the alternative decisions, resulting events, and possible outcomes.

BTLDefine ‘Utility’ in Context

• Decide on number and names of attributes• Weight the attributes

BTLAssign Utilities using Attributes

• Give a number to each attribute of utility: Cost, Performance, and Schedule

• For every possible outcome, assign values

BTLAssign Probabilities to Outcomes

• When there are exactly two possible outcomes of an event, automatic adjustment occurs.

BTLTracking Student Actions

Utility attribute value changes

Probability changes

Threshold value changes

Changes to attribute weights

Creation/Deletion of nodes

…

BTLOffering Instruction