sterling somers : sterling@sterlingsomers dr. robert west : robert_west@carleton both @

Sterling Somers : sterling@sterlingsomers.comDr. Robert West : robert_west@carleton.ca

Both @Institute of Cognitive ScienceCarleton UniversityOttawa, ON, Canada

Macro Cognition : Using SGOMS to Pilot a Flight Simulator

• SGOMS is an extension of GOMS to deal with interruptions, teamwork, and re-planning

• Adds a control structure above unit tasks – planning unit• SGOMS in ACT-R

• A particular way to program ACT-R to do complex tasks• Adds more buffers to ACT-R

• Planning unit buffer• Unit task buffer• Method buffer

• These can be thought of collectively as the goal module• To test SGOMS we need to show that it works across tasks

SGOMS

Sandwiches

Different SGOMS models in the lab

Why Aviation?

1. Real World2. Dynamic3. Both Planned and Reactive Behaviour4. Replanning5. Expertise6. Continuous / Feedback

InterfaceSimulator

• FlightGear• Free• Open Source (hack simulation loop?)

Custom Python API• Property tree via UDP/HTTP/Telnet• http/telnet simultaneously (read/write)

• State / Control of aircraft

Problem• Real time VS ACT-R time (for now…)

Simple Vision• Python bindings to OpenCV

• Very efficient• Redundancy check possible

VisionTop Down:

• SOS VisionVision Module:

• When not busy• Request from environment• Motion Detection

Python bindings OpenCV• Screen shot VS centre of screen comparison / frame

Motion Detection

Screen Shot at frame 1 Screen Shot at frame 2(arrow indicates direction of movement)

Vision : Dynamic Salience / Context Dependence

Vision uses salience factor (0-1) to determine probability of seeing an environment item

• Salience of Horizontal and Vertical movement calculated according to size of movement (in pixels )

• is pixel movement threshold• Possible different for different contexts?

Operator PoolStart Engine Press Both Brakes Recall Heading Maintain Heading

To Full Throttle Set Trim Look Heading Rudder Left/Right

Motor MethodsTo Full Throttle:Continue increasing throttle until lever stops moving

Planning Unit: Prepare for take off

DM

Unit Task: Get Started

Press Both Brakes+

Start Engine+

Cue: Motor module: not busyAuditory Module: no engine noise

Unit Task: Do settings

Set Trim+

Planning Unit: To take off speed

DM

Unit Task: Get to speed

Release Brakes+

To Full Throttle+Unit Task: Watch Speed

Read Air Speed+

+

Planning Unit: To take off speed

DM

Unit Task: Get to speed

Release Brakes+

To Full Throttle+Unit Task: Watch Speed

Read Air Speed+

Vision Module

Look at [target]

Look out window

Top-down request

Opportunistic, when no top-down request

See movement+ Reasonable sized move

Interruption

Maintain Heading

Rudder, etc.+

Clear Buffer+(resulting in resume)

Interruption• Interruptions and re-planning take place on different levels• Case 1

– Bottom up scanning– Small– Expected– Context remains the same (still taking off)– Handle it within the unit task

• Case 2– Bottom up scanning– Large– Unexpected– Context is changed (abort take off)– New unit task needed

• SGOMS Hypothesis – there is a set processing structure used across tasks

Thank you.

Sterling Somers : sterling@sterlingsomers.com

Dr. Robert West : robert_west@carleton.ca

Both @Institute of Cognitive ScienceCarleton UniversityOttawa, ON, Canada