AD-A274 170- W E TATON AGEForm Approvied_MJMENTATION PA GE 0 70409 _

Pubhlc reportig burden for this Collecti Oi o irnfomation is estimated to average 1 hour per response Incling th rime tor revewrg instructrns searcng exsrng rate sources garnering and

maintaining the data needed, and completing and reviewng the collectlon of information Send cormems regarding th imburoen esintmate or any othef asperct or tsrs cohi ection oata normaco•s gncturnng

sugge•tions for reducing this burden. to Washington Headcluaners Senrces Directorate to' Innormation Operations and Reports 1215 Jefterson Davis Hignway Suite 1204 Arlington VA22202-4302 and to the Office of Management and Budget Paperwork Reduction Protect 10704 O 188) Washington DC 20503

1 AGENCY USE ONLY (Leave biank) 2 REPORT DATE 3 REPORT TYPE AND DATES COVERED

November 1993 Professional Paper

4 TITLE AND SUBTITLE 5 FUNDING NUMBERS

TEAM DECISION MAKING AND TECHNOLOGY PR: CE16PE: 0602233N

6 AUTrHOR(S) WU: DN300090

L. T. Duffy7 PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) S PERFORMING ORGANIZATION

REPORT NUMBERNaval Command, Control and Ocean Surveillance Center (NCCOSC)RDT&E DivisionSan Diego, CA 92152-5001

9. SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10 SPONSORING/MONITORINGAGENCY REPORT NUMBER

Office of Naval Research800 North Quincy StreetArlington, VA 22217-5000 D T IC

II SUPPLEMENTARY NOTES E LTDEC 2 3 1993

12a. DISTRIB1AION/AVAILA8ILI1Y STATEMENT 12b. ABBIJTION CODE

Approved for public release; distribution is unlimited.

13. ABSTRACT (Maximum 200 words)

In 1990, Martin Marietta deployed a satellite into the wrong orbit when engineers instructed the computer programmers toopen the bay door to the hatch containing the satellite. The programmers opened the "wrong door," although they had followedthe instructions correctly (Associated Press, 1990). Today, $150 million dollars sits dead in an orbit around the earth. The totalcost of the miscommunication: $500 million. In 1989, an Avianca airliner crashed in New York awaiting clearance for landing,while critically low on fuel. Ground control misinterpreted the Colombian pilot's urgent message regarding his fuel shortageand assumed that a fuel emergency had not been reached. More than 270 people died. The captain aboard the USS Vincenneshad approximately 180 seconds in which to process information from several of his support staff and make the decision as towhether to shoot the (then mis-identified) Iranian airbus and protect his crew. Although the decision was militarily correct, 290civilians died and questions were raised regarding the inadequacy of our scientific knowledge concerning team decision makingand decision support systems in this "real life" setting.

Each of these examples involved more than one decision maker interacting with technologically sophisticated supportsystems, each of which contributed to the final outcome. These examples involved highly skilled, technically competent teammembers. However, something "went wrong" when these multiple-expert parties attempted to reach a resolution. What factorsare important in predicting team effectiveness and what is the impact of technologically sophisticated systems on the teams? Weknow a great deal about the answer when discussing decision makers (Abelson and Levi, 1985), but very little when discussingtechnologically supported multiple decision makers (Diffy, 1990; Galegher, 1990).

Published in Individual or Group Decision Making, pp. 247-266.

14. SUBJECT TERMS 15 NUMBER OF PAGES

Cognitive Modeling Stress Team Decision Making DisplaysDecision Making Stress Man-Machine Interface 16 PRICE CODEDecision Support Performance Measurement

17. SECURITY CLASSIFICATION 18. SECURITY CLASSIFICATION 19 SECURITY CLASSIFICATION 20 LIMITATION OF ABSTRACTOF REPORT OF THIS PAGE OF ABSTRACT

UNCLASSIFIED UNCLASSIFIED UNCLASSIFIED SAME AS REPORT

NSN 7540-01 -260-.500 Standard form 296 (FRONT)

BestAvailable

Copy

UNCLASSIFIED

21a NAME OF RESPONSIBLE INDMDUAL 21b TELEPHONE (.rlC0•e Aea Ci0jde 21c OFFCE SYM8OL

L. T. Duffy (619) 553-9222 Code 442

Ac.e-jcf

NWiS'

vac

............................ ...... "•," •.....

93-30939

93 12 22 0 5 00.NUN754001-20-50 SIdUd CmAI 296 IACK)

UNCLASSIFIED

) c) o "4) to IV 0 c

w~ v - c c- C O-

WCC

_ to w ld~-~ ~ :

- cQ o a O-S ICo~ .- w >

E> 440 ? E .

O- C 4)aý::c *= 4) 4

*a~ 'Z a

U E

co

a. os 0 zV C

uot

UL

0 QI

0u -xc0IV = u- -- 1.

a 0 =0-U .2 E-

0 ~ 05 0 C . 5 -- ; Vu -- 0_ _ o u - V '

z~.0 b-V *o-o .- 0

CA Z -a 'U r- U)r v x

U>o .O, 00 w 0=v.0 0v 0 0

0c4 m ~ 4 0V 000 00.

:0 E 4 .0II )E E 3

0 .c tj 0) - mE0 U)

0 M _ 0 -

6)- $.0 0 -4E~ ~ ~ ~ E, r oU)6C

00-

0.~~o 10 V X -~ 'A0 v1 >-0

to W00r-V5Wa.. M - r=~0 m ~- 00 " ,Vt

to 0- Q4~~~ 04 v 0 W.0 E E. 0,'a - c 0 E I

j~~~ ~ ~ ~ a, to r 04)0c -t T c d0u

""04.O -U)v rc0vC c' 4)y~

CE W 'A 0 v) CID E cc a-0 L. V 0 6))a-.4)00 0~ ~ 4 4) 0.0 >

0- aac.0 E b. '. v 0. -f 0 0. to 0 04) Z

ii~ ii V -L--*-X A A 0E 0 o

t l H -0. s 4 ) V

78~. IS~ g gEEo.. -cu 03 0 A n.

r-) C> ). 4 0- 'WUV

SE "a2~ ccz =00 U 0 0 A

a 40 v m or- 4)

0~~- E CO 4 -...

to4 )

SV 1 n 4) 0 'o < :2

13O .- 4)01 4)4 - 'a 2:CC70 E0 U ) . SCw - r4) ) O Lb. C 0 8.0 -V WO.? W

%t -4 ) t40 0

j :ý -O 2

9'20

to W3 IA -' 4 X- 0 00 v .. .. .0 00.4) C

o " :2 -a -; 4)W clc. w ~ -0 S0 0U m I 0 -

E- .2 E - -5 -c -z: m -0)

o : 8~4 c a 28 4 Zs -- 0 -S! c W~ -z.r0 00 12,4.

c. 21- "o Aa 4

(J0 30 r- o. N. 10 0)~ ... 4

w6- _c _ o= ce wo .o c v E(*0F. 00 > E4)4 -v go 0v C>o M =0'A c 4) 5 0 UU Iv c~C- - r-4 c C/ ) -

to 0 -S y. >- W - 0oE 0- .2 tcinr 0 4) V .- ;6 1 E O 0. E 0)

4. 4)' o .40)?0- COI C.w 0 of- r0 "a E 0- I=-

- -0 'A o x o InA Z0 ch -5:

r- 0 V 0 r- a- .0 0 - . 000

000 U0.~ 0>~~..'4) O~ o~a 0- 0 0U4) C '&Z '

r- 10-0~ £06) -v W t S.C -C-t .'Oua 60 ~~ =' tb w z

E- Z V 0 CL C 00± 0~a'--- 0)

= > b..:2 A a.' .LC v4 --~ to CL v V ov c 1 0 'c

cx-o Br. .0 cc~ v.. u utow cnE

U-.- 'A E - w ut01. 0 to0 v v C& E C 00

.- O0

C~. v2C 4 .0 ) a- C U CiI.- V E 'ar 0 0 o E>. 4 E 0 c~ 0 00

4) -0 cc 0 a 4 0 ) E to 0 n . cc0S0t~~~~j~~ w z 0E~ ) V 0. E . . _ N .~ w.-

A ZI0 , 6tj dc 4"1 43- 0. 0 > 0 OZ 0CA .0 v > .- o C 06 J &3

- 0-. C: 302 ýi '2A ~ j 300M : c&=4 v 0 3 u l= w

'a 043 Ecc~ E co

.;4~~~ 04~~ do V4306. -vc

Z0 ZC3~JE 0 *0 .5E4 u. B 0EV_ 0 ,E 4 4 0 v .2

O. > 0 0 V -- 43 = 3" 3- O

w~" 0 .0o7

0 cc -0 44

o 0 'A v E V3 w) ub ~

o b. ' o0C 0 a 0~.430 0. 00 -. to m b-=c E o>'0. LOZ.C-4v~ 43 0- Ou o~ o- .> 0

o o G T Eý = _ to -43 -- 2,- 2 U= -55 V0v -6 v vc - 00 0m DO IV5 ~ . ~ 4 S E

E~~~~* o -

- o.~0 --- o~.~ 00 c 0c t

to -- o in ~ So V~ 2 ?_ W-'Z.'y V.- to o0 o 03 0) V33

N 0 0

.> V. E-2~ 00 'A?12 C MS WS U04 0o E ',0 0 C

, B u c - 0o a - 0

0~K Z. uO-43J0~

~.0 Z3 A 0± m ~ 0 .. ~~ l O ~ 3 cC,~~~~ o.' Z - -S!4

'4 14 r:

4) (1. = 01- - do C

to c .- Z4 ) ~ -

-0 0) 4 ) u 0. In,

X to 06' U 4V C 0 1)m

to 0 0 I.. E..J 2.. 0- w C o ~~ 0~

0U E to o -d 0 clw c0 -j o c -£ 6Z-r c~ - v C Q. ~ ' E 0.

£0 w - 0 - c -

&.& 0U~ v) o4 - 'A .-

-U 0 0 0

Eo C to c v4 Z E' I . o-- - c'A u m w to0 S qm - ~ - c)' q v)gU0

U~ tj 0to in.~0~ 4

Ei Z4 0.'0 E .0 v. v0o0 0.~ =O toC=> C

a = c. -a - b- > cC -: '03 b=.OOE - I-a -.OWs- tO too-~ ~ ~ -v '6vw ;to 0EC 0 060wvr 0c t -

-0 a -MO 06 .0 ) -0 0~. 2 -aI~ 0.M c~~ a a

44)

E o o ..0. c c w to

E~ togc v0 CU5 0 0

w . u 0 o w w o 0 .0 4)ýg ~.tocVC -- cC c4'0 ~ ~ ~ ~ - ' 06- > .0!O E =U ' .. t'A6

06 0 V~ 4 - =~ m E - 0 06 VtU r 0 A.0 0. ~ u-.0 'A it .m

3:CI

Wk ed 0 ~ . 4 -. -l - C l l 0C a2 to 0 'ccU 0 4A

ro- cC Wo a -

20>. -0 0 oC -0 -0 v to -

0~~ 4)L WO-

a. -F WE '- I o>0U Is W) 4.5t

4) , E~ 2

0 :3 .,- , 3: to 0 x

#A 0 to 44 4))) *4 c~,) > C 4 vC

W V) r: ! 0'~> to

~ ~ 04) 00 0. a 4).;0)

2 ~ ~ w %> :6 .30 -0 0 0 U ý 61- 0'xc I e t &!.9 9 Q- -0 0 1.. 4 C = = Ca v .5 : . us

o5 E cc4 VC0

U- r

Z C ~ ~ -r 0404)~ E' 0 E0 _ E~ .oc2

0V0~~4 0) m C C ~

C 0 E -E r- c CC.. 1=0 lU)*. 5 )

'0 '.C 4 '

0 U

E E~ E r- E o'~ S c z.* ..-.- v - z,

c~ . CC r v C20EOLE 0 ) -a~4~o2 0-0 m

cc -)0

0. 4) 0' 0.04

too .W c 0- > C 0 0 IW

W > 0 W5 us Z 4 -0 .

-0 C C - 0 V . a0-v4 V,0 .0 V. -lm W

e%- IS Zo 05 2

C .2)~ c . r . > . O

0 4

~ C0 . h .- to= '. 4'4.U O 4 o 0c . 3:0

C 0

0 fA COC *.040 z rIx>,5E a 0

V 0 0~ cxC 0 c

cx CXE =. 00~ . W -

A 1-- 0 0 'A 0 -- ~ 'A E O- t--- s-b c0 -z o2 r-4) to . Q CO v '

c) C CC ~ 4 o 4) ~ ~ w ~ 4j 0 0 0. > 0 ~V U . -4

) - .- to "00 W E - C- v - 0 v M W 0~~~r E 0- 0 -. V=. 0 ) ~

CC )C C. o .. 0 > o04 )

C4 Ca%.v

Il v - V E c 0 CV

.4 X2. ~ ' 4) c 0 . O %2U-~ C v -Z -*a -.=uM.0 15 1: > -

'o) to 0 0- 0 - :4)W) C toC

u0 0 . E 'atoa

VI >~ C1 2t0U4).C o-

Q.M>- 4)-EQU WC

.0 I 0 00 C - c c nw c r V

to go0 ý . -V - ob - = vu -- C

b. CV 'A t A > . "v . X O

0 0

00'A e- 0.~ 0- CL 5, 0 L V 00 -

3: u C~ L0 0 .0 U 60 u000 >.E¼~ E

U0 >.

C 0 0 a >'E E EVI~ 'A - - V. w ',

100 0 -" 0 r 0' 0 ~ 0 E. >

4) ~ . ~ > )~04) -J:o L o 0u' 0 M.4)C~C 'A Zc K C J 0w2- ' 0'to~~~ ~ ~ ~ 0. E V '- Z0- 0W u t o .

4)4 5,. >. 0 0:- w.- -0 E 22~

4)~~ >) 0 b-2 ~v ~ 2 m-o 0 Ab 0 -- V= t - a ' r= > V.0to. .

0 oW - -

04 - C4 Co 0

u0o .0 tj~ 04 )A- 'A

0 a V w w , - 0 0 -A) B = ZE . .=*-0

"A 06 0.4 06 o~ W3 > 4)04)u E0 CL C ec v

0 coc uW CC 0 - 0 go0.0.- C. 0 ~ -w $. E

mC ) 4 4 0 u - a> 0 0 4) vi ll E aE d o 0a~w .0 M 0 . a, m co 0 2 > v cc 0 E m-

z A -0 W~ X) 0 04o co a./04 0.t 0 w b A - V 0

0) &- v.. 00> ~

0' wNe00Q~ to > r- w m 0- )0 v U. 0a

V 00 - & 0 0. 0 VCL~~ C) .- w t.rV t

0 C00 4) > o to ý:,ý - a-0 b-0 0 C - 0 r 4)

X o 0 u 06 000 0 > UaC - 0. w u rIV .

0 0 E>

C~ 0

*~5.. O~~.0 W zo go W) Im..UaZu . -- a .- 5 o=

U- > 0 U.0 u3 >z c. .- c0 ac8 > C

W 44 ~ 4). ' o '- ou MU 4)0 tj 0 b-t-0= .- vN3 w > b- A.-u 0'A 0~ ~~ ~ w 0 O 0 s, 3 . C5

4 v4oc 4) 0 =. .4) 4,44 C

w),3 E to A X :`- ) -u t:0 00 E -; "' 4). 0 u. 3:0 w -

:3 L.4) - 3 :ý ZC 4) a.U U .

C3 ;: v .'A

-

tý >C to 0CF0 u2w ) 4-to'04) 'AU'

'U r=) M oL 0 .c 4) :

**- r-C a.S d u ou 0 2x .v C V a..c- - -

~~~~~0 w. .2.-0 >,0 4) c E EU~ z a. 0 -' 2~ ).'A 'A4 000.

'A0'MA = 2t

ul 0~C mU c) ... 0 ) .- E 0 U) 00U._ r_ 0.0C

cf C lz Z cl 0 CL Tjpa g m

2106V. 110

E teS 00

IS cc e'Q 5LQ .20 :3 r 3:LS c -,:- -E 0 o ot w C,

-t3 IV 'D Cc ta u > a't Z -5. C3> IE 'CCX .. 0 r IAs r- 0 cd w CL 2M'o .0 -C '

boo to 'E d o 't. .2 2 - 0 Z;

E .- '3 o W V :3t

Cl- a v .0 L' --o" 41 a x Q7j

8 k -d

c I'j otj .2 1=3 S -2 . t. x4'- Z 0 tA_;, ' .. c CL w

-S ru ra 41 a ro 6ý C- III, M Q6 .2 EE E oc - --c -,,.2%o c, o

X E 0 > o' A!>

S 4E 0,2 -, I'a -% -L; -Z. .4 _ . -o u r E z <me x sc S - U. -,a co abm E C. 4 C c: ej cx cmow -w 3: Gi E Z; -i a q v tj ft CL t 0E zr, g iT, "a w c': cz 4o 'a a'w 0 E cL "a04 t -'.' -0 2 rE -v ]p 5 o M'i E lz :- 243 co 40

r- E cn Go -6 w =8 CLo 0 to r- MO 0 odo v

Cn

lo La m to -0

w CO a co 0- Z z -8, -0LL: v 0 > 0 'w' In a 0 a0 w w X cn a v r N -u 't w- 0z c 0 S 0. "z Cc Eý E- w z < le -12 23 J 3:0 o tj "nn 1-0 ra- 0 0 ci'-l S-- ci Iv 2 >c a - . . z

"w S. E '< -0 v rr-- v, -, .3 . >L, 0, .0 -; al r-7a v 45 c4Go 0 =-m , M -S '- - li > 4 Z; 4F :r t- co

cd ,6 0. E :7- ýý : 0' "N' ='ý -.:. T (M > 0 'cl ci acs v Cý a. 'c o' Oý Zt < - I - =)w CO R Cc Cc U c r- acE ýi< c,Lu w 0- ,u > -'o c w rz Ec: a ý2 'v w0 Ir = = >w w :j0 'g E 6 0 443 oo >W o to -w E 0 .!2 %, = Cl.

> u c c ca a do 4 do 03:

LL. r=

u- 4) v 0 0 0 >D 0 'ro 0 OV :2 "v

z' < -rz m > o

4) v k: :e Z-o mE0 j% ý 4.- EV cc .. I o -t: -V3 -u 4, a a> cc 3: w 'ov tv, m No c ýEcc 0Izo E r- 'v w 'r-r= t T0

0 X CL 0 .0 QL 0 Ew)cc c Z

c>o 'u E zo EE cu to 0 cn 'o- Tj E

0 v 0 -o Go0 u clj0 0 m si %j c3 4) M t: crr S iE0 C6 cý.2 0 M

w 0 06 c E'- v c a; E cxca cl c M cýL a

CL or- Z -: --Z - - - ciz 0 .cc M . E -i m lo c- tnLU u -6 1M c (a a -0 QL o 0- m tor- o Lu -w ;S E E!j v E c E oo w 2o - " -a QL ulU -cc v' - E I Ull0 CD E 3 4 -t: ccs4a Or- :v->M E Co j3cn L -0 = - v C

cn 0 LU LU0 E c 'o 0- o 4;0- 0 cl a I - -a r- Z5 0 cLQ 0v 0 LU :E- 4)UL. E E Lc ciC14 0 0 U s. -00 r- v, - E czcc >ý u, v 3: v v .4 < 00 < . 0 ex 0 10 6; ý!v c" < -i E 'D cc toor W (6 Ei0 0' "g, ".60 'wj E 0 u cR ýu a -- .- :t

4; U. fj 0 wcl - cL0 c'aa 0 v 0. CL. o 0 c3 CL- 16.. 0 > 'Qo t VE 'i c U3 o . to E10 0 10 4) W 0 r- a cd 2 > 0 QL 0 0

0 06 16- T r- -0 1., v-v E o -: c v CC- C3, o = - '-0 Cie =v mv0 to CO 'A E -Icn 00 1-- ýw E 0

0 ci E - 1,-4 2 . :ý S 0 W to0 co 0 'ratj v -t3 M -0 'cc (cR two E -':E ` c

Oc M E Oc (WU CS Mc -J c: f- 0 u Z .0 w -'o

-6 4Z3 v _.: & wrZI r- -4 7- 0w 4, cz'o cA 0

, v . z 0-1 >* ý- :3 i > oE -c u 0 to cL. 3: rz V; 7.2c x > o-ccto tj Z 'E E!l ci o -Sý -Z -3:3 X Z IU - - c ci m Qj c r v o Fo v c v 0

c>

to V tv a -Izi o- cr -DZ: j - o o < c, E uo cx *, v -'ý . :ý .: c

OA 0. 00 v) < < co u o o Ln fs

a1 5

- 40 CD 0V ~ .E o0

to 2 ro .- .2 .0 C2 ia ,.2 -; 0, -K ;... I0 ;

0 _: z- E -. ro~- o E

- oo y-2 ;-t 7 z*) 'w -60 00

.0 cm b- .~ 'a a2 2 w~ :1~ 2.

044 ,3~ 1 4, 4

3'E c~ -o -- K" ~a.-~~ -w toJ 0 .

-~' lu A c.. 0 ex~,~ ~ c,~~~*~~**~ x, 2,~-~ 4 2 .0 ~ ~ o

co~ r- a.-0 C u . , -- E - 0~ < ci -

0 o ww Q ~ -v a' cc0 'cu o .2 .00 lowo ace

c AO Uta z

43 -ol .O 0 0. -0 .

ta~~ ~ ~ ~ Cc3 vý 1 teg-co u mo 0

.0

< c,4 c *v .2- :3 >, a.c x

-,0 .6 0 -1 Iv 0x =

to ' 25< E .2 c o'j

Wa-0 M~ 0 aa U o 20 -KC'bo t; ~ 0 000 0t Q = 1V E-~ 4- -0 *- -T z ~ ~ -1 ;5

Z: -Z I*

o- w -4u 0

0 j < :-go tow -- " =

2z2co .o 0- e-C ~ 4l-~'

-,

-, ;s = L. cccLui

oao -*- 2

40 0. fc> .F u-v . 0C'6.6 =c ~ - 0 r- 0 4,

a. o4,R

o ~'n0,, 0i U

- 0. *u 4, C- 0o ' -* co 0 *ý>I t

0

C C ~ =. .5 L) d. -- . F, .j m 0: 16 -6 C2- 4,J* o~ c %4

~ . 0~U 0 14 oo

E =,

U X. 2 -. =4 ..: =u E.6.-o

L m cl c0 0 0 4

~ a Ov 0 0~ -0. *0 CL Ca. 12~2

.0d cc:~ A. (n~ a, *n(n (

*0 0

> .2.. 0ft -6 r- ~ 0 Lj .2 c40 t oaj 0 E . 0 A0 m.AS go Ito =m

m4 J E

m~W 04, MU0 -E ->U

E E 01

~~, 06 > 0 4 0 ?U-0

-z. 00

.2~~~~~~4 cs nVo C xt o .

00 0 en z0 0 Go.-J0~~~~ a 0,~

0 ck r-0•zf

;3 - Z

le~0 3- -6 -=c-" C Z

.L--ac . .'0 to -0 v

.~~~3 0a2~~~- <

8 0.0 w2 44 o

w, 4F 4, u 0 -r c I

E~~~ Ez Kc2oz",

Ic.

E - tn

-r-00 a 'r

C, 0

tn.)

ro aQ, E t0

ap . E q., -

06 4J 0 .

> -o,- w. oc := C)) -

m. 0 0-

tr.