federal aviation comprehension of symbolic exit signs i ... · exit possibility (6) likely exit is...

59
G. A. G. A. Mac Mac McLean, Ph.D. McLean, Ph.D. Cynthia L. Corbett, M.A. Cynthia L. Corbett, M.A. Protection and Survival Research Laboratory Protection and Survival Research Laboratory FAA Civil Aerospace Medical Institute FAA Civil Aerospace Medical Institute Oklahoma City, OK 73125 Oklahoma City, OK 73125 Comprehension of Comprehension of Symbolic Exit Signs I: Symbolic Exit Signs I: Effects of Context Effects of Context Federal Aviation Administration

Upload: others

Post on 12-Jun-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

G. A. G. A. ‘‘MacMac’’ McLean, Ph.D.McLean, Ph.D.Cynthia L. Corbett, M.A.Cynthia L. Corbett, M.A.

Protection and Survival Research LaboratoryProtection and Survival Research LaboratoryFAA Civil Aerospace Medical InstituteFAA Civil Aerospace Medical Institute

Oklahoma City, OK 73125Oklahoma City, OK 73125

Comprehension of Comprehension of Symbolic Exit Signs I:Symbolic Exit Signs I:

Effects of ContextEffects of Context

Federal AviationAdministration

Page 2: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Symbolic Exit Sign Exemplars

Collins & Lerner ©, 1983

Page 3: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

• 14CFR 25.811 – Emergency Exit Marking(d) (1) A sign located above the aisle

(2) Next to each exit(3) On each obstructing bulkhead or divider

• 14CFR 25.812 – Emergency Lighting (a) (1) Illuminated emergency exit marking and locating signs(b)(1) (i) Red letters 1.5” high on white background, 21 sq in., stroke

width between 6 and 7:1 contrast ratio 10:1, 25 ft. Lamberts,internally illuminated w/high to low background contrast < 3:1.

Required Emergency Exit Sign

Page 4: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Symbolic Exit Sign

14CFR 21.21- Issue of Type Certificate(b)(1) the type design and product [must] meet the applicable airworthiness requirements of the Federal Aviation Regulations or… any provisions not complied with [must be] compensated for by factors that provide an equivalent level of safety.

Page 5: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Test Booklet Contents(6 Booklet Formats)

1. ANSI Z535 Symbols (7)2. Briefing Card Pictorials (10)3. 25.811 – Required Exit Sign (1)4. Symbolic Exit Sign Exemplars (3)

Page 6: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

ANSI Z535 Symbols

Page 7: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

ANSI Z535 Symbols

Page 8: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

• Who do you think these people are?

• What are they doing?

OWEX1

Page 9: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Category Response Type Weight

0 No response

1 Don’t Know

2 Opposite to the intended meaning - 1.00

3 Wrong 0.00

4 Related but understanding is doubtful / suspect 0.25

5 Related but understanding is arguable 0.50

6 Understanding is likely 0.75

7 Understanding is certain 1.00

Response Categories & Weights

Page 10: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Category Frequency Usable % Weight Comprehension0 8 0.0%1 11 3.1%2 6 1.7% *-1.0 -1.7%3 47 13.2% 0.0 0.0%4 47 13.2% *.25 3.3%

5 97 27.2% *.50 13.6%6 14 3.9% *.75 2.9%7 134 37.6% *1.0 37.6%

Total Comprehension Score 55.8%

Usable N= 356

Comprehension Score Algorithm(Modified ISO 9186 Convention)

Page 11: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Non-Contextual Symbols

Page 12: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

• Describe exactly what you think this symbol means.

GRMN4

Page 13: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Exit Here

Comprehension Score = 96.9%

10 0 1 3 6 11 17

489

0

100

200

300

400

500

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=537

Page 14: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

• Describe exactly what you think this symbol means.

GRMN2

Page 15: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Exit Straight Ahead

Comprehension Score = 43.3%

9 120

60

2916

100125

020406080

100120140

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=351

Page 16: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

• Describe exactly what you think this symbol means.

GRMN3

Page 17: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Exit Here

Comprehension Score = 50.4%

7 11 11

90

35

60

16

129

020406080

100120140

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=359

Page 18: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

• Describe exactly what you think this symbol means.

GRMN1

Page 19: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Exit Here

Comprehension Score = 55.8%

8 11 10

50 49

101

20

115

020406080

100120140

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=364

Page 20: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Comparison of Comprehension Scores

Page 21: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Contextual Symbols

Page 22: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

• Describe exactly what you think this symbol means.

GRMN2-C

Page 23: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Exit Straight Ahead

Comprehension Score = 63.7%

0

10

20

30

40

50

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Page 24: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

emergency exit that way (straight ahead) (7) Certain

this is an emergency escape (6) Likely

shows where the closest exit is to where you are sitting (5) Arguable

proceed in this direction (4) Suspect

The floor between the compartments is not level and requires a step up. (3) Wrong

Exit Straight Ahead

Page 25: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

• Describe exactly what you think this symbol means.

GRMN5-C

Page 26: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Exit Both Sides

Comprehension Score = 71.8%

0

10

20

30

40

50

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Page 27: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

emergency exits either side (7) Certain

which directions you can go (6) Likely

you can walk either way (4) Suspect

Caution when approaching ...people may be moving back and forth and crossing in that area.

(3) Wrong

Exit Both Sides

Page 28: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

• Describe exactly what you think this symbol means.

GRMN6-C

Page 29: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Exit Here

Comprehension Score = 74.9%

0

50

100

150

200

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Page 30: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

that’s the get out door (7) Certain

exit possibility (6) Likely

exit is clear and free from debris. Safe to use exit since the green is indicated

(5) Arguable

go one at a time through door (4) Suspect

no running in this area (3) Wrong

do not leave the plane (2) Opposite

Exit Here

Page 31: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Comparison of Comprehension Scores

Page 32: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Context-Based Conclusions

• Traditional Part 25.811 / .812 EXIT Sign Universally Understood

• Symbolic Signs Without Context Had Mean Comprehension of About 50%

• Addition of Contextual Cues Improved Mean Comprehension to About70%

• Symbolic Signs Were Shown NOT to be Equivalent to Traditional EXITSign

• Additional Compensating Factors Would be Required to Establish an Equivalent Level of Safety

Page 33: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

BREAK

Page 34: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

G. A. G. A. ‘‘MacMac’’ McLean, Ph.D.McLean, Ph.D.Cynthia L. Corbett, M.A.Cynthia L. Corbett, M.A.

Protection and Survival Research LaboratoryProtection and Survival Research LaboratoryFAA Civil Aerospace Medical InstituteFAA Civil Aerospace Medical Institute

Oklahoma City, OK 73125Oklahoma City, OK 73125

Comprehension of Comprehension of Symbolic Exit Signs II:Symbolic Exit Signs II:

Effects of Passenger Effects of Passenger AttributesAttributes

Federal AviationAdministration

Page 35: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Correlation Matrix for Subject Demographics

Page 36: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

ANSI Z535 SymbolsMean Comprehension = 94.4%

Page 37: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

ANSI Z535 SymbolsMean Comprehension = 51.2%

Page 38: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Non-Contextual Demographic Effects

Page 39: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Comparison of Comprehension Scores

Page 40: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Category Response Type Weight

0 No response

1 Don’t Know

2 Opposite to the intended meaning - 1.00

3 Wrong 0.00

4 Related but understanding is doubtful / suspect 0.25

5 Related but understanding is arguable 0.50

6 Understanding is likely 0.75

7 Understanding is certain 1.00

Response Categories & Weights

Page 41: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

All Responses

10 0 1 3 6 11 17

489

0

100

200

300

400

500

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=537

Experts

4 0 0 0 0 1 3

75

0

20

40

60

80

100

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=83

Non-Experts

0 0 0 1 0 1 2

109

0

20

4060

80

100

120

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=113

Students

6 0 1 2 6 9 12

305

050

100150200250300350

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y N=341

Expertise Effects(p=.213)

Page 42: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

All Responses

9 120

60

2916

100125

020406080

100120140

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=351

Experts*

20 0

7 9 8

2

25

0

5

10

15

20

25

30

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=53

Non-Experts

0

6

0

21

14

72

18

05

101520253035

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=68

Students**

7 6 0

97

37

14 12

57

020

4060

80100

120

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=230

Expertise Effects(p<.001)

Page 43: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

All Responses

7 11 11

90

35

60

16

129

020406080

100120140

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=359

Experts*

30 0

63

128

24

05

101520

2530

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=56

Non-Experts**

0

7

1

1411

15

1

26

05

101520253035

0 1 2 3 4 5 6 7

Response Cagegory

Freq

uenc

y

N=75

Students**

4 4 10

70

2133

7

79

0204060

80100120

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=228

Expertise Effects(p<.002)

Page 44: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

All Responses

8 11 10

50 49

101

20

115

020406080

100120140

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=364

Experts*

1 0 0

5 3

22

6

20

0

5

10

15

20

25

30

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=57

Non-Experts

2 4 5 4 5 4

2930

05

101520253035

0 1 2 3 4 5 6 7

Rsponse Category

Freq

uenc

y

N=83

Students**

5 7 5

41 4149

10

66

0

20

40

60

80

100

120

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

N=224

Expertise Effects(p<.02)

Page 45: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Contextual Demographic Effects

Page 46: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Comparison of Comprehension Scores

Page 47: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

0

20

40

60

80

100

English Spanish Vietnamese Other

Perc

enta

gePrimary Language Spoken at Home

Page 48: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Subjects’ Gender Split

0

50

100

150

200

Male Female

Gender

Freq

uenc

y

Page 49: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Subjects’ Age Distribution

0

50

100

150

200

15-30 yrs 31-50 yrs 51+ yrs

Age Range

Freq

uenc

y

Page 50: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Subjects’ Education Level

0

50

100

150

200

12 13 14 15 16

Education Level

Freq

uenc

y

Page 51: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Subjects’ Flight History

0

50

100

150

200

0-2 3-6 7-12 13+

Number of Flights in Last 24 Months

Freq

uenc

y

Page 52: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Subjects’ Expertise Level

0

50

100

150

Students Non-Experts Experts

Freq

uenc

y

Page 53: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Expertise Effects(p = .01)

All Responses

2 1 0

19

412

3

43

0

10

20

30

40

50

60

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Experts

0 0 0 3 05 2

16

0

10

20

30

40

50

60

0 1 2 3 4 5 6 7Response Category

Freq

uenc

y

Non-Experts

0 0 0 2 2 0 0

12

0

10

20

30

40

50

60

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Students*

2 1 0

14

27

1

15

0

10

20

30

40

50

60

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Page 54: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Expertise Effects(p<.04)

All Responses

1 0 0

16

2 2

15

44

0102030405060

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Experts*

0 0 0 1 0 07

15

010

2030

4050

60

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Non-Experts --

0 0 0 3 0 1 39

0102030405060

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Students**

1 0 0

12

2 15

20

0

10

20

30

40

50

60

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Page 55: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Expertise Effects(p < .001)

All Responses

7 7 326

823 16

158

0

40

80

120

160

200

0 1 2 3 4 5 6 7

Reponse Category

Freq

uenc

y

Experts

3 1 0 3 110 4

52

0

20

40

60

80

100

120

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Non-Experts

0 0 0 4 1 1 6

37

020

406080

100120

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Students*

4 6 319

6 12 6

69

0

20

40

60

80

100

120

0 1 2 3 4 5 6 7

Response Category

Freq

uenc

y

Page 56: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Demographics-Based Conclusions

• Inter-Correlations Existed Among All Demographic Variables

• Symbolic Exit Sign Comprehension Scores Were Positively Associated with All Demographic Variables, Particularly with Cabin Safety Expertise

• Increasing Age, Education, and (Especially) Flight History Produced Apparent Increases in “Cabin Safety Expertise”

• Trained Cabin Safety Experts Generally Showed Greater Comprehension of Symbolic Signs

Page 57: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

Demographics-Based Conclusions

• The Results Indicate That the Cabin Safety Expertise Effects are Based on “Familiarity” with the Cabin Interior Environment

• The Results Also Suggest That Improvements in Comprehension Related to Context Are Explained by That Increased Familiarity

• Selection of Compensating Factors to Establish an Equivalent Level of Safety to the Traditional EXIT Sign Should be Based on the Degree to Which Such Factors Can Improve the Familiarity of Symbolic Exit Signs

• Such Factors Would Include Special Briefings, Training, and Repeated Exposure, Especially in Multiple Contexts

Page 58: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable

SeaTac Transit Station

Page 59: Federal Aviation Comprehension of Symbolic Exit Signs I ... · exit possibility (6) Likely exit is clear and free from debris. Safe to use exit since the green is indicated (5) Arguable