General knowledge norms: Updated and expandedfrom the Nelson and Narens (1980) norms

Sarah K. Tauber & John Dunlosky &

Katherine A. Rawson & Matthew G. Rhodes &

Danielle M. Sitzman

Published online: 24 January 2013# Psychonomic Society, Inc. 2013

Abstract The Nelson and Narens (Journal of VerbalLearning and Verbal Behavior 19:338–368, 1980) generalknowledge norms have been valuable to researchers inmany fields. However, much has changed over the 32 yearssince the 1980 norms. For example, in 1980, most peopleknew the answer to the question “What is the name of theLone Ranger’s Indian sidekick?” (answer: Tonto), whereasin 2012, few people know this answer. Thus, we updated the1980 norms and expanded them by providing new meas-ures. In particular, we report two new metacognitive meas-ures (confidence judgments and peer judgments) andprovide a detailed report of commission errors. Each ofthese measures will be valuable to researchers, and togetherthey are likely to facilitate future research in a number offields, such as research investigating memory illusions,metamemory processes, and error correction. The presenceof substantial generational shifts from 1980 to 2012 neces-sitates the use of updated norms.

Keywords General knowledge questions . Metacognition .

Commission errors

Over three decades ago, Nelson and Narens (1980) publishednormative information for a set of questions over multipledomains of knowledge. They created 300 questions andassessed several cognitive and metacognitive measures, in-cluding the probability of recall and the latency to generate a

response. Their norms have been used widely in researchinvestigating the processes involved in long-term memory(e.g., Fazio & Marsh, 2008; Hanley, 2011; Marsh, Meade, &Roediger, 2003; Murayama & Kuhbandner, 2011; Woltz,Gardner, & Gyll, 2000), those involved in metacognition(e.g., Barber, Rajaram, & Marsh, 2008; Metcalfe & Finn,2011; Nelson, Leonesio, Shimamura, Landwehr, & Narens,1982; Schwartz, 2001; Singer & Tiede, 2008; Weinstein &Roediger, 2010; Winne & Muis, 2011), and how all of theseprocesses change over the lifespan (e.g., Cosentino, Metcalfe,Butterfield, & Stern, 2007; Dodson, Bawa, & Krueger, 2007;MacDonald, Dixon, Cohen, & Hazlitt, 2004; Mansueti, deFrias, Bub, & Dixon, 2008; Marsh, Balota, & Roediger,2005; Metcalfe & Finn, 2012). Given the continued relianceon these measures, our primary goals were to (a) update the1980 norms and assess shifts in knowledge that have occurredover the 32 years since they were collected, and (b) expand the1980 norms by providing new measures for the questions.

The three-decade gap warrants new data collection in partbecause knowledge is likely to have shifted in comparisonwith people’s knowledge in 1980. For example, in 1980 mostpeople knew the answer to the question “What is the name ofthe Lone Ranger’s Indian sidekick?” (Tonto; 1980 probabilityof recall = .87). Given that the Lone Ranger was most popularin the early to mid-1900s, it is reasonable that people in 2012would be less likely to know that Tonto was the LoneRanger’s sidekick. Conversely, for other information, genera-tional differences may lead to increased knowledge in 2012relative to 1980. For instance, in 1980 very few people knewthe answer to the question “Of which country isBaghdad the capital?” (1980 probability of recall = .07).Iraq, which is the correct response, has been in the news agreat deal since the 1990s, most notably in reference to theIraq war, which began in 2003. Given such generational shifts,researchers should not rely on the 1980 norms.

S. K. Tauber (*) : J. Dunlosky :K. A. RawsonDepartment of Psychology, Kent State University, Kent,OH 44242, USAe-mail: stauber@kent.edu

M. G. Rhodes :D. M. SitzmanDepartment of Psychology, Colorado State University,Fort Collins, CO, USA

Behav Res (2013) 45:1115–1143DOI 10.3758/s13428-012-0307-9

We also identified several questions from the 1980 normsthat were either outdated or incorrect. For instance, considerthe question “What is the name of the company that produ-ces Baby Ruth candy bars?” In 1980, the correct responsewas Curtiss, but now Nestle produces this candy bar. As anexample of incorrect information, consider the question“What is the last name of the first American author to winthe Nobel Prize for literature?” In the 1980 norms, thecorrect answer was listed as “Henry,” but the correct answeris “Lewis.”

In addition to updating the 1980 norms and correctingsuch errors, we also wished to provide three new measures:confidence judgments, peer judgments, and commissionerrors. We will discuss each in turn. After answering eachquestion, participants made a confidence judgment about thelikelihood (0 %–100 %) that the response was correct.Confidence judgments provide an index of how certainpeople are that their knowledge is correct. To foreshadow,in some cases, people’s confidence was in line with theirknowledge: that is, high confidence for correct responsesand low confidence for incorrect responses. However, forother questions, people’s confidence was a poor indicator ofknowledge. For decades, research has investigated illusionsof memory such as confidently held false memories. Suchresearch has commonly investigated false memories thathave been created from word lists (e.g., Anastasi, Rhodes,& Burns, 2000; Gallo, 2010; Roediger & McDermott,1995), produced by misinformation (e.g., Frenda, Nichols,& Loftus, 2011; Loftus & Hoffman, 1989), or implantedinto one’s past (e.g., Loftus, 1997). The expanded measuresreported here provide researchers with information that willfacilitate research on long-term false memories for generalknowledge information by identifying questions with lowprobabilities of recall and high levels of confidence inerrors.

We also created a new metacognitive measure, peer judg-ments, by having people predict how many peers wouldcorrectly answer each question. This measure provides nor-mative information about people’s sense of how their ownknowledge compares with that of others, which will beuseful within a number of research areas. For instance,researchers have increasingly focused on metacognitivejudgments made for oneself, in comparison with judgmentsfor another person (e.g., Kelley & Jacoby, 1996; Koriat &Ackerman, 2010; Nickerson, 1999). Such research has fo-cused on the influence of one’s subjective experience onmetacognitive processes, and on the relationship betweenpredictions made for oneself as compared with predictionsmade for someone else. The peer judgments reported hereprovide an index of the latter relationship. To preview, forsome questions the confidence and peer judgments werestrongly associated (e.g., Pearson’s r > .80), whereas forother questions the measures were weakly associated (e.g.,

Pearson’s r < .30). Thus, researchers can identify subsets ofquestions for which confidence and peer judgments arehighly correlated, and other subsets for which the two meas-ures are uncorrelated or weakly correlated.

Perhaps most importantly, we have provided a detailedassessment of the kinds of errors that people made whenanswering each question. In particular, we focused on com-mission errors by providing the most commonly reportedincorrect responses and confidence in these errors.Information about commissions and normative confidencein these errors may support inquiry in numerous areas, suchas in research investigating false memories and error cor-rection. Concerning the latter area, researchers are currentlyinvestigating how people correct errors (e.g., Butler, Fazio,& Marsh, 2011; Butterfield & Metcalfe, 2001). To do so, theresearchers use items for which people generate responsesthat are incorrect but are held in high confidence, as com-pared with errors that are held in low confidence. Thecommission errors reported here provide normative valuesfor this kind of information by identifying questions forwhich commission errors are both frequent and associatedwith differing levels of confidence.

Method

Participants, materials, and procedure

Six hundred seventy one students (age:M = 20.1, SE = 0.14,n = 639 who reported age; 443 females, 207 males, n = 650who reported gender) from two large state universities par-ticipated in exchange for course credit. The participantswere recruited from introductory psychology courses atKent State University (KSU; n = 636, who provided51,245 responses included in the probability of recall), aswell as from introduction to psychology and introduction toresearch methods courses at Colorado State University(CSU; n = 35, who provided 1,628 responses included inthe probability of recall). This sample was selected forcomparison purposes with the student sample involved inthe original 1980 norms. However, future research mayprofit by targeting a broader sample of participants (e.g.,community samples) to evaluate the degree to which the2012 norms extend to more diverse samples.

The materials were identical to those used in the Nelsonand Narens (1980) norms. These questions tapped generalknowledge in several domains, including art, body andhealth, entertainment, games, geography, history, literature,science and nature, and sports (see Table A1). The proce-dure was similar to that employed for the 1980 norms, witha few exceptions. The odd-numbered questions from the1980 norms were assigned to Set A, and the even-numbered questions were assigned to Set B (150 questions

1116 Behav Res (2013) 45:1115–1143

per set). Participants were randomly assigned to Set A or B.A small subset of participants (n = 56) completed one setand at least a portion of the second set of questions. For bothsets, the entire experiment was computerized, and the ques-tions were randomly ordered anew for each participant.Questions were presented in uppercase letters, one at a timein the center of the screen. Participants were given thefollowing instructions:

This experiment will test your knowledge about generalkinds of information. You will be asked a question, andyou will type your best guess in the space providedbelow the question. The answer will always consist ofexactly one word and will never be longer than oneword. As each question is presented search your mem-ory hard in an attempt to find the answer to the question.When you have determined the answer there is no needto waste extra time before typing in your response.However, if you do not locate the answer immediately,give yourself a chance to find it by searching yourmemory a bit more. Some questions may take a whilebefore you locate an answer. The questions vary greatlyin difficulty such that you will probably be able toanswer some easily, while others will be harder, and stillothers you may not know at all. If, after searching yourmemory, you are sure you don’t know the answer, thentype the word “NEXT” and proceed to the next ques-tion. Please never leave an answer space blank; forevery answer space, either fill in “NEXT” or fill in yourbest guess. However, there is no penalty for guessing,and incorrect answers will not affect your score, so besure to take a guess, if you can, whenever you areunsure. We are only concerned that you get as manyquestions correct as you possibly can.

For each response, the total amount of time to read thequestion, search memory, and type a response was measuredas an index of response latency. Following each question,participants made a confidence judgment on a scale from 0to 100, indicating their level of confidence that their answerwas correct, such that 0 % indicated not confident and100 % indicated absolutely confident. After the confidencejudgment the participants made a peer judgment, given thefollowing instructions:

Make a judgment about how well you think otherpeople would do with that question. Specifically, ifwe gave the question to 100 students who were aboutyour age, how many of them do you think would beable to answer the question correctly?

Participants based their judgments on a scale from 0 to 100people, where 0 indicated that no other students would get thequestion correct, and 100 indicated that all 100 students wouldget the question correct.

The questions in most cases were administered after partic-ipants had finished an unrelated experimental protocol. Giventhat participants took different amounts of time to finish theinitial protocol, they had different amounts of time remaining(given that they participated for a fixed amount of time overall)to answer questions and make their judgments. Also, with thetime remaining, a participant might not have completed all ofthe questions in his or her assigned set. Thus, the number ofobservations varied per question. However, participants com-pleted all responses (i.e., recall attempt, confidence judgment,and peer judgment) for each question that they attempted,which prevented reporting partial information per question.Confidence judgments were not measured for omission errors(i.e., typing NEXT), because confidence judgments for omis-sions should be 0, and hence are uninteresting. However, foromission errors participants did provide a peer judgment, somore observations would typically be available for peer thanfor confidence judgments. Thus, given that the numbers ofobservations per question and per measure could vary forprincipled reasons, Table A1 includes the number of responsesthat contributed to each measure.

Data scoring

As for the 1980 norms, the data were scored so that answerswere considered correct if the first four letters of the responsematched the correct answer. Due to our interest in commissionerrors, the data were then also hand scored by the first author, toadjust for spelling. The vast majority of the hand scoring wasobjective (e.g., WHODINI for HOUDINI, TERANCHALAfor TARANTULA, and OSTERAGE for OSTRICH were allconsidered correct), but in the rare cases in which scoring wasuncertain, the responses were discussed and resolved by thefirst three authors. Hand scoring also allowed us to adjust forcases in which the first four letters could indicate a correct orincorrect response (e.g., for Question 83, the correct responsewas METEORS, not METEORITES).

Results and discussion

The results were collapsed across testing locations (i.e., KSUand CSU) because the Spearman correlation (ρ) between therank-ordered probabilities of correct recall across questions washigh (.94, p < .001), indicating that the question orders werelargely consistent across the two locations. On average, partic-ipants answered 79.0 (SE = 2.3) questions (range from 1 to 300),provided confidence judgments for 34.5 (SE = 1.1) questions(range from 1 to 214), and provided peer judgments for 80.6(SE = 2.3) questions (range from 1 to 300). The total number ofresponses per question ranged from 126 to 232. Although this issomewhat lower than the total number of responses per itemreported in the original norms (N = 270), the number of

Behav Res (2013) 45:1115–1143 1117

responses per item in the present norms is nonetheless sufficientfor establishing normative patterns of performance.

The results for each question are presented in Table A1. Thistable contains normative data for 299 of the original 300 ques-tions (one question—“What is the capital of Czechoslovakia?”—was dropped because it was outdated and had no correct an-swer). Questions are reported in rank order from the highest tothe lowest probability of correct recall. For purposes of compar-ison, the 1980 rank order is provided as well. Most importantly,for each question Table A1 provides (a) the probability of recall,(b) the mean response latencies (in seconds) for correct andincorrect responses, (c) the proportions of commission andomission errors, (d) the mean confidence judgment across allnonomission responses, as well as the mean confidence judg-ment computed separately for correct responses and commissionerrors, (e) the mean peer judgment, and (f) the correlationbetween the confidence and peer judgments. With reference topoint (b), response latencies for incorrect responses are providedonly for commission errors, and not for omission errors.

As is detailed in the Method section, the number ofresponses varied for each measure. For example, whenparticipants omitted an answer, they did not make a confi-dence judgment, but they did make a peer judgment. Thenumber of responses also varied slightly due to the partic-ipants’ typing errors. For example, given that participantswere instructed (and reminded) that answers were one-wordresponses, if participants typed a number (e.g., “5,” “7,” or“12”), this response was considered a typing error (as if theparticipant had accidentally proceeded from a question with-out getting a chance to respond) and did not contribute to theprobability of recall. Accordingly, in Table A1, we reportthe number of responses that contributed to each measure.

To assess generational stability, a coarse-grained measurewas the rank-order correlation between the new norms and theoriginal ones. The Spearman correlation (ρ) was .83 (p < .001),which suggests stability from 1980 to 2012. Even so, this valuemay overestimate stability, and it does not indicate that the newnorms simply duplicated the original ones. For instance, con-sider that in 1980 the most challenging quartile of questions(the items ranked 225–300) contained only four questions thatwere impossible for participants to answer (i.e., the probabilityof correct recall was zero). By contrast, in 2012, themajority ofthe items (68 %, or 51 questions) in this last quartile wereimpossible. Thus, if researchers today wanted to select rela-tively difficult questions and used the original norms, theymight instead be selecting questions with which many—ifnot all—of their college participants had no experience.

For a fine-grained measure of generational stability, weconducted an independent-samples t test for each question tocompare the current recall against the normative values fromthe 1980 norms. The p value was set at .0002 to adjust for the299 tests. The results revealed nonsignificant differences indi-cating generational stability for 157 questions, and significant

differences indicating generational instability for 142 ques-tions. For the latter set, participants in 2012 had a higherprobability of recall for only three questions, and a lowerprobability of recall for 139 questions (see Table A1). Theshifts in knowledge for some questions were likely due to thecontent being dated, and people in 2012 having had lessexposure to the information. This shift is most likely the casefor many of the game questions—for example, “Which gameuses a doubling cube?” (backgammon). In 2012, backgammonis apparently not a popular game among college-aged students.

Table A2 provides details about commission errors, in-cluding (a) the most common commission errors, (b) howoften each commission error occurred out of all of thecommission responses for that question, (c) how often thecommission error occurred out of all responses for thatquestion, and (d) the mean confidence in the commissionerror. Some commission errors were made with high confi-dence. For example, participants were highly confident (M =86.5 %) that the correct answer to “What is the name of adried grape?” is “prune.” For other commission errors, par-ticipants were not confident. For example, they were notconfident (M = 3.1 %) that “Radium” is the correct answerto “What is the last name of the scientist who discoveredradium?” In this particular case, participants may have beenguessing.

As noted previously, we identified questions thatwere either outdated or incorrect from the 1980 norms.Table A3 provides details about these questions, includ-ing (a) the 1980 correct answer and (b) the 2012 correctanswer. For a final subset of questions, the answer fromthe 1980 norms was correct, but participants providedalternative responses that were correct as well. Forexample, the 1980 correct answer to the question“What is the name of an airplane without an engine?”was “glider.” This answer is still correct, of course, butparticipants provided two alternative responses that werealso correct (“paper” and “model”).

To conclude, the update to this set of norms is essential,because much has changed since the original norms werecollected. As a final example, in 1980 the question “Whatwas the last name of the man who was the voice of Mr.Magoo?” (answer: “Backus”) was considered moderately dif-ficult (1980 probability of recall = .341), but in 2012 thisquestion was impossible, because none of our participantsanswered it correctly. Even so, the updated norms maintainedvariability in the question difficulty (range: .933–.000), andhence will remain a valuable research tool.

Author note This research was supported by the James S. McDonnellFoundation 21st Century Science Initiative in Bridging Brain, Mind, andBehavior Collaborative Award. Thanks to Jeff Anastasi and Beth Marshfor helpful comments on a draft of the manuscript.

1118 Behav Res (2013) 45:1115–1143

Tab

leA1

Probabilitiesof

recall,

respon

selatencies,prop

ortio

nsof

errors,confidence

judg

ments,peer

judg

ments,andcorrelations

betweentheconfidence

andpeer

judg

ments

for29

9general

know

ledg

equ

estio

ns

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

12

WHATIS

THENAMEOFTHEHORSE-LIK

EANIM

AL

WITH

BLACK

AND

WHITESTRIPES?(ZEBRA)

.933

196

146.3

14.7

.03

.04

95.0

96.2

58.2

689

.421

3.66*

23

WHATIS

THENAMEOFTHELONG

SLEEPSOME

ANIM

ALSGO

THROUGH

DURIN

GTHEENTIRE

WIN

TER?(H

IBERNATIO

N)

.890

137

179.6

11.8

.06

.05

92.5

95.6

49.5

1083

.815

4.61*

316

WHATIS

THENAMEOFTHERUBBEROBJECTTHATIS

HIT

BACK

AND

FORTH

BY

HOCKEY

PLAYERS?(PUCK)

.888

198

256.7

10.3

.04

.08

93.8

96.3

29.9

883

.122

6.53*

415

WHATIS

THENAMEOFTHEREMAIN

SOFPLANTSAND

ANIM

ALSTHATAREFOUND

INSTONE?(FOSSILS)

.873

137

209.1

23.5

.06

.07

89.0

93.3

24.3

979

.015

9.65*

513

WHICH

PRECIO

USGEM

ISRED?(RUBY)

.849

141

254.6

11.2

.08

.07

8.6

90.8

33.4

1477

.616

6.64*

625

WHATIS

THENAMEOFTHESEVEREHEADACHETHAT

RETURNSPERIO

DICALLY

AND

OFTEN

ISACCOMPA

NIED

BY

NAUSEA?(M

IGRAIN

E)

.847

133

2410

.215

.2.07

.08

80.5

84.0

38.7

1169

.815

9.64*

730

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTE

“ROMEO

AND

JULIET”?

(SHAKESPEARE)

.843

172

3210

.814

.5.03

.13

89.3

90.8

45.0

679

.921

0.61*

89

WHATIS

THENAMEOFA

DRIED

GRAPE?(RAISIN

).835

116

236.8

6.5

.12

.05

87.7

91.0

64.1

1683

.914

0.52*

91

WHATIS

THENAMEOFTHECOMIC

STRIP

CHARACTER

WHO

EATSSPIN

ACH

TO

INCREASEHIS

STRENGTH?

(POPEYE)b

.824

112

248.5

12.7

.06

.12

91.5

94.1

56.3

873

.414

1.66*

1093

WHATANIM

ALRUNSTHEFA

STEST?(CHEETA

H)a

.816

115

265.6

12.8

.13

.05

76.2

83.5

32.1

1971

.114

1.72*

1133

WHATIS

THENAMEOFTHEPROCESSBY

WHICH

PLANTS

MAKETHEIR

FOOD?(PHOTOSYNTHESIS)

.800

104

2611.8

15.0

.04

.16

84.3

87.4

19.0

570

.213

4.40*

1219

WHATIS

THENAMEOFDOROTHY’S

DOG

IN“T

HEWIZARD

OFOZ”?

(TOTO)

.799

123

316.7

16.9

.08

.12

89.6

97.0

13.9

1280

.715

4.69*

137

WHATIS

THENAMEOFTHEMOLT

EN

ROCK

THATRUNS

DOWN

THESID

EOFAVOLCANO

DURIN

GAN

ERUPTIO

N?

(LAVA)

.793

119

318.6

11.7

.10

.11

87.2

90.7

59.7

1577

.115

0.54*

1437

WHATWASTHENAMEOFTHESUPPOSEDLY

UNSIN

KABLE

SHIP

THATSUNK

ON

ITSMAID

EN

VOYAGEIN

1912

?(TITANIC)

.789

112

309.3

12.9

.05

.16

83.8

87.5

24.3

772

.514

4.81*

158

WHICH

SPORTUSESTHETERMS“G

UTTER”AND

“ALLEY”?

(BOWLIN

G)

.788

164

446.6

11.5

.09

.12

86.1

93.5

22.1

1975

.021

0.80*

1657

WHATIS

THENAMEOFA

GIA

NTOCEAN

WAVECAUSED

BYAN

EARTHQUAKE?(TSUNAMI)

.784

120

3310

.514

.3.09

.12

84.4

89.2

45.7

1572

.715

3.63*

1724

WHATIS

THETERM

FORHITTIN

GAVOLLEYBALLDOWN

HARD

INTO

THEOPPONENT’S

COURT?(SPIK

E)

.784

163

457.2

11.3

.12

.10

86.9

91.1

59.4

2574

.921

4.49*

Appendix

Behav Res (2013) 45:1115–1143 1119

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

1873

WHATIS

THELASTNAMEOFTHEVILLAIN

OUSCAPTA

ININ

THESTORY

“PETERPA

N”?

(HOOK)a

.781

114

328.5

16.1

.03

.18

89.9

92.6

28.0

577

.614

6.61*

195

WHATWASTHENAMEOFTA

RZAN’S

GIRLFRIEND?(JANE)

.781

121

344.3

18.7

.12

.10

85.9

96.5

14.8

1874

.015

6.71*

204

WHATIS

THELASTNAMEOFTHEBROTHERSWHO

FLEW

THEFIRSTAIRPLANEATKITTY

HAWK?(W

RIG

HT)b

.751

151

508.6

11.5

.05

.19

81.1

83.5

48.2

1165

.420

4.72*

2117

WHATIS

THENAMEFORA

MEDICALDOCTORWHO

SPECIA

LIZESIN

CUTTIN

GTHEBODY?(SURGEON)

.748

101

3411.5

8.7

.04

.21

70.7

74.0

15.0

659

.013

9.80*

2253

WHATIS

THELASTNAMEOFTHEFIRSTPERSON

TO

SET

FOOTON

THEMOON?(A

RMSTRONG)

.741

100

3511.0

16.2

.12

.14

74.6

77.6

55.8

1672

.013

5.77*

236

WHATIS

THECAPITALOFFRANCE?(PARIS)b

.730

157

585.8

9.3

.11

.16

68.0

71.9

42.6

2468

.021

9.78*

2411

WHATIS

THENAMEOFTHECRIM

EIN

WHICH

ABUILDIN

GORPROPERTY

ISPURPOSELY

SETON

FIRE?(A

RSON)b

.722

109

428.6

18.0

.14

.14

79.1

88.3

31.9

2168

.715

3.72*

2579

WHATIS

THENAMEOFTHESHORTPLEATED

SKIRT

WORN

BY

MEN

INSCOTLAND?(K

ILT)

.717

9939

6.7

13.9

.08

.20

87.9

95.9

15.4

1170

.113

8.75*

2618

WHATIS

THENAMEOFAN

INABILITY

TO

SLEEP?

(INSOMNIA

).714

150

607.6

19.0

.18

.11

81.0

89.4

47.3

3768

.521

4.65*

2726

WHATIS

THENAMEFORA

MEDICALDOCTORWHO

SPECIA

LIZESIN

DISEASESOFTHESKIN

?(D

ERMATOLOGIST)

.692

146

6512

.313

.7.09

.22

80.7

86.7

34.5

1960

.921

7.66*

2843

WHATIS

THENAMEOFTHELARGESTOCEAN

ON

EARTH?(PACIFIC)

.685

9845

8.1

13.4

.28

.03

65.4

72.2

48.9

4070

.314

4.71*

2922

WHATIS

THENAMEOFTHESHIP

THATCARRIED

THE

PILGRIM

STO

AMERICA

IN16

20?(M

AYFLOWER)b

.663

130

668.5

17.6

.16

.18

77.7

86.6

40.3

3166

.520

2.80*

3041

WHATIS

THENAMEFORA

CYCLONETHATOCCURS

OVERLAND?(TORNADO)

.641

8246

8.0

10.8

.18

.18

79.3

86.9

52.3

2368

.412

8.82*

3110

WHICH

SPORTIS

ASSOCIATED

WITH

WIM

BLEDON?

(TENNIS)b

.619

135

835.4

10.4

.14

.24

80.2

91.5

29.0

3058

.722

4.71*

3234

WHATIS

THENAMEOFTHEBIRD

THATCANNOTFLY

AND

ISTHELARGESTBIRD

ON

EARTH?(O

STRICH)b

.603

132

8711.7

14.4

.29

.11

69.2

79.1

48.5

6362

.822

1.68*

3363

WHATIS

THENAMEOFTHEISLAND-CITY

BELIEVED

SIN

CEANTIQ

UITY

TO

HAVESUNK

INTO

THEOCEAN?

(ATLANTIS)

.593

8659

11.7

16.4

.06

.34

78.5

85.1

15.4

957

.614

7.85*

3488

WHATIS

THENAMEOFTHELIZARD

THATCHANGES

ITSCOLORTO

MATCH

THESURROUNDIN

GS?

(CHAMELEON)

.589

126

8811.3

13.2

.34

.07

70.4

85.1

45.0

7368

.421

8.69*

3535

WHATIS

THENAMEOFTHETHICK

LAYEROFFA

TON

AWHALE?(BLUBBER)b

.572

7959

6.2

9.0

.17

.26

73.4

85.5

32.0

2356

.013

9.87*

3649

WHATIS

THELASTNAMEOFTHEBASEBALLPLAYER

WHO

HAD

THEMOSTHOMERUNSIN

ASIN

GLE

SEASON

PRIO

RTO

1961

?(RUTH)b

.568

8464

12.3

16.8

.10

.33

48.6

49.6

43.1

1546

.815

1.44*

3759

WHATIS

THENAMEOFAYOUNG

SHEEP?(LAMB)

.561

8365

7.8

11.8

.22

.22

71.6

87.2

32.5

3365

.614

9.74*

1120 Behav Res (2013) 45:1115–1143

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

3865

WHATIS

THELARGESTPLANETIN

THESOLARSYSTEM?

(JUPITER)

.559

8063

8.1

10.9

.38

.06

68.4

81.0

50.0

5569

.314

4.75*

3952

WHATIS

THENAMEOFTHENAVIG

ATIO

NIN

STRUMENT

USED

ATSEATO

PLOTPOSITIO

NRELATIV

ETO

THE

MAGNETIC

NORTH

POLE?(COMPA

SS)

.526

103

9311.7

15.9

.14

.34

61.2

68.2

34.4

2747

.520

4.84*

4075

WHATIS

THETERM

INGOLFREFERRIN

GTO

ASCOREOF

ONEUNDERPA

RON

APA

RTICULARHOLE?(BIRDIE)

.523

8174

12.2

17.6

.16

.32

60.2

66.9

38.7

2549

.915

8.54*

4177

WHICH

GAMEUSESA

RUBBERBALLAND

LITTLEMETA

LPIECES?(JACKS)

.521

7569

9.8

22.4

.15

.33

69.2

84.0

16.4

2152

.714

5.70*

4247

WHATIS

THENAMEOFA

DRIED

PLUM?(PRUNE)b

.517

7671

7.7

10.7

.27

.21

65.2

79.3

38.3

4058

.514

7.61*

4340

INWHICH

SPORTDOESA

RID

ERON

HORSEBACK

HIT

ABALLWITH

HIS

MALLET?(POLO)b

.510

106

102

9.8

17.4

.20

.29

69.5

85.7

28.7

4255

.721

2.71*

4478

WHATIS

THENAMEOFTHELEGENDARY

ONE-EYED

GIA

NTIN

GREEK

MYTHOLOGY?(CYCLOPS)

.507

107

104

9.1

13.1

.11

.38

74.6

85.0

26.0

2353

.921

5.71*

4536

INWHATPA

RK

IS“O

LD

FAITHFUL”LOCATED?

(YELLOWSTONE)b

.491

105

109

9.7

13.5

.17

.34

62.0

76.8

20.0

3748

.022

0.75*

4651

WHATIS

THENAMEOFTHEPOKERHAND

INWHICH

ALLOFTHECARDSAREOFTHESAMESUIT?(FLUSH)b

.486

6872

14.6

16.1

.25

.26

54.6

64.8

34.8

3553

.914

1.39*

4790

INWHICH

SPORTIS

THESTA

NLEY

CUPAWARDED?

(HOCKEY)

.481

103

111

5.8

9.2

.42

.10

69.7

87.7

49.0

8963

.821

6.72*

4889

WHATIS

THENAMEOFTHECHAPELWHOSECEILIN

GWASPA

INTED

BY

MICHELANGELO?(SISTIN

E)

.475

6774

12.7

17.7

.16

.37

73.2

83.6

41.5

2253

.414

2.67*

4924

1OFWHICH

COUNTRY

ISBAGHDAD

THECAPITAL?(IRAQ)a

.468

5967

9.8

12.6

.40

.13

60.3

68.5

51.9

5063

.312

8.58*

5076

WHATIS

THENAMEOFTHELIQ

UID

PORTIO

NOF

WHOLEBLOOD?(PLASMA)

.468

9410

710

.312

.7.17

.36

47.4

53.9

29.2

3438

.020

6.56*

5155

WHATIS

THENAMEOFTHECITY

INITALY

THATIS

KNOWN

FORITSCANALS?(V

ENICE)b

.459

6779

9.3

10.5

.26

.28

65.4

82.0

36.1

3854

.314

8.72*

5221

WHATIS

THENAMEOFTHESPEARLIK

EOBJECT

THATIS

THROWN

DURIN

GATRACK

MEET?(JAVELIN

)b.452

7186

10.5

19.4

.29

.25

68.0

85.6

40.8

4659

.015

8.39*

5323

WHATIS

THELASTNAMEOFTHEMAN

WHO

RODE

HORSEBACK

IN17

75TO

WARN

THATTHEBRITISH

WERECOMIN

G?(REVERE)b

.443

6683

13.3

14.8

.12

.44

72.1

85.2

24.1

1855

.115

0.67*

5432

WHO

WASTHEEGYPTIA

NQUEEN

WHO

JOIN

ED

FORCESWITH

MARK

ANTONY

OFROME?(CLEOPA

TRA)b

.443

93117

11.0

19.4

.13

.43

57.3

70.4

12.3

2739

.121

5.73*

5567

WHATIS

THELASTNAMEOFTHEMAN

WHO

ASSASSIN

ATED

ABRAHAM

LIN

COLN?(BOOTH)b

.438

6381

10.5

15.8

.20

.36

68.8

90.0

23.5

2958

.914

4.65*

5620

WHATIS

THELASTNAMEOFTHEMAN

WHO

SHOWED

THATLIG

HTNIN

GIS

ELECTRIC?(FRANKLIN

)b.437

9312

011.6

11.5

.34

.22

64.7

75.5

51.0

7357

.921

7.67*

5728

WHATIS

THELASTNAMEOFTHEFA

MOUS

MAGICIA

NAND

ESCAPEARTISTWHO

DIED

OF

APPENDICITIS?(H

OUDIN

I)b

.436

9512

312

.816

.9.06

.50

52.5

58.7

10.7

1437

.322

5.73*

Behav Res (2013) 45:1115–1143 1121

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

5883

WHATIS

THENAMEOFDEERMEAT?(V

ENISON)b

.432

6484

10.4

11.5

.30

.27

65.8

88.6

32.5

4454

.014

9.59*

5945

WHATIS

THENAMEOFTHELARGEHAIRY

SPID

ER

THATLIV

ESNEARBANANAS?(TARANTULA)b

.429

6384

13.8

15.9

.14

.43

42.8

48.8

24.7

2136

.514

9.62*

6082

WHATIS

THENAMEOFTHEOCEAN

THATIS

LOCATED

BETWEEN

AFRICA

AND

AUSTRALIA

?(INDIA

N)b

.427

9012

112

.915

.8.47

.10

52.0

67.4

38.1

9957

.621

6.62*

6127

WHATIS

THELASTNAMEOFTHESIN

GERWHO

RECORDED

“HEARTBREAK

HOTEL”AND

“ALL

SHOOK

UP”?

(PRESLEY)b

.424

6183

11.5

12.4

.21

.37

72.5

80.9

55.3

3052

.514

6.77*

6281

WHATIS

THENAMEOFTHECRIM

EIN

WHICH

APERSON

PURPOSELY

BETRAYSHIS

COUNTRY?

(TREASON)b

.418

6185

12.0

21.6

.20

.38

63.9

83.5

22.7

2956

.314

8.62*

6310

9WHATIS

THENAMEOFTHEFIRSTARTIFICIA

LSATELLITEPUTIN

ORBIT

BY

RUSSIA

IN19

57?

(SPUTNIK

)

.417

5881

9.9

19.8

.08

.50

68.3

79.2

11.1

1146

.014

0.62*

6412

7WHATBRAND

OFCIG

ARETTEWASFIRSTTO

HAVE

THEFLIP-TOPBOX?(M

ARLBORO)

.399

5583

10.8

10.0

.32

.28

27.8

26.7

29.3

4431

.814

0.32*

6529

WHATKIN

DOFMETA

LIS

ASSOCIATED

WITH

A50

TH

WEDDIN

GANNIV

ERSARY?(G

OLD)b

.396

5787

8.5

11.4

.38

.23

48.0

62.2

33.0

5445

.714

4.73*

6639

WHICH

TYPEOFSNAKEDO

ASIA

NSNAKE-CHARMERSUSE?(COBRA)b

.391

5484

9.7

10.3

.28

.33

60.0

74.8

39.5

3940

.914

0.61*

6742

WHATIS

THEONLY

LIQ

UID

META

LATROOM

TEMPERATURE?(M

ERCURY)b

.388

8313

19.5

20.2

.21

.41

49.6

66.6

17.6

4440

.922

0.65*

6856

WHATIS

THENAMEOFTHEDESERTPEOPLEWHO

WANDERIN

STEAD

OFLIV

ING

INONEPLACE?

(NOMADS)b

.352

7413

612

.121

.7.29

.36

47.4

69.1

20.7

6036

.121

6.72*

6912

1WHATIS

THECAPITALOFNEW

YORK?(A

LBANY)

.331

4999

12.8

16.6

.51

.16

68.2

89.0

54.6

7566

.115

3.54*

7010

1WHATIS

THENAMEOFTHEORGAN

THAT

PRODUCESIN

SULIN

?(PANCREAS)b

.327

4910

113

.821

.1.46

.21

54.1

78.1

37.0

6949

.515

1.63*

7114

0WHATIS

THENAMEOFTHECOLLARBONE?

(CLAVICLE)

.324

7014

68.6

13.7

.22

.46

57.4

78.6

25.7

4739

.622

2.56*

7210

4WHATIS

THENAMEOFTHEEXTIN

CTREPTILES

KNOWN

AS“T

ERRIBLELIZARDS”?

(DIN

OSAURS)b

.315

6313

711.2

15.1

.18

.51

32.5

42.8

14.0

3528

.720

7.76*

7354

WHATIS

THECAPITALOFRUSSIA

?(M

OSCOW)b

.309

6414

37.6

14.3

.09

.60

66.7

79.7

20.4

1841

.721

0.77*

7462

WHICH

BREED

OFCATHASBLUEEYES?(SIA

MESE)b

.308

6614

89.4

8.2

.24

.45

48.5

59.1

34.8

5133

.321

7.68*

7510

2WHATIS

THELASTNAMEOFTHESECOND

U.S.

PRESID

ENT?(A

DAMS)b

.303

6314

510

.012

.7.41

.29

46.5

61.0

35.8

8554

.621

5.43*

7615

2WHATIS

THENAMEOFTHECONSTELLATIO

NTHATLOOKSLIK

EA

FLY

ING

HORSE?(PEGASUS)

.300

6414

99.6

12.5

.22

.48

47.0

64.6

22.7

4633

.721

6.71*

7710

6WHATIS

THENAMEOFTHEKIN

DOFCATTHAT

SPOKETO

ALICEIN

THESTORY

“ALICE’S

ADVENTURESIN

WONDERLAND”?

(CHESHIRE)b

.300

6314

710

.416

.8.30

.40

51.3

84.9

18.3

6447

.321

3.71*

1122 Behav Res (2013) 45:1115–1143

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

7864

WHATIS

THELASTNAMEOFTHEMAN

WHO

PROPOSED

THETHEORY

OFRELATIV

ITY?

(EIN

STEIN

)b

.297

6816

19.9

11.8

.21

.49

53.8

65.3

37.2

4743

.323

2.81*

7958

WHATWASTHELASTNAMEOFTHEWOMAN

WHO

SUPPOSEDLY

DESIG

NED

AND

SEWED

THEFIRSTAMERICAN

FLAG?(ROSS)b

.286

6215

58.0

14.0

.24

.48

60.9

87.6

28.5

5143

.022

5.68*

8012

4WHATIS

THELASTNAMEOFTHEFIRSTSIG

NER

OFTHE“D

ECLARATIO

NOFIN

DEPENDENCE”?

(HANCOCK)

.285

6516

311.7

12.2

.44

.27

49.5

64.1

40.1

101

49.0

233

.68*

8118

7WHATWASTHENAMEOFKIN

GARTHUR’S

SWORD?(EXCALIBUR)

.285

4110

310

.09.3

.12

.60

71.1

92.1

20.4

1742

.814

5.86*

8261

WHATIS

THEWORD

THATMEANSA

NAUTICAL

MILEPERHOUR?(K

NOT)b

.277

3910

211.8

17.8

.27

.45

51.6

69.0

33.7

3839

.514

2.75*

8370

WHATIS

THENAMEFORTHEASTRONOMICAL

BODIESTHATENTERTHEEARTH’S

ATMOSPHERE?

(METEORS)b

.271

5414

514

.816

.4.43

.30

46.6

48.7

45.3

8645

.720

5.58*

8487

WHATIS

THELONGESTRIV

ERIN

SOUTH

AMERICA?

(AMAZON)b

.267

40110

9.8

9.3

.29

.44

57.9

79.9

38.0

4445

.315

2.75*

8586

WHATIS

THENAMEOFTHEAUTOMOBILE

INSTRUMENTTHATMEASURESMILEAGE?

(ODOMETER)b

.258

5415

513

.216

.2.39

.35

51.1

77.6

33.5

8155

.521

3.59*

8614

5WHATITALIA

NCITY

WASDESTROYED

WHEN

MOUNTVESUVIU

SERUPTED

IN79

A.D.?(POMPEII)

.258

41118

9.9

12.9

.26

.48

53.9

87.0

20.8

4137

.015

9.70*

87115

WHATIS

THELASTNAMEOFBATMAN’S

SECRET

IDENTITY

INTHEBATMAN

COMICS?(W

AYNE)b

.252

3510

411.0

19.0

.18

.57

68.0

93.9

31.7

2554

.514

1.78*

8866

WHATIS

THELASTNAMEOFTHEMYTHICAL

GIA

NTLUMBERJA

CK?(BUNYAN)b

.245

5115

714

.113

.1.23

.53

58.2

88.9

24.8

4740

.621

2.72*

8919

9WHATIS

THENAMEOFTHECOMPA

NY

THAT

PRODUCES“B

ABY

RUTH”CANDY

BARS?(N

ESTLE)

.245

3410

510

.710

.2.39

.37

42.8

45.1

41.3

5444

.014

0.59*

9010

3WHATIS

THENAMEOFSOCRATES’MOSTFA

MOUS

STUDENT?(PLATO)b

.239

3410

814

.712

.0.35

.42

46.3

55.2

40.0

4938

.914

2.57*

91111

WHATIS

THENAMEOFTHETHREE-LEAFCLOVER

THATIS

THEEMBLEM

OFIRELAND?(SHAMROCK)b

.239

3310

510

.916

.1.25

.51

55.9

84.4

28.1

3447

.413

9.82*

92110

OFWHICH

COUNTRY

ISBUENOSAIRESTHECAPITAL?

(ARGENTIN

A)b

.204

4417

210

.112

.6.50

.29

43.4

70.3

32.6

109

40.4

219

.66*

9360

WHATIS

THELASTNAMEOFTHEACTRESSWHO

RECEIV

ED

THEBESTACTRESSAWARD

FORTHE

MOVIE

“MARY

POPPIN

S”?

(ANDREWS)b

.203

4316

911.5

14.3

.14

.66

58.9

87.3

18.2

3039

.321

8.73*

9412

6WHATIS

THENAMEOFTHEMOUNTA

INRANGEIN

WHICH

MOUNTEVERESTIS

LOCATED?(H

IMALAYAS)b

.198

4116

613

.814

.3.34

.46

42.6

64.4

30.0

7143

.421

3.68*

9580

WHATIS

THEUNIT

OFSOUND

INTENSITY?(D

ECIBEL)b

.190

4017

18.8

14.2

.51

.30

46.1

73.1

36.1

108

41.0

218

.70*

9620

7.188

27117

11.5

16.9

.14

.67

57.5

86.8

18.0

2042

.314

4.71*

Behav Res (2013) 45:1115–1143 1123

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

WHATIS

THENAMEOFTHEPROJECTWHICH

DEVELOPED

THEATOMIC

BOMBDURIN

GWORLD

WARII?(M

ANHATTA

N)

9799

WHATIS

THEUNIT

OFELECTRICALPOWERTHAT

REFERSTO

ACURRENTOFONEAMPEREATONE

VOLT

?(W

ATT)b

.187

26113

12.6

15.6

.32

.49

41.6

59.7

31.1

4537

.014

0.61*

9813

2WHATIS

THELASTNAMEOFTHEAUTHOROFTHE

BOOK

“198

4”?(O

RWELL)b

.185

3716

312

.913

.0.15

.67

66.0

90.5

34.7

2934

.520

4.65*

9969

INWHICH

GAMEAREMEN

CROWNED?(CHECKERS)b

.176

25117

12.9

17.6

.32

.50

39.6

64.0

26.4

4633

.914

3.71*

100

97WHATIS

THELASTNAMEOFTHEMAN

WHO

ASSASSIN

ATED

PRESID

ENTJO

HN

F.KENNEDY?

(OSWALD)b

.172

2512

014

.819

.1.26

.57

55.0

83.9

35.4

3752

.714

7.47*

101

137

WHATIS

THENAMEOFBATMAN’S

BUTLER?

(ALFRED)b

.163

23118

11.4

13.4

.31

.52

51.8

93.0

30.2

4450

.614

2.74*

102

117

WHICH

COUNTRY

WASTHEFIRSTTO

USE

GUNPOWDER?(CHIN

A)b

.160

2312

18.8

11.2

.53

.31

38.9

73.5

28.5

7738

.614

4.69*

103

14WHATIS

THENAMEOFAN

AIRPLANEWITHOUT

AN

ENGIN

E?(G

LID

ER)b

.157

3016

111.8

13.7

.29

.55

33.9

55.8

22.2

5629

.119

6.58*

104

178

WHATIS

THENAMEOFTHENORTH

STA

R?(POLARIS)

.156

3217

36.5

10.6

.21

.63

44.5

81.8

16.6

4338

.121

4.71*

105

159

WHATIS

THEONLY

WORD

THATTHERAVEN

SAYS

INEDGARALLEN

POE’S

POEM

“THERAVEN”?

(NEVERMORE)

.155

2413

111.2

17.2

.37

.48

38.8

91.3

16.7

5735

.615

6.66*

106

46FORWHICH

COUNTRY

ISTHEYEN

THEMONETA

RY

UNIT?(JAPA

N)b

.152

3318

47.1

9.1

.62

.23

54.0

75.5

48.7

134

45.0

222

.70*

107

139

INWHATEUROPEAN

CITY

ISTHEPA

RTHENON

LOCATED?(ATHENS)b

.150

2514

28.4

13.0

.40

.45

51.2

76.8

41.7

6740

.316

9.68*

108

113

WHATIS

THENAMEOFTHEFURRYANIM

AL

THATATTA

CKSCOBRA

SNAKES?(M

ONGOOSE)b

.149

20114

8.0

16.4

.36

.49

46.4

89.7

28.3

4833

.313

6.61*

109

166

FORWHICH

COUNTRY

ISTHERUPEETHE

MONETA

RY

UNIT?(INDIA

).147

3118

08.6

13.3

.27

.58

35.7

71.1

16.8

5824

.521

6.75*

110

154

WHATIS

THELASTNAMEOFTHEMAN

WHO

FIRST

STUDIED

GENETIC

INHERITANCEIN

PLANTS?(M

ENDEL)

.144

3017

99.9

11.2

.21

.65

49.5

85.2

24.6

4329

.221

7.63*

111

107

WHATIS

THELASTNAMEOFTHEMAN

WHO

WROTETHE“STA

RSPA

NGLED

BANNER”?

(KEY)b

.141

2012

28.9

14.8

.22

.64

46.2

85.0

21.1

3142

.914

1.77*

112

112

WHATIS

THENAMEOFTHEPA

LACEIN

LONDON

INWHICH

THEMONARCH

OFENGLAND

RESID

ES?

(BUCKIN

GHAM)b

.141

2917

716

.019

.4.20

.66

46.0

72.9

26.9

4132

.9211

.62*

113

125

INWHICH

GAMEARETHESTA

NDARD

PIECESOF

STA

UNTON

DESIG

N?(CHESS)b

.138

2113

114

.216

.1.14

.72

20.0

30.5

10.0

2221

.415

4.53*

114

206

WHATAREPEOPLEWHO

MAKEMAPSCALLED?

(CARTOGRAPHERS)

.138

2918

19.3

12.4

.41

.45

34.1

73.2

20.8

8632

.021

6.61*

1124 Behav Res (2013) 45:1115–1143

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

115

94WHATWASTHENAMEOFTHEZEPPELIN

THAT

EXPLODED

INLAKEHURSTN.J.IN

1937

?(H

INDENBURG)b

.134

2918

820

.212

.5.13

.74

40.6

68.8

11.3

2824

.022

3.64*

116

167

WHATIS

THEPA

LACEBUILTIN

FRANCEBY

KIN

GLOUIS

XIV

?(V

ERSAILLES)

.128

17116

10.1

13.1

.16

.71

40.7

71.1

16.2

2129

.413

4.38*

117

114

INWHICH

CITY

ISTHEU.S.NAVALACADEMY

LOCATED?(A

NNAPOLIS)b

.127

2718

511.3

20.4

.37

.50

39.0

75.6

26.4

7937

.821

6.61*

118

72WHATIS

THENAMEOFTHELIG

HTESTWOOD

KNOWN?(BALSA)b

.125

2618

29.0

11.9

.45

.43

32.8

48.3

28.5

9328

.521

6.66*

119

31WHATIS

THELASTNAMEOFTHEBOXERWHO

LATERBECAMEKNOWN

ASMUHAMMAD

ALI?

(CLAY)b

.117

1712

810

.613

.1.25

.63

45.1

94.9

21.6

3646

.114

6.69*

120

119

WHATISLAND

ISTHELARGESTIN

THEWORLD

EXCLUDIN

GAUSTRALIA

?(G

REENLAND)b

.111

1612

815

.418

.7.60

.28

34.3

51.3

31.1

8741

.014

4.55*

121

71WHATIS

THENAMEOFTHESMALLJA

PANESE

STOVEUSED

FOROUTDOORCOOKIN

G?(H

IBACHI)b

.110

1612

911.9

10.3

.32

.57

38.2

60.3

30.5

4631

.814

6.65*

122

105

WHATIS

THELASTNAMEOFTHEWOMAN

WHO

BEGAN

THEPROFESSIO

NOFNURSIN

G?

(NIG

HTIN

GALE)b

.108

1613

213

.410

.6.14

.75

41.9

66.9

22.8

2126

.914

8.66*

123

175

WHO

WASTHELEADEROFTHEARGONAUTS?

(JASON)

.107

1512

55.0

11.6

.07

.82

52.2

81.6

8.2

1023

.514

1.69*

124

214

WHATIS

THELASTNAMEOFTHEARTISTWHO

PAIN

TED

“GUERNICA”?

(PICASSO)

.107

2117

611.5

11.7

.16

.73

30.8

56.6

13.8

3220

.820

3.74*

125

177

INWHATANCIENTCITY

WERETHE“H

ANGIN

GGARDENS”LOCATED?(BABYLON)

.103

1412

216

.813

.8.38

.51

36.0

67.9

27.4

5230

.013

6.60*

126

200

WHATAREPEOPLECALLED

WHO

EXPLORE

CAVES?(SPELUNKERS)

.100

2118

814

.712

.6.44

.45

27.7

61.2

20.1

9330

.821

4.53*

127

168

WHATIS

THENAMEOFTHECAPTA

INOFTHE

PEQUOD

INTHEBOOK

“MOBY

DICK”?

(AHAB)

.097

2018

711.7

12.0

.19

.71

41.3

90.9

16.6

4033

.421

2.59*

128

258

WHATIS

THECAPITALOFKENTUCKY?(FRANKFORT)

.095

1918

218

.614

.2.34

.57

48.8

78.4

40.6

6844

.320

5.56*

129

85WHATIS

THENAMEOFAN

ILLEGALMOVEBYA

BASEBALLPITCHERTHATRESULT

SIN

ALL

RUNNERSADVANCIN

GONEBASE?(BALK)b

.093

1413

610

.022

.1.45

.45

53.9

95.7

45.3

6851

.715

2.51*

130

129

WHATIS

THELASTNAMEOFTHEAMERICAN

WHO

STA

RRED

INTHE19

36OLY

MPICS?(O

WENS)b

.093

1413

612

.111.6

.17

.74

31.2

58.6

15.8

2522

.914

9.59*

131

174

THEDEEPESTPA

RTOFTHEOCEAN

ISLOCATED

ATWHICH

TRENCH?(M

ARIA

NA)

.093

1918

511.2

13.2

.29

.61

29.4

70.1

16.6

6026

.420

8.62*

132

169

WHICH

SPORTUSESTHETERMS“STONES”AND

“BROOMS”?

(CURLIN

G)

.092

1312

819

.314

.7.48

.43

37.3

74.6

30.0

6736

.814

2.61*

133

182

WHATIS

THEPROPERNAMEFORA

BADMIN

TON

BIRD?(SHUTTLECOCK)

.091

2020

09.8

10.0

.49

.42

49.6

88.5

42.4

108

37.1

225

.72*

134

128

.090

2020

39.2

14.0

20.71

43.2

87.5

23.0

4435

.122

9.64*

Behav Res (2013) 45:1115–1143 1125

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTE“O

LIV

ERTWIST”?

(DICKENS)b

135

196

WHATIS

THECAPITALOFDELAWARE?(D

OVER)

.090

1919

39.9

19.4

.15

.76

39.8

74.6

19.2

3236

.821

6.60*

136

120

WHATIS

THELASTNAMEOFTHEMAN

WHO

INVENTED

THEPHONOGRAPH?(EDISON)b

.086

1718

015

.89.5

.24

.68

43.8

63.2

36.8

4729

.820

0.76*

137

48IN

WHICH

TYPEOFSKIRACEDOESTHEDOWNHILL

SKIERMAKESHARPTURNSAROUND

POLES?

(SLALOM)b

.086

1920

214

.319

.0.29

.62

30.4

68.3

19.3

6533

.622

6.55*

138

153

INWHICH

CITY

ISHEATHROW

AIRPORTLOCATED?

(LONDON)b

.083

1213

38.1

14.6

.26

.66

31.4

90.8

12.6

3824

.214

5.50*

139

235

WHATIS

THECAPITALOFJA

MAICA?(K

INGSTON)

.081

1213

710

.513

.3.18

.74

34.1

77.5

14.7

2730

.515

0.49*

140

44WHICH

PLANETWASTHELASTTO

BEDISCOVERED?

(NEPTUNE)b

.080

1719

518

.47.5

.77

.15

51.9

47.6

52.3

164

50.5

217

.76*

141

185

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTE“T

HEMURDERSIN

THERUEMORGUE”?

(POE)

.080

1112

78.5

13.6

.11

.81

28.3

55.5

8.5

1522

.714

1.82*

142

205

WHATIS

THENAMEOFTHESHIP

ON

WHICH

CHARLES

DARWIN

MADEHIS

SCIENTIFIC

VOYAGE?(BEAGLE)

.079

1112

910

.215

.3.16

.76

38.3

98.1

8.5

2228

.114

2.54*

143

213

WHATIS

THECAPITALOFCHILE?(SANTIA

GO)

.077

1113

115

.311.6

.19

.73

35.2

70.0

21.0

2733

.814

3.41*

144

100

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTE“T

HEOLD

MAN

AND

THESEA”?

(HEMIN

GWAY)b

.077

1619

38.9

12.6

.11

.81

39.3

75.4

14.1

2322

.521

3.73*

145

147

WHATIS

THELASTNAMEOFTHEMAN

WHO

WROTE“C

ANTERBURY

TALES”?

(CHAUCER)b

.076

1113

410

.115

.5.23

.69

37.0

93.2

18.8

3433

.614

8.60*

146

262

WHATIS

THENAMEOFTHEFOUNTA

ININ

ROMEIN

TO

WHICH

COIN

SARETHROWN

FORGOOD

LUCK?

(TREVI)

.071

1418

324

.712

.2.32

.60

28.9

86.6

16.3

6434

.120

5.52*

147

162

WHATWASTHELASTNAMEOFTHEMAN

WHO

WAS

PRESID

ENTDIRECTLY

AFTERJA

MESMADISON?

(MONROE)b

.068

1520

511.7

14.7

.40

.53

29.3

64.3

23.3

8835

.322

1.53*

148

143

WHATIS

THELASTNAMEOFTHEASTRONOMER

WHO

PUBLISHED

IN15

43HIS

THEORY

THATTHE

EARTH

REVOLV

ESAROUND

THESUN?(COPERNICUS)b

.067

912

615

.016

.8.50

.44

50.5

63.3

48.8

6740

.213

9.69*

149

242

WHATIS

THELASTNAMEOFTHECRIM

INALWHO

WASKNOWN

AS“SCARFA

CE”?

(CAPONE)

.066

1419

99.9

14.3

.38

.56

57.7

60.6

57.3

8050

.122

0.78*

150

12WHATIS

THENAMEOFTHELONERANGER’S

INDIA

NSID

EKICK?(TONTO)b

.061

1320

07.5

11.6

.17

.77

25.3

71.8

8.9

3722

.321

9.52*

151

170

WHATIS

THECAPITALOFDENMARK?

(COPENHAGEN)b

.060

1320

423

.414

.4.18

.76

29.0

52.1

21.3

3927

.222

1.51*

152

96.059

1219

09.5

20.7

.13

.81

32.9

79.9

11.3

2624

.720

9.44*

1126 Behav Res (2013) 45:1115–1143

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

WHATWASTHELASTNAMEOFTHEMAN

WHO

WASTHERADIO

BROADCASTERFORTHE“W

AR

OFTHEWORLDS”?

(WELLES)b

153

203

INWHICH

CITY

ISMICHELANGELO’S

STA

TUEOF

DAVID

LOCATED?(FLORENCE)

.058

812

914

.510

.0.64

.30

39.3

60.0

37.4

8843

.013

8.65*

154

146

WHATWASFRANK

LLOYD

WRIG

HT’S

PROFESSIO

N?

(ARCHITECT)b

.058

1219

67.8

11.1

.45

.49

33.7

91.7

26.3

9425

.921

4.65*

155

135

OFWHICH

COUNTRY

ISNAIROBITHECAPITAL?

(KENYA)b

.053

712

66.6

14.6

.34

.61

27.9

79.1

19.9

4526

.313

4.53*

156

134

WHATIS

THENAMEOFTHEHILLBILLY

FAMILY

THATHAD

AFA

MOUSFEUD

WITH

THEMCCOY

FAMILY?(H

ATFIELD)b

.052

1119

912

.716

.0.22

.73

30.8

81.8

18.6

4627

.721

5.69*

157

156

WHATKIN

DOFPOISON

DID

SOCRATESTA

KEASHIS

EXECUTIO

N?(H

EMLOCK)b

.052

1120

07.5

13.8

.27

.67

26.7

87.8

15.1

5823

.321

6.63*

158

74WHATIS

THELASTNAMEOFTHEFIRSTPERSON

TO

COMPLETEA

SOLO

FLIG

HTACROSSTHEATLANTIC

OCEAN?(LIN

DBERGH)b

.052

1120

115

.614

.7.38

.57

43.1

81.8

37.8

8036

.121

9.66*

159

38ANDY

GRIFFITH

WASTHESHERIFFOFWHATTOWN

ON

TELEVISIO

N’S

“ANDY

GRIFFITH

SHOW”?

(MAYBERRY)b

.052

1120

29.7

13.6

.15

.80

34.3

94.5

12.9

3128

.322

0.64*

160

142

WHATIS

THENAMEOFTHEROMAN

EMPEROR

WHO

FID

DLED

WHILEROMEBURNED?(N

ERO)b

.052

1120

210

.614

.8.25

.70

33.8

72.3

25.8

5323

.422

0.69*

161

231

WHATIS

THECITY

INWHICH

THEBASEBALLHALL

OFFA

MEIS

LOCATED?(COOPERSTOWN)

.051

713

09.8

17.2

.41

.54

29.7

67.9

25.0

5643

.713

7.51*

162

98WHATIS

THENAMEOFTHEUNIT

OFMEASURE

THATREFERSTO

ASIX

-FOOTDEPTH

OFWATER?

(FATHOM)b

.051

1120

619

.217

.0.32

.63

34.9

70.9

29.3

7029

.822

1.49*

163

108

WHATIS

THELASTNAMEOFTHESCIENTISTWHO

DISCOVERED

RADIU

M?(CURIE)b

.046

918

68.9

11.4

.19

.76

19.5

65.0

8.7

3819

.920

1.74*

164

149

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTE“B

RAVENEW

WORLD”?

(HUXLEY)b

.045

714

910

.914

.2.19

.77

32.9

98.6

17.1

2932

.315

7.67*

165

164

INADDITIO

NTO

THEKENTUCKY

DERBYAND

THE

BELMONTSTA

KESWHATHORSERACECOMPRISES

THETRIPLECROWN?(PREAKNESS)b

.044

1021

821

.021

.9.16

.80

33.4

96.5

15.9

3626

.223

3.66*

166

204

WHATIS

THELASTNAMEOFTHECRIM

INALWHO

WASKILLED

BY

FBIAGENTSOUTSID

EOFA

CHICAGO

MOVIE

THEATER?(D

ILLIN

GER)

.044

919

717

.420

.6.20

.76

31.8

81.1

20.9

4122

.4211

.68*

167

95WHATIS

THENAMEOFTHESIN

GERWHO

POPULARIZED

ADANCEKNOWN

ASTHE“T

WIST”?

(CHECKER)b

.041

613

921

.412

.8.30

.66

31.4

63.5

27.0

4432

.514

6.49*

168

221

OVERWHICH

RIV

ERIS

THEGEORGEWASHIN

GTON

BRID

GE?(H

UDSON)

.041

614

132

.214

.1.37

.59

32.5

73.3

27.9

5433

.914

8.39*

Behav Res (2013) 45:1115–1143 1127

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

169

189

WHATIS

THELASTNAMEOFTHEMAN

WHO

INVENTED

DYNAMITE?(N

OBEL)b

.040

614

37.4

11.3

.26

.70

24.6

95.0

13.8

3925

.814

9.54*

170

228

WHATIS

THENAMEOFTHECHIN

ESERELIG

ION

FOUNDED

BY

LAO

TSE?(TAOISM)

.040

819

213

.013

.0.42

.54

37.9

56.3

36.1

8428

.620

7.74*

171

84WHATIS

THELASTNAMEOFTHECOMMANDER

WHO

LOSTTHEBATTLEOFTHELITTLE

BIG

HORN

RIV

ER?(CUSTER)b

.038

820

111.0

12.5

.20

.77

31.9

76.3

23.2

4126

.521

2.66*

172

155

WHATIS

THENAMEOFTHENAVIG

ATIO

NIN

STRUMENTUSED

ATSEATO

PLOTPOSITIO

NBY

THESTA

RS?(SEXTA

NT)b

.038

512

714

.919

.4.54

.42

32.3

62.2

30.2

7136

.813

4.58*

173

161

WHO

WASTHEMOSTFA

MOUSGREEK

DOCTOR?

(HIPPOCRATES)b

.037

513

116

.215

.3.18

.79

27.1

83.0

15.5

2423

.313

9.68*

174

165

INWHICH

CITY

DOESTHECOTTON

BOWLTA

KE

PLACE?(D

ALLAS)b

.037

513

110

.714

.3.36

.60

23.8

16.0

24.6

4933

.713

8.56*

175

192

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTETHESHERLOCK

HOLMESSTORIES?

(DOYLE)

.036

821

217

.013

.4.18

.79

30.1

90.6

17.6

3934

.022

6.59*

176

225

FORWHICH

COUNTRY

ISTHEDRACHMATHE

MONETA

RY

UNIT?(G

REECE)

.036

513

519

.615

.4.31

.66

24.7

88.0

17.3

4320

.914

1.27

177

148

WHATIS

THENAMEOFTHEMANSIO

NIN

VIRGIN

IATHATWASTHOMASJEFFERSON’S

HOME?(M

ONTICELLO)b

.035

719

111.9

16.9

.15

.81

29.5

89.3

15.5

3026

.720

5.51*

178

236

WHATIS

THELONGESTRIV

ERIN

ASIA

?(YANGTZE)

.035

719

117

.310

.0.37

.59

33.4

32.1

33.5

7432

.220

2.71*

179

183

WHATIS

THELASTNAMEOFTHEACTORWHO

RECEIV

ED

THEBESTACTORAWARD

FOR

THEMOVIE

“ON

THEWATERFRONT”?

(BRANDO)b

.034

514

311.3

7.3

.08

.89

31.7

100.0

3.3

1224

.715

1-.06

180

91WHATIS

THELASTNAMEOFTHEMALESTA

ROFTHEMOVIE

“CASABLANCA”?

(BOGART)b

.034

514

49.6

18.1

.27

.70

26.8

86.0

19.4

4033

.414

9.55*

181

150

OFWHICH

COUNTRY

ISBUDAPESTTHECAPITAL?

(HUNGARY)b

.033

720

59.9

11.9

.43

.54

28.9

70.9

25.7

9126

.021

5.64*

182

191

WHO

ISKNOWN

AS“T

HEFA

THEROF

GEOMETRY”?

(EUCLID

)b.033

514

820

.713

.2.31

.66

25.5

70.0

20.7

4730

.415

3.41*

183

193

WHATIS

THELASTNAMEOFTHEHUSBAND-W

IFE

SPIESWHO

WEREELECTROCUTED

IN19

51FORPA

SSIN

GATOMIC

SECRETSTO

RUSSIA

?(ROSENBERG)

.031

412

629

.014

.9.17

.80

21.7

56.3

15.5

2220

.613

2.42*

184

261

WHATIS

THELASTNAMEOFTHECOMPOSERWHO

WROTE

THEOPERA

“DON

GIO

VANNI”?(M

OZART)

.030

412

810

.112

.1.21

.76

18.3

13.8

18.9

2818

.513

2.60*

185

190

WHATIS

THELASTNAMEOFTHEAUTHOROF

THEJA

MESBOND

NOVELS?(FLEMIN

G)b

.030

722

511.4

9.6

.16

.81

19.0

80.7

7.6

3829

.123

4.45*

186

122

WHATWASTHELASTNAMEOFBUFFA

LO

BILL?

(CODY)b

.030

619

614

.210

.2.27

.70

29.0

79.8

23.5

5526

.020

7.62*

1128 Behav Res (2013) 45:1115–1143

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

187

136

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTE

UNDERTHEPSEUDONYM

OFMARK

TWAIN

?(CLEMENS)b

.029

620

115

.211.8

.16

.81

21.6

61.0

14.6

3424

.121

4.68*

188

233

WHATIS

THENAMEOFTHEISLAND

ON

WHICH

NAPOLEON

WASBORN?(CORSICA)

.029

413

638

.313

.5.28

.69

25.0

72.5

20.1

3927

.414

1.40*

189

157

WHATIS

THELASTNAMEOFTHEDOCTORWHO

FIRSTDEVELOPED

AVACCIN

EAGAIN

STPOLIO

?(SALK)b

.028

413

716

.119

.8.16

.82

26.2

80.0

16.4

2229

.314

3.68*

190

181

WHATIS

THELASTNAMEOFTHEMAN

WHO

BEGAN

THEREFORMATIO

NIN

GERMANY?(LUTHER)b

.028

413

818

.79.9

.53

.44

54.1

75.0

53.0

7542

.114

2.64*

191

211

WHATIS

THECAPITALOFFIN

LAND?(H

ELSIN

KI)

.026

414

914

.010

.4.17

.80

19.2

67.3

11.8

2628

.415

4.53*

192

188

WHATWASTHENAMEOFTHEAPOLLO

LUNAR

MODULETHATLANDED

THEFIRSTMAN

ON

THEMOON?(EAGLE)b

.025

519

330

.916

.9.37

.61

28.9

38.4

28.2

7339

.024

1.67*

193

264

WHATIS

THELASTNAMEOFTHECOSMONAUT

WHO

WASTHEFIRSTPERSON

TO

ORBIT

AROUND

THEEARTH?(G

AGARIN

)

.024

520

710

.914

.6.28

.69

31.0

70.0

27.8

6026

.221

7.46*

194

243

WHATWASTHENAMEOFROY

ROGER’S

DOG?

(BULLET)

.021

313

88.6

8.1

.23

.74

7.1

3.3

7.5

3321

.914

1.48*

195

171

WHATWASTHENAMEOFALEXANDERGRAHAM

BELL’SASSISTA

NT?(W

ATSON)b

.021

313

912

.513

.7.13

.85

22.6

26.7

21.9

1923

.114

6.50*

196

176

WHATWASTHELASTNAMEOFTHECOMPOSER

OFTHE“M

APLELEAFRAG”?

(JOPLIN

)b.020

419

69.8

9.5

.15

.83

14.3

75.0

6.2

3016

.720

7.75*

197

216

WHATIS

THELASTNAMEOFTHEPLAYWRIG

HTWHO

WROTE“A

STREETCARNAMED

DESIRE”?

(WILLIA

MS)

.020

419

726

.913

.1.13

.85

18.4

87.5

8.1

2720

.120

5.77*

198

158

WHATIS

THELASTNAMEOFTHEAUTHOROF

“LITTLEWOMEN”?

(ALCOTT)b

.020

419

86.4

11.4

.17

.81

20.0

72.5

13.9

3425

.320

5.76*

199

209

WHATIS

THELASTNAMEOFTHEFIRSTPERSON

TO

CLIM

BMOUNTEVEREST?(H

ILLARY)

.020

314

98.4

9.9

.13

.85

22.8

96.7

11.8

2025

.515

5.62*

200

68WHATIS

THELASTNAMEOFTHEACTORWHO

PLAYED

RHETTBUTLERIN

“GONEWITH

THE

WIN

D”?

(GABLE)b

.020

419

922

.716

.0.14

.84

17.0

68.8

9.6

2823

.920

8.32

201

254

INWHICH

COUNTRY

ISANGELFA

LLSLOCATED?

(VENEZUELA)

.020

419

917

.212

.7.39

.59

27.4

76.3

25.0

8024

.720

6.66*

202

218

WHATIS

THECAPITALOFCANADA?(O

TTA

WA)

.019

420

718

.111.8

.73

.25

41.5

65.0

40.9

154

44.8

215

.61*

203

286

WHATIS

THELASTNAMEOFTHETWENTY-FIRST

U.S.PRESID

ENT?(A

RTHUR)

.019

420

826

.416

.8.49

.49

23.4

93.8

20.7

104

32.0

218

.53*

204

274

WHATWASTHENAMEOFTHEGOLDFISH

INTHE

STORY

OFPIN

OCCHIO

?(CLEO)

.019

421

216

.010

.9.24

.74

15.8

90.0

10.0

5230

.122

1.45*

205

282

WHATIS

THENAMEOFTHEVILLAIN

OUSPEOPLE

WHO

LIV

ED

UNDERGROUND

INH.G.WELLS’S

BOOK

“THETIM

EMACHIN

E”?

(MORLOCKS)

.018

421

919

.516

.4.17

.81

13.5

75.0

7.1

3819

.622

8.52*

Behav Res (2013) 45:1115–1143 1129

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

206

224

WHATWASTHELASTNAMEOFTHECHARACTER

PORTRAYED

BY

ROBERTSTA

CK

ON

THETELEVISIO

NSHOW

“THEUNTOUCHABLES”?

(NESS)

.015

319

511.4

14.9

.12

.86

10.8

63.3

4.2

2424

.020

3.57*

207

284

WHATIS

THECAPITALOFAUSTRALIA

?(CANBERRA)

.015

319

615

.57.7

.63

.35

70.3

100.0

69.6

126

52.2

204

.62*

208

259

WHATIS

THELASTNAMEOFTHEARTISTWHO

PAIN

TED

“THEPERSISTENCEOFMEMORY”?

(DALI)

.015

213

416

.013

.7.21

.77

14.3

57.5

11.3

2919

.314

0.48*

209

144

WHATIS

THELASTNAMEOFTHEMAN

WHO

INVENTED

THETELEGRAPH?(M

ORSE)b

.014

321

09.1

12.0

.41

.58

41.8

83.3

40.3

8735

.821

8.79*

210

160

WHATIS

THENAMEOFTHERIV

ERON

WHICH

BONN

ISLOCATED?(RHIN

E)b

.014

321

017

.512

.1.16

.83

12.9

43.3

10.2

3417

.521

9.69*

211

247

WHATIS

THENAMEOFTHESUBSTA

NCEDERIV

ED

FROM

AWHALETHATIS

USED

TO

MAKEPERFUME?

(AMBERGRIS)

.014

214

141

.612

.9.45

.54

33.8

55.0

33.1

6428

.814

3.73*

212

133

WHATIS

THENAMEOFTHESUBMARIN

EIN

JULESVERNE’S

“20,00

0LEAGUESBENEATH

THESEA”?

(NAUTILUS)b

.014

214

38.4

11.0

.12

.86

15.7

100.0

6.3

1823

.814

6.76*

213

223

WHATWASTHENAMEOFTHECLOWN

ON

THE

“HOWDY

DOODY”TELEVISIO

NSHOW?(CLARABELL)

.014

214

324

.210

.0.18

.81

18.5

45.0

16.5

2625

.314

7.89*

214

226

WHATIS

THELASTNAMEOFDAGWOOD’S

BOSSIN

THECOMIC

STRIP

“BLONDIE”?

(DITHERS)

.010

219

09.3

10.9

.10

.89

15.4

92.5

7.7

2020

.219

8.29

215

184

WHATIS

THELASTNAMEOFTHEMOVIE

ACTOR

WHO

PORTRAYED

SPA

RTA

CUS?(D

OUGLAS)b

.010

219

27.6

12.0

.27

.72

31.5

45.0

31.0

5231

.320

2.67*

216

230

WHATIS

THELASTNAMEOFTHEWOMAN

WHO

FOUNDED

THEAMERICAN

RED

CROSS?(BARTON)

.010

219

814

.115

.6.27

.73

18.0

87.5

15.4

5326

.420

6.55*

217

292

WHATIS

THELASTNAMEOFTHEUNIO

NGENERAL

WHO

DEFEATED

THECONFEDERATEARMYATTHE

CIV

ILWARBATTLEOFGETTYSBURG?(M

EADE)

.010

220

116

.614

.7.44

.55

35.8

60.0

35.3

8935

.520

9.55*

218

198

WHATIS

THENAMEOFTHEAVENUETHAT

IMMEDIATELY

FOLLOWSATLANTIC

AVENUEIN

THEGAMEOFMONOPOLY

?(V

ENTNOR)b

.010

220

231

.816

.4.38

.61

23.1

75.0

21.7

7832

.021

3.63*

219

92WHICH

GAMEUSESA

DOUBLIN

GCUBE?(BACKGAMMON)b

.010

220

826

.715

.7.26

.73

23.6

25.0

23.5

5527

.621

3.72*

220

296

WHATIS

THELASTNAMEOFTHEMAN

WHO

SUPPOSEDLY

KILLED

JESSEJA

MES?(FORD)

.009

221

59.4

16.6

.19

.80

13.2

47.5

11.5

4225

.222

2.53*

221

245

WHATIS

THELASTNAMEOFTHEEUROPEAN

AUTHORWHO

WROTE“T

HETRIA

L”?

(KAFKA)

.008

112

770

.811.4

.13

.87

2.8

0.0

3.0

1619

.912

9.27

222

255

THEGENERALNAMED

HANNIBALWASFROM

WHATCITY?(CARTHAGE)

.007

113

711.5

14.9

.28

.71

13.4

40.0

12.7

3924

.714

3.43*

223

237

WHATIS

THELASTNAMEOFTHEBRITISH

ADMIRALWHO

WON

THEBATTLEOFTRAFA

LGAR?(N

ELSON)

.007

113

86.9

13.4

.12

.88

8.6

100.0

2.9

1618

.414

1-.12

224

265

WHATIS

THENAMEOFTHEIN

DIA

NCOLLEGE

INPENNSYLV

ANIA

FORWHICH

JIM

THORPE

PLAYED

FOOTBALL?(CARLISLE)

.007

114

566

.720

.0.17

.82

11.8

100.0

8.3

2524

.314

7.08

1130 Behav Res (2013) 45:1115–1143

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

225

273

WHATIS

THENAMEOFTHEPLAY

INWHICH

ELW

OOD

P.DOWD

ISA

CHARACTER?(H

ARVEY)

.007

114

56.8

21.8

.12

.88

16.8

100.0

11.9

1720

.214

7.55*

226

251

WHATFA

MOUSKNOTDID

ALEXANDERTHE

GREATUNDO?(G

ORDIA

N)

.007

114

84.5

12.6

.17

.82

8.0

100.0

4.5

2624

.015

1.15

227

131

WHATWASTHENAMEOFTHEUNSUCCESSFUL

AUTO

THATWASMANUFA

CTURED

BY

THE

FORD

MOTORCOMPA

NY

FROM

1957

–19

59?(EDSEL)b

.007

114

95.2

17.9

.15

.85

20.3

100.0

16.7

2226

.715

2.67*

228

293

WHATIS

THELASTNAMEOFTHESONG

WRITER

WHO

WROTETHESONG

“ILOVEPA

RIS”?

(PORTER)

.007

114

935

.910

.9.10

.89

10.9

50.0

8.3

1520

.015

3.68*

229

297

WHATIS

THELASTNAMEOFTHEFIRSTAMERICAN

AUTHORTO

WIN

THENOBELPRIZEFOR

LITERATURE?(LEWIS)

.007

115

026

.315

.4.24

.75

19.6

20.0

19.6

3626

.515

1.85*

230

219

WHATIS

THELASTNAMEOFTHEIN

VENTOROF

THEWIRELESSRADIO

?(M

ARCONI)

.007

115

25.8

14.1

.24

.75

25.3

40.0

24.9

3726

.015

4.22

231

267

WHATIS

THELASTNAMEOFTHEARTISTWHO

PAIN

TED

“AMERICAN

GOTHIC”?

(WOOD)

.007

115

218

.814

.0.19

.80

18.5

100.0

15.7

2924

.615

3.45*

232

195

INWHATPROFESSIO

NWASEMMETTKELLY

?(CLOWN)b

.006

115

33.9

9.8

.31

.68

15.6

100.0

13.8

4822

.815

7.15

233

249

WHATIS

THENAMEOFTHERIV

ERTHATRUNS

THROUGH

ROME?(TIBER)

.006

115

43.5

18.1

.23

.76

22.8

100.0

20.6

3632

.015

7.51*

234

285

WHATIS

THELASTNAMEOFTHEPOETWHO

ORIG

INALLY

WROTE“D

ON

JUAN”?

(BYRON)

.006

116

215

.313

.6.17

.83

17.0

75.0

14.9

2721

.716

6.44*

235

210

WHATIS

THELASTNAMEOFTHEFRENCH

AUTHORWHO

WROTE“T

HESTRANGER”?

(CAMUS)

.005

118

87.4

10.8

.12

.88

8.8

100.0

4.6

2217

.819

8.87*

236

250

WHO

WASTHEFIRSTRULEROFTHEHOLY

ROMAN

EMPIRE?(CHARLEMAGNE)

.005

119

715

.012

.8.47

.53

30.9

50.0

30.7

9328

.920

5.59*

237

276

WHATIS

THELASTNAMEOFTHEMAN

WHO

ISREGARDED

ASTHENATIO

NALPOETOF

SCOTLAND?(BURNS)

.005

119

86.0

12.8

.15

.84

9.6

70.0

7.6

3014

.320

2.23

238

202

WHATIS

THELASTNAMEOFTHEFOOTBALL

PLAYERKNOWN

AS“T

HEGALLOPIN

GGHOST”?

(GRANGE)

.005

119

96.6

12.7

.20

.80

6.4

100.0

4.1

4027

.920

5-.08

239

118

WHATIS

THENAMEOFROY

ROGERS’HORSE?

(TRIG

GER)b

.005

120

23.9

9.4

.24

.76

17.4

100.0

15.7

4819

.020

8.30*

240

288

WHATWASTHENAMEOFTHENUCLEARSUBMARIN

ETHATSUNK

INTHEATLANTIC

IN19

63?(THRESHER)

.005

120

442

.616

.7.15

.84

11.8

90.0

9.3

3122

.1211

.46*

241

248

WHATIS

THENAMEOFTHEMAN

WHO

REMOVED

THE

THORN

FROM

THELIO

N’S

PAW

INTHE

STORY

FROM

AESOP’S

FABLES?(A

NDROCLES)

.005

120

523

.812

.3.19

.80

14.3

20.0

14.2

4022

.721

0.72*

242

232

WHATIS

THENAMEOFTHEBRIG

HTESTSTA

RIN

THESKY

EXCLUDIN

GTHESUN?(SIRIU

S)

.005

120

79.8

12.7

.71

.29

46.4

50.0

46.4

147

44.7

216

.69*

243

290

.005

120

721

.913

.3.13

.86

10.7

80.0

8.2

2825

.9211

.39*

Behav Res (2013) 45:1115–1143 1131

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

WHATIS

THENAMEOFTHELAND

OFTHEGIA

NTS

IN“G

ULLIV

ER’S

TRAVELS”?

(BROBDIN

GNAG)

244

220

WHATWASTHELASTNAMEOFTHEFEMALESTA

ROF

THEMOVIE

“CASABLANCA”?

(BERGMAN)

.005

120

97.4

10.9

.19

.80

13.3

99.0

11.1

4024

.321

2.44*

245

238

WHATIS

THELASTNAMEOFTHEACTORKNOWN

AS

“THEMAN

OFATHOUSAND

FACES”?

(CHANEY)

.005

121

08.3

15.9

.27

.73

18.0

95.0

16.6

5626

.321

8.71*

246

194

WHATIS

THENAMEOFTHEBASEBALL

PLAYERWITH

THEHIG

HESTLIFETIM

EBATTIN

GAVERAGEIN

THEMAJO

RLEAGUES?(COBB)b

.005

121

27.8

14.1

.68

.32

35.7

100.0

35.2

144

43.3

218

.52*

247

116

WHATWASTHELASTNAMEOFTHE

ACTORIN

THEROLEOFPERRY

MASON

ON

TELEVISIO

N?(BURR)b

.005

121

312

.010

.2.12

.87

13.6

100.0

10.2

2620

.621

9.49*

248

212

WHATIS

THELASTNAMEOFTHEMOST

POPULARPIN

-UPGIRLOFWORLD

WARII?

(GRABLE)

.004

122

515

.514

.0.42

.58

39.9

100.0

39.2

9430

.523

3.72*

249

50WHATIS

THENAMEOFTHELARGESTDESERT

ON

EARTH?(A

NTA

RTICA)b

.000

203

8.7

.78

.22

59.4

59.4

159

54.5

208

.77*

250

123

WHATIS

THELASTNAMEOFTHEJO

CKEY

WITH

THEMOSTLIFETIM

EWIN

NERSIN

HORSERACIN

G?(BAZE)b

.000

148

13.0

.15

.85

5.5

5.5

2220

.914

8.25

251

130

WHATIS

THELASTNAMEOFTHEMAN

WHO

WASTHEVOICEOFMR.MAGOO?(BACKUS)b

.000

220

11.2

.17

.83

15.4

15.4

3722

.622

6.46*

252

138

WHATIS

THELASTNAMEOFTHEACTORWHO

PORTRAYED

SERGEANTFRID

AY

ON

“DRAGNET”?

(WEBB)b

.000

211

10.4

.13

.87

2.3

2.3

2817

.421

4.44*

253

141

WHATWASTHELASTNAMEOFTHEACTORWHO

PORTRAYED

THEFA

THERON

THETELEVISIO

NSHOW

“FATHERKNOWSBEST”?

(YOUNG)b

.000

150

13.8

.09

.91

19.7

19.7

1427

.715

3.59*

254

151

WHATWASTHELASTNAMEOFTHEVENTRILOQUIST

WHO

PROVID

ED

THEVOICEFORCHARLIE

MCCARTHY?(BERGEN)b

.000

148

12.6

.14

.86

7.5

7.5

2116

.614

8.70*

255

163

WHATWASTHELASTNAMEOFTHECAPTA

INOFTHEBRITISH

SHIP

“BOUNTY”WHEN

THE

MUTIN

YOCCURRED?(BLIG

H)b

.000

134

18.3

.13

.87

7.9

7.9

1717

.513

7.20

256

172

WHATIS

THELASTNAMEOFTHEIN

VENTOR

OFTHESTEAMBOAT“C

LERMONT”?

(FULT

ON)b

.000

219

9.7

.23

.77

10.5

10.5

5019

.122

3.49*

257

173

WHATIS

THENAMEOFGERMANY’S

LARGEST

BATTLESHIP

THATWASSUNK

INWORLD

WARII?

(BISMARCK)b

.000

148

14.5

.15

.85

23.3

23.3

2228

.814

8.59*

258

179

WHATIS

THELASTNAMEOFTHEJU

DGEWHO

WAS

KNOWN

AS“T

HELAW

WESTOFTHEPECOS”?

(BEAN)b

.000

156

9.1

.08

.92

2.1

2.1

1318

.415

7.77*

1132 Behav Res (2013) 45:1115–1143

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

259

180

WHATIS

JOHN

KENNETH

GALBRAITH’S

PROFESSIO

N?

(ECONOMIST)b

.000

219

10.6

.26

.74

8.4

8.4

5818

.722

4.35*

260

186

WHATWASTHENAMEOFTHEUNIO

NIRONCLAD

SHIP

THATFOUGHTTHECONFEDERATEIRONCLAD

MERRIM

ACK?(M

ONITOR)b

.000

207

17.6

.14

.86

3.2

3.2

2816

.621

2.38*

261

197

WHATIS

THELASTNAMEOFTHEDOCTORWHO

PERFORMED

THEFIRSTSUCCESSFULHUMAN

HEARTTRANSPLANT?(BARNARD)b

.000

151

11.0

.13

.87

11.0

11.0

1919

.415

4.79*

262

208

WHATIS

THELASTNAMEOFTHEMAN

WHO

SAID

“IONLY

REGRETTHATIHAVEBUTONELIFETO

LOSEFORMY

COUNTRY”?

(HALE)

.000

206

18.3

.27

.73

17.9

17.9

5628

.321

2.49*

263

215

WHATIS

THELASTNAMEOFTHEPILOTOFTHEU-2

SPY

PLANESHOTDOWN

OVERRUSSIA

IN19

60?(POWERS)

.000

144

12.7

.13

.88

10.6

10.6

1824

.614

7.54*

264

217

WHATIS

THELASTNAMEOFTHEACTORWHO

PORTRAYED

THESHERIFFIN

THEMOVIE

“HIG

HNOON”?

(COOPER)

.000

145

10.9

.19

.81

16.7

16.7

2722

.514

6.51*

265

222

WHATIS

THENAMEOFTHEMOUNTA

INRANGETHAT

SEPA

RATESASIA

FROM

EUROPE?(U

RAL)

.000

212

14.0

.50

.50

33.8

33.8

107

35.1

217

.65*

266

227

WHATIS

THELASTNAMEOFTHEBOXERWHO

WASKNOWN

ASTHE“M

ANASSA

MAULER”?

(DEMPSEY)

.000

140

10.5

.24

.76

14.6

14.6

3325

.014

4.62*

267

229

WHATIS

THELASTNAMEOFTHEMAN

WHO

CREATED

THECOMIC

STRIP

“LI’LABNER”?

(CAPP)

.000

146

13.5

.14

.86

3.9

3.9

2019

.615

0.21

268

234

WHATIS

THELASTNAMEOFTHEBASEBALL

PLAYERWHO

PITCHED

APERFECTGAMEIN

THE

1956

WORLD

SERIES?(LARSEN)

.000

217

10.3

.36

.64

22.0

22.0

7934

.022

3.56*

269

239

WHATIS

THELASTNAMEOFTHEFIRSTMAN

TO

RUN

THEMILEIN

UNDERFOURMIN

UTES?(BANNISTER)

.000

158

13.5

.25

.75

23.2

23.2

4022

.616

1.59*

270

240

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTE“B

ROTHERSKARAMAZOV”?

(DOSTOYEVSKI)

.000

200

10.9

.14

.87

7.5

7.5

2715

.020

8.78*

271

244

WHATIS

THENAMEOFTHEAUTHORWHO

RECEIV

ED

APULITZERPRIZEFORHIS

WRITIN

GS

ABOUTABRAHAM

LIN

COLN?(SANDBURG)

.000

205

10.9

.10

.90

6.3

6.3

2019

.421

0.41

272

246

WHATIS

THELASTNAMEOFTHEMAN

WHO

CREATED

THECOMIC

STRIP

“WOODY

WOODPECKER”?

(LANTZ)

.000

219

9.9

.21

.79

16.1

16.1

4521

.722

5.69*

273

252

WHATIS

THENAMEOFTHEIN

STRUMENTUSED

TO

MEASUREWIN

DSPEED?(A

NEMOMETER)

.000

207

13.7

.41

.59

27.8

27.8

8531

.621

3.57*

274

253

WHATIS

THELASTNAMEOFTHEAUTHOROF

“OURTOWN”?

(WILDER)

.000

142

11.1

.14

.86

11.0

11.0

2023

.214

7.62*

275

256

WHATIS

THELASTNAMEOFTHESIN

GERWHO

MADEA

HIT

RECORDIN

GOFTHESONG

“WHO’S

SORRY

NOW”?

(FRANCIS)

.000

207

12.6

.15

.85

5.3

5.3

3222

.821

4.33

Behav Res (2013) 45:1115–1143 1133

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

276

257

WHATIS

THELASTNAMEOFTHECUBAN

LEADERTHATCASTRO

OVERTHREW?(BATISTA

).000

141

17.5

.12

.88

20.4

20.4

1632

.214

4.33

277

260

WHATIS

THENAMEOFTHERUBBERROLLERON

ATYPEWRITER?(PLATEN)

.000

200

13.4

.23

.77

7.8

7.8

4619

.520

5.41*

278

263

WHATWASTHENAMEOFTHELARGEST

CONFEDERATEMILITARY

PRISON

DURIN

GTHECIV

ILWAR?(A

NDERSONVILLE)

.000

139

18.3

.14

.86

24.8

24.8

1929

.613

8.50*

279

266

WHATIS

THELASTNAMEOFTHEAUTHOROF

“THEAGONYAND

THEECSTA

SY”?

(STONE)

.000

204

10.5

.10

.90

6.8

6.8

2117

.421

3.44

280

268

WHATIS

THELASTNAMEOFFLASH’S

GIRLFRIEND

INTHECOMIC

STRIP

“FLASH

GORDON”?

(ARDEN)

.000

214

11.0

.20

.80

5.6

5.6

4219

.921

7.04

281

269

WHATIS

THENAMEOFTHEFIRSTMOVIE

TO

RECEIV

ETHEACADEMYAWARD

FORBESTPICTURE?(W

INGS)

.000

127

17.8

.24

.76

23.8

23.8

3019

.613

0.59*

282

270

WHATIS

THELASTNAMEOFTHEDISCOVEREROF

THEVACCIN

ATIO

NFORSMALLPOX?(JENNER)

.000

204

12.8

.19

.81

12.0

12.0

3923

.020

8.84*

283

271

WHATIS

THELASTNAMEOFTHEBOY

INTHEBOOK

“TREASUREISLAND”?

(HAWKIN

S)

.000

144

10.4

.20

.80

20.0

20.0

2932

.014

6.48*

284

272

WHATIS

THELASTNAMEOFTHEBOXERWHO

WON

THEBOXIN

GTITLEFROM

JOHN

L.

SULLIVAN?(CORBETT)

.000

211

10.6

.42

.58

24.7

24.7

8828

.021

5.43*

285

275

WHATIS

THELASTNAMEOFTHEMAN

WHO

WROTE

THESONG

“HOW

DEEPIS

THEOCEAN”?

(BERLIN

).000

145

8.6

.12

.88

2.9

2.9

1720

.914

8.27

286

277

WHATWASTHELASTNAMEOFBILLY

THEKID

?(BONNEY)

.000

138

11.5

.25

.75

17.1

17.1

3525

.414

2.23

287

278

WHATIS

THELASTNAMEOFTHESIN

GERWHOSE

THEMESONG

WAS“W

HEN

THEBLUEOFTHENIG

HT

MEETSTHEGOLD

OFTHEDAY”?

(CROSBY)

.000

214

11.7

.13

.87

8.3

8.3

2817

.921

9.27

288

279

FROM

WHATMUSICALIS

THESONG

“BAUBLESBANGLESAND

BEADS”?

(KISMET)

.000

147

12.0

.16

.84

15.3

15.3

2421

.314

8.55*

289

280

WHATWASTHELASTNAMEOFTHE

ACTORWHO

PORTRAYED

DR.WATSON

INTHESHERLOCK

HOLMESSERIES?(BRUCE)

.000

204

14.2

.25

.75

36.6

36.6

5032

.1211

.76*

290

281

WHATIS

THELASTNAMEOFTHEMAN

WHO

WASMOSTRESPONSIBLEFORPHOTOGRAPHIN

GTHEU.S.CIV

ILWAR?(BRADY)

.000

142

14.9

.13

.87

12.4

12.4

1819

.514

5.39

291

283

WHATIS

THENAMEOFA

NUMBERTWO

WOOD

INGOLF?(BRASSIE)

.000

149

15.0

.50

.50

26.8

26.8

7437

.015

1.38*

292

287

WHATIS

THELASTNAMEOFTHEPOETWHO

WROTE

THELIN

E“INTO

EACH

LIFEA

LITTLERAIN

MUST

FALL”?

(LONGFELLOW)

.000

130

13.0

.19

.81

11.0

11.0

2520

.613

1.49*

293

289

WHATWASTHENAMEOFGENEAUTRY’S

HORSE?(CHAMPIO

N)

.000

154

11.7

.19

.81

9.2

9.2

2914

.715

9.58*

1134 Behav Res (2013) 45:1115–1143

Tab

leA1

(con

tinued)

2012

Rank

Order

1980

Rank

Order

QuestionandCorrect

Respo

nse

Probability

ofRecall

Respo

nse

Latency

Propo

rtion

ofErrors

Con

fidenceJudg

ments

Peer

Judg

ments

Judg

eCorrs

MNrc

Nri

RLc

RLi

Ec

Eo

MCJ c

CJ i

Nci

MNpj

r

294

291

WHATIS

THENAMEOFTHETOWN

THROUGH

WHICH

LADY

GODIVA

SUPPOSEDLY

MADEHER

FAMOUSRID

E?(COVENTRY)

.000

138

16.5

.21

.79

11.7

11.7

2922

.014

0.62*

295

294

WHATIS

THELASTNAMEOFTHEFIRSTWOMAN

TO

SWIM

ACROSSTHEENGLISH

CHANNEL?(EDERLE)

.000

203

9.2

.15

.85

2.2

2.2

3019

.220

9.14

296

295

WHATIS

THELASTNAMEOFTHEFIRSTFLIER

TO

FLY

SOLO

AROUND

THEWORLD?(POST)

.000

145

19.5

.41

.59

37.9

37.9

6039

.014

5.62*

297

298

WHATIS

THELASTNAMEOFTHEMAN

WHO

WROTE

THEPOEM

“ITCOULDN’T

BEDONE”?

(GUEST)

.000

223

10.1

.19

.81

6.9

6.9

4315

.722

8.55*

298

299

WHO

WASTHERACEHORSEOFTHEYEARFORMANY

SUCCESSIV

EYEARSIN

THE19

60S?(K

ELSO)

.000

146

16.0

.49

.51

32.1

32.1

7229

.814

9.64*

299

300

WHATIS

THEHIG

HESTMOUNTA

ININ

SOUTH

AMERICA?(A

CONCAGUA)

.000

202

12.8

.33

.67

32.5

32.5

6629

.821

0.68*

Stand

arderrors

fortheprob

ability

ofrecallrang

edfrom

0to

.04.

Nrc=nu

mberof

respon

sesthat

werecorrect.Nri=nu

mberof

respon

sesthat

wereincorrect.The

totalnu

mberof

respon

sesper

questio

ncanbe

calculated

byadding

Nrcto

Nri.R

Lc=meanrespon

selatency(reactiontim

e,in

second

s)forcorrectrespo

nses.R

Li=meanrespon

selatency(reactiontim

e,in

second

s)forincorrect

respon

ses,specifically

commission

errors.The

totalnu

mberof

respon

sesthat

contribu

tedto

correctandincorrectrespon

selatenciescanbe

calculated

byadding

Nrcto

Nri.Ec=prop

ortio

nof

commission

errors.E

o=prop

ortio

nof

omission

errors.C

J c=meanconfidence

judg

mentfor

correctrespon

ses.The

totaln

umberof

respon

sesthatcontribu

tedto

themeanconfidence

judg

mentfor

correctrespon

sesis

prov

ided

incolumnNrc.CJ i=meanconfidence

judg

mentforincorrectrespon

ses(com

mission

errors).Nci=nu

mberof

respon

sesthat

contribu

tedto

themeanconfidence

judg

mentfor

incorrectrespo

nses,w

hich

reflectsthenu

mberof

confidence

judg

mentsforcommission

errors.T

hetotaln

umberof

respon

sesthatcontribu

tedto

themeanconfidence

judg

mentcan

becalculated

byadding

Nrcto

Nci.N

pj=nu

mberof

respon

sesthatcontribu

tedto

themeanpeer

judg

ment.Judg

eCorrr=Pearson

’srcorrelationbetweenconfidence

judg

mentsandpeer

judg

ments.

aSignificantly

high

erprob

ability

ofrecallin

2012

than

in19

80,p<.000

2.bSignificantly

lower

prob

ability

ofrecallin

2012

than

in19

80,p<.000

2.*Significant

correlation,

p<.05.

The

1980

norm

sinclud

edon

eadditio

nalqu

estio

n:“W

hatisthecapitalof

Czechoslovakia?”(Pragu

e).Thisqu

estio

nwas

notinclud

edbecauseitisou

tdated

andhasno

correctansw

er.

Behav Res (2013) 45:1115–1143 1135

Tab

leA2

Propo

rtions

ofandconfidence

incommission

errors,forerrors

with

aprop

ortio

nof

.05or

greaterof

thetotalrespon

ses

2012

RankOrder

QuestionandCorrect

Respo

nse

Com

mission

(s)

Propo

rtionOut

ofCom

mission

sPropo

rtionOut

ofTotal

Respo

nses

Con

fidence

8WHATIS

THENAMEOFA

DRIED

GRAPE?(RAISIN

)PRUNE

.69

.08

86.5

26WHATIS

THENAMEOFAN

INABILITY

TO

SLEEP?(INSOMNIA

)APNEA

.51

.09

48.7

28WHATIS

THENAMEOFTHELARGESTOCEAN

ON

EARTH?

(PACIFIC)

ATLANTIC

.78

.22

52.2

30WHATIS

THENAMEFORA

CYCLONETHATOCCURSOVER

LAND?(TORNADO)

HURRICANE

.48

.09

70.9

32WHATIS

THENAMEOFTHEBIRD

THATCANNOTFLY

AND

ISTHELARGESTBIRD

ON

EARTH?(O

STRICH)

PENGUIN

.33

.10

60.2

34WHATIS

THENAMEOFTHELIZARD

THATCHANGESITSCOLOR

TO

MATCH

THESURROUNDIN

GS?(CHAMELEON)

IGUANA

.40

.14

63.5

35WHATIS

THENAMEOFTHETHICK

LAYEROFFA

TON

AWHALE?

(BLUBBER)

FLUB/FLUBBER

.43

.07

42.2

37WHATIS

THENAMEOFAYOUNG

SHEEP?(LAMB)

CALF

.27

.06

24.8

38WHATIS

THELARGESTPLANETIN

THESOLARSYSTEM?(JUPITER)

SUN

.29

.11

77.5

42WHATIS

THENAMEOFA

DRIED

PLUM?(PRUNE)

RAISIN

.43

.12

41.5

43IN

WHICH

SPORTDOESA

RID

ERON

HORSEBACK

HIT

ABALL

WITH

HIS

MALLET?(POLO)

CROQUET

.40

.08

34.7

46WHATIS

THENAMEOFTHEPOKERHAND

INWHICH

ALLOFTHE

CARDSAREOFTHESAMESUIT?(FLUSH)

STRAIG

HT

.51

.13

40.9

47IN

WHICH

SPORTIS

THESTA

NLEY

CUPAWARDED?(H

OCKEY)

SOCCER

.30

.13

45.4

49OFWHICH

COUNTRY

ISBAGHDAD

THECAPITAL?(IRAQ)

AFGANISTA

N.74

.29

61.1

50WHATIS

THENAMEOFTHELIQ

UID

PORTIO

NOFWHOLEBLOOD?

(PLASMA)

WATER

.29

.05

29.7

51WHATIS

THENAMEOFTHECITY

INITALY

THATIS

KNOWN

FOR

ITSCANALS?(V

ENICE)

FLORENCE

.32

.08

48.6

52WHATIS

THENAMEOFTHESPEARLIK

EOBJECTTHATIS

THROWN

DURIN

GATRACK

MEET?(JAVELIN

)POLE/POLEVAULT

.17

.05

50.0

56WHATIS

THELASTNAMEOFTHEMAN

WHO

SHOWED

THAT

LIG

HTNIN

GIS

ELECTRIC?(FRANKLIN

)EDISON

.52

.18

63.2

58WHATIS

THENAMEOFDEERMEAT?(V

ENISON)

JERKEY

.20

.06

46.1

60WHATIS

THENAMEOFTHEOCEAN

THATIS

LOCATED

BETWEEN

AFRICA

AND

AUSTRALIA

?(INDIA

N)

PACIFIC

.52

.24

40.0

61WHATIS

THELASTNAMEOFTHESIN

GERWHO

RECORDED

“HEARTBREAK

HOTEL”AND

“ALLSHOOK

UP”?

(PRESLEY)

ELV

IS.47

.10

85.9

64WHATBRAND

OFCIG

ARETTEWASFIRSTTO

HAVETHEFLIP-TOP

BOX?(M

ARLBORO)

CAMEL

.70

.22

31.0

65WHATKIN

DOFMETA

LIS

ASSOCIATED

WITH

A50

TH

WEDDIN

GANNIV

ERSARY?(G

OLD)

SILVER

.52

.19

36.2

66WHICH

TYPEOFSNAKEDO

ASIA

NSNAKE-CHARMERSUSE?(COBRA)

RATTLESNAKE

.59

.17

43.3

69WHATIS

THECAPITALOFNEW

YORK?(A

LBANY)

NEW

YORK/NEW

YORK

CITY

.57

.29

65.3

70KID

NEY

.36

.17

49.3

1136 Behav Res (2013) 45:1115–1143

Tab

leA2

(con

tinued)

2012

RankOrder

QuestionandCorrect

Respo

nse

Com

mission

(s)

Propo

rtionOut

ofCom

mission

sPropo

rtionOut

ofTotal

Respo

nses

Con

fidence

WHATIS

THENAMEOFTHEORGAN

THATPRODUCESIN

SULIN

?(PANCREAS)

72WHATIS

THENAMEOFTHEEXTIN

CTREPTILESKNOWN

AS

“TERRIBLELIZARDS”?

(DIN

OSAURS)

DRAGON

.26

.05

20.6

74WHICH

BREED

OFCATHASBLUEEYES?(SIA

MESE)

CALICO

.24

.06

36.9

75WHATIS

THELASTNAMEOFTHESECOND

U.S.PRESID

ENT?

(ADAMS)

JEFFERSON

.39

.16

44.0

78WHATIS

THELASTNAMEOFTHEMAN

WHO

PROPOSED

THE

THEORY

OFRELATIV

ITY?(EIN

STEIN

)NEWTON

.58

.12

46.5

80WHATIS

THELASTNAMEOFTHEFIRSTSIG

NEROFTHE

“DECLARATIO

NOFIN

DEPENDENCE”?

(HANCOCK)

JEFFERSON

.51

.23

44.6

82WHATIS

THEWORD

THATMEANSA

NAUTICALMILEPER

HOUR?(K

NOT)

MPH

.24

.06

47.8

83WHATIS

THENAMEFORTHEASTRONOMICALBODIESTHAT

ENTERTHEEARTH’S

ATMOSPHERE?(M

ETEORS)

METEORITES

.26

.11

52.8

84WHATIS

THELONGESTRIV

ERIN

SOUTH

AMERICA?(A

MAZON)

NILE

.61

.18

48.2

85WHATIS

THENAMEOFTHEAUTOMOBILEIN

STRUMENTTHAT

MEASURESMILEAGE?(O

DOMETER)

SPEEDOMETER

.48

.19

47.4

86WHATITALIA

NCITY

WASDESTROYED

WHEN

MOUNT

VESUVIU

SERUPTED

IN79

A.D.?(POMPEII)

ROME/ROMA

.27

.07

30.9

87WHATIS

THELASTNAMEOFBATMAN’S

SECRETID

ENTITY

INTHEBATMAN

COMICS?(W

AYNE)

CLARK/CLARK

KENT

.40

.07

46.7

88WHATIS

THELASTNAMEOFTHEMYTHICALGIA

NT

LUMBERJA

CK?(BUNYAN)

JACK

.34

.08

22.8

89WHATIS

THENAMEOFTHECOMPA

NY

THATPRODUCES

“BABY

RUTH”CANDY

BARS?(N

ESTLE)

HERSHEY

.50

.19

40.1

MARS

.31

.12

53.5

90WHATIS

THENAMEOFSOCRATES’MOSTFA

MOUS

STUDENT?(PLATO)

ARISTOTLE

.53

.18

57.5

91WHATIS

THENAMEOFTHETHREE-LEAFCLOVERTHATIS

THEEMBLEM

OFIRELAND?(SHAMROCK)

CLOVER

.59

.14

33.2

92OFWHICH

COUNTRY

ISBUENOSAIRESTHECAPITAL?

(ARGENTIN

A)

SPA

IN.26

.13

25.7

94WHATIS

THENAMEOFTHEMOUNTA

INRANGEIN

WHICH

MOUNTEVERESTIS

LOCATED?(H

IMALAYAS)

APPA

LACIA

N.34

.12

29.1

95WHATIS

THEUNIT

OFSOUND

INTENSITY?(D

ECIBEL)

HERTZ

.33

.17

39.4

97WHATIS

THEUNIT

OFELECTRICALPOWERTHATREFERS

TO

ACURRENTOFONEAMPEREATONEVOLT

?(W

ATT)

VOLT

/VOLT

AGE

.20

.06

33.9

99IN

WHICH

GAMEAREMEN

CROWNED?(CHECKERS)

CHESS

.17

.06

43.8

100

WHATIS

THELASTNAMEOFTHEMAN

WHO

ASSASSIN

ATED

PRESID

ENTJO

HN

F.KENNEDY?(O

SWALD)

BOOTH

.30

.08

58.8

101

WHATIS

THENAMEOFBATMAN’S

BUTLER?(A

LFRED)

ROBIN

.16

.05

15.1

Behav Res (2013) 45:1115–1143 1137

Tab

leA2

(con

tinued)

2012

RankOrder

QuestionandCorrect

Respo

nse

Com

mission

(s)

Propo

rtionOut

ofCom

mission

sPropo

rtionOut

ofTotal

Respo

nses

Con

fidence

102

WHICH

COUNTRY

WASTHEFIRSTTO

USEGUNPOWDER?(CHIN

A)

BRITAIN

/ENGLAND

.31

.17

31.3

103

WHATIS

THENAMEOFAN

AIRPLANEWITHOUTAN

ENGIN

E?(G

LID

ER)

JET

.20

.06

20.5

104

WHATIS

THENAMEOFTHENORTH

STA

R?(POLARIS)

NORTH/NORTH

STA

R.23

.05

9.5

105

WHATIS

THEONLY

WORD

THATTHERAVEN

SAYSIN

EDGAR

ALLEN

POE’S

POEM

“THERAVEN”?

(NEVERMORE)

DEAD/DEATH

.21

.08

19.2

106

FORWHICH

COUNTRY

ISTHEYEN

THEMONETA

RY

UNIT?(JAPA

N)

CHIN

A.87

.53

53.1

107

INWHATEUROPEAN

CITY

ISTHEPA

RTHENON

LOCATED?(ATHENS)

ROME

.51

.20

46.2

108

WHATIS

THENAMEOFTHEFURRYANIM

ALTHATATTA

CKS

COBRA

SNAKES?(M

ONGOOSE)

BEAR

.17

.06

23.8

109

FORWHICH

COUNTRY

ISTHERUPEETHEMONETA

RY

UNIT?

(INDIA

)FRANCE

.19

.05

18.6

110

WHATIS

THELASTNAMEOFTHEMAN

WHO

FIRSTSTUDIED

GENETIC

INHERITANCEIN

PLANTS?(M

ENDEL)

DARWIN

.42

.09

33.7

113

INWHICH

GAMEARETHESTA

NDARD

PIECESOFSTA

UNTON

DESIG

N?(CHESS)

MONOPOLY

.32

.05

13.1

114

WHATAREPEOPLEWHO

MAKEMAPSCALLED?(CARTOGRAPHERS)

GEOGRAPHER

.19

.08

32.2

117

INWHICH

CITY

ISTHEU.S.NAVALACADEMY

LOCATED?(A

NNAPOLIS)

WASHIN

GTON

.16

.06

19.6

118

WHATIS

THENAMEOFTHELIG

HTESTWOOD

KNOWN?(BALSA)

OAK

.27

.12

20.7

119

WHATIS

THELASTNAMEOFTHEBOXERWHO

LATERBECAME

KNOWN

ASMUHAMMAD

ALI?

(CLAY)

ALI

.53

.13

23.4

120

WHATISLAND

ISTHELARGESTIN

THEWORLD

EXCLUDIN

GAUSTRALIA

?(G

REENLAND)

HAWAII

.21

.13

22.8

121

WHATIS

THENAMEOFTHESMALLJA

PANESESTOVEUSED

FOROUTDOORCOOKIN

G?(H

IBACHI)

GRILL

.37

.12

31.5

125

INWHATANCIENTCITY

WERETHE“H

ANGIN

GGARDENS”

LOCATED?(BABYLON)

GREECE

.21

.08

31.8

126

WHATAREPEOPLECALLED

WHO

EXPLORECAVES?(SPELUNKERS)

EXPLORERS

.31

.14

14.3

128

WHATIS

THECAPITALOFKENTUCKY?(FRANKFORT)

LOUISVILLE

.32

.11

57.4

129

WHATIS

THENAMEOFAN

ILLEGALMOVEBYA

BASEBALL

PITCHERTHATRESULT

SIN

ALLRUNNERSADVANCIN

GONE

BASE?(BALK)

BALL

.21

.09

54.1

132

WHICH

SPORTUSESTHETERMS“STONES”AND

“BROOMS”?

(CURLIN

G)

BROOMBALL

.16

.08

39.9

133

WHATIS

THEPROPERNAMEFORA

BADMIN

TON

BIRD?

(SHUTTLECOCK)

BIRD/BIRDIE

.92

.45

44.8

134

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTE

“OLIV

ERTWIST”?

(DICKENS)

TWAIN

.27

.05

34.7

136

WHATIS

THELASTNAMEOFTHEMAN

WHO

INVENTED

THE

PHONOGRAPH?(EDISON)

BELL

.55

.13

53.3

138

INWHICH

CITY

ISHEATHROW

AIRPORTLOCATED?(LONDON)

HEATHROW

.32

.08

20.0

139

WHATIS

THECAPITALOFJA

MAICA?(K

INGSTON)

JAMAICA

.30

.05

16.8

1138 Behav Res (2013) 45:1115–1143

Tab

leA2

(con

tinued)

2012

RankOrder

QuestionandCorrect

Respo

nse

Com

mission

(s)

Propo

rtionOut

ofCom

mission

sPropo

rtionOut

ofTotal

Respo

nses

Con

fidence

140

WHICH

PLANETWASTHELASTTO

BEDISCOVERED?(N

EPTUNE)

PLUTO

.84

.65

57.7

143

WHATIS

THECAPITALOFCHILE?(SANTIA

GO)

CHILE

.41

.08

22.4

146

WHATIS

THENAMEOFTHEFOUNTA

ININ

ROMEIN

TO

WHICH

COIN

SARETHROWN

FORGOOD

LUCK?(TREVI)

YOUTH

.31

.10

25.8

147

WHATWASTHELASTNAMEOFTHEMAN

WHO

WASPRESID

ENT

DIRECTLY

AFTERJA

MESMADISON?(M

ONROE)

JEFFERSON

.20

.08

30.5

148

WHATIS

THELASTNAMEOFTHEASTRONOMERWHO

PUBLISHED

IN15

43HIS

THEORY

THATTHEEARTH

REVOLV

ESAROUND

THESUN?(COPERNICUS)

GALILEO

.51

.25

60.0

149

WHATIS

THELASTNAMEOFTHECRIM

INALWHO

WAS

KNOWN

AS“SCARFA

CE”?

(CAPONE)

MONTA

NA

.35

.13

86.0

151

WHATIS

THECAPITALOFDENMARK?(COPENHAGEN)

DENMARK

.26

.05

18.2

153

INWHICH

CITY

ISMICHELANGELO’S

STA

TUEOFDAVID

LOCATED?(FLORENCE)

ROME

.56

.36

41.5

154

WHATWASFRANK

LLOYD

WRIG

HT’S

PROFESSIO

N?(A

RCHITECT)

WRITER/W

RITIN

G.19

.09

17.2

155

OFWHICH

COUNTRY

ISNAIROBITHECAPITAL?(K

ENYA)

AFRICA

.18

.06

29.4

156

WHATIS

THENAMEOFTHEHILLBILLY

FAMILY

THATHAD

AFA

MOUSFEUD

WITH

THEMCCOY

FAMILY?(H

ATFIELD)

BEVERLY

/BEVERLY

HILLBILLY

.26

.06

31.2

158

WHATIS

THELASTNAMEOFTHEFIRSTPERSON

TO

COMPLETE

ASOLO

FLIG

HTACROSSTHEATLANTIC

OCEAN?(LIN

DBERGH)

AIRHEART/EARHART

.51

.19

47.1

160

WHATIS

THENAMEOFTHEROMAN

EMPERORWHO

FID

DLED

WHILEROMEBURNED?(N

ERO)

CAESAR

.49

.12

35.3

161

WHATIS

THECITY

INWHICH

THEBASEBALLHALLOFFA

MEIS

LOCATED?(COOPERSTOWN)

CHICAGO

.25

.10

22.6

162

WHATIS

THENAMEOFTHEUNIT

OFMEASURETHATREFERS

TO

ASIX

-FOOTDEPTH

OFWATER?(FATHOM)

LEAGUE

.20

.06

57.5

163

WHATIS

THELASTNAMEOFTHESCIENTISTWHO

DISCOVERED

RADIU

M?(CURIE)

RADIU

M.26

.05

3.1

166

WHATIS

THELASTNAMEOFTHECRIM

INALWHO

WASKILLED

BY

FBIAGENTSOUTSID

EOFA

CHICAGO

MOVIE

THEATER?

(DILLIN

GER)

CAPONE

.27

.05

44.5

167

WHATIS

THENAMEOFTHESIN

GERWHO

POPULARIZED

ADANCEKNOWN

ASTHE“T

WIST”?

(CHECKER)

ELV

IS.52

.16

33.3

168

OVERWHICH

RIV

ERIS

THEGEORGEWASHIN

GTON

BRID

GE?

(HUDSON)

MISSISSIPPI

.24

.09

30.2

169

WHATIS

THELASTNAMEOFTHEMAN

WHO

INVENTED

DYNAMITE?(N

OBEL)

DYNAMITE

.44

.11

16.0

170

WHATIS

THENAMEOFTHECHIN

ESERELIG

ION

FOUNDED

BY

LAO

TSE?(TAOISM)

BUDDHISM

.60

.25

35.2

172

WHATIS

THENAMEOFTHENAVIG

ATIO

NIN

STRUMENTUSED

ATSEATO

PLOTPOSITIO

NBY

THESTA

RS?(SEXTA

NT)

COMPA

SS

.42

.23

36.5

176

FORWHICH

COUNTRY

ISTHEDRACHMATHEMONETA

RY

UNIT?(G

REECE)

RUSSIA

.19

.06

31.3

Behav Res (2013) 45:1115–1143 1139

Tab

leA2

(con

tinued)

2012

RankOrder

QuestionandCorrect

Respo

nse

Com

mission

(s)

Propo

rtionOut

ofCom

mission

sPropo

rtionOut

ofTotal

Respo

nses

Con

fidence

178

WHATIS

THELONGESTRIV

ERIN

ASIA

?(YANGTZE)

NILE

.36

.14

39.3

181

OFWHICH

COUNTRY

ISBUDAPESTTHECAPITAL?(H

UNGARY)

INDIA

.48

.21

30.4

182

WHO

ISKNOWN

AS“T

HEFA

THEROFGEOMETRY”?

(EUCLID

)PYTHAGORAS

.30

.09

30.9

184

WHATIS

THELASTNAMEOFTHECOMPOSERWHO

WROTE

THEOPERA

“DON

GIO

VANNI”?(M

OZART)

GIO

VANNI

.25

.05

24.4

185

WHATIS

THELASTNAMEOFTHEAUTHOROFTHEJA

MES

BOND

NOVELS?(FLEMIN

G)

BOND

.37

.06

6.8

186

WHATWASTHELASTNAMEOFBUFFA

LO

BILL?(CODY)

BILL

.35

.09

36.7

187

WHATIS

THELASTNAMEOFTHEAUTHORWHO

WROTE

UNDERTHEPSEUDONYM

OFMARK

TWAIN

?(CLEMENS)

TWAIN

.53

.09

15.4

190

WHATIS

THELASTNAMEOFTHEMAN

WHO

BEGAN

THE

REFORMATIO

NIN

GERMANY?(LUTHER)

HITLER

.83

.44

58.9

192

WHATWASTHENAMEOFTHEAPOLLO

LUNARMODULE

THATLANDED

THEFIRSTMAN

ON

THEMOON?(EAGLE)

APOLLO

.22

.08

17.3

193

WHATIS

THELASTNAMEOFTHECOSMONAUTWHO

WAS

THEFIRSTPERSON

TO

ORBIT

AROUND

THEEARTH?(G

AGARIN

)ARMSTRONG

.27

.08

34.2

201

INWHICH

COUNTRY

ISANGELFA

LLSLOCATED?(V

ENEZUELA)

CANADA

.16

.06

20.9

202

WHATIS

THECAPITALOFCANADA?(O

TTA

WA)

TORONTO

.28

.20

49.8

203

WHATIS

THELASTNAMEOFTHETWENTY-FIRSTU.S.

PRESID

ENT?(A

RTHUR)

BUSH

.14

.07

21.7

204

WHATWASTHENAMEOFTHEGOLDFISH

INTHESTORY

OF

PIN

OCCHIO

?(CLEO)

GOLDIE

.23

.06

12.6

207

WHATIS

THECAPITALOFAUSTRALIA

?(CANBERRA)

SYDNEY

.79

.50

80.3

208

WHATIS

THELASTNAMEOFTHEARTISTWHO

PAIN

TED

“THEPERSISTENCEOFMEMORY”?

(DALI)

DAVIN

CI

.24

.05

11.4

209

WHATIS

THELASTNAMEOFTHEMAN

WHO

INVENTED

THE

TELEGRAPH?(M

ORSE)

BELL

.40

.16

59.6

211

WHATIS

THENAMEOFTHESUBSTA

NCEDERIV

ED

FROM

AWHALETHATIS

USED

TO

MAKEPERFUME?(A

MBERGRIS)

BLUBBER

.64

.29

36.4

213

WHATWASTHENAMEOFTHECLOWN

ON

THE“H

OWDY

DOODY”TELEVISIO

NSHOW?(CLARABELL)

BOZO

.42

.08

25.5

215

WHATIS

THELASTNAMEOFTHEMOVIE

ACTORWHO

PORTRAYED

SPA

RTA

CUS?(D

OUGLAS)

BUTLER

.23

.06

53.8

217

WHATIS

THELASTNAMEOFTHEUNIO

NGENERALWHO

DEFEATED

THECONFEDERATEARMYATTHECIV

ILWAR

BATTLEOFGETTYSBURG?(M

EADE)

GRANT

.29

.13

66.7

218

WHATIS

THENAMEOFTHEAVENUETHATIM

MEDIATELY

FOLLOWS

ATLANTIC

AVENUEIN

THEGAMEOFMONOPOLY

?(V

ENTNOR)

PACIFIC

.40

.15

26.2

233

WHATIS

THENAMEOFTHERIV

ERTHATRUNSTHROUGH

ROME?(TIBER)

NILE

.25

.06

21.6

236

WHO

WASTHEFIRSTRULEROFTHEHOLY

ROMAN

EMPIRE?

(CHARLEMAGNE)

CAESAR

.55

.26

38.5

1140 Behav Res (2013) 45:1115–1143

Tab

leA2

(con

tinued)

2012

RankOrder

QuestionandCorrect

Respo

nse

Com

mission

(s)

Propo

rtionOut

ofCom

mission

sPropo

rtionOut

ofTotal

Respo

nses

Con

fidence

242

WHATIS

THENAMEOFTHEBRIG

HTESTSTA

RIN

THESKY

EXCLUDIN

GTHESUN?(SIRIU

S)

NORTH/NORTH

STA

R.58

.41

47.1

246

WHATIS

THENAMEOFTHEBASEBALLPLAYERWITH

THEHIG

HEST

LIFETIM

EBATTIN

GAVERAGEIN

THEMAJO

RLEAGUES?(COBB)

BABE/BABERUTH/RUTH

.71

.48

40.0

248

WHATIS

THELASTNAMEOFTHEMOSTPOPULARPIN

-UP

GIRLOFWORLD

WARII?(G

RABLE)

MONROE

.40

.17

46.9

249

WHATIS

THENAMEOFTHELARGESTDESERTON

EARTH?

(ANTA

RTICA)

SAHARA

.82

.65

63.9

256

WHATIS

THELASTNAMEOFTHEIN

VENTOROFTHE

STEAMBOAT“C

LERMONT”?

(FULT

ON)

CLERMONT

.54

.12

15.1

259

WHATIS

JOHN

KENNETH

GALBRAITH’S

PROFESSIO

N?(ECONOMIST)

WRITER

.21

.05

14.5

262

WHATIS

THELASTNAMEOFTHEMAN

WHO

SAID

“IONLY

REGRETTHATIHAVEBUTONELIFETO

LOSEFORMY

COUNTRY”?

(HALE)

WASHIN

GTON

.34

.09

13.3

265

WHATIS

THENAMEOFTHEMOUNTA

INRANGETHAT

SEPA

RATESASIA

FROM

EUROPE?(U

RAL)

HIM

ALAYAS

.34

.17

56.4

266

WHATIS

THELASTNAMEOFTHEBOXERWHO

WASKNOWN

ASTHE“M

ANASSA

MAULER”?

(DEMPSEY)

ALI

.48

.11

23.1

268

WHATIS

THELASTNAMEOFTHEBASEBALLPLAYERWHO

PITCHED

APERFECTGAMEIN

THE19

56WORLD

SERIES?(LARSEN)

RUTH

.63

.23

28.9

272

WHATIS

THELASTNAMEOFTHEMAN

WHO

CREATED

THE

COMIC

STRIP

“WOODY

WOODPECKER”?

(LANTZ)

DISNEY

.27

.05

28.8

273

WHATIS

THENAMEOFTHEIN

STRUMENTUSED

TO

MEASURE

WIN

DSPEED?(A

NEMOMETER)

BAROMETER

.47

.19

43.3

281

WHATIS

THENAMEOFTHEFIRSTMOVIE

TO

RECEIV

ETHE

ACADEMYAWARD

FORBESTPICTURE?(W

INGS)

TITANIC

.43

.10

29.4

284

WHATIS

THELASTNAMEOFTHEBOXERWHO

WON

THE

BOXIN

GTITLEFROM

JOHN

L.SULLIVAN?(CORBETT)

ALI

.42

.18

31.2

289

WHATWASTHELASTNAMEOFTHEACTORWHO

PORTRAYED

DR.WATSON

INTHESHERLOCK

HOLMESSERIES?(BRUCE)

LAW

.36

.09

65.0

291

WHATIS

THENAMEOFA

NUMBERTWO

WOOD

INGOLF?(BRASSIE)

DRIV

ER

.22

.11

52.2

295

WHATIS

THELASTNAMEOFTHEFIRSTWOMAN

TO

SWIM

ACROSSTHEENGLISH

CHANNEL?(EDERLE)

SMITH

.33

.05

1.2

296

WHATIS

THELASTNAMEOFTHEFIRSTFLIERTO

FLY

SOLO

AROUND

THEWORLD?(POST)

AIRHEART/EARHART

.48

.20

52.4

298

WHO

WASTHERACEHORSEOFTHEYEARFORMANY

SUCCESSIV

EYEARSIN

THE19

60’S?(K

ELSO)

SEABISCUIT

.60

.29

40.8

299

WHATIS

THEHIG

HESTMOUNTA

ININ

SOUTH

AMERICA?

(ACONCAGUA)

ANDES

.24

.08

37.6

Com

mission

respon

sesandmeanconfidence

judg

mentsin

commission

respon

sesareprov

ided

forthosequ

estio

nswith

consistenciesin

errors

for.05or

greaterou

tof

thetotalrespon

ses.When

available,thetopthreecommission

errors

areprov

ided;otherw

ise,thetopon

eor

twocommission

errors

areprov

ided.

Behav Res (2013) 45:1115–1143 1141

References

Anastasi, J. S., Rhodes, M. G., & Burns, M. C. (2000). Distinguishingbetween memory illusions and actual memories utilizing phenom-enological measurements and explicit warnings. American Jour-nal of Psychology, 112, 1–26. doi:10.2307/1423458

Barber, S. J., Rajaram, S., & Marsh, E. J. (2008). Fact learning: Howinformation accuracy, delay and repeated testing change retentionand retrieval experience. Memory, 16, 934–946. doi:10.1080/09658210802360603

Butler, A. C., Fazio, L. F., & Marsh, E. J. (2011). The hypercorrectioneffect persists over a week, but high confidence errors return.Psychonomic Bulletin & Review, 18, 1238–1244. doi:10.3758/s13423-011-0173-y

Butterfield, B., & Metcalfe, J. (2001). Errors committed with high-confidence are hypercorrected. Journal of Experimental Psychol-ogy: Learning, Memory, and Cognition, 27, 1491–1494.doi:10.1037/0278-7393.27.6.1491

Cosentino, S., Metcalfe, J., Butterfield, B., & Stern, Y. (2007). Objec-tive metamemory testing captures awareness of deficit in Alz-heimer’s disease. Cortex, 43, 1004–1019. doi:10.1016/S0010-9452(08)70697-X

Dodson, C. S., Bawa, S., & Krueger, L. E. (2007). Aging, metame-mory, and high-confidence errors: A misrecollection account.Psychology and Aging, 22, 122–133. doi:10.1037/0882-7974.22.1.122

Fazio, L. K., & Marsh, E. J. (2008). Slowing presentation speedincreases illusions of knowledge. Psychonomic Bulletin & Re-view, 15, 180–185. doi:10.3758/PBR.15.1.180

Frenda, S. J., Nichols, R. M., & Loftus, E. F. (2011). Current issues andadvances in misinformation research. Current Directions in Psy-chological Science, 20, 20–23. doi:10.1177/0963721410396620

Gallo, D. A. (2010). False memories and fantastic beliefs: 15 years ofthe DRM illusion. Memory & Cognition, 38, 833–848.doi:10.3758/MC.38.7.833

Hanley, J. R. (2011). Why are names of people associated with somany phonological retrieval failures? Psychonomic Bulletin &Review, 18, 612–617. doi:10.3758/s13423-011-0082-0

Kelley, C. M., & Jacoby, L. L. (1996). Adult egocentrism: Subjectiveexperience versus analytic bases for judgment. Journal of Mem-ory and Language, 35, 157–175. doi:10.1006/jmla.1996.0009

Koriat, A., & Ackerman, R. (2010). Metacognition and mindreading:Judgments of learning for self and other during self-paced study.Consciousness and Cognition, 19, 251–264. doi:10.1016/j.concog.2009.12.010

Loftus, E. F. (1997). Memory for a past that never was. CurrentDirections in Psychological Science, 6, 60–65. doi:10.1111/1467-8721.ep11512654

Loftus, E. F., & Hoffman, H. G. (1989). Misinformation and memory:The creation of new memories. Journal of Experimental Psychol-ogy: General, 118, 100–104. doi:10.1037/0096-3445.118.1.100

MacDonald, S. W. S., Dixon, R. A., Cohen, A. L., & Hazlitt, J. E.(2004). Biological age and 12-year cognitive change in olderadults: Findings from the Victoria Longitudinal Study. Gerontol-ogy, 50, 64–81. doi:10.1159/000075557

Mansueti, L., de Frias, C. M., Bub, D., & Dixon, R. A. (2008). Exploringcognitive effects of self reported mild stroke in older adults: Selec-tive but robust effects on story memory. Aging Neuropsychologyand Cognition, 15, 545–573. doi:10.1080/13825580701858216

Table A3 Questions for which the correct response has changed from the 1980 norms

2012 Rank Order Question 1980 Correct Response 2012 Correct Response

Questions for which the 1980 response was incorrect

16 WHAT IS THE NAME OF A GIANT OCEAN WAVE CAUSED BYAN EARTHQUAKE?

TIDALa TSUNAMI

89 WHAT IS THE NAME OF THE COMPANY THAT PRODUCES“BABY RUTH” CANDY BARS?

CURTISSb NESTLE

140 WHICH PLANET WAS THE LAST TO BE DISCOVERED? PLUTOb NEPTUNE

229 WHAT IS THE LAST NAME OF THE FIRST AMERICAN AUTHORTO WIN THE NOBEL PRIZE FOR LITERATURE?

HENRYa LEWIS

249 WHAT IS THE NAME OF THE LARGEST DESERT ON EARTH? SAHARAa ANTARTICA

250 WHAT IS THE LAST NAME OF THE JOCKEY WITH THE MOSTLIFETIME WINNERS IN HORSE RACING?

SHOEMAKERb BAZE

– WHAT IS THE CAPITAL OF CZECHOSLOVAKIA? PRAGUEc

Questions for which the 1980 response is still correct, but participants provided alternative responses that are also correct

30 WHAT IS THE NAME FOR A CYCLONE THAT OCCURS OVERLAND?d

TORNADO HURRICANE

66 WHICH TYPE OF SNAKE DO ASIAN SNAKE-CHARMERS USE? COBRA VIPER

74 WHICH BREED OF CAT HAS BLUE EYES? SIAMESE HIMALAYAN

83 WHAT IS THE NAME FOR THE ASTRONOMICAL BODIES THATENTER THE EARTH’S ATMOSPHERE?d

METEOR METEORITE

103 WHAT IS THE NAME OF AN AIRPLANE WITHOUT AN ENGINE? GLIDER PAPER, MODEL

108 WHAT IS THE NAME OF THE FURRYANIMAL THAT ATTACKSCOBRA SNAKES?

MONGOOSE HONEY BADGER

259 WHAT IS JOHN KENNETH GALBRAITH’S PROFESSION? ECONOMIST PROFESSOR

289 WHAT WAS THE LAST NAME OF THE ACTOR WHO PORTRAYEDDR. WATSON IN THE SHERLOCK HOLMES SERIES?

BRUCE LAW

a The 1980 response was incorrect. b The 1980 response was correct at the time, but is now incorrect. c Outdated question: Czechoslovakia is nolonger a country, so there is no correct response. d The wording of the question is somewhat ambiguous, so the alternative response could beconsidered correct.

1142 Behav Res (2013) 45:1115–1143

Marsh, E. J., Balota, D. A., & Roediger, H. L., III. (2005). Learningfacts from fiction: Effects of healthy aging and early-stage de-mentia of the Alzheimer type. Neuropsychology, 19, 115–129.doi:10.1037/0894-4105.19.1.115

Marsh, E. J., Meade, M. L., & Roediger, H. L., III. (2003). Learningfacts from fiction. Journal of Memory and Language, 49, 519–536. doi:10.1016/S0749-596X(03)00092-5

Metcalfe, J., & Finn, B. (2011). People’s hypercorrection of high-confidence errors: Did they know it all along? Journal of Exper-imental Psychology: Learning, Memory, and Cognition, 37, 437–448. doi:10.1037/a0021962

Metcalfe, J., & Finn, B. (2012). Hypercorrection of high confidenceerrors in children. Learning and Instruction, 22, 253–261.doi:10.1016/j.learninstruc.2011.10.004

Murayama, K., & Kuhbandner, C. (2011). Money enhances memoryconsolidation—but only for boring material. Cognition, 1, 120–124. doi:10.1016/j.cognition.2011.01.001

Nelson, T. O., Leonesio, R. J., Shimamura, A. P., Landwehr, R. F., &Narens, L. (1982). Overlearning and the feeling of knowing.Journal of Experimental Psychology: Learning, Memory, andCognition, 8, 279–288. doi:10.1037/0278-7393.8.4.279

Nelson, T. O., & Narens, L. (1980). Norms of 300 general-informationquestions: Accuracy of recall, latency of recall, and felling-of-knowing ratings. Journal of Verbal Learning and Verbal Behav-ior, 19, 338–368. doi:10.1016/S0022-5371(80)90266-2

Nickerson, R. (1999). How we know and sometimes misjudge whatothers know: Imputing one’s own knowledge to others. Psycholog-ical Bulletin, 125, 737–759. doi:10.1037/0033-2909.125.6.737

Roediger, H. L., III, & McDermott, K. B. (1995). Creating falsememories: Remembering words not presented in lists. Journalof Experimental Psychology: Learning, Memory, and Cognition,21, 803–814. doi:10.1037/0278-7393.21.4.803

Schwartz, B. L. (2001). The relation of tip-of-the-tongue states andretrieval time. Memory & Cognition, 29, 117–126. doi:10.3758/BF03195746

Singer, M., & Tiede, H. L. (2008). Feeling of knowing and duration ofunsuccessful memory search.Memory & Cognition, 36, 588–597.doi:10.3758/MC.36.3.588

Weinstein, Y., & Roediger, H. L., III. (2010). Retrospective bias in testperformance: Providing easy items at the beginning of a testmakes students believe they did better on it. Memory & Cogni-tion, 38, 366–376. doi:10.3758/MC.38.3.366

Winne, P. H., & Muis, K. R. (2011). Statistical estimates of learners’judgments about knowledge in calibration of achievement. Meta-cognition and Learning, 6, 179–193. doi:10.1007/s11409-011-9074-8

Woltz, D. J., Gardner, M. K., & Gyll, S. P. (2000). The role of attentionprocesses in near transfer of cognitive skills. Learning and Indi-

Behav Res (2013) 45:1115–1143 1143

vidual Differences, 12, 209–251. doi:10.1016/S1041-6080(01)00038-3