appendix b - boston college · hhhhhhhhhhhhh iiiimacedonia, rep. of hhhhhhhhhhhhh iiiiiran, islamic...
TRANSCRIPT
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 395
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS
Appendix BMultiple Comparisons of Average Achievement in Science Content Areas
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE396
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS
TIMSS2003
Grade88SCIENCE
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei h h h h h h h h h h h h h h h h h h h h h h h h h h h
Korea, Rep. of I h h h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I I I h h h h h h h h h h h h h h h h h h h h h h h
Japan I I I h h h h h h h h h h h h h h h h h h h h h h h
Estonia I I I h h h h h h h h h h h h h h h h h h h h h h h
England I I I h h h h h h h h h h h h h h h h h h h
United States I I I I I I h h h h h h h h h h h h h h h h h h h
Hungary I I I I I I h h h h h h h h h h h h h h h h h h h
Netherlands I I I I I I h h h h h h h h h h h h h h h h h h h
Australia I I I I I I h h h h h h h h h h h h h h h h
Sweden I I I I I I I I I I h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I I I I I I I h h h h h h h h h h h h h h h
New Zealand I I I I I I I I I I h h h h h h h h h h h
Slovenia I I I I I I I I I I I I h h h h h h h h h h h h
Lithuania I I I I I I I I I I I I I h h h h h h h h h h
Russian Federation I I I I I I I I I I I I I h h h h h h h h h h
Slovak Republic I I I I I I I I I I I I I h h h h h h h h h h
Scotland I I I I I I I I I I I I I I h h h h h h h h h
Latvia I I I I I I I I I I I I I I I h h h h h h h h h
Malaysia I I I I I I I I I I I I I I I I I I h h h h h h h h
Italy I I I I I I I I I I I I I I I I I I I I h h h h h h
Norway I I I I I I I I I I I I I I I I I I I I I h h h h h h
Israel I I I I I I I I I I I I I I I I I I I I I h h h h h h
Jordan I I I I I I I I I I I I I I I I I I I I I I I I h
Bulgaria I I I I I I I I I I I I I I I I I I I I I I I I h
Romania I I I I I I I I I I I I I I I I I I I I I I I I h
Serbia I I I I I I I I I I I I I I I I I I I I I I I I h
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I h
Armenia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Cyprus I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Lebanon I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I I I I I I I I h h h h h h
Indiana State, US I I I I h h h h h h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I I h h h h h h h h h h h h h h h h h h h
Quebec Province, Can. I I I I I I I I I I h h h h h h h h h h h h h h h
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Sin
gap
ore
Ch
ines
e Ta
ipei
Ko
rea,
Rep
. of
Ho
ng
Ko
ng
, SA
R
Jap
an
Esto
nia
Eng
lan
d
Un
ited
Sta
tes
Hu
ng
ary
Net
her
lan
ds
Au
stra
lia
Swed
en
Bel
giu
m (
Flem
ish
)
New
Zea
lan
d
Slo
ven
ia
Lith
uan
ia
Ru
ssia
n F
eder
atio
n
Slo
vak
Rep
ub
lic
Sco
tlan
d
Latv
ia
Mal
aysi
a
Ital
y
No
rway
Isra
el
Jord
an
Bu
lgar
ia
Ro
man
ia
Serb
ia
Mo
ldo
va, R
ep. o
f
Arm
enia
Exhibit B.1: Multiple Comparisons of Average Achievement in Life Science
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS TIMSS2003
GradeSCIENCE
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 397
Countries
h h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h h h Korea, Rep. of
h h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h h Japan
h h h h h h h h h h h h h h h h h h h Estonia
h h h h h h h h h h h h h h h h h h England
h h h h h h h h h h h h h h h h h h United States
h h h h h h h h h h h h h h h h h h Hungary
h h h h h h h h h h h h h h h h h h Netherlands
h h h h h h h h h h h h h h h h h Australia
h h h h h h h h h h h h h h h h h I I Sweden
h h h h h h h h h h h h h h h h h I I Belgium (Flemish)
h h h h h h h h h h h h h h h h h I I New Zealand
h h h h h h h h h h h h h h h h h I I Slovenia
h h h h h h h h h h h h h h h h h I I I Lithuania
h h h h h h h h h h h h h h h h h I I I Russian Federation
h h h h h h h h h h h h h h h h h I I I Slovak Republic
h h h h h h h h h h h h h h h h h I I I Scotland
h h h h h h h h h h h h h h h h h I I I Latvia
h h h h h h h h h h h h h h h h h I I I Malaysia
h h h h h h h h h h h h h h h h I I I Italy
h h h h h h h h h h h h h h h h I I I Norway
h h h h h h h h h h h h h h h h I I I Israel
h h h h h h h h h h h h h h h h I I I I Jordan
h h h h h h h h h h h h h h h h I I I I Bulgaria
h h h h h h h h h h h h h h h h I I I I Romania
h h h h h h h h h h h h h h h h I I I I Serbia
h h h h h h h h h h h h h h h h I I I I Moldova, Rep. of
h h h h h h h h h h h h h h I I I I Armenia
h h h h h h h h h h h h h I I I I Macedonia, Rep. of
h h h h h h h h h h h h h I I I I Iran, Islamic Rep. of
h h h h h h h h h h h h h I I I I Bahrain
I I I h h h h h h h h h h h I I I I Cyprus
I I I h h h h h h h h h I I I I Palestinian Nat'l Auth.
I I I I h h h h h h h h I I I I Chile
I I I I h h h h h h h I I I I Egypt
I I I I I h h h h h h h I I I I Indonesia
I I I I I I h h h h h h I I I I Tunisia
I I I I I I I I h h h h h h I I I I Saudi Arabia
I I I I I I I I I I h h h h I I I I Morocco
I I I I I I I I I I h h h h I I I I Philippines
I I I I I I I I I I I I h h I I I I Botswana
I I I I I I I I I I I I h h I I I I Lebanon
I I I I I I I I I I I I I I I I I I Ghana
I I I I I I I I I I I I I I I I I I South Africa
h h h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h h Indiana State, US
h h h h h h h h h h h h h h h h h h Ontario Province, Can.
h h h h h h h h h h h h h h h h h I I Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Mac
edo
nia
, Rep
. of
Iran
, Isl
amic
Rep
. of
Bah
rain
Cyp
rus
Pale
stin
ian
Nat
'l A
uth
.
Ch
ile
Egyp
t
Ind
on
esia
Tun
isia
Sau
di A
rab
ia
Mo
rocc
o
Phili
pp
ines
Bo
tsw
ana
Leb
ano
n
Gh
ana
Sou
th A
fric
a
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
88Multiple Comparisons of Average Achievement in Life ScienceExhibit B.1:
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE398
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS
TIMSS2003
Grade88SCIENCE
Countries
Chinese Taipei h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Hungary I I h h h h h h h h h h h h h h h h h h h h h h h h h h h
Japan I I I h h h h h h h h h h h h h h h h h h h h h h h h h
Estonia I I I h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I I I I I h h h h h h h h h h h h h h h h h h h h h h h h
Lithuania I I I I I I h h h h h h h h h h h h h h h h h h h
Slovenia I I I I I I h h h h h h h h h h h h h h h h h h
Korea, Rep. of I I I I I I h h h h h h h h h h h h h h h h h h
Russian Federation I I I I I I h h h h h h h h h h h h h h h h h
England I I I I I I h h h h h h h h h h h h h h h h h
Sweden I I I I I I I h h h h h h h h h h h h h h h h h
Slovak Republic I I I I I I I I I h h h h h h h h h h h h h
Netherlands I I I I I I I I I I I I h h h h h h h h h h h h
Latvia I I I I I I I I I I I I h h h h h h h h h h h h
Malaysia I I I I I I I I I I I I h h h h h h h h h h h
United States I I I I I I I I I I I I h h h h h h h h h h h
Australia I I I I I I I I I I I I I h h h h h h h h
Belgium (Flemish) I I I I I I I I I I I I I I I I I h h h h h h h h
New Zealand I I I I I I I I I I I I I I I h h h h h h h h
Israel I I I I I I I I I I I I I I I I I h h h h h h h h
Scotland I I I I I I I I I I I I I I I I I h h h h h h h h
Italy I I I I I I I I I I I I I I I I I I I I I I h h h
Norway I I I I I I I I I I I I I I I I I I I I I I h h
Bulgaria I I I I I I I I I I I I I I I I I I I I I I h
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I h
Jordan I I I I I I I I I I I I I I I I I I I I I I
Romania I I I I I I I I I I I I I I I I I I I I I I I
Serbia I I I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I
Armenia I I I I I I I I I I I I I I I I I I I I I I I I I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Cyprus I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Lebanon I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I I I I I I I I I I I
Indiana State, US I I I I I I I I I h h h h h h h h h h h h
Ontario Province, Can. I I I I I I I I I I I I I h h h h h h h h
Quebec Province, Can. I I I I I I I I I I I I h h h h h h h h h h h h h
Ch
ines
e Ta
ipei
Sin
gap
ore
Hu
ng
ary
Jap
an
Esto
nia
Ho
ng
Ko
ng
, SA
R
Lith
uan
ia
Slo
ven
ia
Ko
rea,
Rep
. of
Ru
ssia
n F
eder
atio
n
Eng
lan
d
Swed
en
Slo
vak
Rep
ub
lic
Net
her
lan
ds
Latv
ia
Mal
aysi
a
Un
ited
Sta
tes
Au
stra
lia
Bel
giu
m (
Flem
ish
)
New
Zea
lan
d
Isra
el
Sco
tlan
d
Ital
y
No
rway
Bu
lgar
ia
Mo
ldo
va, R
ep. o
f
Jord
an
Ro
man
ia
Serb
ia
Mac
edo
nia
, Rep
. of
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Exhibit B.2: Multiple Comparisons of Average Achievement in Chemistry
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS TIMSS2003
GradeSCIENCE
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 399
Countries
h h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h h Hungary
h h h h h h h h h h h h h h h h h h h h Japan
h h h h h h h h h h h h h h h h h h h h Estonia
h h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h h h Lithuania
h h h h h h h h h h h h h h h h h h h h Slovenia
h h h h h h h h h h h h h h h h h h h h Korea, Rep. of
h h h h h h h h h h h h h h h h h h h Russian Federation
h h h h h h h h h h h h h h h h h h h England
h h h h h h h h h h h h h h h h h h h Sweden
h h h h h h h h h h h h h h h h h h Slovak Republic
h h h h h h h h h h h h h h h h h Netherlands
h h h h h h h h h h h h h h h h h Latvia
h h h h h h h h h h h h h h h h h Malaysia
h h h h h h h h h h h h h h h h h United States
h h h h h h h h h h h h h h h h h I Australia
h h h h h h h h h h h h h h h h h I I Belgium (Flemish)
h h h h h h h h h h h h h h h h h I I New Zealand
h h h h h h h h h h h h h h h h h I I Israel
h h h h h h h h h h h h h h h h h I I Scotland
h h h h h h h h h h h h h h h h h I I I Italy
h h h h h h h h h h h h h h h h h I I I Norway
h h h h h h h h h h h h h h h h I I I Bulgaria
h h h h h h h h h h h h h h h h I I I Moldova, Rep. of
h h h h h h h h h h h h h h h h I I I Jordan
h h h h h h h h h h h h h h h I I I Romania
h h h h h h h h h h h h h h h I I I Serbia
h h h h h h h h h h h h h h h I I I Macedonia, Rep. of
h h h h h h h h h h h h h h h I I I Armenia
I h h h h h h h h h h I I I I Iran, Islamic Rep. of
I h h h h h h h h h I I I I Palestinian Nat'l Auth.
I h h h h h h h h h I I I I Cyprus
I h h h h h h h h h I I I I Egypt
I h h h h h h h h h I I I I Bahrain
I I h h h h h h h h h I I I I Lebanon
I I I I I I I h h h h h h h h I I I I Tunisia
I I I I I I I I h h h h h h I I I I Chile
I I I I I I I I h h h h h h I I I I Morocco
I I I I I I I I I I h h h h I I I I Indonesia
I I I I I I I I I I h h h h I I I I Saudi Arabia
I I I I I I I I I I I I h h I I I I Botswana
I I I I I I I I I I I I h h I I I I Philippines
I I I I I I I I I I I I I I I I I I South Africa
I I I I I I I I I I I I I I I I I I Ghana
h h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h Indiana State, US
h h h h h h h h h h h h h h h h h I Ontario Province, Can.
h h h h h h h h h h h h h h h h h h Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Arm
enia
Iran
, Isl
amic
Rep
. of
Pale
stin
ian
Nat
'l A
uth
.
Cyp
rus
Egyp
t
Bah
rain
Leb
ano
n
Tun
isia
Ch
ile
Mo
rocc
o
Ind
on
esia
Sau
di A
rab
ia
Bo
tsw
ana
Phili
pp
ines
Sou
th A
fric
a
Gh
ana
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
88Multiple Comparisons of Average Achievement in ChemistryExhibit B.2:
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE400
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS
TIMSS2003
Grade88SCIENCE Exhibit B.3:
Countries
Korea, Rep. of h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I I h h h h h h h h h h h h h h h h h h h h h h h h h h
Japan I I h h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I I I I h h h h h h h h h h h h h h h h h h h h h h h h h
England I I I I I h h h h h h h h h h h h h h h h h h h h h
Estonia I I I I I h h h h h h h h h h h h h h h h h h h h h h
Netherlands I I I I I h h h h h h h h h h h h h h h h h h h h h
Hungary I I I I I I h h h h h h h h h h h h h h h h h h h h h
Sweden I I I I I I I I I h h h h h h h h h h h h h h h
Australia I I I I I I I I I h h h h h h h h h h h
Lithuania I I I I I I I I I h h h h h h h h h h h
Malaysia I I I I I I I I I h h h h h h h h h h
Slovak Republic I I I I I I I I I h h h h h h h h h h
New Zealand I I I I I I I I I h h h h h h h h h
United States I I I I I I I I I I h h h h h h h h h
Scotland I I I I I I I I I I h h h h h h h h h
Belgium (Flemish) I I I I I I I I I I h h h h h h h h h
Latvia I I I I I I I I I I I I h h h h h h h h h
Russian Federation I I I I I I I I I I h h h h h h h h h
Slovenia I I I I I I I I I I I I I I h h h h h h h h h
Norway I I I I I I I I I I I I I I I I I I I I I h h h h h h
Bulgaria I I I I I I I I I I I I I I I I I I I I I h h h
Israel I I I I I I I I I I I I I I I I I I I I I h h h h
Armenia I I I I I I I I I I I I I I I I I I I I I I h h h
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I h
Romania I I I I I I I I I I I I I I I I I I I I I I I
Serbia I I I I I I I I I I I I I I I I I I I I I I I I I
Italy I I I I I I I I I I I I I I I I I I I I I I I I I
Jordan I I I I I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Cyprus I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Lebanon I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I I I I I I I I h h h h
Indiana State, US I I I I I I I I I h h h h h h h h h
Ontario Province, Can. I I I I I I I h h h h h h h h h h h h h h h h h h h
Quebec Province, Can. I I I I I I I I I h h h h h h h h h h h h h h h
Ko
rea,
Rep
. of
Sin
gap
ore
Ch
ines
e Ta
ipei
Jap
an
Ho
ng
Ko
ng
, SA
R
Eng
lan
d
Esto
nia
Net
her
lan
ds
Hu
ng
ary
Swed
en
Au
stra
lia
Lith
uan
ia
Mal
aysi
a
Slo
vak
Rep
ub
lic
New
Zea
lan
d
Un
ited
Sta
tes
Sco
tlan
d
Bel
giu
m (
Flem
ish
)
Latv
ia
Ru
ssia
n F
eder
atio
n
Slo
ven
ia
No
rway
Bu
lgar
ia
Isra
el
Arm
enia
Mo
ldo
va, R
ep. o
f
Ro
man
ia
Serb
ia
Ital
y
Jord
an
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Multiple Comparisons of Average Achievement in Physics
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS TIMSS2003
GradeSCIENCE
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 401
Countries
h h h h h h h h h h h h h h h h h h h h Korea, Rep. of
h h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h h h Japan
h h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h h h England
h h h h h h h h h h h h h h h h h h h h Estonia
h h h h h h h h h h h h h h h h h h h Netherlands
h h h h h h h h h h h h h h h h h h h Hungary
h h h h h h h h h h h h h h h h h Sweden
h h h h h h h h h h h h h h h h h Australia
h h h h h h h h h h h h h h h h h I Lithuania
h h h h h h h h h h h h h h h h h I Malaysia
h h h h h h h h h h h h h h h h h I Slovak Republic
h h h h h h h h h h h h h h h h h I New Zealand
h h h h h h h h h h h h h h h h h I I United States
h h h h h h h h h h h h h h h h h I I Scotland
h h h h h h h h h h h h h h h h h I I Belgium (Flemish)
h h h h h h h h h h h h h h h h h I I Latvia
h h h h h h h h h h h h h h h h h I I Russian Federation
h h h h h h h h h h h h h h h h h I I Slovenia
h h h h h h h h h h h h h h h h I I I Norway
h h h h h h h h h h h h h h h h I I I Bulgaria
h h h h h h h h h h h h h h h h I I I Israel
h h h h h h h h h h h h h h h h I I I Armenia
h h h h h h h h h h h h h h h h I I I Moldova, Rep. of
h h h h h h h h h h h h h h h h I I I I Romania
h h h h h h h h h h h h h h h h I I I I Serbia
h h h h h h h h h h h h h h h h I I I I Italy
h h h h h h h h h h h h h h h I I I I Jordan
h h h h h h h h h h h h h h h I I I I Macedonia, Rep. of
I h h h h h h h h h h h h h I I I I Cyprus
I h h h h h h h h h h h h I I I I Iran, Islamic Rep. of
I I h h h h h h h h h h h h I I I I Bahrain
I I I I h h h h h h h h h h I I I I Palestinian Nat'l Auth.
I I I I h h h h h h h h h h I I I I Indonesia
I I I I I I h h h h h h h I I I I Lebanon
I I I I I I h h h h h h h I I I I Egypt
I I I I I I h h h h h h h I I I I Morocco
I I I I I I I I I h h h h h I I I I Chile
I I I I I I I I I h h h h I I I I Saudi Arabia
I I I I I I I I I I h h h I I I I Tunisia
I I I I I I I I I I I h h I I I I Philippines
I I I I I I I I I I I I h h I I I I Botswana
I I I I I I I I I I I I I I I I I I South Africa
I I I I I I I I I I I I I I I I I I Ghana
h h h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h I Indiana State, US
h h h h h h h h h h h h h h h h h h Ontario Province, Can.
h h h h h h h h h h h h h h h h h Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Mac
edo
nia
, Rep
. of
Cyp
rus
Iran
, Isl
amic
Rep
. of
Bah
rain
Pale
stin
ian
Nat
'l A
uth
.
Ind
on
esia
Leb
ano
n
Egyp
t
Mo
rocc
o
Ch
ile
Sau
di A
rab
ia
Tun
isia
Phili
pp
ines
Bo
tsw
ana
Sou
th A
fric
a
Gh
ana
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
88Multiple Comparisons of Average Achievement in PhysicsExhibit B.3:
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE402
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS
TIMSS2003
Grade88SCIENCE Exhibit B.4:
Countries
Estonia h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I h h h h h h h h h h h h h h h h h h h h h h h h h
England I h h h h h h h h h h h h h h h h h h h h h h h
Korea, Rep. of I I I I h h h h h h h h h h h h h h h h h h h h h
Hungary I I I I h h h h h h h h h h h h h h h h h h
Netherlands I I I I I h h h h h h h h h h h h h h h h h
Sweden I I I I I I h h h h h h h h h h h h h h h h
United States I I I I I I h h h h h h h h h h h h h h h h h
Australia I I I I I h h h h h h h h h h h h h h h
Japan I I I I I I h h h h h h h h h h h h h h h h
New Zealand I I I I I I I h h h h h h h h h h h
Slovenia I I I I I I I I I I I h h h h h h h h h h h h h
Slovak Republic I I I I I I I I I h h h h h h h h h h h h
Russian Federation I I I I I I I I I I I I h h h h h h h h h
Norway I I I I I I I I I I I I I h h h h h h h h h
Scotland I I I I I I I I I I I I h h h h h h h h
Latvia I I I I I I I I I I I I I I h h h h h h h h
Italy I I I I I I I I I I I I I I I h h h h h h h h
Lithuania I I I I I I I I I I I I I I I h h h h h h h h
Belgium (Flemish) I I I I I I I I I I I I I I I I I h h h h h h h
Malaysia I I I I I I I I I I I I I I I I I I I I I h h h h h h
Bulgaria I I I I I I I I I I I I I I I I I I I I I I h h h h h
Israel I I I I I I I I I I I I I I I I I I I I I I I h h h h h
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I
Jordan I I I I I I I I I I I I I I I I I I I I I I I I I
Serbia I I I I I I I I I I I I I I I I I I I I I I I I I
Romania I I I I I I I I I I I I I I I I I I I I I I I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I
Armenia I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Cyprus I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Lebanon I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I I I I h h h h h h h
Indiana State, US I I I I h h h h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I h h h h h h h h h h h h h h h h h
Quebec Province, Can. h h h h h h h h h h h h h h h h h h h h h h h h h
Esto
nia
Sin
gap
ore
Ho
ng
Ko
ng
, SA
R
Ch
ines
e Ta
ipei
Eng
lan
d
Ko
rea,
Rep
. of
Hu
ng
ary
Net
her
lan
ds
Swed
en
Un
ited
Sta
tes
Au
stra
lia
Jap
an
New
Zea
lan
d
Slo
ven
ia
Slo
vak
Rep
ub
lic
Ru
ssia
n F
eder
atio
n
No
rway
Sco
tlan
d
Latv
ia
Ital
y
Lith
uan
ia
Bel
giu
m (
Flem
ish
)
Mal
aysi
a
Bu
lgar
ia
Isra
el
Mo
ldo
va, R
ep. o
f
Jord
an
Serb
ia
Ro
man
ia
Iran
, Isl
amic
Rep
. of
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Multiple Comparisons of Average Achievement in Earth Science
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS TIMSS2003
GradeSCIENCE
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 403
Countries
h h h h h h h h h h h h h h h h h h h Estonia
h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h England
h h h h h h h h h h h h h h h h h I Korea, Rep. of
h h h h h h h h h h h h h h h h h I Hungary
h h h h h h h h h h h h h h h h h I Netherlands
h h h h h h h h h h h h h h h h h I Sweden
h h h h h h h h h h h h h h h h h I United States
h h h h h h h h h h h h h h h h h I Australia
h h h h h h h h h h h h h h h h h I Japan
h h h h h h h h h h h h h h h h h I New Zealand
h h h h h h h h h h h h h h h h h I I I Slovenia
h h h h h h h h h h h h h h h h h I I I Slovak Republic
h h h h h h h h h h h h h h h h h I I I Russian Federation
h h h h h h h h h h h h h h h h h I I I Norway
h h h h h h h h h h h h h h h h I I I Scotland
h h h h h h h h h h h h h h h h I I I Latvia
h h h h h h h h h h h h h h h h I I I Italy
h h h h h h h h h h h h h h h h I I I Lithuania
h h h h h h h h h h h h h h h h I I I Belgium (Flemish)
h h h h h h h h h h h h h h h h I I I Malaysia
h h h h h h h h h h h h h h h h I I I I Bulgaria
h h h h h h h h h h h h h h h h I I I I Israel
h h h h h h h h h h h h h h h h I I I I Moldova, Rep. of
h h h h h h h h h h h h h h h h I I I I Jordan
h h h h h h h h h h h h h h h h I I I I Serbia
h h h h h h h h h h h h h h h I I I I Romania
h h h h h h h h h h h h h h h I I I I Iran, Islamic Rep. of
h h h h h h h h h h h h h h h I I I I Armenia
I h h h h h h h h h h h h h I I I I Cyprus
I I h h h h h h h h h h I I I I Bahrain
I h h h h h h h h h I I I I Macedonia, Rep. of
I I h h h h h h h h h I I I I Palestinian Nat'l Auth.
I I h h h h h h h h h I I I I Chile
I I I h h h h h h h h h I I I I Indonesia
I I I I I I I h h h h h h h I I I I Tunisia
I I I I I I I h h h h I I I I Egypt
I I I I I I I I h h h h I I I I Morocco
I I I I I I I I h h h h I I I I Lebanon
I I I I I I I I h h h h I I I I Saudi Arabia
I I I I I I I I I I I I h h h I I I I Philippines
I I I I I I I I I I I I I h h I I I I Botswana
I I I I I I I I I I I I I I I I I I Ghana
I I I I I I I I I I I I I I I I I I South Africa
h h h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h I Indiana State, US
h h h h h h h h h h h h h h h h h I Ontario Province, Can.
h h h h h h h h h h h h h h h h h h h Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Arm
enia
Cyp
rus
Bah
rain
Mac
edo
nia
, Rep
. of
Pale
stin
ian
Nat
'l A
uth
.
Ch
ile
Ind
on
esia
Tun
isia
Egyp
t
Mo
rocc
o
Leb
ano
n
Sau
di A
rab
ia
Phili
pp
ines
Bo
tsw
ana
Gh
ana
Sou
th A
fric
a
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
88Multiple Comparisons of Average Achievement in Earth ScienceExhibit B.4:
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE404
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS
TIMSS2003
Grade88SCIENCE Exhibit B.5:
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei h h h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I h h h h h h h h h h h h h h h h h h h h h h h h h h h
Korea, Rep. of I I I h h h h h h h h h h h h h h h h h h h h h h h
England I I I h h h h h h h h h h h h h h h h h h h h
Estonia I I I h h h h h h h h h h h h h h h h h h h h
Netherlands I I I h h h h h h h h h h h h h h h h h h h h
Japan I I I I h h h h h h h h h h h h h h h h h h h h
Australia I I I I h h h h h h h h h h h h h h h h h h h
United States I I I I h h h h h h h h h h h h h h h h h h
Hungary I I I I I I I I h h h h h h h h h h h h h h h h h
New Zealand I I I I I I I I I h h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I I I I I I I h h h h h h h h h h h h h h h h h
Slovenia I I I I I I I I I I I I I h h h h h h h h h h h h
Malaysia I I I I I I I I I I I I I h h h h h h h h h h h
Scotland I I I I I I I I I I I I I h h h h h h h h h h h
Slovak Republic I I I I I I I I I I I I I h h h h h h h h h h h
Latvia I I I I I I I I I I I I I h h h h h h h h h h h
Lithuania I I I I I I I I I I I I I I h h h h h h h h h h h
Sweden I I I I I I I I I I I I I I I I I I I h h h h h h h
Italy I I I I I I I I I I I I I I I I I I I h h h h h h
Norway I I I I I I I I I I I I I I I I I I I h h h h h h
Jordan I I I I I I I I I I I I I I I I I I I h h h h
Russian Federation I I I I I I I I I I I I I I I I I I I I h h h h
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I h h h h
Israel I I I I I I I I I I I I I I I I I I I I I I h h h h
Romania I I I I I I I I I I I I I I I I I I I I I I I I I I h h
Bulgaria I I I I I I I I I I I I I I I I I I I I I I I I I I
Serbia I I I I I I I I I I I I I I I I I I I I I I I I I I I
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Cyprus I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Armenia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Lebanon I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I I I I I I h h h h h
Indiana State, US I I I h h h h h h h h h h h h h h h h h h h h
Ontario Province, Can. I I I h h h h h h h h h h h h h h h h h h h h h
Quebec Province, Can. I I I I I h h h h h h h h h h h h h h h h h h
Sin
gap
ore
Ch
ines
e Ta
ipei
Ho
ng
Ko
ng
, SA
R
Ko
rea,
Rep
. of
Eng
lan
d
Esto
nia
Net
her
lan
ds
Jap
an
Au
stra
lia
Un
ited
Sta
tes
Hu
ng
ary
New
Zea
lan
d
Bel
giu
m (
Flem
ish
)
Slo
ven
ia
Mal
aysi
a
Sco
tlan
d
Slo
vak
Rep
ub
lic
Latv
ia
Lith
uan
ia
Swed
en
Ital
y
No
rway
Jord
an
Ru
ssia
n F
eder
atio
n
Iran
, Isl
amic
Rep
. of
Isra
el
Ro
man
ia
Bu
lgar
ia
Serb
ia
Mo
ldo
va, R
ep. o
f
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Multiple Comparisons of Average Achievement in Environmental Science
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS
TIMSS2003
GradeSCIENCE
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 405
Exhibit B.5:
Countries
h h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h Korea, Rep. of
h h h h h h h h h h h h h h h h h England
h h h h h h h h h h h h h h h h h h Estonia
h h h h h h h h h h h h h h h h h Netherlands
h h h h h h h h h h h h h h h h h Japan
h h h h h h h h h h h h h h h h h Australia
h h h h h h h h h h h h h h h h h I United States
h h h h h h h h h h h h h h h h h I I Hungary
h h h h h h h h h h h h h h h h h I I New Zealand
h h h h h h h h h h h h h h h h h I I I Belgium (Flemish)
h h h h h h h h h h h h h h h h h I I I Slovenia
h h h h h h h h h h h h h h h h h I I I Malaysia
h h h h h h h h h h h h h h h h h I I I Scotland
h h h h h h h h h h h h h h h h h I I I Slovak Republic
h h h h h h h h h h h h h h h h h I I I Latvia
h h h h h h h h h h h h h h h h h I I I Lithuania
h h h h h h h h h h h h h h h h I I I Sweden
h h h h h h h h h h h h h h h h I I I Italy
h h h h h h h h h h h h h h h h I I I Norway
h h h h h h h h h h h h h h h h I I I Jordan
h h h h h h h h h h h h h h h h I I I Russian Federation
h h h h h h h h h h h h h h h h I I I I Iran, Islamic Rep. of
h h h h h h h h h h h h h h h h I I I Israel
h h h h h h h h h h h h h h h h I I I I Romania
h h h h h h h h h h h h h h h I I I I Bulgaria
h h h h h h h h h h h h h h h I I I I Serbia
h h h h h h h h h h h h h h I I I I Moldova, Rep. of
h h h h h h h h h h h h h h I I I I Indonesia
h h h h h h h h h h I I I I Palestinian Nat'l Auth.
I h h h h h h h h h I I I I Macedonia, Rep. of
I h h h h h h h h h I I I I Cyprus
I h h h h h h h h I I I I Bahrain
I I h h h h h h h h I I I I Tunisia
I h h h h h h h h I I I I Chile
I I I I h h h h h h h h I I I I Egypt
I I I I I I I I h h h h h I I I I Armenia
I I I I I I I I h h h h h I I I I Saudi Arabia
I I I I I I I I h h h h I I I I Philippines
I I I I I I I I I I h h h h I I I I Morocco
I I I I I I I I I I I I h h I I I I Botswana
I I I I I I I I I I I I h h I I I I Lebanon
I I I I I I I I I I I I I I I I I I Ghana
I I I I I I I I I I I I I I I I I I South Africa
h h h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h Indiana State, US
h h h h h h h h h h h h h h h h h h Ontario Province, Can.
h h h h h h h h h h h h h h h h h I Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Ind
on
esia
Pale
stin
ian
Nat
'l A
uth
.
Mac
edo
nia
, Rep
. of
Cyp
rus
Bah
rain
Tun
isia
Ch
ile
Egyp
t
Arm
enia
Sau
di A
rab
ia
Phili
pp
ines
Mo
rocc
o
Bo
tsw
ana
Leb
ano
n
Gh
ana
Sou
th A
fric
a
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Multiple Comparisons of Average Achievement in Environmental Science
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
88
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE406
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS TIMSS2003
GradeSCIENCE
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h
Netherlands h h h h h h h h h h h h h h h h h h h h h h h I h
Chinese Taipei I I h h h h h h h h h h h h h h h h h h h I h
United States I I h h h h h h h h h h h h h h h h h h I h
Hungary I I h h h h h h h h h h h h h h h h I h
Hong Kong, SAR I I h h h h h h h h h h h h h h h I h
England I I I h h h h h h h h h h h h h h I h
Latvia I I I I h h h h h h h h h h h h h h I I h
Japan I I I I I h h h h h h h h h h h h h h I I h
Russian Federation I I I I h h h h h h h h h h I I h
Belgium (Flemish) I I I I I I I I I h h h h h h h h h h h I I h
Australia I I I I I I h h h h h h h h h h I I h
Italy I I I I I I I I I h h h h h h h h h h I I h
New Zealand I I I I I I I I I h h h h h h h h h h I I h
Lithuania I I I I I I I I I I h h h h h h h h h h I I h
Scotland I I I I I I I I I I I I I I I h h h h h h h h I I
Moldova, Rep. of I I I I I I I I I I I I I I I h h h h h h h h I I
Slovenia I I I I I I I I I I I I I I I I I h h h h h h I I I
Cyprus I I I I I I I I I I I I I I I I I h h h h h I I I
Norway I I I I I I I I I I I I I I I I I I h h h h h I I I
Armenia I I I I I I I I I I I I I I I I I I I I h h h I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I h h h I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I h h I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsIndiana State, US h h h h h h h h h h h h h h h h h h h h h h h h h h
Ontario Province, Can. I h h h h h h h h h h h h h h h h h h I h
Quebec Province, Can. I I I I I I I I I I I I I I I h h h h h h h h I I
Sin
gap
ore
Net
her
lan
ds
Ch
ines
e Ta
ipei
Un
ited
Sta
tes
Hu
ng
ary
Ho
ng
Ko
ng
, SA
R
Eng
lan
d
Latv
ia
Jap
an
Ru
ssia
n F
eder
atio
n
Bel
giu
m (
Flem
ish
)
Au
stra
lia
Ital
y
New
Zea
lan
d
Lith
uan
ia
Sco
tlan
d
Mo
ldo
va, R
ep. o
f
Slo
ven
ia
Cyp
rus
No
rway
Arm
enia
Iran
, Isl
amic
Rep
. of
Phili
pp
ines
Mo
rocc
o
Tun
isia
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
44Multiple Comparisons of Average Achievement in Life ScienceExhibit B.6:
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS
TIMSS2003
GradeSCIENCE
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 407
44Exhibit B.7:
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h
Japan I h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I I h h h h h h h h h h h h h h h h h h h h h h
England I I I h h h h h h h h h h h h h h h h h h h h h h
Latvia I I I I I h h h h h h h h h h h h h h h h I h
United States I I I I I h h h h h h h h h h h h h h h h I h
Russian Federation I I I I I h h h h h h h h h h h h h h I h
Hungary I I I I I h h h h h h h h h h h h h h h I I h
Australia I I I I I I I h h h h h h h h h h h h I I h
New Zealand I I I I I I I I h h h h h h h h h h h h I I h
Lithuania I I I I I I I I I h h h h h h h h h h h I I h
Italy I I I I I I I I I h h h h h h h h h h I I h
Belgium (Flemish) I I I I I I I I I I I h h h h h h h h h I I h
Netherlands I I I I I I I I I I I I h h h h h h h h h I I h
Scotland I I I I I I I I I I I I I h h h h h h h h I I
Slovenia I I I I I I I I I I I I I I I h h h h h h h I I
Moldova, Rep. of I I I I I I I I I I I I I I I I h h h h h h h I I
Cyprus I I I I I I I I I I I I I I I I I I h h h h h h I I I
Norway I I I I I I I I I I I I I I I I I I I h h h h h I I I
Armenia I I I I I I I I I I I I I I I I I I I I h h h I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I h h h I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I h I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsIndiana State, US I I h h h h h h h h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I h h h h h h h h h h h h h h h h h h
Quebec Province, Can. I I I I I I I I I I I I I I I h h h h h h h I I
Sin
gap
ore
Jap
an
Ch
ines
e Ta
ipei
Ho
ng
Ko
ng
, SA
R
Eng
lan
d
Latv
ia
Un
ited
Sta
tes
Ru
ssia
n F
eder
atio
n
Hu
ng
ary
Au
stra
lia
New
Zea
lan
d
Lith
uan
ia
Ital
y
Bel
giu
m (
Flem
ish
)
Net
her
lan
ds
Sco
tlan
d
Slo
ven
ia
Mo
ldo
va, R
ep. o
f
Cyp
rus
No
rway
Arm
enia
Iran
, Isl
amic
Rep
. of
Phili
pp
ines
Tun
isia
Mo
rocc
o
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
Multiple Comparisons of Average Achievement in Physical Science
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE408
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS TIMSS2003
GradeSCIENCE
Countries
Chinese Taipei h h h h h h h h h h h h h h h h h h h h h h h h h h
Singapore I h h h h h h h h h h h h h h h h I h
Hong Kong, SAR I h h h h h h h h h h h h h h h h h I h
England I h h h h h h h h h h h h h h h h I h
United States I h h h h h h h h h h h h h h h h h I h
Japan I h h h h h h h h h h h h h h h h h I h
Latvia I h h h h h h h h h h h h h h h h I h
Russian Federation I h h h h h h h h h h h h I h
Hungary I I I I h h h h h h h h h h h h I I h
New Zealand I I I I I I I h h h h h h h h h h h h I I h
Belgium (Flemish) I I I I I I I h h h h h h h h h h h h I I h
Italy I I I I I I I h h h h h h h h h h h h I I h
Australia I I I I I I I h h h h h h h h h h h h I I h
Moldova, Rep. of I I I I I I I I I I I I I h h h h h h h h I I
Lithuania I I I I I I I I I I I I I h h h h h h h h I I
Netherlands I I I I I I I I I I I I I h h h h h h h h I I
Scotland I I I I I I I I I I I I I h h h h h h h h I I I
Slovenia I I I I I I I I I I I I I I I I I h h h h h h I I I
Cyprus I I I I I I I I I I I I I I I I I h h h h h h I I I
Norway I I I I I I I I I I I I I I I I I I I h h h h h I I I
Armenia I I I I I I I I I I I I I I I I I I I I h h h h I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I h h h I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I h I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsIndiana State, US h h h h h h h h h h h h h h h h h h h h h h h h h h
Ontario Province, Can. I h h h h h h h h h h h h h h h h h I h
Quebec Province, Can. I I I I I I I I I I I I I h h h h h h h h h I I
Ch
ines
e Ta
ipei
Sin
gap
ore
Ho
ng
Ko
ng
, SA
R
Eng
lan
d
Un
ited
Sta
tes
Jap
an
Latv
ia
Ru
ssia
n F
eder
atio
n
Hu
ng
ary
New
Zea
lan
d
Bel
giu
m (
Flem
ish
)
Ital
y
Au
stra
lia
Mo
ldo
va, R
ep. o
f
Lith
uan
ia
Net
her
lan
ds
Sco
tlan
d
Slo
ven
ia
Cyp
rus
No
rway
Arm
enia
Iran
, Isl
amic
Rep
. of
Tun
isia
Phili
pp
ines
Mo
rocc
o
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
44Multiple Comparisons of Average Achievement in Earth ScienceExhibit B.8:
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 409
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN SCIENCE CONTENT AREAS