PISA for Schools PilotOverview of Results

FAIRFAX COUNTY PUBLIC SCHOOLS March 2013

1

Welcome and Introductions

2

• History - Established in 1961• Headquarters - Paris, France• Membership - 34 countries• Budget - EUR 347 million• Secretary-General - Angel Gurría

3

The Organization for Economic Co-operation and Development (OECD)

•Promote policies that will improve the economic and social well-being of people around the world

•Provide a forum in which governments can work together to share

experiences and seek solutions to common problems

•Work with governments to understand what drives economic, social and environmental change

•Analyze and compare data to predict future trends

•Set international standards on a range of things, from agriculture and tax to

the safety of chemicals4

•Objective: Our analyses and recommendations are independent and evidence-based

•Open: We encourage debate and a shared understanding of critical global issues

•Bold: We dare to challenge conventional wisdom starting with

our own

•Pioneering: We identify and address emerging and long term challenges

•Ethical: Our credibility is built on trust, integrity and transparency

OECD’s Core Values

5

OECD’s Programme for International Student

Assessment (PISA)

• Evaluates the quality, equity and efficiency of school systems in more than 70 countries

• Monitors outcomes of education systems regularly within an internationally agreed framework

• Provides a basis for global collaboration in defining and implementing education policies

6

PISA Purpose

•Benchmarking in reading, math and science•Results and comparative analysis•Policy analysis

It is not:•Mandated or standardized•Not formative•Not aligned to common core or specific curricular standards

7

Why did FCPS participate in the PISA Pilot for Schools?

• In our global economy, the measurement of educational success can no longer be based on VA or national standards alone

• Students are expected to apply knowledge and skills in new situations and to interpret and infer meaning from complex information

• Benchmarking against the best in the world should be part of our culture in FCPS 8

PISA for Schools Pilot• 125 Schools in Canada, UK and US• 48 School Districts• FCPS had 10 schools participate• 6 magnets, 6 charters and 1 private

school included• 7,400 students tested during May

and June 2012• 75 students per school targeted• Reading, Math, and Science are

assessed• Students also answered a

questionnaire about classroom management and relationships with teachers 9

PISA for Schools Pilot

• Students were selected by the testing company, based on their birthday

• Students had ~ 2 hours to complete the PISA test for schools, including the questionnaire

• Students had to be able to take a paper and pencil test

10

• Lake Chad Questions and Discussion• Other Sample PISA Questions 11

PISA’s Measure of SES

The PISA index of social, cultural and economic status is based on information provided by students about their parents’ education, occupations and wealth (i.e., internet, computers, cars, and bathrooms)

Noted on slides as: PISA index of socio-economic background (ESCS)

12

Lan

gle

y H

igh

Sch

oo

l

The socio-economic background of students in Fairfax County schools

Socio-economic advantage of students

La

ng

ley

Hig

h S

ch

oo

l

13

How the reading performance of the schools in Fairfax County compare with other schools in the United States on PISA 2009

Mea

n S

core

on

the

PIS

A r

eadi

ng s

cale

500 is the US Mean

566 is the Shanghai Mean

14

How the mathematics performance of the schools in Fairfax County compare with other schools in the United States on PISA 2009

300

400

500

600

700

-2 -1.5 -1 -0.5 0 0.5 1 1.5 2

Mea

n sc

ore

on t

he P

ISA

mat

hem

atics

sca

le

Socio-economic background (ESCS)

Schools in the United States that participated in PISA 2009

MathematicsFairfax County Public Schools (2012)

487 is the US Mean

600 is the Shanghai Mean

1 15

300

400

500

600

700

-2 -1.5 -1 -0.5 0 0.5 1 1.5 2

Mea

n sc

ore

on t

he P

ISA

sci

ence

sca

le

Socio-economic background (ESCS)

Schools in the United States that participated in PISA 2009

ScienceFairfax County Public Schools (2012)

How the science performance of the schools in Fairfax County compare with other schools in the United States on PISA 2009

502 is the US Mean

575 is the Shanghai Mean

16

Levels Examples of 4C’s in each level

6• Students can assimilate information from unfamiliar content

area presented in atypical formats

5• Students can find information in unfamiliar texts and infer

which information is relevant

4• Students can locate embedded information and construct

meaning from linguistic nuances

3• Students can integrate several parts of the text to identify a

main idea

2• Students can compare and contrast between texts and outside

knowledge

1• Student can locate pieces of information that is explicitly

stated

Reading

17

Levels Examples of 4C’s in each level

6• Students can conceptualize, generalize and utilize information

based on their investigations and modeling of complex problems

5• Students can reflect on their problem solving actions and

communicate their interpretations and reasoning

4• Students can select and integrate different representations,

including symbolic ones, linking them directly to the real-world.

3• Students can write short communications reporting their

interpretations, results and reasoning

2• Students can extract relevant information from a single source

1• Student can perform actions that are obvious

Mathematics

18

Levels Examples of 4C’s in each level

6• Students can use scientific knowledge and develop arguments

in support of recommendations and decisions that center on personal, social or global situations

5• Students can construct explanations based on evidence and

arguments based on critical analysis

4• Students can reflect on their actions and can communicate

decisions using scientific knowledge and evidence

3• Students can select facts and knowledge to explain phenomena

2• Students can use direct reasoning and make literal

interpretation of the results

1• Student can use limited scientific knowledge and apply it to

familiar situations

Science

19

How proficient are students in schools in Fairfax County in mathematics?

MATHEMATICS

-100 -80 -60 -40 -20 0 20 40 60 80 100

Shanghai-China--2009

US--2009

FCPS--Pilot Average

Woodson HS

Thomas Jefferson HSST

Oakton HS

Mount Vernon HS

Lee HS

Langley HS

Herndon HS

Hayfield SS

Falls Church HS

Chantilly HS

Level1 Below Level 1 Level 2 Level 3 Level 4 Level 5 Level 6

Students at Level 1 or below Students at Level 2 or above

2020

• Self-efficacy in mathematics: Students’ self-belief in their ability to overcome difficulties or obstacles to solving math problems

• Confidence that one will be able to solve a problem is a precursor to investing the time and effort needed to tackle it

Students’ Self-efficacy in Mathematics

21

Oakton

22

Teacher Student-Relations

23

Other Data Available• International and national

comparisons• Learning Environment and

Teacher-Student Relationship• Students’ reading habits• Students’ attitudes about

reading, math and science• Student’s self-beliefs and

interest in reading and science• Public and private school

comparisons• Boys and girls comparison in

reading, math, and science• Extensive research information 24

Next Steps for FCPS• Network with other schools in the US that

participated in the PISA pilot– America Achieves Event– EdLeader21

• Share the results with all FCPS schools – Pyramid Planning– Benchmarking against the best– Leadership Conference- Pasi Sahlberg– Division Strengths/Challenges

• Examine FCPS/VA/US policies to ensure they are supportive ofthe best conditions for learning

25

PISA for Schools PilotOverview of Results

FAIRFAX COUNTY PUBLIC SCHOOLS March 2013

26