title of the report - education review office six dimensions of a successful school ... school...
TRANSCRIPT
Page | 1 Education Review Office - Framework for School Reviews
Contents ERO’s Framework for School Reviews ..................................................................................... 3
What is in the framework? .................................................................................................. 3
Why ERO reviews ..................................................................................................................... 4
Purpose of the review ......................................................................................................... 4
Accountability and improvement ........................................................................................ 4
What ERO reviews ................................................................................................................... 5
What the review considers .................................................................................................. 5
ERO’s major evaluative question ......................................................................................... 5
The six dimensions of a successful school ........................................................................... 5
National evaluation topics ................................................................................................... 5
Legal requirements .............................................................................................................. 6
ERO reviews – a complementary process ................................................................................ 7
Fair and transparent process ............................................................................................... 7
Preparing for the review .......................................................................................................... 8
Gathering information ......................................................................................................... 8
Scoping the review .............................................................................................................. 8
Relationships and conduct during reviews .............................................................................. 9
The ERO visit .......................................................................................................................... 12
Areas for development and review ................................................................................... 12
Consultation with the board of trustees ........................................................................... 12
ERO’s Report .......................................................................................................................... 13
Likely nature and timing of your school’s next review ...................................................... 13
Recommendations to other agencies: Interventions ........................................................ 13
ERO’s review principles .......................................................................................................... 14
Equity of Educational Opportunities and Outcomes ..................................................... 14
Enquiry-Focused............................................................................................................. 14
Responsive ..................................................................................................................... 14
Transparent .................................................................................................................... 14
Collaborative and Participatory ..................................................................................... 14
Informed by Evidence .................................................................................................... 15
Building Evaluation Capacity .......................................................................................... 15
Page | 2 Education Review Office - Framework for School Reviews
The School’s Curriculum ........................................................................................................ 16
The New Zealand Curriculum ............................................................................................ 17
School curriculum design and review ................................................................................ 18
Teaching as Inquiry Cycle .................................................................................................. 18
Building evaluation capability ................................................................................................ 21
Self review: a continuum of understanding and practice ................................................. 22
Different types and cycles of self review ........................................................................... 23
Self-review processes ........................................................................................................ 24
Highly effective self review .................................................................................................... 25
In this section ..................................................................................................................... 27
Six Dimensions of a Successful School ........................................................................... 28
Diagram 5: The Six Dimensions of a Successful School ................................................. 28
ERO’s Key Evaluative Questions ........................................................................................ 29
Criteria for Review Timing Decisions ..................................................................................... 30
Next ERO review over the course of one-to-two years ..................................................... 31
Next ERO review in three years ......................................................................................... 32
Next ERO review in four-to-five years ............................................................................... 32
Table 2: Overall Evaluation Framework ............................................................................ 34
Page | 3 Education Review Office - Framework for School Reviews
ERO’s Framework for School Reviews
The Framework for School Reviews is about the process the Education Review Office (ERO)
uses for reviews of state schools and kura that do not operate in accordance with the
principles of Te Aho Matua.
The Framework is a resource that both ERO and schools and kura can use during reviews. It
reflects ERO’s current review methodology and is a complementary document to ERO’s
Evaluation Indicators for School Reviews.
What is in the framework?
There are two parts to this framework. The first part focuses on the essential information
about the review and the school’s involvement.
Why ERO reviews
What ERO reviews
ERO reviews – a complementary process
Preparing for the review
Report and return times
The second part includes more detail about how ERO reviews and the thinking behind our
processes.
ERO’s review principles
The School’s Curriculum
Complementary evaluation and school self review/evaluation
Conceptual framework – the Six Dimensions of a Successful School
Criteria for Review Timing Decisions
Overall Evaluation Framework
Note: ERO’s reviews for private schools are different to reviews of state and
state-integrated schools, and for kura. ERO also has separate review procedures for
Te Aho Matua kura kaupapa Māori.
Page | 4 Education Review Office - Framework for School Reviews
Why ERO reviews
Purpose of the review
An ERO review supports a school to strengthen its capacity to promote students’ learning
and achievement. The review process also aims to sustain ongoing development and
improvement through effective self review.
ERO is a government department providing independent external evaluation of schools and
early childhood services
Through its reviews ERO is able to provide assurance to the Government, parents and
communities about the quality of schools and early childhood services and the effective use
of public funds.
Children and young people are central to ERO’s approach. This is reflected in ERO’s
whakataukī and is the foundation for ERO’s vision and mission statement.
Accountability and improvement
ERO’s evaluation in schools has two purposes – accountability and educational
improvement.
Evaluation for accountability purposes involves reporting on goals and standards (including
checking on compliance matters), while an improvement focus involves assisting schools to
develop and improve through their self review.
ERO’s approach is to work with schools to identify both their strengths and areas for
development and review.
Page | 5 Education Review Office - Framework for School Reviews
What ERO reviews
What the review considers
ERO’s review considers:
the school curriculum
school self review
national evaluation topics
the Board Assurance Statement
student health and safety
ERO’s major evaluative question
Reviews take the most useful aspects from external review and a school’s self review,
together with information about the school’s context, to build an overall picture of the
school. This helps ERO to answer the major evaluation question for reviews:
How effectively does this school’s curriculum promote student learning - engagement,
progress and achievement?
In relation to ERO’s major evaluation question, ERO’s review framework is designed
to make it easier for schools to see:
what they are doing well
where they need to develop and review
implications for future action.
The six dimensions of a successful school
The review focuses on the quality of education provided by the school. This involves
evaluating the impact of governance and management, professional leadership and
teaching on your students’ learning and achievement. This is set out in the diagram the Six
Dimensions of a Successful School – this is a useful tool for ERO and schools.
National evaluation topics
During reviews in individual schools, ERO collects information on national evaluation topics.
This information is brought together and analysed so it can be published in a national
report. The findings from these reviews influence national debate and support the
Government in the development and implementation of education policy and practice.
Page | 6 Education Review Office - Framework for School Reviews
ERO’s national evaluation programme reflects current education issues. Some topics are
ongoing, such as Success for Māori Students, while others are investigated for a short
period of time. Current national evaluation topics are on ERO’s website.
Legal requirements
Providing a safe and healthy learning and working environment and complying with
statutory legislation and legal requirements are important responsibilities of schools. For
this reason ERO evaluates the school's provision of a safe and healthy learning and working
environment and the board's compliance with statutory legislation and legal requirements.
ERO's Board Assurance Statement (BAS) and Self-Audit Checklist, completed before the
review, provides an opportunity for the school systematically review these aspects of
school performance and to provide assurance that all reasonable steps have been taken to
meet legal and health and safety requirements.
ERO checks the board's compliance as attested in the BAS. If this indicates any significant
problems, ERO may decide to investigate further. ERO's main interest in compliance is to do
with the quality of the school's self review. Any non-compliance not identified by the board
and discovered by ERO may be included in the ERO report and, if significant, may result in a
further review. ERO decides on a case-by-case basis whether or not to report non-
compliance issues identified by the board.
ERO also checks six key areas to do with student safety. These are:
emotional safety of students (including prevention of bullying and sexual harassment)
physical safety of students teacher registration processes for appointing staff stand-downs, suspensions, expulsions and exclusions attendance
Page | 7 Education Review Office - Framework for School Reviews
ERO reviews – a complementary process
ERO’s review process is a differentiated and complementary evaluation approach. It
provides external evaluation that responds to a school’s context and uses and builds on
each school’s capacity for self review.
Differentiated reviews build responsive, professional and productive relationships between
ERO and schools. Differentiated reviews aim to build on school strengths and self review
capacity and capability and ensure that ERO’s review findings are useful and used.
At the school level the differentiated review approach is:
o centred on learners
o responsive to school context and self review
o development and improvement focused
At the education system level the differentiated approach is:
o responsive to government education priorities
o focussed on learners, specifically Māori and Pacific learners, and students with
special learning needs
o promotes sustainability through building capacity in self review
Fair and transparent process
ERO education reviews are fair and transparent. ERO reviewers are professional evaluators
with many years of experience in education, and specific training in evaluation. All reviews
are underpinned by seven key principles and are carried out in accordance with:
Standard of Integrity and Conduct (State Services Commission)
Expectations of Review Officers (ERO Code of Conduct)
It is important that ERO and schools have a common understanding of relationships and
conduct during reviews. ERO’s Information Exchange table has more information about
these relationships and ERO’s expectations of schools.
Page | 8 Education Review Office - Framework for School Reviews
Preparing for the review
The starting point for ERO’s evaluation will be what the school knows about its students’
learning and progress and how they have used that information to design and develop a
curriculum that is responsive to students’ diverse educational strengths and needs.
ERO will also evaluate how well positioned the school is to sustain developments and
continue to improve outcomes for all students.
The Information Exchange table is a useful guide as to what ERO will do and what ERO
expects from schools before, during and after the process.
Gathering information
In preparation for a review, a school needs to consider its self-review information and how
to present it to the ERO team.
In addition to school self-review data, the School’s Charter and targets for students and the
completed Board Assurance Statement and Self Audit Checklist will be useful information
for the ERO review team. ERO will also send a pre-review questionnaire for the school to
complete before the review.
ERO gathers information from other sources including interviews with school staff,
students, parents and whānau, documentation and observation. Schools are expected to
seek the views of students and parents as part of their ongoing community consultation
and self review.
Scoping the review
The review coordinator and team will work with the school’s board and leadership team to
establish a shared commitment to the review process. This is vital for the school to gain the
maximum benefit from the review.
The school’s board and leadership could consider who they would like to be involved in the
review process. This may include someone from outside the school who has good
knowledge of the school’s self-review processes and context and can contribute to the
school’s self review both during and after the review.
Page | 9 Education Review Office - Framework for School Reviews
Relationships and conduct during reviews
It is important for ERO and schools to have a common understanding of relationships and conduct in reviews. The following table summarises how ERO
manages relationships and processes in reviews, and sets out ERO’s expectations of schools.
Table 1: Information Exchange
ERO will:
make information about the review process and the review criteria available to each school and will provide the pre-review questionnaire, Board Assurance Statement and Self-Audit Checklists and Evaluation Indicators
ask the school to complete a questionnaire. This gives ERO contextual background and information about student engagement, progress and achievement
use the results of the school’s self review and analysis of student achievement as the starting point for the design of the review
give the school opportunities to ask questions about the review process
invite school staff including the board to discuss the school’s progress and curriculum in relation to ERO’s major evaluation question and the Government’s education priorities. This usually takes place shortly before or at the beginning of the onsite stage.
ERO expects the school to:
make all relevant information available to ERO including self-review results and the school’s analysis of student achievement
complete the Board Assurance Statement and Self-Audit Checklists
complete and return the Pre-review questionnaire and other information about the school
work constructively with the review team to give access to information on site
facilitate discussions with members of the board, school management, staff and students.
Before going to a school ERO will:
conduct the initial scoping for the review using the school’s and publicly available information about student achievement and self review.
ERO expects the school to:
notify the school community that a review is scheduled to take place
Page | 10 Education Review Office - Framework for School Reviews
Designing the Review
ERO will:
discuss the design of the review with the school and take into account its suggestions
keep the school informed about the evolving design of the review.
ERO expects the school to:
discuss the aspects of its policies, practices and plans that are having a high impact on teaching and learning and student achievement, and the material they have gathered from self-review information
share information about the school’s process/approach to self review.
The Review
ERO will:
carry out the on-site stage of the review with a focus on student achievement and curriculum
discuss emerging findings
reach judgements based on evidence
outline its findings to the school
outline the evidential basis for key findings
in consultation with the school, decide on ways to effect improvement in student achievement.
ERO expects the school to:
participate in the review by presenting self-review material and explanations to help review officers understand the context of the school
be involved in discussions about emerging findings
work constructively with review teams to identify the implications for action, areas for development and review and to develop any recommendations or actions for compliance based on ERO’s findings.
Reporting
Page | 11 Education Review Office - Framework for School Reviews
ERO will:
report areas of strength, areas for development and review, implications for action and any recommendation/s
write an unconfirmed report that answers ERO’s major evaluation question
give schools an opportunity to consider the unconfirmed report
confirm the report and send it to the board of trustees
release its report publicly two weeks after confirmation and publish it on ERO’s website.
ERO expects the school to:
have the board of trustees and principal consider the unconfirmed report and respond to any errors of fact
make the confirmed report available to the school community
address the areas for development and review, and recommendations in the report.
Page | 12 Education Review Office - Framework for School Reviews
The ERO visit
The length of ERO’s visit will vary. Review officers will want to gather all relevant
information and discuss their findings with the school as these emerge during the review.
Review officers will visit some classrooms as part of the review.
Areas for development and review
Where appropriate, ERO will identify and discuss with the school areas for development
and review. These areas are identified to support improvement where it is likely to have a
direct and positive impact on student achievement.
In some cases a single, specific course of action might not be the most useful response to a
particular problem. In these cases ERO and the board may consider a range of options or
ideas and through discussion choose the most appropriate strategy or strategies.
Consultation with the board of trustees
Considering possible courses of action and /or developing recommendations is a key
outcome of the review process. ERO and the board work together to consider options and
ideas that are practical and achievable. The review team may still make recommendations
even if the discussions with the board are not successful in reaching agreement about the
areas for development and review.
Page | 13 Education Review Office - Framework for School Reviews
ERO’s Report
ERO’s report sets out the findings of the review. The report is intended primarily for the
parent and whānau audience and will be clear and succinct. The report will reflect ERO’s
focus on the learner.
The report addresses ERO’s major evaluative question and the Government’s national
education priorities to do with Māori and Pacific students.
The report will discuss:
how effectively the school’s curriculum promotes and supports student
learning engagement, progress and achievement
how well placed the school is to sustain, improve and develop its performance
through effective self review
how well the school promotes Māori student success as Māori
the important features of the school that have an impact on student learning.
The report will include what is working well and any areas for development and review,
ERO’s decision regarding the timing of future reviews of the school and any
recommendations to other agencies.
Likely nature and timing of your school’s next review
The review team formulates judgements about the school’s performance and capacity to
maintain a sustainable cycle of self review and improvement. These judgements, in
conjunction with ERO’s criteria, form the basis of ERO’s decisions regarding the likely nature
and timing of your school’s future reviews.
The review team makes decisions about the timing of future reviews in consultation with a
manager. Where a one-to-two year return time is being recommended, the review
coordinator may discuss the timing of the next review with the board before the
unconfirmed ERO report has been sent to the school.
Recommendations to other agencies: Interventions
Probably the most frequent recommendation by ERO to other agencies will be a
recommendation to the Ministry of Education related to an intervention.
The Education Act 1989 provides for a range of statutory interventions to help the Ministry
of Education identify and respond to difficulties in schools, especially where student
welfare or learning is at risk. The interventions allow the Ministry to step in at an early
stage to support schools where needed. The Ministry can, on its own initiative, decide to
intervene or the board of trustees can ask for Ministry help.
Page | 14 Education Review Office - Framework for School Reviews
Where the intervention is being recommended by ERO the expectation is that the Ministry
will discuss the nature of the intervention with the board of trustees. The interventions are
set out in Part 7A of the Education Act 1989. More than one intervention can be used at
the same time, or one can follow another.
ERO’s review principles
All of ERO’s Education Reviews are underpinned by the following principles. Although the
review principles are discussed separately below they interact and overlap in the course of
a review.
Equity of Educational Opportunities and Outcomes
A first principle of Education Reviews is to promote equity of educational opportunities and
outcomes for all students, with particular reference to Māori and Pacific students and
students with special needs. This principle will be emphasised in each school review
through discussion about how and to what extent the school has improved equity of
educational opportunity and outcomes for particular groups of students.
Enquiry-Focused
Education Reviews embody the principle that enquiry, through action and reflection, should
underpin the progressive development of a school’s self-improving cycle. This supports the
school’s ongoing efforts to sustain its development initiatives and to raise student
achievement. The starting point for all reviews will be an evaluation of the school’s own
enquiry focuses and processes.
Responsive
ERO takes account of each school’s unique context, situation and circumstances and of the
diverse perspectives of stakeholders. The review process is continuously responsive to
emerging findings and developments. ERO’s principle of responsiveness involves
responding in the first instance to the school’s own account of its context for learning and
teaching, and its capability and capacity for self review.
Transparent
At all stages of its reviews ERO makes its evaluation processes, analyses, interpretations,
decisions and conclusions transparent. This transparency supports fairness of process and
builds trust and confidence in review processes and outcomes and contributes to building
capacity in self review.
Collaborative and Participatory
Collaborative and constructive relationships are critical in establishing the trust necessary
for effective formative evaluation to be undertaken. A collaborative, participatory
approach encourages the participation of stakeholders and helps to ensure that the review
generates new insights for the school and strengthens its capacity for ongoing development
and improvement. In addition, stakeholders take greater ownership of the evaluation
processes, and the outcomes of the review are more likely to be useful and used.
Page | 15 Education Review Office - Framework for School Reviews
Informed by Evidence
ERO’s judgements about school performance are always appropriately informed by
evidence gathered through the review process. Evidence is defined as the material or
information that is used to support a finding, fact or judgement. Evidence positions
material or information within the context of a theory or hypothesis.
Because the starting point for ERO reviews is the school’s own information and evidence
generated through self review, ERO’s evaluation focuses on evaluating the breadth of the
school’s evidence and the extent to which the school’s self-review processes are
systematic, trustworthy and credible.
Building Evaluation Capacity
ERO is the external partner in a complementary process that combines the generative
power of external review and school self review. The aim of all reviews is to build the
school’s capacity for self review.
Through the Education Review process ERO and the school can determine the
school’s existing capacity and capability for self review. This is the basis for further
development of the school’s evaluation capacity and promotes ongoing
development.
Page | 16 Education Review Office - Framework for School Reviews
The School’s Curriculum
ERO’s evaluation places the school’s curriculum and the student at the heart of ERO’s reviews:
How effectively does this school’s curriculum promote student learning - engagement, progress
and achievement?
ERO defines the term curriculum broadly to encompass all the learning experiences that a student
encounters in the school environment.
The starting point for ERO’s evaluation is what the school knows about students’ learning and how it
has used that information to design and develop a curriculum that is responsive to students’ diverse
educational strengths and needs. ERO also evaluates how well-positioned each school is to continue
improving all students’ learning so that they can become “confident, connected, actively involved,
lifelong learners”
Page | 17 Education Review Office - Framework for School Reviews
The New Zealand Curriculum
The New Zealand Curriculum sets the direction for student learning. It provides guidance for
each school to design its own curriculum based on The New Zealand Curriculum. Schools
tailor their own curriculum to suit their particular context and to promote the learning and
achievement of their students.
The New Zealand Curriculum is underpinned by principles. These principles are the
foundation of curriculum decision-making in New Zealand schools and “put students at the
centre of teaching and learning, asserting that they should experience a curriculum that
engages and challenges them, is forward looking and inclusive and affirms New Zealand’s
unique identity” (The New Zealand Curriculum p 9).
The New Zealand Curriculum sets out the values, key competencies, learning areas and
effective pedagogies that are the basis for teaching and learning in New Zealand’s schools.
Each school’s curriculum is expected to encompass the vision, principles, and values, key
competencies, learning areas, effective pedagogy and achievement objectives of The New
Zealand Curriculum.
Page | 18 Education Review Office - Framework for School Reviews
School curriculum design and review
ERO’s evaluation considers how schools use ‘the scope, flexibility and authority’ of The New Zealand
Curriculum to design and shape a curriculum that is meaningful and that effectively promotes
student learning - engagement, progress and achievement.
ERO’s Evaluation Indicators clarify the basis on which ERO evaluates student learning – engagement,
progress and achievement (Evaluation Indicators for School Reviews pp15-19).
Diagram 1 outlines a process schools can use in
developing and reviewing curriculum. It shows that the
primary function of the curriculum is to improve student
learning and that each phase of the cycle provides the
information, resources and basis for the next stage.
Diagram 1: Curriculum Development Cycle
ERO’s discussion about a school’s curriculum can start at any point in the process and can work
forwards or backwards. Most importantly, this cycle of development does not stop. When one cycle
has been completed a school will already find it has reviewed and embarked on the next cycle. The
changes made as a result of the first cycle will produce new information about the strengths and
needs of students, and so the process begins again.
The school’s self-review information about the impact its curriculum is having on promoting and
improving student learning is central to curriculum review and to ERO’s review. Curriculum design
and review is a major component of all schools’ self-review/evaluation processes.
Teaching as Inquiry Cycle
The curriculum development and review cycle is closely aligned to the Teaching as Inquiry cycle. The
purpose of the Teaching as Inquiry cycle is to improve outcomes for students. It is a process that
enables teachers to learn from their practice and build their knowledge. You can find more
information about Teaching as Inquiry by clicking on the link above.
Page | 20 Education Review Office - Framework for School Reviews
Self review
Self review in schools plays an important role in promoting achievement, and in school improvement
and development. A school’s self-review information is a critical part of a review and informs ERO’s
overall judgement about the school.
This section gives information about the different stages and types of self review, self-review
processes and what highly effective self review looks like.
Building evaluation capability
Self review: a continuum of understanding and practice
Self review in schools
Different types and cycles of self review
Self-review processes
Highly effective self review
Page | 21 Education Review Office - Framework for School Reviews
Building evaluation capability
ERO uses its external evaluation process to support school development and build the capacity and
capability of schools to undertake ongoing internal evaluation (self review) for both improvement
and accountability.
ERO helps build schools’ evaluation capability through:
making its own external review processes transparent
modelling evaluation practice
encouraging participation in ERO’s evaluation process
evaluating the school’s self review processes
the participation of school leaders in evaluation design, analysis and synthesis processes
providing tools (e.g. examples of evaluation questions and indicators) and discussing
resources that schools can use in their self review
Page | 22 Education Review Office - Framework for School Reviews
Self review: a continuum of understanding and practice
The following diagram represents self-evaluation/ review as a developmental continuum moving
from the early stages of development to a more effective and capacity building form.
Diagram 2: Self review: a continuum of understanding and practice
Page | 23 Education Review Office - Framework for School Reviews
Different types and cycles of self review
Just as there are a number of different and overlapping purposes for school self review there are
also a number of different types and cycles of self review that interact and overlap.
Diagram 3 describes the connection between the different cycles of strategic, regular and
spontaneous self review.
Diagram 3: Types of self review
Strategic self review is long term an overarching form of self review, which focuses on evaluating
how well a school is achieving its mission, vision and strategic goals and can support decisions about
school direction and priorities.
Regular (or planned) self reviews are about ‘business as usual’ reviews. They are smaller, focused
and ongoing. This kind of self review feeds information into strategic self review.
Emergent (or spontaneous) self reviews are in response to unplanned events or issues as they arise.
They are one-off spontaneous reviews but should fit with the school’s overall goals and feed into
other reviews.
Page | 24 Education Review Office - Framework for School Reviews
It needs to be noted that the different types and cycles of self review/evaluation described here will
be enacted in different ways depending on the school’s unique situation and context.
Self-review processes
Self review involves deciding on a focus, gathering and collecting data/ information to find out what
is happening, analysing and synthesising the data and deciding what was worthwhile, what has been
learnt and where to next.
At its simplest self review/evaluation can be simply described as the following set of linked questions
and processes. Although depicted and discussed as a sequence these processes are not necessarily
discrete and can and do overlap and interact.
What is so? So what? Now what?
Data Analysis Decisions
Data: The school gathers raw or aggregated data - hard (quantitative/numerical) and soft
(qualitative/narrative). This shows “what is” or “what is happening.”
Analysis: Data are turned into information which is analysed to give meaning to the raw data
allowing schools to make statements or comparisons.
Decisions: The information is used to support judgements (how well/to what extent), to make
decisions (if this is so, then we need to …) and to determine priorities (the most compelling need is
…).
A school’s self review will involve all three processes to establish a continuous cycle of school and
curriculum development and improvement.
Page | 25 Education Review Office - Framework for School Reviews
Diagram 4: From data to decisions
Highly effective self review
Between 2008 and 2010 ERO undertook consultation and evaluation focused on the understanding
and implementation of self review in schools and early childhood services.
ERO found that high quality self review:
was strongly focused on improvement and with well-established procedures to guide
practice
served both improvement and accountability purposes
was characterised by shared understandings about self review
was embedded in practice and an integral and ongoing process
had a clear focus
was both planned and spontaneous
included scheduled policy reviews and more in-depth reviews of specific areas of practice
included spontaneous reviews which were responsive to emerging issues.
The factors that support high quality self review are:
strong leadership to promote self review
professional development to support self review
stable and collaborative staff
sound, sustainable systems for self review
use of relevant resources and support systems.
The school gatheris raw or aggregated data.
Some of the data will be quantitative/numerical and
some will be qualitative/narrative. The
data describes “what is” or what is happening.
The school turns the data into information.
It explains what this means.
The school uses this information as evidence to support judgements (how
well/to what extent),
and to draw implications for action and decide priorities.
Page | 26 Education Review Office - Framework for School Reviews
For further information about effective school self review ERO’s Evaluation Indicators for Schools.
Page | 27 Education Review Office - Framework for School Reviews
ERO’s Conceptual Framework for School Reviews
ERO’s conceptual framework for school reviews is based on analysis of ERO’s national evaluations,
synthesis of New Zealand research (in particular the Best Evidence Syntheses) and international
research and current evaluation theory and practice.
The framework is based on six dimensions of good schooling practice. ERO’s Evaluation Indicators for
Schools provide further in depth information including the evaluative questions, prompts and
indicators for each of the six dimensions. The conceptual framework together with ERO’s Evaluation
Indicators for Schools can:
assist schools in self review
assist ERO and schools to identify and discuss how the different dimensions of the school
work together to promote student learning and achievement.
In this section
Six Dimensions of a Successful School
ERO’s Key Evaluative Questions
Page | 28 Education Review Office - Framework for School Reviews
Six Dimensions of a Successful School
The Six Dimensions of a Successful School (Diagram 4) shows how student achievement connects to
effective governance, professional leadership, high quality teaching, school culture and engagement
with parents, whānau and communities. All of the six dimensions directly or indirectly contribute to
creating the conditions that promote student learning and achievement.
The diagram is not a ‘logic model’ showing detailed causal relationships, but a tool to assist schools
and ERO to determine how the different dimensions connect in a particular school. It should be
possible to trace a relationship between each dimension and student achievement.
A useful exercise for schools is to consider the key dimensions and the specific ways in which each
can influence the others. The process of ERO and the school working together in tracing the links
may be useful not only in deciding what to include and what to exclude, but also to clarify what is
material to the ERO review.
It may also help schools and ERO to identify sources of information and aspects of school life that
ERO needs to view in order to make sound evaluation judgements.
Diagram 5: The Six Dimensions of a Successful School
Page | 29 Education Review Office - Framework for School Reviews
ERO’s Key Evaluative Questions
ERO’s major evaluation question focuses on the central dimension of the framework:
How effectively does this school’s curriculum promote student learning - engagement, progress and
achievement?
Schools and ERO will want to look at the key evaluative questions and criteria that apply to the
dimensions and decide how they link together to contribute to student learning - engagement,
progress and achievement in each school context. To decide if a school has the capacity to sustain
and continue improving learning for students ERO considers information from across the six
dimensions using the school’s self review and findings from ERO’s inquiries.
Diagram 6: Key Evaluative Questions
Page | 30 Education Review Office - Framework for School Reviews
Criteria for Review Timing Decisions
ERO decides the timing of the next review based on the outcome of its Education Review of a
school/kura. Subsequent changes in circumstances may lead to a review taking place earlier than
indicated.
There are three options for the timing of the next ERO Education Review:
over the course of one-to-two years – Education Review: Arotake Paetawhiti
in three years – Education Review: Arotake Paerewa
in four-to-five years – Education Review: Arotake Paehiranga.
Page | 31 Education Review Office - Framework for School Reviews
ERO's decisions about the timing of reviews are based on the criteria below. The criteria are
designed to facilitate national consistency. The criteria do not apply to private schools.
ERO expects to review most schools again in three years.
The decision about the timing of the next review is made in consultation between each review team
and an ERO Review Services Manager and/or National Manager Review Services. The return timing is
stated in the unconfirmed report.
Where an Arotake Paetawhiti is being recommended, the review coordinator may discuss the timing
of the next review with the board chairperson, board of trustees and principal before the
unconfirmed report is sent to the school.
Next ERO review over the course of one-to-two years
Education Review: Arotake Paetawhiti
ERO will decide to carry out another review over the course of one-to-two years where there is
evidence that gives ERO cause for concern about the education and safety of students with regard to
one or more of the following:
Student engagement, progress and achievement
Māori student engagement, progress and achievement
Provision of effective teaching
Leadership and management
Governance
The provision of a safe and inclusive school culture
Engagement of parents, whānau and communities.
In addition, ERO will return over the course of one-to-two years where, in ERO’s view, the board
needs external intervention at either a statutory or lower level to bring about the desired
improvement.
If a Limited Statutory Manager (LSM) or commissioner or other Ministry of Education intervention
was in place at the time of the review or is being recommended, the timing of the review is decided
case-by-case in consultation with a National Manager Review Services.
Factors that may influence the duration of an Arotake Paetawhiti will include the extent to which the
school has:
useful or appropriate documented plans for improvement
a likelihood of stable governance and management over the next two years
a board focus on improvement
evidence of self-review practices that are helping to lift student achievement and are
likely to support school improvement.
Page | 32 Education Review Office - Framework for School Reviews
Next ERO review in three years
Education Review : Arotake Paerewa
The majority of schools will come into this category.
With reference to ERO’s Framework for School Reviews - The Six Dimensions of a Successful School
and Evaluation Indicators for School Reviews, ERO will next review the school in three years where it
finds that the school’s curriculum is effective in promoting student learning, engagement, progress
and achievement.
Good performance, with aspects of high quality performance, will be evident and ERO will have no
material concerns about the education and safety of students.
Overall, the school will demonstrate that:
learners experience a well-designed curriculum that provides them with choices and
pathways and supports their successful transition through schooling and on to further
education and training
learners, including priority groups of learners, are actively engaged in their learning and
are progressing and achieving well
Māori learners are actively engaged in their learning, progressing and achieving well and
succeeding as Māori
there is a culture of high expectations for students and staff
critical reflection and established processes for conducting and using self review support
improvement
leadership is effective in promoting student learning and achievement
teaching demonstrates good quality practices, makes good use of student achievement
information and is consistently effective in promoting outcomes for students
the school has taken all reasonable steps to provide a safe and inclusive environment
governance uses good processes for self review, direction setting and decision-making,
and to ensure school accountabilities are met
the school effectively engages the community in the life of the school.
Next ERO review in four-to-five years
Education Review: Arotake Paehiranga
With reference to ERO’s Framework for School Reviews - The Six Dimensions of a Successful School
and Evaluation Indicators for School Reviews, ERO will next review the school in four-to-five years
where it finds that the school’s curriculum is consistently effective in promoting student learning –
engagement, progress and achievement.
Page | 33 Education Review Office - Framework for School Reviews
High quality performance will be evident and ERO will have no material concerns about the
education and safety of students.
Overall, the school will convincingly demonstrate that:
learners experience a coherent and rich curriculum that provides them with relevant choices
and pathways and supports their successful transition through schooling and on to further
education and training
learners are actively engaged in their learning, and are progressing and achieving well; and
the progress of priority groups of learners is being accelerated
Māori learners are actively engaged in their learning, progressing and achieving well and
succeeding as Māori
there is a well-sustained culture of high expectations for students and staff
a school-wide culture of rigorous critical reflection and self review contributes effectively to
sustaining the school’s positive performance and continuous improvement
leadership is highly effective and strategic, and is consistently improving student learning
and achievement
teaching consistently demonstrates high quality practices, makes very good use of student
achievement information, and is highly effective in promoting outcomes for learners
the school has taken all reasonable steps to provide a safe and inclusive environment
governance is highly effective in self review, direction setting, decision-making and ensuring
school accountabilities are met
the school is highly effective in engaging the community in partnerships for learning and in
the life of the school.
Page | 34 Education Review Office - Framework for School Reviews
Table 2: Overall Evaluation Framework
ERO’s overarching evaluation question can be teased out into three broad investigative strands (See Table 2). These strands focus on evaluating the school’s capability to build and sustain improvement and design, enact and review a curriculum that effectively promotes student learning, progress and achievement. The questions under each of the investigative strands are useful for your school to consider.
The questions under each of the strands in Table 2 are indicative only. Reviewers and schools may devise different questions to suit the context of the review. ERO’s Evaluation Indicators provide a resource for generating evaluative questions.
How effectively does this school’s curriculum promote student learning - engagement,
progress and achievement?
Curriculum design,
enactment and review
Student progress
and achievement
Capability
and sustainability
How effectively is the school’s
curriculum designed, enacted and
reviewed to respond to the strengths
and needs of all students and promote
their progress and achievement?
How well are students engaged in learning?
How well are students achieving?
How well are students progressing?
How robust is the information the school
gathers and uses for making judgements
about student achievement?
How well do students, teachers, school
leaders, trustees and parents use
achievement information?
To what extent is the school using its
teaching, leadership and governance
capability to sustain ongoing
improvement and promote progress and
achievement for all students?
What are the school’s processes, findings and outcomes of self review?
Areas for investigation include:
How have the school’s curriculum
priorities (including content and
context) been determined?
How well is the school giving effect to
its curriculum?
What are the links between The New
Zealand Curriculum and the school
curriculum?
What learning opportunities, activities
and experiences does the school
provide to promote the learning of all
Areas for investigation include:
What do students know about their
achievement and what they need to do to
improve?
How well do teachers use achievement
information to provide focused teaching and
make judgements about student
achievement and rates of progress?
How well is information used to report to
parents in plain language about their child’s
progress and achievement?
What information do parents receive about
Areas for investigation include:
How does the school determine its
strategic priorities?
How well are resources used to support
the curriculum and teaching and
learning?
What do teachers, school leaders and
trustees know about:
their school community and context;
their roles and responsibilities;
the areas the board and school need to improve; and
assessment practices and
Page | 35 Education Review Office - Framework for School Reviews
students?
How well is assessment information
being used as a basis for ongoing
curriculum development and review?
how to support their child’s learning?
What are the specific outcomes in terms of
students’ engagement progress and
achievement?
What information do trustees receive about
student achievement?
How well do trustees and school leaders use
student achievement information to identify
priorities, establish strategic direction, build
capability and sustain improvement?
student achievement?
How well does the school use this
information to sustain and promote
ongoing improvement?
Success for Māori students Success for Pacific students International students
Using assessment information to promote student progress and achievement
and any other national evaluation topics