Welcome to

Assessment Tools for Teaching and Learning

(Version 2)

Online Workshop 2003

What’s on the CD

Reading / Pānui

Writing / Tuhituhi

Mathematics / Pāngarau

Curriculum levels 2-4

Years 5-7

• An introduction to asTTle and how it fits in to the National Assessment Strategy

• Purpose of the asTTle tools

• How can asTTle help teaching and learning?

• Effective use of asTTle in your classroom and school

• Reports and what they tell us

For assistance in installing asTTle and creating tests, go to

http://www.tki.org.nz/r/asttle/index_e.php

and download the pdf file The Beginner’s Guide to Installing

asTTle and Creating Tests

What’s in this presentation?

Goals of the National Assessment Strategy

The National Assessment Strategy focuses on:

• setting specific and challenging goals with students

• fostering partnerships in learning

• using information to improve learning

• developing high-quality assessment tools

• developing teachers’ assessment literacy

• informing strategic planning

National Assessment Strategy

High-quality assessment tools

asTTle is one of a portfolio of assessment tools available or becoming available to schools nationally.

The following two slides provide an overview of these tools and the levels at which they are used.

Level 1 Level 2 Level 3 Level 4 Level 5

Yr 1 Yr 2 Yr 3 Yr 4 Yr 5 Yr 6 Yr 7 Yr 8 Yr 9 Yr 10

EXEMPLARSIn all Essential Learning Areas

English and Māori.

SEA / 6 Yr Net

ARBs (Assessment Resource Banks) English, Mathematics, and Science

NEMP

The National Education Monitoring Project

asTTle Version 2Assessment Tools for Teaching and Learning

Initially designed for monitoring achievement for years 5, 6, and 7 in Literacy and Numeracy (English and Te Reo)

PAT (Progressive Achievement Tests)

STAR ( Supplementary Test of Achievement in Reading)

Reading Running Records

Numeracy and Literacy Projects

National assessment tools

National assessment tools

The purpose of the asTTle tool

• The main purpose of asTTle is to provide teacher-managed, curriculum-based analysed assessment information for the purpose of improving the quality of teaching and learning.

• Along with other assessment tools asTTle provides externally referenced assessment information to assist teachers in making valid, reliable, and nationally consistent judgments about the work and progress of their students.

The purpose of the asTTle toolAt classroom level asTTle enables teachers to:

• diagnose how their students are performing

• give their students focused feedback

• help students set learning goals

• develop and modify their classroom programmes

At school level information may be aggregated and used to evaluate teaching programmes and inform strategic planning.

Getting started?If you need assistance in getting started with asTTle, go to http://www.tki.org.nz/r/asttle/index_e.php

and download the pdf file The Beginners Guide to Installing asTTle and Creating Tests.

For assistance in reading and interpreting reports move on to the next slide.

Using asTTle data

Reports and what they tell us.

asTTle reports• When you have created and administered a test,

marked it and entered the data, you can view reports that show:

– curriculum levels (aka the skylines)

– individual learning pathways

– group learning pathways

– the console

– What Next profile

• The first three report types are directly useful to the classroom teacher as they give information about individual students and the class as a whole.

• The console allows for nationally-referenced comparisons with similar groups of students.

• The What Next profile provides useful guidance as to next teaching steps.

Curriculum levels This is the “skyline” - it shows you graphically the spread of your class over the curriculum levels.

For reading, the curriculum functions you have tested are shown along with three curriculum processes.

For writing the “skyline” shows the seven elements the writing is marked on.

Within each curriculum level there are three categories of ability to provide you with more precise information - these are basic, proficient, and advanced.

Curriculum levelsClicking on a graph will take you directly to a table which shows which students are at each level.

This report allows you to (a) group students appropriately and (b) monitor that students are moving up levels throughout the year.

Individual learning pathways – reading/mathematics

These reports are for individual students so that you can plan for their specific needs. Each item in the test is placed in one of four quadrants.

Console information for individual students gives scores and levels for: the content areas tested overall, and surface and deep thinking, along with the national mean for their year group.

The asTTle Reading scale (aRs) - this is your student’s overall mean score (shown by the red oval) compared to the national mean score (shown by the coloured bar).

Individual learning pathways –

reading/mathematics, contd.

The placement of the items in the four quadrants relates to the student’s level. ‘Hard’ items are those that would be difficult for this student, likewise ‘easy’ items are those that we would expect the student to get right – they are easy for this student.

‘Hard’ questions that the student got right

‘Easy’ questions that the student got right

‘Hard’ questions that the student got wrong

‘Easy’ questions

the student got wrong

aRs

Individual Learning Pathways - Implications for Teaching

Strengths Take advantage by giving the student more work of

this kind at this level

To be Achieved

Plan to teach these objectives at this level within the next term

Gaps

Investigate causes but do NOT ‘skill & drill’ teach these

objectives because the student will learn them quickly, as they

are easy

Achieved

Stop teaching this type of material at this level to this

student

Group learning pathways

Gaps are shown as pink

To be achieved as yellow

Achieved as green

Strengths as blue

In this report, the bar indicates the proportion of students in the group for whom the achievement objective was a gap, to be achieved, achieved or a strength.

A predominance of red and yellow is an indicator that the class as a whole needs to be taught that achievement objective

The green and blue indicates AOs that the class has largely achieved and does not need to be re-taught

The console

The console gives you information relating to the achievement of all or particular groups of your students compared to nationally-referenced performance.

The console in sections –

the top

The interaction effects you have chosen General test

information

For a multi level class you can select one, two, or three year levels.

The default selection is for the year group with the most students in it and “all” for every other category.

The Reading Console

The console in sections – the sides

Information relating to the three content areas you have focussed your test on. Your class mean is compared to the national mean for the groups you have selected

(For writing this would show all seven marking elements)

Note: Differences of more than 15 points (the standard error of measurement) are significant for teaching and learning

The national mean for the given year is written under each dial

Your class mean is shown by the arrow on the dial

The console in sections –

the middle 1 This shows the level of cognitive processing by your students in the test. Both their surface thinking and their deep thinking is compared against the national mean for the comparison groups you chose.

Surface thinking is their ability to use one or unconnected lists of facts, information, or ideas to answer questions.

Deep thinking is their ability to relate the facts, ideas, or information to each other and to hypothesise about them in a more abstract manner.

Your class mean (+/- 1 SEM) is shown by the red ovals.

The national mean is shown by the height of the coloured bars.

The console in sections –

the middle 2 This compares the total mean score for your class with the national mean score for reading, writing, or maths, based on the interaction effects you have chosen.

The score is calculated using the difficulty of the questions that your students got right.

The mean for your class is shown by the red circle - remember this is the average not the range and students will be outside this circle.

The national mean is shown by the height of the coloured bar.

If you have chosen more than one year level in your class you will get a reading scale for each one.

The console in sections –

the bottom Your selected students’ mean - remember some students will be outside the red circle.

The national mean for all students is shown by the green bar.

This shows the attitude your selected students have to the content that was tested on a scale shown by the smiley (or not) faces.

Note when this is scored 4 = love it and 1 = hate it.

Remember that, while attitude does not predict achievement, it is still an important facet of children’s learning

What Next profile

This shows you the mean level your class is achieving at in the curriculum functions that were tested; and guides you to the next level.

Your class average level

A hyper link to a resource bank which contains appropriate lesson material for each of the levels used in asTTle (you need to be logged on to the Internet).

Individual learning pathways – writing

asTTle Writing scale score for writing

The individual console shows scores and levels on the literacy scale, for surface and deep thinking, and the seven marking elements.

For writing it is the 7 marking elements that are placed in quadrants.

Individual learning pathways – writing

Where a marking element is placed is determined by comparing the level achieved for each marking element with the overall level of the individual student on the asTTle Writing scale.

Strengths Elements scored at more than one level higher than the student’s overall mean level for the writing

AchievedElements scored at one level either side of the student’s mean level, or at the mean level

GapsElements scored at more than one level lower than the mean level

What Next profile pathways – writing

This shows you what level most of your class are achieving at in the writing purpose you tested.

Your class average level in that purpose

A hyper link to a resource bank that contains appropriate lesson material for the level your class is at and needs to move onto. (You will need to be logged on to the Internet to access this.)