results of tsa 2005

Results of TSA 2005

A Report on the Basic Competencies of Students at the End of Key Stages 1 and 2 in

Chinese, English and Mathematics

2

Background to the TSA

• The 2000 report of the Education Commission sets out detailed proposals for two kinds of basic competency assessment:– Student Assessment– System Assessment (now renamed ‘Territory-wide System

Assessment’ (TSA))

• HKEAA commissioned to develop and administer both projects for EMB

3

Purposes of the TSA

• Provide the Government and schools with information on standards

• Monitor the effectiveness of policies• School improvement

4

Scope of TSA

• Chinese Language, English Language and Mathematics

• P3 in 2004• P3 and P6 in 2005• P3, P6 and S3 in 2006

5

Administration of the Assessment

• Written Assessments– 68,000 P3 students and 78,000 P6 students from

some 700 schools– Conducted over 2 days in July – Students randomly assigned

• Oral Assessment– 12 or 24 students randomly selected from each

school– Conducted over two days in May– Two oral assessors

6

Changes in 2005

• All written papers centrally marked by an external panel of experienced teachers

• One internal and one external assessors to assess oral language

7

Setting the Standards

P3 standards– Set in 2004 using expert panels and international

benchmarking

P6 standards– Set using expert panels to fine tune standards

established empirically with reference to P3 standards

8

Territory-wide P3 Results

Subject

Percent Achieving Basic Competency

2004 2005

Chinese Language(Listening, Reading & Writing)

82.7 84.7

English Language(Listening, Reading & Writing)

75.9 78.8

Mathematics 84.9 86.8

9


82.7

75.9

84.984.7

78.8

86.8

70727476788082848688

Chinese English Mathematics

2004 2005

10


SubjectPercent Achieving Basic

Competency

Chinese Language(Listening, Reading & Writing)

75.8

English Language(Listening, Reading & Writing)

70.5

Mathematics 83.0

11

P3 versus P6

82.775.9

84.975.8

70.5

83.0

0102030405060708090

Chinese English Mathematics

P3: 2004 P6: 2005

12

Absenteeism Rate

• A survey was conducted in August 2005 on absenteeism rates in primary schools by the HKEAA.

• The figures showed that the average daily absenteeism rate in the month of June was 1.5% but that the average absenteeism rate on the two days was 1.8%.

• A total of 58 schools were found to have absenteeism rates of 5% or more for P.3 written assessments, while 50 schools were found to have absenteeism rates of 5% or more for P.6 written assessments.

13

Absenteeism Rate

• Based on a worst-case scenario in which all absences over 1.5% were of students who would have failed to achieve basic competency

• The maximum distortion in the territory-wide estimates of the percent meeting the standard – around 0.3% for P.6 and around 0.6% for P.3.

14

Absenteeism Rate

• Schools with absenteeism rates of 5% or more may not truly reflect the percentages had they been in full attendance.

• Hence, these results are not recommended as the sole indicators for the development of learning and teaching programme.

15

Confidentiality

• EMB and HKEAA will maintain confidentiality of individual schools’ results at all times.

• School results are for school improvement purposes.

• Schools will be able to access their own results electronically via the internet, using confidentiality protocols.

Territory-wide System Assessment 2005

Release of Results

8 December 2005

TSA 2005 Results

Results are released in the form of three reports:

1. School Report – Summary of school data with percentages of students achieving Basic Competency, and the average percentages for each of the subject papers.

2. Item Analysis Report (sorted by Sub-paper) – detailed analysis of school percentages for each of the items, following the question paper sequence.

3. Item Analysis Report (sorted by Basic Competency) – detailed analysis of school percentages for each of the items, in sequence of Basic Competencies.

Note: Reports excluding SEN to be released in mid-January

TSA 2005 Results – New Initiative in 2005

Results are released on the TSA website through online access to “www.systemassessment.edu.hk”.

Schools can download the reports from the TSA website from 12 December 2005 to 31 January 2006.

TSA 2005 Results – Reports Security

Schools will receive a sealed envelope through registered mail with the new passwords to access the website and the reports.

1.Logon User Name

2.Logon Password

3.PDF Password for downloading reports

TSA 2005 Results – Reports Security

The PDF password, additional password on file level, provides greater security for the files.

Reminder to Schools – Please keep all the passwords in a safe and secure place..

TSA 2005 Results – Reports Download

• Select ‘Login’

TSA 2005 Results – Reports Download

• Input the Login Name and User Password

TSA 2005 Results – Reports Download Procedure

• Select Download Assessment Reports


• Select the Report to be downloaded


• Read through the Protocol from EMB …


• And then click the ‘I Accept’ before downloading the report


• Then the system prompts for the file level password

• Input the PDF Password and then click ‘OK’

• The report will then be displayed

TSA 2005 Results – Enquiries

Three ways for enquiries:

1. Schools not yet receiving a sealed envelope through registered mail on 13 December or later – call Administrative Team at 2325 0161.

2. Technical problems during download – Call our hotline at 2591 3099.

3. Questions on school data – Fill in the Recheck Request Form (on the website) and fax to 2591 0728.

TSA 2005 Report

• Details of the background to TSA, the development process, administration, marking and standards-setting

• Extensive competency-by-competency analyses of student performance in each subject, with exemplars

• Discussion of the way forward and proposed improvements for the future

Thank You

results of tsa 2005

Documents