th national stakeholders conferenceneas.gov.pk/siteimage/downloads/neas nat presentation... ·...
TRANSCRIPT
![Page 1: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/1.jpg)
5th NATIONAL
STAKEHOLDERS
CONFERENCE
Dissemination of
National Achievement Test (NAT)
Findings 2016-17
National Education Assessment System
Ministry of Federal
Education & Professional
Training Islamabad
(Pakistan)
January 24, 2018
![Page 2: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/2.jpg)
NAT 2016 – Today’s presentation contents
NAT-2016 at a glance
Grade 4 - Key highlights
Grade 8 - Key highlights
Physical facilities vs Student score
Research questions
HLM analysis findings at school & student level
Way forward.
………………………………….
Short briefing on TIMSS study
Short briefing on UNESCO ‘Participation study’
![Page 3: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/3.jpg)
NAT 2016 at a glance – Grades & sample size
Assessment Grades: 4 and 8
PPS sample : 30,000 students
No. of schools planned: 1500 (20 students per school)
Subjects assessed:
Grade 4: Mathematics, Urdu reading & Urdu Writing
Grade 8: Science, English Reading & English Writing
Test language: Urdu, Sindhi and English
Schools covered: Public, Private, NCHD, BECS & Community model schools
![Page 4: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/4.jpg)
NAT 2016 –Highlights - Assessment instruments
1. Standardised test (2 booklet ‘A & B’ in each subject)
2. Background questionnaires:
a) Students and their parents
b) Subject teachers (Mathematics, Science, Urdu/Sindhi, English)
c) Head teacher
3. Test administrator manual
4. Provision of stationary items for 30,000 sample students
![Page 5: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/5.jpg)
NAT 2016 – Highlights - Stationary items
Stationary items with NEAS logo: Clip board, one pouch
containing: ballpoint, pencil, eraser, sharpener, scale, protractor
![Page 6: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/6.jpg)
NAT 2016 at a glance – Grade 4 sample
Source: NEMIS data base 2015
750 750100.00
15000
13197
87.980
2000
4000
6000
8000
10000
12000
14000
16000
Planned No. Response No. % Response
Schools Students
![Page 7: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/7.jpg)
NAT 2016 at a glance – Grade 8 sample
750 74999.87
1500014287
95.250
2000
4000
6000
8000
10000
12000
14000
16000
Planned No. Response No. % Response
Schools Students
![Page 8: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/8.jpg)
NAT 2016 at a glance – District covered
Source: NEMIS data base 2015
155
10
31
13 101
2536
29
139
90
10 20 13 7 124
3529
142
92
10
24
11 81
23
3629
0
20
40
60
80
100
120
140
160
180
Total District/Regions District Covered Grade 4 District Covered Grade 8
Province/ Regions Total District/RegionsDistrict Covered
Grade 4 Grade 8
National 155 139 142
% Response 100% 90 % 92%
AJK 10 10 10
Balochistan 31 20 24
FATA 13 13 11
G.B 10 7 8
ICT 1 1 1
KPK 25 24 23
Punjab 36 35 36
Sindh 29 29 29
![Page 9: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/9.jpg)
NAT 2016 at a glance – Characteristics
Assessed Grade 4 & 8 students before annual examination;
Winter and summer zones students were assessed separately;
New questions included in BGQs like nutrition, SES, health;
Policy questions were framed according to international standard
and shared with provinces/areas before NAT 2016;
National Steering Committee constituted under Chairmanship of
Federal Secretary, M/o FE&PT; and,
Conducted without the financial and technical assistance of the
international partners.
![Page 10: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/10.jpg)
NAT 2016 at a glance –Partner institutions
Punjab Examination Commission (PEC) Lahore Punjab;
Balochistan Examination & Assessment Commission
(BEAC), Quetta;
Provincial Education Assessment Centre (PEACE)
Jamshoro Sindh;
Provincial Education Assessment Centre (PEACE)
Abbottabad, Khyber Pakhtunkhwa;
Kashmir Education Assessment Centre (KEACE),
Muzaffarabad AJK;
G.B Education Assessment Centre Gilgit; and,
FATA Education Assessment Centre Peshawar.
![Page 11: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/11.jpg)
NAT 2016 at a glance – Services utilised
For Printing of assessment tools: Printing Corporation of
Pakistan (PCP), Islamabad
Sending & receiving assessment bags: Pakistan Post Office
(PPO) Islamabad
For data entry: National Institute of Psychology (NIP)
Quaid -e- Azam University for 125,000 tools
NEAS 5 Experts Trained120 LMTS at national level
Trained 3300 Test Administrators (TAs) at provincial
level Assessed 27484 students + 27484 parents +
1499 Head Teaches + 6000 Teachers at school level
110 monitors deputed by M/o FEPT and provinces/regions
![Page 12: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/12.jpg)
NAT 2016 at a glance – Software used for analysis
1. Microsoft Excel
2. SPSS Statistical Package for the Social Sciences
3. ConQuest (Generalised Item Response Modelling-IRT analysis)
4. HLM (Hierarchical linear modelling)
5. AM (AM is a statistical software package for analysing data from
complex)
6. Iteman (provide detailed item and test analysis reports using
classical test theory (CTT)
7. StatPlanet for visualization
![Page 13: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/13.jpg)
Grade 4 - Key highlights
(i) Mathematics (ii) Urdu Reading (iii) Urdu Writing
![Page 14: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/14.jpg)
Understanding NEAS scale (mean 500)
Mean
Scale
0 100 200 300 400 500 600 700 800 900 1000
-500 -400 -300 -200 -100 0 +100 +200 +300 +400 +500
Standard Deviation
The scale used in NEAS is the same as in TIMSS, PISA, SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries. The range of scaled scores is between 0-1000.
The achievement scales are constructed so that a student achieving 50% correct marks receives a scaled score of 500 and the Standard Deviation of the scale is set at 100.
![Page 15: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/15.jpg)
Grade 4 – Maths score by nation & regions (mean = 500)
462
459
465
469
479
491
500
548
484
400 420 440 460 480 500 520 540 560
AJK
GB
KPK
FATA
Balochistan
ICT
Sindh
Punjab
National Score
Mathematics Score
Score
![Page 16: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/16.jpg)
Grade 4 – Urdu result by nation & regions (mean = 500 & combined mean = 1000)
464 469 452 473 485 492 513 536 485
431 453 475 478 490 525 514 543489
895 922 927 951 9751,016 1,027
1,079
974
0
200
400
600
800
1,000
1,200
Urdu Reading, Writing & Combined Score
Urdu Reading Urdu Writing Combined Score
![Page 17: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/17.jpg)
17
481
493
497
502
508
523
Grade 4 – Subject results by gender (mean 500)
![Page 18: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/18.jpg)
18
518
489
494
511
508
495
Grade 4 – Subject results by location (mean 500)
![Page 19: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/19.jpg)
Winter Zone
Summer Zone
19
510
453
462
508 508
463
Grade 4 – Subject results by school zone (mean 500)
![Page 20: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/20.jpg)
20
519
515
471
489
504
508 507
501
490
Grade 4 – Subject results by administrative gender (mean 500)
![Page 21: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/21.jpg)
21
511
508
487
483
511511
514
499
482
Grade 4 – Subject results by medium of instruction (mean 500)
![Page 22: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/22.jpg)
22
547
521
519
484
493
506
510
527
537
514
509
490
Grade 4 – Subject results by school level (mean 500)
![Page 23: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/23.jpg)
23
553
508
496
472
494
499
503
511 511
499
491
448
Grade 4 – Subject results by school type (mean 500)
![Page 24: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/24.jpg)
Student score
Teacher score
24
489 485 484
Grade 4 – Subject results teachers & students (mean 500)
![Page 25: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/25.jpg)
Each 'X'
represents 27
students
Items which were below
average difficulty
Item which were above
average difficulty
0
Item-Person Map: Grade 4 Math
![Page 26: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/26.jpg)
Each 'X'
represents 27
students
Items which were below
average difficulty
Item which were above
average difficulty
0
Item-Person Map: Grade 4 Math
26
![Page 27: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/27.jpg)
Grade 4 – Mathematics (mean = 500)
China
Iran
Arabian sea
![Page 28: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/28.jpg)
Grade 4 - Urdu/Sindhi – Reading (mean = 500)
China
Iran
Arabian sea
![Page 29: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/29.jpg)
Grade 4 - Urdu/Sindhi – Writing (mean = 500)
China
Iran
Arabian sea
![Page 30: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/30.jpg)
Grade 4 – Combined Score (mean = 1500)
China
Iran
Arabian sea
![Page 31: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/31.jpg)
Mathematics score
Writing s
core
Grade 4 – Maths vs Writing Score (mean 500)
Average in writing but very low in maths
Very high in maths but very low in writing
![Page 32: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/32.jpg)
NAT 2016 Grade 8 – Subject results Grade 8 – Key highlights(i) Science (ii) English Reading (iii) English Writing
![Page 33: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/33.jpg)
Grade 8 – Science result by national & region (Mean=500)
439
452
463
473
474
476
477
566
478
0 100 200 300 400 500 600
AJK
GB
KPK
Sindh
ICT
Balochistan
FATA
Punjab
National Score
Science Score
![Page 34: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/34.jpg)
Grade 8 –English result by nation & region (mean=500
& combined mean = 1000)
459 464 466 496 466 475 521 555 488
448 454 461 473518 512
557 549496
907 918 927969 985 986
1,078 1,104
984
0
200
400
600
800
1,000
1,200English Reading, Writing & Combined Score
English Reading English Writing Combined Score
![Page 35: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/35.jpg)
35
488
520
526
484
492
512
Grade 8 – Subject results by gender (mean 500)
![Page 36: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/36.jpg)
36
488
519
484
495
506
515
Grade 8 – Subject results by location (mean 500)
![Page 37: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/37.jpg)
Winter zone
Summer zone
37
471
505505
467465
506
Grade 8 – Subject results by school zone (mean 500)
![Page 38: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/38.jpg)
Urdu
English
Sindhi
38
463
494
519
533
486
453
477
502
504
Grade 8 – Subject results by medium of instruction (mean 500)
![Page 39: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/39.jpg)
Grade 8 – Subject results by level of school
39494
500
540
579
632
535
499497495
500
527528
![Page 40: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/40.jpg)
40
495
556
493
498
519
541
Grade 8 – Subject results by type of school (mean=500)
![Page 41: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/41.jpg)
Student score
Teacher score
41
488
620621
496478
661
Grade 8 – Subject results teachers & students (mean 500)
![Page 42: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/42.jpg)
Each 'X'
represents 24
students
Items which were below
average difficulty
Item which were above
average difficulty
0
Item-Person Map: Grade 8 Science
![Page 43: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/43.jpg)
Each 'X'
represents 27
students
Items which were below
average difficulty
Item which were above
average difficulty
0
Item-Person Map: Grade 8 Science
43
![Page 44: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/44.jpg)
Grade 8 – Science (mean = 500)
China
Iran
Arabian sea
![Page 45: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/45.jpg)
Grade 8 – English Reading (mean = 500)
China
Iran
Arabian sea
![Page 46: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/46.jpg)
Grade 8 – English Writing (mean = 500)
China
Iran
Arabian sea
![Page 47: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/47.jpg)
Grade 8 – Combined (mean = 500)
China
Iran
Arabian sea
![Page 48: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/48.jpg)
NAT 2016 Grade 8 – Subject results Physical facilities Vs students score
![Page 49: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/49.jpg)
Grade 4 - Combined score vs school facilities
![Page 50: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/50.jpg)
Grade 4 – School facilities composite index
China
Iran
Arabian sea
![Page 51: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/51.jpg)
Grade 8 - Combined score vs School facilities
![Page 52: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/52.jpg)
Grade 8 – School facilities composite index
China
Iran
Arabian sea
![Page 53: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/53.jpg)
Average percentage of school facilities
3136 36
4245 48
57
64
48%45% 46% 48%
51% 49%
58%
67%
0
10
20
30
40
50
60
70
80
Grade 4 Grade 8
![Page 54: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/54.jpg)
Research questions & HLM analysis findings
![Page 55: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/55.jpg)
Research questions
At Student level – Level -1
1. To what extent are student characteristics associated with Grade 4 and
Grade 8 learning achievement in Pakistan?
2. To what extent are instructional support factors associated with Grade 4
and Grade 8 students learning achievement in Pakistan?
3. To what extent are student family SES associated with Grade 4 and
Grade 8 student learning achievement in Pakistan?
At School level –Level -2
4. To what extent are teacher characteristics and instruction-related
(classroom environment) factors associated with Grade 4 and Grade 8
student learning achievement in Pakistan?
5. To what extent are head teacher characteristics and school-related
(school environment) factors associated with Grade 4 and Grade 8
student learning achievement in Pakistan?
![Page 56: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/56.jpg)
Two-level hierarchical linear modeling for student achievement
Student Achievement
Student SES
Time Factor Student Characteristics
Home Environment
H/Teacher Characteristics
Teacher Characteristics
Management Factors
Classroom Environment
School Environment
Satisfaction
Factor
Learning Support
At school level -2
At student level-1
![Page 57: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/57.jpg)
Findings at school level
Hierarchical linear modelling (HLM)
![Page 58: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/58.jpg)
NAT 2016 – Urban-rural differences
Student attending school located in urban areas did better in all the subjects
.
As compared to the student attending schools located in rural areas.
![Page 59: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/59.jpg)
NAT 2016 – Students Absenteeism
Students in schools with less student absenteeism did better in all subjects
than those in schools where absenteeism is common among students.
![Page 60: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/60.jpg)
NAT 2016 – Experienced school leadership
Students of such schools which have head teachers with higher years of experience performed better
Than students in schools with head teachers with fewer years of experience.
![Page 61: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/61.jpg)
NAT 2016 – Student involvement in co-curricular
activitiesStudents in schools taking part in
co-curricular activities significantly better
Than those students who have
not in taking part in co-curricular activities.
![Page 62: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/62.jpg)
NAT 2016 – Course completion by teachers
Students who reported that they
had completed all of the course
book did better
As compared to those students who
said they had not completed the
course book.
![Page 63: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/63.jpg)
NAT 2016 – Use of local language in classroom teaching
Students scored worse when
teachers used local language as
medium of instruction/teaching at
grade 8 level
As compared to those whose
teachers did not use local
language.
![Page 64: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/64.jpg)
NAT 2016 – School with boundary wall
Students in schools with boundary
wall did better in all the subjects
than their counterparts in schools with
non-functional wall or without
boundary wall.
![Page 65: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/65.jpg)
Findings at student level
Hierarchical linear modelling (HLM)
![Page 66: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/66.jpg)
NAT 2016 – Student age factor
Younger students performed better in all subjects
As compared to older students of the class.
![Page 67: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/67.jpg)
NAT 2016 – Books at home
Students who had books for use at home did better in all subjects
As compared to those who had no such books at home.
![Page 68: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/68.jpg)
NAT 2016 – Getting homework
Students in schools where
teachers were given homework
frequently, scored better
As compared to those who were
not given homework frequently
![Page 69: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/69.jpg)
NAT 2016 – Checking homework by the teacher
Student who had their homework
checked by their teachers more
frequently did better in all the
subjects
As compared to those who had
homework rarely or never checked
by their teachers.
![Page 70: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/70.jpg)
NAT 2016 – Feedback (correction) on homework
Students in schools where homework mistakes were pointed out by teachers scored better
As compared to those schools where such facility was not provided.
![Page 71: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/71.jpg)
NAT 2016 – Home possession
Students from homes with more home
possession items (i.e. calculator,
computer, internet, dictionary, radio,
mobile phone and landline phone) did
significantly better in all subjects,
When compared to student from homes with fewer home possession items.
![Page 72: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/72.jpg)
NAT 2016 – Educated parents
Students whose parents were
highly educated did better in all
the subjects
As compared to their counterparts whose parents were less or not educated.
![Page 73: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/73.jpg)
NAT 2016 – Paid tuition
Students who did not take paid
tuition performed significantly better
As compared to those students
who took paid tuition.
![Page 74: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/74.jpg)
NAT 2016 – Helping parents
Student who said that household chores affected their school work did worse in all Students
As compared to their counterparts
who said they were not involved
in household work.
![Page 75: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/75.jpg)
NAT 2016 – Distance travel to school
Students with less travel distance to
school outperformed their
counterparts
Who travelled long distances to
school.
![Page 76: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/76.jpg)
Way forward
![Page 77: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/77.jpg)
# Description – Expenditure on Rs. In Million
1 Printing cost of assessment tools through PCPP. 4.505
2 Training of 120 Lead Master Trainers. 4.050
3 Stationary for 33,000 students 2.5
4 4.1 Test Administration Training in Provinces 4.2 Conduct of Test Administration in 1500 schools. 3.3 Monitoring of NAT
12.781
5 Total Expenditure 23.836
6 Expenditure paid till date. 19.358
7 Pending claims of provinces / areas assessment centers 4.478
8 Per student cost = Rs.722.00
NAT 2016 - Expenditure
![Page 78: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/78.jpg)
Conceptual framework model: Factors influencing
student learning achievement
Outside School Factors
1.0 SUPPORTING INPUTS
1.1 Strong parent and
community support
1.2 Effective support from the
education system
1.3 Adequate material support
1.3.1 Frequent and
appropriate teacher
development activities
1.3.2 Sufficient textbooks and
other resource materials
1.3.3 Adequate physical
facilities
CHILDREN’S
CHARACTERISTICS
3.0 SCHOOL CLIMATE
3.1 High expectations of
students
3.2 Positive teacher attitudes
3.3 Oder and discipline
3.4 Organised curriculum
3.5 Rewards and Incentives
Outside School Factors
2.0 ENABLING CONDITIONS
2.1 Effective leadership
2.2 A capable teaching force
2.3 Flexibility and autonomy
2.4 High amount of time-in-
school
5.0 STUDENTS
OUTCOMES
5.1 Student participation
(attendance,
promotion,
graduation,
continuation)
5.2 Academic
achievement
5.3 Social skills
5.4 Economic success
after school
4.0 TEACHING/LEARNING PROCESS
4.1 High amount of learning time
4.2 Variety in teaching strategies
4.3 Frequent homework , checking and
feedback
4.4 Frequent formative assessment and
feedback
Contextual Factors
Socio-Cultural
Socio- Economic
Political
![Page 79: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/79.jpg)
Way forward
Constitution of National/Provincial Task Force for implementation &
monitoring of NEAS findings;
Clear guidelines as medium of instruction in schools before TIMSS
assessment;
Conducting National / Provincial / Area level seminars for awareness
purposes for sharing the NAT 2016 findings accurately;
Conducting regional levels studies in districts where interesting findings are
noticed;
Alignment of Assessment Studies at National and Provincial level;
(Cont…)
79
![Page 80: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/80.jpg)
Way forward
80
Consultation process with provinces to ensure the correct
transformation of National Curriculum SLO’s into new Text Book
contents;
Inclusion of agenda point in forthcoming IPEMC regarding TIMSS
For sustainability purposes the Restructuring of NEAS is important
immediately; and,
Rationalization of NEAS HR and technical capacity.
![Page 81: th NATIONAL STAKEHOLDERS CONFERENCEneas.gov.pk/SiteImage/Downloads/NEAS NAT Presentation... · 2020. 1. 20. · SACMEQ, TOEFL, Vietnam, LOAS and many other develop & developing countries](https://reader033.vdocuments.us/reader033/viewer/2022052812/608f1ac937766741277c961c/html5/thumbnails/81.jpg)
www.neas.gov.pk
www.facebook.com/neaspakistan
Thank you for your patience