kochandcoiimk

13
Manthan Stepping Stones: Enhancing the quality of Primary Education Team: Koch & Co IIM Kozhikode Shiksha Ka Parinaam – My Shiksha

Upload: citizens-for-accountable-governance

Post on 05-Jul-2015

121 views

Category:

Education


1 download

TRANSCRIPT

Page 1: KochandcoIIMK

Manthan

Stepping Stones: Enhancing the quality of Primary Education

Team: Koch & Co

IIM Kozhikode

Shiksha Ka Parinaam – My Shiksha

Page 2: KochandcoIIMK

Primary Education In India

150% is the avg attendance in any

class of primary school(4)

96% of all children are

enrolled in school(2)

Overall, govt. and parentshave ensured enrollment oftheir wards, now time is toturn the focus from inputs tooutputs

13% of country’s population

under 6yrs age(1)

We have to accommodate andensure quality education for160m students in our primaryschools over the next 5 years

83% of India has a primary

school in less than 1km dist (3)

The govt. has been reasonablysuccessful in ensuring easyaccess of schools in theneighborhood of all children

Attendance should be themain criteria to asses ifchildren are in school ratherthan considering enrollmentratio.

432

The following are possible reasons for low attendance of pupils:1. Poor Infrastructure2. Difficult curriculum3. Lack of learning material 4. Lack of teachers5. Poverty/Involvement in

income generation6. Nutrition / Child sickness

Alarming rate of drop in attendance in schools despite high enrollment ratio!

Page 3: KochandcoIIMK

Primary Education In India

30

40

50

60

70

80

Building Playground Girls' Toilets Library Drinking water

% o

f sc

ho

ols

wit

h f

acili

ties

Infrastructure improvement over the years

2010

2011

2012

Examining the various possible causes for dropping attendance

Reasonable improvement is being made in variousdomains of infrastructure development. The last leg is themost difficult and is said to take extra effort and funds.

38

40

42

36

37

38

39

40

41

42

43

44

2010 2011 2012

No

of

stu

den

ts p

er t

each

er

Year

Pupil-Teacher ratio

Reasonable teacher – student ratio. However theabsenteeism of teachers remains to be monitored.Currently, there is no proper system to record teacherattendance

Lack of learning outcome could be main reason of absenteeism of students from govt. schools

All pass policy does not ensure proper learning for students.On the contrary, students tend to be promoted withoutacquiring basic skill sets and eventually drop out.

Increasing age diversity of class could hinder thelearning outcome of students who attend govt.schools. This leads to variation in ability levels ofstudents in a particular class.

Fraction of those who could not read grade II text in that grade but moved to next grade

84%

87%87%

83

84

85

86

87

88

2010 2011 2012

% o

f sc

ho

ols

un

der

MD

M

Year

Mid day meal scheme

Mid day meal scheme has been rolled outextensively and been a major motivation forparents to send their wards to school.

Only 1 out of every 5 students has any print material to refer to at home.

Percentage of classrooms with students from more than one grade

The students are not provided with adequatelearning materials and as a result classroominteraction becomes the only option for learning.

On the whole, although there are sufficient efforts being taken to improve infrastructure and schooling, quality of education remains neglected. As a result there is no learning outcome.

Page 4: KochandcoIIMK

The test application will assess thestudents on mathematical andlanguage skills. The testing wouldcomprise of two components:

Objective evaluation – througha pre loaded test

Subjective evaluation – throughthe test facilitator

Web-enabled tablets foradministering the test.

Preloaded with an interactiveapplication that would bechildren friendly.

Native language audio support. The questions will be made

available from the server only atthe time of the test, to avoidmalpractices like priorpreparation by students andteachers

The test scores for each child will bestored in a central server that wouldmaintain a database of scores. Thiswould be updated every time thechild takes a test.

This would serve as a progressreport for performancemonitoring over the years.

The cumulative scores for aschool would be used fordetermining other factors

The tablets would be used as aninteractive teaching aid during theacademic year. It would helpsupplement the current pedagogywith:

Multimedia content Self- evaluation tools Customized input delivery

based on previous performance

Our Solution - ‘My Shiksha’ tool for measuring the learning outcome

Page 5: KochandcoIIMK

Design of the ‘My Shiksha’ Tool

Area Components

Mathematics Number, space, measurement and pattern

WritingIdeas, content knowledge, structure,style,

vocabulary, spelling, grammar

Reading Phonic , Fluency, comprehension

Communication Fluency, vocabulary,

To evaluate and quantify the level of primary education at a school,district and state level

To continuously monitor the improvement of student learningachievement year-wise throughout his/her primary education

To analyse variations in student performance by age, region,gender, location and language of instruction

To generate recommendations for policy making to improveeducational quality

Objectives of the assessment

Components of assessment

Mathematical Language

Grade IVocabulary of spatial relationship; identifies

numbers with physical objectsFollow simple instructions, identify

a person, singing rhymes

Grade IIIdentifies 2D and 3D shapes; Understands

place values and reads and writes numbers up to 99

Read and write simple phrases

Grade III

Draws 3D objects; counts in different ways, understands 3 – digit numbers

Read a story/poem

Grade IV

Multiplies two and three digit numbers; Draws intuitively the plan, elevation of

simple objects

Write a short description of a person/place/thing

Grade VUnderstands numbers beyond 1000;

explores symmetry in 2D and 3D objectsProper group activity role play and

dramatization

Overview of standards to be met by students in different grades

Examples of Psychographics/General Questions:

Do you like coming to school Do your parents support you in your

studies Do you face any inconvenience in the

classroom Do you understand what the teacher says

Pattern/Format of Assessment

Interactive audio/video questioning

Native language writing

Multiple and short answer

Activity based evaluation

Page 6: KochandcoIIMK

School accreditationThe cumulative test scores of individualclasses would be used to arrive upon anoverall score for the school. Based onthis, schools would be given a rating.The rating will help schools attractfunding and also good quality students.

0

5

10

15

20

25Mathematical

Writing skill

Reading skill

Speaking skill

SAMPLE OUTPUT FROM ‘MY SHIKSHA’ TEST

End term

Student level assessmentThe test score will help understand thestudent better. This can be used tocustomize some of the teachings forthe particular student. The assessmentwill also help monitor the progress ofthe student over the years.

Teacher performance assessmentThe cumulative test scores of a class ofstudents will be used to computeteacher efficiency scores. This can inturn be used to compute performancerelated bonuses.

Test output measurementEach student will be tested on his/herlevel of competency with respect to fourkey factors – Mathematical ability,Writing skills, Reading skills and Speakingskills and an extensive result sheet wouldbe available at the end of the testing.

Cu

rriculu

mTrain

ing n

eeds

Systemic ch

anges

Improvements to curriculum & pedagogy

Identify specific gaps in the current training (if any)

Helpful in formulating design changes to education system

Implications of Usage

Page 7: KochandcoIIMK

Solution efficacy – merits, sustainability & monitoring mechanisms

Merits:The proposed system for testing studentcapabilities has the following merits overthe currently available systems: Almost instantaneous results Scientific and objective evaluation Shall provide useful data for further

analytics to determine the levels ofvarious other factors that determinelearning outcomes

Student friendly testing experience Enables continuous progress

monitoring

Sustainability:Our system will be built on the latestavailable platforms of smart mobiledevices and would be upgradable as andwhen there are updates. The system shall consist of handheld

devices, a central server and a cloudbased platform

There shall be a uniform platform overwhich customizable modules can beadded on for easy roll out and delivery

The system entails just a one timeinvestment for the handheld devices,the software and the server afterwhich it is almost maintenance free

Monitoring mechanism:In order to maintain the integrity of thetesting process, the following checks shallbe in place: The test shall be based out of an

extensive pool of questions that wouldprevent malpractices by offering aunique test experience for eachstudent

The test difficulty level shall bemaintained uniform across thepopulation

The implementation agencies shall beNGOs and PPPs that would preventinfluences of the governmentmachinery

Page 8: KochandcoIIMK

Flow of work-PHASE 1-year March 2014-Feb 2015

Collect information from all states- school wisenumber of students, teachers, infrastructure, facilities

Identify an test development agency to designsoftware taking into account all the factors

Ministry of Education agrees upon the framework ofthe ‘My Shiksha’ toolkit and expected learningoutcome for each component for each grade.

Subject Specialists draft the blueprint andquestionnaires

These inputs given to the test development agencyand required format is mentioned (inaudio/video/online etc)

Flow of work-PHASE 2- 8 months (Apr 2015- Nov 2015)

Madhya Pradesh is chosen for the pilot run. It is divided into 5zones and a set of 10 (2 schools each) government schoolsare chosen for pilot run

Implementation agency is identified. These could be privatecompanies CSR units or NGOs willing to take up the same.Implementation agency conducts tests in these schools andrecords results. Appropriate training is given to theimplementation agency organizers.

The data is analyzed and the scores are compared to reflectwith the actual situation.

The meaning of each score is given by the test developmentagency and guidelines to the States are drafted accordingly bythe panel

Feedback (technical issues, comprehension, logistics etc) fromstudents, teachers, school administration andimplementation agency taken. This feedback is used to alterthe learning outcome tool kit before rolling it out in a largescale. The validation of the implementation budget isascertained and modified accordingly

The implementation of the toolkit throughoutall primary schools in Madhya Pradesh towardend of academic year (Jan-Mar)

Assessment of data results done by testdevelopment agency and submitted to theShiksha Parinaam Committee

Analysis is done at State level, District leveland School Level and appropriate steps aretaken at each level to improve the scores oflearning outcome before the onset of nextacademic year (May end)

Repeat the phase 2 steps region-wise to all states

Flow of work-PHASE 3- 5 months (Jan 2016-May 2016)

Flow of work-PHASE 4-1 year

Align different performance related funding andincentives at different levels with My Shiksha

Flow of work-PHASE 5 – Future Prospects

Roadmap for implementation

Phase 1&2 expenses: 5 croresand 15 lakhsPhase 3: 35 croresPhase 4: 838 crores

After that Year on YearExpenses: 100 crores

Page 9: KochandcoIIMK

1Shiksha Parinaam Committee

Test Development AgencyThe test development agencyis responsible to design thetests based on the inputs bythe panel. Different modulesfor each native language ismade.

2

A panel containing representatives fromthe Centre and one from each state +subject specialists gather to decide theinputs for the assessment and expectedlearning outcome gradewise.

States analyze the results obtained andtake decisions to improve itsperformance

3States Implementation Agency

The State appoints implementationagencies like NGOs or throughPublic Private Partnerships toconduct these assessments acrossall schools in all districts in the State

4

5

Schools

The various assessments areconducted in schools scores ofwhich are directly available withthe test development agency

The analysis report of thetests are generated by thetest development agency

6

7 The generated reports areused to identify the focalproblems that need to beaddressed on priority basis .

Shiksha Parinaam – method of working

(MHRD + State)+ Subject Specialists

Page 10: KochandcoIIMK

Union Minister of HRD

National ShikshaParinaam

Commissioner

State ShikshaParinaam

Comissioners

District Shikshaparinaam

commissioners

Village level supervisors/

School Principals

My Shiksha Tool Development and Analytics Agency

Implementation Agencies

Teachers

Students

Parents

Subject level experts

Shiksha Parinaam Committee

1 2 3 4 58

6 7

Responsibilities:• Monitoring the entire

program• Sanction of funds

1

Responsibilities:• Coordination with the

different state level SPCs• Setting of national level

standards to be achieved in conjunction with ShikshaParinaam Committee

• Awarding tender to My Shiksha tool development and analytics agency

• Periodic Monitoring functioning of state level Committees

• Coming up with recommendations for different levels of performance

2 Responsibilities: • Ensuring attainment of

national standards by coordination with district level SPCs

• Deciding Corrective course of action at the state level and funding required from center

• Coordination with National SPC to incorporate state level requirements into the testing tool

• Arranging for different Implementation agencies and the revenue models

3 Responsibilities:• Coordinating with Allotted

Implementation agencies • Promoting awareness and

benefits of the system to different stakeholders

• Ensuring coverage of all villages under the district

• Coordinating with village level supervisors to help with proper scheduling of test

4

Responsibilities:• Understand the current

standard of education in India

• Study the acceptable levels world over

• Come up with acceptable standards for the country to be achieved in the near future

• Continuously review status and modify standards

8

Responsibilities: • Develop the test based on

inputs given by ShikshaParinaam Committee

• Modify the test format and questionnaires after feedback from phase 2

• Provide Analysis of the collected data to the Committee every year

• Continuous improvement and modifications as per insights gained during implementation of the program

6

Responsibilities: • Proper coordination with

the state level Commissioner, District level and village level supervisors

• Timely execution of all tests

• Build up sufficient capacity to interact with all students, teachers and parents

7

Responsibilities: • Ensure coordination and

goodwill of all stakeholders• Test implementation at school• Ensure all students take the test

5

Stakeholders and responsibilities

Page 11: KochandcoIIMK

There can be demo session before the actual test toacquaint the students with its working

The test should be designed as user friendly aspossible simulating slate chalk conditions

Challenges and mitigation plan

1

• Students may find operation of the tablet during test conditions to be difficult

2

• Tablets have to be maintained properly without allowing for vandalisms and damage

5

• Training of volunteers of the implementation agency

The tablets could be maintained by a team ofvolunteers who are made responsible of visiting variousrural schools to record the learning outcomes students

4

• Identification of implementation agency maybe be difficult

In order to conduct the assessment in a transparentand efficient manner the state government will have tospecify criteria for selection

There should be proper mechanisms to validate thecredibility of the implementation agency

3

• Developing testing tools with different native language support may be a problem

The tool can be developed in a few languages that are morecommonly understood.

Employing appropriate language specialists and testing thelanguage aspect of the tool

Apart from written based test the assessment mayinvolve other aspects like viva voce/ activity based testsfor which proper training of the organizers is required

6

• Cooperation of school administration, teachers and students

School authorities and teachers must be made awareof the significance the assessment . In case of failure tooblige/ cooperate, there should be appropriate controlmechanisms to ensure against the same.

Based on the proactive participation of the schools,appropriate incentives can be given

7

• Cooperation of States to take up the assessment

Though the assessment is designed at the Centre Level(with inputs from each of the State representatives) toachieve a better learning outcome, it lies with the Stateto understand the implications of the same andimplement policies which will help achieve a greaterlearning outcome of primary school

8

• Understanding the analysis report of the assessment

Proper and easy guidelines which will help theconcerned authorities at State/District/School level tounderstand the results of the analysis report

Page 12: KochandcoIIMK

Appendix

S.No Item Price Quantity Total Expense

1 Implementing Agency Workers 225 10 days; 2 workers 4500

2 Tabs 1300 2 2600

3 Transportation Costs for implementing workers 300 10 3000

4 Software implementation 50000000 1 50000000

5 Conventions in Delhi and finalising of objectives 100000 10 1000000

6 Training of workers 20000 1 20000

7 Collection of database 500000 500000

51530100

Phase 1 & 2

S.No Item Price Quantity Total Expense

1 Implementing Agency Workers 225 110 days; 2000 workers 49500000

2 Tabs 1300 200000 260000000

3 Transportation Costs for implementing workers 300 95517 28655100

4 Software implementation 10000000 1 10000000

5 Conventions in Delhi review of objectives and performance100000 10 1000000

6 Training of workers 2000 2000 4000000

353155100

Phase 3

All India Phase 4

S.No Item Price Quantity Total Expense

1 Implementing Agency Workers 225 110 days; 56000 workers 135520000

2 Tabs 1300 200000 7280000000

3 Transportation Costs for implementing workers 300 95517 802342800

4 Software implementation 10000000 1 50000000

5 Conventions in Delhi review of objectives and performance 100000 10 1000000

6 Training of workers 2000 2000 112000000

8380862800 838 crores

Year on Year costs

1 Implementing Agency Workers 225 110 days; 56000 workers 135520000

3 Transportation Costs for implementing workers 300 95517 802342800

5 Conventions in Delhi review of objectives and performance 100000 10 1000000

938862800 100 crores

Page 13: KochandcoIIMK

References

1. http://www.teachforindia.org/about-us/india-education-crisis2. http://www.pratham.org/file/ASER-2012report.pdf3. http://www.firstpost.com/india/why-the-state-of-indias-primary-education-is-shocking-

598011.html4. http://www.indexmundi.com/india/demographics_profile.html5. http://forbesindia.com/article/briefing/primary-education-in-india-needs-a-fix/35287/16. http://www.ssa.mp.gov.in/educationalprofile.htm7. http://www.paycheck.in/main/salary/minimumwages/madhya-pradesh8. http://www.uis.unesco.org/Education/Documents/Ferrer.pdf9. http://siteresources.worldbank.org/EDUCATION/Resources/278200-

1099079877269/547664-1099079993288/assessing_national_achievement_level_Edu.pdf10. http://web.worldbank.org/WBSITE/EXTERNAL/TOPICS/EXTEDUCATION/0,,contentMDK:21911

176~menuPK:5495844~pagePK:148956~piPK:216618~theSitePK:282386,00.html