Outcomes from educational oversight

Rachael Gee, Assistant Director

Educational Oversight Conference24 November 2014

*provisional (some outcomes pending)

Total EO activity to date

Year TotalProviders

Drop out rate (%)

Providers reviewed

Pass rate (%)

2012 287 26 213 902013 236 8 216 972014 238 9 217 95*

Over 3 years, 135 providers have maintained a 100% pass rate at the first attempt

(99 REO; 15 RSEO; 27 ECREO)

Of all providers, 157 have passed all activity first time

Only 2 providers have had a full review every year (3 consecutive years)

Key findings from reviews

Good practice found in teaching and learning, and student support

Most recommendations around formalising and implementing more robust quality assurance processes

Room for improvement in ongoing quality monitoring and evaluation

Providers very responsive to student feedback but still developing student engagement in quality assurance, especially on committees

New overview report:

Findings from the first year of annual monitoring 2013

http://www.qaa.ac.uk/en/ReviewsAndReports/Pages/Educational-Oversight-.aspx

First monitoring visit findings

Commendable: fully implemented action plan, effectiveness evaluated and in many cases, additional actions carried out (27 per cent)

Acceptable: action plan mostly implemented; limited evidence of effectiveness (64 per cent)

Improvement required: lack of engagement with action plan or with the Quality Code (9 per cent)

First monitoring visit findings

Enhancements in learning and teaching:Teaching and learning strategy implementedExtensive use of guest speakers/ industry practitionersImprovement to or extension of learning resources

Other enhancements:More effective annual monitoring: continual improvementMore rigorous oversight of the integrity of assessmentStudents engaged in work of programme committeesBetter identification of and support for ‘students at risk’

First monitoring visit findings

Room for improvement:-More timely completion of actions-More evaluation of impact/effectiveness-Better engagement of students-More proactive than responsive QAE-More rigorous oversight of assessment-More scrupulous programme monitoring/review-Staff development in pedagogy/subject expertise-More thorough oversight of information

• 118 monitoring visits

EO activity 2014

Method Total Commendable

Acceptable Requires improvement

pending

REO 93 16 54 4 19

RSEO 8 5 3 - -

ECREO 17 10 4 - 3

39 providers did not require a visit20 REO; 13 ECREO; 6 RSEO

29 providers triggered a full review20 REO; 6 ECREO; 3 RSEO

• 56 Full reviews

EO activity 2014

Method Total Pass Near miss Fail pending

REO/HER+ 44 35 5 2 2

RSEO 3 3 - - -

ECREO 10 5 - - 5

Second monitoring visits

Enhancements to quality assurance processes:

regular academic discussion and review of programmes

Use of Quality Code to review and improve policies

Staff development in assessment procedures

Detailed and evaluative monitoring reports

improvements to student feedback questionnaires

maintenance of an institution-wide quality action plan

Second monitoring visits

Enhancements to learning and teaching:

greater use of technology-enhanced learningstaff research interests to inform their teachingpromotion of student research-led presentations improvements to the quality and availability of learning resourcesintroduction of peer observation and forums for sharing good teaching practiceincreased engagement with industry practitioners

Second monitoring visits

Enhancements to student support:

Improving understanding of good academic practiceUse of tutorials to support students’ academic study skills, language skills and academic progressCareers support, including feedback from recent graduatesUse of personal development plans to enable students to plan and monitor their own achievement

Second monitoring visits

Areas for improvement in quality assurance:Lack of effective marking and internal verificationPoor record keeping of student attendance and academic progressInaccuracies/inconsistencies in informationPoor oversight of academic standards and qualityLimited or no annual monitoring

Second monitoring visits

Areas for improvement in teaching and learning:Poor oversight of teaching qualityLittle or no consideration of student feedbackStudents have difficulty in accessing necessary learning resources

Annual monitoring in 2015

More of the same...

Plus a focus on the rigour of admissions and assessment

qaa.ac.uk

enquiries@qaa.ac.uk

+44 (0) 1452 557000

© The Quality Assurance Agency for Higher Education 2014

Registered charity numbers 1062746 and SC037786