End-of-Semester Module Review (EMR) Briefing to MCs

Office of Quality Assurance & Systems (OQS)

4 Feb 2012

Revised EMR Report Template(dated 5 Feb 2013)

As endorsed by PAC , the EMR Report template has been refined:  

Involve Senior Academic staff identified by their respective HOD to assist in the review & endorsement of EMR Reports (besides PCs & ADs Acad).

Schools/Centres may choose to tap on this provision to:•(i) develop the academic capabilities of their senior staff; and/or •(ii) spread out the review & endorsement workload.

 Removed the “Template for Student Assessment Results” (to be be

replaced by the BOE Module Chair (MC) Report.

Removed the removal of 3 Committee of Student Learning Abilities (CSLA) recommendations that will no longer be tracked in the EMR (refer to Appendix D for details).  

Microsoft Word 97 - 2003 Document

Initial Findings: CSLA 2009 Recommendations

CSLA 2009

3

P19 Students know

Learning Outcomes

P23 Ways to gauge learning pace &

understanding level during lesson

P25 Knowledge & skills

reflection questions

P24 Review UTs with students

P20 Sufficient quantity and quality

resources for problem

P62 Materials stretch better students

P21 Train & brief Facilitators before

lessonSTANDAR

D

PRACTICE

1-2 weeks after UT

Clicker Pop quiz Quick survey

Problem / curriculum review committee decide

Feedback from facilitators/students

Challenges Too complex or not

enough depth Insufficient copies in

library

Going further questions/activities in worksheet/materials

Attempted by 10-20% of students

Reminder Modules that have implemented changes in adopting

flexibility in teaching and learning as approved by PAC [Cross-ref:  PAC 04(12)] will be required to include another section, i.e., Section 2.5  “Implementation of flexibility in teaching and learning approach with approval by PAC”

  This is only applicable for modules that have implemented

such changes.  

2.5    Implementation of flexibility in teaching and learning approach with approval by PAC [Cross-ref:  PAC 04(12)]

 If the module has implemented PAC approved changes relating to flexibility in teaching and learning, please: •attach the relevant endorsed PAC paper as Appendix E;

•outline the key changes in the module;

•provide findings on the outcome of the implementation, including student and facilitator feedback, and other relevant findings;

•indicate any challenges or issues faced, if applicable. 

INCLUDE SECTION 2.5 ONLY IF APPLICABLE

End-of-Semester Module Review Process End-of-Semester Module Review Process

Module Delivery (Ongoing Monitoring & Evidence Gathering)

Module Delivery (Ongoing Monitoring & Evidence Gathering)

Module Review DeliberationsModule Review Deliberations

Review Findings and AnalysisReview Findings and Analysis

Baseline Evidences

Monitor Follow-upMonitor Follow-up

Process Flow Endorsement/ Approving Authorities

Closed by Programme Head/ AD (Acad)Closed by Programme Head/ AD (Acad)

Recommendations Recommendations

Follow-up Actions by next Module Coordinator

Follow-up Actions by next Module Coordinator

CET Module Review

Approval By Relevant Authority

Approval By Relevant Authority

Facilitator Feedback Student Feedback

Student Assessment Results

Facilitator Feedback Student Feedback

Student Assessment Results

Authorities for Approving Module ChangesAuthorities for Approving Module Changes

Approval by PC/ AD (Acad) Typically Minor Changes to Module Materials

Approval by HOD (as required) Change in Assessment Weightings Add/ Remove LOs(> 15%; serves as a guide for PCs/ AD Acad to trigger

discussion and approval by HOD)

Approval by PAC/ Senate (as required) Change in Module Name/ Module Synopsis Change in Assessment Mode Change in Delivery Mode

Pointers on Writing the Report

Outline:

General Comments

Findings and Analysis (Section 2)

Recommendations (Section 3)

Endorsement (Section 4)

Concluding Remarks

General Comments Focus on areas to improve module academic quality

rather than operational issues

Example: Avoid operational issues that do NOT directly address areas to improve module academic quality

General Comments As a general guide, keep main report to 4-5 pages

(excluding appendices)

It is a good practice to have a handover of the EMR Report from the current MC to the incoming MC

It should highlight areas for improvement and follow-up

Only essential and relevant information or evidences should be included in the document

The EMR Report should be properly signed off by the current MC and endorsed by the AD/PC/HOD

There should be no subsequent changes to the document after the report sign-off/approval

Section 2 : Findings and Analysis Avoid restating objectives and details of the Module

Comment on the changes made and what can be improved

Sub-headers may be useful for organising the issues

Findings and analysis should be balanced and corroborated across 3 baseline evidences Facilitator Feedback Student Feedback Student Assessment

Elaborate and analyze the baseline evidences instead of merely attaching them

Example from AY0910 Sem 2 C203

Use of sub-headings for clarity

Some Pointers/ Suggestions

Evidence-based review

Some Pointers/ Suggestions

Evidence-based review

Other Examples of Evidence-Based Review

Example:2.1 Module Design

Section 3: Recommendations

Address issues highlighted in Section 2

Follow-up to be completed by incoming programme coordinator

Avoid generic statements ego “Review the current problem statements and make

necessary changes”o “Check validity of weblinks”o “Re-craft UT questions”

State specific actions on how the module can be improved

2.2 Facilitation …Students sometimes find the lessons dry and mundane and would prefer more real life experiences shared and hands-on sessions/visits, to be more motivated. This should be taken into consideration in the next run…

2.4 Assessment

… it would be good to have a compulsory weightage in one of the UTs for practical assessment …

Address issues

raised in Section 2

Specific actions

Some Pointers/ Suggestions

Where rectification can be done immediately, this should be done before handing over to next MC

For example: “Problem 02: Inconsistent use of words –

“Chinese” vs “Mandarin”

Recommendations should be clear and actionable

Section 4: Endorsement

Endorsement Options

School/Centre storage

Acad QA Sharepoint

1 Sign using Tablet

Nil MS Word document (signed copy)

2 Sign hardcopy Signed hardcopy must be stored by School/Centre and retrieved as proof during audits

Upload MS Word document (Unsigned)*Indicate “Hardcopy signed and archived” as remarks

3 E-mail approval Signed hardcopy of email must be stored by School/ Centre and retrieved as proof during audits.

Upload MS Word document (Unsigned)*Indicate “Approval via email” as remarks

Correct

Example from AY0910 Sem 2 C203

Tan Ah Beng

Lim Ah Mui

Tan Ah Beng

Lim Ah MuiIncorrect

Incorrect