QILT Reporting Approach and

2015 SES progress

Quality Indicators for Learning and Teaching

Just before we get started…

• Who am I?

• How questions will be handled

• Resources available after the webinar

SES 2015 Preparations 2

Overview

1. QILT Reporting

1. Background

2. Reasons for change

3. Proposed approach

- 2014 UES Institution Report demonstration

4. Sector input

2. 2015 SES

1. Progress

2. Timelines

SES 2015 Preparations 3

QILT ReportingCase Study – UES/SES Reports

University Experience Survey 2012-2014

• National UES Report 2012-2014 https://education.gov.au/university-experience-survey Long and technical

• 2014 report - 95 pages

• Has attracted some criticism in the media– Too descriptive– Highly aggregated data

Intended Audience

• Institution Reports 2012-2014 Written component standard text with comparison table at scale

level plus analytical tables with scales broken down by demographic variables

SES 2015 Preparations 5

Reasons to change - Institution Report

• Increase in smaller institutions without SPSS or data analytics capability

• Institutional management in institutions often only looking at headline scale scores from current report(s) Less useful for continuous improvement purposes and targeted

strategies

• Very limited ability to benchmark or interrogate the data from the report Particularly for institutions not party to a data sharing agreement

SES 2015 Preparations 6

What are we proposing? Shorter National Report

• Focusing on performance indicators

• Broader audience

• Technical/methodological report separate More nuanced institutional reports with

benchmarks• Dashboard approach to allow quick and easy

internal reporting and basic data interrogation

• Cost neutral option for institutions

SES 2015 Preparations 7

• What will you get: Business as usual(ish) Institutional data files in current formats (SPSS & CSV) National data file (If you have signed up and applied through the

Department) National Report (and technical/methodological report) –

publically available from QILT Website The proposed new bit Institutional Report (Dashboard) with underlying de-identified

data file including agreed benchmark and demographic data

Deliverables

SES 2015 Preparations 8

• Using Tableau to report data Cost neutral to institutions if using the free Tableau Reader Reports will be distributed as packaged workbooks which can be

housed in a shared location or distributed to relevant staff in the organisation if required.

Institutions who have purchased a copy of the same version of Tableau Desktop would be able to customise the dashboards if required.

Tableau Reader can be used for:• Live presentations to relevant groups

• Export of images and tables for presentations and documents

• Crosstab downloads of relevant tables to MS Excel or Access for distribution to relevant groups.

Dashboard reporting

SES 2015 Preparations 9

Demonstration

UES Institutional Report

SES 2015 Preparations 10

• Approvals from the Department and QILT working group on reporting approach.

• If approved, these reports would be distributed to institutions once the National Data Files and Reports are released for distribution.

• If you have any thoughts or suggestions regarding these institutional reports please let us know.

Where to from here

SES 2015 Preparations 11

2015 Student Experience Survey

Progress and timelines

Take a bow!(You all deserve it)

2015 SES Progress - in a couple of words

SES 2015 Preparations 13

• With only a few days and one reminder to go … Nationally 128,328 completed surveys compared with 108,322 in

2014 Overall average response rate for the Universities of 33.5%

compared with 30.1% in 2014 (not that we focus on response rate – it’s all about the targets)

Almost all institutions have improved on their 2014 response rates and achievement of their targets

Our NUHEIs have achieved 35.7% overall Six institutions have already exceeded their overall study area

targets and 22 have achieved over 85%

2015 SES Progress

SES 2015 Preparations 14

• Online survey closes this weekend• Telephone follow up period for those who booked it• SRC follow up on coding or data queries with institutions

(Please get back to us quickly! The sooner you do the sooner we can finalise the files and the reports!)

• Institutional interim data files distributed (as per 2014)• Final reports distributed once they are released by the

Department

Where to from here?

SES 2015 Preparations 15

To summarise…

SES 2015 Preparations 16

Finally…

• Questions?

SES 2015 Preparations 17

Working with the QILT team

• We are always available to

answer questions (no matter how vague)

provide advice about research methodology or data collection

• If you have been liaising with a specific person, please contact them directly, otherwise, qilt@srcentre.com.au will always work.

SES 2015 Preparations 18