thinkspace.csu.edu.authinkspace.csu.edu.au/alts/files/2017/08/2017-08-16...re… · web...

ALTS DASHBOARDS AND REPORTS, LEARNING TECHNOLOGIES UNIT, DLT 16 AUGUST 2017CONTACT IAN HOLDER/STEWART MCKINNEY/DR CASS COLVIN (FROM 31 AUGUST)

FOR MORE INFORMATION SEE HTTPS://WWW.CSU.EDU.AU/DIVISION/LEARNING-AND-TEACHING/HOME/ANALYTICS-AND-EVALUATIONS

AS THE DASHBOARDS AND REPORTS ARE CONSTANTLY GROWING!

DASHBOARDS

Heads of School, Executive Faculty

SES Dashboard

This dashboard allow staff to investigate SES results and compare them over sessions, as well as reporting on subjects meeting and not meeting benchmarks. Dashboards also exist for Workplace Learning SES results, Study Link subjects and Study Centre subjects.

https://www.csu.edu.au/division/learning-and-teaching/home/analytics-and-evaluations


EASTS Dashboard

This dashboard allow staff to see EASTS assignment return times for online and internal subjects, and compare them over sessions.


MSI Dashboard

This dashboard allow staff to see MSI on-time results over sessions and for a selected session.


DLT SRS Dashboard

This dashboard allow staff to see the number and type of DLT SRS requests raised and resolved by month. Separate dashboards exist for Heads of School and Faculty Executives.


Course Directors

Draft Course Director’s SES Dashboard

Currently being tested by the Course Directors, this dashboard allow course directors to compare the SES results of the overall cohort against their course cohort.


Educational Designers

ED Dashboard

Provides various analytics on the design of and student engagement with i2 sites.


uImagine Online Learning Model Staff

OLM Dashboard

Provide detailed analytics on the student engagement with i2 sites.


Lecturers in Learning and Teaching (FoA&E)

LLT Dashboard

Similar to the OLM dashboard, this dashboard also provides detailed design analytics for the LLT dashboard in addition to student and staff engagement analytics.


Faculty Administration Officers

Faculty Administration Officer Dashboard

Provides information on the use, or lack of use, of i2 Course sites.


Manager, Career Development, Division of Student Services

Jobs and Opportunities Dashboard

Provides information on the use of the Jobs and Opportunities site, particularly after its refresh in February 2017.


All Staff

Learning Technologies Dashboard

Provides information on the use of the Jobs and Opportunities site, particularly after its refresh in February 2017.


SCHEDULED REPORTS

Heads of School, Executive Faculty

MSI Progress Report

Sent 32, 25, 18, 14, 7 and 0 days before session start.

Shows the current status of MSIs by Faculty and School in the lead-up to due date and session start.

Future plans include connecting direct to the MSI database and making this a live dashboard which can be run at any time instead.


Heads of School

EASTS Held Assignments Report

Sent each Monday of session.

Show EASTS Assignments Held for 9 or more working days, to assist staff in returning assignments on-time.

Plans are underway to make this a live dashboard which can be run at any time.


SYSTEM BUILT-IN REPORTS

The reports here are produced from systems we support.

Subject Coordinators

SES Results

These are automatically generated by the CoursEval system. We assist in downloading these as needed, and with interpreting the results.


i2 Grade Centre – Test / Survey Attempts Statistics

Provides statistics to determine how students answered each question in a test.


i2 Grade Centre – Test Item Analysis

Provides statistics to determine questions in a test that may be poor discriminators of students’ performance. Summary and detailed information is provided by question.


i2 Grade Centre – Survey Download

Provides an Excel download of responses to surveys.


i2 Grade Centre – Grade Centre Column Statistics

Provides overall statistics and distribution information for the student attempts made for a particular Grade Centre column.


i2 Grade Centre – Excel Report

Downloads a selection of (or all) Grade Centre columns to Excel, allowing analysis of results.


i2 Performance Dashboard

Shows a student’s last login date, the number of forums they have posted on and how many Retention Centre alerts they have triggered. Primarily used to determine students not logging on to i2 sites, or to easily find all discussion forum posts by a student.


i2 Retention Centre

Allows the creation of customisable rules to determine student engagement, or lack thereof. Allows emailing of students triggering these rules.

(The Students at Risk in the example below is greatly exaggerated due to a rule that needs to be changed)


i2 Site Analytics – Site at a Glance

Shows summary engagement statistics for the cohort via graphs, and for students individually as shown below.


i2 Site Analytics – Student at a Glance

Shows summary engagement statistics for a single student. Report was generated in Week 4…hence 0s for the rest of the weeks.


i2 Site Analytics – Site Access and Grade Scatter Plot

Shows a scatterplot of site accesses vs grade centre mark (usually Cumulative Mark). Can be useful for determining students who are putting a lot of effort in but are not achieving high grades, or students not accessing the site often enough.


i2 Site Analytics – Activity and Grade Matrix

Places students into quartiles by activity and grade. Also shows engagement week-on-week by student. Report was generated in Week 4…hence blanks for the rest of the weeks.


BKSB

Provides a number of reports on module completions.


Smart Sparrow and Realize It

Provide a series of analytics on engagement information, module completion and student performance/engagement.


Heads of School

SES Results

These are automatically generated by the CoursEval system. Heads of School can see results for all subjects in their school.


SERVICES WE PROVIDE AND REPORTS WE PRODUCE

The information below details services we provide that result in us producing reports, or reports we produce on an as-needs basis to provide deeper analysis than is available in the reports shown previously.

All Staff

Surveys

We create, make live and analyse the results of surveys for various staff across the university, as well as surveys such as those under the Academic Compass Banner. Previous survey requesters include DFM, staff wishing to conduct WPL surveys and surveys on learning technologies.


The Pulse

LTU’s Infographic providing a picture on what is happening within CSU with regard to learning technologies and analytics, with the aim of our enhancing our knowledge, challenging our thinking and stimulating conversation about the use of technology/analytics in learning and teaching.


i2 Site Analytics

Access to the Pyramid BI tool and the analytics SQL Server Blackboard Analytics database allows us to provide custom reports to staff at various levels. Data extracted from the database, or the BI tool, is transferred to Excel for summary or visual reporting.


DVC-A

SES Results

Each session we produce a summary of SES results for the DVC-A, detailing the performance of the university overall and by school. Questions which have not achieved the benchmark are also included.


Subject Coordinators

i2 Site Analytics – Content Access Statistics

Shows, for each piece of trackable content, analytics on engagement with that content at the cohort and student level.

This report will once again be available under Site Analytics in the i2 sites for academics to run themselves once Blackboard fixes access issues; currently we manually remove content that is not tracked correctly manually before sending it on to staff.


SES Results for Academic Promotion

We currently put together Word documents detailing SES results for the Promotions Panel and the applicant for Academic Promotion.


SES Star Performers

For each session a list of subject coordinators whose subjects achieved exceptional results in the SES is collected and awards generated for them by ALTS and the DLT Administration Team.


Subject Coordinators / Faculty Staff / Staff Researching / Other Staff

SES Analytics

We provide customised reports on the SES reports to meet particular needs that are either not shown in the SES dashboard, or would require much manual work to collate: e.g. questions that improved responses, comparison of results with overall university results, etc.


EASTS Analytics

We provide detailed EASTS reports to meet particular needs; these reports originally come from the Banner DLT system which is looked after by the DLT Systems team. Schools have access to this and we may assist them to run a report or run reports as needed for them, for example, a list of EASTS submissions for an offering by student, or we may take a report and transform or graphically represent the data in Excel for them.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 150%

10%

20%

30%

40%

50%

60%

70%

80%

Days to Return EASTS Assignments


i2 Analytics

On an at-request basis, we provide detailed i2 analytics for staff which are not readily available through the i2 site. These may relate to discussion forum posts, engagement with blogs or journals, analytics on organisation sites or comparisons between offerings. These analytics are mainly accessed through the BI tool Pyramid which connects to the analytics data warehouse hosted by Blackboard.


Heads of School / Faculty Executive / QLT Leads / Academic Staff / ALTS

i2 Site Information / Analytics

We have direct access to the analytics database which allows us to run deeper queries to report on a single i2 site or i2 sites overall than the analytics BI tool allows. We are currently investigating what reporting we can do to meet KPI and other standards (e.g. site landing page ready at 14 days), as well as to determine issues (e.g. sites missing key Grade Centre columns) before they become problems.


ALTS

Analytics on i2 Analytics

We have access to reports showing subject coordinator use of the in-built i2 analytics report, enabling us to determine which reports are most popular and which schools and subjects are generating these reports. These inform our development of reports and services offered.

FOR MORE INFORMATION SEE HTTPS://WWW.CSU.EDU.AU/DIVISION/LEARNING-AND-TEACHING/HOME/ANALYTICS-AND-EVALUATIONS

AS THE DASHBOARDS AND REPORTS ARE CONSTANTLY GROWING!

https://www.csu.edu.au/division/learning-and-teaching/home/analytics-and-evaluations

thinkspace.csu.edu.authinkspace.csu.edu.au/alts/files/2017/08/2017-08-16...re… · web...

Documents