the university of sydneypage 1 nsw learning analytics working group meeting presented by kathryn...
TRANSCRIPT
The University of Sydney Page 1
NSW Learning Analytics Working Group Meeting
Presented byKathryn Bartimote-AufflickInstitute for Teaching and Learning, DVC(Education) Portfolio30 June 2015
Plenary discussion:Academic analytics versus learning analytics – Rivals or complementary strangers
The University of Sydney Page 2
iconarchive.com
In pairs
What’s your definition of…
Academic analytics?
Learning analytics?
Business intelligence?
Discuss, argue…
The University of Sydney Page 3
A taxonomy for analytics
Learning analytics (LA) & educational data mining (EDM)
Learner analytics & personalization
Academic/institutional analytics
Systemic improvement
Unit of analysis
Online activity events
Individual students
Whole organization or a sub-unit
Whole sector
Data provenance
Use existing data e.g. LMS, MOOC
Actively collect data
Use existing data
Actively collect data
Data examples
Access, learning materials usage, task completion, discussion/chat/wiki/blog participation, grades, interactions
Learning (& other) styles, prior learning, socioeconomic status
Student admissions, student records, finance, staff performance
U.S. schools national/state longitudinal testing, teacher & student background information, teacher evaluations
The University of Sydney Page 4
A taxonomy for analytics (continued)
Learning analytics (LA) & educational data mining (EDM)
Learner analytics & personalization
Academic/institutional analytics
Systemic improvement
Type of work to date
Detect patterns; analyze which patterns linked to achievement; design interventions (LA) or adapt the technology (EDM) to influence student activity and alter patterns
Explore relationships between learner differences and persistence/achievement; support or re-direct students at risk
Student progression to inform future admissions; productivity in central services; staff productivity; benchmarking
‘Data-driven decision making’ by teachers, schools, districts; teacher value-added models
Future possibilities
? Enhanced visual feedback for students & teachers; evidence-based actions
Optimize for all students; over time; evidence-based measures
Develop and share common metrics and models across institutions
The University of Sydney Page 5
References
Chatti, M.A, Dyckhoff, A.L., Schroeder, U. & Thüs, H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning, 4(5/6), 318-331.
Piety, P.J., Hickey, D.T., & Bishop, M.J. (2014). Educational data sciences – Framing emergent practices for analytics of learning, organizations, and systems. Paper for the Learning and Knowledge Analytics (LAK) Conference 24-28 March 2014 in Indianapolis, USA. http://dx.doi.org/10.1145.2567574.2567582
Romero, C. & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics: Part C: Applications and Reviews, 40(6), 601-618.
Siemens, G. (2012). Learning analytics: Envisioning a research discipline and a domain of practice. Paper for the Learning and Knowledge Analytics (LAK) Conference 29 April – 2 May 2012 in Vancouver, Canada.
The University of Sydney Page 6
Group discussion
Form groups
1. Learning analytics/educational data mining [back left]
2. Learner analytics & personalization [back right]
3. Institutional analytics [front centre]
Discuss the following
– What are some problems worth solving in this area? Select one to discuss in depth
– What data sources would be useful to gain insight into this problem?
– What personnel skill sets would be needed to grapple with this problem?
– What actions might be appropriate to address this problem?
konaapplemac.com
The University of Sydney Page 7
Quick report back
Key issues arising out of the discussion…
Roadblocks?
Promising new ideas?
Points of overlap and collaboration?
Thank you
Simon Buckingham Shum (UTS)Panos Vlachopoulos (MQ)
The University of Sydney Page 8
Next…
Grant opportunities
(Sydney internal) Educational Innovation Grants, close 27 Aug with earlier internal deadlines http://www.itl.usyd.edu.au/awards/educational_innovation_grants.htm
(National) OLT , cross-institutional, close approx late Nov with earlier internal deadlineshttp://www.olt.gov.au/grants-and-projects/innovation-and-development
Analytics gatherings
#edtech talk Gregor Kennedy ‘Logging students: Understanding digital learning one click at a time’ Mon 27 Jul http://tiny.cc/v4dzzx
Australian Learning Analytics Summer Institute (ALASI) 26-27 Nov, University of Sydney
Learning Analytics & Knowledge (LAK) Conf 25-29 April 2016, University of Edinburgh, UK http://lak16.solaresearch.org/
Stay in touch– http://listserv.uts.edu.au/mailman
/listinfo/nswlawg
– [email protected] – @abelardopardo– @SoLAResearch