electronic management of assessment: challenges to solutions
TRANSCRIPT
![Page 1: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/1.jpg)
19/11/2014 Electronic Management of Assessment: moving onElectronic management of assessment: challenges to solutions
22/01/2015
![Page 2: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/2.jpg)
Lisa Gray, senior co-design manager, Jisc
Hello
![Page 3: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/3.jpg)
Project team
» Lisa Gray, senior co-design manager, Jisc
» Gill Ferrell, consultant, Jisc EMA project
» Marianne Sheppard, account manager, Jisc
» Wilbert Kraan, assistant director, CETIS
» Heather Price, senior co-design manager, Jisc
» Alex Nisbett, project lead, Livework
» Marta Ferreira De Sa, service designer, Livework
3Introduction - Electronic Management of Assessment (EMA) project
![Page 4: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/4.jpg)
Background and context
Recently completed – a 3 year programme exploring technology-enhanced assessment and feedback
4 main themes:
»Feedback and feed forward
»Enhancing student employability
»Strategies for change
»Electronic management of assessment (EMA)
Introduction - Electronic Management of Assessment (EMA) project 4
http://bit.ly/jisc-assess and http://bit.ly/jiscdsaf
![Page 5: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/5.jpg)
Background and context
»EMA - benefits and drivers are
clear
»Challenges surfacing relating to
process, practice and technology
»Working in collaboration with
the Heads of e-Learning Forum
(HeLF) and UCISA to maximise
the benefits technology can
offer in the management of
assessment
Introduction - Electronic Management of Assessment (EMA) project 5
CC BY-NC-SA 2.0 ©comedynose via Flickr
![Page 6: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/6.jpg)
Project overview
Introduction - Electronic Management of Assessment (EMA) project 6
Phase 1March – July 2014
Landscape review providing initial identification of challenges and outline of the state of play with regards to EMA
Phase 2.1Oct –Aug 2015
Second phase of consultation, refining and prioritising challenges (speaking as a ‘single voice’)
Moving from challenges to solutions (Oct – Jan)
Solution development (Feb – July)
Phase 2.2Oct –Aug 2015
Ongoing development of resources for the ‘toolkit’ based on the assessment and feedback
![Page 7: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/7.jpg)
Where are we now?
» Produced a review of the EMA
landscape across UK HE and FE.
Gathered examples of practices,
policies & process as well as
implementation approaches
»Identified and prioritised the
challenges around EMA, in terms
of pedagogy/culture, process and
technology
»In December we ran a workshop
to explore possible solutions to
these prioritised challenges
Introduction - Electronic Management of Assessment (EMA) project 7
»Today – is about working these
ideas up into concrete, realistic
and detailed proposals
http://ema.jiscinvolve.org/
![Page 8: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/8.jpg)
What’s next?
»Ideas will be shared publically for
comment and prioritisation
w/c 2 Feb
»These ideas will go forward for
discussion within Jisc and
decisions made on which to take
forward
»Advice and Guide Toolkit already
in train…
Introduction - Electronic Management of Assessment (EMA) project 8
CC BY-NC-SA 2.0 ©comedynose via Flickr
![Page 9: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/9.jpg)
Participants today - welcome
» Anglia Ruskin University
» University of Birmingham
» Birmingham City University
» Cardiff University
» Edge Hill University
» University of Gloucestershire
» University of Huddersfield
» University of Hull
» Institute of Education
» King’s College, London
» Royal Veterinary College
Title of presentation 00/00/2013 9
Universities
» University of Leicester
» University College London
» University of Manchester
» Manchester Metropolitan University
» University of Northampton
» The University of Nottingham
» Plymouth University
» Queen’s University, Belfast
» University of Salford
» Sheffield Hallam University
» University of Southampton
![Page 10: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/10.jpg)
Participants today - welcome
» eAssignment
» Hedtek Ltd (Mark it Quickly)
» iParadigms (Turnitin)
» LiveText
» MyKnowledgeMap
» PebblePad (Atlas)
» TAG Assessment
» ULCC (Moodle and Mahara)
» CETIS, and the IMS Global Learning Consortium
Title of presentation 00/00/2013 10
Assessment system suppliers
»Not able to make today, but
continuing to engagement with:
› Blackboard
› Canvas (Joe Berry)
› Desire2Learn
› Questionark Perception
![Page 11: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/11.jpg)
Today
![Page 12: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/12.jpg)
Project timeline
Challenges to solutions - Electronic Management of Assessment (EMA) project 12
![Page 13: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/13.jpg)
Our objectives
»To share the solution areas developed in the first ‘imagine’ workshop and develop, validate and prioritise the propositions
» In collaboration with users, experts and suppliers to develop a clear picture of what these solution ideas look like at a sector level for decisions to be made in the next stage about whether or not they should proceed to development
»To better understand the implications of these developments for all stakeholders
»To identify potential supporters, owners and partners in the development of these solutions
Challenges to solutions - Electronic Management of Assessment (EMA) project 13
![Page 14: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/14.jpg)
The aim of today
Generate a detailed view on five potential solutions so that we can then prioritise.
Challenges to solutions - Electronic Management of Assessment (EMA) project 14
![Page 15: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/15.jpg)
Today’s schedule
» Project introduction
» Present solutions
» Solution validation
» Lunch 12.30 – 13.15
» Solution validation
» Playback
» Discussion / prioritise
» Summary & close 15.30
15Challenges to solutions - Electronic Management of Assessment (EMA) project
![Page 16: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/16.jpg)
What we’re going to do
1. Present the solutions
Challenges to solutions - Electronic Management of Assessment (EMA) project 16
3. Discuss and prioritise
2. Define and validate solutions
![Page 17: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/17.jpg)
The solutions
![Page 18: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/18.jpg)
The solutions
18Challenges to solutions - Electronic Management of Assessment (EMA) project
1. Specifying workflows
2. Feedback hub
3. Reliable submissions
4. Systems integration
5. Assessment and feedback toolkit
![Page 19: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/19.jpg)
19Challenges to solutions - Electronic Management of Assessment (EMA) project
![Page 20: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/20.jpg)
20Challenges to solutions - Electronic Management of Assessment (EMA) project
![Page 21: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/21.jpg)
21Challenges to solutions - Electronic Management of Assessment (EMA) project
![Page 22: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/22.jpg)
22Challenges to solutions - Electronic Management of Assessment (EMA) project
![Page 23: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/23.jpg)
23Challenges to solutions - Electronic Management of Assessment (EMA) project
![Page 24: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/24.jpg)
24Challenges to solutions - Electronic Management of Assessment (EMA) project
Team ASpecifying workflows
Simon Grundy
Jason Bell
Ian Barrett
Joel Mills
Anthony Lewis
James Trueman
Mira Vogel
Gill Ferrell
Team BFeedback hub
Richard Havinga
Joseph Berry
Calum Thompson
Duncan Greenhill
Emma Purnell
Chris Turnock
Lisa Gray
Team CReliable submissions
Stuart Blacklock
Stuart Hepplestone
Gill Kelly
Fran Morton
Peter Rayment
Justin Steele-Davis
Heather Price
Team DSystems integration
John Couperthwaite
Mark Van Harmelen
Adel Gordon
John Hill
Nigel Owen
Colin Smythe
Bill Warburton
Wilbert Kraan
Team EA+F toolkit
Steve Sidaway
Stefanie Anyadi
David Callaghan
Lynette Lall
Cheryl Reynolds
Alistair Spark
Marianne Sheppard
![Page 25: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/25.jpg)
Introductions
![Page 26: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/26.jpg)
Solution validation
![Page 27: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/27.jpg)
How we’re going to validate
» In your teams, sequentially address your
solution with the questions
» Discuss, then capture on the cards
» This framework should catch everything
which is significant
» In addition, capture any new ideas or
observations on blanks
Challenges to solutions - Electronic Management of Assessment (EMA) project 27
![Page 28: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/28.jpg)
Seven questions to explore
1. Understand and critique
2. Develop and describe the solution
3. Define the key benefits
4. Define the risks
5. Who’s your development dream team?
6. Required resources
7. Implications for the service.
28Challenges to solutions - Electronic Management of Assessment (EMA) project
75 mins
![Page 29: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/29.jpg)
Some guidelines
» Build upon your collective knowledge, together
» You’ll need a scribe, someone to capture your thoughts
» Keep responses clear, concise and understandable by anyone
» Answer all the questions!
29Challenges to solutions - Electronic Management of Assessment (EMA) project
![Page 30: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/30.jpg)
Lunch, 45 mins
![Page 31: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/31.jpg)
Seven questions to explore
1. Understand and critique
2. Develop and define the solution
3. Define the key benefits 5-10 min
4. Define the risks 5 min
5. Who’s your development dream team? 5 min
6. Required resources 5 min
7. Implications for the service 20 min
31Challenges to solutions - Electronic Management of Assessment (EMA) project
50 mins
![Page 32: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/32.jpg)
Playback, vote and prioritise
![Page 33: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/33.jpg)
Summary, next steps and close
![Page 34: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/34.jpg)
Keeping in touch:
»Lisa Gray [email protected]
»Landscape report available from: bit.ly/jisc-ema
»Join the conversation on the blog: ema.jiscinvolve.org/
and on twitter #jiscassess
»Join the mailing list: www.jiscmail.ac.uk/tech-enhanced-assessment
»Guides, case studies, videos and other resources on assessment and feedback: bit.ly/jisc-assess
34Challenges to solutions - Electronic Management of Assessment (EMA) project
![Page 35: Electronic management of assessment: challenges to solutions](https://reader030.vdocuments.us/reader030/viewer/2022032616/55a45ee31a28ab8d6f8b475b/html5/thumbnails/35.jpg)
Thank you