a pedagogical end game for examstransformingexams.com/files/ascilite2015_possible... · a...

Apedagogicalendgameforexams:alook10yearsintothefutureofhighstakesassessment

TransformingExams.com

Dr Mathew Hillier Monash University and University of Queensland Dr Andrew Fluck

TransformingExamsAcrossAustraliaAustralianGovernmentOfficeforLearningandTeachingNa:onalGrantID15-4747:AU$500Kover3Years+100KMonash

Acknowledgements-DiamondandGoldSponsors!500KinsupportforthisprojecthasbeenprovidedbytheAustralianGovernmentOfficeforLearningandTeaching.TheviewsexpresseddonotnecessarilyreflecttheviewsoftheAustralianGovernmentOfficeforLearningandTeachingorpar:cipa:ngins:tu:ons.100Kaddi:onalcashfromMonashUniversity.

Demo&Guide

s

Dr Mathew Hillier; Leader OLT national project. Seed leader

Monash University 5 Oct 2015 (was University of Queensland)

Dr Andrew Fluck; Originator of USB e-exam concept. Seed partner.

University of Tasmania

Dr Michael Cowling, Mr Kenneth Howah Seed trial site.

Central Queensland University

Dr Kim Blackmore Australian National University Assoc. Prof. Paul Newhouse Edith Cowan University Dr Matthew Bower, Prof. Dominic Verity Macquarie University Prof. Marilyn Baird (H), Mr Scott Grant (A) Monash University Assoc. Prof. Shona Leitch RMIT University Dr Ruth Geer, Mr Bruce White University of South Australia TransformingExams.com

Civil Service Exam Under Emperor Jen Tsung (fl.1022) from a history of Chinese emperors(colour on silk): Bibliothèque Nationale, Paris, France.

Is this your exam space?

Thedissonanceofitall!RealworldofworkExams

4

World Economic Forum – How will digital change your working world. https://agenda.weforum.org/wp-content/uploads/rtr2m8vm1-628x330.jpg

Exams at Monash Caufield in 2015 (mathew.hilier[at]monash.edu)

Wearefacedwithagrowingdisconnectbetweenthewayhighstakestes*ngisconductedusingpenonpaperexamsandstudents’everydayexperiencesofstudy,workandlife.

APossibleFutureAnevolu:onratherthanarevolu:on.Someaspectsmayoccurquickerthenothersdependingonpar:cularimplementa:onandtechnicalmodelschosen.

5

Wherewearegoing:Post-paperexamsWeneedgreaterpedagogicalflexibilityandmoreauthen:cassessmentsintheexamroom.…alignment!

6

Simula:ons,toolsofthetrade,virtualexperiments…

'Windows'soawareviaWINE.E.g.CAD/3Dmodeling,Celes:a.

Moodlequizwithmedia(automarked).

7

Physical hardware can be connected to the internet or we can use software simulations of labs and experiments.

SimulatedLabs

VirtualImmersiveLanguageLessons(1)

TAwebinarhhp://transformingassessment.com/events_1_april_2015.php8

ScohGrant(MonashUniversity,Australia)hhp://www.virtuallyenhancedlanguages.com

VirtualImmersiveLanguageLessons(2)TaskBasedLearningorTaskBasedLanguageLearning(TBLL).Includescommunica:onac:vi:es,usinglanguagetocarryouttasks,languageusethatismeaningfultothelearnerandhasapurpose,andcommunica:onac:vi:esthatreflectreal-lifeac:vi:eswithauthen:cmaterials.Learnbydoing:Purchasesuppliesthencooknoodles–allinChinese.

9

Wherewearenow:PaperEquivalent(UQ)Suitable format adjustments were made to cater for both paper and screen.

Wherewearenow:PaperPlus(UTAS)Worddoc,plusapps.Ques:ondocumentwithlinkstolaunchlocalappsandresources:graphics,Scratchprogrammingtools,presenta:onslides,PDFs.Allon-boardtheUSBs:ck.‘ITinEduca:on’exams:AndrewFluck,UTAS.

11

PDF

Scratch SDK

Exam doc

e-ExamTrialsWorkflow

Postsession:retrieveresponsesandassessment

Examroomuse

ResponsesretrievedfromUSBs. Collatede-responsessenttoacademic.

CreatemasterUSB(tested)

USBsduplicatedperstudentAcademiccreatesexamlearningmaterial

Set-up:prepareexamlearningmaterials Pre-session:Studentlaptopsetup&prac:ce.

CollectUSBs(responses)

1. Studentsenterroom.

2. GivenUSB.3. Bootlaptop.4. Doexam.5. ReturnUSB.6. Leaveroom.

e-Examsystemtakesoverlaptop.UbuntuLiveUSB.LibreOffice.

Ready?

13

Moreinforma:on….Demoset-upGuide,StudentPrac:ceandUserGuidehhp://transformingexams.com

Demovideosstart-up,useandrecoveryexamples.Applehhp://ta.vu/eexam-demo-a'Wintel'(Dell)hhp://ta.vu/eexam-demo-dContact:mathew.hillier[at]monash.edu

e-ExamProjectResources

14

End

CitethisresourceHillier,M&Fluck,A(2015)“Apedagogicalendgameforexams:alook10yearsintothefutureofhighstakesassessment”Presenta:onatASCILITEConference,Perth,Australia,30Nov-2Dec.Moretomorrow!Wed12.05PMBld216.room206e-Examtrialresults–“Totypeorhandwrite:student'sexperienceacrosssixe-Examtrials”Contact:mathew.hillier[at]monash.edu

References•  ABS(2013)YoungAdults:NowandThen,4102.0-AustralianSocialTrends,April2013,AustralianBureauofSta:s:cs

hhp://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4102.0Main+Features40April+2013•  ABS(2014)Non-schoolqualifica:onatBachelorDegreelevelorabove,personsaged20-64years,6227.0-Educa:on

andWork,Australia,May2014,AustralianBureauofSta:s:cshhp://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/6227.0May%202014

•  Ackoff,R.(1999)Re-Crea:ngtheCorpora:on:adesignoforganiza:onsforthe21stcentury.OxfordUniv.Press,NewYork

•  Binkley,M.,Erstad,O.,Hermna,J.,Raizen,S.,Ripley,M.,Miller-Ricci,M.,&Rumble,M.(2012).DefiningTwenty-FirstCenturySkills.InGriffin,P.,Care,E.,&McGaw,B.AssessmentandTeachingof21stCenturySkills,Dordrecht,Springer.hhp://www.atc21s.org/

•  Crisp,G.(2009).TowardsAuthen:ce-AssessmentTasks.InG.Siemens&C.Fulford(Eds.),ProceedingsofEdMedia:WorldConferenceonEduca:onalMediaandTechnology2009(pp.1585-1590).Associa:onfortheAdvancementofCompu:nginEduca:on(AACE).hhp://www.editlib.org/p/31689/

•  Fluck,A.,Pullen,D.,&Harper,C.(2009).CaseStudyofaComputerBasedExamina:onSystem.AustralasianJournalofEduca:onalTechnology,25(4),509–523.hhp://ajet.org.au/index.php/AJET/ar:cle/view/1126

•  Herrington,J.,Reeves,T.C.&Oliver,R.(2010).Aguidetoauthen:ce-learning.NewYork:Routledge•  Hillier,M&Fluck,A.(2014)TransformingExams:ProcessesandPla}ormfore-ExamsinSupervisedBYOD

Environments,AustralianGovernmentOfficeforLearningandTeaching.hhp://www.olt.gov.au/resource-transforming-exams-byod-environments

•  Hillier,M.,&Fluck,A.(2013).Arguingagainfore-examsinhighstakesexamina:ons.InH.Carter,M.Gosper,&J.Hedberg(Eds.),ElectricDreams(pp.385–396).MacquarieUniversity.Retrievedfromhhp://www.ascilite.org.au/conferences/sydney13/program/papers/Hillier.pdf

•  Linstone,H.A.(1999)Decisionmakingfortechnologyexecu:ves,ArtechHouse,Boston•  Rihel,H.&Webber,M.(1973)DilemmasinaGeneralTheoryofPlanning,PolicySciences,4,pp.155-169.

16

References•  TasmanianQualifica:onsAuthority(2013)BoardMee:ngs.hhp://www.tqa.tas.gov.au/10270&

hhp://www.tqa.tas.gov.au/23727•  Universi:esAustralia(2015)Universi:esAustraliaPre-BudgetSubmission2015–16.Canberra,ACT.•  VonZansen,A.(2015)DigabiNewsleherII/2015.

hhp://translate.google.com.au/translate?hl=en&sl=sv&u=hhps://digabi.fi/%3Flang%3Dsv_se&prev=search•  TransformingExams(2015).'e-ExamSystem'project,hhp://transformingexams.com

220moreat:hhps://www.zotero.org/groups/e-assessment/items/tag/e-exam

17