LearningAnalyticsCommunityExchangewww.laceproject.eu

ReportonWP6EventsPublicDeliverable–D6.4

DeliverableCoordinators:RebeccaFergusonandDougClow

CoordinatingInstitution:TheOpenUniversity,UK(OUUK)

Datadue:31May2016

Keywords:highereducation,learninganalytics,educationaldatamining,universities,stateoftheart

Abstract: This deliverable summarises the events delivered and attendedby LACEworkpackage 6 (WP6) since March 2015 and identifies how they have led to theachievementofprojectobjectives.

LACEDeliverable6.4–ReportonEventsv2

Contents

Introduction...........................................................................................................................................1

Successcriteria......................................................................................................................................2

EventsorganisedbyLACEWP6.............................................................................................................3

SpringBriefingandPolicyEvent,15April2015,Brussels..................................................................3

SoLARFlareUK:9October2015........................................................................................................5

LearningAnalyticsExpertWorkshop,15March2016,Amsterdam..................................................7

EP4LAworkshopseries,worldwide,ongoing..................................................................................10

WP6participationinexternalevents..................................................................................................12

TalisInsight......................................................................................................................................13

eMOOCssummit..............................................................................................................................13

Finnish-NorwegianWorkshoponlearninganalytics.......................................................................13

EMMASummerSchool....................................................................................................................13

EUNIS2015......................................................................................................................................13

EDEN2015.......................................................................................................................................14

1stLearningAnalyticsSummercamp(LEA’sBOX)...........................................................................14

EARLI2015.......................................................................................................................................14

GMWconference.............................................................................................................................14

ALT-C2015.......................................................................................................................................14

EC-TEL2015.....................................................................................................................................15

ICT15Days.......................................................................................................................................15

i-Knowevent....................................................................................................................................15

OpenConference,UniversitatObertadeCatalunya......................................................................15

LearningAnalyticsforManagingOrganizationalandindividualKnowledge(ICKM15)...................16

EducationDays(DéOnderwijsdagen).............................................................................................16

iLife:Health,EducationandLifestyleintheDigitalEra...................................................................16

ResearchandPracticeinHigherEducationseminar.......................................................................17

2ndICCEWorkshoponLearningAnalytics......................................................................................17

FutureLearnAcademicNetwork......................................................................................................17

CodeJamonInteroperability...........................................................................................................17

Institutionalreadinessday..............................................................................................................17

SeminaratORTUniversity...............................................................................................................17

NewMetricsforEvaluation:Towardsinnovationinlearning.........................................................18

Targetedevents...................................................................................................................................19

LACEDeliverable6.4–ReportonEventsv2

Targetedevent:LAK15(Poughkeepsie,USA)..................................................................................19

Targetedevent:LAK16(Edinburgh,UK)..........................................................................................20

LACEWP6activity,January2014–June2016......................................................................................23

Stateoftheartinlearninganalytics....................................................................................................24

Furtherreading................................................................................................................................24

Pressingissuesinlearninganalytics....................................................................................................25

Conclusion...........................................................................................................................................26

About...................................................................................................................................................27

LACEDeliverable6.4–ReportonEventsv2

1

IntroductionLACEprojectWorkPackage6(WP6)isdedicatedtothehighereducationsector.ItrunsinparalleltoWP4,whichfocusesontheschoolssector,andWP5,whichfocusesontheworkplace-learningsector.LedbytheUKOpenUniversity(OUUK),thisworkpackageincludesactivityfromOpenUniversiteitNederland(OUNL),UniversityofBolton(UOB)andHøgskolenIOsloogAkershus(HIOA).

LACEprojectobjectiveoneistopromoteknowledgecreationandexchange.WP6workstoachievethisbybringingtogether,‘disparatecommunitieswithrelatedinterests,eitherbydirectcontactormediatedbyourvariouscommunicationchannelsandoutputs.’The‘directcontact’elementofthisobjectiveisassociatedwithtwotasks:

• Task1:Plan,organiseanddeliverevents• Task2:Attendandparticipateinevents

Thisdocumentreportstheprogressmadeonthesetwotasks.ItdetailstheeventsorganisedbyWP6,andtheexternaleventstowhichWP6hascontributedorwillcontribute,fromthestartofMarch2015untiltheendoftheprojectinJune2016.

LACEDeliverable6.4–ReportonEventsv2

2

SuccesscriteriaTheLACEdescriptionofwork(DOW)identifieseightstakeholdergroupstargetedbyLACE:

1. Policymakers2. Headsandmanagersofinformationsystems3. HeadsofeLearningandTELdevelopmentteams4. Suppliersoftechnology-enhancedlearning(TEL)software5. Softwaredevelopers6. Earlyadopterpractitioners7. Learninganalytics(LA)andeducationaldatamining(EDM)researchers8. Standardsandinteroperabilityexpertsandbodies

Acrossalltheworkpackages,andacrossthelifeoftheproject,successisdefinedas

• 600directcontactsinvolvingmoststakeholdergroups.Adirectcontactisdefinedas‘attendanceatoneofoureventsoratasessionswhereaLACEprojectmemberpresents.

• 50%ofeventsinvolveatleastthreestakeholdergroupsoratleasttwosectors• Attendeesblogortweetabouttheevent

ThisdocumentestimatesdirectcontactsforalleventsLACEWP6hasrun.Insomecasesthesearenecessarilyvague–thenumberofeventattendees.Inothercases,morespecificnumbersofregistrationsandengagedparticipantsarerecorded.StakeholderengagementisnotedforeventsrunbyWP6andengagementwithsocialmediaisalsonotedforeventsorganisedortargetedbytheworkpackage.

LACEDeliverable6.4–ReportonEventsv2

3

EventsorganisedbyLACEWP6Workpackage6wasinvolvedintheorganisationoffoureventsduringtheyear.Thefirstofthese,aSpringBriefingandPolicyEvent,wasorganisedbythewholeconsortiumandtookplaceinBrusselsinApril2015.Thesecondwasa‘SoLARFlare’inOctober2015;oneofaworldwideseriesoflearninganalyticsnetworkingeventsorganisedundertheauspicesoftheSocietyforLearningAnalyticsResearch.InMarch2016,WP6organisedalearninganalyticsExpertWorkshopinAmsterdaminassociationwiththeLAEPEuropeanproject.Throughouttheyear,theworkpackagehasalsoorganisedaseriesofworkshopsonethics,privacyandlearninganalytics.

SpringBriefingandPolicyEvent,15April2015,BrusselsThisbriefingwasorganisedbytheLACEprojectconsortiumincollaborationwiththePELARS,Lea’sBoxandWatchMeprojectconsortiaandwiththesupportofEuropeanSchoolnet.IttookplaceonWednesday,15April2015from09.30until16.30intheThonHotelEU,RuedelaLoi/Wetstraat75inBrussels.

Thisone-daybriefingeventwasaimedateducationalpolicy-makers,influencersandstakeholdersaswellaspoliticalrepresentativesinterestedingettingtogripswiththecurrentstate-of-theartinlearninganalyticsandeducationaldatamining.Thosetakingpartwereintroducedtothelatestdevelopmentsinthisfieldandtheexplosionofinterestintoolsthatcanbeusedtomeasurelearningimpact.Theywerealsoinvitedtotakepartindiscussionsonhowbesttodeveloppoliciesrelatedtothefairandethicaluseofsuchdatainschools,universitiesandtheworkplace.

TheeventresultedinthepublicationofaLACEReview:‘Policyrecommendationsforlearninganalyticsfromthreestakeholderworkshops’.ThispublicationreviewedtheissuesthatwereconsideredtobeprioritiesbyEuropeaneducationaladministrators,professionalsandacademicsinconsideringanalyticsanditsrelationshiptopolicyandpractice.TheReviewincludesaseriesofinterviewswithSpringBriefingparticipants.

Table1:ScheduleforSpringBriefingandPolicyevent

09.30 WelcomeCoffee10.00 WelcomeandintroductiontotheeventbyJulieWard,MEPfortheNorthWestof

EnglandandmemberoftheCultureandEducationCommitteeSpeakers:

• RobertMadelin,Director-General,DirectorateGeneralforCommunicationsNetworks,ContentandTechnology(DGConnect)

• Prof.Dr.DraganGašević,ChairinLearningAnalyticsandInformatics,UniversityofEdinburghandPresidentElectoftheSocietyforLearningAnalyticsResearchLearninganalyticsaremorethanmeasurement

10.45 Q&Aanddiscussion

Figure1:RobertMadelin,Director-GeneralofDGConnect,speakingtoapackedaudienceattheLACESpringBriefing

LACEDeliverable6.4–ReportonEventsv2

4

11.00 Coffee11.30 IntroductiontoEuropeanCommission-supportedinitiativesrelatedtotheuseof

learninganalyticsandeducationaldatamining.Speakers:

• HendrikDrachsler,OpenUniversityoftheNetherlands,TheNetherlands(LACE)TheLACEproject–AcommunitysupportactionfortheupdateofLAinEurope,

• MichaelKickmeier-Rust,KnowledgeTechnologiesInstitute,GrazUniversityofTechnology,Graz,Austria(Lea’sBox)LittleGirlsandBigData–ToolsforPractice-centeredLearningAnalytics,

• ManolisMavrikis,InstituteofEducation,UniversityCollegeLondon,UK(PELARS),

• MariekevanderSchaaf,UtrechtUniversity,&DeniseJanssen,Mateum(WatchMe)ImprovingWorkplace-BasedLearning

12.30 Lunch13.30 Usinglearninganalyticseffectivelyandethicallyinschools,universitiesand

workplacelearning–recommendationsforpolicyDuringthisafternoondiscussionandreviewsession,participantsinthreeseparatediscussiongroupswillworktogethertoreviewspecificissuesrelatedtotheuseoflearninganalyticsinschools,universitiesandworkplacetraining.Schools

• Moderator:PeterKarlberg,Skolverket,LACE• Rapporteur:PatriciaWastiau,EuropeanSchoolNet

Universities• Moderator:ToreHoel,OsloandAkershusUniversityCollege,LACE• Rapporteur:RebeccaFerguson,TheOpenUniversity,LACE

Workplace• Moderator:FabrizioCardinali,SkillawarePerformanceSupport,LACE• Rapporteur:MariekevanderSchaaf,UtrechtUniversity,WatchMeProject

15.30 Reportbackwithmainpointsandpolicyrecommendations16.00 Conclusionandnextsteps16.30 Closeofevent

ProgresstowardsLACEobjectives:

Directcontacts:67peopleattendedtheevent.

Stakeholderengagement:MEPsandrepresentativesfromtheEuropeanParliament,EuropeanCommissionprojectofficersandadvisors(DGCONNECTandDGEAC),representativesfromkeylobbyingandstakeholderorganisationsincludingEuropeanSchoolnet,theEuropeanTradeUnionCommitteeforEducation,DIGITALEUROPE,EuropeanPublishersAssociationandorganisationswithamoregeneralinterestindatamanagementinEuropeincludingEuropeanDataProtectionsupervisorsandtheBigValueDataAssociation.

LACEReview:Policyrecommendationsfromtheworkshop:http://www.laceproject.eu/learning-

analytics-review/policy-recommendations-lace-workshops/

Eventwebsitehttp://www.laceproject.eu/spring-briefing/

LACEblogposthttp://www.laceproject.eu/blog/springtime-is-learning-analytics-time-in-brussels/

LACEDeliverable6.4–ReportonEventsv2

5

SoLARFlareUK:9October2015

Figure2:LanyrdsitefortheOctober2015SoLARFlareevent

TheSoLARFlarewasanetworkinggatheringforeveryoneinterestedinlearninganalytics.UndertheauspicesoftheSocietyforLearningAnalyticsResearch(SoLAR),thiseventformedpartofaninternationalseries.SoLARFlaresprovideopportunitiestolearnwhatisgoinginlearninganalyticsresearchandpractice,toshareresourcesandexperience,andtoforgevaluablenewconnections.Thethemeforthe2015LACESoLARFlarewas‘ResearchintoPractice’.

Thedaywasdesignedtomaximisesociallearning.Itthereforeincluded

• achanceforparticipantstointroducethemselvesandexplainwhattheywantedtoknowaboutlearninganalytics

• opportunitiestomeetwithpeersandexplorecollaborationpossibilities• thechancetohear—andshare—lightningupdatesonthestateoftheart• timetoexplorethefutureoflearninganalytics

Thedayalsoincludedopportunitiestolearnabouthowlearninganalyticsarebeingputintopracticeinbothformalandinformallearningenvironments.

LACEDeliverable6.4–ReportonEventsv2

6

Figure3:ThenetworkoftweetsusingtheeventhashtagwascapturedandvisualisedinTagsExplorerbyMartinHawksey

Forthosewhocouldnotmakeitinperson,someofthesessionsweresharedonlineandcanbereplayed.TheLACEteamreplayedtheeventonFriday23Octoberfrom10amto1pm(BST).Peoplewhohadbeenunabletoattendonthedaywereinvitedtojointheteamvirtuallybetweenthosetimestowatchtherecordingsandshareopinionsviathe#LACEflarehashtag.

TheeventwebsitewassetuponLanyrd,astructuredwiki(Figure3).Thisallowedallparticipantstorecordtheirinterestortheirpresence,addresourcesandlinktoexternalsitesandinformation.

Table2:LACESoLARFlaretimetable

09:30 RegistrationandRefreshments

10:00 IntroductionandWelcomepresentedbyPatrickMcAndrew

10:15 IntroductionandQuestionsfortheday

10:30 KeynotepresentedbyDrBartRientiesandBelindaTynan

11:00 Coffee,PostersandNetworking

11:30 KeynotepresentedbyChrisBallard

12:00 Lightningpresentations:

LACEDeliverable6.4–ReportonEventsv2

7

AndrewBrasher:FormingapictureofincidentalandinformallearningDougClow:LACEEvidenceHubAdamCooper:TheLAEPInventoryoflearninganalyticsFranciscoCordoba:SimuladordeNegociosIanDewes:Learninganalyticsinanearly-yearssettingRebeccaFerguson:LearninganalyticsforEuropeaneducationalpolicyNickFreear:AccessibilityissuesDannyGlick:PredictingstudentsuccessinonlinecoursesMarkGlynn:PredictEd–dataminingoftheVLEPriyaLakhani:Real-timedataanalyticslearningplatformRiccardoMazza:AnalyticsforadministratorsJennaMittelmeier:CulturalissuesinlearninganalyticsElenaSalvatori:ReformoftheItalianadulteducationsystemSharonSlade:Increasingstudenttransparency–learninganalyticsAdrianaWilde:Measurablefactorsforlearningsuccess

13:00 LunchandNetworking

14:00 Workshopsessions:EnvisioningtheFutureofLearningAnalytics

15:45 SummaryandFuturedirectionspresentedbyDougClow

16:00 CoffeeandNetworking

ProgresstowardsLACEobjectives:

Directcontacts:50peopleregisteredforandattendedtheevent.Figure3showsthat94peopleactivelyengagedviaTwitter.Stakeholderengagement:headsandmanagersofinformationsystems,headsofeLearningandTELdevelopmentteams,suppliersoftechnology-enhancedlearning(TEL)software,softwaredevelopers,early-adopterpractitioners,learninganalytics(LA)andeducationaldatamining(EDM)researchers,standardsandinteroperabilityexpertsSocialmedia:Theevent’sLanyrdwebsite(Figure3)broughttogetheronlineactivityaroundtheevent,includingblogpostsandSlidesharedecks

Onlinedelegatepackwithlinkstoallslidesandvideoshttp://www.laceproject.eu/blog/lace-solar-flare-2015-pack/

SoLARFlarelightningpresentationsonSlideshare(viewed1,186times)http://www.slideshare.net/laceproject/learning-analytics-lace-solar-flare-2015

LearningAnalyticsExpertWorkshop,15March2016,AmsterdamThisExpertWorkshopwasorganisedinconjunctionwiththeLAEPlearninganalyticspolicyproject(fundedbytheEuropeanCommission’sJointResearchCentre–JRC).TheeventfocusedonthecurrentstateoftheartoflearninganalyticsinEuropeandonprospectsfordevelopmentoverthenext10–15years.Itformedpartofastudythatisconsideringtheimpact,potentialandlimitsof

LACEDeliverable6.4–ReportonEventsv2

8

learninganalyticsinordertoproviderecommendationsforEuropeaneducationpolicythatwillguideandsupportthetake-upandadaptationofthistechnologytoenhanceeducationinEurope.

Theeventparticipantsincluded20invitedexpertsaswellasrepresentativesofEuropean-fundedlearninganalyticsprojects.

Day1–Tuesday15March2016

10:30 Registration,coffeeandice-breakersession

WelcomeandOpening11:00 Settingthepolicycontext

RiinaVuorikari,JRC-IPTS11:05 InvitedExpertintroductions(1slide,4minuteseach)12:30 Lunch13:30 Introduction:LAEPaims,researchquestionsandfindingssofar

RebeccaFergusonandBartRienties,TheOpenUniversity,UK14:00 Learninganalyticsprojects/tools:lightningpresentations

European-fundedprojects14:30 IntroductiontoState-of-the-ArtExercise:

Identifyingkeylearninganalyticstools,policiesandpractices15:00 Coffeeanddiscussion15:20 State-of-the-ArtExercise:

Identifyingkeylearninganalyticstools,policiesandpractices16:20 Plenarysession:keytools,policiesandpractices

IncludingvalidationofState-of-the-ArtExercise17:00 Endofformalsessions,Day1 Straightafterthesession:networkingandsnackatMuseumcafé Day2–Wednesday16March201609:00 Arrival,coffeeandDay2ice-breakersession09:30 Visionsofthefutureoflearninganalytics

LACE–LearningAnalyticsCommunityExchange10:00 LearningAnalyticsPlanningExercise:

Howparticipantsseetheirworkinthisareadeveloping10.45 Coffeebreak11:00 IntroductiontoForesightExercise:

Waysofthinkingaboutandplanningforthefuture12:30 Lunch13:30 ForesightExercise:

Usinglearnerandeducatorprofilestoenvisagethefuture15:15 Coffeebreak15:30 ValidationofForesightExercise16:00 Plenarysession:

PotentialforEuropeanpolicyrelatedtolearninganalytics17:00 Endofworkshop

LACEDeliverable6.4–ReportonEventsv2

9

Figure4:Reportingbackongroupdiscussion

ProgresstowardsLACEobjectives:

Directcontacts:49peoplefrom13countriesand10Europeanprojectsattendedtheevent.Stakeholderengagement:policymakers,headsandmanagersofinformationsystems,headsofeLearningandTELdevelopmentteams,suppliersoftechnology-enhancedlearning(TEL)software,softwaredevelopers,earlyadopters,learninganalyticsandeducationaldataminingresearchers,standardsandinteroperabilityexperts Slidesforexpertpresentations(230views)http://www.slideshare.net/laceproject/expert-presentations-laep-lace-amsterdam-workshop

SlidesforEuropeanprojectpresentations(252views)http://www.slideshare.net/laceproject/laep-european-projects

Liveblogsofsessionshttps://dougclow.org/2016/03/16/laep2016-weds-pm/https://dougclow.org/2016/03/16/laep2016-weds-am/https://dougclow.org/2016/03/15/laep2016-tues-pm/https://dougclow.org/2016/03/15/laep2016-tues-am/

Interviewswithkeystakeholdersontheday(YouTubeplaylist)https://www.youtube.com/playlist?list=PLGhWMQqRuaF9cR9JaR3XQKLPHTm0PmKeh

LACEDeliverable6.4–ReportonEventsv2

10

EP4LAworkshopseries,worldwide,ongoingThisseriesofinteractiveworkshopsonethicsandprivacyforlearninganalytics(EP4LA)hastheaimofraisingawarenessofmajorissuesintheseareas.Theworkshopsarealsousedtodeveloppracticalsolutionsforlearninganalyticsresearchersandpractitionersthatwillenablethemtoadvancetheapplicationoflearninganalyticstechnologies.

Therehavenowbeensevenoftheseworkshops,withfourtakingplaceinthecurrentreportingperiodandoneplannedinBilbaoduringthefinaldaysoftheproject.

1stEP4LA@Utrecht,NL,28October2014

2ndEP4LA@EducationDays,NL,11Nov2014

3rdEP4LA@BDEDU,USA,11Nov2014

4thEP4LA@ApereoFoundation,FR,Feb2015

5thEP4LA@JISC,UK,February2015

6thEP4LA@LAK15,USA,March2015

7thEP4LA@LAK16,UK,April2016

8thEP4LA@LASIBilbao,ES,June2016

Theseworkshopshavebeenresponsiblefordrivingandtransformingworkinthisarea.In2014privacywasonlyacknowledgedasanissueinafewpapersatthemajorannualconferenceinthisarea,LAK14.However,bythetimethatpapersweresubmittedforLAK15,whichincludedanEP4LAworkshop,thereweresignsofanewapproachthatnotonlyidentifiedprivacyasaconcernbutalsopointedtoprivacysolutionsatdifferentlevels.ByLAK16,theseissueswerebeingdealtwithinpapers,workshopsandkeynotes.TheworkhasculminatedintheDELICATEchecklist,whichwonbestpaperatLAK16.

TheworkshopshavehelpedwiththedevelopmentoftheJiscCodeofPractice,andhavealsoledtoaspecialissueoftheJournalofLearningAnalytics(volume3,issue1,2016),whichbringstogethereightpapersonthesubject,mostofwhichwerefirstpresentedatoneoftheseworkshops.

ProgresstowardsLACEobjectives:

Directcontacts:Workshopsinvolving10-30people,heldinsixcountries

Stakeholderengagement:policymakers,headsandmanagersofinformationsystems,headsofeLearningandTELdevelopmentteams,suppliersoftechnology-enhancedlearning(TEL)software,softwaredevelopers,earlyadopters,learninganalyticsandeducationaldataminingresearchers,standardsandinteroperabilityexperts

Socialmedia:ActiveTwitterhashtag#EP4LA

Workshopserieswebsite

http://www.laceproject.eu/ethics-privacy-learning-analytics/

JiscCodeofPractice

Figure5:PresentationatEP4LAworkshopatLAK16

LACEDeliverable6.4–ReportonEventsv2

11

https://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics

DELICATEchecklistonLACEwebsite

http://www.laceproject.eu/blog/ethics-privacy-in-learning-analytics-a-delicate-issue/

AcademiccitationforDELICATEchecklist

Drachsler,H.&Greller,W.(2016).PrivacyandAnalytics–it’saDELICATEissue.AChecklisttoestablishtrustedLearningAnalytics.6thLearningAnalyticsandKnowledgeConference2016,April25-29,2016,Edinburgh,UK.

LACEDeliverable6.4–ReportonEventsv2

12

WP6participationinexternaleventsLACEpartnershavetakenpartin27externaleventsrelatedtoWP6in16countries,comparedto18eventsin10countriesinthefirstyear.Table3providesanoverviewofWP6engagementwithexternalevents.Twooftheseweretargetedexternalevents,withasignificantcontributionfromLACE:LAK15andLAK16,whicharethemaininternationalconferenceseriesforthelearninganalyticscommunity.BettwastheoccasionoftheLACEAnnualMeeting,andisreportedmorefullyinotherdeliverables.Thereportsub-sectionsbelowprovideanoverviewofWP6engagementwiththeseevents.

Table3:ExternaleventsinwhichLACEpartnershaveparticipated

Date Event Location LACEpartnersinvolved

16/03/15 LAK15 Poughkeepsie,USA OUUK15/04/15 TalisInsight Birmingham,UK Cetis17/05/15 eMOOCssummit Mons,Belgium ATiT22/05/15 Finnish-NorwegianWorkshoponlearning

analyticsHelsinki,Finland HiOA

06/07/15 EMMASummerSchool Ischia,Italy OUUK10/06/15 EUNIS2015 Abertay,Scotland Cetis10/06/15 EDEN2015 Barcelona,Spain HiOA,ATiT31/07/15 1stLearningAnalyticsSummercamp(LEA’s

Box)Prague Cetis

25/08/15 EARLI2015 Cyprus OUNL,OUUK03/09/15 GMWconference Munich,Germany OUUK10/09/15 ALT-C2015 Manchester,UK OUUK16/09/15 ECTEL2015 Toledo,Spain OUUK15/09/15 5thWorkshoponAwarenessandReflectionin

TechnologyEnhancedLearningToledo,Spain(ECTELworkshop)

OUUK

20/10/15 ICT15Days Lisbon,Portugal HiOA,ATiT20/10/15 i-Knowevent Graz Cetis27/10/15 OpenConference,UniversitatObertade

CatalunyaBarcelona,Spain Hendrik

04/11/15 LearningAnalyticsforManagingOrganizationalandindividuaKnowledge(ICKM15)

Osaka-Shi,Japan HiOA

9/11/15 EducationDays(DéOnderwijsdagen),includingpre-conference

Rotterdam,TheNetherlands

OUNL,OUUK,Kennisnet

24/11/15 iLife:Health,EducationandLifestyleintheDigitalEra

Maastricht,TheNetherlands

OUUK

25/11/15 ResearchandPracticeinHigherEducationseminar

Liverpool,JohnMooresUniversity

OUUK

30/11/15 2ndICCEWorkshoponLearningAnalytics Hangzhou,China HiOA02/12/15 FutureLearnAcademicNetwork Southampton,UK OUUK07/12/15 CodeJamonInteroperability Paris,France OUNL,Cetis10/12/15 Institutionalreadinessday Amsterdam Cetis12/04/16 SeminaratORTuniversity Montevideo,Uruguay OUUK13/04/16 NewMetricsforEvaluation:Towards

innovationinlearningMontevideo,Uruguay OUUK

25/04/16 LAK16 Edinburgh,UK OUNL,OUUK

LACEDeliverable6.4–ReportonEventsv2

13

TalisInsightTalisInsightbringstogetherlearningtechnologyandlibraryprofessionalsinUKHigherEducation,andattracted230delegatesfrom130institutions.AdamCooperfromCETISgaveapresentationandcontributedtoapaneldiscussion.

Eventwebsitehttps://talis.com/talisinsight2015/

eMOOCssummitSallyReynoldsfromATiTgaveoutLACEpublicitymaterialattheThirdEuropeanMOOCsStakeholdersSummitinMons,Belgium,whichattractedawideaudience,frompolicymakerstopractitionersandresearchers.

Eventwebsitehttp://www.emoocs2015.eu/

Finnish-NorwegianWorkshoponlearninganalyticsToreHoelfromHiOAgaveaworkshopwithaplenarykeynoteon‘Datasecurityissues,ethicalissuesandchallengestoprivacyinknowledge-intensivelearninganditsevaluation’atthisworkshoporganisedbytheResearchCouncilofNorwayandtheAcademyofFinland.

Eventwebsite

http://www.anpdm.com/newsletterweb/43465C4B7841415E4B74424359/40?noTracking=true

EMMASummerSchoolRebeccaFergusonfromOUUKattendedthe11thJointEuropeanSummerSchoolonTechnologyEnhancedLearning,whichisjointlyorganisedbyProLearnandeatel,theEuropeanAssociationofTechnologyEnhancedLearning.HerworkshoponLearningDesignandLearningAnalyticswaswellreceived,andhasattractednearly15,000viewsonSlideshare.

Eventwebsitehttp://www.prolearn-academy.org/Events/summer-school-2015

WorkshoppresentationonSlideShare(14,697views)http://www.slideshare.net/R3beccaF/learning-design-and-learning-analytics-50180031

EUNIS2015EuropeanUniversityInformationSystems’annualCongressattractsanaudienceofprofessionalsinITfromacrosstheHEsectorinEurope.AttheCongressinDundee,AdamCoopergaveapresentationonScalableLearningAnalytics,andcontributedasectiononanalyticswithintheTeachingandLearningTaskForceworkshop,whichhadafocusonassessmentandfeedback.

Eventwebsitehttp://www.eunis.org/eunis2015/

ScalableLearningAnalyticspresentationhttp://www.eunis.org/eunis2015/wp-content/uploads/sites/3/2015/06/Parallel-5-Track-1-Paper-57-Scalable-Learning-Analytics-and-Interoperability-an-assessment-of-potential-limitations-and-evidence.pdf

(ThiseventwasacrossoverbetweenWP6andWP7.)

LACEDeliverable6.4–ReportonEventsv2

14

EDEN2015TheEuropeanDistanceandE-learningNetworkannualconferencewasheldinBarcelona.ToreHoel(HiOA),SallyReynolds(ATiT)andDaiGriffiths(Cetis)ranaLACEworkshoptitled‘LearningAnalytics–WhatDataCouldTellIfWeWereWillingtoShareInformation:ExploringBenefitsandBarrierstotheUseofAnalyticsinSchoolsandUniversities’.

Eventwebsitehttp://www.eden-online.org/2015_barcelona.html

PresentationonSlideShare(1,398views)http://www.slideshare.net/toreh/workshop-on-learning-analytics-eden15-in-barcelona-jun3

1stLearningAnalyticsSummercamp(LEA’sBOX)DaiGriffithsfromCetisrepresentedtheLACEprojectatthisSummercamporganisedbytheLEA’sBOXproject,with23participantsincludingkeyrepresentativesworkingonEuropeanlearninganalyticsprojects.DaipresentedtheLACEprojectandcontributedtothediscussions.

Eventwebsitehttp://css-kmi.tugraz.at/mkrwww/leas-box/summercamp15.html

EARLI2015The16thBiennialConferenceoftheEuropeanAssociationforResearchinLearningandInstruction(EARLI)tookplaceinLimassol,Cyprus,andHendrikDrachsler(OUNL)andBartRienties(OUUK)representedLACEthere.Bartgaveapresentationon‘Thepoweroflearninganalytics:LACEevidencehubandlearningdesign’andapaperon‘Thepoweroflearninganalyticsandlearningdesign:Alarge-scalelongitudinalstudy’.

Eventwebsitehttp://www.earli2015.org/

GMWconferenceRebeccaFerguson(OUUK)gaveakeynoteon‘ScalingUpLearningAnalytics’featuringLACEprominentlyatajointconferenceoftheGesellschaftfürMedieninderWissenschaft(GMW)andderFachgruppeE-LearningderGesellschaftfürInformatik(Delfi)inMunich,Germany.ShealsodistributedleafletsabouttheLACEEvidenceHubandsmallcardstopromotetheLACESoLARFlare,whichledtosevenregistrationsinthedaysfollowing.ThiseventwasatnocosttotheLACEproject.

PresentationonSlideShare(3,539views)http://www.slideshare.net/R3beccaF/scaling-up-learning-analytics

Eventwebsitehttp://www.delfi2015.de/

ALT-C2015RebeccaFergusongaveaninvitedpresentationatALT-C,theannualconferenceoftheUKAssociationforLearningTechnology,themainprofessionalbodyfore-learningprofessionalsinUKhighereducation.ShealsodistributedinformationabouttheLACEEvidenceHubandSoLARFlare.

PresentationonSlideShare(3,540views)http://www.slideshare.net/R3beccaF/scaling-up-learning-analytics

Eventwebsitehttps://altc.alt.ac.uk/2015/

LACEDeliverable6.4–ReportonEventsv2

15

EC-TEL2015LACEwaswellrepresentedatEC-TEL2015,thetenthEuropeanConferenceonTechnology-EnhancedLearning,soweco-locatedaconsortiummeetingtosavecosts.TheconferenceattractsabroadEuropeanaudienceofresearchers,practitioners,developers,entrepreneursandpolicymakers.DougClowandRebeccaFergusonpresentedapaperon‘MovingthroughMOOCS:Pedagogy,LearningDesignandPatternsofEngagement’.

RebeccaFerguson(OUUK)wasontheprogrammecommitteeforthe5thWorkshoponAwarenessandReflectioninTechnologyEnhancedLearning,organisedimmediatelybeforeEC-TEL,andtheworkshopwebsiteincludedtheLACElogoasabadgedsupporter.

Eventwebsitehttp://ectel2015.httc.de/index.php?id=696

Workshopwebsitehttp://www.teleurope.eu/pg/pages/view/389887/5th-workshop-on-awareness-and-reflection-in-technology-enhanced-learning

MovingthroughMOOCshttp://link.springer.com/chapter/10.1007/978-3-319-24258-3_6Presentation(detailedversion,2,152views):http://www.slideshare.net/R3beccaF/moving-through-moocs-pedagogy-learning-and-patterns-of-engagementPresentation(headlineversion,1,667views)http://www.slideshare.net/dougclow/moving-through-moocs

ICT15DaysToreHoel(HiOA)andSallyReynolds(ATiT)representedLACEattheEuropeanCommission’sICT2015eventinLisbon,Portugal,whichattractedmorethan6,000visitors.TheretheyranaLACEworkshopwithotherEuropeanprojects.

Eventwebsitehttps://ec.europa.eu/digital-single-market/en/ict2015

i-KnoweventDaiGriffiths(Cetis)tookpartinthe16thInternationalConferenceonKnowledgeTechnologiesandData-drivenBusiness(i-Know)inGraz,Austria.

Eventwebsitehttp://i-know2015.know-center.tugraz.at/

OpenConference,UniversitatObertadeCatalunyaLACEwasinvitedtodiscuss‘datainteroperability‘and‘learninganalyticssupportedinstructionaldesignmethods‘attheUniversityofCataloniaatanOpenConferencewithvariousworkshops.LACEorganisedoneworkshopon‘LearningAnalyticssupportedInstructionalDesign’atwhichtheattendeeshadcraftedaforumdiscussionevaluationtoolwithdatafromtheUOCeLearnCenterandteachersfromdifferentdisciplines.HendrikDrachsler(OUNL)alsopresentedataworkshoponInteroperability.ThiseventwasatnocosttotheLACEproject.

Figure6:Workshopparticipants

LACEDeliverable6.4–ReportonEventsv2

16

Interoperabilitypresentationhttp://www.slideshare.net/Drachsler/learning-analytics-metadata-standards-xapi-recipes-learning-record-store?ref=http://www.laceproject.eu/blog/hendrik/

SummaryblogpostfromtheLACEsitehttp://www.laceproject.eu/blog/hendrik/

LearningAnalyticsforManagingOrganizationalandindividualKnowledge(ICKM15)Aspartofthe11thInternationalConferenceonKnowledgeManagementinOsaka,Japan,ToreHoel(HiOA)presentedon‘LearningAnalyticsforManagingOrganizationalandIndividualKnowledge’.

Eventwebsitehttp://ickm.kis.osakafu-u.ac.jp/cfp/theme-based-os/os-2/

PresentationonSlideshare(595views)http://www.slideshare.net/toreh/privacy-in-learning-analytics-implications-for-system-architecture

EducationDays(DéOnderwijsdagen)LACEpartnerKennisnetorganisesanannualseriesofEducationDays(DéOnderwijsdagen),incollaborationwithSURF,thecollaborativeorganisationforICTinDutcheducationandresearch.TheeventiscomparabletoBettintheUKandOnlineEducainGermany.HendrikDrachsler(OUNL)contributedasessiontothepre-conferenceworkshops,andgaveakeynote,‘SixDimensionsofLearningAnalytics’(participationnotfundedbyLACEproject).DougClow(OUUK)gavetheclosingkeynoteon‘LearningAnalytics:TrainsandBalloons’,andalsofacilitatedaworkshopontheLACEVisionsoftheFutureStudy(discussedindetailinD3.2VisionsoftheFutureHorizonReport).

BlogpostfromHendrikDrachslerontheLACEsitehttp://www.laceproject.eu/blog/keynote-on-introduction-to-learning-analytics-still-highly-needed/

Keynotepresentation‘SixDimensionsofLearningAnalytics’onSlideShare(2,070views)http://www.slideshare.net/Drachsler/six-dimensions-of-learning-analytics

Keynotepresentation‘LearningAnalytics:TrainsandBalloons’onSlideShare(620views)http://www.slideshare.net/dougclow/learning-analytics-balloons-and-trains

Videoreplayofkeynote‘LearningAnalytics:TrainsandBalloons’http://surf.mediamission.nl/Mediasite/Play/5411c729d9ca495098e48caef8f471b51d

VisionsoftheFuturepresentationonSlideShare(1,313views)http://www.slideshare.net/Drachsler/the-future-of-learning-analytics

Eventwebsitehttps://www.deonderwijsdagen.nl/

iLife:Health,EducationandLifestyleintheDigitalEraRebeccaFerguson(OUUK)gaveapresentationtitled‘Thefutureoflearninganalytics’,atiLife:Health,EducationandLifestyleintheDigitalErainMaastricht,Netherlands,largelybasedontheLACEVisionsoftheFutureStudy(discussedindetailinD3.2VisionsoftheFutureHorizonReport).

PresentationonSlideShare(954views)http://www.slideshare.net/R3beccaF/the-future-of-learning-analytics-55456556

Eventwebsitehttp://www.ilife-maastricht.eu/

LACEDeliverable6.4–ReportonEventsv2

17

ResearchandPracticeinHigherEducationseminarRebeccaFerguson(OUUK)organiseda90-minuteworkshopon‘ScalingUpLearningAnalytics’for25peopleattheResearchandPracticeinHigherEducationseminarheldatLiverpoolJohnMooresUniversity,UK.

PresentationonSlideShare(3,542views)http://www.slideshare.net/R3beccaF/scaling-up-learning-analytics

Blogposthttps://r3beccaf.wordpress.com/2015/11/30/research-and-practice-in-he-2/

2ndICCEWorkshoponLearningAnalyticsAspartofICCE(23rdInternationalConferenceonComputersinEducation)heldinHangzhou,China,ToreHoelandWeiqinChenwereco-organisersofahalf-dayworkshop,the2ndICCEWorkshoponLearningAnalytics,withpaperpresentationsanddiscussions,whichattractedabout40participants.ThiseventwasatnocosttotheLACEproject.

Eventwebsitehttps://sites.google.com/site/la2015ws/

FutureLearnAcademicNetworkTheFutureLearnAcademicNetwork(FLAN)bringstogetherresearchersinterestedinFutureLearn’sMOOCplatform.AtameetingofthenetworkinSouthampton,attendedbyabout25researchers,RebeccaFerguson(OUUK)gaveapresentationontheLACEVisionsoftheFutureworkinthecontextofMOOCethicsandprivacy.ThiseventwasatnocosttotheLACEproject.

CodeJamonInteroperabilityHendrikDrachsler(OUNL)andDaiGriffiths(Cetis)attendedaCodeJamorganisedbytheFrenchMinistryofEducationinParis,whichwasattendedbyaround60people.TheypresentedaboutanddiscussedtheLACEVisionsoftheFutureWork,interoperability,work‘TowardsaResearchAgendaforLAinFrance’.ThiseventwasatnocosttotheLACEproject.

InstitutionalreadinessdayWP6partners(DaiGriffiths,Cetis,andToreHoel,HiOA)contributedtoanInstitutionalReadinessDayco-organisedandhostedbytheUniversityofAmsterdam,Netherlands.Thiseventalsocoveredinteroperability(WP7)andtheVisionsoftheFutureStudy(WP3),andisreportedmorefullyinotherdeliverables.

LACEblogpostaboutthedayhttp://www.laceproject.eu/events/institutional-readiness-for-learning-analytics-technologies/

SeminaratORTUniversityRebeccaFerguson(OUUK)gaveapresentationonLACEandlearninganalyticsatORTUniversity,Montevideo,Uruguay.ThiseventwasatnocosttotheLACEproject.

Website:http://www.ort.edu.uy/

LACEDeliverable6.4–ReportonEventsv2

18

NewMetricsforEvaluation:TowardsinnovationinlearningRebeccaFerguson(OUUK)wasaninvitedspeakeratthe1stInternationalWorkshop‘NewMetricsforEvaluation:Towardsinnovationinlearning’inMontevideo,Uruguay,anddiscussedtheLACEprojectduringherpresentation.ThiseventwasatnocosttotheLACEproject.

Eventwebsite:https://www.hastac.org/opportunities/1st-international-workshop-new-metrics-evaluation-towards-innovation-learning

LACEDeliverable6.4–ReportonEventsv2

19

TargetedeventsEventsthataretobetargetedbytheLACEprojectareidentifiedinconjunctionwithWP1,andworktakesplacetoensurethatWP6engagementattheseeventsisaseffectiveaspossible.

Targetedevent:LAK15(Poughkeepsie,USA)LACEmembersfromOUNL,OUUK,HiOAandCetisattendedtheFifthInternationalConferenceonLearningAnalyticsandKnowledge(LAK15).Theircontributionsincludedpapers,apaneldiscussion,thedatachallengeandahackathon,aswellasextensivenetworking.Over300peopleattendedLAK15,whichisthemajorinternationalconferenceinthisfield.

SignificantLACEactivityattheconferenceincluded:

Event LACErepresentativesFirstAnnualOpenLearningAnalyticsHackathon AdamCooper(Cetis)MU3203:EthicsandPrivacyinLearningAnalytics(#EP4LA)

AdamCooper(Cetis),RebeccaFerguson(OUUK),HendrikDrachsler(OUNL),ToreHoel(HII)&MarenScheffel(OUNL)

MU3204:The3rdLAKDataChallenge(mergedwithfull-dayVISLA15:VISualApproachestoLearningAnalytics)Datachallengerunsfrom13.00-13.45

MarenScheffel(OUNL),HendrikDrachsler(OUNL)andAdamCooper(Cetis)

ExaminingEngagement:AnalysingLearnerSubpopulationsinMassiveOpenOnlineCourses(MOOCS)[FULLSession1A:MOOCs—AssessmentsConnectionsandDemographicsSessionID:1A-02]

RebeccaFerguson(OUUK)(forDougClow,OUUK)

UsinganActivityDashboardtoSupportAwarenessandReflectioninaEuropeanVirtualSeminar[PRACTITIONERSession:1C.ID:1C-01:IndicatorsandToolsforAwareness]

MarenScheffel(OUNL)andHendrikDrachsler(OUNL)

DevelopinganEvaluationFrameworkofQualityIndicatorsforLearningAnalytics[SHORTSession:1C.ID:1C-04:IndicatorsandToolsforAwareness]

MarenScheffel(OUNL)andHendrikDrachsler(OUNL)

LearningAnalytics:EuropeanPerspectives[RESEARCHPANELSession:2C.ID:2C-01PracticeAcrossBoundaries]

RebeccaFerguson(OUUK),AdamCooper(Cetis)andHendrikDrachsler(OUNL)

CorrelationsBetweenAutomatedRhetoricalAnalysisandTutors’GradesonStudentEssays[SHORTPaperID:7B-04]

RebeccaFerguson(OUUK)

Aspartoftheworkpackage’sengagementwithLAK15,webroughtparticipantsfromacrossEuropetogethertotalkaboutEuropeanperspectivesonlearninganalytics.

AlejandraMartínezMonésfromSpaintalkedaboutpastworkcarriedoutaspartoftheEuropeanKaleidoscopeNetworkofExcellencethathasimplicationsforthedevelopmentoflearninganalyticsinternationally.AlanBergfromTheNetherlandsprovidedlinkstoaseriesofinitiativesdesignedtobringresearchersandpractitionerstogetheracrossnationalboundaries.KairitTammetsintroducedlearninganalyticsworkinEstonia,andAnneBoyerofferedaFrenchperspective.MembersoftheLACEprojecttalkedabouttheirworktopulltogetherresearch,practiceandevidenceacrossEurope.

LACEDeliverable6.4–ReportonEventsv2

20

TheLACEprojectalsotooktheopportunitytorecordshortinterviewswithexpertsinthelearninganalyticsworld,whicharenowavailableontheLACEYouTubechannel.ExpertsinterviewedincludethelateErikDuval,GeorgeSiemens,SharonSlade,AlyssaWise,AbelardoPardo,ShaneDawson,AlanBerg,DraganGasevicandPaulPrinsloo.

Figure7:AdamCooper(Cetis),presentingintheLACEpanelsessionatLAK15

ProgresstowardsLACEobjectives:

Directcontacts:Morethan300peopleregisteredforandattendedtheevent.Stakeholderengagement:headsandmanagersofinformationsystems,headsofeLearningandTELdevelopmentteams,suppliersoftechnology-enhancedlearning(TEL)software,softwaredevelopers,learninganalytics(LA)andeducationaldatamining(EDM)researchers,standardsandinteroperabilityexpertsandbodiesSocialmedia:EventamplificationiscoveredintheLACEprojectbloghttp://www.laceproject.eu/blog/review-of-lak15-lace-team-participation/Eventwebsitehttp://lak15.solaresearch.org/

PanelpresentationonSlideshare(320views)http://www.slideshare.net/laceproject/european-perspectives-on-learning-analytics

InterviewswithlearninganalyticsexpertsatLAK15onYouTube(Morethan2,000views)https://www.youtube.com/c/laceprojecteu

https://www.youtube.com/playlist?list=PLGhWMQqRuaF_A0_QFWcDOFvvrUHB-FO0T(playlist)

Targetedevent:LAK16(Edinburgh,UK)LACEpartnersfromOUUK,OUNLandCetisattendedthe6thInternationalConferenceonLearningAnalyticsandKnowledge,heldinEdinburgh,UK,25-29April2016,whereLACEhadasignificantpresence.TheLACEbannerwasbehindtheregistrationdesk,andHendrikDrachslerandRebeccaFerguson(OUUK)werechairsoftheResearchTrackandthePractitionerTrack.

LACEDeliverable6.4–ReportonEventsv2

21

LACEcontributedtotwopre-conferenceworkshops:

• EthicalandPrivacyIssuesintheDesignofLearningAnalyticsApplicationsToreHoel,AlanBerg,WeiqinChen,AdamCooper,HendrikDrachsler,RebeccaFerguson,GáborKismihókandMarenScheffel

• LAKFailathonDougClow,RebeccaFerguson,LeahMacfadyen,PaulPrinslooandSharonSlade

LACEcontributedtwopapers,includingapaperbuildingonLACE’sethicsandprivacyworkthatwonbestpaper:

§ Presentation2A1:‘Investigatingcollaborativelearningsuccesswithphysiologicalcouplingindicesbasedonelectrodermalactivity’(fullpaper)byHéctorJavierPijeira-Díaz,HendrikDrachsler,SannaJärveläandPaulA.Kirschner

§ Presentation2B1:‘PrivacyandAnalytics–it’saDELICATEIssue.AChecklistforTrustedLearningAnalytics’(fullpaper)byHendrikDrachslerandWolfgangGreller.Bestpaperaward.

TwoposterswerelargelybasedonLACEwork:

§ LearningAnalyticsCommunityExchange:EvidenceHubRebeccaFergusonandDougClow

§ TheDutchxAPIExperienceAlanBerg,MarenScheffel,HendrikDrachsler,StefaanTernierandMarcusSpecht.Bestposteraward.

AndLACEorganisedapaneldiscussionontheVisionsoftheFuturework:

§ LearningAnalytics:VisionsoftheFuturebyRebeccaFerguson,AndrewBrasher,DougClow,DaiGriffithsandHendrikDrachsler

LACEpartnerswereactiveontheeventhashtag,#lak16,asseeninNodeXLvisualisationscreatedforWednesday27thApril(https://nodexlgraphgallery.org/Pages/Graph.aspx?graphID=67217)andThursday28thApril(https://nodexlgraphgallery.org/Pages/Graph.aspx?graphID=67306).TheTwitterstreamwasextensive:650distinctusershadusedthehashtagbyWednesday,27Aprilat16:19UTC.

LACEDeliverable6.4–ReportonEventsv2

22

Figure8:LAK16TwitterNodeXLSNAMapandReportforWednesday,27April2016at16:08UTC,fromhttps://nodexlgraphgallery.org/Pages/Graph.aspx?graphID=67217

ProgresstowardsLACEobjectives:

Directcontacts:460peopleattendedtheevent.Stakeholderengagement:headsandmanagersofinformationsystems,headsofeLearningandTELdevelopmentteams,suppliersoftechnology-enhancedlearning(TEL)software,softwaredevelopers,learninganalytics(LA)andeducationaldatamining(EDM)researchers,standardsandinteroperabilityexpertsandbodiesSocialmedia:Atleast650distinctusersoftheeventhashtag;reachislikelytobemuchmore.

Eventwebsite:http://lak16.solaresearch.org/

LiveblogsbyDougClow:https://dougclow.org/lak16-liveblogs/

BlogpostontheLACEwebsite:http://www.laceproject.eu/lace-lak16/

LACEDeliverable6.4–ReportonEventsv2

23

LACEWP6activity,January2014–June2016Duringthe30monthsoftheproject,workpackage6hasorganisedseveneventsandsetsofevents,whichhaveinvolvedmorethan700participantsfromalleightoftheLACEtargetstakeholdergroups.

• LASI-NL:30June–1July2014LASILocalNetherlandswasorganisedwiththeSURFSIGLAandtookplaceinZeist,TheNetherlands,inconjunctionwiththeComputer-AssistedAssessmentConference(CAA2014).40attendees

• LASI@MK:8July2014ALearningAnalyticsSummerInstitutelocaleventtookplaceinMiltonKeynes,UKwithparticipantsfromAustralia,UKandtheUSA.25attendees

• SoLARFlareUK:24October2014One-daylearninganalyticsevent,whichtookplaceinMiltonKeynes,UK.50attendees,plus350onlivestream

• SpringBriefingandPolicyEvent:15April2015OrganisedinBrusselsbytheLACEprojectconsortiumincollaborationwiththePELARS,Lea’sBoxandWatchMeprojectconsortiaandwiththesupportofEuropeanSchoolNet.67attendees

• SoLARFlareUK:9October2015NetworkinggatheringheldinMiltonKeynes,UK,foreveryoneinterestedinlearninganalytics.50attendees

• LearningAnalyticsExpertWorkshop,15March2016OrganisedinAmsterdaminconjunctionwiththeLAEPlearninganalyticspolicyproject48attendees

• EP4LAworkshopseries,on-goingSeriesofworkshopsonethicsandprivacyforlearninganalytics,heldinFrance,Netherlands,Spain,UKandUSAApproximately150attendees

Inaddition,theworkpackagehastakenpartin50externallyorganisedeventsin19countriesonfivecontinents:Austria,Belgium,China,Croatia,Cyprus,Czechoslovakia,Finland,France,Germany,Italy,Japan,Netherlands,Norway,Serbia,SouthAfrica,Spain,UK,UruguayandtheUSA

LACEDeliverable6.4–ReportonEventsv2

24

StateoftheartinlearninganalyticsLearninganalyticshasgrownasafieldduringthelifetimeoftheLACEproject.Thiscanbeseeninthegrowthofthemainconference,LAK,whichhad320participantsin2015but467in2016.

Thisgrowthisparticularlystronginhighereducationspecifically.LearninganalyticsfeaturedinthelastthreeEducauseHorizonReportsforHigherEducation(2014,2015,2016),mostrecentlywithatime-to-adoptionhorizonofoneyearorless.UniversitiesandotherHigherEducationInstitutionsareincreasinglyawareofthepotentialfortheuseofdatatoimprovelearning.ProducersofsoftwaretosupportlearninginHEnownearly-universallyofferanalyticsofsomesort,andsectororganisationssuchasJiscintheUKandSURFintheNetherlandshaveincreasedtheiractivityinlearninganalytics.

FortheHEsector,thisincreaseininterestandactivityhasoftenbeendrivenbyinstitutionalconcernstoimproveretention,completionandstudentsuccess,butthereissomeevidenceofawiderconcernforimprovingthelearningexperience.

Forinstance,theWP6eventshaveseenamaturingoflearninganalyticsasafieldofendeavourinthehighereducationsector.Earlyeventswithdevelopersandpractitionersfocusedonpilotprojectsandtrialwork.TheLACESoLARFlareinAutumn2015focusedonmovingfromresearchintopractice,withlearninganalyticsdeployedatscaleinDublinCityUniversity,NottinghamTrentUniversityandTheOpenUniversity.

Likewise,theEP4LAworkshopshaveshownmovementfrominitialawarenessoftherelevantissues,towardsthedevelopmentanddeploymentofcodesofpractice,suchastheJiscCodeofPracticeonLearningAnalyticsintheUK,1andofcoursetheLACEproject’sownDELICATEChecklist.

ThestrongdemandforLACEWP6partnerstopresentateventsorganisedbyothers–increasedinthissecondyear–showsthatthereisanincreasingappetiteinHEtomoveforwardintheareaoflearninganalytics.

FurtherreadingTheLAEPprojecthascapturedelementsofthestateoftheartoflearninganalyticsinacomprehensive,openlyaccessibleinventoryoflearninganalyticspolicies,practicesandtools.TheinventoryisavailableontheCloudworkssite,andanyonewhoregisters(freeofcharge)forthesitecanaddentriesorcommentonexistingentries

LAEPInventoryoflearninganalyticstools,policiesandpracticeshttp://cloudworks.ac.uk/cloudscape/view/2959

1https://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics

LACEDeliverable6.4–ReportonEventsv2

25

PressingissuesinlearninganalyticsDespitethisprogress,manychallengesremainiflearninganalyticsistoreachitsfullpotential.WorkwiththeLAEPproject(LearningAnalyticsforEuropeaneducationalPolicy)hasshownthat,inthecontextofEurope,workinthefieldneedstofocusonsevenareas.

1. Strategy:WorkonlearninganalyticsshouldbealignedwithEurope’sstrategicobjectivesandpriorityareasforeducationandtraining.Inordertomovethefieldforwardbothefficientlyandeffectively,weneedtodevelopaframeworkforlearninganalyticswithinEuropeandthensetupresearchandfundingprogrammesthatarealignedwiththeframeworkinordertoavoidduplicationofeffortandgapsinprovision.

2. Researchanddevelopment:Fourstrandsofworkareneededinthisarea.Theseare:todeveloppedagogiesthatmakegooduseofanalytics,analyticsthataddressstrategicobjectivesandpriorities,andbothtechnologiesandframeworksthatcanenabledeploymentofanalytics.

3. InfrastructureandCapability:Inordertodeploylearninganalyticseffectivelyinschoolsandhighereducation,Europeneedstoincreaseitsdatahandlingcapability,developorganisationalstructuresthatsupporttheuseoflearninganalytics,useanEvidenceHuborotherevidencerepositorytoidentifyareasfordevelopment,anddevelopmethodsofsharingexperienceandgoodpractice.

4. Context:Thesamelearninganalyticsandpracticescannotalwaysbedeployedindifferentsectors,andmayalsoneedtobeadaptedtosuitregionalpriorities.Learninganalyticsmustbeadaptedtoworkwithdifferentsectorsofeducation.Wealsoneedtodevelopandsharepracticesthatareappropriatetodifferentcontexts.Asdevelopingandimplementinglearninganalyticshasacostintermsofinfrastructureandstaffcosts,itisalsoimportanttoidentifyandsharesuccessfulfinancialmodels.

5. Standards:AtaEuropeanlevel,andatanationallevel,weneeddifferenttypesofstandardsinplacesothatlow-grade,unethicalorinaccurateanalyticsdonotblockthedevelopmentanduseofeffectiveanalytics.Thiswillinvolvedevelopingandemployingbothinteroperabilitystandardsandethicalstandards,developingopenapproachestolearninganalytics,aligninganalyticswithassessmentpracticesanddevelopingrobustqualityassuranceprocesses.

6. Skills:Useoflearninganalyticsrequiresawiderangeofpeople,includingendusers,todevelopnewskills.Afirststepwillbetoidentifytheskillsrequiredindifferentareas.Oncethishasbeendone,prioritieswillbetotrainandsupportresearchersanddeveloperstoworkinthisfield,developandsupporteducationalleaderstoimplementthenecessarychanges,trainandsupporteducatorstouseanalyticstosupportachievementandeducatelearnerstouseanalyticstosupporttheirownachievement.

7. Outreach:Ateachstageitwillbeimportanttoengageandinvolvestakeholders,supportcollaborationwithcommercialorganisationsandpromoteawarenessoflearninganalytics.

LACEDeliverable6.4–ReportonEventsv2

26

ConclusionWorkpackage6hassucceededinmeetingallitstargetsforoutreachandengagement.Indoingso,togetherwiththeotherLACEworkpackages,ithastakenaleadingroleinthedevelopmentoflearninganalyticsataninternationallevel.WithinEurope,ithasbeeninstrumentalinbringingtogetherthoseengagedinlearninganalyticsandinterestedinlearninganalyticsatbothnationalandinternationallevels.IthascatalysedworkintheareasofethicsandprivacyandhasbroughttogetherEuropean-fundedprojectsonlearninganalytics,whichwouldotherwisehaveworkedinisolationfromeachother.IthaspresentedhighqualityEuropeanworkinlearninganalyticstoaninternationalaudienceatthreeLAKconferences.IthasmadeconnectionswitheducatorsandpolicymakersinNorthAmerica,SouthAmericaandAsia–sharingexpertisedevelopedwithinEuropeandbringingbackinsightsdevelopedonothercontinents.IthasworkedwiththeLAEPprojecttodevelopanopen-accessinventoryofpolicies,practicesandtoolsthatactsasareferencepointforthefield.Itleavesalegacyofresources,manyofwhicharelinkedtointhisdocument,whichcanbeusedbythoseworkinginthefieldoflearninganalyticsacrosstheworld.Inaddition,ithasforgedlastingconnectionsbetweenkeystakeholdersacrossEurope–startingmanyconversationsthatwillcontinuelongaftertheLACEprojecthascometoanend.

LACEDeliverable6.4–ReportonEventsv2

27

About

VersionHistoryDate Notes Person2016-05-20 Firstdraft RebeccaFergusonandDougClow2016-05-23 Revisions,basedonreviewbyToreHoel RebeccaFerguson2016-05-31 Revisions,basedonreviewbyMarenScheffel DougClow2016-05-31 ClearedforsubmissiontotheEC HendrikDrachsler,MarenScheffel

AboutthisdocumentLicensedforuseunderthetermsoftheCreativeCommonsAttributionv4.0licence.Attributionshouldbe“byRebeccaFergusonandDougClowfortheLACEProject(http://www.laceproject.eu)”.

Formoreinformation,seetheLACEPublicationPolicyhttp://www.laceproject.eu/publication-policy/.

AboutLACETheLACEprojectbringstogetherexistingkeyEuropeanplayersinthefieldsoflearninganalytics&educationaldataminingwhoarecommittedtobuildingcommunitiesofpracticeandsharingemergingbestpracticeinordertomakeprogresstowardsfourobjectives.

Objective1–PromoteknowledgecreationandexchangeObjective2–IncreasetheevidencebaseObjective3–ContributetothedefinitionoffuturedirectionsObjective4–Buildconsensusoninteroperabilityanddatasharing

http://www.laceproject.eu @laceproject

ThisdocumentwasproducedwithfundingfromtheEuropeanCommissionSeventhFrameworkProgrammeaspartoftheLACEProject,grantnumber619424.