seminario emadrid/sheila sobre "analítica del aprendizaje". el papel de la ética y la...
TRANSCRIPT
TheDELICATEchecklistinac3onApplyingEthics&PrivacyPoliciestoaLearningAnaly6csDashboard
HendrikDrachsler|@hdrachsler|#laceprojecteMadridconference,21.10.2016,Madrid,Spain.
LearningAnaly3cs
HEManagerssee:• Promisevs.Concerns• Poten6alvs.Risks• Benefitsvs.Cost• Purposevs.Compe66vePressures• Inten6onsvs.Hesita6ons
• LeadingtoConfusion
HEIs:HowtoimplementLA?
Ins3tu3onalisingLA
Recentset-backsineduca6on:• (1)inBloom• (2)Snappet
Acceptancefactors:Datasubjectsbeingsufficientlyawareoftheconsequencesofusingthesystem,thevalidityandrelevanceoftheresultsobtained,andtheleveloftransparencyofthedatamodel.
5
• $100millioninvestment• Aim:Personalizedlearninginpublicschools,throughdata&technology
standards• 9USstatespar6cipated,in2013dataaboutmillionsofchildren
havebeenstored
PrivacyasShow-StopperforLA
6
PrivacyasShow-StopperforLA
Ignoringthefearsandpublicpercep3onoftheapplica6onofanaly6cscanleadtoalackof
acceptance,protests,andevenfailureofen6reLAimplementa6ons.
7
RelatedResearchWork
Prinsloo&Slade(2013)Slade&Prinsloo(2013)Pardo&Siemens(2014)Prinsloo&Slade(2015)Hoel&Chen(2015)Sclater,Bailey(2015)Steiner,Kickmeier-Rust,Albert(2015)
hNp://bit.ly/lace-privacy.
8
RelatedPolicies
h]p://www.open.ac.uk/students/charter/essen6al-documents/ethical-use-student-data-learning-analy6cs-policy#
h]ps://www.jisc.ac.uk/sites/default/files/jd0040_code_of_prac6ce_for_learning_analy6cs_190515_v1.pdf
9
RelatedPolicies
h]p://www.ed.ac.uk/informa6on-services/learning-technology/learning-analy6cs
10
RelatedPolicies• HEIlawondatacollec6oninNLlikeinall
EUcountriessinceNurembergtrials(datacollec6onallowedtoimproveeduca6on,clearpurpose,consent,limitedaccess)
• Engelfriet,A.,Jeunink,E.,Manderveld,J.(2015).Learninganaly3csonderdeWetbeschermingpersoonsgegevens.h]ps://www.surf.nl/kennis-en-innova6e/kennisbank/2015/learning-analy6cs-onder-de-wet-bescherming-persoonsgegevens.html
• SURFfollow-upreportwithusecasesinprepara6on
ResearchEthics
Originslieinpost-WWII.–Milestones:• NurembergCode(1949)• HelsinkiDeclara6on(1964)• BelmontReport(1978)• 2000s:BiomedicalScience• RRI(ResponsibleResearchandInnova6on)
UnethicalResearch
MilgramExperiment
StanfordPrisonExperiment
FacebookStudy
Privacy
• Therighttobeleialone(Wes6n1968)• Informa6onalself-determina6on(Flaherty1989)
• Informa6onal,decisional,localprivacy(Roessler2005)
• Privacyisnotanonymityordatasecurity!
Privacy
Contextual Integrity vs. Big Data Research
Context bound information vs.
Repurposing of data
WhoaretheBadGuys?
ME&
MYDATAGovernment? Commerce?
Educa6on? Hackers&BadGuys?
LegalFrameworks
• EUDataProtec6onDirec6ve95/46/EC(automatedprocessingof‘personaldata’)2016:GeneralDataProtec6onRegula6on(GDPR)
• Restric6ngthe(re-)useofdataà vs.andcontradic6ng• BigDatabusinessmodels• EuropeanDataReten6onDirec6ve2006/24/EC(datastorageforsecuritypurposes)
Moderniza3onofEUUniversi3esreportRecommenda3on14MemberStatesshouldensurethatlegalframeworksallowhigher
educa6onins6tu6onstocollectandanalyselearningdata.Thefullandinformedconsentofstudentsmustbearequirementandthedatashouldonlybeusedforeduca6onalpurposes.
Recommenda3on15Onlineplapormsshouldinformusersabouttheirprivacyanddata
protec6onpolicyinaclearandunderstandableway.Individualsshouldalwayshavethechoicetoanonymisetheirdata.
hNp://ec.europa.eu/educa3on/library/reports/modernisa3on-
universi3es_en.pdf
19
LegalFrameworks
h]ps://studentprivacypledge.org/
20
LegalFrameworks
Fears
• Power-rela6onship,userexploita6on• Dataownership• Anonymityanddatasecurity• Privacyanddataiden6ty• Transparencyandtrust
Power-rela3onship
• Trackingandid-ingusersorci6zensbystateorcorpora6ons(e.g.insurancecompanies,banks,carmanufacturers,etc.)=benefitnottotheuser!
• Power-rela6onshipisasymmetrical
Exploita3on
• Freelabourasbusinessmodeloffor-profitcompanies
• Crowdsourcingoutsidethe„commons“
DataOwnership
DataOwnership
DataOwnership
AnonymityandDataSecurity
• Noabsoluteanonymityorde-iden6fica6on
• Integra6onofmul6pledatasourcesincreasecompromisedpersonaliden6ty
• Datastoresarenot100%secure
PrivacyandDataIden3ty
• Systemiden6tyvs.Socialiden6ty• Peopleapproximatedontodatamodelsbyprobability
• Power:datasubjectshavenosayinthedesignofdatamodel
TransparencyandTrust
• Assump6on:moretransparency=moretrust• But:rela6onshipismostlyasymmetrical(individualvs.bigcorpora6on)
• Transparencyasinstrumentofcontrol
Introducing:DELICATE
• Isnotreplacingdeepthoughts!
• Checklistforquickdataconversa6ons
• TofacilitatetrustedLA
• Guidefordatascien6sts,decisionmakers
• Inspiredbymedicalchecklistsforpa6entinforma6on
Introducing:DELICATE
Introducing:DELICATE
Introducing:DELICATE
Puh,heavytobacco!Ques3onsfornow?
LASER - Learning Analytics !for Sustaining Europe’s Resources !Groupawarenessforstudentsincollabora3velearningenvironments
Welten: Hendrik Drachsler, Maren Scheffel, Karel Kreijns, Aad Slootmaker MST: Joop de Kraker
AfirstLearningAnaly3csapplica3onthatfollowedtheDELICATEchecklist.
Context!
Project aims: • Stimulating awareness and reflection by visualising platform
activities • Getting insights into effects that visual of learning analytics
feedback may have on individuals and groups
Expected Outcomes: • Fostering awareness and reflection for students and tutors • Improving engagement with the platform • Improving team performance and group atmosphere • Reducing conflicts in the groups
EVS: Platform!Developed and Open Source Widget that provides:
– Awareness of and reflection on individual performance – Awareness of and reflection on group performance
• Hurdle: pass the ethics board
• Solution: reciprocal relations
g r o u p p e r f o r m a n c e
The Activity Widget!Cumula3veView PeriodicView
DELICATEfortheLADashboard
DELICATEfortheLADashboard
DELICATEfortheLADashboard
Reciprocal Relationship!
The Widget!
The Widget!
The Widget!
The Widget!
Andnowguess,howmanyofthe45studentswantedtheirdatahidden?
Lessons-Learned!1. E&Pispartofthegame2. GeneralDataProtec3onRegula3onatdefinesseriousfees
andrights.Privacy->asservices3. WefollowE&Pguidelinesfortheonepersonthatneeds
thatprotec6on4. WidgetneedstobefurtherdevelopedtowardsDELICATE
checklist• Studentsneedtobeabletogetfullaccesstotheirdata• PreventrepurposingofwidgetormakeotherpurposestransparentUsingthewidgetforassessment