8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 1/43
Predictive Learnin
Analytics: Fuelin ActionableIntelligence
2015 EDUCAUSE CONFERENCE
THURSDAY, OCTOBER 29, 2015
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 2/43
ShadPrincipalB!ine
$
John WhitmerDirect%r &%r Anal'tic an( Reearc)
Blac*+%ar( "nc
Josh BaronAitant -ice Prei(ent"n&%r.ati%n Tec)n%l%#'
&%r Di#ital E(!cati%n
Fueling Actionable
Intelligence
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 3/43
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 4/43
Special t)an* t% Ka&%r )elpin# t% &acilitate t
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 5/43
Shady ShPrincipal Dat
B!ine "ntelli#e
John WhitmerDirect%r &%r Anal'tic an( Reearc)
Blac*+%ar( "nc
Josh BaronAitant -ice Prei(ent"n&%r.ati%n Tec)n%l%#'
&%r Di#ital E(!cati%n
Fueling Actionable
Intelligence
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 6/43
Preentati%n Oerie
1 "ntr%(!cti%n an( C%nte3t 45 .in!te 6%)2 Data S%!rce, Releance 8 Dierit' 410
.in!te 6%)n7
:i&e C'cle 8 Cleanin# Data 410 .in!te S
; Strate#ic ".ple.entati%n C%ni(erati%n .in!te 6%)7
5 < 8 A 4All 15 .in7
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 7/43
39%Re&erence= "nte#rate( P%tec%n(ar' E(!cati%n Data S'te. 4"PEDS7 )ttp=>>ncee(#%>pr%#ra.>(i#et>(1;>ta+le>(t1;?2@10ap
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 8/43
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 9/43
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 10/43
Predictive
LearningAnalytics hel
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 11/43
"#arty$ yo are going to &ail IntroducPhysics dring yor sohomore year$sre yo see a ttor a&ter the (rst we
class and yo)ll ace the (nal e*am
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 12/43
What is Predictive LearniAnalytics! Predictive Learning Analytics= The statistical analyhistorical and current data derived from the learning pro
create models that allow for predictions that impro
learning outcomes.
A !+et %& lar#er learnin# anal'tic el(
Ue %p)iticate( .at)e.atical .%(el rat)er t)an !er
r!le
EA$P:E= Aca(e.ic Earl' Alert S'te. t)at !e pre(icti
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 13/43
-en Academic Analytics .nitiative /
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 14/43
JA1AP2AKASH$ S #$ #--41$ 5 W$ LA627A$ 5
J$ 258A$ J 2$ : BA2-$ J 4 /;<=>0
EAR:Y A:E RT OF ACADE$"CA::Y ATR"S STUDENTS=
AN OPEN SOURCE ANA:YT"CS "N"T"AT"-E
J-62AL -? L5A2.8 [email protected]$ =/=0$ C>D
$%re Reearc)
Fin(in#G
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 15/43
ant t)e late!p(ateI
Join the mailing listanal'ticJapere%%r#
(subscribe by sendingmessage to
analytics+subscribe@apeorg)
Aereo Learning Analytics.nitiative
Wi'iE )ttp=>>c%nK!encea*aipr%Lect%r#>3>r"B?B8itHFE )ttp=>>#it)!+c%.>Apere%:earnin#
Anal'tic"nitiatie
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 16/43
Data S%!rce,Releance 8Dierit'
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 17/43
:$S= Aca(e.ic Tec)n%l%#'/ Firt App
Fr%.=
E(en Da)ltr%., D C)rit%p)er Br%%*, an( 6acM!eline Bic)el
T)e C!rrent Ec%'te. %& :earnin# $ana#e.ent S'te. in Hi#)er E(!cati%n= St
Fac!lt', an( "T Perpectie Reearc) rep%rt :%!iille, CO= ECAR, Septe.+er 20
Aaila+le &r%. )ttp=>>e(!ca!ee(!>ecar
%!rce 4e # S"S7 are 'te.atic
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 18/43
%!rce 4e# S"S7 are 'te.atic,i#nicant pre(ict%r %& c%!re!cceI
Tric* M!eti%n= NONE
Hi#) Sc)%%l PAI Race>Et)nicitFirt in Fa.il' t% Atten( C%lle#e
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 19/43
Aca(e.ic Tec)n%l%#' Data i aS'te.atic Pre(ict%r %& C%!re S!cce
A!.in#, %& c%!re, t)at tec)n%l%#' i inte#rate( int% t)e c%!re in a (eep an( .
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 20/43
E.+e((in# Pre(ictie Anal't
Blac*+%ar( :earn SaaS Ultra C%!re -ie Dic!i%n F%r!. Critical T)in*in# $%Ra' :earnin# Anal'tic
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 21/43
Strate#ic ".p%rtance %t)er DP%int
S%!rce= Pe Reearc) Center, 201;
S%!rce= Caltatee
=
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 22/43
=c%.e in $an' Fla%r an(Releance
Activity /Behavioral0 4ata
Di#ital C%ntent
Per%nal Rep%ne S'te. 4Clic*er7
Strea.in# -i(e% Serer
e+ C%n&erencin#
Static 4ata
S!re' Data
St!(ent Aptit!(e
E3traC!rric!lar Actiitie
De.%#rap)ic Fact%r 8 Pri%r E(!cati%nal E3perience
Where /and when0 does the data (t into yor initiat
O!tc%.eI "nC%!re Pre(ict%rI Da' 0 Pre(ict%rI Tar#etin# Feat!re
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 23/43
Fact%r aQectin# #r%t) %&pre(ictie learnin# anal'tic
5naFler
onstraint
Widesr2are
Ne
e(!cati%n.%(el
Re%!rce
4,talent7
Data #%ernance4priac', ec!rit',
%ner)ip7
Clear #%alan( lin*e(
acti%n
Data al!e( inaca(e.ic(ecii%n
T%%l>'te. &%r(ata
c%.in#lin# an(anal'i
Aca(e.ictec)n%l%#'a(%pti%n
:% (ata M!alit'4(elit' it)
.eanin#&!l learnin#7
Dic!lt' %&(ata
preparati%n
N%t inente()ere 'n(r%.e
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 24/43
Pre(ictie Anal'tic,H% it %r*I)at i t)e (ata i.pactPREDI!I"E LEAR#I#$ A#AL%!I&: F'ELI#$ A!I(#A)LE I#!ELLI$E#E
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 25/43
H% Pre(ictie Anal'ticS'te. %r*I
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 26/43
H% it reall' %r*I
Hit%ricalData
Pre(ice $%
"t a &%!n( t)at in t)e lat 10 c%!re %Qerin# %& $at) 101, t!(ent )% iec%!re c%ntent in t)e rt .%nt) .%re t)an 100 ti.e, )i>)er nal #ra(e i %
@o Simli&ye ant t% pre(ict t!(ent (nal grade an( all (ata e )ae i corse content in t)e :$S e+ applicati%n
"np!t= %& c%!re c%ntent ie t% :$SO!tp!t= Final ra(e
Pre(ictie Anal'tic
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 27/43
H% it reall' %r*I 4c%nt7
Pre(icti
e $%(el
Ne
Data
C!rrent OQerin#%& $at) 101
A&ter t)e rt .%nt), pre(ictie .%(el can pr%i(e pre(icti%n %& t)#ra(e +ae( %n t)e %& c%ntent ie %& t)e t!(ent in t)e c!rren
%Qerin# %& $at) 101
Pre(icti%n
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 28/43
E3a.ple %& )at can #%r%n#I
What i& stdents are viewing the content &rom #oFile Al
Data i n%t c%.plete
What i& one o& the historical corse has hndreds o& corsewhere other corses have tens o& corse toics!
Data i n%t acc!rate
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 29/43
)at (%e t)at .eanI
Predictive Analytics Systems are 4ata 4Systems
ar+a#e in, ar+a#e %!t
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 30/43
)' Data <!alit'I
Poor data quality is costly. It lowers customsatisfaction adds e!pense and ma"es it more to run a business and pursue tactical improvem
such as data warehouses and re$engineerin
T)%.a C Re(.an
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 31/43
Data <!alit' Acc!rac'
T)e (ata a rec%r(e( c%rrectl'
C%.pleteneAll releant (ata a rec%r(e(
UniM!eneEntitie are rec%r(e( %nce
Ti.eline T)e (ata i *ept !p t% (ate an(
in&%r.ati%n i aaila+le %n ti.e
C%nitenc' T)e (ata a#ree it) itel&
-ali(it' T)e' .ea!re )ainten(e( t% .ea!
Relia+ilit' T)e (ata are .eac%llecte( c%niten(eniti%n an(.et)%(%l%#ie are%er ti.e
"nte#rit' T)e (ata are pr%te.anip!lati%n &%r a
r # pace ! en !cce
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 32/43
r # pace ! en !cceS'te.Bet P%ter Aar( 4:A 20157
r # pace ! en !cceS
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 33/43
r # pace ! en !cceS'te.Bet P%ter Aar( 4:A 20157 4c%nt7
r # pace ! en !cceS t
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 34/43
r # pace ! en !cceS'te.Bet P%ter Aar( 4:A 20157 4c%nt7
Hi#)er ED "ntit!ti%n 45V@W t!(ent7
Pre(icti%n Err%r %er ;5 c%!re X 012
0 5 10 15 20 25
0
002
00;
00@
00W
01
012
01;
01@
01W
02
Average Prediction 5rror over the wee's
0 2 ; @ W 1
0
0,05
0,1
0,15
0,2
0,25
Average o& Prediction 5r
C%lle#e "ntit!ti%n 412V0
Pre(icti%n Err%r %er @
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 35/43
Data Strate#'
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 36/43
Data Strate#' 4c%nt7
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 37/43
Strate#ic".ple.entati%nC%ni(erati%nPREDI!I"E LEAR#I#$ A#AL%!I&: F'ELI#$ A!I(#A)LE I#!ELLI$E#E
Strategic .mlementation
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 38/43
Strategic .mlementationonsiderations
=.nstittionalStages o&
Analytics 6sage
38aining Access
to Learning4ata
>5thics :Privacy
;-rganizatioLeadershi
ltre : S
.nstittional Stages o&
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 39/43
.nstittional Stages o&Analytics 6sage
Basic AnalyticsRep%rt %n pat tren( an( (ata %+erati%n
Atomated AnalyticsA!t%.aticall' per&%r. anal'tic an( pr%i(ere!lt (irectl' t% en(!er
PredictiveAnalyticsUe lar#e a.%!nt %& )it%rical (atacreate pre(ictie .%(el
-rganizational Leadershi
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 40/43
-rganizational Leadershiltre : S'ills Hain# a eni%r %r#aniati%nal c)a.pi%n can +e critical
Brea*in# (%n (ata il% an( !pp%rt p%lic' c)an#e
A((rein# re%!rce reM!ire.ent
Deel%p a (ata(rien (ecii%n .a*in# c!lt!re
Hain# (iii%n, &ac!lt' an( t!(ent c)a.pi%n i al% i.
C%%r(inati%n %n (ata e3tracti%n, tran&%r.ati%n an( l%a(in#
Ait it) c%..!nicati%n acr% entire c%..!nit'
"netin# in ne *ill et i an i.peratie ee rep%rt &%pecic
8raining Access to Learni
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 41/43
8raining Access to Learni4ata Learning 4ata= Data pr%(!ce( +' learner a t)en#a#e in t)e learnin# pr%ceE3a.ple= c%!re #ra(e, PA, li+rar' (ata, :$S eent(ata, tet c%re
:earnin# (ata i t)e &!el %n )ic) :A r!n
Acce can +e an i.ple.entati%n +arrierData .a' )ae n%t +een inten(e( &%r :A !e %ri#inall'
C)allen#e e3tractin# (ata &r%. cl%!(+ae( SaaS
Data in l%cal 'te. can +e )i((en %r encr'pte(
E3tractin# a.ple (ata et i %&ten a #%%( tart
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 42/43
5thics and Privacy 5thics= Uin# :A &%r #%%( an( n%t eil
Privacy= Balancin# t)e nee( t% pr%tect c%n(enrec%r( )ile .a3i.iin# t)e +enet %& :A
O&ten reM!ire ne p%licie an( pr%ce(!re
:earnin# Anal'tic ta* &%rce t% a((re et)ic
priac' i!e 6ic C%(e %& Practice )ttp=>>Licac!*>#!i(e>c%(e%&pralearnin#anal'tic
SURF :earnin# Anal'tic S" )ttp=>>!r&pacenl>i#>1Wanal'tic>9et)ic>
8/20/2019 Predictive Learning Analytics: Fueling Actionable Intelligence (288265247)
http://slidepdf.com/reader/full/predictive-learning-analytics-fueling-actionable-intelligence-288265247 43/43
Josh Baron= JoshBaronGmaristed
John WhitmerE JohnWhitmerGFlac'Foardco
Shady ShehataE ShadyShehataG4;Lcom
Let)s @al'+