big data, big flops: the gag reel of algorithms
TRANSCRIPT
TheDangerZone
4/20/16 J.S.Ramos(@xuxoramos) 3
ComputerScience Math&Stats
DomainExperience
DangerZone!
Whenprogrammersdelveinto“StatisticalLearning”withoutlearningstatistics. Asktherightquestions
ModelReality
OpsAnalytics
StatisticalLearning
DataSciencePredict
Reality
BigFlop1
4/20/16 J.S.Ramos(@xuxoramos) 5
“Famouscellphonecompanycreatescreditproductsforpossiblecriminalsuspects.”
BigFlop2
4/20/16 J.S.Ramos(@xuxoramos) 6
“Googleimageclassifiertagsphotosof2african-americansas‘Gorillas’”.
BigFlop3
4/20/16 J.S.Ramos(@xuxoramos) 7
“GoogleFluTrendspredictsinfluenzaoutbreaksbasedsolelyonsearches.Nothinghappens.”
Rootcause
4/20/16 J.S.Ramos(@xuxoramos) 10
Surveyof+200dataprofessonals.Thosecomingfromsoftwaredevelopmenthaveanegativecorrelationwithbusiness.Whenthisredcloudturnsintoadeepblueovalwithpositiveslope,AnalyticswillandmustbeborninIT.
Howdoweturnintoanalysts?
4/20/16 J.S.Ramos(@xuxoramos) 11
• Honeyourstats,mathsandoptimizationskills.Startwith
matrixalgebra.
• Read“ThinkStats”byAllenDowney.
• Stopautomatingcustomsandstartimprovingprocesses.
• Getclosertoyourbusinessandlearnitslanguage.
• LearnR.It’sugly,butwillgetyouthinkinginstats.
• Don’tcodemachinelearningwithoutlearningstats!
4/20/16 J.S.Ramos(@xuxoramos) 12
“ForgetRvsPython.Thebestlanguagefordataanalysis,[regardlessofscaleorsophistication],isthelanguageofbusiness!”
@jokame
Conclusion1
4/20/16 J.S.Ramos(@xuxoramos) 13
“Realitydoesnotrevealitselftothosewhoonlycontemplateit,buttothosewhoimmerseinittotransformit.”
OctavioPaz,TheLabyrinthofSolitude
Conclusion2