Michigan Institute for Data Science (MIDAS) Overview!Al Hero and Brian Athey!

MIDAS Co-directors !

midas.umich.edu!

The Future of Data Science: A Convergence of Academia, Industry, and Government Speakers!!October 6, 2015!

!"#$%&'&$()*+,)+-$$!"#$,./-$

•! Information Explosion: Big Data methods of knowledge discovery are transforming all academic disciplines!

!•! Educational Transformation: Digital data and information are

transforming teaching, learning, and knowledge creation!!•! Societal Demands: New technical, social, and political solutions are

required to address emerging privacy and security issues !!•! Industry and Social Sectors Desire: A new class of knowledge worker

– the data science trained domain specialist!!•! Cloud and Mobile Solutions: Data Science Services and

infrastructures that are modern, adaptable, and cost-e"ective!

%&'&$0.1+2$*,$3&,#$4.512$&'$6$.7$3$

http://blogs.cdc.gov/!

Electronic Health Records !(UMHS)!

Annotated images/videos!(UMENG)!

http://web.eecs.umich.edu/~jjcorso!

Electronic Sensor Data (UMTRI)!

!

http://www.umtri.umich.edu/content/rr_45_2.pdf!

Social Media Feeds!(UMSI)!

http://socialmedia.umich.edu/!

http://www.sca.isr.umich.edu/!http://www.sca.isr.umich.edu/http://www.umtri.umich.edu/content/rr_45_2.pdf

Economic/Financial Data (UMISR)!

!

Open Tree of Life!(UMLSA)!

Lab of Stephen A. Smith | http://blackrim.org!

Trans. Res. Institute!>1 petabyte cts data from >9000 vehicles!

School of Information!>1 petabyte cts Twitter feed data!

S. Smith -Ecol&EvolBio!>2-3 million species over 3.5 Billion years!

Institute for Social Res!>7000 digital social science data sets!

UM Health System:!15 years and >4.91M unique patient records!

ImageNet: !>10M images w/ 10K synsets!

CVPR A2D Actor Action Dataset!

Jason Corso -EECS!4000 videos with a total 2.5M frames!

Library/Data repositories!(UM-Libraries)!

81.9,'$.7$:;.<&;$%&'&$*2$:5./*,=$>?@.,+,A&;;#$Jo

hn A

liiso

n, M

at. S

ci a

nd E

ng !

!Materials Genome Initiative!

(UM-ENG) !

!!

Registered OA Repositories!Social media users!

Twitter Rumor Tracking!(UM-SI)!

Qia

ozhu

Mei

, SI!

Twitter firehose generates!10,109 Tweets/sec!

!!

146893430

13,250,648 volumes!47,073,334 digital records!9,261,111 downloads!! 85,000 items!

Library/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositories(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)(UM-Libraries)

13,250,648 volumes

Library/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositoriesLibrary/Data repositories

9,261,111 downloads9,261,111 downloads9,261,111 downloads

13,250,648 volumes

Open access library !and data repository!

13,250,648 volumes47,073,334 digital recordsrecords9,261,111 downloads9,261,111 downloads9,261,111 downloads9,261,111 downloads9,261,111 downloads

85,000 items9,261,111 downloads

2,227,787 books from US libraries!145,227 from US Lib Congress!

205,046 from UM Library!!

Materials Science!

160,000 Engineering materials!Multiscale multiphysics!

!!

!!

Cambridge Structural Database!

http://www.dstevenshite.com!

81.9,'$.7$B+&;'"$&,C$D*7+$()*+,)+$%&'&$*2$&;2.$$

:5./*,=$>?@.,+,A&;;#$

Abecasis, Nature 2015!

Human genetic diversity!(UM-SPH) !

Gene sequencing!!

National Library of Medicine!

Ontologic Data integration!Yonqun He, Medical School!

!

OBO Foundry Data Servers!155 ontologies, 1,768,134 terms, 100K users!

deposit!

GSE00001!

GSE00002! GSE00003!

GSE00004! GSE00005!

# of Samples: 1345828!

The Cancer Genome Atlas (TCGA)!

NCBI GEO Flat Data Repository!

NCI Integrated Dataset!

Nature Genetics 45, !1113–1120 (2013)!

%*1+,2*.,2$.7$%&'&$E$'"+$F$GH2$.7$IJ*=$%&'&K$

http

://w

ww

.slid

esha

re.n

et/

ibm

sver

ige/

build

ing-

confi

denc

e-in

-big

-dat

a!

Cost of e"ciently!processing the!growing Volume!

Collectively analyzing !the broadening Variety!

Responding to the !increasing Velocity!

10,109 tweets/sec! 50,659 searches/sec!107,000 videos/sec!

Establishing/managing !data source Uncertainty !

iPhone GPS error: 8m !!e-survey resp. rate: 25% !!% not trusting data: 33% !

Data at Scale Data in Many Forms Data in Motion Data Uncertainty Terabytes to

petabytes of data Structured, unstructured, text

multimedia Analysis of streaming data To enable decisions within

Fractions of a second.

Managing the reliability and Predictability of inherently

Imprecise data types.

Volume Variety Velocity Veracity

Cost of e"ciently Responding to the

L@+,$(.95)+$(.M/&5+$*2$%*N+52+$&,C$:5./*,=$

https://www.oreilly.com/ideas/2015-data-science-salary-survey! !!"#$%&'()%*+%,'-(%&'(./)&"0.1,(2'%&34"32'%&(•! 5%-4'&(*"/)64%7"1(%18(9':'&(/'/"&2(/%1%,'/'14(•! ;':'&()%*+%,'(*6&%7"1(%18(.14'&")'&%9.<.42(•! ="&'(8%4%(8.%,1"-7*-(%18(8%4%(*<'%1.1,(>'%46&'-(•! ="&'(&'<.%9<'(8%4%(%1%<2-.-(%18(8%4%(0.-6%<.?%7"1(

%&'&$()*+,)+$D*+2$&'$'"+$39;AC*2)*@;*,&5#$

O,'+57&)+$

Computer Science

Mathematics

Engineering & Natural Sciences

Information Science

Application domains

Statistics

DATA SCIENCE

(.1+$P9+2A.,2$8CC5+22+C$<#$%&'&$()*+,)+$

(•! @%4%(*"<<'*7"1(•! AB%4(.-(6<7/%4'(0%<6'(">(%(8%4%(-"6&*'(4"('1836-'&C(•! D"$(9'-4(4"(>6-'(8%4%(>&"/(8.0'&-'(-"6&*'-C(

•! @%4%(/%1%,'/'14(•! D"$(9'-4(4"('E*.'14<2(-4"&'F(%11"4%4'(%18()&"4'*4(4B'(8%4%C(•! D"$(9'-4(4"(0'&.>2()&"0'1%1*'G0'&%*.42(">(8%4%C(

•! @%4%(H1%<2-.-(•! D"$(9'-4(4"()&"*'--(%18(%1%<2?'(*"/)<'I(8%4%C(•! D"$(9'-4(4"(-6//%&.?'(%18(0.-6%<.?'(*"/)<'I(8%4%C(

•! D"$(4"(%64"/%4'(8%4%34"38'*.-."1().)'<.1'C(

!

%&'&$()*+,)+$Q&5&C*=1$

•! Q5*,)*@;+2(>"&(46&1.1,(*"/)<'I(8%4%(.14"(.1-.,B4-(%18(8'*.-."1-(•! 3+'".C2(>"&(8%4%(*"<<'*7"1F(/.1.1,F(/%1%,'/'14F(%18(%1%<2-.-(

Complex!Data!

Decisions!Relevant !

information!

analysis!

Insights!Pascal Van Hentenryk, Dept IOE Univ of Michigan!!

%&'&R'.RS,./;+C=+$Q*@+;*,+$TUVVWX$

http://www.aaai.org/aitopics/assets/PDF/AIMag17-03-2-article.pdf!

Data sources!are centralized !

!

All data!Is stored !locally !

!

Data is homogeneous!

and small!

Data is !structured!

as simple list !! !

Algorithms are primitive by!

today’s standard !

Processing not!designed for!

Decision making!!

%&'&R'.R%+)*2*.,$@*@+;*,+$TYZU[$&,C$J+#.,CX$

Data Acquisition

Information Extraction

and Cleaning

Integration Aggregation

Representation

Modeling & Analysis

Interpretation

Heterogeneity (Variety)

Heterogeneity Scale (Volume)

Scale Timeliness (Velocity)

Reliability (Veracity)

Relevance (Value)

Human Collaboration

Privacy and Data

Ownership

DATA

Sensors!

Local storage!

Crowdsourcing Human-in-the-loop!Expert knowledge!

Acquisition and Cleaning and Cleaning Representation Representation

& Analysis

Collaboration

Local storageLocal storageLocal storage

Interpretation Machine Learning!

& Analysis

Cloud services!

INSI

GHTS

& D

ECIS

IONS

%&'&$()*+,)+$3+'".C.;.=*+2$

Mathematics! Statistics!Computer Science!Computer Science

%&'&$()*+,)+$3+'".C.;.=*+2$

Physics!

Mark Newman, UM Physics!

Engineering!Engineering

http://en.wikipedia.org/wiki/Control_theory!

Information Science!

http://um3d.dc.umich.edu/visualization/!

http://dspace.org/sites/dspace.org/!

6R3$*2$'"+$OC+&;$>).2#2'+1$7.5$%&'&$()*+,)+$

• UM has some of the largest corpora of data and data analytics–! Transportation and energy data (UMTRI, EI)!–! University student records!–! Electronic health records and patient testing data (UMHS)!–! Social media feeds (SI) and economic data (ISR, ICPSR, Ross)!–! Astronomy, earth sciences, materials, and phylogeny data (LSA,

SNRE) •! Top ranked educational programs in data science disciplines!

–! Electrical Engineering and Computer Science, Mathematics, Statistics…

•! High level of engagement with business and industry!•! Location in a region with a vibrant rapidly & ! diversifying economy

!