![Page 1: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/1.jpg)
“Learn from details, act global”
Statistics Netherlands and Big Data
Marco Puts
![Page 2: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/2.jpg)
Big Data Team
2
Martijn Tennekes
Piet Daas
Joep Burger
Marco Puts
![Page 3: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/3.jpg)
From Survey to Big Data
Primairy data Secondary data
Our ‘own’ surveys Data from ‘others’ - Administrative sources
- Big Data
Statistics Netherlands
![Page 4: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/4.jpg)
4
Big Data: Another Perspective
The internet
had 1800
exabytes of
data in 2011
exa = 10^18
NOW IDC/EMC white paper 2008
![Page 5: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/5.jpg)
CES 2011 Geneva
5
Data Deluge: 50.000 EXAbytes in 2020
We live in exponential times
27 fold growth in the next 9 years
![Page 6: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/6.jpg)
Stategic Aspects of Big Data
Statistics at Statistics Netherlands
• Known and good quality
• Slow
Statistics at commercial institutes
• Unknown Quality
• Fast
Bigger urge for Fast and Reliable Statistics
Data deluge
Attention for positioning Statistics
Netherlands w.r.t. Big Data
6
![Page 7: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/7.jpg)
Big Data Organization: the Roadmap
Strategic importance of Big Data
Responsibility at DG level
Roadmap Big Data: o Mobile phone data
o Traffic loop data
o AIS
o Social Cohesion
Half-yearly update of Roadmap
Coordination Group Big Data
7
![Page 8: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/8.jpg)
Isues
Used Methods
Stability of Sources
Representativity
Privacy
Usability
Infrastructure
Knowledge and Skills
Unknown or nonmatching Metadata
Quality of big Data
8
![Page 9: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/9.jpg)
Big Data Processes Data driven vs. output driven
9
Stats Big Mess of Data
![Page 10: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/10.jpg)
Quality of Big Data The Signal and the Data
10
Manually
Automatic
Q Q
Process parameters
Data Signal
Noise
![Page 11: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/11.jpg)
Big Data Team Backgrounds
11
Martijn Tennekes
Piet Daas
Joep Burger
Marco Puts
Biology Bio-informatics
Computer Science Cognitive Science Psychophysics
Biology
Knowledge engineering
![Page 12: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/12.jpg)
Secret of our Success
Experimental Skills
Explorative Research
Artificial Intelligence
Computer science
12
![Page 13: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/13.jpg)
Some Data sources and Projects
13
Sentiment on social media o “Consumer Confidence”
o Safety indicator
Road Sensor Data o Traffic intensities
AIS data (Automatic Identification System for Vessels) o ESSnet
o Maritime traffic around the Netherlands
o Inland waterway traffic
o Emissions of vessels
Mobile phone meta data o Daytime population
o Tourism
Social Cohesion o Relationship between people on social media
![Page 14: Statistics Netherlands and Big Data › dokument › 8685 › Statistics-Netherlands...Big Data Team 2 Martijn Tennekes Piet Daas Joep Burger Marco Puts From Survey to Big Data Primairy](https://reader033.vdocuments.us/reader033/viewer/2022060423/5f19839032ecb933ec05f602/html5/thumbnails/14.jpg)
The Future
The future
of statistics
looks
BIG 14