big data, bad data -- closing keynote at the open world forum 2013

10
Big Data – Bad Data Rayna Stamboliyska, PhD Paris Descartes University RS Strategy

Upload: rayna-stamboliyska

Post on 09-May-2015

1.406 views

Category:

Technology


0 download

DESCRIPTION

In this talk, I partnered with Dr. Rand Hindi (Snips) and Romain Lacombe (French Prime Minister's Commission Etalab) addressing various facets surrounding Big Data. My point was to critically discuss common misconceptions in both Big Data meaning and analysis.

TRANSCRIPT

Page 1: Big data, bad data -- Closing keynote at the Open World Forum 2013

Big Data – Bad Data

Rayna Stamboliyska, PhD

Paris Descartes UniversityRS Strategy

Page 2: Big data, bad data -- Closing keynote at the Open World Forum 2013

XXXL Data

XXXL Issues

Page 3: Big data, bad data -- Closing keynote at the Open World Forum 2013

300 years BC: "of making many books there is no end"

1935-1937, Social Security Act

1943-1945, 'Colossus' & Enigma

1997: first mention of 'big data' in Application-Controlled Demand Paging for Out-of-Core Visualization (NASA)

“Is there anywhere on earth exempt from these swarms of new books?”

...

Page 4: Big data, bad data -- Closing keynote at the Open World Forum 2013

What is it?No, Big Data isn't new... but

Maximizing computation power and algorithmic accuracy

Drawing on a range of tools to analyse and compare large datasets

Believing large datasets give greater objectivity and accuracy

Page 5: Big data, bad data -- Closing keynote at the Open World Forum 2013

No, Data doesn't speak of itself

Page 6: Big data, bad data -- Closing keynote at the Open World Forum 2013

Numbers never lie... o rly?

* 51% of web traffic is non-human

* there are 30 million fake Twitter accounts

… poor bots on Thursday night :'(

Page 7: Big data, bad data -- Closing keynote at the Open World Forum 2013

Yes, Big Data discriminates between social groups

Scientists are allowing their assumptions about race to shape their big-data genomics research

If your past buying history indicates you are more likely to pay top euro for trousers, your starting price the next time you shop for clothes online might be considerably higher.

Page 8: Big data, bad data -- Closing keynote at the Open World Forum 2013

Big Data Fundamentalism?

There's a word for that: apophenia!

… Does big data change the erroneous 'correlation = causation' dynamic?

Page 9: Big data, bad data -- Closing keynote at the Open World Forum 2013

Math majors, rejoice!

''With big data techniques, you can get much closer to being able to predict causal relations.''

I beg to disagree

Your question and your data are not random entities.

Big Data needs several steps: ● of preparation● in interpretation

Page 10: Big data, bad data -- Closing keynote at the Open World Forum 2013

And...

If data are somehow subject to us, we are also subject to data