big data ethics - poolstok...with a lot of data, should be transparent, and should be updated...
TRANSCRIPT
![Page 2: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/2.jpg)
https://www.washingtonpost.com/opinions/its-okay-to-be-paranoid-someone-is-watching-
you/2018/03/27/1a161d4c-2327-11e8-86f6-
54bfff693d2b_story.html?noredirect=on&utm_term=.8a457c337d5d
![Page 3: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/3.jpg)
https://www.academicforecast.org/about
![Page 4: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/4.jpg)
https://www.academicforecast.org/about
![Page 5: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/5.jpg)
• Big data ethics = critical thinking
- Correlation is not causation
www.facebook.com/depoorterdries
![Page 6: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/6.jpg)
• Big data ethics = critical thinking
- Not everything that counts can be counted
![Page 7: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/7.jpg)
Outline
‛Ethical implications of:
‛1. Tracking employees (IoT)
‛2. Machine learning at work (AI)
![Page 8: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/8.jpg)
Quantifiedworkplace.eu
![Page 9: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/9.jpg)
Quantified workplace
• Presented as self-tracking but: also other-tracking
• Surveillance and coveillance
• Neo-Taylorism / Digital Taylorismo ‘The corporeal turn’
• Privacy and physical integrity
• Control versus Self-Determination Theoryo ‘Success’, ‘efficiency’, ‘productivity’
‛Gabriels, K., & Coeckelbergh, M. (2019, in press). ‘Technologies of the self and other’: How self-tracking
technologies also shape the other. Journal of Information, Communication and Ethics in Society 17 (2).
![Page 10: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/10.jpg)
https://www.businessinsider.com/amazon-patents-bracelet-that-tracks-workers-2018-2?r=US&IR=T
![Page 11: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/11.jpg)
Humanyze.com
![Page 12: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/12.jpg)
https://blogs.nvidia.com/blog/2016/07/29/whats-difference-artificial-intelligence-machine-
learning-deep-learning-ai/
![Page 13: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/13.jpg)
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., and Thrun, S. (2017). Dermatologist-level
classification of skin cancer with deep neural networks. Nature 542, pp. 115-118. Doi: 10.1038/nature21056.
![Page 14: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/14.jpg)
![Page 15: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/15.jpg)
‛“Algorithms are opinions embedded in code” (Cathy O’Neil)
https://www.theverge.com/2018/10/10/17958784/ai-recruiting-tool-bias-amazon-report
![Page 16: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/16.jpg)
![Page 17: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/17.jpg)
• Analyses (and correlations) with ‘bad’ datasets
• Algorithm is not inherently objective
• “statistical systems require feedback” (p. 7)- “Without feedback, however, a statistical
engine can continue spinning out faulty and
damaging analysis while never learning from
its mistakes” (p. 7)
• The model you are applying must be trained with a lot of data, should be transparent, and should be updated regularly
O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases Inequality and Threatens Democracy.
Broadway Books, New York.
![Page 18: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/18.jpg)
‛“you could argue that WMDs are no worse than the humannastiness of the recent past. (…) But human decisionmaking, while often flawed, has one chief virtue. As humanbeings learn and adapt, we change, and so do ourprocesses. Automated systems, by contrast, stay stuck in timeuntil engineers dive in to change them. (…) Big Dataprocesses codify the past. They do not invent the future.Doing that requires moral imagination, and that’s somethingonly humans can provide. We have to explicitly embed bettervalues into our algorithms, creating Big Data models thatfollow our ethical lead. Sometimes that will mean puttingfairness ahead of profit”‛(O’Neil, 2017, pp. 203-204)
![Page 19: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/19.jpg)
‛1. Codes of ethics and professional conduct• “the Hippocratic Oath ignores the on-the-ground pressure that data
scientists often confront when bosses push for specific answers”
(O’Neil, 2017, p. 206)
‛2. Strong regulation• “To disarm WMDs, we also need to measure their impact and
conduct algorithmic audits” (O’Neil, 2017, p. 208)
‛3. More research• Example: https://unbias.wp.horizon.ac.uk/
![Page 20: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/20.jpg)
• No blind faith in data set and algorithms
• Does the problem need a big data solution?
- If yes, look for an evidence based one- Importance of education and critical thinking- Importance of long term vision- Stakeholders have to be informed
![Page 21: Big data ethics - Poolstok...with a lot of data, should be transparent, and should be updated regularly O’Neil, C. (2016/2017). Weapons of Math Destruction. How Big Data Increases](https://reader034.vdocuments.us/reader034/viewer/2022042302/5eccf1cc184b0602ce22f74e/html5/thumbnails/21.jpg)
https://www.fatml.org/resources/principles-for-accountable-algorithms