social class inequalities in general cognitive ability ...€¦ · data analysis outputs (e.g....
TRANSCRIPT
![Page 1: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/1.jpg)
Social Class Inequalities in General Cognitive Ability: Reflecting on a Transparent and Reproducible
Sociological Study
Roxanne [email protected]@ConnellyRoxanne
Vernon [email protected]@profbigvern
![Page 2: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/2.jpg)
![Page 3: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/3.jpg)
It’s a kind of scientific integrity, a principle of scientific thought thatcorresponds to a kind of utter honesty - a kind of leaning overbackwards. For example, if you’re doing an experiment, you shouldreport everything that you think might make it invalid—not only whatyou think is right about it…”
(Feynman 1974)
Feynman, Richard P. "Cargo cult science." Engineering and Science 37, no. 7 (1974): 10-13.
![Page 4: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/4.jpg)
![Page 5: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/5.jpg)
The Research
• Flynn (2012) makes an appeal for researchers to move beyondpsychology's standard disciplinary boundaries and to considersociological contexts, in order to develop a more comprehensiveunderstanding of cognitive inequalities
• We investigated social class inequalities in general cognitiveability test scores over time using existing cohort study data
![Page 6: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/6.jpg)
![Page 7: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/7.jpg)
Jupyter Notebook
• Open source web-based application
1. Live code (e.g. Stata or R code)
2. Data analysis outputs (e.g. modelling results, plots etc.)
3. Documentation (e.g. text describing and detailing the workflow)
![Page 8: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/8.jpg)
![Page 9: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/9.jpg)
![Page 10: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/10.jpg)
![Page 11: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/11.jpg)
![Page 12: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/12.jpg)
![Page 13: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/13.jpg)
Literate Programing
• A computer programming paradigm introduced by Knuth (1992)
• Computer code is written for humans not just for computers
• ‘Weaving’ – The process of generating a comprehensive documentabout a program and its maintenance
![Page 14: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/14.jpg)
Open Social Science Innovations
• Pair Programming
• Code Peer Review
![Page 15: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/15.jpg)
A Banana Skin…
Data providers don’t provide version control information
• Issue when you cannot openly share the data
• Share very detailed information about when the data weredownloaded (i.e. date and time)
![Page 16: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/16.jpg)
Removing a Banana Skin..
• Valuable ‘component code’ made public
e.g. social class measures, psychological scales, employment status variables
![Page 17: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/17.jpg)
Reflections
• Research ‘with our trousers down’
• Obvious benefits (transparency, duplication, replication)
• Is this our first ‘genuinely’ peer reviewed paper?
![Page 18: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/18.jpg)
Reflections
• Harder work?
• Re-orientation of the workflow
• Small step from private to public transparency?
• Can we teach old dogs new tricks?
• Incentives?
![Page 19: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/19.jpg)
Would we do it again?
![Page 20: Social Class Inequalities in General Cognitive Ability ...€¦ · Data analysis outputs (e.g. modelling results, plots etc.) 3. ... Literate Programing •A computer programming](https://reader031.vdocuments.us/reader031/viewer/2022011914/5fc0bdca38921a1301563694/html5/thumbnails/20.jpg)
• Access paper here: https://doi.org/10.1111/1468-4446.12343
• Or here: https://osf.io/preprints/socarxiv/szxdm/
• Or here: https://github.com/RoxanneConnelly/Social-Class-Inequalities-in-General-Cognitive-Ability-in-Two-British-Birth-Cohorts
We are indebted to the National Child Development Study and 1970 British Cohort Study participants. We are grateful to theCentre for Longitudinal Studies, UCL Institute of Education for the use of these data and to the UK Data Archive and Economicand Social Data Service for making them available. These organizations bear no responsibility for the analysis or interpretationof these data. This work was funded by the Economic and Social Research Council [Grant Number: ES/N011783/1]