tweetment effects on the tweeted: an experiment to reduce...
TRANSCRIPT
![Page 1: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/1.jpg)
Tweetment Effects on the Tweeted: An Experimentto Reduce Twitter Harassment
Kevin Munger
NYU
December 1, 2016Prepared for Yale Human Nature Lab
![Page 2: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/2.jpg)
Project Outline
Find harassers on Twitter
Randomize assignment 2x2I In-group v Out-group (race of bot)I High Status v Low Status (number of followers)
Offensiveness as outcome variable
See how long the treatment persists
![Page 3: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/3.jpg)
Project Outline
Find harassers on Twitter
Randomize assignment 2x2I In-group v Out-group (race of bot)I High Status v Low Status (number of followers)
Offensiveness as outcome variable
See how long the treatment persists
![Page 4: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/4.jpg)
Project Outline
Find harassers on Twitter
Randomize assignment 2x2I In-group v Out-group (race of bot)I High Status v Low Status (number of followers)
Offensiveness as outcome variable
See how long the treatment persists
![Page 5: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/5.jpg)
Project Outline
Find harassers on Twitter
Randomize assignment 2x2I In-group v Out-group (race of bot)I High Status v Low Status (number of followers)
Offensiveness as outcome variable
See how long the treatment persists
![Page 6: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/6.jpg)
Why does it happen?
Prejudice
Social Identity model of De-Individuation (SIDE)
Girard’s theory of mimetic desire
![Page 7: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/7.jpg)
Why does it happen?
Prejudice
Social Identity model of De-Individuation (SIDE)
Girard’s theory of mimetic desire
![Page 8: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/8.jpg)
Why does it happen?
Prejudice
Social Identity model of De-Individuation (SIDE)
Girard’s theory of mimetic desire
![Page 9: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/9.jpg)
State of the art
Experiments in the lab
I Convenience samples
I Short time frame
I In the lab
![Page 10: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/10.jpg)
State of the art My Approach
Experiments in the lab Experiment in the “field”
I Convenience samples Sample of real, consistent harassers
I Short time frame Continuous and unbounded time frame
I In the lab In the same context as the harassment
![Page 11: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/11.jpg)
Find harassers
Needs to be fast, and accurate
Don’t care about recall
In the presence of strongly offensive language, a dictionary of slursis best (Chen et al, 2012)
![Page 12: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/12.jpg)
Find harassers
Needs to be fast, and accurate
Don’t care about recall
In the presence of strongly offensive language, a dictionary of slursis best (Chen et al, 2012)
![Page 13: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/13.jpg)
Find harassers
Needs to be fast, and accurate
Don’t care about recall
In the presence of strongly offensive language, a dictionary of slursis best (Chen et al, 2012)
![Page 14: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/14.jpg)
Detection “Algorithm”
Include Exclude
StreamR finds a tweet with“nigger”
Is the tweet with the slur an “@”-reply? EXCLUDE
Is the user’s offensiveness scoreabove the 90th percentile? EXCLUDE
Is the user an adult white man? EXCLUDE
Manually inspect history of inter-action between user and subject ofharassment–do they appear to begenuinely harassed?
EXCLUDE
Assign to a treatment conditionsubject to balance constraints
![Page 15: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/15.jpg)
Apply Treatment
![Page 16: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/16.jpg)
Treatment uptake
![Page 17: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/17.jpg)
Hypotheses
All hypotheses have been pre-registered through EGAP.
Hypothesis
The ranking of the magnitudes of the decrease in harassment will be:In-group/High status > In−group/Low status
Out−group/High status> Out-group/Low status.
Table: Experimental Design and Hypothesized Effect Sizes
In-group Out-groupLow followers Medium effect Small effect
High followers Large effect Medium effect
![Page 18: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/18.jpg)
Hypotheses
All hypotheses have been pre-registered through EGAP.
Hypothesis
The ranking of the magnitudes of the decrease in harassment will be:In-group/High status > In−group/Low status
Out−group/High status> Out-group/Low status.
Table: Experimental Design and Hypothesized Effect Sizes
In-group Out-groupLow followers Medium effect Small effect
High followers Large effect Medium effect
![Page 19: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/19.jpg)
Hypotheses
All hypotheses have been pre-registered through EGAP.
Hypothesis
The ranking of the magnitudes of the decrease in harassment will be:In-group/High status > In−group/Low status
Out−group/High status> Out-group/Low status.
Table: Experimental Design and Hypothesized Effect Sizes
In-group Out-groupLow followers Medium effect Small effect
High followers Large effect Medium effect
Hypothesis
The decrease in offensive language will be smaller in subjects whoprovide less information in their profile.
![Page 20: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/20.jpg)
Hypotheses
All hypotheses have been pre-registered through EGAP.
Hypothesis
The ranking of the magnitudes of the decrease in harassment will be:In-group/High status > In−group/Low status
Out−group/High status> Out-group/Low status.
Table: Experimental Design and Hypothesized Effect Sizes
In-group Out-groupLow followers Medium effect Small effect
High followers Large effect Medium effect
Hypothesis
The decrease in offensive language will be smaller in subjects whoprovide less information in their profile.
![Page 21: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/21.jpg)
Change in Racist Language: Full Sample (242)1 Week 2 Weeks 1 Month
●
●
●
●
●
Change in Average Daily Slur Use
−0.6 −0.4 −0.2 0.0 0.2 0.4
In−Group/Low
Out−Group/Low
In−Group/High
Out−Group/High
Log Followers
●
●
●
●
●
●
●
●
●
●
−0.6 −0.4 −0.2 0.0 0.2 0.4
●
●
●
●
●
●
●
●
●
●
−0.6 −0.4 −0.2 0.0 0.2 0.4
●
●
●
●
●
![Page 22: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/22.jpg)
Change in Racist Language: Non-Anonymous Sample (84)1 Week 2 Weeks 1 Month
●
●
●
●
●
Change in Average Daily Slur Use
−0.6 −0.4 −0.2 0.0 0.2 0.4
In−Group/Low
Out−Group/Low
In−Group/High
Out−Group/High
Log Followers
●
●
●
●
●
●
●
●
●
●
−0.6 −0.4 −0.2 0.0 0.2 0.4
●
●
●
●
●
●
●
●
●
●
−0.6 −0.4 −0.2 0.0 0.2 0.4
●
●
●
●
●
![Page 23: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/23.jpg)
Science Moves Quickly
![Page 24: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/24.jpg)
In Real World Terms
My intervention caused the 50 subjectsin the most effective condition to tweet
the word “nigger” an estimated 186fewer times in the month after
treatment.
![Page 25: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/25.jpg)
Ongoing Project
Political civility
Incivility demobilizes and polarizes
![Page 26: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/26.jpg)
Ongoing Project
Political civility
Incivility demobilizes and polarizes
![Page 27: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/27.jpg)
A Visual Overview
![Page 28: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/28.jpg)
Detection
![Page 29: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/29.jpg)
Manipulations
All bots are white men with many followers
Trump-critical subjects get a tweet from a Democrat or Hillary bot
Test effectiveness of three types of messages
Ideologically scale subjects (Barbera, 2015) and look forheterogeneous effects
![Page 30: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/30.jpg)
Manipulations
All bots are white men with many followers
Trump-critical subjects get a tweet from a Democrat or Hillary bot
Test effectiveness of three types of messages
Ideologically scale subjects (Barbera, 2015) and look forheterogeneous effects
![Page 31: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/31.jpg)
Manipulations
All bots are white men with many followers
Trump-critical subjects get a tweet from a Democrat or Hillary bot
Test effectiveness of three types of messages
Ideologically scale subjects (Barbera, 2015) and look forheterogeneous effects
![Page 32: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/32.jpg)
Manipulations
All bots are white men with many followers
Trump-critical subjects get a tweet from a Democrat or Hillary bot
Test effectiveness of three types of messages
Ideologically scale subjects (Barbera, 2015) and look forheterogeneous effects
![Page 33: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/33.jpg)
Tweetment Variations
Different rhetoric to appeal to different moral frameworks
I Authority moral foundation: ”You shouldn’t use language like that.[Democrats/Republicans] need to behave according to the properrules of political civility.”
I Care moral foundation: ”You shouldn’t use language like that.[Democrats/Republicans] need to remember that our opponentsare real people, with real feelings.”
I Placebo message: ”Remember that everything you post here ispublic. Everyone can see that you tweeted this.”
![Page 34: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/34.jpg)
Tweetment Variations
Different rhetoric to appeal to different moral frameworksI Authority moral foundation: ”You shouldn’t use language like that.
[Democrats/Republicans] need to behave according to the properrules of political civility.”
I Care moral foundation: ”You shouldn’t use language like that.[Democrats/Republicans] need to remember that our opponentsare real people, with real feelings.”
I Placebo message: ”Remember that everything you post here ispublic. Everyone can see that you tweeted this.”
![Page 35: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/35.jpg)
Tweetment Variations
Different rhetoric to appeal to different moral frameworksI Authority moral foundation: ”You shouldn’t use language like that.
[Democrats/Republicans] need to behave according to the properrules of political civility.”
I Care moral foundation: ”You shouldn’t use language like that.[Democrats/Republicans] need to remember that our opponentsare real people, with real feelings.”
I Placebo message: ”Remember that everything you post here ispublic. Everyone can see that you tweeted this.”
![Page 36: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/36.jpg)
Tweetment Variations
Different rhetoric to appeal to different moral frameworksI Authority moral foundation: ”You shouldn’t use language like that.
[Democrats/Republicans] need to behave according to the properrules of political civility.”
I Care moral foundation: ”You shouldn’t use language like that.[Democrats/Republicans] need to remember that our opponentsare real people, with real feelings.”
I Placebo message: ”Remember that everything you post here ispublic. Everyone can see that you tweeted this.”
![Page 37: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/37.jpg)
Preliminary Results
Feelings Rules Public
Response Rates by Treatment (N=224)
0.0
0.1
0.2
0.3
0.4
![Page 38: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/38.jpg)
Preliminary Results
Feelings Rules Public Feelings Rules Public
Percentage of Conciliatory Response (N=72)
LEFTIST RIGHTIST
0.00
0.10
0.20
0.30
![Page 39: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/39.jpg)
An Optimistic Note
![Page 40: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/40.jpg)
An Optimistic Note
![Page 41: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/41.jpg)
An Optimistic Note
![Page 43: Tweetment Effects on the Tweeted: An Experiment to Reduce ...kmunger.github.io/pdfs/munger_tweetment_12_1_16.pdfStreamR nds a tweet with \nigger" Is the tweet with the slur an \@"-reply?](https://reader033.vdocuments.us/reader033/viewer/2022042305/5ed045b9e14d1766ba59ebf3/html5/thumbnails/43.jpg)
Attrition rates
Control A B C DBaseline # of subjects 40 49 44 50 48
# with > 1 Post-treatment tweets 40 46 42 47 47# with > 25 Post-treatment tweets 40 34 33 35 43
Attrition %, < 25 tweets 10% 18% 16% 18% 4%The number of subjects who tweeted more than 1 or 25 times after the
application of the treatment.