powerpoint presentation€¦ · easy “sock puppets” curated “sock puppet” human-like ai...

10
© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4. | 1 |

Upload: others

Post on 25-Jun-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

| 1 |

Page 2: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

MITRE’s Experience

| 2 |

MITRE is investing in addressing the intentional spread and amplification of disinformation

MITRE▪ Not-for-profit

▪ Working in the public interest for 60+ years

▪ Building social media analytics for14 years (first publication)

▪ Social technologies patented (4) and licensed (10) for the public interest

MITRE believes protecting the information and news infrastructure is a critical

global challenge

A trusted third party✓ Aviation Safety Information Analysis and Sharing

Program (ASIAS)✓ Serves as a central conduit for the exchange of data

and analytics✓ Establishes key safety benchmarks✓ Results are shared with ASIAS participants (airlines)

https://portal.asias.aero/web/guest

✓ ATT&CK is a knowledge base of adversary tactics and techniques based on real-world cyber security observations

✓ Used as a foundation for the development of threat models and methodologieshttps://attack.mitre.org/

Page 3: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

Crimson Hexagon

Joint Study with the Alliance for Securing Democracy (#1)Impact of Inauthentic Behavior in Social Media on Anti-Feminist Issues as it Relates to the EU Elections

| 3 |

Amplification of anti-feminist disinformation across social media platforms, countries, and languages

Source: Crimson Hexagon, Botometer, Rest-Sleep-Comment (RSC), MITRE hashtag tool

La Pildora Roja “The Red Pill”

Feminismo Científico “Scientific Feminism”

Mereces Saberlo“You Deserve to Know”

Mereces Saberlo

Gender-based violence (somewhat suspicious)

The Red Pill/MGTOW “Men Going Their Own Way”

Men’s Rights Activism (Broader EU Narrative)

Misogynist Views

TwitterInstagram

Blog

Spanish

UK

HU NL+

ESES

“Real” gender-based violence data show that women are violent and lie about rape and abuse and “deserve to know” the true statistics

Women and society have become hostile against masculinity

Antifeminist content linked to EU-related populist,

racist, anti-migrant, and anti-muslim content

Bot amplification of tweets and URLs

“Nikola Tesla (hero)”“anti-abortion”

“distorted wage gap”“anti-Gillette campaign”

Spain/Spanish-centric

antifeminist movement

Pan-EUantifeministmovements

Activity showed connection to gaming communities

(Subreddits, Twitch, Discord)

2 May 2019

26 Feb 2019

4 Apr 2019

Female oppression is a myth and men are the ones holding the short end of the stick

Overlap in topic

EnglishWomen’s/Men’s Rights (highly suspicious)

Botometer

RSC

ARES

ES

MITRE hashtag tool

Showing strong dislike or prejudice against women Backlash

against feminism

Twitter

Reddit

Datesillustrative

Feminismo Científico

AR

Blog

13 Dec 2018

13 Dec 2018

13 Dec 2018

29 Apr 2019

15 Jan 2018

Instagram

“snip feminist vocal cords”

Page 4: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

“Hung drawn quartered”

“Hung drawn quartered”

B*tch/Witch

Progressive ovaries… get

raped

| 4 |

Anti-feminist disinformation hate speech across social media platforms, countries, and languages

Source: Crimson Hexagon, MITRE HatEval

Twitter

Tumblr

Forum

Blog

News

Swedish MP said “All men are rapists”

“So Central Europe is starting to give way tothe pro EU, pro feminism dumbf*cks?”

SE

UK

SK

MITRE HatEvalNews

HatEval enabled identification of suspicious YouTube

Italian politician “who takes her baby into parliament with her… represents a f*ckingfascist party and you shouldn’t reblog it anymore”

Antifeminismo, un arma electoral de éxito

“Antifeminism, a successful electoral weapon”

SK

IT

ES

C*nt/Tw*t

“The Male version of

Hillary or Merkel,

spineless Macaroni”UK

Derogatory portrayal of female politician

Biased portrayal of female politician

Offensive Language Towards Women/Men (highly suspicious)

Twitter

Twitter

FR

Facebook

UK

Derogatory portrayal of female politician 8 Nov 2019

Crimson Hexagon

EnglishSpanish

Datesillustrative

14 Apr 2019

13 Mar 2019

Gender-based violence (highly suspicious)

Women’s/Men’s Rights (highly suspicious)

UK

Reddit

Feb 2019

Antifeminismo, un arma electoral de éxito

14 Nov 2018

8 May 2019

18 Apr 2019

18 Mar 2019

13 Jul 2018

13 Nov 2018

Joint Study with the Alliance for Securing Democracy (#2)Impact of Inauthentic Behavior in Social Media on Anti-Feminist Issues as it Relates to the EU Elections

Page 5: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

| 5 |

Each category has challenges. What are the definitions? What are the edge cases?

Difficulty of Monitoring Environment for Harmful Content

Enga

gem

en

t

Allowed Content Prohibited Content

For each topic, modality, and platform!For each topic…

Impersonation of Person / Brand

Pornography/ Sexual Services

Abusive Behavior / Violent Threat

Self HarmPrivacy Infringement

PlatformAbuse

PromotingCrime

Child Privacy / Exploitation

Coordinating Harm

InauthenticAccounts

For each modality…

Categoriesof Harm

Notionalordering

of platforms

What does the linelook like for each

category of harm?

RemoveAccounts

RemoveContent

Standardization of categories for Facebook and

Twitter based on Terms of Service

(see backup slide)

Lines arefuzzy

Page 6: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

Platform Approach for Disinformation “Game”Platform to Foster Shared Knowledge and Common Action Against Disinformation

| 6 |

Removal of inauthentic accounts will push adversaries to the bottom of the red triangle

An Alliance with a Response Framework➢ Develop industry wide standards➢ Share threats across social media platforms➢ Coordinate actions➢ Share information across infrastructure sectors

Detecting Influence Operations Across Social Media PlatformsA. Detect inauthentic accounts across social media platforms by topic (as done in example)B. Monitor environment for harmful content in text and media (next slide)C. Go beyond current terms of service to analyze data to detect influence operationsD. Setting standards with social media platforms can improve detection

Easy Bots created by anyone

Curated Bot networks

Easy “Sock puppets”

Curated“Sock puppet”

Human-Like

AIdetection

insufficient

Divisive

Harmful

Criminal

Amplification

Abusive Behavior / Violent Threat

Co

st p

er

Acc

ou

nt

$

$$$$

$$

$$$

Influence Operations strategies:False news sites, Spread misinformation, Flood

channels, Inauthentic accounts, Others…

Disinformation spectrum: Inauthentic account/bot spectrum:

Page 7: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

| 7 |

Facebook Only

Source: https://newsroom.fb.com/news/2019/05/enforcing-our-community-standards-3/

Where do we go from here?

Abusive Behavior / Violent Threat

Page 8: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

| 8 |

Stronger together

Transatlantic Vision on Disinformation with the Atlantic CouncilNeed for Alliance in Addressing Global Disinformation

Strengtheninformation/news infrastructure,

businesses/economies,and democracies/countries

by reducing the effectiveness of disinformation campaigns

Vision What would the alliance do?

Members

Social Media Platforms

News Media

Nonprofits

Fact Checkers

Academics

Analytic FirmsPPPP

SectorsP

In Discussions

Others?

▪ Archive data sets that are removed by social media platforms

▪ Earlier sharing of information on disinformation threats and work together, following cyber security model

▪ Perform cross social media platform analysis

▪ Develop industry-wide standards for addressing disinformation

▪ Use common data sets to assess threats

▪ Engage globally

▪ Engage in activities to empower the public

▪ Other?

Page 9: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

Jennifer Mathieu, PhD

[email protected]

781-271-8672

| 9 |

Page 10: PowerPoint Presentation€¦ · Easy “Sock puppets” Curated “Sock puppet” Human-Like AI detection insufficient Divisive Harmful Criminal Amplification Abusive Behavior / Violent

© 2019 The MITRE Corporation. All Rights Reserved. Approved for Public Release; Distribution Unlimited. Case Number 18-03361-4.

From Facebook and Twitter Terms of Service

Sale of counterfeit goods

Promoting crimeSelling regulated goods

Gambling

Spammy, or just plain fake / Account security at risk

Tied to false individuals and organizations

Abusive tweets or behavior

Tied to dangerous individuals or organizations Coordinating harm

Spam and system abuseViolation of Twitter ads policy

Unauthorized trademarkUnauthorized copyright

Private information posted Self harm

Abusive behavior / violent threats

Harassment

Impersonation of person / brand

Sexual services

PornographyPrivacy infringement

Child nudity Child sexual exploitation

Privacy toward children Child sexual exploitation

Not allowed on social media

platforms

Impersonation of Person / Brand

Pornography/ Sexual Services

Abusive Behavior / Violent Threat

Self HarmPrivacy Infringement

PlatformAbuse

PromotingCrime

Child Privacy / Exploitation

Coordinating Harm

InauthenticAccounts

Remove Accounts

Remove Content

From company terms of service

Legend

Note, Facebook enforcement report has different categories

| 10 |