lydia chilton stanfordindustrial affiliatesforum.stanford.edu/events/2016/slides/hci/lydia.pdf ·...

51
1 Decomposing Creativity: The Case of Writing Humor Lydia Chilton University of Washington, Stanford University

Upload: others

Post on 13-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

1

Decomposing Creativity: The Case of Writing Humor

Lydia ChiltonUniversity of Washington, Stanford University

Page 2: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

E = mc2

2

Page 3: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

mc2

3

E

Page 4: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

E = mc2

4

What type of creative artifact should we decompose first?

What type of creative artifact should we decompose first?

Page 5: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Humor

5

Page 6: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Properties of Humor

6

• Creative– Novel ‐ something you’ve never seen before– Hard ‐ not something you’d obviously think of

• Suited for Experimentation– Short ‐ can iterate on it quickly– Expert examples to learn from

Page 7: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Approach To Decomposing Humor

7

Examples + TheoryExamples + Theory

Model + System + StudyModel + System + Study

Page 8: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

8

“I can’t believe people would just walk into an Apple store and start breaking things like it’s a Best Buy.”

American VoicesExamplesExamples

People Bending iPhones At Apple StoresFriday September 30, 2014

Input

Output

Page 9: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

9

1. Associations2. Expectation Violation

Books on humor by philosophers, linguists, comedians

TheoryTheory

Page 10: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Satisfy a Constraintby searching a space of associations

10

Headline

Joke

ExpectationViolation SarcasmSarcasmUnexpected

AngleUnexpected

AngleBait‐and‐Switch

Bait‐and‐Switch

Apple

Broken DisplaysBest Buy

Best Buy

AlternativeAlternative InsultInsultAssociations

ModelModel

Page 11: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Sure, I guess UConn’s course is fine if you couldn’t get into Yale’s football clinic.

UConn Holding Football 101 Clinic for Female Fans

Association: Alternative Thing

11

Page 12: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Alright, how many ‘Summer Savannah’ Backyard Garden Lion Pedestals do I have to order to turn this thing around?

Report: ‘SkyMall’ Magazine May End Print Edition

Association: Details

12

Page 13: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Just tell me what to do and where to go to guarantee happiness forever.

Poll: Elite Colleges Don’t Produce HappierGraduates

Association: Personality Flaw

13

Page 14: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Satisfying a Constraintby searching a space of associations

14

Headline

Joke

ExpectationViolation SarcasmSarcasmUnexpected

AngleUnexpected

AngleBait‐and‐Switch

Bait‐and‐Switch

Apple

Broken DisplaysBest Buy

Best Buy

AlternativeAlternative InsultInsultAssociations

ModelModel

Page 15: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

People Bending iPhones At Apple Stores

I can’t believe people would just walk into an Apple store and start breaking things like it’s a Best Buy.

Bait‐and‐SwitchBait‐and‐SwitchBait: Expectation: This is bad.Switch: Insult: Best Buy sucks.

15

Expectation Violation #1

Page 16: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

UnexpectedAngle

UnexpectedAngle

“So did he think Transcendencewas good, or what?”

Stephen Hawking: AI Could Spell the End for MankindInspired by the film Transcendence, Stephen Hawking wrote that is a mistake to dismiss the threat of AI.

Expected Focus: End for Mankind

Unexpected Focus: Transcendence

16

Expectation Violation #2

Page 17: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

SarcasmSarcasm

“There is absolutely no other explanation.”

Mick Jagger Blamed for Brazil’s World Cup Defeat

17

Expectation Violation #3

Page 18: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

HumorToolsAdaptive Workflow

• Apply microtasks to the headline• Until you can find a way of violating an expectation

• Follow your train of thought, until you get stuck, then backtrack

• Not yet crowdsourced• But it is decomposed into microtasks

18

AspectsAspects

Violation Mechanism

HeadlineHeadline

Prototype & Test

Prototype & Test

JokeJoke

Expected ReactionsExpected Reactions

AssociationsAssociations

Page 19: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

HumorTools Interface

19

Justin Bieber was baptized this weekend in an attempt to wash away his sins following a scandal in which the singer appears in videos uses racial slurs

Page 20: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke20

Page 21: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

21

Page 22: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bad.His music sucks.

Expected Reactions

22

Page 23: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bad.His music sucks.

Expected Reactions

Violation Mechanism

23

Page 24: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bad.His music sucks.

24

Page 25: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bieber’s PR peopleAssociations

Bad.His music sucks.

25

Page 26: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bieber’s PR peopleAssociations

Bad.His music sucks.

Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.

Violation Mechanism

26

Page 27: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bieber’s PR peopleAssociations

Bad.His music sucks.

Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.

Violation Mechanism

Prototype

Test

Joke

……

Never let it be said that Bieber’s PR people aren’t bringing new ideas to the table. 27

Page 28: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bieber’s PR peopleAssociations

Bad.His music sucks.

Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.

Violation Mechanism

Prototype

Test

Joke

……

Never let it be said that Bieber’s PR people aren’t bringing new ideas to the table. 28

Page 29: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bieber’s PR people

Bad.His music sucks.

Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.

Joke

……

29

Page 30: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bieber’s PR people

Bad.His music sucks.

Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.

Joke

Expected Reactions

Bad.Dirty, Gross

……

30

Page 31: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bieber’s PR people

Bad.His music sucks.

Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.

Joke

Expected Reactions

Bad.Dirty, Gross

Violation Mechanism

Unexpected Angle:A Bieber fan who’d worship his dirty bathtub

……

31

Page 32: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bieber’s PR people

Bad.His music sucks.

Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.

Joke

Expected Reactions

Bad.Dirty, Gross

Violation Mechanism

Unexpected Angle:A Bieber fan who’d worship his dirty bathtub

Prototype

Test……

……

……

32

Page 33: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Justin Bieber Baptized In NYC BathtubHeadline

Joke

Justin Bieber Baptized BathtubHeadline Aspects

Bieber’s PR people

Bad.His music sucks.

Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.

Joke

Expected Reactions

Bad.Dirty, Gross

Violation Mechanism

Unexpected Angle:A Bieber fan who’d worship his dirty bathtub

Prototype

Test……

……

……

Oh my God! Can I lick the tub?33

Page 34: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

HumorTools Study

• 20 users: Stanford undergraduates• Humor novices• 60‐80 minutes:

– Tutorial on 20 microtasks– Humor Writing

• Write jokes for 3 headlines• Rate jokes against The Onion (21 people)

34

Page 35: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

HumorTools Study Headlines

35

PETA Seeks Copyright for Primate A lawsuit filed by PETA claims that “monkey selfies” snapped by a macaque who stole a photographer’s camera should be considered the legal property of the macaque himself.

Liquid Water Found on MarsNASA revealed Monday that they have found evidence of liquid water on the Mars, pointing to the possibility of life on the red planet.

Can users synthesize humor?Can users synthesize humor?

Page 36: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

HumorTools Study Headlines

36

PETA Seeks Copyright for Primate A lawsuit filed by PETA claims that “monkey selfies” snapped by a macaque who stole a photographer’s camera should be considered the legal property of the macaque himself.

Liquid Water Found on MarsNASA revealed Monday that they have found evidence of liquid water on the Mars, pointing to the possibility of life on the red planet.

Page 37: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

HumorTools Evaluation

• 75% of participants were able to synthesize humor

• 25% of the HumorTools jokes were rated funny 

37

Page 38: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

38

PETA Seeks Copyright for Primate

This is great news for animal rights. Now my neighbor can take my dog to court instead of me the next time he deposits some of his “legal property” in their front lawn.

This is why you always get the macaque to sign a release.

Page 39: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

39

PETA Seeks Copyright for Primate

This is great news for animal rights. Now my neighbor can take my dog to court instead of me the next time he deposits some of his “legal property” in their front lawn.

This is why you always get the macaque to sign a release.

HumorTools

47% Funny

62% Funny

Page 40: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

40

Liquid Water Found on Mars

I think it’s more convenient for me to get it from the tap.

In other news, Pluto has been calledeven less of a planet now.

Sounds refreshing!

Page 41: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

41

Liquid Water Found on Mars

HumorTools

HumorToolsI think it’s more convenient for me to get it from the tap.

In other news, Pluto has been calledeven less of a planet now.

Sounds refreshing!15% Funny

45% Funny

45% Funny

Page 42: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

User Comments

42

“[Associations] helped me think of jokes in a wider conceptual space than I previously had.” (p9)

Before this, I never really knew where to start with joke writing I just kind of sat and thought until I came up with something. (p5)

Page 43: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

43

Theory + ExamplesTheory + Examples

Model + System + StudyModel + System + Study

Future: Continuous Improvement

Page 44: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Grant: Be funnier than the Onion

44

Page 45: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Future Work

45

Page 46: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Crowdsource HumorTools

46

Headline

Joke

ExpectationViolation

Associations

Page 47: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Automate Some Microtasks 

Train ML system with user collected data

47

• Entity extraction• Sentiment analysis• Semantic parsing

Page 48: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

Extend HumorTools Approach to Other Creative, Open‐Ended Domains

Step 1 Synthesize theories

Step 2 Analyze examples for concrete mechanisms

Step 3 Identify microtasks that define the search space

Step 4 Define Constraints Violation Mechanism

Apple Stores

Best Buy

Alternative Thing

Alternative Thing

48

Page 49: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

New Domain: Persuasive Argumentation

49

Page 50: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

New Domain: Persuasive Argumentation

50

Step 1 Synthesize theories Rhetoric

Step 2 Analyze Op‐Eds for mechanismsMetaphor

Step 3 Identify microtasks that define the search spaceFind facts to support arguments

Step 4 Define constraintsThesis Statement

Page 51: Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf · Creative, Open‐Ended Domains Step 1Synthesize theories Step 2Analyze examples for

51

Decomposing Creativity: The Case of Writing Humor