facial expressions and speech acts pdfsearle 1975) prediction our main prediction resultsfrom an...

74
Speech Acts, Facial Expressions and Gender Bias FILIPPO DOMANESCHI, MARCELLO PASSARELLI, LUCA ANDRIGHETTO (University of Genoa) Milano – San Raffaele 12.12.2017

Upload: phungmien

Post on 15-Feb-2019

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Speech Acts, Facial Expressions and Gender Bias

FILIPPO DOMANESCHI, MARCELLO PASSARELLI, LUCA ANDRIGHETTO

(University of Genoa)

Milano – San Raffaele 12.12.2017

Page 2: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

SPEECH ACTS

Page 3: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

“…the business of a sentence is not only todescribe some state of affairs but also toperform other kinds of speech acts”

Page 4: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological
Page 5: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

“Mark is studying”

Page 6: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

“Mark is studying”

Page 7: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

“Mark is studying”

Illocutionary Force

Page 8: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

“Mark is studying”

Illocutionary Force

Assertion “Mark is studying”

Page 9: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

“Mark is studying”

Illocutionary Force

Assertion “Mark is studying”Question “Is Mark studying?”

Page 10: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

“Mark is studying”

Illocutionary Force

Assertion “Mark is studying”Question “Is Mark studying?”Order “Mark, study!”

Page 11: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

“Mark is studying”

Illocutionary Force

Assertion “Mark is studying”Question “Is Mark studying?”Order “Mark, study!”Suggestion “Mark… study…”

Page 12: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

“Mark is studying”

Illocutionary Force

Assertion “Mark is studying”Question “Is Mark studying?”Order “Mark, study!”Suggestion “Mark… study…”… …… …… …

Page 13: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Illocutionary force-indicatingdevices IFIDs

Linguistic element that indicates or delimits theillocutionary force of an utterance

(Searle 1969, Searle & Vanderveken 1985)

Page 14: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Linguistic IFIDs

Semantics, Syntax, Phonology.

Page 15: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Non-verbal IFIDs ?

..multimodal process that often involves thecomputing of non-verbal signals.

Gestures (Dresner & Herrig 2010, Kendon 2004)Gaze (Argyle & Cook 1976, Poggi & Pelachaud 2001)

Mouth (Cosi &Perin 2002)

Page 16: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Non-verbal IFIDs ?

..multimodal process that often involves thecomputing of non-verbal signals.

Gestures (Dresner & Herrig 2010, Kendon 2004)Gaze (Argyle & Cook 1976, Poggi & Pelachaud 2001)

Mouth (Cosi &Perin 2002)

Page 17: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

PREVIOUS WORK

Domaneschi F., Passarelli M., Chiorri C. (2017), “Facial Expressions and Speech acts”, Cognitive Processing, 3, 1-22.

Page 18: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological
Page 19: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological
Page 20: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

FACS - Facial Action Coding System

(Ekman & Friesen 1978)

Page 21: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

FACS - Facial Action Coding System

The facial muscular activity is coded in the formof a combination of Action Units (AUs)

(Ekman & Friesen 1978)

Page 22: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

FACS - Facial Action Coding System

The facial muscular activity is coded in the formof a combination of Action Units (AUs)

Facial expressions described in terms of discreteAUs and combinations of AUs.

(Ekman & Friesen 1978)

Page 23: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Upper AUs

We focused our attention on the Upper face AUs

Page 24: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

ASSERTION “Mark is studying”

QUESTION “Is Mark studying?”

ORDER “Mar, study!”

(Levinson 1983)

Page 25: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

EXPERIMENT 1 – Production

Page 26: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

EXPERIMENT 1 – Production

ITALIANAssertion: So che Marco studiaQuestion: Una domanda: Marco studia?Order: È un ordine: Marco studia!!

ENGLISH Tr.Assertion: I know that Marco studiesQuestion: Una domanda: Marco studia?Order: È un ordine: Marco studia!

Page 27: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

EXPERIMENT 1 – Production

ITALIANAssertion: So che Marco studiaQuestion: Una domanda: Marco studia?Order: È un ordine: Marco studia!!

#£$%ç!?”

ENGLISH Tr.Assertion: I know that Marco studiesQuestion: Una domanda: Marco studia?Order: È un ordine: Marco studia!

Page 28: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

EXPERIMENT 2 – Comprehension – Selection Task

Page 29: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

EXPERIMENT 2 – Comprehension – Selection Task

Page 30: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

EXPERIMENT 2 – Comprehension – Selection Task

Page 31: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

EXPERIMENT 3 – Comprehension – Rating Task

Page 32: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

EXPERIMENT 3 – Comprehension – Rating Task

Page 33: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Domaneschi et al. (2017)

EXPERIMENT 3 – Comprehension – Rating Task

Page 34: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

RESULTS

ASSERTION “Mark is studying”

QUESTION “Is Mark studying?”

ORDER “Mar, study!”

(Domaneschi et al. 2017)

Assertion Orders Questions Ambiguous

Page 35: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

GENDER BIAS?

Page 36: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

RESEARCH QUESTION

It is plausible to predict that this peculiar pattern of associations between Speech actsand Upper-face AUs could be affected by individual characteristics of the actor thatperforms the speech act.

Is understanding speech acts affected by the gender of the actor?

Page 37: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

PREDICTION

Page 38: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

PREDICTION

Our main prediction results from an integration of the linguistic literature on speechacts and the social psychological research on gender roles and stereotypes:

Page 39: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

PREDICTION

Our main prediction results from an integration of the linguistic literature on speechacts and the social psychological research on gender roles and stereotypes:

Linguistic

Preparatory rulesAssertions & Questions S = HOrders S > H

(Searle 1975)

Page 40: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

PREDICTION

Our main prediction results from an integration of the linguistic literature on speechacts and the social psychological research on gender roles and stereotypes:

Social-role theory

(Eagly & Wood, 1999; Eagly, Wood, & Diekman, 2000)

Page 41: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

PREDICTION

Our main prediction results from an integration of the linguistic literature on speechacts and the social psychological research on gender roles and stereotypes:

Social-role theoryGender stereotypes arise from the characteristics associated with the roles that menand women typically fill in a given society.

(Eagly & Wood, 1999; Eagly, Wood, & Diekman, 2000)

Page 42: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

PREDICTION

Our main prediction results from an integration of the linguistic literature on speechacts and the social psychological research on gender roles and stereotypes:

Social-role theoryGender stereotypes arise from the characteristics associated with the roles that menand women typically fill in a given society.

In most of the western societies, men hold positions that are viewed as more powerfuland agentic than those hold by women, whereas women occupy positions that areperceived as more subordinate and passive than those occupied by men

(Eagly & Wood, 1999; Eagly, Wood, & Diekman, 2000)

Page 43: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

PREDICTION

Perceivers would be less likely to associate the illocutionary force of the order withthe corresponding facial expression (i.e., AU4+5) when it is displayed by womenrather than by men

Page 44: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

EXPERIMENT

Page 45: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Methods – Selection task

- 195 Participants(N = 152; 105 females; age = 27.17 ± 8.24, range = 18-64)

- 16 Pics (8 males, 8 females)

- 40 Items (3 target sentences + 2 distractors)

- 5 AUs:

Assertion Orders Questions Ambiguous

Page 46: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

RESULTS

Page 47: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological
Page 48: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological
Page 49: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological
Page 50: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological
Page 51: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

RESULT 1: Orders

Assertion: “Mark is studying”

Question: “Is Mark studying?”

Order: “Mark study!”

Page 52: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

RESULT 1: Orders Express4+5:ActorSex1 0.045815 *

Assertion: “Mark is studying”

Question: “Is Mark studying?”

Order: “Mark study!”

Page 53: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

RESULT 1: Orders Express4+5:ActorSex1 0.045815 *

Assertion: “Mark is studying”

Question: “Is Mark studying?”

Order: “Mark study!”

Page 54: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Assertion: “Mark is studying”

Question: “Is Mark studying?”

Order: “Mark study!”

RESULT 2: Questions Express4+5:ActorSex1 0.00397 **

Page 55: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Assertion: “Mark is studying”

Question: “Is Mark studying?”

Order: “Mark study!”

RESULT 2: Questions Express4+5:ActorSex1 0.00397 **

Page 56: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

RESULT 3: Assertion ActorSex1 0.0331 *

Assertion: “Mark is studying”

Question: “Is Mark studying?”

Order: “Mark study!”

Page 57: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Assertion: “Mark is studying”

Question: “Is Mark studying?”

Order: “Mark study!”

RESULT 3: Assertion ActorSex1 0.0331 *

Page 58: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

DISCUSSION

Page 59: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Gender Effect

Orders + AU4+5

> probability: men performers of orders > prbability: women performers of questions.

Assertions

> prbability: men performers of assertions

Page 60: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

ORDERS + AU4+5

Page 61: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Freedom of Speech and Gender Bias

The deprivation of the freedom of a speech : illocutionary potential

(Hornsby 1993; Langton 1993)

E.g.

Pornography: women are deprived of their illocutionarypotential.

Women are perceived as mere sexual objects via a process of subordination that silencesthem and limits their illocutionary potential to a restricted range of illocutionary types, e.g.agreeing, accepting, etc.

(Bianchi, 2008; Hornsby, 2000; West, 2003)

Page 62: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Freedom of Speech and Gender Bias

Claim: Data collected suggest that multimodal communication is affected by agender bias which associates different illocutionary potentials respectively to menand women.

In particular, such a difference reflects a process of women’s subordination.

62

Page 63: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Freedom of Speech and Gender Bias

Preparatory conditions: Orders vs. Questions

Order: hierarchical superiority of the S on the HQuestion: admits an equal status of S/H

(Austin, 1962; Searle, 1975)

63

Page 64: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Freedom of Speech and Gender Bias

Our results show that the interpretation of orders reflects a representation of womenas having less power than men and as holding a subordinated hierarchical position

64

Page 65: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Freedom of Speech and Gender Bias

When considering male vs. female speakers, therefore, the perception of thishierarchical position seems to be biased by the (aforementioned) gender stereotypespermeating past and today’s western societies

65

Page 66: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Freedom of Speech and Gender Bias

This result, therefore, might provide further support about the idea that men’shigher social status is translated into men’s privileges in speech.

(Eckert & McConnell-Ginet 2003)

66

Page 67: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

ASSERTIONS

Page 68: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Assertions

Women < performers of assertions than men, independently of the non-verbalmarker associated with the production of a speech act and, in particolar, with AU0.

68

Page 69: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Assertions

Women are usually recognized as more tentative than men in actual speech

(Lakoff 1975)

69

Page 70: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Assertions

Lakoff (1975), for example, has shown that women tend to be less assertive thanmen and are more inclined to replace illocutionary forces like assertions that involvea demanding epistemic commitment, with, for example, tag questions.

70

Page 71: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

Assertions

Lakoff (1975), for example, has shown that women tend to be less assertive thanmen and are more inclined to replace illocutionary forces like assertions that involvea demanding epistemic commitment, with, for example, tag questions.

“The train is at 2.00pm” vs “The train is at 2.00om, isn’t it?”

71

Page 72: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

CONCLUSION

Page 73: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

What if this story is true?

Stereotype-consistent interpretations of men’s and women’s speech acts might haveimplications for the social roles that people occupy, by contributing to maintaingender inequalities.

For example, when women occupy leading positions in a working organization, theiract of expressing orders may be affected by gender stereotypes and thus may bemisunderstood by their subordinates.

Such a process could reinforce the belief that women are unable to perform ordersand to hold the dominant social position required for the execution of an order,reproducing in this way a gender inequality

73

Page 74: Facial Expressions and Speech Acts PDFSearle 1975) PREDICTION Our main prediction resultsfrom an integration of the linguistic literatureon speech acts andthe social psychological

THANKS!