thompson_the role of facial expressions in vocal emotional communication

8/13/2019 Thompson_The Role of Facial Expressions in Vocal Emotional Communication

1/26

!"# %&'# &( )*+,*' -./0#11,&21 ,2 3&+*'-4&5,&2*' 6&4472,+*5,&2

"#$$ %&'()*'+

,-./0-1#2 3+#421*#56768+269 :0*51-$#-


2/26

6*5#8&0,#1 &( 2&29:#0;*' ;#"*:,&70 -+?@A?B

;$$0*51-5'1* :


3/26

%&2#.5#2F#F9#4&5,&21 )21*)2.5#42

?G -4&5,&21 ,2:&':# +"*28#1 ,2 47'5,/'# 17;1E15#41 ;#E&2F (##',28H

+&82,5,&2I 4&5,:*5,&2I /"E1,&'&8,+*' 0#*+5,&2 = 4&5&0 #./0#11,&2G

JG K7;1E15#41 *0# 1E2+"0&2,L#F &2 47'5,/'# '#:#'1 *2F #.5#2F >:,* (##F;*+< = (##F (&0C*0FB 5& 1&+,*' = /"E1,+*' '#:#'1

MG )*+,*' #./0#11,&21 *0# ,25#80*5#F C,5" 5"# 1&2,+ F,4#21,&2 &( 471,+= (72+5,&2 *1 ;&5" 1,82*' 1E15#4 = (&0 #4&5,&2*' 1E2+"0&2,L*5,&2

K## K+"#0#0I ?@ANI JOO?I JOONI P0*2FD#*2 = K+"#0#0I JOOAI &5"#01Q K## *'1& C&0< ;E R2FE 6'*0


4/26

%&2 2A52+828B2('5#'+* )21*)2.5#42C&212 8'


5/26

;+51'*)2.5#42 25&+'@1-)&6

K7;D#+5,:# #./#0,#2+#


6/26

J21.2)50-$ *508#2*

R((#+51 /#0+#,:#F F,11&2*2+# R((#+51 /#0+#,:#F :*'#2+# R((#+51 /#0+#,:#F 1507+570# S++701 *75&4*5,+*''E *2F /0#*55#25,:#'E

%#/&05#F ,2H!"&4/1&2I JOO@!"&4/1&2 = T*'


7/26

Facial expressions of emotional valence

Participants shown videos of sung major or minor intervals & ratedemotional valence of sounded music (positive to negative).

In some conditions, the dynamic facial expressions were switched

to make incongruent conditions (e.g., major sounded interval withfacial expressions that accompanied the minor sung interval).

Thompson, Russo & Quinto (2008)

M ;* .'+*.#'0* -552+5#'+ #+4'$428D %'-**2** 5* /02*5#'+9 4#2H21* -$*'

.'0+528 5&2 +0(>21 '< N21'* 5&-5-))2-128 '+ 5&2 *.122+F

M "6 O'..0)6#+@P -552+5#'+-$ 12*'01.2*H2 .'0$8 82521(#+2 5&2 #+4'$42(2+5'< .'+*.#'0* -552+5#'+ #+ -08#'B4#*0-$#+52@1-5#'+ '< 2('5#'+-$ #+


8/26

3,17*' 1,82*'1 &( #4&5,&2 *0# ,25#80*5#F C,5" *7F,5&0E1,82*'1 *75&4*5,+*''E *2F /0#9*55#25,:#'E


9/26

Facial expressions of melodic interval

Participants shown silent videos of sung melodic intervals and askedto rate the size of the imagined intervals

Several intervals presented, from zero to 12 semitones

Thompson & Russo (2007)


10/26

1

2

3

4

5

6

7

0 1 2 3 4 5 6 7 8 9 10 11 12

Interval Size (semitones)

M e a n

I n t e r v a

l S i z e

R a

t i n g

Singer 1Singer 2Singer 3

R+0&11 1,28#01H 0 Y OG@N >/#0+#,:#F = *+57*' ,25#0:*' 1,L#B

1QRFSR

1QRFTT

1QRFSU


11/26

)*+,*' #./0#11,&21 &( 5&2*',5E

V-NN *#+@21* *-+@ 5&2 $-*5 )&1-*2 '< *#$2+5 +#@&59*0>*5#505#+@ 5&2 $-*5 5'+2


12/26

Z K/&51 71#F (&0 4&5,&2 50*+/0&;#B 5&2# 1728 5C,+# 5&4,2,4,L# +&2150*,251 &( ,25#0:*' 1,L#

Z [0#1#25#F \]!^S_! 1&72F

[0#1#25*5,&21


13/26

0 Y OGAA 5&2*' ",#0*0+"E >,2F,:,F7*' 0`1 Y OGAA = OGA?B0 Y OGOM /0&.,4,5E


14/26

0 Y OGU? >5&2*' ",#0*0+"EB0 Y OGAa >/0&.,4,5EBb7'5,/'# % Y OG@M >;&5" /0#F,+5&01 1,82,(,+*25B


15/26

[0&F7+5,&2 157F,#1

,'5#'+ .-)5012

!"#$%&G Z )-15#.#)-+5* H-5.&28 - O('82$P -+8 5&2+#(#5-528 5&2 *0+@ )&1-*2 -+8 2('5#'+-$ #+52+5 #+)12.#*2 5#(2 H#5& 5&2 (0*#.F

'()*$+$,(&*# G 8#


16/26

,25&'8* \0(>21 '< (-1]21* 0*28 Q EL ^-(21-*G _ A ,`B[IR WI (2@- )#A2$*X ^'+8#5#'+*G

=('5#'+ 2A)12**28G L W&-))69 *-89 +2051-$X

a21>-$ -..'()-+#(2+5G b ?2)25#5#'+G I

%'5-$ +0(>21 '< 51#-$* W.-)5012*X Q Lb %2()'G TR >)( ,2$'86G 5'+#. B *0)215'+#. B $2-8#+@ 5'+2 B 5'+#. J1-.5#.2 51#-$*G ->'05 ER


17/26

,'82$ *5#(0$#Z T*0 ? ,1 5"# 4&F#'

Z T*0 J ,1 5"# +&725 F&C2

Z T*0 M ,1 5"# ,4,5*5,&2 >80##2 ',8"5B


18/26

%#(2


19/26

,-1]21 )$-.2(2+5 '+ 1'H*M ;++21 K '05219 $2$2 )'#+5*M %#) -+8 >1#8@2 '< +'*2

M d2


20/26

J'*#5#42 2('5#'+G .-)5012 *2**#'+

%#(2 .'01*2 '<


21/26

R:#0*8# F,1/'*+#4#25 &( #E#;0&C

BZ

Bb

BU

B_

BL

BI

BE

R

E

Perception Planning Production Post-Production

D i s p

l a c e m e n

t ( m m

)

'(&"9 6: 3;*") .


22/26

R:#0*8# F,1/'*+#4#25 &( ',/ +&02#0

BZ

Bb

BU

B_

BL

BI

BE

R

E

Perception Planning Production Post-Production

D

spa

me

mm)

'(&"9 C: 5$, 0>)&")

@(,,

thompson_the role of facial expressions in vocal emotional communication

Documents