affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · previous studies: 2004...
TRANSCRIPT
![Page 1: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/1.jpg)
Affective Priming
Music 451A Final Project
![Page 2: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/2.jpg)
The Question
● Music often makes us ‘feel’ a certain way. Does this feeling have semantic meaning like the words ‘happy’ or ‘sad’ do?
● Does music convey semantic emotional content?
![Page 3: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/3.jpg)
Previous Studies: 2004● Koelsch investigates language and music. Found an N400 for music primes
and semantically unrelated target words.
![Page 4: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/4.jpg)
Previous Studies: 2012● Goerlich study showed negligible results that could be due to the motor
response during the N400: mean RT’s = 600ms ○ Subjects had to respond as quickly as possible with congruent or incongruent.
![Page 5: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/5.jpg)
Experimental Design
GoalTo compare N400 between congruent and incongruent primes when a prime is given major or minor, and a probe of happy or sad emoji is displayed.
HypothesisIncongruent stimuli (major+sad face, minor+happy face) elicit an N400 for all listeners. This could indicate melodic priming has semantic emotional content.
![Page 6: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/6.jpg)
MethodsParticipants: 5 University students aged 20-29, 3 Female and 2 Male, 3 Musician and 2 Non-musician.
Stimuli and Tasks: A melody lasting ~3.5 seconds played on piano (27 C Major and 27 possible corresponding C Minor melodies), followed by a happy (3 possible) or sad (3 possible) emoji for 1 second. Some trials had a black screen instead of an emoji and participants were asked to respond with a button click. Trials were separated into 3 blocks, 12 minutes each, for a total recording time of 36 minutes.
EEG Recording Procedure: Participant was capped with a 67 electrode cap (standard 10-20 system), seated in a recording room with ear-buds, facing a computer screen showing stimuli. Participants were in the chamber for roughly 1 hour total, as they participated in two experiments. Order was randomized.
![Page 7: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/7.jpg)
Grand Average Results
Congruent average: Major/happy and Minor/sad
Incongruent average: Major/sad and Minor/happy
Latency: 400ms
Latency: 400ms
![Page 8: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/8.jpg)
Grand Average Results Difference
Incongruent Average - Congruent average: (Major/sad + Minor/happy) - (Major/happy + Minor/sad)
Small N400 in topo!But not visible in waveform
Latency: 400ms
![Page 9: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/9.jpg)
Grand Average Results
![Page 10: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/10.jpg)
Individual Results: Major
Barbara
Elena
Kunwoo
Michael
Trang
Major Melody Difference Waves
![Page 11: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/11.jpg)
Individual Results: Minor
Barbara
Elena
Kunwoo
Michael
Trang
Minor Melody Difference Waves
![Page 12: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/12.jpg)
Individual Results: BN
Congruence (Major/Happy) vs Incongruence (Major/Sad) Congruence (Minor/Sad) vs Incongruence (Minor/Happy)
![Page 13: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/13.jpg)
Individual Results: TN
Congruence (Major/Happy) vs Incongruence (Major/Sad) Congruence (Minor/Sad) vs Incongruence (Minor/Happy)
![Page 14: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/14.jpg)
Individual Results: EG
Congruence (Major/Happy) vs Incongruence (Major/Sad) Congruence (Minor/Sad) vs Incongruence (Minor/Happy)
![Page 15: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/15.jpg)
Individual Results: KK
Congruence (Major/Happy) vs Incongruence (Major/Sad) Congruence (Minor/Sad) vs Incongruence (Minor/Happy)
![Page 16: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/16.jpg)
Individual Results: MM
Congruence (Major/Happy) vs Incongruence (Major/Sad) Congruence (Minor/Sad) vs Incongruence (Minor/Happy)
![Page 17: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/17.jpg)
Grand Average of EG, KK, MM
Congruence (Major/Happy) vs Incongruence (Major/Sad) Congruence (Minor/Sad) vs Incongruence (Minor/Happy)
![Page 18: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/18.jpg)
Grand Average of EG, KK, MM
Incongruence (Major/Sad) - Congruence (Major/Happy) Topography at 400ms Latency
Incongruence (Minor/Happy) - Congruence (Minor/Sad)Topography at 400ms Latency
![Page 19: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/19.jpg)
Discussion
● N400 in major (sad - happy) was greater than N400 in minor (happy - sad)● 4 out of 5 subjects showed N400 in major (happy/sad)● 4 out of 5 subjects showed N400 in minor (happy/sad)
○ The N400 for minor melody incongruence is low
![Page 20: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/20.jpg)
DiscussionWhy low N400?
● Weak melodic primes○ Prime length of 3.5 seconds may not be enough to induce mood.○ 3rd (which helps distinguish major from minor) appeared infrequently or
too late (not enough priming occurred).○ All melodies were in the same key.○ Pitch was the only varying acoustic feature
● Visual response domination○ Happy and sad emojis may evoke significant responses that are mutually exclusive to auditory
primes
![Page 21: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/21.jpg)
Exploration
What’s affecting the data?
1. Does the Happy/Sad Visual Response dominate Incongruence/Congruence?
2. Does the Major/ Minor Response dominate?
![Page 22: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/22.jpg)
1. Happy/Sad Visual Response: Grand Average
Sad Grand Average: Major/sad and Minor/sad
Happy Grand Average: Major/happy and Minor/happy
![Page 23: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/23.jpg)
1. Happy/Sad Visual Response: Grand Average Difference
Sad Average - Happy Average: (Major/sad and Minor/sad) - (Major/happy and Minor/happy)
The sad emoji evokes a slightly larger negative amplitude than the happy emoji, regardless of melody type (major or minor).
![Page 24: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/24.jpg)
2. Major/Minor Response: Grand Average
Major Grand Average: Major/happy + Major/sad
Minor Grand Average: Minor/happy + Minor/sad
![Page 25: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/25.jpg)
2. Major/Minor Response: Grand Average Difference
Minor Average - Major Average: (Minor/sad and Minor/happy) - (Major/happy and Major/sad)
A small amplitude difference around 250ms indicates the minor primes had a slightly stronger effect than major. This is less of a difference than the emojis.
![Page 26: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/26.jpg)
Remediations
● Vary key so that subjects engage more with melodic context● Increase the number of acoustic features (tempo, timbre, harmony)● Increase length of melodies for better priming● Include more minor tonality (3rd, 6th, 7th)● Use soundtrack music instead to convey emotional content● Use human faces instead of emojis● Use pos/neg words associated with happy (e.g. “joy”) or sad (e.g.
“dark”)
![Page 27: Affective - ccrma.stanford.eduegeorgie/documents/affective_priming.pdf · Previous Studies: 2004 Koelsch investigates language and music. Found an N400 for music primes and semantically](https://reader031.vdocuments.us/reader031/viewer/2022022010/5b0600217f8b9ae9628c6d73/html5/thumbnails/27.jpg)
References● Goerlich, K.S., Witteman, J., Schiller, N.O., Van Heuven, V.J., Aleman, A., &
Martens, S. (2012). The nature of affective priming in music and speech. Journal of cognitive neuroscience, 24(8), 1725–41.
● Koelsch, S., Kasper, E., Sammler, D., Schulze, K., Gunter, T., & Friederici, A.D. (2004). Music, language, and meaning: brain signatures of semantic processing. Nature Neuroscience, 7, 302-307.