language and the human brain - university of california ... · language and the human brain jeff...

71
Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego

Upload: others

Post on 29-May-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Language and the human brain

Jeff Elman

Department of Cognitive Science University of California, San Diego

Page 2: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Animal language?

Page 3: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Protective coloration

Page 4: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 5: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Vervet alarm calls

•  Eagle alarm call

•  Snake alarm call

Page 6: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Kanzi

Page 7: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Kanzi

Page 8: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 9: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Is this language?

Page 10: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

4 quick examples

Page 11: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

1.

Where are the words, anyway?

Page 12: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Whereareth es il ens es b et w eew or d s Whereareth es il enc es b et w eenw or d s

Page 13: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Baby statisticians?

Saffran, Aslin, Newport, 1996

Page 14: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

pabikulatidorepabikutalikulatidopabikulilitalatidotupabiku

Page 15: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

2.

What a big vocabulary you have!

Page 16: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

milk

bottle

bed

chair

kitty

doggie

cookie

candy horse

bird mommy

daddy Jane

go

run

see

man

drink

Do you want to eat a VIOLET CRUMBLE?

Page 17: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

3.

Syntax, syntax, syntax

Page 18: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

The dog barked. mouse sees The the dog.

that the

Page 19: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Noun Phrase Verb Phrase

The dog barked

that the mouse sees

NP VP

Sentence

NP VP

that the cat chases

The dog the mouse sees barked. The dog the mouse the cat chases sees barked.

Page 20: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

4.

Saying one thing, meaning another

Page 21: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

This car is a lemon.

If you do that, you’ll be sorry.

If I were you, I’d hate myself.

Page 22: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

The Voringian Binx glorphed the Knappaboor.

Page 23: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Language really is different

Page 24: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

A language organ in the brain?

Page 25: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Brain of Leborgne - Left Hemisphere

Page 26: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 27: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 28: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Moses, 1999

Page 29: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Nichelli et al. (1994).

Brain regions that are active in expert chess players during the end game of chess

Page 30: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

MENTAL ROTATION: Imagining the Movement of an Object

010002000300040005000

40 80 120 160Angle of Rotation from Vertical (degrees)

Res

pons

e Ti

me

(ms)

SAME

MIRROR

SAME

The mental rotation task

Page 31: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Mental Rotation FMRI Data Ark, Haist, & Stiles (in prep)

R R L L

Parietal Lobe • Visual attention • Visual memory • Image generation • Spatial

manipulation

Fusiform Gyrus - Object Recognition

Area MT •  Perception of motion

Page 32: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Brain areas that process environmental sounds

Dick, Saygin, Galati, Pitzalis, Bentrovato, D’Amico, Wilson, Bates, Pizzamiglio (in revision)

Page 33: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Brain areas that process language

Dick, Saygin, Galati, Pitzalis, Bentrovato, D’Amico, Wilson, Bates, Pizzamiglio (in revision)

Page 34: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Hauk, Johnsrude, Pulvermuller (2004)

Page 35: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Our brains are opportunistic

Page 36: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Our brains are integrative

Page 37: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Hearing (speech) alone Seeing (lips) alone

Hearing (speech) & Seeing (lips) together

Page 38: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

•  The left hemisphere •  Many more regions

involved

Page 39: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

A gene for language?

Page 40: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 41: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 42: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 43: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

pyramidal cells

mossy cells

muscle cells

sperm cells Purkinje cell

Page 44: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 45: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 46: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 47: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

A gene for language?

Page 48: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

3 generations 30 family members 15 afflicted members

The KE family

Page 49: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 50: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

FOXp2

Page 51: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Human FOXp2

Mouse FOXp2

nearly identical!!

Page 52: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

BASAL GANGLIA

Page 53: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Language depends on rapid and complex vocal movements

Chimpanzees cannot voluntarily control vocalizations

A very small change in FOXp2 makes this possible

Page 54: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Small changes can lead to big differences

Page 55: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

A new machine built out of old parts

Page 56: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Brain areas that process environmental sounds

Dick, Saygin, Galati, Pitzalis, Bentrovato, D’Amico, Wilson, Bates, Pizzamiglio (in revision)

Page 57: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Brain areas that process language

Dick, Saygin, Galati, Pitzalis, Bentrovato, D’Amico, Wilson, Bates, Pizzamiglio (in revision)

Page 58: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

The connections really matter

Page 59: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Coronal section of brain (looking forward)

Page 60: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Scanning the brain of Leborgne – Nina Dronkers

Page 61: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Superior longitudinal fasciculus

Page 62: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Superior longitudinal fasciculus of Leborgne

Right Hemisphere Left Hemisphere

Page 63: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Other things matter, too

Page 64: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 65: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 66: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators
Page 67: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Anterior

Redcay, Haist, & Courchesne (submitted)

Posterior

Right Left

Page 68: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Development:

The importance of starting small

Page 69: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Putting it all together. . .

Page 70: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

bonobo macaque human song bird termite

Control over respiration

Control over articulators

Sequencing

Memory

Sociability

Auditory processing

Imitation

Predictive learning

Lang

uage

is p

ossi

ble

Page 71: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators

Thank you