the cognitive neuroscientist’s toolkitcs182/sp07/notes/rissman_cogneuromethods_final.pdfe = mc2...

54
fMRI LESION EEG/MEG QuickTimeª and a TIFF (Uncompressed) decomp are needed to see this pictur PET TMS The Cognitive Neuroscientist’s Toolkit Jesse Rissman CS 182 Guest Lecture, 2/1/07

Upload: others

Post on 22-Feb-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

fMRILESION EEG/MEG

QuickTim

eª and aTIFF (U

ncompressed) decom

pressorare needed to see this picture.

PET TMS

The Cognitive Neuroscientist’s Toolkit

Jesse Rissman CS 182 Guest Lecture, 2/1/07

Page 2: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Ventricular theory of brain function

* Anterior ventricle controls perception * Middle ventricle controls cognition * Posterior ventricle controls memory

Galen (129-200 AD)

A little history…

Page 3: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Could he have been right?

Don’t believe everything you read in Glamour Magazine!

Page 4: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Franz Joseph Gall(1758-1828)

Phrenology: the start of localizationism

Page 5: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Mr. Burns: Who could forget such a monstrous visage? She has the sloping brow and cranial bumpage of the career criminal.”

Smithers: "Uh, Sir? Phrenology was dismissed as quackery 160 years ago.”

Mr. Burns: (measuring Smithers' head) "Of course you'd say that... you have the brainpan of a stagecoach tilter!"

Some people still believe in phrenology to this day.

Page 6: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Lesions as tool to gain insight into brain function

Broca’sArea

The brain of patient “tan”

Page 7: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Another landmark case

Carl Wernicke(1848-1904)

Page 8: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Cytoarchitectonic Areas (Brodmann, early 1900s)

Page 9: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Electrocortical Stimulation Mapping

the motor homunculus

Page 10: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

E = mc2

???

The First “Brain Imaging” Experiment

“[In Mosso’s experiments] the subject to be observed lay on a delicately balanced table which could tip downward either at the head or at the foot if the weight of either end were increased. The moment emotional or intellectual activity began in the subject, down went the balance at the head-end, in consequence of the redistribution of blood in his system.”

-- William James, Principles of Psychology (1890)

Angelo MossoItalian physiologist

(1846-1910)

… and probably the cheapest one too!

Source: Jody Culham’s fMRI for Dummies web site

Page 11: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Positron Emission Tomography (PET)

• Subjects injected with radioactive isotope, which emits positrons• Positrons collide with electrons, emitting two photons (gamma rays) in

opposite directions• Detectors surrounding brain register simultaneous photons and compute

likely source• Neural activity ==> increased metabolic demand ==> local increase in

blood flow the active region

Page 12: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

PET• Compares regional cerebral blood

flow (rCBF) between cognitive states (experimental conditions)

• Integrates signal over 45-60 sec• Need to wait a number of half-lives

before next injection

Page 13: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Listening to wordsPassively viewing words

Speaking words Generating verbs

Petersen et al. (1988). Positron emission tomographic studies of the cortical anatomy of single-word processing. Nature.

The first cognitive PET study

Page 14: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

PET: Pros and Cons

• PROs– Decent spatial

resolution (5-10mm3)– Can also measure

neurotransmitter metabolism.

– Can be used as a tool to aid in early diagnosis of disorders such as Alzheimer’s disease

• CONs– Invasive

(radioactive injection)

– Very expensive– Poor temporal

resolution– Cannot detect the

neural response to discrete cognitive events.

Page 15: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

MRI studies brain anatomy.Functional MRI (fMRI) studies brain function.

MRI vs. fMRI

Source: Jody Culham’s fMRI for Dummies web site

Page 16: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Berkeley’s 4 Tesla Magnet1 Tesla (T) = 10,000 Gauss

Earth’s magnetic field = 0.5 Gauss

4 Tesla = 4 x 10,000 ÷ 0.5 = 80,000 X Earth’s magnetic field

B0

Page 17: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Magnets attract metal objects

Page 18: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Necessary Equipment

Magnet• very strong magnetic field

Gradient Coil• enables spatial encoding

Radio Frequency Coil• receives and transmits radio frequencies

Source for Photos: Joe Gati

RF Coil

giant magnet

gradient coil(inside)

fMRI for Dummies

Page 19: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Very Basic MRI Physics

Page 20: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

MRI vs. fMRI

↑ neural activity ↑ blood oxygen ↑ fMRI signal

MRI fMRI

one image

many images (e.g., every 2 sec for 20-60 mins)

high resolution(1 mm)

low resolution(~3 mm but can be better)

fMRI Blood Oxygenation Level Dependent (BOLD) signal

indirect measure of neural activity

Source: Jody Culham’s fMRI for Dummies web site

Page 21: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

As the ratio of oxygenated to deoxygenated hemoglobin increased, BOLD fMRI signal increases

Page 22: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Hemodynamic Response Function (HRF)

brief stimulus

peak BOLD response (4-6 sec post-stimulus)

signal decay

undershoot

Page 23: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

fMRI Setup

Page 24: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

A basic fMRI experimental design

• Subject is given sensory stimulation or task, interleaved with control or rest condition

• Acquire BOLD-sensitive MRI images during stimulation

• Analyze image timeseries to determine where signal changed in response to stimulation

PredictedBOLD signal

time

Stimuluspattern

on

off

on

off

on

off

on

offoff

Page 25: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

The first fMRI Experiment

Time

BrainActivity

Source: Kwong et al., 1992

Flickering CheckerboardOFF (60 s) - ON (60 s) -OFF (60 s) - ON (60 s) - OFF (60 s)

Page 26: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

W. W. Norton

BOLD signal change during presentation of static and moving visual stimuli

QuickTimeª and aTIFF (LZW) decompressor

are needed to see this picture.

Page 27: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Blocked vs. Event-Related Designs

Page 28: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Advantages of event-related designs

Wagner et al., 1998, Science

Characterize individual trials after-the-fact, based on the subject’s behavioral response

Blumenfeld et al., 2006 J Neuroscience

Correct trials vs. Incorrect trials

Page 29: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Modularity vs. Networks

Functional Segregation

Functional Integration

Localization of category-specific visual processing regions

Statistical modeling of functional interactions between brain regions

Page 30: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Diffusion Tensor Imaging (DTI)

• Water diffusion restricted along white matter pathways

• Tractography: tracing white matter pathways between gray matter regions

Tract-based connectivity

Color-coded directions

xy

z

Page 31: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Can fMRI read your mind?

Page 32: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

The Era of Neuromarketing Has Begun

Page 33: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

A more reasonable example

O’Craven & Kanwisher, 2001FFAFFA- Fusiform Face Area- Fusiform Face AreaPPAPPA- Parahippocampal Place Area- Parahippocampal Place Area

FFAPPA

Page 34: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

But we still have a long way to go

Page 35: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Spatial and Temporal Resolution

Page 36: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Single-unit recording:Identifying neuronal receptive fields

Page 37: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Memory Cells in the Prefrontal Cortex

Page 38: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

A Face Area in the Monkey Brain

An area of the monkey’s brain that responds to faces

Page 39: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

A Halle Berry neuron?

Quiroga et al., 2005, Nature

Page 40: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Electroencephalography (EEG)

• fMRI does not provide precise info about the timing of neural activity.

• Single-unit recordings can only measure activity in one brain region at a time.

• EEG can record electrical potentials of large populations of simultaneously active neurons at the scalp with millisecond resolution.

• Plus, EEG is a direct measure of neural activity.

Page 41: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

W. W. Norton

Arousal states of the brain: characteristic waveform patterns

Page 42: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

What about electrical activity for specific cognitive events?

Event-Related Potentials (ERPs)

Page 43: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

ERP example:The face-sensitive N170

QuickTimeª and aTIFF (LZW) decompressor

are needed to see this picture.

Page 44: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Magnetoencephalography (MEG)

SQUID Array:64 to 275 Sensing Locations

Page 45: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Cortical surface rendering of MEG activity

Gonsalves et al. (2005) Neuron

Page 46: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Electrocorticography (ECoG):Direct recordings from the cortical surface

Page 47: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Transcranial Magnetic Stimulation (TMS)

• Brief powerful (several thousand amperes) electrical charge is created in coil

• Creates a 1.5-2.0 Tesla magnetic field capable of inducing eddy currents in tissue 1-2 cm deep

QuickTimeª and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Page 48: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Transcranial Magnetic Stimulation (TMS)

– Disrupts normal neural function by adding noise

– In essence, TMS creates a temporary “virtual patient”

– Unlike fMRI and PET, TMS can assess the causal influence of a region on behavior.

– Unlike naturally-occurring lesions, TMS gives the researcher more control, better temporal resolution, and the ability to create multiple virtual patients in the same individual.

Page 49: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Safety Issues

• Generally thought to be free from harmful effects

• Examination of brain tissue submitted to thousands of TMS pulses has shown no detectable structural changes

• It is possible in unusual circumstances to trigger a seizure in healthy subjects, but using the proper guidelines eliminates this risk

Page 50: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

A simple TMS experiment

• Coil placed over target brain region• Cognitive failures recorded

Page 51: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Real lesion

Blue = sighted; Red = early blind

Cohen et al., 1997. Occipital TMS disrupts braille reading in early blind, but not control subjects

Hamilton et al., 2000. Reported case of blind woman who lost ability to read braille following bilateral occipital lesions

Establishing causal links between brain activity and behavior

TMS “lesion”

Page 52: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

fMRI-guided TMS stimulation

Page 53: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Converging Methodolgies: fMRI guided-TMS/ERP

FFA

PFC)))TM

SEEG

0 50 100 150 200 250 300 350 400[ms]-16-14-12-10-8-6-4-20246810[µV]PO8

N170 ERP

Page 54: The Cognitive Neuroscientist’s Toolkitcs182/sp07/notes/Rissman_CogNeuroMethods_FINAL.pdfE = mc2 The First “Brain Imaging” Experiment “[In Mosso’s experiments] the subject

Thanks for your attention!