simultaneous recording of eeg and bold responses why and how
TRANSCRIPT
Simultaneous recording of EEG and BOLD responsesWhy and How
1. Motivation and perspectives2. Technical Setup3. EEG data processing
i. The gradient artifact• Technical prerequisites: synchronization• Artifact removal and data quality
ii. The ballistocardiographic artifact4. Current studies5. Conclusions
Synopsis
• Achieving both high spatial and temporal resolution• Shed light on the foundations and interrelations of MEG, EEG and fMRI
Motivation and perspectives
Is there a (partial) correspondence of fMRI and EEG/MEG?• fMRI indirectly inferes neural activity via BOLD-reponse (neurovascular coupling)• EEG/MEG more directly reflect neural activity (apical EPSPs…)
large scalesynchrony
neural firingrates
Motivation and perspectives
Basic applications
• fMRI-informed source reconstruction• parametric designs and EEG-fMRI covariation• single-trial coupling of EEG and fMRI
Motivation and perspectives
Motivation and perspectives
Higher order models
• compound neural mass and hemodynamic models• joint ICA• parallel ICA
Clinical relevance???
Original Motivation:• Mapping epileptic zones
Recent „clinical“ research:• Movement disorders (cortical myoclonus)• Brain-computer interfaces (Biofeedback)
Motivation and perspectives
Measurement techniques and applications
• separate recordings of EEG and fMRI (two sessions)• interleaved recordings (EEG in “silent periods”)• simultaneous recordings (both modalities continuously
measured)
Motivation and perspectives
Continuous/simultaneous measurements:
• temporal correlation of EEG and fMRI• avoidance of order effects
• semi-optimized design
• strongly degraded signal quality (especially EEG)
Fp1
Fp2
F3
F4
C3
C4
P3
P4
O1
O2
F7
F8
T7
T8
P7
P8
Fz
Cz
Pz
Oz
FC1
FC2
CP1
CP2
FC5
FC6
CP5
CP6
TP9
TP10
F1
F2
1 64 2 1 1 1 64 2 1 64
10 µVFp1
Fp2
F3
F4
C3
C4
P3
P4
O1
O2
F7
F8
T7
T8
P7
P8
Fz
Cz
Pz
Iz
FFT9
FFT10
TFT9
TFT10
TP9
TP10
PO9
PO10
FT11
FT12
EOG
ECG
Sync On R128Sync On Sync On R128Sync On Sync On S 4R128Sync On Sync On R128S 1Sync On Sync On R128Sync On
10 µV
Sub-Delta Delta Theta Alpha Beta
Cz
20 40 60 80 100 1200
2
4
6
8
10
12
Sub-Delta Delta Theta Alpha Beta
Cz
20 40 60 80 100 1200
2
4
6
8
10
12
raw „clean“ EEGcontaminated EEGraw „clean“ EEGcontaminated EEG
Motivation and perspectives
Combined EEG – fMRI Recordings
Actual Status Hard- and Software
Technical Setup
EEG-Recording
System Components (BrainAmp MR plus, Brain Products GmbH):
1. EEG amplifier unit, 32 channel, fMRI approved (GE, Bruker, Siemens and
Phillips scanner), accumulator driven
2. EEG cap (EASY Cap), 32 channel (plus EOG, ECG), modified 10-20 system, sintered Ag/AgCl sensors, 10 kOhm for EEG cables, 15 kOhm for EOG/ECG cables, 3 different sizes
3. Sync-Box (Frequency divider), synchronization between MR scanner and EEG data recording
4. EEG-Data acquisition computer + Recording Software
5. BrainAmp I/O USB Adapter, interface between all other components
Technical Setup
Technical Setup
EEG cap
Technical Setup
EEG Amplifier
Stimulation Modes
1. Visual Stimulation:
Stimulation Computer (Presentation) -> Beamer -> Ground Glass -> Mirror (800x600 pixel) -> Subject
2. Auditory Stimulation:
Stimulation Computer (Presentation) -> Audiometer -> Audio Amplifier -> MR compatible stereo Head Phones -> Subject
3. Tactile Stimulation:
Stimulation Computer (Presentation) -> pneumato-tactile Stimulator -> 8 (finger) membranes -> Subject
Technical Setup
Components which are inside the MR measurement chamber are emphasized in green
Technical Setup
Tactile Stimulation
• driven by compressed air• up to eight independent output channels• integrated TTL trigger control unit
MRI compatible opto-electrical Response Unit
– 2 response panels (shape is adapted for left and right hand)
– Each panel provides 2 response buttons (best fitting for index and middle finger)
– Response panels are connected to opto-electrical transducers via fiber optical cables (inside MR chamber)
– Response signals are recorded by Stimulation and Recording Software in order being referable during later analysis
Technical Setup
Technical Setup
Response Unit
Triggering / Synchronization
(Hardware) Trigger Generators:
1. Stimulation Computer: event coding and timing via Presentation port codes
2. Response Unit: response coding trigger
3. SyncBox: periodic sync trigger generated from scanner electronic pulse to synchronize the EEG signal sampling by the MR scanner rate (requisite for scanner artefact rejection)
4. fMRI-Scanner: volume trigger representing MR volume scan onset time (used for scanner artefact rejection and event timing in Presentation) All triggers are represented in the recorded EEG data set and one can refer to
them during the subsequent data analysis (artefact rejection, averaging etc.).
Technical Setup
Technical Setup
EEG Recording
EEG-Amplifier
fMRIScanner
Electronic
Syn
c pr
eAm
p
I/O-USB Adapter
Sync Box
MR
cha
mbe
r
Stimulation
Audio Amplifier
Opto-elect Transducer
Pneumato-tactile
Stimulator
ResponseButtons
ClipsMembranes
Head Phones
BeamerV
olum
e T
rigge
r
Technical Setup
Online Recording Setup
Combined EEG – fMRI Recordings
Data quality
Technical Setup
EEG data correction
Major artifacts
• “gradient artifact”• induced currents due to gradient switching
• “ballistocardiographic artifact” • movement of conductive material in static magnetic
field
• vibrations due to active helium pump
The “gradient artifact”
• slice selection: • frequency of slice acquisition• e.g. TR = 2s, 28 slices – 14 Hz (and harmonics)
• spatial encoding within a slice:• usually phase encoding• e.g. 64 × 64 Matrix – 64 × 15 = 960 Hz (not recorded)
EEG data correction
The “gradient artifact”
• technical artifact – rather invariant• correction via subtraction of channel-specific templates
• problem 1: subject motion changes position of cables/electrodes
• foam cushions• problem 2: differential timing of EEG sampling and fMRI
acquisition• EEG/MR Synchronisation – “SyncBox”
EEG data correction
synchronized unsynchronized
EEG data correction
Sub-Delta Delta Theta Alpha Beta
Cz
20 40 60 80 100 1200
2
4
6
8
10
12
Sub-Delta Delta Theta Alpha Beta
Cz
20 40 60 80 100 1200
2
4
6
8
10
12
Sub-Delta Delta Theta Alpha Beta
Cz
20 40 60 80 100 1200
2
4
6
8
10
12Fp1
Fp2
F3
F4
C3
C4
P3
P4
O1
O2
F7
F8
T7
T8
P7
P8
Fz
Cz
Pz
Iz
FFT9
FFT10
TFT9
TFT10
TP9
TP10
PO9
PO10
FT11
FT12
EOG
ECG
R128Sync On Sync On Sync On R128Sync On Sync On Sync On R128Sync On Sync On Sync On R128Sync On
10 µV
Sub-Delta Delta Theta Alpha Beta
ECG
20 40 60 80 100 1200
2
4
6
8
10
12
contaminated EEGraw „clean“ EEGcorrected EEGcorrected EEG with sluggishly fixed electrode
EEG data correction
EEG data correction
The ballistocardiographic artifact
• “ballistocardiographic artifact” • movement of conductive material in static magnetic
field
a) cardiac-related axial head motionb) pulsatile movement of the scalpc) electromagnetic induction due to blood flow
EEG data correction
The ballistocardiographic artifact
• correction via subtraction of channel-specific templates
Problems:• biological artifact – high degree of variability• template stability over time – motion induced changes
EEG data correction
BCG artifact
Fp1
Fp2
F3
F4
C3
C4
P3
P4
O1
O2
F7
F8
T7
T8
P7
P8
Fz
Cz
Pz
Iz
FFT9
FFT10
TFT9
TFT10
TP9
TP10
PO9
PO10
FT11
FT12
EOG
ECG
Sync OnS 2 S 32R128Sync On Sync On R128Sync On R128Sync On Sync OnS 1 R128Sync On Sync On R128Sync On
R R
R
R
R
R
R
R
R
R
10 µV
Sync OnS 4
Fp1
Fp2
F3
F4
C3
C4
P3
P4
O1
O2
F7
F8
T7
T8
P7
P8
Fz
Cz
Pz
Iz
FFT9
FFT10
TFT9
TFT10
TP9
TP10
PO9
PO10
FT11
FT12
EOG
ECG
Sync OnS 2 S 32R128Sync On Sync On R128Sync On R128Sync On Sync OnS 1 R128Sync On Sync On R128Sync On
R R R RR R R R R R
200 µV
Sync OnS 4
Fp1
Fp2
F3
F4
C3
C4
P3
P4
O1
O2
F7
F8
T7
T8
P7
P8
Fz
Cz
Pz
Iz
FFT9
FFT10
TFT9
TFT10
TP9
TP10
PO9
PO10
FT11
FT12
EOG
ECG
Sync OnS 2 S 32R128Sync On Sync On R128Sync On R128Sync On Sync OnS 1 R128Sync On Sync On R128Sync On
R R R RR
RR
R R R
200 µV
Sync OnS 4
BCG artifact – after template subtraction
EEG data correction
EEG data correction
The ballistocardiographic artifact
• further improvements may be obtained via:• removal of residual BCGA via ICA• Optimal Basis Set (OBS – channelwise temp. PCA)• OBS - ICA
EEG data correction
Fp1
Fp2
F3
F4
C3
C4
P3
P4
O1
O2
F7
F8
T7
T8
P7
P8
Fz
Cz
Pz
Iz
FFT9
FFT10
TFT9
TFT10
TP9
TP10
PO9
PO10
FT11
FT12
EOG
ECG
Sync OnS 2 S 32R128Sync On Sync On R128Sync On R128Sync On Sync OnS 1 R128Sync On Sync On R128Sync On
R R R RR
RR
R R R
200 µV
Sync OnS 4
Fp1
Fp2
F3
F4
C3
C4
P3
P4
O1
O2
F7
F8
T7
T8
P7
P8
Fz
Cz
Pz
Iz
FFT9
FFT10
TFT9
TFT10
TP9
TP10
PO9
PO10
FT11
FT12
EOG
ECG
Sync OnS 2 S 32R128Sync On Sync On R128Sync On R128Sync On Sync OnS 1 R128Sync On Sync On R128Sync On
200 µV
Sync OnS 4
BCG artifact – after template subtractionBCG artifact – after additional ICA filtering
EEG data correction
Sub-Delta Delta Theta Alpha Beta
Cz
20 40 60 80 100 1200
2
4
6
8
10
12
Sub-Delta Delta Theta Alpha Beta
Cz
20 40 60 80 100 1200
2
4
6
8
10
12
BCG artifact – after template subtractionBCG artifact – after additional ICA filtering
EEG data correction
The ballistocardiographic artifact
• further improvements may be obtained via:• removal of residual BCGA via ICA• Optimal Basis Set (OBS – channelwise temp. PCA)• OBS – ICA
• “automatized” component identification• correlating the raw ECG-trace with time courses of
independent component• correlating BCGA-topography with IC weighting matrix
EEG data correction
F00
F01
F02
F03
F04
F05
F06
F07
F08
F09
F10
F11
F12
F13
F14
F15
F16
F17
F18
F19
F20
F21
F22
F23
F24
F25
F26
F27
F28
F29
F30
F31
Sync OnS 2 S 32R128Sync On Sync On R128Sync On R128Sync On Sync OnS 1 R128Sync On Sync On R128Sync On
R R R R R R R R R R
5 µV
Sync OnS 4
Fp1
EOG
ECG
S 2Sync On S128Sync On Sync On R128Sync OnS 8 Sync On R128Sync On S 2Sync OnS 32R128Sync On Sync On Sync On
RR R R
R
R R R R RR R
R R
1000 µV
1000 µV
1000 µV
S 32R128 S 8R128
F00
F01
F02
F03
F04
F05
F06
F07
F08
F09
F10
F11
F12
F13
F14
F15
F16
F17
F18
F19
F20
F21
F22
F23
F24
F25
F26
F27
F28
F29
F30
F31
S 2Sync On S128Sync On Sync On R128Sync OnS 8 Sync On R128Sync On S 2Sync OnS 32R128Sync On Sync On Sync On
10 µV
S 32R128 S 8R128
EEG data correction
Fz
Cz
Pz
10 µV
10 µV
10 µV
Fz
Cz
Pz
10 µV
10 µV
10 µV
-7.84 µV 7.84 µV0.00 µV
248 ms
50 µV
-14.32 µV 14.32 µV0.00 µV
344 ms -4.83 µV 4.83 µV0.00 µV
240 ms
-15.00 µV 15.00 µV0.00 µV
348 ms
subtraction only additional ICA filtering
EEG data analysis
EEG data analysis
EEG data analysis
-15.00 µV 15.00 µV0.00 µV
FCz
-15.00 µV 15.00 µV0.00 µV
FCz
time
ampl
itude
EEG data analysis
standard fMRI single trial fMRI
Conclusions
Current studies:• Tactile Stop-Signal task (executive functions)• Affective conditioning• Language processing
Planned study:• Resting state/default mode network