decoding neural signals for the control of movement
DESCRIPTION
Decoding Neural Signals for the Control of Movement. Jim Rebesco and Sara Solla Lee Miller and Nicho Hatsopoulos. Outline. Recording of neural activity in primary motor cortex during task execution. - PowerPoint PPT PresentationTRANSCRIPT
Decoding Neural Signals for the Control of Movement
Jim Rebesco and Sara Solla
Lee Miller and Nicho Hatsopoulos
Outline
• Recording of neural activity in primary motor cortex during task execution.
• Analysis of multielectrode data based on directional tuning: linear dimensionality reduction.
• Uncovering task-specific low dimensional manifolds: nonlinear dimensionality reduction.
Primary motor cortex: neural recordings
Primary motor cortex: motion direction
Center-out task
QuickTime™ and aH.264 decompressor
are needed to see this picture.
Primary motor cortex: simultaneous recordings
Target-dependent population activity
reach implies
Cosine tuning for direction of motion
Dimensionality reduction
N=100
PCA: two-dimensional projection
PCA: eigenvalues
ISOMAP: nonlinear dimensionality reduction
Multidimensional scaling
A B C D
A 0 7 2 3
B 7 0 4.5 6
C 2 4.5 0 5
D 3 6 5 0
A method for embedding objects in a low dimensional space such that Euclidean distances between the corresponding points reproduce as well as possible an empirical matrix of dissimilarities.
Multidimensional scaling Consider data in the form of N-dimensional vectors. For us, the data is the N-dimensional vector of firing rates associated with each reach
Multiple reaches result in an NxM matrix:
If the matrix is hidden from us, but we are given instead an
MxM matrix
of squared distances between data points, can
we reconstruct the matrix ?
Multidimensional scaling
If the distances are Euclidean to begin with:
the scalar product between data points can be written as:
In matrix form,
and
where is the MxM centering matrix:
Multidimensional scaling
In matrix form:
From this equation the data matrix can be easily obtained:
If the distance matrix to which this calculation is applied is based on Euclidean distances, this process allows us to compute the data matrix X from the distance matrix S. A reduction of the dimensionality of the original data space follows from truncation of the number of eigenvalues from M to K, and the corresponding restriction in the number of eigenvectors used to reconstruct X. It can be proved that this truncation is equivalent to PCA, which is based on the diagonalization of .
Tenenbaum et al. 2000
ISOMAP: a nonlinear embedding
ISOMAP: two-dimensional projection
Mutual informationHow much can we learn about the class that a given point belongs to by knowing its location in space?
Center-out task: eight targets
Center-out task, revisited
ISOMAP: two-dimensional projection
Tuning for velocity?
At a specified time after the go-signal, identify the direction of the velocity vector in the work space, and also the direction of the projection of the corresponding reach in the isomap space.
UC 1 UC 2
ISOMAP
Principalcomponents
1
8
Targets
360
300
240
180
120
60
0
3603002401801206 00
360
300
240
180
120
60
0
3603002401801206 00
360
300
240
180
120
60
0
3603002401801206 00
Initial trajectory (degrees)Initial trajectory (degrees)
Neuraldirectionvector(degrees)
Neuraldirectionvector(degrees)
360
300
240
180
120
60
0
3603002401801206 00
Development of a bidirectional Brain Machine Interface
• Incorporate realistic limb dynamics into forward pathway• Incorporate proprioception in feedback pathway
Motion predictions from M1 activity
* simultaneous recordings of population activity can be analyzed with techniques fundamentally different techniques than those used for single neurons
* for limb reaches, the population activity defines a nonlinear low dimensional manifold, whose intrinsic coordinates capturetask-relevant kinematic dimensions
* this technique enables the visualization of high-dimensional neural data with minimal information loss