operant conditioning of cortical activity
DESCRIPTION
Operant Conditioning of Cortical Activity. E Fetz , 1969. http://web.mit.edu/bcs/schillerlab/research/A-Vision/A5-1.html. Background. Many foundations considered a given now Muscle – motor unit correlation Voluntary control of activity Operant conditioning of firing. Design. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/1.jpg)
Operant Conditioning of Cortical Activity
http://web.mit.edu/bcs/schillerlab/research/A-Vision/A5-1.html
E Fetz, 1969
![Page 2: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/2.jpg)
Background
• Many foundations considered a given now• Muscle – motor unit correlation
• Voluntary control of activity
• Operant conditioning of firing
![Page 3: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/3.jpg)
Design
• Experimental Paradigm
• Controls (What could modulate firing rate?)
• Goal: Determine modulator(s)
• Stimuli• Reaching for pellet• Getting a pellet
![Page 4: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/4.jpg)
Methods
Jackson 2007
![Page 5: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/5.jpg)
Results
ISIs
Avg.Wave
Different feedback modalities / subjects
![Page 6: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/6.jpg)
Summary / Criticisms
• Modulation of firing rate is reward bound
• Do documentation of movement, what is the monkey learning to do?
![Page 7: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/7.jpg)
Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex.
Chapin et al. 1999
![Page 8: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/8.jpg)
Lever-movement/robot-arm mode
Robot Arm
Water Dispenser
Lever
![Page 9: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/9.jpg)
![Page 10: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/10.jpg)
What does spatio-temporal mean in this context?
Trials #
Time from movement onset (s)
![Page 11: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/11.jpg)
NP-function/robot-arm mode
Robot Arm
Water Dispenser
Lever
![Page 12: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/12.jpg)
NP-function/robot-arm mode
Did not press the lever, but still continued to reach
![Page 13: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/13.jpg)
• Was it the rats’ “imaginary movement” that triggered the robot-arm movement?
• The decoder did not discriminate physical movements and imaginary movements in neural signal. What kind of potential drawbacks could that make in real application?
• What kind of additional signals could potentially help discriminate physical vs imaginary movements?
![Page 14: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/14.jpg)
Real-Time prediction of hand trajectory by ensembles of cortical neurons in primates
Wessberg et al. 2000
![Page 15: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/15.jpg)
Background
• Builds on previous paper, can “binary” decision be expanded to an analog signal?
• Primary and secondary motor cortices involved in reaching tasks (M1, PMd, PP)
![Page 16: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/16.jpg)
Experiment• Hypotheses• 1-D and 3-D prediction• Task dependent activation• Linear vs. Non-linear Models• Control External Device
• Experimental Overview
![Page 17: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/17.jpg)
Methods - Recording
Nieder 2005
![Page 18: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/18.jpg)
Methods - Tasks
![Page 19: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/19.jpg)
Artificial Neural Network (non-linear)
Methods - Models
Position Regression intercepts
Firing rates
Error
Weights
Regression (linear)
![Page 20: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/20.jpg)
Results - Data
![Page 21: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/21.jpg)
Results – Prediction, 1-D
![Page 22: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/22.jpg)
Results – Prediction, 3-D
![Page 23: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/23.jpg)
Results – Neuron Dropping
![Page 24: Operant Conditioning of Cortical Activity](https://reader035.vdocuments.us/reader035/viewer/2022062520/56815c36550346895dca1eed/html5/thumbnails/24.jpg)
Discussion / Criticisms• Max accuracy with short training times (10 minutes)• Generalizability of classifier• Relative contributions of motor areas• More neurons != more accuracy. Why?• Why does PMd contribute to better decoding w/ fewer
neurons?
• Real time decoding different from offline decoding (ANNs better in offline, just more computationally expensive)
• Assumption of hyperbolic relationship, limited in extrapolation
• Engineering application is showy, but open loop.