Download - beyond brain
-
7/30/2019 beyond brain
1/50
figure1.1
Tearchitectureofaneural
circuit.Reproductionofa
RamnyCajaloriginal
drawin
gshowinganeural
circuitform
edbymany
neurons.Onesingleneuron
anditscellu
larspecializa-
tionsarehighlighted.In
general,den
dritesserve
asthemain
neuronal
specializationreceivin
g
synapsesfromother
neurons.Axonterminals
establishtheneurons
synapseswithotherbrain
cells.(Cajalsdrawingfrom
HistologyoftheNervous
Systemwas
reproducedwith
permissiono
ftheCajal
Legacy,InstitutoCajal[CSIC],
Madrid,Spain.)
-
7/30/2019 beyond brain
2/50
figure 1.2 Use of graph theory to study the distribution of pathways linking
pairs of neurons. On top, a square matrix is used to represent the direct, monosyn-
aptic connectivity of a small brain circuit. In this matrix, 1 represents the existence
of a direct connection between a pair of brain structures, while 0 depicts its absence.
Next to the matrix, a graph is used to represent the circuit. Circles with numbers
represent the structures and directional arrows represent the direct connectivity
information contained in the square matrix. Te histogram below depicts the total
number of pathways linking two structures (carotid baroreceptor and cerebellum)
that did not share a direct, monosynaptic connection. Te X axis represents thenumber of synapses of the pathways and the Yaxis depicts the number of pathwaysfound. Notice that millions of pathways were found for this particular example.
(Courtesy of Dr. Miguel Nicolelis; redrawn by Dr. Nathan Fitzsimmons, Duke University.)
-
7/30/2019 beyond brain
3/50
figure 2.1 Tomas Youngs trichromatic theory of color. A portrait of Tomas
Young and a graphic representation of his theory on the right. Notice that any color
stimulus (P, Q, R, or S in theXaxis of the plot on the bottom le) can be representedby the graded response of three distinct color receptors, which responds maxi-mally to red, green, and blue respectively, but can also respond submaximally to
dierent colors. (Youngs portrait was reproduced with permission of the NationalPortrait Gallery, London. Te gure was originally published in M.A.L. Nicolelis,Brain-Machine Interfaces to Restore Motor Function and Probe Neural Circuits.Nature Reviews Neuroscience 4 [2003]: 41722.)
-
7/30/2019 beyond brain
4/50
figure 2.2 Putting the neurons supremacy in ink. Don Santiago Ramn y Cajal
at his favorite place, in front of a microscope, and a few of his masterpiece drawings
of dierent portions of the central nervous system. (Cajals three drawings from His-
tology of the Nervous System and the photo were reproduced with permission of the
Cajal Legacy, Instituto Cajal [CSIC], Madrid, Spain.)
-
7/30/2019 beyond brain
5/50
figure 3.1 Korbinian Brodmanns cortical cytoarchitectonic map and the six lay-
ers of the cortex. A side view of the human brain with the original numeral desig-
nations of cortical areas created by Brodmann is on the right. A comparison of the
six layers of a section through the primary motor (M1) and visual (V1) cortices is
shown on the le. Cytoarchitectonically speaking, the M1 is characterized by thepresence of large pyramidal-looking neurons (Betz cells) in layer V, while V1 exhib-
its a very dense cluster of neurons in the bottom part of layer IV and upper part of
layer VI. (Cajals two drawings from Histology of the Nervous System were reproduced
with permission of the Cajal Legacy, Instituto Cajal [CSIC], Madrid, Spain. Brodmanns
Areas, originally published in 1910, are in the public domain.)
-
7/30/2019 beyond brain
6/50
figure 3.2 Te homunculus meets the rattunculus. Te drawing depicts an
impossible meeting between the reconstruction of the cortical homunculus, the
distorted representation of a humans body in the primary somatosensory cortex,
based on Wilder Penelds studies, and a cortical rattunculus, the equivalent dis-
torted representations of the rats body, in the rodent primary somatosensory
cortex. Notice the overrepresentation of the lips and hands in the homunculus and
the facial whiskers, snout, and forepaws in the rattunculus. Te cheese is Swiss.
(Illustrated by Dr. Nathan Fitzsimmons, Duke University.)
-
7/30/2019 beyond brain
7/50
figure 3.3 Revolutionary plasticity experiment in owl monkeys by Jon Kaas and
Michael Merzenich. On the le, Jon Kaas appears with a close collaborator. On the
right, the top shelf describes how, aer a traumatic amputation of the third nger,
the territory representing this nger in the primary somatosensory cortex of an
owl monkey does not remain silent. Instead, the region that was occupied by nger 3
is now invaded by enlarged representations of ngers 2 and 4. Te lower shelf
shows that enlargement of the representations of ngers 14 can be obtained byrepetitive, selective stimulations of these digits in detriment of nger 5. o see the
eect, just compare the map on the bottom middle (before selective stimulation)
with the cortical map on the bottom right (aer stimulation). (Adapted from, M. M.
Merzenich, J. H. Kaas, J. Wall, R. I. Nelson, M. Sur, and D. Felleman, opographic Reorga-
nization of Somatosensory Cortical Areas 3B and 1 in Adult Monkeys Following Restricted
Deaerentation,Neuroscience 8, no. 1 [1983]: 3355, with permission from Elsevier.)
-
7/30/2019 beyond brain
8/50
figure 3.4 Te brain adopts a rubber hand. Te drawing depicts the experimen-
tal apparatus used to induce the rubber hand illusion. See the text for details.
(Illustrated by Dr. Nathan Fitzsimmons, Duke University.)
-
7/30/2019 beyond brain
9/50
figure 4.1 Sample of rst EEG recording ever obtained by Hans Berger. Te trace
represents a few seconds of the electrical activity of Bergers own son, recorded
using scalp sensors. (From Hans Berger, ber das Elektrenkephalogramm des Men-
schen, European Archives of Psychiatry and Clinical Neuroscience 87, no. 1 [1929]:
52770, with permission from Springer.)
figure 4.2 Te single microelectrode recording method. A single metal micro-
electrode, positioned in the extracellular space next to two neurons, is capable of
recording the extracellular action potentials of both cells. Inspection of the record-
ing trace in the oscilloscope reveals that the action potentials of the two neuronshave dierent shapes and magnitudes, allowing the distinction between the two
cells. (Illustrated by Dr. Nathan Fitzsimmons, Duke University.)
-
7/30/2019 beyond brain
10/50
figure 4.3 3-D image of a small patch of the sky produced by an array of radio
telescopes in Cambridge, England. Peaks identify galaxies that emit radio signals.Te height of each peak indicates the magnitude of the radio signal produced by
each galaxy. (Originally published in Joseph Silk, Te Big Bang [San Francisco, Calif.:
W. H. Freeman, 1980], with permission from Mullard Radio Astronomy Observatory
[MRAO] and Cavendish Laboratory, Cambridge.)
-
7/30/2019 beyond brain
11/50
figure 4.4 Engineering a better way to listen to the brain. On the le, a high-
power magnication of a multi-electrode array produced at the Duke University
Center for Neuroengineering (DUCN) by Gary Lehew and Jim Meloy. Notice that
multiple thin metal laments are clustered in a matrix format. Such laments are
exible and can be chronically implanted in the brain, remaining active for months
to years. On the right, a sample of dierent types of multi-electrode arrays created
at the DUCN in the past decade. (Courtesy of Dr. Miguel Nicolelis.)
-
7/30/2019 beyond brain
12/50
figure 5.1 An experimental setup designed for testing the ability of freely behav-
ing rats to use their facial whiskers to discriminate the diameter of an aperture in
the dark. Eshe is seen in the right frame performing the task with gusto! (Originally
published in D. J. Krupa, M. C. Wiest, M. Laubach, and M.A.L. Nicolelis, Layer Specic
Somatosensory Cortical Activation During Active actile Discrimination,Science 304
[2004]: 198992.)
-
7/30/2019 beyond brain
13/50
figure 5.2 emporal and spatial resolution of the single electrode versus multi-
electrode recording methods. Te top graph relates the spatial and temporal resolu-
tion of most techniques used to investigate brain function. Te lower graph compares
the single and multi-electrode recording method using the same parameters.
(Adapted from A. Grinvald and R. Hildesheim, VSDI: A New Era in Functional Imaging
of Cortical Dynamics.Nature Reviews Neuroscience 5 [2004]: 87485, with permission
from Macmillan Publishers Ltd.)
-
7/30/2019 beyond brain
14/50
figure5.3
Manysingleneurons.
Computers
creenimage
depictingth
eaction
potentialsp
roducedbya
sampleof394cortical
neuronsrec
orded
simultaneouslyinafreely
behavingprimate.Te
lemosthalfofthe
picture
showsfourdistinctfamilies
ofactionpo
tentials,
recordedsimultaneously
fromasingle
microelectrodeofanarray,
demonstratingtheelectrical
activityoffourdierent
corticalneu
ronssampled
simultaneously.Tesefour
distinctneu
ronsareshown
inisolation
inthelowerle
corner.(Cou
rtesyof
Dr.MiguelN
icolelis.)
-
7/30/2019 beyond brain
15/50
figure 5.4 Te whisker map of the rats face. Te le panel depicts the distribu-
tion of facial whiskers in the rat snout on four rows and many columns. Te right
half of the gure depicts a horizontal section through layer IV of the rat primary
somatosensory cortex (S1) that contains the entire rattunculus, including a whis-
ker representation (barrel cortex), nose (N), lower jaw (LJ), forepaw (FP), and hind-paw (HP), and is stained for the presence of a mitochondrial enzyme found in
neurons. Dark clusters represent clusters of neurons in layer IV. Notice that the
barrel cortex contains an isomorphic representation of whisker rows and columns.
Circles identify whisker C2 both in the rat face and the S1 cortex.
(Courtesy of Drs. John Chapin and Rick Lin.)
-
7/30/2019 beyond brain
16/50
figure 5.5 Te le half of the gure depicts the connectivity of some of the main
brain structures that dene the rat trigeminal somatosensory system. Excitatory (+)
and inhibitory (-) connections are shown. Te mechanical stimulation of facial whis-
kers triggers electrical responses of neurons in the trigeminal ganglion (Vg). Vg neu-
rons project to two distinct trigeminal nuclei in the brain stem: the spinal (SpV) and
principal (PrV) nuclei. Tese two send nerve pathways to three thalamic nuclei: the
ventroposterior medial nucleus (VPM), the posterior medial (POM) nucleus, and
the zona incerta (ZI). Te thalamic reticular nucleus (R) provides inhibition to the
VPM and POM. VPM, POM, and ZI provide thalamic nerve bers to the primary
somatosensory cortex. Of those, the ZI is the only one that sends inhibitory aerents
to the S1 cortex. In the right half of the gure, a stack of 3-D graphs illustrates the
simultaneously recorded tactile-evoked responses of populations of individual neu-
rons at dierent levels of the trigeminal system. (Adapted from M.A.L. Nicolelis, L. A.Baccala, R.C.S. Lin, and J. K. Chapin, Sensorimotor Encoding by Synchronous Neural
Ensemble Activity at Multiple Levels of the Somatosensory System.Science 268 [1995]:
135358; and from M.A.L. Nicolelis, A. A. Ghazanfar, B. Faggin, S. Votaw, and L.M.D.
Oliveira, Reconstructing the Engram: Simultaneous, Multisite, Many Single Neuron
Recordings.Neuron18 [1997]: 52937, with permission from Elsevier.)
-
7/30/2019 beyond brain
17/50
figure 5.6 VPM peri-stimulus time histograms. Four peri-stimulus time histo-
grams illustrate typical averaged electrical responses of single VPM neurons fol-
lowing the deection of facial whiskers. In each histogram, the Xaxis representsthe peri-stimulus time, 0 indicates the time of whisker deection. Te Y axisdepicts the number of spikes produced by the cell. (Courtesy of Dr. Miguel Vieira,
Duke University.)
-
7/30/2019 beyond brain
18/50
-
7/30/2019 beyond brain
19/50
figure 5.7 Spatiotemporal RF and maps. (A) Spatiotemporal receptive
eld (RF) of a single VPM neuron. Each 3-D graph represents the spatial
domain (RF) of a single VPM neuron at a par ticular post-stimulus time
interval (510 ms, 2025 ms, 3550 ms). In each 3-D graph theXand Yaxesdepict the position of whiskers in the rows and columns found in the rats
face. Te Z axis represents the magnitude of the VPM neurons ringresponse when one particular whisker is mechanically deected. Notice
that at 510 ms, whisker E1 elicits the strongest ring response of the VPM
neuron, while stimulation of other whiskers produces somewhat smaller
responses. Yet, at 3550 ms aer the whisker stimulus, whisker E4 triggers
the strongest response of the same cell. Tus, the spatial center of the RF of
this VPM neuron shis as a function of post-stimulus time. (B) Spatiotem-
poral histogram depicting the tactile responses of a population of simulta-
neously recorded VPM neurons. Post-stimulus time is represented in theXaxis, with 0 marking the onset of whisker stimulation. Te Yaxis depicts anumber of individual VPM neurons recorded simultaneously. Te gray-
shaded Zaxis illustrates the magnitude of ring of these VPM neurons as afunction of time. (C) Spatiotemporal RF of a single neuron located in the
rat primary somatosensory cortex. In each of these 3-D graphs, theXaxisrepresents whisker columns, the Yaxis represents whisker rows, and the Zaxis (gray-scale) represents the magnitude of a single cortical neuron response.
Each 3-D graph depicts a particular post-stimulus time interval (812, 12
16, 1620, 2024, 2428 ms). Notice that, like in the VPM, the spatial
domain of the RF changes as a function of post-stimulus time. (Adapted from
M.A.L. Nicolelis, L. A. Baccal, R.C.S. Lin, and J. K. Chapin, Sensorimotor Encod-
ing by Synchronous Neural Ensemble Activity at Multiple Levels of the Somato-
sensory System. Science 268 [1995]: 135358; from M.A.L. Nicolelis, A. A.
Ghazanfar, B. Faggin, S. Votaw, and L.M.O. Oliveira, Reconstructing the Engram:
Simultaneous, Multisite, Many Single Neuron Recordings. Neuron 18 [1997]:
52937, with permission from Elsevier; from M.A.L. Nicolelis, and J. K. Chapin,
Te Spatiotemporal Structure of Somatosensory Responses of Many-Neuron
Ensembles in the Rat Ventral Posterior Medial Nucleus of the Talamus.Journalof Neuroscience 14 [1994]: 351132, with permission; and from A. A. Ghazanfar
and M.A.L. Nicolelis, Spatiotemporal Properties of Layer V Neurons in the Rat
Primary Somatosensory Cortex.Cerebral Cortex 9 [1999]: 34861, with permis-
sion from Oxford Journals.)
-
7/30/2019 beyond brain
20/50
figure 5.8 Examples of 714 Hz rhythmic mu oscillations observed in the rat tri-
geminal somatosensory system. In the le panel, dierent traces obtained simul-
taneously illustrate that mu oscillations start in the S1 cortex, spread to the VPM,
and later to the spinal complex of the trigeminal brain-stem complex (SPV) before
whisker twitching movements begin. In the right panel, a similar illustration of
the relationship between mu rhythm and whisker twitching is made between the
barrel cortex (rat S1 whisker area), the VPM, the basal ganglia (CP), and the hip-
pocampus (HI). (Originally published in M.A.L. Nicolelis, L. A. Baccala, R.C.S. Lin,
and J. K. Chapin, Sensorimotor Encoding by Synchronous Neural Ensemble Activity at
Multiple Level s of the Somatosensory System.Science 268 [1995]: 135358.)
s/sekipS
edutilpmAPFLlainarcartnI
Time (s) Time (s)64 66 68 0 5 10 15 20
0
0
0
0
200
150
150
150
Whisker
Twitching
Onset
Whisker
Twitching
OnsetSpV
VPM
S1
S1
Barrel Cx
VPM
CP
HI
PC1
PC2
-
7/30/2019 beyond brain
21/50
figure 5.9 Peri-event histograms depict the ring response pattern of a single
cortical neuron in the rat primary somatosensory cortex under three dierentbehavioral conditions: active tactile discrimination in a freely behaving animal
(lemost panel), awake but immobilized (center panel), and immobilized and pas-
sive discrimination (rightmost panel). Notice how the pattern of this neurons
responses is totally dierent according to the animals behavioral context. For each
histogram, the X axis represents peri-event time, with 0 indicating the onset offacial whisker mechanical stimulation, and the Yaxis represents the electrical r-ing response of the neuron in spikes per second. (Originally published in D. J. Krupa,
M. C. Wiest, M. Laubach, and M.A.L. Nicolelis, Layer Specic Somatosensory Cortical
Activation During Active actile Discrimination.Science 304 [19891992, 2004].)
-
7/30/2019 beyond brain
22/50
figure 6.1 Te debut of the brain-machine interface. Systems engineering draw-
ing depicting the general organization of a brain-machine interface. Multi-
electrode arrays and microchips are used to record large-scale brain activity. Signal
processing techniques are then used to translate raw brain activity into digital
commands that can be employed to reproduce, in a robotic arm, the voluntary
motor intentions generated by the brain. Visual, tactile, and proprioceptive feed-
back signals from the robotic actuator are then sent back to the subjects brain.
(Originally published in M.A.L. Nicolelis and M. A. Lebedev, Principles of Neural
Ensemble Physiology Underlying the Operation of Brain-Machine Interfaces. Nature
Reviews Neuroscience 10 [2009]: 53040.)
-
7/30/2019 beyond brain
23/50
figure 6.2 General algorithm for translating raw neuronal electrical activity into
digital commands that can be employed to predict kinematic parameters and con-trol articial tools based on brain activity alone (see text for details). (Illustrated by
Dr. Nathan Fitzsimmons,Duke University.)
-
7/30/2019 beyond brain
24/50
figure 6.3 Where will Belles wrist go? Te graphs illustrate real-time predic-
tions, derived from Belles and Carmens brain activity, and how well they repro-
duce the actual position of these two owl monkeys hands. Te bottom panel shows
that the same kinematic predictions can be used to control simultaneously a robot
arm located next to the animals at Duke University or remotely, at MI. (Originally
published in J. Wessberg, C. R. Stambaugh, J. D. Kralik, P. D. Beck, J. K. Chapin, J. Kim,
S. J. Biggs, M. A. Srinivasan, and M.A.L. Nicolelis, Real-ime Prediction of Hand ra-
jectory by Ensembles of Cortical Neurons in Primates.Nature 408 [2000]: 36165.)
-
7/30/2019 beyond brain
25/50
figure 6.4 Aurora loses her joystick and frees her mind. On top, the experimen-
tal setup employed for Aurora to use her brain activity alone to control the move-
ments of a robotic arm. On the bottom le, a sample of the electrical activity of
96 cortical neurons from Auroras brain. On the Yaxis, each vertical bar representsan action potential produced by a single cortical neuron. Te Xaxis representstime (10 seconds). In the right panel, a graphic representation of the task Aurora
performed and examples of predictions of arm movements based on combined
brain activity. (Originally published in J. M. Carmena, M. A. Lebedev, R. E. Crist,
J. E. ODoherty, D. M. Santucci, D. R. Dimitrov, P. G. Patil, C. S. Henriquez, and M.A.L.Nicolelis, Learning to Control a Brain-Machine Interface for Reaching and Grasping by
Primates.Public Library of Science 1 [2003]: 193208.)
-
7/30/2019 beyond brain
26/50
figure 7.1
How many neurons does it take? wo neuron-dropping curves corre-late the number of neurons (X axis) with the accuracy of real-time predictionobtained for two distinct parameters (hand position and hand gripping force). Te
same sample of neurons from the primary motor cortex of a monkey was used to
construct these curves. (Originally published in J. M. Carmena, M. A. Lebedev, R. E.
Crist, J. E. ODoherty, D. M. Santucci, D. R. Dimitrov, P. G. Patil, C. S. Henriquez, and
M.A.L. Nicolelis, Learning to Control a Brain-Machine Interface for Reaching and
Grasping by Primates.Public Library of Science 1 [2003]: 193208.)
-
7/30/2019 beyond brain
27/50
figure 7.2 Gathering motor commands all over the brain. Neuron droppingcurves are used to compare the accuracy of prediction of populations of neurons
simultaneously recorded in the primary motor cortex (M1, traced line) and the
posterior parietal cortex (PP, dotted line) for two parameters (hand position and
gripping force). Notice that information about both parameters is available in both
cortical regions, but that M1 contains more information, for equal neuronal popu-
lations, for hand position. Yet, both M1 and PP yield similar levels of accurate pre-
dictions for gripping force, considering neuronal populations of the same size.
(Originally published in J. M. Carmena, M. A. Lebedev, R. E. Crist, J. E. ODoherty, D. M.
Santucci, D. R. Dimitrov, P. G. Patil, C. S. Henriquez, and M.A.L. Nicolelis. Learning toControl a Brain-Machine Interface for Reaching and Grasping by Primates. Public
Library of Science 1 [2003]: 193208.)
Position
Posterior Parietal Cortex
Posterior Parietal CortexMotor Cortex
Motor Cortex
Number of Neurons
noitciderPfo
R
10
0.2
0.4
0.6
0.8
20 40 60
2
Gripping Force
Number of Neurons
noitciderPfo
R
10
0.2
0.4
0.6
0.8
20 40 60
2
(M1)(PP)
-
7/30/2019 beyond brain
28/50
-
7/30/2019 beyond brain
29/50
figure 7.3 Fine-tuning of cortical neurons that control the movements
of the body and machines.Gray-scaled polar plots of the ring rate of one
M1 neuron as a function of both arm velocity (key, top le) for dierent
lags with respect to instant of instantaneous arm velocity measurement
(0 ms). Velocity = 0 is at the center of each circle and maximum velocity (14
cms/second) is at the perimeter of the circle. Firing patterns were obtained
during dierent modes of operation (pole control and brain control with
and without hand movements), and during the use of dierent actuators
(hand or robot movements, see legends). Each of the circles also encodes
the neurons preferred direction (see scale). Gray shading indicates ring
rate (minimum is white, maximum is dark gray). (A) A neighboring neuron
that exhibits strong velocity and direction tuning only when the animal is
using its hand to play the video game, but not the robot. (B) A single M1
neuron that displays both velocity and direction tuning during both pole
and brain control and when the animal is using its hand or only the robot to
play the video game. (C) A neighboring M1 neuron that exhibits enhanced
velocity and direction (dashed arrows) tuning only when the monkey is
preparing to use its brain activity to move the robot arm, but not when it
moves its own biological arm. (Originally published in M. A. Lebedev, J. M.
Carmena, J. E. ODoherty, M. Zacksenhouse, C. S. Henriquez, J. Principe, and
M.A.L. Nicolelis. Cortical Ensemble Adaptation to Represent Velocity of an Arti-
cial Actuator Controlled by a Brain Machine Interface.Journal of Neurosci-
ence 25 [2005]: 468193, with permission.)
-
7/30/2019 beyond brain
30/50
figure 8.1 Experimental setup employed to create a brain-machine interface for
locomotion. (Originally published in N. Fitzsimmons, M. A. Lebedev, I. Peikon, and
M.A.L. Nicolelis, Extracting Kinematic Parameters for Monkey Bipedal Walking from
Cortical Neuronal Ensemble Activity.Frontiers in Integrative Neuroscience 3 [2009]:
119.)
-
7/30/2019 beyond brain
31/50
figure 8.2 Kinematic predictions, derived from combined raw brain activity, for
dierent types of bipedal locomotion behaviors: slow forward walking (top shelf),
fast forward walking (middle shelf), and variable speed (lower shelf). Black trace
depicts actual position of Idoyas leg whereas the gray traces yield real-time predic-
tions of this kinematic parameter obtained from her brain activity alone. (Originally
published in N. Fitzsimmons, M. A. Lebedev, I. Peikon, and M.A.L. Nicolelis, Extracting
Kinematic Parameters for Monkey Bipedal Walking from Cortical Neuronal Ensemble
Activity.Frontiers in Integrative Neuroscience 3 [2009]: 119.)
-
7/30/2019 beyond brain
32/50
figure 8.3 Idoya and CB-1s great leap across the globe. General schematic repre-
sentation of the experiment that allowed a monkey on the U.S. East Coast to use its
brain activity to control the leg movements of a humanoid robot (CB-1) in Kyoto,
Japan, while receiving visual feedback back in Durham, North Carolina, from the
robot locomotion. (Courtesy of Dr. Miguel Nicolelis.)
-
7/30/2019 beyond brain
33/50
figure 9.1 Alberto Santos-Dumont and his ying machine. A photograph of the
aviator (on the le) and the historic moment when he circumnavigated the Eiel
ower on October 19, 1901. (Reprinted with permission from the National Air and
Space Museum, Smithsonian Institution Archives, Washington, D.C.)
-
7/30/2019 beyond brain
34/50
figure 9.2 Summary of the experiments carried out by Dr. Atsushi Iriki and col-
leagues showing that the visual receptive eld of a parietal cortical neuron expands
when the animal employs a simple tool to perform a task. On the top shelf, a single
neuron with both a tactile and visual RF centered on the hand changed its visual
receptive eld to include the entire tool used by the animal to retrieve some food
reward. Notice that when the animal merely holds the tool, but does not utilize it to
perform a task, the visual RF remains centered on the animals hand alone. On the
bottom shelf, another neuron with the tactile RF centered on the animals shoulder
and a broad visual RF shows the same expansion of the visual RF when the animalutilizes a tool in a 3-D space. Notice that the visual expansion of the RF includes
the entire space in which the tool can reach. (Adapted from A. Maravita and A. Iriki,
ools for the Body (Schema).rends in Cognitive Sciences 8, no. 2 [2004]: 7986, with
permission from Elsevier.)
Before tool use
Before tool use
Distal-type neurons
Proximal-type neurons
After tool use
After tool use Passive holding
sensory
receptive
field
sensory
receptive
field
visual
receptive
field
visual
receptive
field
visual
receptive
field
visual
receptive
field
visual
receptive
field
-
7/30/2019 beyond brain
35/50
figure 9.3 Te le panel shows Pel in one of his characteristic shooting maneu-
vers in the 1960s. On the right, a drawing represents how the theory proposed in
this book predicts what Pels sensorimotor cortex would look like. According to this
view, the soccer ball would be incorporated into Pels foot representation in the
cortex. (From Swedish press image in the public domain.)
-
7/30/2019 beyond brain
36/50
figure
10.1
Teneu
roscientistin
thebullring.Tis
sequenc
eofphoto-
graphsillustratesthe
classicalexperiment
carried
outbyDr.Jos
Delgadoinwhicha
chargin
gbullwasmade
tostopitschargeusing
deepele
ctricalbrain
stimulation.(Photo-
graphsu
sedwith
permissionofDr.Jos
Delgado.)
-
7/30/2019 beyond brain
37/50
figure 10.2 John Chapin and roborat. In
the le panel, Dr. John K. Chapin and his
creation. Below, roborat walks over a metal
mesh. (Courtesy of Dr. John Chapin.)
-
7/30/2019 beyond brain
38/50
figure 10.3 alking back to the brain. op shelf illustrates the experimental
paradigm utilized to deliver electrical messages to the brain of a monkey. Chron-
ically implanted microelectrode arrays are employed to deliver spatiotemporalelectrical patterns that represent dierent messages. Middle shelf illustrates the dif-
ferent types of patterns utilized to deliver messages to the primate brain: basic
amplitude discrimination, temporal discrimination, or spatiotemporal discrimi-
nation. Lower shelf illustrates learning curves for each of the three methods to
deliver messages. (Adapted from N. Fitzsimmons, W. Drake, . Hanson, M. Lebedev,
and M.A.L. Nicolelis, Primate Reaching Cued by Multichannel Spatiotemporal Cortical
Microstimulation.Journal of Neuroscience 27 [2007]: 5593602.)
-
7/30/2019 beyond brain
39/50
figure 10.4 Drawing depicting a future experiment in which an R6- rat will be
implanted with a magnetic eld sensor that delivers electrical microstimulation
to the animals primary somatosensory cortex proportional to magnetic elds ofdierent magnitudes. Each of these dierent magnetic elds identies dierent
objects, things like food, water, and the location of a toy rat. (Illustrated by Dr. Nathan
Fitzsimmons, Duke University.)
-
7/30/2019 beyond brain
40/50
figure 10.5 Te explorer rat and the decoder rat. Illustration of a true brain-to-
brain interface linking an explorer rat, which uses its facial whiskers to discrimi-
nate the diameter of a variable aperture, with a decoder rat whose main function is
to indicate the diameter of the aperture based on the pattern of brain activity trans-
mitted by the explorer rat, without ever touching the aperture with its whiskers.
Te brain-to-brain interface connects the brains of the two rats. (Illustrated by Dr.
Nathan Fitzsimmons, Duke University.)
-
7/30/2019 beyond brain
41/50
figure 10.6 A dierent version of a brain-to-brain interface involving an inter-
mediary layer of rats between the explorer and decoder rats. (Illustrated by Dr.
Nathan Fitzsimmons, Duke University.)
-
7/30/2019 beyond brain
42/50
figure 11.1 Spectrograms (top four 3D graphs) and corresponding raw local eld
potentials (5 graphs in the lower shelf) illustrate the frequency and general timepattern of dierent types of brain oscillations observed under dierent types of
behaviors: active exploration, quiet waking, whisker twitching, slow wave sleep,
and paradoxical REM sleep. In the spectrogram (top shelf) graphs, Xaxis is time(with the period of each behavioral state marked) and the Yaxis depicts the fre-quency of oscillations. Gray scale in the Zaxis depicts the magnitude or power of aparticular frequency of oscillation for each state. (Adapted from D. Gervasoni, Shih-
Chieh L., S. Ribeiro, E. S. Soares, J. Pantoja, and M.A.L. Nicolelis, Global Forebrain
Dynamics Predict Rat Behavioral States and Teir ransitions.Journal of Neuroscience
24 [2004]: 1113747.)
-
7/30/2019 beyond brain
43/50
figure11.2
TeLochNes
sMonster,as
depictedinth
eclassic
fakephotog
raph,appears
inthetopshelf.Itsbrain
relativeisdep
ictedinthe
state-spaceof
thelowerle
shelf.Onthelowerright
panel,thedi
erentbrain
statesthatcorrespondto
dierentlocationsinthe
state-spacear
emarkedby
ellipses.Atra
nsitionstate
betweenquietawakeand
slow-wavesleepisalso
depicted.(AdaptedfromD.
Gervasoni,Shih-ChiehL.,
S.Ribeiro,E.S.Soares,
J.Pantoja,and
M.A.L.
Nicolelis,GlobalForebrain
DynamicsPredictRat
BehavioralStatesandTeir
ransitions.Journalof
Neuroscience24[2004]:
1113747,with
permission.)
-
7/30/2019 beyond brain
44/50
figure 11.3 Te hypno-map. Tis 3-D graph illustrates the time spent by rats in
each of their main behavioral states. TeXand Yaxes of the graph depict the state-space shown in Figure 11.2, while the gray-scaled Zaxis represents the time spentby rats in each state. Notice that for most of their lives, our furry friends sleep,
without dreaming, in the slow wave sleep state. Quiet awake is only the secondmost common brain state in the life of rats. (Courtesy of Dr. Shih-Chieh Lin, National
Institute on Aging, NIH; and Dr. Damien Gervasoni, Claude Bernard University, Lyon,
France.)
-
7/30/2019 beyond brain
45/50
Slow Wave Sleep
Wire and Ball Model
Brain State-Space
Active Exploration
Quiet Waking
figure 11.4 Te wire and ball model (see text for explanation). (Illustrated by Dr.
Nathan Fitzsimmons, Duke University.)
-
7/30/2019 beyond brain
46/50
figure 11.5 Patterns of single neuronal ring during normal ring (top shelf)
and during the occurrence of a sensory stimulus (middle shelf). Te refractoryperiod, illustrated in the bottom shelf, denes the maximum ring rate that a neu-
ron can reach. Troughout these examples, the total ring rate produced by the
whole brain has to be maintained below a maximum cap. (Illustrated by Dr. Nathan
Fitzsimmons, Duke University.)
-
7/30/2019 beyond brain
47/50
figure 12.1 Cross-modal processing in the primary somatosensory and visual
cortices of rats. Peri-event histograms display the isomodal and cross-modal
sensory-evoked responses of individual S1 and V1 neurons. In the le panel, the
traditional visually evoked responses of V1 neurons and tactile-evoked responses
of S1 neurons are shown. In the right panel, samples of V1 neurons that respond
to a tactile stimulus and S1 neurons that respond to a visual stimulus are plotted.
Korbinian Brodmann would be shocked! (Courtesy of Dr. Sidarta Robeiro, Interna-
tional Institute of Neuroscience of Natal, Brazil; and Dr. Damien Gervasoni, Claude
Bernard University, Lyon, France.)
-
7/30/2019 beyond brain
48/50
figure 13.1 Cortical Neuroprosthesis for Restoring Motor Functions. A drawing
illustrates how a cortical neuroprosthetic device may one day help patients para-
lyzed due to a spinal cord lesion (see text for details).(Adapted from M.A.L. Nicolelis,
Brain-Machine Interfaces to Restore Motor Function and Probe Neural Circuits.Nature
Reviews Neuroscience 4 [2003]: 41722.)
-
7/30/2019 beyond brain
49/50
figure 13.2 Design of the whole-body exoskeleton to be utilized by the WalkAgain Project. (Courtesy of Dr. Gordon Cheng, echnical University of Munich.)
-
7/30/2019 beyond brain
50/50
figure 13.3 reating a Parkinsons disease-like syndrome in rats using electrical
stimulation of the spinal cord. On the top shelf, the stimulating electrodes and the
implantation approach to place them on the dorsal surface of the spinal cord.
Middle shelf shows an implanted rat that exhibits signs of Parkinsons disease.
On the bottom shelf two circles are used to identify bursts of the epileptic activity
observed in a spectrogram of the rats brain activity, that are correlated with the
akinesia produced by Parkinsons disease. At 0 time, the electrical stimulation of
the spinal cord started, using the implanted electrodes. Notice that the epileptic
activity disappears and, as a result, the rat was able to walk freely again (not
shown). Te spectrogramXaxis represents time (0 start of stimulation) and the Yaxis represents frequencies. Te gray scale of the Zaxis represents power or magni-tude of brain activity at a given frequency (see scale on the right). (Adapted from R.
d l l l d