anticipation in the retina and the primary visual cortex
TRANSCRIPT
![Page 1: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/1.jpg)
HAL Id: hal-02150600https://hal.inria.fr/hal-02150600
Submitted on 7 Jun 2019
HAL is a multi-disciplinary open accessarchive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come fromteaching and research institutions in France orabroad, or from public or private research centers.
L’archive ouverte pluridisciplinaire HAL, estdestinée au dépôt et à la diffusion de documentsscientifiques de niveau recherche, publiés ou non,émanant des établissements d’enseignement et derecherche français ou étrangers, des laboratoirespublics ou privés.
Anticipation in the retina and the primary visualcortex : towards an integrated retino-cortical model for
motion processingBruno Cessac, Selma Souihel, Matteo Di Volo, Frédéric Chavane, Alain
Destexhe, Sandrine Chemla, Olivier Marre
To cite this version:Bruno Cessac, Selma Souihel, Matteo Di Volo, Frédéric Chavane, Alain Destexhe, et al.. Anticipationin the retina and the primary visual cortex : towards an integrated retino-cortical model for motionprocessing. Workshop on visuo motor integration, Jun 2019, Paris, France. �hal-02150600�
![Page 2: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/2.jpg)
Anticipation in the retina and the primary visual cortex :towards an integrated retino-cortical model for motion
processing
Bruno Cessac, Selma Souihel Biovision
![Page 3: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/3.jpg)
Anticipation in the retina and the primary visual cortex :towards an integrated retino-cortical model for motion
processing
Bruno Cessac, Selma Souihel Biovision
![Page 4: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/4.jpg)
Anticipation in the retina and the primary visual cortex :towards an integrated retino-cortical model for motion
processing
Bruno Cessac, Selma Souihel
In collaboration with :
Frédéric ChavaneSandrine Chemla
Olivier MarreMatteo Di VoloAlain Destexhe
Biovision
![Page 5: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/5.jpg)
4
The visual flow
Source : Wikipedia
![Page 6: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/6.jpg)
5
The visual flow
Source : Wikipedia
Source : Ryskampet al. 2014
Upcoming light
![Page 7: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/7.jpg)
6
The visual flow
Source : Wikipedia
Source : Ryskampet al. 2014
Upcoming light
![Page 8: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/8.jpg)
7
The visual flow
Source : Wikipedia
Source : Ryskampet al. 2014
Upcoming light
![Page 9: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/9.jpg)
8
The visual flow
Source : Wikipedia
Source : Ryskampet al. 2014
Upcoming light
Decoding spike trains
![Page 10: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/10.jpg)
9
The visual flow
Source : Wikipedia
Source : Ryskampet al. 2014
Upcoming light
Decoding spike trains
Encoding motion
![Page 11: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/11.jpg)
10
The visual flow
Source : Wikipedia
Source : Ryskampet al. 2014
Upcoming light
Decoding spike trains
« Analogic computing »Low energy consumpution
Dedicated circuitsSmall number of neurons
Specialized synapses
Encoding motion
![Page 12: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/12.jpg)
11
The visual flow
Source : Wikipedia
Source : Ryskampet al. 2014
Upcoming light
![Page 13: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/13.jpg)
12
The visual flow
Source : Wikipedia
Source : Ryskampet al. 2014
Upcoming light
Too slow !
![Page 14: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/14.jpg)
13
Visual Anticipation
Source : Benvenutti et al. 2015
![Page 15: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/15.jpg)
14
Visual Anticipation
Source : Benvenutti et al. 2015
Anticipation is carried out by the primary visual cortex (V1) through an activation wave
![Page 16: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/16.jpg)
15
Visual Anticipation
Source :Berry et al.1999
Anticipation also takes place in the retina
![Page 17: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/17.jpg)
16
Visual Anticipation
What are the respective :
➢Mechanisms underlying retinal and corticalanticipation?
➢Role of each part ?
TrajectoryTrajectory
![Page 18: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/18.jpg)
17
Visual Anticipation
![Page 19: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/19.jpg)
18
Visual Anticipation
No thalamus ...
![Page 20: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/20.jpg)
19
Visual Anticipation
Which animal ?No thalamus ...
![Page 21: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/21.jpg)
20
Visual Anticipation
No thalamus ... Which animal ?
![Page 22: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/22.jpg)
21
Visual Anticipation
No thalamus ... Which animal ?
![Page 23: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/23.jpg)
22
Visual Anticipation
No thalamus ... Which animal ?
![Page 24: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/24.jpg)
23
Visual Anticipation
No thalamus ... Which animal ?
![Page 25: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/25.jpg)
24
Visual Anticipation
No thalamus ... Which animal ?
![Page 26: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/26.jpg)
25
Visual Anticipation
Developping a retino-cortical model of anticipation soas to
understand / propose
possible mechanisms for anticipation in the retina and in the cortex.
![Page 27: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/27.jpg)
26
Anticipation in the retina
![Page 28: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/28.jpg)
27
The Hubel-Wiesel view of vision
Ganglion cells
Nobel prize 1981
Ganglion cells response is the convolution of the stimulus with a spatio-temporalreceptive field followed by a non linearity
Ganglion cells are independent encoders
![Page 29: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/29.jpg)
28
The Hubel-Wiesel view of vision
Source : Berry et al. 1999
Ganglion cells
Nobel prize 1981
![Page 30: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/30.jpg)
29
Building a 2D retina model for motionanticipation
Gain control (Chen et al. 2013)
![Page 31: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/31.jpg)
30
Building a 2D retina model for motionanticipation
![Page 32: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/32.jpg)
31
Building a 2D retina model for motionanticipation
Gain control (Chen et al. 2013)
![Page 33: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/33.jpg)
32
Building a 2D retina model for motionanticipation
Gain control (Chen et al. 2013)
![Page 34: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/34.jpg)
33
1D results : smooth motion anticipationwith gain control
Bipolar layer Ganglionlayer
![Page 35: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/35.jpg)
34
1D results : smooth motion anticipationwith gain control
Anticipation variability with stimulusparameters
![Page 36: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/36.jpg)
35
Building a 2D retina model for motionanticipation
Ganglion cells are independent encoders
![Page 37: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/37.jpg)
36
Building a 2D retina model for motionanticipation
Ganglion cells are not independent encoders
Gap junctions connectivity
![Page 38: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/38.jpg)
37
Building a 2D retina model for motionanticipation
Gap junctions connectivity
![Page 39: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/39.jpg)
38
Building a 2D retina model for motionanticipation
Gap junctions connectivity
![Page 40: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/40.jpg)
39
Building a 2D retina model for motionanticipation
Gap junctions connectivity
![Page 41: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/41.jpg)
40
Building a 2D retina model for motionanticipation
Diffusive wave of activity ahead of the motion
Gap junctions connectivity
![Page 42: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/42.jpg)
41
1D results : smooth motion anticipationwith gap junctions
6
![Page 43: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/43.jpg)
42
1D results : smooth motion anticipationwith gap junctions
Anticipation variability with stimulusparameters
![Page 44: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/44.jpg)
43
Building a 2D retina model for motionanticipation
![Page 45: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/45.jpg)
44
Building a 2D retina model for motionanticipation
Ganglion cells are not independent encoders
Amacrine cells connectivity
![Page 46: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/46.jpg)
45
Amacrine cells connectivity
● A class of RGCs are selective to differential motion
Building a 2D retina model for motionanticipation
![Page 47: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/47.jpg)
46
Amacrine cells connectivity
● The circuitry involves amacrine cells connectivity upstream of ganglion cells
Building a 2D retina model for motionanticipation
● A class of RGCs are selective to differential motion
![Page 48: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/48.jpg)
47
Connectivity pathways
Amacrine cells connectivity
![Page 49: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/49.jpg)
48
Connectivity pathways
Amacrine cells connectivity
![Page 50: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/50.jpg)
49
Connectivity pathways
Amacrine cells connectivity
Anti diffusive wave of activityahead of the bar
![Page 51: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/51.jpg)
50
1D results : smooth motion anticipationwith amacrine connectivity
Bipolar layer Ganglion layer
![Page 52: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/52.jpg)
51
1D results : smooth motion anticipationwith amacrine connectivity
Anticipation variability with stimulusparameters
![Page 53: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/53.jpg)
52
Comparing the performance of the three layers
![Page 54: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/54.jpg)
53
Suggesting new experiments : 2D results
1) Angular anticipation
Stimulus
t = 0 ms 100 200 ms 300 ms 400 ms 500 ms 600 ms 700 ms
Bipolar linearresponse
Bipolar gainresponse
Ganglion linearresponse
Ganglion gainresponse
A)
B) C)
![Page 55: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/55.jpg)
54
Suggesting new experiments : 2D results
1) Angular anticipation
![Page 56: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/56.jpg)
55
Anticipation in V1
![Page 57: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/57.jpg)
56
Anticipation in V1
![Page 58: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/58.jpg)
57
A mean field model to reproduce VSDIrecordings Zerlaut et al 2016
Chemla et al 2018
![Page 59: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/59.jpg)
58
A mean field model to reproduce VSDIrecordings Zerlaut et al 2016
Chemla et al 2018
![Page 60: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/60.jpg)
59
A mean field model to reproduce VSDIrecordings Zerlaut et al 2016
Chemla et al 2018
Affords a retino thalamic input
![Page 61: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/61.jpg)
60
A mean field model to reproduce VSDIrecordings Zerlaut et al 2016
Chemla et al 2018
![Page 62: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/62.jpg)
61
A mean field model to reproduce VSDIrecordings Zerlaut et al 2016
Chemla et al 2018
![Page 63: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/63.jpg)
62
A mean field model to reproduce VSDIrecordings Zerlaut et al 2016
Chemla et al 2018
![Page 64: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/64.jpg)
Response of the cortical model to a LNretina drive
![Page 65: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/65.jpg)
Response of the cortical model to a retinadrive with gain control
![Page 66: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/66.jpg)
Anticipation in the cortex : VSDI dataanalysis (Data courtesy of F.
Chavane et S. Chemla)
![Page 67: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/67.jpg)
Comparing simulation results to VSDIrecordings
Cortex experimentalrecordings
Simulation resultsResponse to an LNmodel of the retina
Simulation resultsResponse to a gaincontrol model of theretina
![Page 68: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/68.jpg)
Conclusions
● We developped a 2D retina with three ganglion cell layers,implementing gain control and connectivity.
● We use the output of our model as an input to a mean field model ofV1, and were able to reproduce anticipation as observed in VSDI
![Page 69: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/69.jpg)
Conclusions
● How to improve object identification ● 1) exploring the model's parameters and
● 2) using connectivity ?
● Is our model able to anticipate more complex trajectories, withaccelerations for instance ?
● How to calibrate connectivity using biology ?
● How does anticipation affect higher order correlations ?
● Would it be possible to design psycho-physical tests clearly showingthe role of the retina in visual anticipation ?
![Page 70: Anticipation in the retina and the primary visual cortex](https://reader030.vdocuments.us/reader030/viewer/2022012810/61c084116a07034c5046a48a/html5/thumbnails/70.jpg)
Thank you for your attention !