freelance graphics - prosill06-b&w - dspace@mit...

47
Visual Prosthetics

Upload: others

Post on 14-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Visual Prosthetics

Page 2: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

fovea

vertical

Lunate Sulcus Central Sulcus

V1

87 6 5 4 3 2 1

270

180 0

905

4

3

2

1

horizonta

Figure by MIT OCW.

Page 3: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Present two visual targets Present one visual target and stimulate

Vary contrast or size of the visual stimulus not in the receptive field

Page 4: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Percent target contrast difference

Size diameter difference in minutes

Percent target contrast difference

10090807060

P

erce

nt b

otto

m ta

rget

cho

ice 50

403020100

N = 40 trials per point

RF

Contrast series

Eccentricity = 3.4 deg

-7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6

100908070605040

302010

N = 40 trials per point 0

Size series

RF

-15 -10 -5 0 5 10 15

Two visual targets

Page 5: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

One visual target paired with electrical stimulation

0 10 20 30 40 50 60 70 80 90

100

Perc

ent c

hoic

e at

ele

ctric

al s

timul

atio

n si

te20uA

RF

Contrast series

Eccentricity = 3.5 deg Henk, Apr, 03

40uA

4 6 8 10 12 14 16 18 20 22

Percent target contrast

100908070605040302010

00

40uA Electrical stimulation at 200Hz for 80ms

Size series

10 15 20 25 30 35 40

Target size in minutes

Page 6: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

One visual target paired with electrical stimulation

2 4 6 8 10 12 14 16

0 10 20 30 40 50 60 70 80 90

100 120uA

90uA 60uA

RF

Eccentricity = 3.4 deg

Percent target contrast

Per

cent

cho

ice

at e

lect

rical

stim

ulat

ion

site

0 10 20 30 40 50 60 70 80 90

100 Size series

Contrast series

Henk, Jul, 05

5 10 15 20 25

Target size in minutes

Page 7: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

One visual target paired with electrical stimulation

2 4 6 8 10 12 14 16

0 10 20 30 40 50 60 70 80 90

100 120uA

90uA 60uA

RF

Eccentricity = 3.4 deg

Percent target contrast

Per

cent

cho

ice

at e

lect

rical

stim

ulat

ion

site

0 10 20 30 40 50 60 70 80 90

100 Size series

Contrast series

Henk, Jul, 05

5 10 15 20 25

Target size in minutes

Page 8: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Using currents of 20 to 120 microamps at eccentricities between 2.5 and 3.5 degrees, the contrast of the visual percept created in monkeys is 6 to 12% and the size is between 15 and 20 minutes of visual angle.

Page 9: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Percent contrast

75% 40% 17% 8%

A - B Contrast = X 100

A + B

Page 10: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Figure by MIT OCW.

Page 11: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Figure by MIT OCW.

Page 12: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

5

4

3

21

6FIATLUX

FIATLUX

Figure by MIT OCW.

Page 13: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

A. What aspects of vision might be desirable to recover with a prosthetic device?

1. Two dimensional pattern perception for object recognition and reading (what?)

2. Two dimensional spatial vision (where?)

3. Three dimensionl vision (stereopsis, motion parallax, etc.)

4. Three dimensionl spatial localization

5. Motion perception

B. Problems and issues:

1. Type of prosthetic device

2. What brain area should be the target for the device?

3. What is the longevity of any selected prosthetic device?

Page 14: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Illusions

Page 15: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

A re-examination of the Hermann grid illusionPeter H. Schiller

Page 16: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

The most widely cited theorypurported to explain the illusion:

ON ON

larger response smaller response

Due to antagonistic center/surround organization, the activity of ON-center retinal ganglion cells whose receptive fields fall into the intersections of the grid produces a smaller response than those neurons whose receptive fields fall elsewhere.

Page 17: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

The effect is not size dependent

Page 18: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Illusion is less pronounced when display is rotated 45 degrees

Page 19: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

The illusion persists with contrast reversal

Page 20: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Differently oriented vertical and horizontal lines reduce illusion

Page 21: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Serrated edges reduce illusion

Page 22: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

The center-surround antagonism produced in ON-center ganglion cells is similar

for the four displays but they induce notable differences in the illusory effect

ON

ON ON

ON

Page 23: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Smudges are seen on the left where gray lines are in front and are not seen or the right where white lines are in front.

Page 24: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Color of smudges is defined by which set of lines is in front. On left color lines are in front and smudges have the same color. On right the white lines are in front and the smudges are weakly darker gray.

Page 25: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

The illusion is reduced at isoluminancde

Page 26: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Retinal ganglion cell receptive field layout at an eccentricity of 5 degrees

At the eccentricity of 5 degrees the 0.5 by 0.5 degree visual angle area outlined impinges on 365 midget cells and 50 parasol cells. Half of these are ON and half OFF cells. The layout of the ON cells is shown in B and C.

5mm 5 deg of visual angle

Retinal midget cells Retinal parasol cells

0.5 deg of visual angle

Page 27: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 28: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 29: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 30: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Figure by MIT OCW.

Page 31: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Figure by MIT OCW.

Page 32: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Figure by MIT OCW.

Page 33: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Figure by MIT OCW.

Page 34: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 35: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 36: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 37: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 38: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 39: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 40: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Figure by MIT OCW.

Muller-Lyer illusion

A. B.

Page 41: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at
Page 42: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Limitations and ambiguities in perception:

Figure/ground relationships Face recognition

Page 43: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Figure-ground relationships

a b

Page 44: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Figure-ground relationships

a b

Page 45: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

The Road to Salvation

When you get to a fork in the road, take it! YB

Page 46: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

The Greek key motif

Basis: The myth of the labyrinth that imprisoned the minotaur

This motif, supposedly symbolic of democracy, graces some of the walls in the US senate building

Page 47: Freelance Graphics - prosill06-B&W - DSpace@MIT …dspace.mit.edu/.../contents/lecture-notes/lec8.pdf10 20 30 40 50 60 70 80 90 100 Pe rc en t ch oice at elec t r ica l s t imul at

Summary: 1. Research on visual prosthetics is in its infancy. A great deal of basic research is needed before such a device can become effective.

2. The brain area that holds the best promise for a prosthetic device based electrical microstimulation is V1.

3. There is no unitary explanation for the great many visual illusions extant.

4. The most popular theory explaining the Hermann grid illusion based on the center/surround organization of retinal ganglion cells is incorrect. A more likely theory is the one that assumes that V1 cells are involved.

5. Retinal adaptation processes can explain illusions based on after-effects.

6. Many illusions disappear under isoluminant conditions.

7. There are no viable theories that explain illusions based on figure/ground relationships.