advances in bionic eye research nigel lovell and gregg suaning · advances in bionic eye research...

52
Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University of New South Wales, Sydney 1 IEAust 2012

Upload: others

Post on 14-Jun-2020

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Advances in Bionic Eye Research

Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering

University of New South Wales, Sydney

1 IEAust 2012

Page 2: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 2

Biomaterials and tissue engineering

Bionics, biomonitoring and biomodelling

15 Academic and research staff

20 General staff

~50 PhD students + 10 others in Elec Eng

~60 P/G coursework students

~350 BE/MBiomedE students

~> $6 million research income p.a.

GSBmE

Page 3: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Biomonitoring and Bionics

Implantable sensors and devices (bionic eye, heart assist devices)

Wearable sensors for falls detection/prevention (triaxial accelerometer)

Clinical measurements for management of chronic disease (home telehealth)

Unobtrusive monitoring of functional health (sensor networks and telecare integration)

IEAust 2012 3

Page 4: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Electrical/Computer Engineering interface with Medicine

IEAust 2012 4

Wireless sensor networks Embedded systems Electrical and biosignal processing Microelectronics Miniaturisation - nanotechnologies Control systems for heart pumps Computational modeling

IRBP dP sensor

IRBP

LVP sensor

IRBP flow Aortic and PA flow sensors

Page 5: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Retinal Disorders

End Stage RP 5

RP

AMD IEAust 2012

Page 6: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 6

The Problem

Together, AMD and RP affect at least 30 million people in the world

6,500 cases of RP in Australia and 87,000 in the USA

AMD currently costs Australia $2.6bn p.a.

For RP there is no effective means of restoring vision

Retinitis Pigmentosa (RP)

Age-related Macular Degeneration (AMD)

Page 7: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Oops!!

IEAust 2012 7

Page 8: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 8

Retinal Remodelling

Marc et al, Prog Retinal and Eye Res, 22, 2003

Page 9: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 9

Blind (A) and Sighted (B) Subjects – Finger Tapping Task

Gizewski et. al., Neuroimage, 19, 2003

Page 10: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 10

Blind (A) and Sighted (B) Subjects – Reading Braille with Right Hand

Gizewski et. al., Neuroimage, 19, 2003

Page 11: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Brindley, Donaldson and Lewin, 1968

IEAust 2012 11

Page 12: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 12

Optic Nerve Implants

Retinal Implants

Cortical Implants

Page 13: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

How Does Our Bionic Eye Work?

1. Camera captures

vision and

transmits data to an

external, body worn

processing unit

4. Implanted

electrode array

stimulates retina

3. Implanted

receiver passes

signals onto retinal

implant

2. Data

processed and

sent to implanted

system via

external wire

5. Electrical

signals sent from

retina via visual

pathway to vision

processing centres

in the brain

IEAust 2012 13

Page 14: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

The Olden Days...(1997)

Nigel Lovell UNSW

(Cardiac Research and

Telehealth)

Gregg Suaning Manager of Process

Development Engineering -

Cochlear (Implant Research)

IEAust 2012 14

Page 15: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

The Plan Back Then: Human Implants by 2000

IEAust 2012 15

Page 16: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

First generation implant One hundred stimulation channels Series stimulation Biphasic constant current waveforms RF (inductively-coupled) data and power Reverse telemetry Ceramic and epoxy package PDMS and platinum electrode array

The Plan Back Then: Human Implants by 2000

IEAust 2012 16

Page 17: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

The Reality: Sheep Implants by 2000

IEAust 2012 17

Page 19: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

International Approaches

German – VC funded founded 2003 Clinical trials (Zrenner group)

Second-Sight

US – VC & Govt funded

Clinical trials conducted

Argus II on the EU market

Com

me

rcia

l

German-Swiss – VC & Govt funded

Aca

de

mic

Optoelectronic Retinal Prosthesis (Palanker group)

Mass Eye and Ear / MIT (Rizzo & Wyatt group)

Intelligent Medical

Implants (IMI)

France: Institut de la Vision Paris

Japan: Medicine, Nagoya Uni

Korea: Seoul Artificial Eye Center

IEAust 2012 19

Epi-Ret-3

Page 20: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Optobionics Second Sight Argus I

16 Retina Implant

1500

EpiRet

25

IMI

49

Second Sight Argus II

60

Clinical Trials

IEAust 2012 20

Page 21: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Laboratory and Cleanroom Facility

IEAust 2012 21

Page 22: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

External Hardware

IEAust 2012 22

Page 23: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Split Architecture

IEAust 2012 23

Page 24: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Laser Micromachining

IEAust 2012 24

Page 25: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Titanium+

alumina 'hybrid'

Titanium lid

IEAust 2012 25

Ceramic and Titanium Encapsulation

Page 26: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Implant Research:

High Density Ceramic Feedthroughs

IEAust 2012 26

Page 27: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 27

98-Channel Electrode Array

1 2

3

5

4

6

Page 28: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Comparison of Laser Cuts

IEAust 2012 28

Page 29: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

PDMS Ablation - Excimer Laser

IEAust 2012 29

Page 30: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Electrode Surface Roughening

IEAust 2012 30

Page 31: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

98-Channel Electrode Array

IEAust 2012 31

Page 32: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

30/06/2012 32

Bioinspiration

Fluorescent images of

Drosophila (fly) retina 42

hours after pupal

development

SEM of an adult fly eye

showing near perfect rows

of ommatidia or unit eyes

arrayed hexagonally

Page 33: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Concurrent Stimulation

IEAust 2012 33

Page 34: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Austriamicrosystems AMS

H35B4D3 4M 2P process

Scalable architecture

98 channels of stimulation

Up to 14 channels

in parallel

Constant current

Biphasic stimuli

Post-stimulus shorting

Monolithic

Reverse telemetry

Quasi-Monopolar

Monolithic Neurostimulation Chip

IEAust 2012 34

Page 35: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 35

Prototype Implanted Device (Eye Unit)

Page 36: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

36

Does the Device Work?

“What do you see?”

Baa Baa

IEAust 2012

Page 37: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

The Science: Device Efficacy and Stimulation Strategy

Biomathematical modelling

Surgical placement

In vivo animal experiments (multi- electrode arrays)

In vitro animal experiments (patch clamping, extra-cellular recording, two-photon imaging)

Simulated psychophysics

Human psychophysics …

IEAust 2012 37

Page 38: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Modelling: Current Containment

IEAust 2012 38

Page 39: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Electrode Interaction

IEAust 2012 39

Page 40: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 40

Supra-Choroidal Implantation

Courtesy of Chris Williams,

Penny Allen, BEI/RVEEH

Page 41: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

41

Device Placement

IEAust 2012

Page 42: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 42

Page 43: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 43

Page 44: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Patch Clamp and Sharp Microelectrode Electrophysiology

IEAust 2012 44

Page 45: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

The Neural Code

IEAust 2012 45

Page 46: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Two-Photon Microscopy

IEAust 2012 46

Page 48: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Simulated Prosthetic Vision

IEAust 2012 48

Click Image to View Video

Head movement allows identification of difficult

Landolt C items. This movie demonstrates some very

difficult test items, but were all identified correctly by

subject.

Page 49: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

Images at NICTA CRL trial environment; various representations

based on depth, intensity, contrast etc.

Incorporating Depth Mapping

IEAust 2012 49

Page 50: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

50

Science Fact or Science Fiction

IEAust 2012

Page 51: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

51

Summary

Suprachoroidal space appears to be a viable position for a visual prosthesis

Differentiator - smart visual processing and current steering strategies to create ‘virtual phosphenes’

Human trials of our device this time in 2013

Current neuroprostheses rely on microtechnologies to fabricate and service electrodes >500 m in size (typically interfacing to thousands of nerve fibres)

Unlikely that 1000+ electrode devices will be approved by regulatory bodies in next few years

Either need disruptive technologies to solve the wiring, feedthrough and hermeticity issues or tissue engineering approaches? …

IEAust 2012

Page 52: Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning · Advances in Bionic Eye Research Nigel Lovell and Gregg Suaning Graduate School of Biomedical Engineering University

IEAust 2012 52

http://bionic.gsbme.unsw.edu.au

http://www.bionicvision.org.au

facebook.com/bionicvisionaustralia

twitter.com/bionicvision