engineering next-generation self- healing and self-optimizing neural network based medical platforms...

9
Engineering Next- generation Self-healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng [email protected] [email protected] ASPLOS 2010, The Wild and Crazy Session VIII

Post on 19-Dec-2015

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Engineering Next-generation Self- healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng zhj6@pitt.eduzhj6@pitt.edu

Engineering Next-generation Self-healing And Self-

optimizing Neural Network Based Medical PlatformsZhanpeng Jin Allen C. Cheng

[email protected] [email protected]

ASPLOS 2010, The Wild and Crazy Session VIII

Page 2: Engineering Next-generation Self- healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng zhj6@pitt.eduzhj6@pitt.edu

Artificial Neural Network

(Source: "Anatomy and Physiology" by the US National Cancer Institute's Surveillance, Epidemiology and End Results (SEER)

Program.)

(Source: CapitalISM BI)

Page 3: Engineering Next-generation Self- healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng zhj6@pitt.eduzhj6@pitt.edu

Emerging Neural Hardware

Neural chip (384 neurons + 100,000 synapses) @ FACET Project

Microchip of a neural network @ RIEC, Tohoku University

The China-Brain Project (10,000 – 15,000 neural nets) @ Hugo de Garis

3-D neural chip for better visualization @ CalTech

Page 4: Engineering Next-generation Self- healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng zhj6@pitt.eduzhj6@pitt.edu

Bio-inspired Autonomously Reconfigurable Mechanism

AutonomousReconfigurability

Topology Adaptation

Redundancy

(Picture Source: “Brain Injury: Recovery” in Psychology Wiki)

Page 5: Engineering Next-generation Self- healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng zhj6@pitt.eduzhj6@pitt.edu

Autonomously Reconfigurable ANN

Autonomously Reconfigurable ANN (ARANN) Based Medical

Processing Platforms

Error Detectio

n

µControllerRun-Time Reconfiguration

Controller

Mask-Based Topology Adaption

Coarse-/Fine-Grained Hybrid Reconfiguration

New topology

Flash Memory

Coarse-grained Reconfiguration

Bitstream Database

Curr

ent

AN

N

Configura

tion

Fine-grained Reconfiguration

Bitstream

New Configuration

Select/Merge Bitstreams

Coarse-grained Reconfiguration

Bitstream

Error Scale and Location

Outputs

Data Traffic

Request

Request

Inputs Sensors/DatabaseDiagnosis

/Controller

s

Page 6: Engineering Next-generation Self- healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng zhj6@pitt.eduzhj6@pitt.edu

Virtual-physical Neuron Mapping

Neural TopologyPhysical Neurons

Virtual-to-Physical (V2P)

Neuron Mapping

Topology Adaptation

(Coarse-grained)

Connectionism Evolvement

(Fine-grained)Autonomous

ANN+ =

Page 7: Engineering Next-generation Self- healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng zhj6@pitt.eduzhj6@pitt.edu

Mask-based Topology Adaptation

Page 8: Engineering Next-generation Self- healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng zhj6@pitt.eduzhj6@pitt.edu

WACI Conclusion

Systems are increasingly vulnerable to unexpected faults and defects, especially for emerging biomedical systems.

Non-invasive autonomous reconfigurability is promising, particularly for ANN-based biomedical platforms.

Autonomously adapting ANN’s behaviors and structures, both algorithmically and microarchitecturally. Neuron Virtualization helps to decouple the fault scale and

reduce the reconfiguration latency (idle time). Mask-based Topology Adaptation can achieve significant

reduction of design complexity and spatial overhead.

Page 9: Engineering Next-generation Self- healing And Self-optimizing Neural Network Based Medical Platforms Zhanpeng Jin Allen C. Cheng zhj6@pitt.eduzhj6@pitt.edu

Thanks for Listening

Questions?

(This work is supported by NSF No. 0832990)