a customizable framework for neurophysiology data … · 2015-10-26 · a customizable framework...

13
A customizable framework for A customizable framework for neurophysiology data management and neurophysiology data management and provenance tracking provenance tracking Jonathan Duperrier, Domenico Guarino, Andrew Davison Unité de Neuroscience, Information et Complexité (UNIC) CNRS, Gif sur Yvette, France Orsay, OSI Day 26 th October 2015

Upload: others

Post on 01-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

A customizable framework for A customizable framework for neurophysiology data management and neurophysiology data management and provenance trackingprovenance tracking

• Jonathan Duperrier, Domenico Guarino, Andrew Davison

• Unité de Neuroscience, Information et Complexité (UNIC)

• CNRS, Gif sur Yvette, France

• Orsay, OSI Day 26th October 2015

Page 2: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Neuroscience data

Datasharing

Neuroscience produces a lot of data Neuroscience produces a lot of data but it is difficult to share it.but it is difficult to share it.

Why?Why?

Page 3: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Neuroscientific experiment

thanks to Lyuba Zehl, Michael Denker, Alexa Riehle, Sonja Grün and Thomas Brochier

Page 4: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Data-sharing as a problem

● Many ways to do experiments● Many devices● Many source of data recording● Many storage formats● Many softwares

How to organize and share the data?

Annotations!

Page 5: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Annotations

We have to reduce cost and increase benefitWe have to reduce cost and increase benefit

Page 6: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Experimental protocols and methods of data

acquisition are extremely diverse

A scientist should obtain immediate benefits from

annotating their data

A scientist should be able to easily annotate their

data with minimal disruption to their

workflow

The metadata stored should be customizable but there should be a common core to ensure

interoperability

The same tool should be useable both as a local database and as

a public resource

Multiple, easy-to-use interfaces are needed for different phases of

the workflow

Constraints Requirements

Page 7: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Helmholtz meta­database

Helmholtz provides core components to handle elements common to all or many domains of neurophysiology

Helmholtz is customizable according to each experimental setup

The metadata stored should be customizable but there should be a common core to ensure

interoperability

Page 8: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

RESTful solution

Using RESTful interface:

● Well-known

● Simple (HTTP)

● Many libraries available for many languages and platforms

Multiple, easy-to-use interfaces are needed for different phases of

the workflow

Page 9: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Python/Django solutionThe same tool should be useable both as a local database and as

a public resource

Webserver(e.g. Apache with mod_wsgi)

+ Django + Helmholtz

RDBMS(PostgresSQL,

MySQL, SQLite or Oracle)

Data Server(e.g. file server)

Scripting Interface Data acquisition

Data analysis(e.g. Matlab)

Touch Interface Data acquisition

(e.g. Hermann) Web Interface

Data analysis

REST

Page 10: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Example of data acquisition interface

Current interaction with experimenters:

• Portable device

• Easy to use due to time constraints during experiment

• This application is built with Bootstrap and AngularJS

Page 11: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Example of implementation

● Timeline of experiment

Page 12: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Example of implementation

● Form to add and edit Cell

Page 13: A customizable framework for neurophysiology data … · 2015-10-26 · A customizable framework for neurophysiology data management and provenance tracking • Jonathan Duperrier,

Acknowledgements

Funding bodies:Funding bodies:

Thanks to:Thanks to:

●Xoana TroncosoXoana Troncoso●Christophe DesboisChristophe Desbois●Cyril MonierCyril Monier●Gerard SadocGerard Sadoc●Yves FrégnacYves Frégnac