building open science communities luis ibáñez kitware, inc. insight software consortium the...

65
Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Upload: grace-daly

Post on 26-Mar-2015

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

BuildingOpen Science Communities

Luis IbáñezKitware, Inc.Insight Software Consortium

The Insight Toolkit

Page 2: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

What is ITK ?

Software Library

Written in C++

Using Generic Programming

Extreme Programming

Open Source with Free license

Page 3: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

What is Free Software ?

“Free software” is a matter

of liberty, not price.

To understand the concept,

you should think of “FREE” as

in “FREE SPEECH”,

not as in “FREE BEER”.

http://www.gnu.org/philosophy/free-sw.html

Page 4: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Open Source Software versus Free Software

“Open source is a development methodology”

“Free software is a social movement”

“For the Open Source movement, non-free software is

a suboptimal solution.”

“For the Free Software movement, non-free software

is a social problem and free software is the solution.”

http://www.gnu.org/philosophy/free-software-for-freedom.html

Page 5: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Interdit d’Interdire

ITK is Free

as in

“Free Speech”

and…

as in

“Free Beer”

Page 6: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Well…

free for the users…

Page 7: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

ITK Sponsors

The NationalScienceFoundation

The NationalInstitute for Dental and Craniofacial Research

The National Institute of Neurological Disorders and Stroke

Page 8: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

ITK Developers

Insight Software Consortium

Page 9: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How did ITK start ?

VisibleHumanProject

Acquisition

MR, CT & Cryogenic Distribution

Page 10: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

but,

Data was not Enough…

Page 11: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Software was needed

for analyzing the data

Page 12: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Use my library…

I haveone, but…

I haveone, but…

I haveone, but…

I haveone, but…

I haveone, but…

Page 13: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Developing Software

for Research

is an intrinsically

Ungrateful

business

Page 14: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Software

PapersAlgorithms

Research

Mean Goal

DataDriving

Problem

?

Page 15: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

You don’t get research credits for:

Implementing algorithms published by others

Writing Software Documentation Fixing Bugs Improving Performance Preparing Tutorials Porting to new platforms Supporting Users Making software releases

Page 16: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

If you are a student

If you are a professor

Software will not giveyou a degree…

Software will not give you a promotion…

Page 17: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Software development is seen as

not worthy

of a researcher time

Page 18: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Raise your hand those who can do

Medical Image Processing

without Software

Page 19: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

You do get research credits for:

Publishing papers Publishing books Getting Patents Getting Funding (Grants, Contracts) Licensing your Patents

Page 20: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Why is that ?

Page 21: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Time to face the

Truth

Page 22: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit
Page 23: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Publications

do not

cure Cancer !

Page 24: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Doctors do not prescribe

“reading papers”

as a treatment.

Page 25: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Medical treatment is done with

Medical Devices

Drugs

Surgical Procedures

Page 26: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Publications that don’t lead

to one of those treatments

are sterile publications

Page 27: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Really good

research results

are not published…

They get Patented !

Page 28: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

With the hope of being used for

Medical Devices

Drugs

Surgical Procedures

Page 29: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Why do we care so much

about publishing ?

Page 30: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Publications are a measure

of scientific productivity

They disseminate knowledge

They allow others to reproduce our results

They are validated by the peer-review process

Page 31: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Papers disseminate

knowledge

Page 32: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Information in the 21st Century

Is disseminated on the Internet

Page 33: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How long it takes to post a

PDF file on the Web ?

At most 1 day

Typically 1 hour

Page 34: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How long it takes to publish

a paper on a Journal ?

At least 1 year

Typically 2 years

Page 35: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How much do you

have to pay for publishing

a paper in a Journal ?

About $500 / paper

Page 36: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How much do you

have to pay

for reading the same paper ?

About $30 / paper

or subscribe for $300 / year

Page 37: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How much it costs to

post a PDF on the Web ?

Certainly less than

$500 + N x $30

Page 38: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Papers allow others to

reproduce the results

Page 39: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Reproducing the Results…

Do you get source code with the paper ?

How long it will take you to rewrite this code ?

Do you get the author’s data ?

How can you get their data ?

Do you get all the parameters they used ?

How can you reproduce results if you don’t

have code, data and parameters ?

Page 40: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

And anyways, why do you

want to invest time in reproducing

somebody else’s results…

If you don’t get any credit for doing it ?

Page 41: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Have you ever seen a paper

in a Medical Image Journal

whose only content is the

reproduction of results from

another paper ?

Page 42: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Have you ever seen a paper

in a Medical Image Journal

whose only content is the

failure to reproduce the results

of another paper ?

Page 43: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

If reproducibility is the goal

of publishing…

You should post your source codeYou should post your dataYou should post your parameters

In the same way that you posted your PDF file: on the Web.

Page 44: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Research is validated

by the

Peer-Review process

Page 45: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How can a reviewer

validate a paper ?

If we just concludedthat papers are not

reproducible…

Page 46: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

What does a reviewer

actually do ?

Emit an opinion based on his/her expertise

Page 47: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How much time does a reviewer

dedicate to a paper ?

1 hour ?

2 hours ?

6 hours ?

Page 48: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Why not more time ?

Reviewers are volunteers

They don’t get paid for reviewing papers

They don’t get credits for reviewing papers

They have their own papers to write

They have exams to grade

Their own grant applications to submit

They also have families, pets and… a life !

Page 49: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How long does a paper waits on

the reviewer’s desk before he/she

finds time for reviewing it ?

Six weeks ?

6 months ?

Page 50: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How many reviewers typically

judge your paper ?

Minimum Two

Typically Three

Exceptionally Four

Why not more ?

Why only one time ?

Page 51: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Why do we really

want to publish ?

Page 52: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Because we need

to have publications

in our CV

Page 53: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

“Publish or Perish”

Who invented this ?

and Why ?

Page 54: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

“Publish or Perish”

Was invented by those who needed to evaluate

researcher’s productivity.

Page 55: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

“Publish or Perish”

Empowers those who read

your CV to grade you by

simply counting lines in the

“Publications” section.

Page 56: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

“Publish or Perish”

The group of best educated

people in the world has been

alienated with a simple trick

Page 57: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Who are you

working for ?

Page 58: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Who really pays

your salary ?

Page 59: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Public

Researchers

Hospitals& Doctors

Who pays for Research ?

PharmaceuticalCompanies

Medical DeviceManufacturers

Page 60: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

What do your owe to those

who pay your salary ?

Page 61: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

or

Competition with other

researchers ?

Collaboration with other

researchers ?

Page 62: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

How to collaborate ?

Creating public repositories for source code Creating public image databases Posting parameters on the web Creating forums for hosting positive

discussions online Validating other’s methods and suggesting

improvements.

Page 63: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

The Insight Journal Solution

Open Source

Open Science

Agile Programming

Agile PublishingInsightJournal

Page 64: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

The Dark Ages are Over…

Page 65: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Embrace Open Science !