icat schema current schema organization what’s there but not yet implemented what could we want in...

ICAT Schema

• Current Schema organization

• What’s there but not yet implemented

• What could we want in the future

1ICAT developer workshop, 25-26 August 2009Laurent Lerusse – STFC l.lerusse@gmail.com

ICAT Schema

2

Proposal

Metadata Catalogue

Information

Experiment

Secure Storage

Data Analysis

Publication

E-PubsProposal System

Data Acquisition

System

Data and Metadata Capture is automated.

Integrated e-Infrastructure

Experiment

4

•What is it all about?•Title•Abstract•Full proposal•Publications

•Who will participate?

•What will be studied?•Sample information•Safety information

A Proposal

PublicationPublication

InvestigatorInvestigator

KeywordsKeywords

TopicsTopics

SampleSample

Sample parameters

Sample parameters

InvestigationInvestigationInvestigationInvestigation

InvestigationInvestigation

visits

InvestigationInvestigation

•Only one Sample in a DataSet. •No other fixed rules.

•Examples• 1 DataSet / Investigation• 1 DataSet / Sample• 1 DataSet / Scan

•How will the data be analyzed?•Has the configuration changed?•Authorization is at this level.

•The DataSet level is where you organize your experiment.

Experiment

SampleSample

Sample parameters

Sample parameters

InvestigationInvestigation

DataSetDataSet

DataSet parameters

DataSet parameters

DataSet

Data Capture

6

•Could point to a specific entryin a neXµs file. •Hold a URL to the data. SampleSample

Sample parameters

Sample parameters

InvestigationInvestigation

DataSetDataSet

DataFile

DataFileDataFile

DataFile parameters

DataFile parameters

DataSet parameters

DataSet parameters

ParameterParameter•A parameter table keeps the description of sample/dataset/datafile parameters

Larger View

7

InvestigationInvestigationSampleSample

Sample DataSimulations

DataSetDataSet

DataFileDataFile

Reduced DataAnalyzed Data

DataSetDataSet

DataFileDataFile

Raw Data

DataSetDataSet

DataFileDataFile

Study

InvestigationInvestigationInvestigationInvestigation

InvestigationInvestigation

Not yet implemented

Related DataFilesNot yet implemented

Study

• Many to Many relation between Investigation and DataSet/Sample

•Read-only Investigation for facility .•Read-write for user (better metadata)

•Can define a’ Reference data Investigation’•Sharing data•Virtual experiment combining data from multiple visits.

•Is it useful?•Development Cost?•Performance?

•Multiplication of Investigation.

Future Development

Investigation Investigation

Sample ASample A

Published Investigation

Published Investigation

DataSet 2DataSet 2DataSet 1DataSet 1

Sample BSample B

Future Development

9

InvestigationInvestigationSampleSample

Reduced DataAnalyzed Data

DataSetDataSet

DataFileDataFile

Raw Data

DataSetDataSet

DataFileDataFile

• Many to Many relation between DataSet and DataFile•Reorganize your data.•Sharing specific data.•More metadata.

•Is it useful?•Development Cost?•Performance?

•How to make sure that we don’t analyze twice the same data?

•Sample description (ISPyB).•Analysis description.•Others?

Comments and Questions

10

ICAT schema is the foundation of the ICAT system.

Careful evaluation is needed before any change.

Migration path has to be defined.

More on governance tomorrow.

Jdeveloper project included in icatprojecthttp://code.google.com/p/icatproject

Integration via Metadata

11

Data Store

DataData

Data Store

DataData

Experiment

Experiment

Data

Analysis

Simulation

DataData