icat schema current schema organization what’s there but not yet implemented what could we want in...
TRANSCRIPT
ICAT Schema
• Current Schema organization
• What’s there but not yet implemented
• What could we want in the future
1ICAT developer workshop, 25-26 August 2009Laurent Lerusse – STFC [email protected]
ICAT Schema
2
Proposal
Metadata Catalogue
Information
Experiment
Secure Storage
Data Analysis
Publication
E-PubsProposal System
Data Acquisition
System
Data and Metadata Capture is automated.
Integrated e-Infrastructure
Experiment
4
•What is it all about?•Title•Abstract•Full proposal•Publications
•Who will participate?
•What will be studied?•Sample information•Safety information
A Proposal
PublicationPublication
InvestigatorInvestigator
KeywordsKeywords
TopicsTopics
SampleSample
Sample parameters
Sample parameters
InvestigationInvestigationInvestigationInvestigation
InvestigationInvestigation
visits
InvestigationInvestigation
•Only one Sample in a DataSet. •No other fixed rules.
•Examples• 1 DataSet / Investigation• 1 DataSet / Sample• 1 DataSet / Scan
•How will the data be analyzed?•Has the configuration changed?•Authorization is at this level.
•The DataSet level is where you organize your experiment.
Experiment
SampleSample
Sample parameters
Sample parameters
InvestigationInvestigation
DataSetDataSet
DataSet parameters
DataSet parameters
DataSet
Data Capture
6
•Could point to a specific entryin a neXµs file. •Hold a URL to the data. SampleSample
Sample parameters
Sample parameters
InvestigationInvestigation
DataSetDataSet
DataFile
DataFileDataFile
DataFile parameters
DataFile parameters
DataSet parameters
DataSet parameters
ParameterParameter•A parameter table keeps the description of sample/dataset/datafile parameters
Larger View
7
InvestigationInvestigationSampleSample
Sample DataSimulations
DataSetDataSet
DataFileDataFile
Reduced DataAnalyzed Data
DataSetDataSet
DataFileDataFile
Raw Data
DataSetDataSet
DataFileDataFile
Study
InvestigationInvestigationInvestigationInvestigation
InvestigationInvestigation
Not yet implemented
Related DataFilesNot yet implemented
Study
• Many to Many relation between Investigation and DataSet/Sample
•Read-only Investigation for facility .•Read-write for user (better metadata)
•Can define a’ Reference data Investigation’•Sharing data•Virtual experiment combining data from multiple visits.
•Is it useful?•Development Cost?•Performance?
•Multiplication of Investigation.
Future Development
Investigation Investigation
Sample ASample A
Published Investigation
Published Investigation
DataSet 2DataSet 2DataSet 1DataSet 1
Sample BSample B
Future Development
9
InvestigationInvestigationSampleSample
Reduced DataAnalyzed Data
DataSetDataSet
DataFileDataFile
Raw Data
DataSetDataSet
DataFileDataFile
• Many to Many relation between DataSet and DataFile•Reorganize your data.•Sharing specific data.•More metadata.
•Is it useful?•Development Cost?•Performance?
•How to make sure that we don’t analyze twice the same data?
•Sample description (ISPyB).•Analysis description.•Others?
Comments and Questions
10
ICAT schema is the foundation of the ICAT system.
Careful evaluation is needed before any change.
Migration path has to be defined.
More on governance tomorrow.
Jdeveloper project included in icatprojecthttp://code.google.com/p/icatproject
Integration via Metadata
11
Data Store
DataData
Data Store
DataData
Experiment
Experiment
Data
Analysis
Simulation
DataData