instrument requirements to the daq/ control /scientific computing system

Controls/software sessionEuropean XFEL collaboration meeting Apr 24, 2013

Thomas Tschentscher

on behalf of the European XFEL scientific instruments [email protected]

Instrument requirementsto the DAQ/Control/Scientific

Computing system

Science instruments requiremens to DAQ/control/scientific computing

Outline

short description of elements of European XFEL user facility

a ‚prototypical‘ experiment

requirements to DAQ/Control/Scientific Computing

2

Thomas Tschentscher, European XFEL, 21 Mar 2010


User facility and its operation

Mission Provision of x-ray FEL radiation and instrumentation User facility based on peer-review Support of users by tools and facility staff

Enable efficient conduct of experiments Enable successful completion of proposed science work

Some numbers ~4200-4800 hrs accelerator operation in x-ray delivery user mode

No distinction here between external users & internal usage Current operation mode is 12+12 for two instruments at one source

typically 3 instruments take beam (simultaneous/quasi-simultaneous) other 3 instruments prepare/set-up (but are basically also operating/online)

Each proposal typically receives 3-8 12hr-shifts (36-96 hrs) per experiment ~1000 user visits per year Extend in future (5 beamlines, 10 instruments, higher rate of sim. operation)

3



4


Layout x-ray facility

2 e--beamlines 3 (5) undulators 6 (10-15) instruments

e-

e-

SQS SCS

SPB FXE

MID HED

Boxes only placeholders !


XTDs - X-ray optics and transport 5

Thomas Tschentscher, European XFEL, 17 Apr 2012

offset mirrors surpression of bremsstrahlung & higher harmonics deflection mirrors distribution to 3 instruments in XHEXP Monochromators & focusing optics X-ray beam diagnostics Others (pulse picker, split&delay, …)


XHEXP – Scientific Instruments & Optical lasers

Each instrument will have its devices to be interfaced Several optics (mirrors, CRL, monochromators, …) X-ray beam delivery (slits, attenuators, …) X-ray diagnostics (Io monitor, time-diagnostics, …) Optical laser beam delivery & diagnostics Sample manipulation & sample environment Detector(s) and spectrometers Vacuum system & devices

6


SPB instrument


Differentiation

Users are … 6 unique science instruments

Instrument staff External users

Specific teams with need to control and readout their systems Beam transport Optical lasers Detectors …

The different ‚systems‘ will likely require specific and somewhat different implementation based on platform KARABO.

7



Expert users

Some ‚access‘ restriction may be needed Complex instrumentation and completed alignment/adjustment Danger of damaging instrumentation

Access limitation Only ‚experts‘ are allowed to operate these devices (to be identified)

Instrument/facility staff Specific staff, trained in use of specific devices

‚General users‘ may initiate action if needed for experiment Buffered request: undulator gap change, … 24/7 or on-call people to execute

However: this classification is not unique and adaption/configuration neededHowever, most ‘access’ with the aim of manipulating the experiment will happen from one, maybe two specific working places in the ctrl hutch (surrounded by screens, phone, tools, ...).

Unique control applicationAccess limitation cannot be achieved by login or similar fundamental waysSR: limit access to critical devices by passwd or similar

8



Outline




9



A prototypical experiment Detailed proposal define parameters, check feasibility Pre-experiments; preparation of experimental setup Setup at European XFEL instrument (without beam)

Set & verify x-ray parameters according to requirements Alignment of sample and additional/secondary diagnostics Verify optical laser beam settings and performance Verify detection systems settings and performance Search for signal Time fraction : significant (days) for non-standard exps. Time fraction : moderate (hrs) for standard exps.

Collect data according to experiment protocol Modification of variables and switching of samples Apply on-line data analysis & reduction

Pre-analysis on-site up to preliminary results Full analysis off-site up to final results

10


Preparationphase

Setupphase

Data takingphase

Data analysisphase


Operation modes of instruments

Preparation phase Before experiment period

Clarify setup, required instrumentation, ctrl tools, data analysis tools Integrate & test new components Expect that something (10-20%) comes up only at start of experiment

This phase is mostly off-line. Experiment coordinator with DAQ/Ctrl/SciComp group(s)

11




Setting up and adjustment Setup & adjust hardware Setup & trim software & initial data analysis tools

Examples of such tools Data selection/restriction/reduction Time or parameter sorting methods ‚Hit‘ finding Correlation analysis FFT transformations

Fully on-line (occupies instrument to large percentage) Primary user:

Instrument/facility staff Secondary user:

Scientist performing experiment (external/internal)

Need to use Ctrl/DAQ from several comp‘s (hutch, tunnel, external, ...)

12




Data taking Collect data according to experiment protocol Modification of variables and switching of samples Apply on-line data analysis & reduction

Absolute crucial component for experiments ! Needs to be considered part of experiment. This task is different to SR experiments.

‚Semi-continuously‘ verification of instrument performance Facility staff

Fully on-line Primary user:

Scientist performing experiment (external/internal) Secondary user:

Instrument/facility staff

13




Data analysis On-line (during data taking). See above Off-line (during data taking): Preliminary data checks

In order to ensure we get not swamped with data and to ensure high data quality standards this may become a requirement to the users, but will need resources to be established

During this phase proximity to instrument is very helpful Off-line (after experiment): Complete preliminary analysis

Directly after experiment a preliminary data analysis should occur. Probably at xfel.eu, but should be remote from instrument

Off-line (after experiment): Full analysis Occurs after experiment and will require time Access to data from home institute or short visits to xfel.eu

14



Example: HED-CTR room layout 1

Acc

ess

to h

utch

Inst

rum

ent c

trl 1

/2/3

Tabl

eAccess to hutch

Data analysis 1

PSS/Interlock PSS/Interlock

4 m

7 m

Dat

a an

alys

is 2

/3

Version: 04/12/2012

1 m


Example: HED-CTR room layout 1

Acc

ess

to h

utch

Inst

rum

ent c

trl 1

/2/3

Tabl

eAccess to hutch

Data analysis 1

PSS/Interlock PSS/Interlock

4 m

7 m

Dat

a an

alys

is 2

/3

Version: 04/12/2012

1 m

PLUS:• Overflow space for more people working on

data analysis (ideally close to instrument to enable exchange & feedback)

• Space for data analysis (not the same people)


Data analysis areas in XHQ 17


2nd floor, XHQ


Outline




18



User requirements to DAQ/Ctrl/SciComp

Entry point Unique entry point login – selection panel – various functionalities

DAQ – ctrl – data analysis/scientific computing – others Very clear and structured appearance (at all levels ?)

Clear identification of function of application Unique usage of certain functionalities (start, exit, update, …) Not too many buttons and too small text/features in GUIs Update of window „live view“

Configurable (and saveable) Possibly identifiable by Exp ID (or similar)

Ideally have only one ‚session‘ open Issue of how to deal with expert vs. user mode (!)

19



Functionalities

DAQ/Ctrl Motors control/status/display Signals/detectors control/status/display External devices display/Interface-to-access

Electron beam delivery (pulse sequence, others tbd) Undulator control (set photon energy, define scan of photon energy) X-ray beam transport, vacuum & diagnostics Equipment protection system X-ray interlock system / shutter control Optical laser Data (intermediate & long-term) …

operation GUIs Command line Macro capability

20



Functionalities

DAQ/Ctrl operation Single device access

Display status/value Configure settings Operate: move, readout, …

Multiple device access Scan capability

Synchronized with 10 Hz pulse delivery 1D-, 2D-, 3D-, nested scans Any real or virtual motor or value Read any signal/detector as function of motor position Display/plotting of signal (real or calculated) Time optimized (no overhead) Easy (clear) command language/configuration of scans

Plotting/display of signals 1D, 2D, several signals in one plot, different scale; easy configurable ‚quasi-online‘ verification of data streaming

21



Functionalities

Data analysis – on-line Immediate access to all data (no transfer times; x-ray & e--beam) Tool-kit to on-line data analysis

extract, manipulate, display, store ‚real experimental data‘ from complex data-files 2D image treatment & analysis:

» Fourier transform, Element-wise matrix multiplication, Matrix subtraction (addition), Thresholding utility, Definition of sub arrays (e.g., regions of interest), Sum of all/selected pixels, Crystal peak identification, and more …

Manipulations: select, compare, fit, math-functions, … Immediate access (during data accumulation ?)

Define new ‚virtual‘ signals Possibility to make available at experiment control ???

Tool-kit on-line data reduction Verify signals with/without ‚Veto‘ signal

Comparison: visual, some tbd calculated qualifier Select Veto signal: real, virtual

Storage of ‚reduced‘ data

22



Functionalities

Data analysis – off-line Preliminary analysis (during exp., on-site)

… (all you can/cannot imagine) Script development tools for internal & external usage

Final analysis (off-site) Access similar to that from instrument (ease of operation)

23


General data treatment; tool kits

Specific data pipelines e.g. bio-imaging (SPB)

User defined scripts/packages


Thank you for your attention

The end.

24



Add. slides 25



Interaction of acc. operators & experimenters 26


Diffractionpattern

X-ray pulse

Electron bunch

Reconstruction

Accelerator operation Instrument operation

As close as possible interaction

instrument requirements to the daq/ control /scientific computing system

Documents

instruments prepareset

european xfel user facility

transport5thomas tschentscher

operation3thomas tschentscher

xray beam delivery slits

instrumentationuser

xray diagnostics io

user visits