bolko beutner, helge brands, rasmus ischebeck: adaqa

© 2013 Paul Scherrer Institut

Slides available at http://people.web.psi.ch/ischebeck

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

ADAQAAn Accelerator Data Acquisition & Analysis FrameworkBolko Beutner, Helge Brands, Rasmus Ischebeck

>The Past

>Accelerator Data Acquisition

>Design Ideas

>The Present

>Available Tools

>Demo

>The Future

>Data Acquisition with Large Data Sets at 100 Hz

11

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

What Came Before…

(my personal collection of accelerator data acquisition)

>TESLA Test Facility at DESY, Hamburg

>Access to accelerator process variables from MATLAB, C++ (read/write)

>Easy to write data acquisition software, scan parameters, record variables…

>Data stored in .MAT, ASCII & ROOT files

>No common data format

>Experts required to set up scan, analyze data…

>SLAC LINAC at Stanford, California

>VAX-based control system

>Scan software to determine the dependency of a variable on a parameter

>On-line display & fits

>Writes MATLAB 4 files for further analysis

22

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

Design Goals

>Have a universal scan and data acquisition software

>Well-tested scan core

>Universal GUI to set up scan easily

>Specialized GUIs for easy access for regularly performed scans

>Error checking and treatment

>Common HDF5-based file format for easy access from any data analysis code

>Automatic generation of logbook entries

>Link to auxiliary information on accelerator configuration

>Synchronized data acquisition

33

Rasmus IschebeckRasmus Ischebeck

Data File Format

>Hierarchical format to store Instruments

>Based on HDF5

>Readable from Matlab, Root, Mathematica…

44www.nexusformat.or

g

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

Accelerator Data Acquisition

Many accelerator measurements consist of the following tasks:

>Control 0…N actuators

>Acquire 1…M measurements

>Analyze data

Important features

>On-line analysis

>Reasonable error handling

>Robust code for use by other persons than the programmer

55

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

ADAQA Layers

>ADAQA consists of several separate building blocks

>Applications, written by different programmers, make use of the same data acquisition code

>Instruments gather connected devices

>Logbook

>Common data storage format

>Online model*

>Device information server*

>Synchronized data acquisition

* ongoing work, not yet ready for prime time

66

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

ADAQA Layers

>Tree-like structure:

>Many devices (roots)

>One data acquisition core (trunk)

>Many applications (branches)

>Building blocks can be exchanged

77

Devices

DataAcquisitio

n

Applications

Wikipedia

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

Synchronized Data Acquisition

>All VME crates for diagnostics are equipped with an Event Receiver

>Connected with a star topology network to the Event Generator

>Supported for:

>BPMs, Bunching monitor, RF, …

>Ongoing work:

>Laser shutter, oscilloscopes, cameras

88Sven

Nordquist

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

• ScreenMonitorTool• General Purpose Scan Tools• Specialised Scan Tools

–Slice Emittance–Optics Matching–Slit Scan–…

• “Do it yourself! - Scan Tools

ADAQA Applications

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

• General purpose camera display andanalysis tool

• In every day use for different kinds of cameras and screen monitors

ScreenMonitorTool

Dione and Saturnhttp://www.ciclops.org

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

General Purpose Scan Tool

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

the future…

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

• Scans can be stored in Template files• The last scan is always stored as template

–“Repeat Last Scan…”-Button

• Data files are scan templates as well–All scans can be exactly repeated

• Templates can handed over to the scan tool at startup–example: extracted charge vs. gun phase scan

Scan Templates

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

Specialised Scan Tools

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

Specialised Scan Tools

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

Automatised logbook entries

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

• General and specialised scan tools are possible with ADAQA–a wide variety of tools is available

• Common data format• Templates

–data files are templates – for all tools

• Actions–e.g. automatic screen insertion or background subtraction

• Analysis functions

• Automatic logbook entries

Scan Tools Summary

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

knob{1} = LoadKnobDefinition('ManagementKnob'); % setup Knob and Instrumentknob{1}.SetpointValues = [1, 2.4, 3, 3.78, 92]; % scan setpoints

instrument{1} = LoadInstrumentDefinition('SwissFEL_Meeting_Demo');

Setup.Function = 'scan'; % define scan setupSetup.Repeat = 10; % “shots” per scan step

Info.Author = 'Beutner'; % human readable infoInfo.Title = 'SwissFEL Meeting Demo';Info.Purpose = 'this is a small scan tool for demo...';

[DAQFileName, Setup, knob, instrument, Info] = ... daq(Setup,knob,instrument,Info); % execute scan

% …insert your analysis code here…

Do it yourself! - Scan Tools

Image based measurements: today

IOC

AFS

EPICS Control+Data

cameraworkstation

Helge Brands

control room

Image based measurements: today

Problems:• available buffers on IOC are not used• „lost“ of measured data• high frequencies can‘t be reached• high CPU load on workstations

Helge Brands

IOC

AFS

EPICS Control+Data

cameraworkstation

control room

Image based measurements : future

DATA

Compute-Node

Results

Results+Data

IOC

AFS

EPICS Control+Preview

cameraworkstation

Helge Brands

control room

Why?

•less radiation•higher recording speed (10Hz/100Hz)•independent of the workstation (CPU and memory)•system is similar to SLS (Tomcat, in operation, 1* PCO Edge)

Helge Brands

Why?

•less radiation•higher recording speed (10Hz/100Hz)•independent of the workstation (CPU and memory)•system is similar to SLS (Tomcat, in operation, 1* PCO Edge)

BUT

Helge Brands

Technical values

example: ~30TB/week

more storage needed

Helge Brands

Specs

storagesize/speed

network(camera IOC)

IOClocal memory

compute nodes

WHLATest-Injector

558 GB/50MB/s

1Gb/s 16GB~3000 pic

1-2

SwissFEL (?)/(?) 10Gb/s (?) min. 5-10

Helge Brands

Current situation

•WHLA: each Camera-IOC has 1GB/s (enough for 10Hz) •3 PCO Edge in operation + 1 PCO Edge in preperation•upload to AFS max 50MB/s•software is ready for 100Hz•needed network speed 10GBit/s for 100 Hz•other GIGE cameras can be used too•additional compute nodes should be planned•storage policies are needed

Helge Brands

>Project started in 2008, always between 5 and 10 developers

>Written mostly in Matlab

>89093 lines of code (including code sourced from MathWorks Central and other external sources)

>Performed 22775 scans, resulting in 558 GB of data

>A joint project between the Controls, Beam Dynamics & Diagnostics Sections at PSI

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

ADAQA

3131

ADAQADiagnostic

sControl

sBeam

Dynamics

© 2013 Paul Scherrer Institut

Slides available at http://people.web.psi.ch/ischebeck

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQABolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

Outlook> We are looking forward to many new

applications for SwissFEL!

> Thank You to:

> all ADAQA programmers and users, in particular Eduard Prat, Marta Divall, Peter Peier, Marc Guetg, Gian Luca Orlandi, Bennie Smit & Thomas Schietinger

> support from Jan Chrin & Babak Kalantari

3232Sven Nordquist