Creation of data storage and analysis center

Dmytro IAKUBOVKYI (BITP, Kiev, Ukraine), Igor TELEZHINSKY (KNU, Kiev, Ukraine),

Andrii ELYIV (MAO, Kiev, Ukraine)On behalf of Virtual Roengen and Gamma

Observatory in Ukraine (VIRGO.UA)

Off-line analysis in high-energy astrophysics and its challenges

Complexity of the instruments, large amount of analyzed data;

Some tasks start to challenge the existing computing capabilities;

An example of computationally challenging task: search of Dark Matter decay line in X-rays;

INTEGRAL/SPI – processing more than 20.000 ScWs from GC and outer regions -- > thousands of CPU-hours;

XMM-Newton/EPIC – excluding more than 200 point sources from M31 halo, extended sources analysis (generation of precise response matrices) -- > hundreds of CPU-hours;

Xspec – joint spectral fitting of several spectra with complex models (e.g. XMM-ESAS analysis for extended sources), confidence ranges calculation --> hundreds of CPU-hours.

Possible solution – on-line analysis:

These tasks can't be run at a single local computer (several months' tasks);

The alternative – computing cluster (usually about 100 CPUs), several hours – several days' tasks (if cluster is free);

Hundreds of INTEGRAL and XMM-Newton active users work on dozens of different places. Do they need dozens of their own computing clusters?

The other alternative is to have a single “supercluster” and on-line (web-based) analysis (versus off-line);

THAT'S WHAT WE PROPOSE!

How it works …

Make request tothe Analysis System

via web site

The user-friendlyInterface module

converts your request into high levelGRID tasks…

Task Execution and Error Control module

Error localization and task re-submission

Final data andlogs delivery

logs production

data

logs

COMPUTER CLUSTERS

USER

???...

INTERFACE

Current progress:

Data storage and analysis center in Kiev (part of VIRGO.UA), created with the help of ISDC, works since 2005;

16 computing clusters in Ukraine, working under Ukrainian Academic GRID (UAGRID) since 2006;

We have the access to UAGRID resources since the end of 2008 when virgo_ua Virtual Organization was formed;

The process of implementation of INTEGRAL/OSA and XMM-Newton/SAS has been started in 2009;

The contacts with European groups having similar ideas (e.g. RISA from XMM-Newton/SAS) have been established.

Thank you for attention!