Monte-Carlo Event Monte-Carlo Event Database: current statusDatabase: current status

Sergey Belov, JINR, Dubna

OutlineOutline

IntroductionIntroduction CMS MCDB – pros and consCMS MCDB – pros and cons Main features of LCG MCDBMain features of LCG MCDB Main interfacesMain interfaces Technical implementationTechnical implementation Current project statusCurrent project status Future plansFuture plans

IntroductionIntroduction

Correct Monte Carlo simulation of Correct Monte Carlo simulation of complicated processes requires rather complicated processes requires rather sophisticated expertisesophisticated expertise

Different physics groups often are in need Different physics groups often are in need of the same MC samplesof the same MC samples

Public availability of the event files speeds Public availability of the event files speeds up their validationup their validation

Central and public location where well-Central and public location where well-documented event files can be found documented event files can be found would be very usefulwould be very useful

CMS MCDBCMS MCDBAdvantagesAdvantages

Based on web Based on web technologiestechnologies

Stores detailed Stores detailed documentation for each documentation for each set of event samplesset of event samples

Storing data on AFS let Storing data on AFS let make its easy of accessmake its easy of access

Provide rapid Provide rapid communication communication between users and between users and expertsexperts

ProblemsProblems

Stores parton level events Stores parton level events onlyonly

The expected number of The expected number of physics processes in the physics processes in the database is several hundred database is several hundred (data are stored on AFS so (data are stored on AFS so there is a space limitation)there is a space limitation)

Cannot serve sophisticated Cannot serve sophisticated queries owing to it isn’t SQL queries owing to it isn’t SQL basedbased

Main features of LCG MCDBMain features of LCG MCDB

The most important reason to develop LCG The most important reason to develop LCG MCDB is to expel the restrictions of CMS MCDB is to expel the restrictions of CMS

MCDBMCDB

An SQL-based databaseAn SQL-based database Wide search abilitiesWide search abilities Possibility to keep the events at particle level as Possibility to keep the events at particle level as

well as at partonic levelwell as at partonic level Direct programming interface from LCG Direct programming interface from LCG

collaboration softwarecollaboration software Inheritance of all the advantages of the Inheritance of all the advantages of the

predecessor - CMS MCDBpredecessor - CMS MCDB

General conceptions and General conceptions and termsterms

Event file (sample)Event file (sample) – the file containing particle – the file containing particle or partonic eventsor partonic events

ArticleArticle – a document describing the set of – a document describing the set of samplessamples

Event dataEvent data – the events themselves, all the data – the events themselves, all the data are stored into event filesare stored into event files

Event metadataEvent metadata – information which describes – information which describes all events in a sample in general (beam all events in a sample in general (beam description, physics parameters, applied cuts, description, physics parameters, applied cuts, etc.)etc.)

MCDB interfacesMCDB interfaces

Search formSearch form Article management (creating, changing, Article management (creating, changing,

removing)removing) Downloading sample filesDownloading sample files User management (registration, editing profiles, User management (registration, editing profiles,

removing)removing) Editing metadata on physical models and Editing metadata on physical models and

parametersparameters Moderating articles and user comments on themModerating articles and user comments on them Application programming interface to allow Application programming interface to allow

program-based article creationprogram-based article creation Comment the articlesComment the articles

Access ways to LCG MCDBAccess ways to LCG MCDBEnd-UserEnd-User Read articles, comments, newsRead articles, comments, news Download event filesDownload event files

AuthorAuthor Post articles and upload event filesPost articles and upload event files Post news and answer the commentsPost news and answer the comments

ModeratorModerator Manage users profilesManage users profiles Moderate articles and commentsModerate articles and comments

AdministratorAdministrator Control the systemControl the system Technical database managementTechnical database management

Application softwareApplication software Automatic articles posting and samples uploadAutomatic articles posting and samples upload

The most common operations The most common operations with MCDBwith MCDB

Users in generalUsers in general

1)1) Browses articles via the tree view of physics Browses articles via the tree view of physics categoriescategories

2)2) Searches by author, title, keywords, physical Searches by author, title, keywords, physical processes, parameters values, etc.processes, parameters values, etc.

3)3) Downloads desired sample after agreement on MCDB Downloads desired sample after agreement on MCDB LicenseLicense

Articles’ authorsArticles’ authors

1)1) Uploading event filesUploading event files

2)2) Completing article with the information that wasn’t Completing article with the information that wasn’t not included in the description of an event filenot included in the description of an event file

Software selectionSoftware selectionMySQL MySQL (DB management system)(DB management system)+ Supported as a standard software in CERN LCG Supported as a standard software in CERN LCG

collaborationcollaboration+ Free and open source softwareFree and open source software+ Very fast database operationsVery fast database operations+ Reliable and stableReliable and stable- Doesn’t have good developed DB consistency supportDoesn’t have good developed DB consistency support

Perl Perl (programming language)(programming language) Stable, cross platform programming languageStable, cross platform programming language Powerful and easy-to-developPowerful and easy-to-develop Open source softwareOpen source software Has wide choice of free modules for many purposesHas wide choice of free modules for many purposes

Apache Apache (web server)(web server) Powerful and flexible HTTP serverPowerful and flexible HTTP server Highly configurable and extensible with third-part modulesHighly configurable and extensible with third-part modules

SQL tables in MCDBSQL tables in MCDB

AuthorsAuthors ArticlesArticles CategoriesCategories Generators and their parametersGenerators and their parameters Models and parameters namesModels and parameters names Model parameters’ valuesModel parameters’ values Processes, initial and final statesProcesses, initial and final states Applied cutsApplied cuts Event files, graph filesEvent files, graph files

and a few other tablesand a few other tables

SQL tables structureSQL tables structure

Current status of LCG MCDBCurrent status of LCG MCDB

By now was developed as a preliminary:By now was developed as a preliminary:

1)1) Design of MCDB web siteDesign of MCDB web site

(available at (available at http://http://top.sinp.msu.ru/lcgtop.sinp.msu.ru/lcg))

1)1) SQL tables structureSQL tables structure

2)2) Articles and authors management Articles and authors management systemsystem

3)3) Users privileges schemaUsers privileges schema

Main Perl modules to Main Perl modules to create/modifycreate/modify

Raw DB access (connection, queries)Raw DB access (connection, queries) Operating with tables (managing Operating with tables (managing

users, articles, models, etc.)users, articles, models, etc.) Article authors helperArticle authors helper Security check for man-written texts Security check for man-written texts

(articles body, user comments, news)(articles body, user comments, news) Logging moduleLogging module

Further plans for next two Further plans for next two monthsmonths

Create or amend all base Perl modules Create or amend all base Perl modules described abovedescribed above

Make the following interfaces: article Make the following interfaces: article posting, articles management and users posting, articles management and users managementmanagement

Write detailed documentation and Write detailed documentation and database consistency rules for database consistency rules for develoresdevelores

Develop the site mailing systemDevelop the site mailing system