atlas escience programme atlas uk oversight committee 21 may 2004 roger jones 12 uk institutions

ATLAS eScience ProgrammeATLAS UK Oversight Committee 21 May 2004

Roger Jones

12 UK institutions

RWL Jones, Lancaster University 2

• POOL/SEAL release (done)

• ATLAS release 7 (with POOL persistency) (done)

• LCG-1 deployment (in progress...)

• ATLAS complete Geant4 validation (done)

• ATLAS release 8 (done)

• DC2 Phase 1: simulation production

• DC2 Phase 2: intensive reconstruction (the real challenge!)

• Combined test beams (barrel wedge)

• Computing Model paper

• Computing Memorandum of Understanding

• ATLAS Computing TDR and LCG TDR

• DC3: produce data for PRR and test LCG-n

• Physics Readiness Report

• Start commissioning run• GO!

2003

2004

2005

2006

2007

NOW

LCG and GEANT 4 Integration

Testing the Computing Model

Testing the Physics Readiness

Data-ready versions

Confront with data

Packages shake-down in DC3 (or earlier)

ready for physics in 2007

ATLAS Computing TimelineATLAS Computing Timeline


ATLAS eScience ProgrammeATLAS eScience Programme

Original bid was presented to PPRP on 14Original bid was presented to PPRP on 14thth July 2003 July 2003 Reduced programme indicated An allocation and full management plan had not been requested at

that time A presentation to the PPRP of a prioritized programme and a A presentation to the PPRP of a prioritized programme and a

fuller description of the management plan and process given on fuller description of the management plan and process given on 44thth February 2004 and approved at £2.45M February 2004 and approved at £2.45M

‘Required’ 10% working margin No similar programme has that level of working margin

LHCb (1/2 the size), 3.5% GridPP (5 times the size) has just under 5% (although can vary

the hardware spend) 10% would do serious damage in terms of the number of hires, in a

way that would not be recoverable when the residual margin is released

We ask Oversight Committee endorsement of a 7.6% working margin (on April 2004 numbers) as detailed in the paperwork


New ATLAS eScience Programme:New ATLAS eScience Programme:Summary of DeliverablesSummary of Deliverables

This project will produce:This project will produce:

Major components of the track & vertex reconstruction and fitting Major components of the track & vertex reconstruction and fitting packages for the (major UK participation in construction) ATLAS SCT, packages for the (major UK participation in construction) ATLAS SCT, validated against test beam and simulation datavalidated against test beam and simulation data

The calibration and monitoring software required to ensure reliable and The calibration and monitoring software required to ensure reliable and optimal operation of the detector system for which the UK is responsibleoptimal operation of the detector system for which the UK is responsible

The validated simulation and monitoring tools for UK aspects of the The validated simulation and monitoring tools for UK aspects of the trigger.trigger.

The ATLAS fast simulation validated against full GEANT simulation and The ATLAS fast simulation validated against full GEANT simulation and interfaced to UK-lead physics simulations (HERWIG++)interfaced to UK-lead physics simulations (HERWIG++)

The general ATLAS software validation system.The general ATLAS software validation system. General ATLAS reconstruction and physics tools.General ATLAS reconstruction and physics tools. The ATLAS event display/visualisation program.The ATLAS event display/visualisation program.

(see appendix A of February 2(see appendix A of February 2ndnd document to PPRP for detailed deliverables – document to PPRP for detailed deliverables – currently under revision in the light of staggered hiring, delayed approval)currently under revision in the light of staggered hiring, delayed approval)


Project DefinitionProject Definition

Project broken into 4 work packagesProject broken into 4 work packages Co-ordinated with ATLAS GridPP effort, effectively ‘WP5’ lead Co-ordinated with ATLAS GridPP effort, effectively ‘WP5’ lead

by Roger Jonesby Roger Jones 2.5 FTEs working on Grid integration and a 2FTE joint project

constructing a User Interface (GANGA) with LHCb Overall project leader (R Jones, project manager in ATLAS Overall project leader (R Jones, project manager in ATLAS

terms)terms)

Work Package

Sub-package

(Sub) Package Leader

Activity

Low-level Tracking Software

1 S Lloyd; QMUL Monitoring, alignment, ‘core tracking algorithms’ and tracking validation

High-level Tracking &reconstruction software

2 D Tovey; Sheffield Tracking tools, energy flow

Trigger & Simulation Software

Trigger 3.1 S George; RHUL Level-1 monitoring and simulation and trigger validation. HLT re-validation under the new B-physics framework

Simulation 3.2 (A Doyle; Glasgow) Geant4 integration and framework activity

Support Software, Frameworks & Visualisation

Support & Frameworks

4.1 P Sherwood; UCL Validation framework, tier support, ARTEMIS

Visualisation 4.2 (N Konstantinidis; UCL) ATLANTIS package


Management StructureManagement Structure

ATLAS UK Oversight Committee

ATLAS-UK Computing Project Management Board

CEB & Institute representatives

ATLAS UK Collaboration Board UK Group and Project leaders

A-UK Computing Executive BoardProject & WP leaders, Resource

officer, Comp. Co-ordinator

WP1Low Level TrackingSteve Lloyd, QMUL

WP2High level Tracking

Dan Tovey, Sheffield

WP3Trigger and SimulationSimon George, RHUL

WP4Software Support/Frameworks

Peter Sherwood, UCL

3.1Trigger

Simon George, RHUL

3.2Simulation

Tony Doyle, Glasgow

4.1Software Support

Peter Sherwood, UCL

4.2Visualisation

Nikos Konstantinidis, UCL


Spend ProfileSpend Profile

Salary profile

£0.00

£100,000.00

£200,000.00

£300,000.00

£400,000.00

£500,000.00

£600,000.00

£700,000.00

£800,000.00

£900,000.00

1 2 3 4

FY

Sal

ary

Support and Frame

Trig and Simul

High Level Tracking

Low Level tracking

There will be some shift later because of delayed hiresContingency generated by shaving months off the end

Conservative salary total 2.43M


Risk registerRisk register

PARTICLE PHYSICS PROJECTS RISK PROFORMA

Ref Risk Description Potential impact on project Inherent Risk Score Existing Controls Mitigating factors Residual risk score Comment Proposed Action

1 Recruitment/retention of new staff Delays and non-delivery

2 36 Staged recruitment, some postholders already known

2 36

2 Sudden loss of key staff Weakened management

2 36 Close interworking

2 36

3 Contingency too smallLater deliverables lost

1 33 Very large contingency, reviews

1 33

4 Late deliverables 2 3 6 Review of deliverables, project controls Redeployment of effort 1 3 3

5 Non-adoption by ATLAS

3 26 Integration with ATLAS WBS; engagement of area leaders

2 36

6 Change in requirements Inefficient use fo effort

3 26 Central review of deliverables

2 24

7 Lack of external recognition

2 24 CHEP talks and other papers

1 22

8 External software 1 5 5 LCG support 1 3 3 External

9 Lack of inter-WP cooperation Inefficient use fo effort

1 33 Regular CEB meetings Collaboration meetings

1 33

10 Maintainability of software developed Poorer physics

2 36 Validation framework, enforced QA

2 36

11 Technology shifts Extra effort required 1 5 5 Strong analysis,design and QA regimes 2 2 4

12 Dupication of effort Inefficient use fo effort 3 2 6 Integration with ATLAS WBS; engagement of area leaders 2 3 6

13 Non-delivery of existing effort Shortfall of effort

2 510 CB managing programme

2 510

14 Insuffiecient computing hardware Potential risk for real-time testing

1 33

1 33

15 Local system support not adequate Impaired development

2 36 Rolling grant funding for SYSMAN

1 33

16 Failure of international ATLAS computing

1 5

5

1 5

5

17 Early start of LHC Pressure for early delivery 1 3 3 Evolutionary development approach 1 3 3

18 Late start of LHC/ATLAS Insufficient effort for testing

1 33

1 33

19 Construction delays Inability to delveop e.g. alignment 3 2 6

19 Lack of continued funding Non-maintenance of developed code

3 39 Detector project management Roll-off into RG base programme

3 39 External

20 Travel budget inadequate Imparied integration

2 36 Virement, use of collaborative tools Improved collaborative tools

1 33

L = Likelihood on scale of 1, 2 ,3 4 where 1 is low.I = Impact on scale of 1, 2, 3, 5 where 1 is low.

High risk is a score greater than 8

C-MoU covering software project, create Core Software Team


Work Packages: Recent work and Work Packages: Recent work and Plans at Start-upPlans at Start-up


WP1 Low Level TrackingWP1 Low Level Tracking

Digits and GeometryDigits and Geometry QMUL worked on SCT digits (switch to Raw Data Objects) New hits definition

SCT MonitoringSCT Monitoring Work is underway at Cambridge and Liverpool

Core Tracking Algorithms (Core Tracking Algorithms (RALRAL) ) Tuning and testing of iPatRec code Impact of ID layouts Future work shaped by common Track framework, merging of two

tracking suites AlignmentAlignment

Steve Haywood co-convenes alignment group Much RAL work on interfacing the GeoModel First tests of debugged code and algebra have been done Manchester are working on the magnetic alignment code


WP2 High Level TrackingWP2 High Level Tracking

V0s (V0s (LancasterLancaster)) Inefficiency largely caused by hit requirements Field causes more minor problems New strategies developed, but implementation awaiting the new ATLAS track

model (currently iPatRec and xKalman are different and should merge) Bremsstralung recovery (Bremsstralung recovery (LancasterLancaster))

Various strategies tried and compared, small improvements More use of the calorimeter is possible, Gaussian-filter shows promise Again awaits unified track model

VertexingVertexing First look at implementing billoir fitter by Liverpool Sheffield providing a C++ fitter working on CBNT until an Athena solution

available Energy FlowEnergy Flow

Sheffield have had a notable success with EflowRec implementing first energy flow ideas

Now porting it to the RTF recommended formats Redesign and extensions are planned

Revised deliverables available and discussed with overall ATLAS ID soft. coordinator


WP3.1 Trigger and OfflineWP3.1 Trigger and Offline

HLTHLT Simon George co-ordinated HLT/PESA software, is on the

Architecture team and the Software PMB RHUL prototyping offline trigger code validation (with some

UCL assistance) Also working on a region selector and the event and

conditions data access

Level 1Level 1 Birmingham developing the Level 1 calorimeter simulation

(started by QMUL) More realistic simulation of electronics being developed New scheme for tower simulation, preliminary releasse this

month

Deliverables under revision


WP3.2 SimulationWP3.2 Simulation

ATLFast ATLFast A great UCL-driven success story Wish to transfer the experience into other areas Integration with POOL persistancy FASTShower integration – final verification stalled because of non-retention of

staff ATLFast must continue to evolve and match the GEANT4 simulation and – ATLFast must continue to evolve and match the GEANT4 simulation and –

GlasgowGlasgow post hired early on local money post hired early on local money This needs a comparator, which will be Artemis based (see later) Adaptors reconstructionArtemis Parser for DC2 Geant4 data

EvtGenEvtGen Framework (Lancaster) will allow inter-experiment sharing of decay data and

models First crude integration done More work need on framework itself and on the integration incorporated Will be used to validate the HLT B-physics triggers (sensitive to the angular

structure)

Deliverables under revision


WP4.1 Support and FrameworksWP4.1 Support and Frameworks

ArtemisArtemis The UK (mainly UCL, but also Glasgow and Lancaster) has

developed a prototype lightweight physics analysis framework

Full functionality OO/C++ Easy to develop (students can extend it) Can allow painless evolution to track reconstruction

framework attempts to provide same

ATLAS workshop in UCL prompted by ArtemisATLAS workshop in UCL prompted by Artemis

Contributions to ‘Core&Infrastructure’ ~9 s-yComputing MoU is being constructed by Task Force

UK is represented by Neil GeddesRoger Jones actively reviews as ICB Chair

Revised deliverables available and being added to WBS


ATHENA reconstruction

(xKalman, iPatrec)

StoreGateDataVector<

Trk::Track

Trk::Track

Trk::Track

….>

ARTEMIS

Track Interface

(ITrack)Create()

getTrkTrack

getPerigee

getBLayerHits

etc

TrackCollection

DataVector<

ITrack

ITrack

ITrack

….>

(shared ptrs)

User’s analysis

code

Histograms/

ASCII output

Artemis tools Vertexing software

Data flow

Shared pointerService

Calorimetry users already happyThis will allow B-physics use


WP4.2 Support and FrameworksWP4.2 Support and Frameworks

Validation FrameworkValidation Framework Software hooks as well as testing suite envisaged Current product RTT allows frequent large sample tests Mainly developed by UCL with Manchester support Parallel testing framework developments at RHUL on trigger

simulation

With convergence of HLT and offline, convergence and co-With convergence of HLT and offline, convergence and co-ordination planned in these activitiesordination planned in these activities


WP4.2 VisualisationWP4.2 Visualisation

UCLUCL has the graphics and visualisation coordinator has the graphics and visualisation coordinator Lead responsiblity for ATLANTISLead responsiblity for ATLANTIS

See cover of current CERN Courier for an example

Evolved from ALEPH display DALIEvolved from ALEPH display DALI JAVA basedJAVA based Should:Should:

Be able to run reconstruction algorithms (C++ - use PYTHON bus?)

Be able to interact work on the Grid (interaction with Alvin Tan, GridPP funded)

Be tailored to ID and trigger needs


ATLANTIS Display makesthe cover of the

April 2004 CERN Courier


SummarySummary

This prioritised programme will ensure ATLAS-UK is ready to This prioritised programme will ensure ATLAS-UK is ready to exploit LHC data:exploit LHC data:

Supports the large construction phase experiment Supports the existing UK leadership Integrates with the GridPP activities Makes a significant contribution to the overall shortfall in ATLAS

computing effort, commensurate with our share of the experiment Will position the UK well for physics exploitation

Management team blends project management experience with Management team blends project management experience with software expertisesoftware expertise

Local expertise in place to support and manage new staff Collaboration eager to start posts at the earliest possible date

Request your support of 7.6% working marginRequest your support of 7.6% working margin Largest uncertainties (new salary scales) will be resolved over the

next few months. The current PPARC model for them still gives 5.4% working margin, and would still just cover the full program.

atlas escience programme atlas uk oversight committee 21 may 2004 roger jones 12 uk institutions

Documents