trigger and online software simon george & reiner hauser t/daq phase 1 idr

Trigger and online software

Simon George & Reiner HauserT/DAQ Phase 1 IDR

2

Scope• Scope– Trigger software: runs in HLT farm, selects events– Online software: DAQ and HLT infrastructure– Upgrade only; M&O excluded

• Plans:– Main work during 2015-2018– Based on experience of original software, data

taking, and planning LS1

S.George & R. Hauser

3

Time line

• TDR (end 2013)– Will describe baseline assumptions and plan, with some potential options to

consider– Some technology evaluations (e.g. GPGPU, Xeon Phi) already starting

• Advantage to delay technology decisions to 2016/17– Most software upgrades will benefit from experience of development during

LS1 and operational experience in 2015– Hardware decisions best taken as late as practical - avoid being caught out by

change in technology trends after decision– Lead time on software changes varies: plans will reflect this– Evaluate emerging hardware and software technologies until decision is needed

• Final software testing and iteration through 2018


2013 2014 2015 2016 2017 2018 2019 2020 2021

LS1 LS2

TDR

Phase 1Phase 1 software upgrade

4

Drivers for changes to Trigger/DAQ/HLT software (1)

• LHC upgrade– higher energy, luminosity, pileup

• Detector and T/DAQ upgrades– L1Calo, L1Muon, L1Topo– FTK– Dataflow software, network and ROS upgrades

• The next rolling network upgrade will be in 2018.

• Performance requirements– Higher rates and bandwidth throughout the system– More complex algorithms and trigger strategies to achieve

necessary rejection/efficiency– More precise/frequent online conditions updates


5

Drivers for changes to Trigger/DAQ/HLT software (2)

• External computing trends– CPU evolution, co-processors, PC architecture (memory, cores, i/o)– Networking technology and prices– Developments and possible paradigm shifts in software languages, libraries,

technologies– Rise and fall of numerous free & commercial products we use

• Offline computing– Offline software: framework, detector, data and reconstruction code– Common infrastructure: o/s, build, compilers, libraries

• Turnover of people and significant evolution of requirements– Some of the TDAQ core services and HLT core software will be over 10 years old,

during which time they have been extended to do things that were never imagined when first designed

– Plan refactoring and replacement where needed for future maintenance and to rebuild a pool of expertise

• Need for increased automation– Operations procedures, scaling of expert systemsS.George & R. Hauser

6

Summary of main trigger work• Trigger core software

– Includes steering, data access, configuration, monitoring, analysis– Need sub-event parallel code to exploit many-core and co-processor

architectures– Work closely with offline to introduce new framework before phase 1– Expect significant effort to contribute and adapt– New challenges for monitoring algorithm performance and code

analysis/debugging tools– Also expect possible changes to i/o framework and data model– Interfaces with DAQ/HLT, steering, algorithms affected

• Menus & algorithms– A lot of work on studies, strategy development, code development and offline

code adaption.– Includes use of IBL, FTK

• Trigger simulation– New L1 hardware– Implications of using specialist processors online such as GPGPUs and FTK– Fast trigger simulationS.George & R. Hauser

7

Common Trigger and DAQ/HLT work• Evaluate emerging software and hardware

technologies– GPGPU, other co-processors, better CPU vector

engines, performance vs. cost of many-core vs multi-core

– Example: GPGPU evaluation• Data preparation, tracking in HLT algorithms.• Gatherer in DAQ?

– Redesign of software to take advantage of chosen technologies


8

Trigger work packages and effort

Work package 2015 2016 2017 2018 TotalCore software 3.7 5.5 5.3 2.7 17.2Evaluate and exploit new technologies 3.0 3.0 2.0 1.5 9.5Menus & algorithms 10.5 10.5 8.0 10.0 39.0Simulation 1.3 1.3 1.3 1.3 5.2Total 18.5 20.3 16.6 15.5 70.9


9

Summary of DAQ/HLT work• Changes are required to HLTPU for new offline

framework interface to data flow.• DAQ/HLT core software, control and monitoring

changes will depend on outcome of evaluation in 2015– Some changes likely but not yet known which– Might also require many changes in detector sw that

are not costed in this plan.• Data flow changes will be driven by the

availability/cost/capabilities of networking technology.


10

DAQ/HLT work packages and effortWork package 2015 2016 2017 2018 Total

HLT Processing Unit 1.0 0.5 0.4 0.4 2.3DAQ/HLT Core Software, Infrastructure 0.7 3.5 4.0 3.0 11.2Configuration, Control & Monitoring, Web Services 2.4 3.7 3.7 2.0 11.8

Data Flow, Event Format 0.2 3.2 3.2 3.0 9.6Detector and Control Room Software and Tools - 0.3 2.5 2.3 5.1Evaluate and exploit new technologies 0.5 0.5 0.4 - 1.4

Total 4.8 11.7 14.2 10.7 41.4


11

Developer profile• Due to extensive use of new software and

hardware technologies and highly technical nature of work

• Most work requires people with software engineering background or significant experience.

• Estimate about 25% of trigger work could be done by motivated physicists, mainly in menus and algorithms.


12

Major Milestones• End 2013: TDR• End 2015: Decisions on need to renew major

software components and software technology choices

• Early 2017: Decision on PC architecture for new HLT farm nodes

• End 2017: Final software release ready for testing

• End 2018: Ready for data taking


13

Summary


Total effort over 4 years (FTE):70.9 (Trigger) + 41.4 (DAQ/HLT)

See document for more details

2013 2014 2015 2016 2017 2018 2019 2020 2021

LS1 LS2TDR

Phase 1Phase 1 software upgrade

4-year software plan for Phase 1

2015 2016 2017 20180

5

10

15

20

25

30

35

18.5 20.316.6 15.5

4.8

11.714.2

10.7

Trigger DAQ/HLT

FTE/

year

https://edms.cern.ch/document/1258042/1



trigger and online software simon george & reiner hauser t/daq phase 1 idr

Documents