Summary and Discussion

Rüdiger Schmidt

Summary and discussions

Introduction

04/21/23Author – Review Commissioning

S452

• Thanks to all speakers for their presentations• Thanks to the audience for comments and discussions

• We are all aware of the progress, and understand what has been done

• Very few slides summarising the results

• Most slides are related to questions that were adressed, and reflects open issues to be followed up (my understanding)

• Some questions to be adressed in equipment groups • Many question that should be adressed in detail by MiniTeams

in particular those across groups / departements

The summary and the discussionThe follow-up by mini teamsThe reportThe implementation and the testing in the few weeks where we have one sector at a time

The deliverables

February 28th 2008

Roberto Saban – Review of the Commissioning of Sector 45

3

Achievements: Main Circuits at 6TeV (>10kA)

04/21/23B.Bellesia – Review Commissioning

S454

Squeezing test, including all main quadrupole magnets in matching section and dispersion suppressor

19 February 2008,15:00commissioning team

196 electrical circuits: test Steps

04/21/23B.Bellesia – Review Commissioning

S456

w9W8W6W4W2W5

2W50

W48

Succ

ess

ful te

st s

teps

Cry

o

Sta

rts

~60 test/wday

targets

procedure7TeV

DONE6TeV

Ack:

A. M

arq

ueta

V. Z

am

bra

no

Ack:

M. S

oubiran

procedure

targets

done

Main Circuits

74 67 92

IPQ-D 221 221 232

600A 688 520 503

120A 300 210 216

60A 282 94 232

Total 1565 1112 1275

The months to come

February 28th 2008

Roberto Saban – Review of the Commissioning of Sector 45

7

ICC February 15thICC February 15th

fewThe few months to come

Identification of main issues appearing during the commissioning Sector 45 R.Saban

04/21/23Author – Review Commissioning

S458

- Event driven by view from operation - invitation to an open discussion

- Scenarios: commissioning to 450 GeV, 2 TeV and 4 .. 6 TeV- Key dates in preparation for the next sector and outlook to planning- Discussions on improvements: what can be done in the next 3-4

weeks?- 2 shifts during 5 days versus 3 shifts during 7 days, , MPP analysis,

what can be done in a nightshift – WE? Bottlenecks in manpower- Organisation: HC coordinator on a weekly basis? For coordination

between sectors etc.- (written) guidelines for operators (coordination tools, conditions for

powering)- Commissioning meetings efficient? How continue activities during

meetings?- Follow-up by mini teams on: Automatic commissioning and controls

issues, Tools required to optimize commissioning, Organisation, System upgrades and improvements

04/21/23 9

• Sectors in parallel versus circuits in parallel MiniTeam• 7 TeV or lower? What energy? eLTC• Circuit commissioning to current for energy/optics?• MiniTeams

– Controls issues: managing tests, preparing SOCs, following progress, inteface with MTF

– Organisational issues, access and safety– Reporting, logging what happens, logbook, …– Powering groups of circuits

• Organisational issues: 2/3 shifts, weekend, Commissioning Coordinator on duty during one week (mandate?), MPP analysis

• Meetings effficient? MiniTeam• Help to EICs (guidelines, tools, reporting, passing info from

between shifts, …) MiniTeam• Liason with beam commissioning

R.Saban Summary and Issues

Powering Test OverviewB.Bellesia

04/21/23 10

- What happens before powering tests after cooldown- Main issues that slowed us down- ELQA: Continue as for sector 45? Further optimisation of the

strategy?- What has been done during the powering tests? During what

time? By whom? Efficiency?- How to ensure minimization of re-commissioning 45 and to

secure what has been achieved?- How to avoid that changes during the “shutdown” require re-

commissioning?

04/21/23 11

• Parameters for RCO to be checked tbd• Interlock tests on RB-RQD-RQF with cables connected – can it

be done for all circuits ? MiniTeam• All interventions should be know, but how to approve/trace

them? Clear strategy to be defined! No time to redo the entire commissioning HCC

• How avoid that circuits are powered above Imax if less then nominal? MiniTeam

B.Bellesia Powering Test Overview Summary and Issues

Safety and Access

A.Funken Safety and access I- Electrical safety during interventions, “consignation”- Electrical safety subsectors

M.Gruwe Safety and access II- Hardware commissioning using the access system- Set the rules for access, different modes

K.H.Mess + H.Thiesen Safety and access III- Tunnel access during powering – what can access during

powering as a function of current in the different circuits? Clear and transparent rules.

13

Anne Funken• “Authorisation de travail” if not given back stops progress• Two days of Thierry enough?• Analysis of 60A / 80-120A circuits all to be “consignee”? What about DFBA

to be “consignee” on both sides? WHO? MiniTeam?• How to make sure that access procedures are respected during powering?

M.Gruwe • Lot of progess, we need to learn using the access system, training planned,

documentation required and training for people accessing the tunnel• Mapping of access sectors to powering (sub-)subsectors• List of people in the access lists, how to manage it? Can we see it?• What about signs? To be included into procedures• Screen above access door will have some information• It is possible to create temporary permission for access (e.g. for one day,

takes 10 minutes)• One console for access (number of consoles / screens ?)• War map scales with sectors?

– several questions for MiniTeams on access/safety and on organisation

Safety and Access Summary and Issues

14

• RB and RQ above 1 kA, not access to tunnel• Others above 1 kA: sector split into two parts (Left-Right),

access depends on where powering takes place• How should the proposals be approved? HT / MPP / CRG

• Status of protection screens for DFB, in final design stage, to be installed after powering tests

• All people in tunnel have B0V/H0V? Should it be required to be included in the list for resticted access?

• Some tubes did not yet experience cold gas, possibly to be tested before hardware commissioning

• Strategy for fences (as proposed by Hugues) in front of DFB to be clarified– several questions for MiniTeam

H.Thiesen and K.H.Mess Safety and Access Summary and Issues

15

Cryogenics, DFBs and current leadsCryo Performance & Operation

S.Claudet

- Availability for cryogenic system- Magnet level measurements - DFB commissioning- Recovery time after quenches: what can we expect?- Operation overnight and over the weekend: is it possible?- Operation with several sectors in parallel, what will change?- Presence in the CCC

16

• Quench recovery for high current dipole quenches somewhat longer then prediced some years ago, improvements expected

• Y lines – still some non-conformities to be expected (cannot be seen at warm)

• Consolidation of valves for temperature control of line D• Some other consolidation planned (see Serges talk)• Air leak to circuits with sub atmospharic pressure – being adressed• Final anti-condensation system being installed for 56 and other

sectors• Problem with valves on DFBs: filters to be installed + spare valves tp

be made available• Range of acceptable temperature in DFBs CryoStart to be relaxed• Level gauge for stand-alone magnets: valves to be installed and

(possibly if needed) capillaries to be installed• Optimise cryogenic commissioning of stand-alone magnets, DFBs

and arcs (beam screen cooling loop to be operational early)

S.Claudet Cryo Performance & Operation Summary and Issues

17

• Organisation: possible to reach an expert from CRG also during late hours

• Every day activities: in local Cryo Control Room• Specific test: presence of expert in CCC• HC activities up to 22:00 and Saturdays should be possible• Future when N2 logistics finished: one operator during 2 shifts

in CCC (~end of April), with support from local Cryo Control Room

• Tools being prepared to help operators in Cryo Control Room• High availability of cryogenic system for beam operation is

required: being adressed, availability is expected to improve

S.Claudet Cryo Performance & Operation Summary and Issues

Powering, Power Converters, Quench Protection System, 600A and 13kA Energy Extraction

18

A.Siemko: Cryogenic conditions for powering tests- What can be done at what temperature? (e.g. below 2.8 K low

current tests), and when can we start the tests?- Relaxed operation at reduced current (e.g. can we operate

without cold compressors a magnet currents corresponding to 2 TeV)?

- Table for all steps and all circuits?- Orbit correctors 60 / 120 A – what conditions? - Procedure: masking of interlocks to provide CryoStart and

CryoMaintain- ElQA optimization

D.Nisbet / Y.Thurel: Power Converters - 600 A spikes during 0 V crossing and QPS system- Spikes and how to avoid them (IERROR and IEARTH)- RB power converter performance, is there an issue?

19

• New table for all steps and all circuits – reduced number of test steps• Five stages of crogenic conditions (1.9, 2.1, 2.5, 3.5 and 4.5K)• Scenario 5 to 6TeV: at 2.1K possible (preliminary) • Pressure is an important parameter, in particular for ElQA to possibly relax

conditions (ElQA constraint due to DFBs) Cryo Control Room MiniTeam? MPP?• 5-6 TeV: correctors up to 400 A, most below 200 A• CryoStart and CryoMaintain for other temperatures? MiniTeam• Further automation of PM analysis: high priority! MiniTeam• Scenario for operation at 5 TeV seems to be optimum

Other questions MiniTeam• How to make sure that the test results are correctly analysed and the circuit is

signed off?• How to ensure that a circuit with a non-conformity is not powered?• Who blocks and unblocks an electrical circuit?

A.Siemko Powering etc. Summary and Issues

Scenario 5 TeV to 6 TeV

04/21/23A. Siemko– Review Commissioning

S4520

-600

-400

-200

0

200

400

600

0 1 2 3 4 5 6 7 8

• Optics requirements for 600A circuits vs. energy (after M.Lamont)

• to be further looked at

• The 5 TeV “cut” sets the I_PNO at comfortable level.

21

• 60A: reliability looks good, some improments for operation around 0 A• 120A: RCBYHS4.L5B1 quenched in some conditions, being analysed• 600A

– operation at zero Volt produces distortion and trips QPS – filter on QPS to be tested during next tests, very difficult to do something about on the PO side. During commissioning it should be ok and not stop thte sequence

– Undulator inductance variation: LHC DB to include additional data?– Crow bar validation issue: improved software for analysis is required,

depending on the type of circuit MiniTeam• High current converters

– Issue on SigmaDelta ADC, spikes seen, improvement on the way– Apparent “Earth” fault: weak fuse

• Inner Triplet commissioning: new, needs to be taken seriously• PM and MTF: not easy to get data, e.g. for statistical analysis MiniTeam

Y.Thurel Powering etc. Summary and Issues

Quench Protection System, 600A and 13 kA Energy Extraction

22

R.Denz / K.Dahlerup-Petersen Quench Protection and Energy Extraction System

- Partial heater firing if switches do not open – yes/no?- Access to the tunnel for 600 A extraction switches, can be

optimised?- Firing heaters w/o current in the circuit – Why? EMC due to

other tests?- Closing switches for many circuits

23

600A– Much better performance (better inductance tables, improved

firmware)– Nonlinear filter developed to suppress spikes from zero crossing– Fast feeback still an issue: to be tested

Dipole magnets– Sometimes firing heaters after high dipole current ramp (not

considered as real problem)

Tests requiring presence in the field should have priority (idle time)– To be improved, in particular during RAT meetings– More realistic estimation of downtime

More flexibility for changing sequencer parameters

Some experienced people will leave 1st half of 2008 – must be replaced

Preparation of QPS must become transparent for LHC operation, being prepared

R.Denz Quench Protection Summary and Issues

24

600A– No non-conformities– Tunnel measurements are vital for long term stability of switch

gear (arc diagnostics)– Measurement at only one current, should take 3 hours if done

during one campaign– Macro software routine for closing switches under development

13 kA– RQ resistor showed too low resistance and needed repair, all others

have been check and are ok– Spurious trigger in the signal to fire part of heaters, maybe fire

heaters on lower number of magnets, still under discussion. For the time being, this back-up system not used

K.Dahlerup-Petersen Energy extraction Summary and Issues

25

• Adressing cabling erros– QF/QD interlock cable between and PC and PIC was

swapped at PIC side due to incorrect installation drawings (years ago), this is limited to sector45 and should not appear again

– Discharge loop for 13 kA wrong polarity circuits, 78 and 45 should be fixed now, for other sectors to be made sure that polarity is ok

– Individual powered quadrupoles, QPS cabling for current leads: the convention has been changed some time ago and was not propagated, to be considered for the next sectors (M.Zerlauth, D.Bozzini, V.Chareyre and R.Denz)

• Other issues– Global protection mechanism: resistors in current loop must

have correct values (has been corrected)

Quench Protection etc Summary and Issues

Powering tests

26

A.Vergara Time for commissioning versus objectives- 450 GeV, 2 TeV and 5 .. 6 TeV: what circuits at what current?

What can be left for later? (reit is always possible to bring in other circuits on the fly)

- How much time is required to commission for injection, for ~2 TeV, 4-6 TeV and 7 TeV? What could be gained? What circuits could be left out?

- When is tunnel access required? By whom? How to optimise it? What can be done without access to the tunnel?

27

• Testing took less time than planned, due to parallism and automatisation tools (sequencer, post-mortem, …)

Reducing the commissioning time• Simplification of test plans and avoid provoked quenches at nominal• ….however, we have to take care, no shortcuts related to protection• Commissioning to 5 TeV faster than to 7 TeV• Commissioning to 5 TeV not very different from, say, 2 TeV when

considering quenches• Commissioning to 2-3 TeV: more tolerant in case of technical problems

(e.g. cold compressor trips, …)• Commissioning to injection or 1 TeV: might be possible with electrical

non-conformities• For correctors: do everything that requires access to field early, and

then perform remote powering (progress outside working hours)

A.Vergara Powering tests Summary and Issues

Although there are no significant differences among the times needed to commissionthe machine at 1, 2, 3 or 5 TeV, the technical constraints may largely vary dependingon the energy chosen. This can be a key point if we want beam in the machine byJune 2008.

Powering tests and Magnet Performance Panel Powering tests and Magnet

W.Venturini / N.Catalan-Lasheras Procedures- Procedures and their realisation in sequences: can they be

lighter? - EDMS approval of procedures and their changes- Analysis and approval of test steps in CCC – can it be

improved?- Specifics for sectors

A.Verweij / B.Flora What quenches did we observe? What is expected?

- What circuits?- What quenches?- Why did it quench?

29

• Simplification while still secure commissioning– Type testing suppressed– Less approvals required

• I_PNO (nominal current) is a parameter that depends on energy and optics• RB and RQ ~30% of the steps suppressed• IPQ and IPD: quenches suppressed, less steps• 600A: less tunnel access and ~30% of the steps suppressed (tunnel access

for energy extraction measurements)

Looking at data and nonconformities• Unstructured PM data, difficult to find data MiniTeam• Tool of handing non-conformities is required MiniTeam

EDMS: modified procedures will be approved (modification of sequences)

• If I_PNO is lower than intermediate level - case by case – names (nominal)• Ramp speed dI/dt to be optimised

W.Venturini Procedures Summary and Issues

30

• Most quenches for at ~80-90% of nominal current (RB, RQ, IRmagnets)

• Some quenches below past first training quench• For 5 TeV: no quenches expected• For 6 TeV: a few quenches expected per sector• For 7 TeV: several ten quenches expected per sector

• For all quenches, the protection systems incuding PM, interlocks, … worked well

• Quench propagation is as expected (some 10 seconds)• Two cases: short propagation time not understood

A.Verweij Quenches Summary and Issues

Post-Mortem, Logging, Sequencer, Tracking data and progress after the tests

M.Zerlauth Tools provided by CO- Status of PM system? Data gets sometimes stuck?- PM event builder- Can we become more efficient with more automatic analysis?- Coherence MTF – LSA etc.- Long tests: can one reduce the time of the test online, for

example due to a long plateau? PASS TO THE NEXT STEP button.

- Managing powering: better SOC names to avoid confusion? SOCs per day?

- Tools for powering groups of circuits (based on SOCs?)

A.Marqueta Barbero Tools for coordination- How to improve the Powering Test Visualisation tool, etc.- How to improve the planning tool (EXCEL?) Can both be

merged?

32

• Sequencer and sequences– improved exception handling– better GUI for battery tests

• Post Mortem– properties to be send to sequences and MTF– infrastructure being upgraded next week (redundant and scalable

service)

• Event building– just about to upload data into database

• Powering interlocks– locking circuits is possible– 60 A power permit will be implemented

• Logging and measurement service– very good progress– performance might become an issue, improvement for March (major

upgrade)

M.Zerlauth Tools Summary and Issues

33

• Powering Group of Circuits– additional tools are required

• Working environment and organisation– standardise working environment (use of circuit synoptics)– training for these tools

• Set Of Circuits (SOCs)– could help to work more efficiently – proposal for using pre-defined

SOCs (naming convention)

• Coherency– inconsistent naming between procedures, sequences and MTF (more

effort into MTF) – is there a specification?

• Other issues– conscious signing of tests

Follow-up by SACEC (see link in Markus presentation) and by MiniTeams: Priorities required

M.Zerlauth Tools Summary and Issues

34

• Tool to show Status/Progress of powering tests– ideas for improvement– extension of the tool could be also used for planning– several other ideas for upgrade

• Follow-up of non-conformities from MTF– browser existing, to be used

• Use of MTF … and other data sources MiniTeam– one needs to access data…. that are clearly defined in the

procedures– data acquired during test is not easily accessible– issue for parameters that need to be provided by experts– report from MTF can be (easily) created

A. Alvaro Marqueta Barbero Tools Summary and Issues

35

• Functional access system is needed• Wap Map should be used and extended MiniTeam• Locking/Blocing circuits MiniTeam• Initial sign-off before powering, how? MiniTeam• No running of powering tests remotely MiniTeam• Software (see Markus presentation)• Flag non-conformities MiniTeam• Overview of the test (Alvaros tool very useful)• Circuit synoptics for 60 A – temperatures?• PM analysis sign-off MiniTeam

– improved tool, to be used (comments)– streamlining of procedurs

• Automatic entries in logbook? MiniTeam• Sequence failed: better comments

A.MacPherson Feedback by LHC HWC Operators Summary and Issues

36

• Sequencer to be careful with MD mode• Cross check prior to powering – parameters to be clarified (e.g.

current lead temperatures)• Limit number of people in CCC- LHC island• Documentation to be updated• HC coordinator? • Reporting and planning (to be agreed and followed during the

tests)• Shifts: several comments and proposals to be digested and

followed up (working hours, number of people, …)

A.MacPherson Feedback by LHC HWC Operators Summary and Issues