27 February 2003 Wolfgang von Rüden, IT Update for Focus 1

Update on ongoing IT activities

FOCUS February 2003

Thanks to all contributors from IT groups

Wolfgang von Rüden

27 February 2003 Wolfgang von Rüden, IT Update for Focus 2

IT reorganization

• Reasons:– LCG established in 2002, adjustments needed– Successful creation of EP-SFT group, impact on IT-API

• Goals:– Optimize services related to CERN’s Tier 0 and Tier 1

role– Establish global services to support LCG world-wide– Streamline EDG – LCG– Prepare for EGEE proposal and transition

27 February 2003 Wolfgang von Rüden, IT Update for Focus 3

IT Divisional Management

• Division Leader’s Office (DLO):– Division Leader: Wolfgang von Rüden– Deputy Division Leader: Frédéric Hemmer– Divisional Planning Officer: Judy Richards– LCG Project Leader: Les Robertson

• Special Tasks:– EDG & EGEE Project Leader: Fabrizio Gagliardi

27 February 2003 Wolfgang von Rüden, IT Update for Focus 4

API moves to EP

• Motivation was to have all applications people working in one team and geographically together

• Apart from a few exceptions, all API people will move to EP-SFT and building 32

• Most resources move as well, some stay with the LCG project management

• Existing obligations, including to non-LHC experiments, move with the people

• Effective date is 1st March• Thanks to J. Knobloch and J. Harvey for the detailed

preparation and for the smooth transition

Big thanks to all API group members for the excellent work done in the previous years and

the acceptance to change Division.

All the best for the coming years.

27 February 2003 Wolfgang von Rüden, IT Update for Focus 5

Local Physics Services• Concerns all services related to the running of the farms

(lxplus, lxbatch, lxshare, disk servers, HSM services, …)• Ideally in one group, but would be too big (>50 people)• Two groups: ADC and FIO

– DS group is split between them– AFS and Castor development now in ADC– Data Services now in FIO– Monitoring (incl. EDG WP4) in FIO– O. Bärring takes over from J.-P. Baud as Castor project leader

Thanks to DS team for the running of important

services and multiple innovations.

Special thanks toJean-Philippe Baud

for the outstanding work done for Castor.

27 February 2003 Wolfgang von Rüden, IT Update for Focus 6

Architecture and Data Challenges Group (ADC)

• Group Leader: Bernd Panzer-Steindel• Deputy: Jan Iven• Sections:

– Linux Expertise (LE): Jan Iven (10)– Castor and AFS (CA): Rainer Többicke (7)– Openlab (OL): Sverre Jarp (3 + ?)

27 February 2003 Wolfgang von Rüden, IT Update for Focus 7

Fabric Infrastructure and Operations (FIO)

• Group Leader: Tony Cass• Deputy: Tim Smith• Sections:

– Data Services (DS): Harry Renshall (5)– Fabric Services (FS): Tim Smith (10)– Supervision & Monitoring (SM): Helge Meinhard (8)– Sys Admin & Operations (SAO): Vincent Doré (6 + n)

• Insourcing of System Management is under way, replacing the SERCo contract, initially 6 positions, funded via M->P.

27 February 2003 Wolfgang von Rüden, IT Update for Focus 8

Global Physics Services (LCG)

• Grid Deployment (GD) group created– Group Leader: Ian Bird– Deputy: Zdenek Sekera

• Sections:– Certification and Testing (CT): Zdenek Sekera (7+3)– Grid Infrastructure Support (GIS): Markus Schulz (3+4)– Experiment Integration and Support (EIS): Flavia Donno

(acting) (2+3)• Coordination of external grid deployment groups

and collaborative projects

27 February 2003 Wolfgang von Rüden, IT Update for Focus 9

Service changes and updates

27 February 2003 Wolfgang von Rüden, IT Update for Focus 10

CVS Service Status (PS)

• In production since last September, the following projects and sections use it – ANAPHE, NA48 analysis software, MammoGrid project

– Several AB division projects:

• Machine Component State Manager• GUI Platform project, Common Logging API• Java Data Viewer, Macsy• Java Api for Parameter Control

– IT/CO/BE, IT/FIO, CCDB (computer centre DB), IT/PS/UI • Working on a proposal to address the concern of

the LCG Architects Committee about the usage of AFS as underlying file system.

27 February 2003 Wolfgang von Rüden, IT Update for Focus 11

SUNDEV and CMS Disk Servers (PS)• SUNDEV upgraded to Solaris 8 last December

– Cleanup of system configuration– Fully automated system installation procedure to guarantee

uniformity of the nodes– To facilitate local scratch

• /pool/scratch interactive scratch space enabled• In memory (tmpfs) /tmp

– LSF night only queues available• CMS Disk Servers upgraded to Solaris 8 in order to

improve Gigabit ethernet performance– CMSC01 (Objy server) in December– SHIFT20 and SHIFT19 (Stager) during CASTOR shutdown in January– Cleaned system configuration– Cleaned DiskSuite configuration without loss of data

27 February 2003 Wolfgang von Rüden, IT Update for Focus 12

ODBMS Migration (DB)• COMPASS

– Bulk migration complete; dedicated drives returned; bad tapes / files being addressed together with COMPASS

– Some 290TB migration at up to 120MB/s• HARP

– Programs ported to RH7 and new(-er) compiler– Migration should start around now

• CHORUS– Will stay on RH6; no need for firewall (yet) but will take off

net if security issues until fixed• Plots (next) show increase in efficiency gained during the

migration (weeks 1, 5 & 12)

27 February 2003 Wolfgang von Rüden, IT Update for Focus 13

Oracle licensing & maintenance (DB)

[ from December ] • DB market survey new contract amendment

– Covers CERN staff & registered users– Deployment & support issues being worked out

• Licenses for Oracle DB & Application Server + Dev. Tools

• Based on ‘named users’ – not restricted to a server or site!

• Collaborator agreement similar to Objy• Currently preparing distribution kits

27 February 2003 Wolfgang von Rüden, IT Update for Focus 14

Oracle Distribution Kits (DB)• Oracle Installer based + ‘reply files’

– Oracle standard – reply files can be obtained through support– We will provide kits for:

• Client runtime; Client developer; ‘Canned’ server (e.g. for EDG-RLS application, conditionsDB etc.)

• N.B. Red Hat Advanced Server currently required!• RHAS has been successfully installed on CERN disk server, farm

node & desktop• Support Issues:

– All contact with Oracle through IT-DB– Concerns on support load (there is much more to support than

with Objy!)– Tier1 sites may (e.g. FNAL) already have or need their own

support cont(r)acts– Being discussed with Oracle HQ– (As is RHAS and many other issues…)

27 February 2003 Wolfgang von Rüden, IT Update for Focus 15

STK Silo Moves to 513 Basement (DS-FIO)• Symmetric splitting of tapes and drives into two separate robotic

clusters was completed last year with 5 new silos in building 613 and 5 in the ground floor machine room in building 513.

• For LHC computing layout low power and heat devices need to be concentrated in the 513 basement and the 5 silos and the associated infrastructure (networking, tape servers, cameras) will be moved there.

• They are in part of 513 to be cleared first so must be moved this year which means well before data taking starts in early June.

• We have arranged to rent 3 silos from STK to be installed in the basement during March. They will be equipped with newly purchased 9940B tape drives. They will run in parallel with the production service for several weeks and be used in a 1GByte/sec data challenge (IT “MD”).

• We have already taken cartridges out of the 513 silos to leave only 3 full so after the data challenge we will shutdown for 2-3 days and move the cartridges downstairs and switch the production load. STK will then move 2 more silos downstairs and take 3 back. We hope to complete by the end of April.

27 February 2003 Wolfgang von Rüden, IT Update for Focus 16

Various topics

• The migration to the new Mail infrastructure is proceeding steadily, with more than 1000 very active users who have migrated (IS).

• Phasing out TMS (FIO)– TMS decoupled from CASTOR (Easter)– TMS decoupled from FATMEN (mid-2003)– TMS switchoff (4 weeks after FATMEN change, latest

19/12/03)• Full implementation of managed storage (FIO)

– all disk servers to be managed by CASTOR by 19/12/03

27 February 2003 Wolfgang von Rüden, IT Update for Focus 17

Other major events• Council has endorsed new medium/long-term plan assuring

support for LHC computing. Missing funding for phase 1 discussed in details in POB, proposal will go to next C-RRB to held on 15 April 2003

• Proposed scenario is with big savings, implications on tape drive availability

• 2nd EDG Review– very positive feedback by reviewers– See Weekly Bulletin for details

• EU-Proposal for EGEE– Preparation progressing well– Encouragement from EU– Technical Advisory Board (TAB) established, chaired by

M.Kasemann, draft report under discussion. – Experiments are represented via LCG

• CERN openlab: IA-64 cluster (32 nodes) up and running