report on cvs services : central and lcg-dedicated services [email protected]...

Report on CVS Services:

Central and LCG-dedicated services

[email protected]@cern.ch

CERN IT/PS/UI

May 2004

Report on CVS Services – S. Lopienski, M. Guijarro, (CERN IT/PS/UI) – May 2004

Outline• Overview• Projects• What do they offer?• Architectures• Advantages• Drawbacks• Implementation• Figures• Problems• Future


CERN CVS Services

Overview

• hosting CERN-related software projects• Central CVS service: created following a service request

- collection of user requirements- architecture proposals- implementation based on assigned resources- in production since 08/2002, 71 projects and 12GB of data

• LCG dedicated CVS service: requested not to rely on AFS- aligns, as much as possible, with Central CVS service setup- in production since 02/2004, 22 projects and 1.5GB of data


CERN Central CVS Service

Projects•AB-CO FPGA designs•AB-RF-CS Section Software•Anaphe•AtCom II•ATLAS•ATLAS TDAQ RobIn•ATLAS Networking •Automatic Driver Code Generation•BIC surveillance project•CASTOR project•CCDB•CERN Central CVS Service•CERN Fire and Gas detection•CERN Oracle Grid Data Management Services•CERN Safety Alarm Monitoring•CESAR Project•Chorus (W95) experiment•Compass Reconstruction Program

•Computer Centre - Operational Procedures Management • CSDB project • Cyan Jaguar•Diana Network device information analysing and monitoring Project•EDG Project at CERN•EGEE Middleware SCM Tools•EJB Platform Project•ELFms Extremely Large Fabric Management•Front End Software Architecture•Ganga – Gaudi/Athena and Grid Alliance•Gaudi•GridSite•GUI Platform project•HEPiX scripts•IT-FIO software•IT-PS-UI software

•Itcobe•Java Api for Parameter Control•Java Data Viewer•LCG Oracle AS + DB Tier 1 Deployment•LHC Alarm Service Project•LHC Logging Project •LHC Orbit feedback•LHCb software•Machine Component State Manager•Macsy•MammoGrid project•Middle Tier Server for CMW•NA48 analysis software•NA60 Offline Project•OASIS software•OPERA project•PHOS Trigger Router Unit•...


CERN CVS Services

What do they offer?

• data integrity (mirror every hour, daily archiving)• several access methods: Kerberos IV, SSH, pserver• automatic CVS lock monitoring and reporting• good performance• web user interfaces (CVSWeb, ViewCVS, Bonsai); • administration tools: Project creation, Access

restrictions, • service support (200 Remedy trouble tickets per

year + Web documentation)• service monitoring (UIMON, CVS access check,

Archiving check,…)


ArchitecturesCentral Service vs LCG Service

repositories

X.cvs.cern.ch

Project X

1 2 N

servers


AdvantagesCentral Service vs LCG Service

• fastest possible access to the repositories (local file system)

• independent of AFS

• automatic and transparent load-balancing and fault tolerance (via an ISSCVS DNS alias that distributes CVS requests among a farm of four servers)


DrawbacksCentral Service vs LCG Service

• dependency on AFS and DNS

• constant mirroring may affect performance

• load-balance is on repository level (not request level)

• slave server down => no fault tolerance

• fail-over requires human intervention (for the time being)


ImplementationCentral Service vs LCG Service

• DNS relocation via ISSCVS• ISSCVS: A central service

queries some home made metrics in each CVS server

• Redirects every 30 secs• Metrics: SSH SNMP• For more info: V. Bahyl• AFS (NFS?)• automatic AFS volume

resizing (adapt to each repository needs).

• tools and web interfaces for project relocation (via DNS)

• CVS domain cvs.cern.ch• data replication system

(CVSUP)• access to repositories and

user home directorieson a file-system level via NFS

• automatic relocation not wanted


FiguresCentral Service vs LCG Service

• 71 projects• 4 new projects per month• Ave. Size= 170MB• Top. Size > 4GB• less than 12 hours/year

downtime

• 22 projects• Not growing• Ave. Size= 70MB• Top. Size > 270MB• less than 12 hours/year

downtime


# of projects trend

0

10

20

30

40

50

60

70

May

'03

J ul

'03

Sep

'03

Nov

'03

J an

'04

Mar

'04

May

'04

CENTRAL

LCG


Not so many problems

• disk failures:- some Western Digital 120GB disks models were

faulty- backplane installation (less vibration)

• computer centre:- refurbishment (relocation of servers)- power cuts- several short network interruptions (mainly at non-

working hours)

• partial interruptions: CERN firewall, AFS problems - affecting only some users


Future

• provide Kerberos V access (CERN soon ready)• slave server relocation for LCG• hardware update (some nodes are 5 years old)• automatic detection of inactive projects • migrate monitoring from UIMON->Lemon• ¾ of service manpower will disappear => no more

dev.


Thank you!

Any questions?

More information at:http://cern.ch/cvshttp://cern.ch/lcgcvs

report on cvs services : central and lcg-dedicated services [email protected]...

Documents

cern itpsui

central cvs service

cvs requests

monitoring project edg

project creation

cvs access check

service support

lcgdedicated services