FP6−2004−Infrastructures−6-SSA-026409

www.eu-eela.org

E-infrastructure shared between Europe and Latin America

SRM + gLite IO Server install

Emidio Giorgio

INFN Catania

First EELA Grid Tutorial for user and system administrators

Madrid, 21.02.2006

First EELA Grid Tutorial for user and system administrators 2FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

SRM + gLite IO server

• IO server is the gLite component in charge of handling user input-output request

• gLite IO server relies against a Mass Storage System implementing SRM interface

• gLite IO server comunicates with MSS through SRM• Tested MSS are CASTOR, dCache and DPM• So to use gLite IO you need an SRM too ! • Further details on DPM

– https://uimon.cern.ch/twiki/bin/view/LCG/DpmAdminGuide

First EELA Grid Tutorial for user and system administrators 3FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Dpm installation

First EELA Grid Tutorial for user and system administrators 4FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Installing DPM via apt

1. Verify if apt is present:– rpm -qa | grep apt– Install apt if necessary:

rpm -ivh http://linuxsoft.cern.ch/cern/slc30X/i386/SL/RPMS/apt-0.5.15cnc6-8.SL.cern.i386.rpm

2. Add gLite apt repository:– Put one of the following lines in a file (e.g. glite.list) inside the

/etc/apt/sources.list.d directory – rpm http://glitesoft.cern.ch/EGEE/gLite/APT/R1.5/ rhel30 externals

Release1.5 updates 3. Update apt repository:

– apt-get update – apt-get dist-upgrade

4. Install DPM server:– apt-get install glite-dpm-disk-server-config – apt-get install glite-dpm-server-mysql-config

Extra packages needed (non freely distributable) :

• J2SE v 1.4.2_08 JRE: http://java.sun.com/j2se/1.4.2/download.html

See http://glite.web.cern.ch/glite/packages/APT.asp

First EELA Grid Tutorial for user and system administrators 5FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

• Request host certificates for the box– https://gilda.ct.infn.it/CA/mgt/restricted/srvreq.php

• Copy host certificate (hostcert.pem and hostkey.pem) in /etc/grid-certificates.– chmod 644 hostcert.pem– chmod 400 hostkey.pem

• If planning to use certificates released by unsupported EGEE CA’s, be sure that their public key and CRLs (usually distributed with an rpm) are installed.– CA GILDA ones are available from https://gilda.ct.infn.it/RPMS/ca_GILDA-0.28.1.i386.rpm

Preliminary

First EELA Grid Tutorial for user and system administrators 6FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

gLite configuration – short reminder

• Configuration files– XML format– templates provided in /opt/glite/etc/config/templates

• Hierarchy of configuration file– Global configuration file– service specific configuration files

• Parameter groups– User parameters (‘changeme’)– Advanced parameters– System parameters

First EELA Grid Tutorial for user and system administrators 7FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Configuration

• Configuration comes through the execution of pyhton scripts, which takes as input xml files.

• So services have to be configured by editing these xml files

• Xml files are provided as templates, under /opt/glite/etc/config/templates

• Copy templates file to /opt/glite/etc/config

glite-dpm-server.cfg.xml glite-rgma-gin.cfg.xml

glite-global.cfg.xml glite-rgma-servicetool.cfg.xml

glite-dpm-disk-server.cfg.xml

glite-rgma-common.cfg.xml glite-security-utils.cfg.xml

vo-list.cfg.xml

First EELA Grid Tutorial for user and system administrators 8FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Other cfg.xml

• vo-list.cfg.xml– Fill with the information on the VO (VOMS) that the services will

support.• glite-rgma-common.cfg.xml

– Set the RGMA-server name(s) • glite-rgma-servicetool.cfg.xml

– Just the machine FQDN name on rgma.servicetool.sitename attribute

• glite-global.cfg.xml – General aspects. Typically just the JAVA_HOME attribute needs to

be changed, put in the location of your JVM

• glite-rgma-gin.cfg.xml– “NO” for both the attributes

• glite-security-utils.cfg.xml– Just set the cron.mailto attribute value

First EELA Grid Tutorial for user and system administrators 9FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

glite-dpm-disk-server.cfg.xml

• Provides configuration for the DPM clients (gsiftp, rfio)• An instance of dpm-disk-server must be running on

each machine exporting disk space• Preliminary

– Each “piece” of fs we want to export must stay on a separate partition, owned by the user running DPM client services

– So create a separate partition on filesystem– See command history for details

Key values : dpm-server.host : set to the DPM server FQDN (itself in this configuration)

dpns-server.host : set to the DPNS server FQDN (itself in this configuration)

Now we need to configure the DPM server…….

First EELA Grid Tutorial for user and system administrators 10

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

glite-dpm-server.cfg.xml

• Key values

– db.type mysql (don’t set root password and be sure that mysql server hasn’t…)

– disk-server.list : fill with list of disk server which are exporting filesystems (the box itself in this case)

– io-server.voname : name of vo in the IO server this DPM will support

– io-server.hostname : put the name of the machine which will run the IO server relying on this DPM (the box itself in this case)

– io-server.certificate.subject : the subject of IO server host certificate

First EELA Grid Tutorial for user and system administrators 11

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Commit configuration

• Once edited xml files, commit configuration for both disk-server and DPM server– cd /opt/glite/etc/config/scripts– ./glite-dpm-disk-server-config.py –-configure– ./glite-dpm-server-config.py –-configure– ./glite-dpm-server-config.py –-start– ./glite-dpm-disk-server-config.py –start

First EELA Grid Tutorial for user and system administrators 12

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Post configuration

• DPM server and disk-server are now running, but they are not exporting any part of filesystem

• We have to build the DPNS namespace, with the right permissions – dpns-mkdir– dpns-chmod– dpns-chown– dpns-setacl

• We should make aware DPM clients of which disk space they have to export– dpm-addfs– dpm-addpool

• The disk portion we’ll export should stay on a separate partition owned by the user running dpm (dpmmgr usually)

• See related history for deep details !

First EELA Grid Tutorial for user and system administrators 13

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

IO server Installation

First EELA Grid Tutorial for user and system administrators 14

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Installing gLite IO server via apt

1. Verify if apt is present:– rpm -qa | grep apt– Install apt if necessary:

rpm -ivh http://linuxsoft.cern.ch/cern/slc30X/i386/SL/RPMS/apt-0.5.15cnc6-8.SL.cern.i386.rpm

2. Add gLite apt repository:– Put one of the following lines in a file (e.g. glite.list) inside the

/etc/apt/sources.list.d directory – rpm http://glitesoft.cern.ch/EGEE/gLite/APT/R1.4/ rhel30 externals

Release1.4 updates 3. Update apt repository:

– apt-get update – apt-get dist-upgrade

4. Install DPM server:– apt-get install glite-io-server-config

Extra packages needed (non freely distributable) :

• J2SE v 1.4.2_08 JRE: http://java.sun.com/j2se/1.4.2/download.htmlSee http://glite.web.cern.ch/glite/packages/APT.asp

First EELA Grid Tutorial for user and system administrators 15

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

• Request host certificates for the box– https://gilda.ct.infn.it/CA/mgt/restricted/srvreq.php

• Copy host certificate (hostcert.pem and hostkey.pem) in /etc/grid-certificates.– chmod 644 hostcert.pem– chmod 400 hostkey.pem

• If planning to use certificates released by unsupported EGEE CA’s, be sure that their public key and CRLs (usually distributed with an rpm) are installed.– CA GILDA ones are available from https://gilda.ct.infn.it/RPMS/ca_GILDA-0.28.1.i386.rpm

Preliminary

First EELA Grid Tutorial for user and system administrators 16

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Configuration

• Configuration comes through the execution of pyhton scripts, which takes as input xml files.

• So services have to be configured by editing these xml files

• Xml files are provided as templates, under /opt/glite/etc/config/templates

• Copy templates file to /opt/glite/etc/config

glite-global.cfg.xml glite-rgma-servicetool.cfg.xml

glite-io-server.cfg.xml

glite-rgma-common.cfg.xml glite-security-utils.cfg.xml

First EELA Grid Tutorial for user and system administrators 17

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Other cfg.xml

• glite-rgma-common.cfg.xml– Set the RGMA-server name(s)

• glite-rgma-servicetool.cfg.xml– Just the machine FQDN name on rgma.servicetool.sitename

attribute

• glite-global.cfg.xml – General aspects. Typically just the JAVA_HOME attribute needs to

be changed, put in the location of your JVM

• glite-security-utils.cfg.xml– Just set the cron.mailto attribute value

First EELA Grid Tutorial for user and system administrators 18

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

glite-io-server.cfg.xml

• VO instance section(s) : for each VO served, need to configure an instance– init.CatalogType (fireman)– io-resolve-common.SeHostname (the name of SRM box)– io-resolve-common.SrmEndPoint SRM endpoint– io-resolve-common.RootPath DPNS namespace for the VO– io-resolve-common.SeProtocol rfio – io-authz-fas.FasEndpoint endpoint of Fireman catalogue– io-resolve-fireman.FiremanEndpoint = FasEndpoint– io-daemon.Port (< 9999)

• General section : service parameter (uid, gid)– init.username init.groupname uid—gid

First EELA Grid Tutorial for user and system administrators 19

FP6−2004−Infrastructures−6-SSA-026409

E-infrastructure shared between Europe and Latin America

Post configuration

• Before committing configuration, is better to check the gridmap file is filled

• Put on /opt/glite/etc/glite-mkgridmap.conf a line for each served VO

• The vo users will be mapped so to the user running IO daemons

/opt/glite/etc/config/scripts/mkgridmap.py./glite-io-server-config.py --configure./glite-io-server-config.py --start

• Enjoy !

group vomss://voms.ct.infn.it:8443/voms/gilda?/gilda gliteio