installation and configuration of a gilda pnp ui

12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORSFP6−2004−Infrastructures−6-SSA-026409

www.eu-eela.org

E-infrastructure shared between Europe and Latin America

Installation and Configuration of a Gilda PnP UIRichard Miguel San Martín

SENAMHI – Perú

12th EELA Tutorial

Lima, 24-28 September,2007


System requirements

• Distributions– Fedora Core 2/3/4

– Scientific Linux 3.0.x

– Suse 9.x – 10.x (with some slight modifications)

– Mandrake 9.2

– Debian

• NO root privileges is required• Date and time of the system must be correct!• You should make sure some port are opened. The list of the

needed ports can be found here:– http://lcgdeploy.cvs.cern.ch/cgi-bin/lcgdeploy.cgi/*checkout*/lcg2/docs/lcg-

port-table.pdf

• A X509 personal certificate and a successfully join request to a Virtual Organization

12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007 2


Installation Step by Step

• Create user limaxx on the SL virtual machine– $useradd limaxx– $passwd limaxx

• Password: GridLIMxx• XX is the machine number • Login with user limaxx• Verify the right time

– $ntpdate -s -sb -p 8 -u cefiro.pucp.edu.pe

• Verify permission of certificates in .globus directory – userkey.pem file(400 permissions) in $HOME/.globus– usercert.pem file (600 permission) in $HOME/.globus



Installation Step by Step

• $ wget http://lima01.ring.pucp.edu.pe/gildaUI/gilda-UIPnP30.tar.gz --no-check-certificate

• $ tar zxvf gilda-UIPnP30.tar.gz

• $ cd ./UIPnP30

• $ source install.sh

Your UI Gilda PnP is ready for to be used !!!!



What install.sh does?

• Downloads CA certificates, Signing Policy, CRLs, if needed

• Creates the .globus directory (where you have to upload your personal certificates)

• Creates the JobOutput directory (where the output of your jobs will be stored)

• Sets all the relevant environment variables in .bashrc

• Sets a cron job to update the CRL’s periodically



Configuration of UI

In $HOME/UIPnP30/glite/etc/, $HOME/UIPnP30/edg/etc/, you can edit the file: glite_wmsui_cmd_var.conf

Change the values in : DefaultVo and OutputStorage

[

requirements = other.GlueCEStateStatus == "Production" ;

rank = - other.GlueCEStateEstimatedResponseTime ;

RetryCount = 3 ;

ErrorStorage= "/tmp" ;

OutputStorage="~/JobOutput";

ListenerStorage = "/tmp" ;

LoggingTimeout = 30 ;

LoggingSyncTimeout = 30 ;

.

.

.

DefaultLogInfoLevel = 1;

DefaultVo = "gilda";

]


DefaultVo: default VO OutputStorage: default output folder of all jobs


Configuration of UI

In HOME/UIPnP30/glite/etc/gilda/glite_wmsui.conf /, file:[

VirtualOrganisation = "gilda";

HLRLocation = "";

NSAddresses = {

"glite-rb.ct.infn.it:7772"

};

LBAddresses = {

{"glite-rb.ct.infn.it:9000"}

};

MyProxyServer = "grid001.ct.infn.it";

]


In this file you define :

•The VO name•Hostname and port of the following servers:

Resource BrokerLogging&Bookkeeping MyProxy


Gilda PnP UI testing

create a proxy:

voms-proxy-init --voms gilda

You should get something like this:


Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=LIMA/CN=LIMA41/[email protected] GRID pass phrase:Creating temporary proxy ........................................ DoneContacting voms.ct.infn.it:15001 [/C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it] "gilda" DoneCreating proxy .......................................................... DoneYour proxy is valid until Wed Sep 26 12:11:56 2007

Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=LIMA/CN=LIMA41/[email protected] GRID pass phrase:Creating temporary proxy ........................................ DoneContacting voms.ct.infn.it:15001 [/C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it] "gilda" DoneCreating proxy .......................................................... DoneYour proxy is valid until Wed Sep 26 12:11:56 2007


Testing: Check for job matching

• Create a jdl file : (example)

Type = "Job";

JobType = "Normal";

Executable = "/bin/hostname";

StdOutput = "hostname.out";

StdError = "hostname.err";

OutputSandbox = {"hostname.err","hostname.out"};

Arguments = "-f";

$ edg-job-list-match hostname.jdl


Selected Virtual Organisation name (from proxy certificate extension): gildaConnecting to host glite-rb.ct.infn.it, port 7772

*************************************************************************** COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found:

*CEId* ce-nano-37.to.infn.it:2119/jobmanager-lcgpbs-infinite ce-nano-37.to.infn.it:2119/jobmanager-lcgpbs-long ce-nano-37.to.infn.it:2119/jobmanager-lcgpbs-short gilda-ce-01.pd.infn.it:2119/jobmanager-lcgpbs-short gilda01.ihep.ac.cn:2119/jobmanager-lcgpbs-infinite iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-long iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-short gilda01.ihep.ac.cn:2119/jobmanager-lcgpbs-short***************************************************************************

Selected Virtual Organisation name (from proxy certificate extension): gildaConnecting to host glite-rb.ct.infn.it, port 7772

*************************************************************************** COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found:

*CEId* ce-nano-37.to.infn.it:2119/jobmanager-lcgpbs-infinite ce-nano-37.to.infn.it:2119/jobmanager-lcgpbs-long ce-nano-37.to.infn.it:2119/jobmanager-lcgpbs-short gilda-ce-01.pd.infn.it:2119/jobmanager-lcgpbs-short gilda01.ihep.ac.cn:2119/jobmanager-lcgpbs-infinite iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-long iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-short gilda01.ihep.ac.cn:2119/jobmanager-lcgpbs-short***************************************************************************


Testing: Job submission

• edg-job-submit --vo gilda hostname.jdl


Selected Virtual Organisation name (from --vo option): gildaConnecting to host glite-rb.ct.infn.it, port 7772Logging to host glite-rb.ct.infn.it, port 9002

********************************************************************************************* JOB SUBMIT OUTCOME The job has been successfully submitted to the Network Server. Use edg-job-status command to check job current status. Your job identifier (edg_jobId) is:

- https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ

*********************************************************************************************

Selected Virtual Organisation name (from --vo option): gildaConnecting to host glite-rb.ct.infn.it, port 7772Logging to host glite-rb.ct.infn.it, port 9002

********************************************************************************************* JOB SUBMIT OUTCOME The job has been successfully submitted to the Network Server. Use edg-job-status command to check job current status. Your job identifier (edg_jobId) is:

- https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ

*********************************************************************************************


Testing: Job Status

• edg-job-status https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ


*************************************************************BOOKKEEPING INFORMATION:

Status info for the Job : https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQCurrent Status: Done (Success)Exit code: 0Status Reason: Job terminated successfullyDestination: grid010.ct.infn.it:2119/jobmanager-lcgpbs-infinitereached on: Wed Sep 26 05:34:07 2007*************************************************************

*************************************************************BOOKKEEPING INFORMATION:

Status info for the Job : https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQCurrent Status: Done (Success)Exit code: 0Status Reason: Job terminated successfullyDestination: grid010.ct.infn.it:2119/jobmanager-lcgpbs-infinitereached on: Wed Sep 26 05:34:07 2007*************************************************************


Testing: Job get Output

• edg-job-get-output https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ


Retrieving files from host: glite-rb.ct.infn.it ( for https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ )

********************************************************************************* JOB GET OUTPUT OUTCOME

Output sandbox files for the job: - https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ have been successfully retrieved and stored in the directory: /home/lima41/JobOutput/lima41_48JTceTQDIdFeG1ZB_l6nQ

*********************************************************************************

Retrieving files from host: glite-rb.ct.infn.it ( for https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ )

********************************************************************************* JOB GET OUTPUT OUTCOME

Output sandbox files for the job: - https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ have been successfully retrieved and stored in the directory: /home/lima41/JobOutput/lima41_48JTceTQDIdFeG1ZB_l6nQ

*********************************************************************************


Testing: LFC Catalog

•Set the following environment variables to specify the catalog type and its location:

export LCG_CATALOG_TYPE=lfcexport LFC_HOST=lfc-gilda.ct.infn.itexport LFC_HOME=/grid/gilda/

•$ lfc-ls –l


[lima41@lima41 lima41]$ lfc-ls -l-rw-rw-r-- 1 196 102 13499 Jul 12 07:08 .bash_history-rw-rw-r-- 1 467 102 603 Jul 06 2006 .bash_profile-rw-rw-r-- 1 196 102 3169 Jul 12 07:02 .bashrcdrwxrwxr-x 0 714 102 0 Sep 19 2006 007guy-rw-rw-r-- 1 837 102 14690244 Nov 23 2006 0476e601-a838-4b72-9508-94b887967301-rwxrwxr-x 1 378 102 817 Jun 23 2006 04ad08fb-b26e-4b2f-8492-d9101069e081-rwxrwxr-x 1 585 102 642 Aug 28 2006 04db3c38-3d61-4858-be5e-8fec7245c83b-rwxrwxr-x 1 378 102 8263998 Jun 26 2006 06085e4b-8944-48da-8a50-e723f0bc584b-rw-rw-r-- 1 399 102 7031793 Jul 02 2006 06d2f3cd-2043-48a7-931c-eae6f2b5c120-rw-rw-r-- 1 430 102 1893 Jul 05 2006 06e77989-ff51-435c-a30a-152b42ea7b80-rw-rw-r-- 1 399 102 5435239 Jul 05 2006 08b338b7-80da-497c-a0d1-cffe451d8e1b-rw-rw-r-- 1 837 102 6460491 Nov 22 2006 0b5dc765-2a5a-4523-9def-f75c802726

[lima41@lima41 lima41]$ lfc-ls -l-rw-rw-r-- 1 196 102 13499 Jul 12 07:08 .bash_history-rw-rw-r-- 1 467 102 603 Jul 06 2006 .bash_profile-rw-rw-r-- 1 196 102 3169 Jul 12 07:02 .bashrcdrwxrwxr-x 0 714 102 0 Sep 19 2006 007guy-rw-rw-r-- 1 837 102 14690244 Nov 23 2006 0476e601-a838-4b72-9508-94b887967301-rwxrwxr-x 1 378 102 817 Jun 23 2006 04ad08fb-b26e-4b2f-8492-d9101069e081-rwxrwxr-x 1 585 102 642 Aug 28 2006 04db3c38-3d61-4858-be5e-8fec7245c83b-rwxrwxr-x 1 378 102 8263998 Jun 26 2006 06085e4b-8944-48da-8a50-e723f0bc584b-rw-rw-r-- 1 399 102 7031793 Jul 02 2006 06d2f3cd-2043-48a7-931c-eae6f2b5c120-rw-rw-r-- 1 430 102 1893 Jul 05 2006 06e77989-ff51-435c-a30a-152b42ea7b80-rw-rw-r-- 1 399 102 5435239 Jul 05 2006 08b338b7-80da-497c-a0d1-cffe451d8e1b-rw-rw-r-- 1 837 102 6460491 Nov 22 2006 0b5dc765-2a5a-4523-9def-f75c802726


Testing Resource Discovery: BDII

export PERL5 LIB=$PERL5LIB:/home/lima41/UIPnP30/lcg/sft/lib/perl/


To find out which SEs the user is allowed to use, one can use the following command: $

$ lcg-infosites --vo gilda se

[lima41@lima41 lima41]$ lcg-infosites --vo gilda se

Avail Space(Kb) Used Space(Kb) Type SEs----------------------------------------------------------63550000 10520000 n.a egee016.cnaf.infn.it324080000 48428868 n.a aliserv6.ct.infn.it7142988 2425464 n.a trigriden01.unime.it69169736 2576304 n.a se-nano-38.to.infn.it54450000 3550000 n.a iceage-se-01.ct.infn.it91090000 5030000 n.a gilda04.ihep.ac.cn885548728 26858688 n.a grid005.iucc.ac.il19038976 554880 n.a gn0.hpcc.sztaki.hu

[lima41@lima41 lima41]$ lcg-infosites --vo gilda se

Avail Space(Kb) Used Space(Kb) Type SEs----------------------------------------------------------63550000 10520000 n.a egee016.cnaf.infn.it324080000 48428868 n.a aliserv6.ct.infn.it7142988 2425464 n.a trigriden01.unime.it69169736 2576304 n.a se-nano-38.to.infn.it54450000 3550000 n.a iceage-se-01.ct.infn.it91090000 5030000 n.a gilda04.ihep.ac.cn885548728 26858688 n.a grid005.iucc.ac.il19038976 554880 n.a gn0.hpcc.sztaki.hu


References

• UI PnP GILDA Web site:https://gilda.ct.infn.it/UIPnP/

• gLite 3.0 User guide:http://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/index.cgi?var=eis/docs


installation and configuration of a gilda pnp ui

Documents