bob jones – project architecture - 1 march 2002 - n° 1 information & monitoring services...
TRANSCRIPT
Bob Jones – Project Architecture - 1 March 2002 - n° 1
Information & MonitoringServices
Antony Wilson
WP3, RAL
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 2
Introduction
information systems – LDAP (Lightweight Directory Access Protocol)
Ftree Globus MDS
information providers RPMs configuration
starting ftree
configuration of the GRIS/GIIS registration
starting Globus MDS
example searches
summary
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 3
LDAP Information Systems
2 configuration files /etc/edg/info-mds.conf /etc/globus.conf
info-mds.conf configuration of the information providers
globus.conf configuration of Globus MDS
includes registration details
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 4
Information Providers - RPMs
configuration edg-info-main-*.i386.rpm
computing element information provider CEInformationProviders-*.i386.rpm
netmon information provider edg-info-netmon-*.i386.rpm
storage element information provider edg-info-se-*.i386.rpm
replica catalogue information provider edg-info-rc-*.i386.rpm
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 5
Information Providers - Configuration
configuration via /etc/edg/info-mds.conf generic information site information provider computing element information provider netmon information provider storage element information provider replica catalogue information provider
static data via /opt/edg/info/mds/etc/ldif/*.ldif computing element replica catalogue
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 6
info-mds.conf - Generic
WP3_DEPLOY=/opt/edg/info/mdsFTREE_INFO_PORT=2171FTREE_DEBUG_LEVEL=0
# the default value is "Mds-Vo-name=local,o=grid“SITE_DN=Mds-Vo-name=local,o=grid
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 7
info-mds.conf - Site
Note this is usually combined with computing element
SITE_INFO=yesSITE_NAME=RALSITE_INSTALLATION_DATE=20011115123410ZSITE_SYSADMIN_CONTACT=grid.sysadmin@gridpp.rl.ac.ukSITE_USER_SUPPORT_CONTACT=grid.support@gridpp.rl.ac.ukSITE_SECURITY_CONTACT=grid.security@gridpp.rl.ac.ukSITE_DATAGRID_VERSION=1SITE_NETMON_HOST=gppnetmon.gridpp.rl.ac.uk
# comma separated list with no spacesSITE_SE_HOSTS=gppse05.gridpp.rl.ac.uk
# comma separated list with no spacesSITE_CE_HOSTS=gppce05.gridpp.rl.ac.uk
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 8
info-mds.conf – Computing Element
CE_PRESENT=yesCE_HOST=gppce05.gridpp.rl.ac.ukCE_BATCHSYSTEM=pbsCE_CLUSTER_BATCH_SYSTEM_BIN_PATH=/usr/pbs/bin
# comma separated list with no spacesCE_QUEUE=workq
# comma separated list with no spacesCE_CLOSE_SE_ID=gppse05.gridpp.rl.ac.uk
# comma separated list with no spaces, these values must relate to the corresponding CLOSE_SE_ID
CE_CLOSE_SE_MOUNT_POINT=data
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 9
info-mds.conf – Netmon
This will be changing in the next release
This is also usually combined with computing element
NETMON_PRESENT=yesNETMON_PINGER_HOST=gppnetmon.gridpp.rl.ac.uk
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 10
info-mds.conf – Storage Element
SE_PRESENT=yesSE_ID=gppse05.gridpp.rl.ac.ukSE_SIZE=500000SE_CONTACT=grid.support@gridpp.rl.ac.ukSE_TYPE=disk
# comma separated list with no spaces, this is a list of Vos supported by the SE
SE_VO=alice,atlas,biomedical,cms,earthob,lhcb
# comma separated list with no spaces, values used in df to obtain freespaceSE_FILESYSTEMS=/dev/hda2,/dev/hda4
# comma separated list with no spacesSE_CLOSE_CE=gppce05.gridpp.rl.ac.uk:2119/jobmanager-pbs-workq
# comma separated list with no spacesSE_PROTOCOLS=gridftp,rfio,file
# comma separated list with no spaces, these values must relate to the corresponding SE_PROTOCOLS
SE_PROTOCOL_PORTS=2811,3147,
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 11
info-mds.conf – Replica Catalogue
RC_PRESENT=yesRC_HOST=gpprc05.gridpp.rl.ac.uk
# comma separated list with no spacesRC_VO=alice,atlas,biomedical,cms.earthob,lhcb
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 12
Static Information – Computing Element
makes use of static information /opt/edg/info/mds/etc/ldif/ce-static.ldif
this will be changing to /opt/edg/etc/info/mds/ce-static.ldif
ldif file can be customized for a queue /opt/edg/info/mds/etc/ldif/ce-static-queuename.ldif
Architecture: intelOpSys: RH 6.2MinPhysMemory: 512MinLocalDiskSpace: 24000NumSMPs: 2MinSPUProcessors: 2MaxSPUProcessors: 2AverageSI00: 450MinSI00: 450MaxSI00: 450RunTimeEnvironment: CMS4.2RunTimeEnvironment: ATLAS1.1AFSAvailable: FALSEOutboundIP:TRUEInboundIP: TRUE
The architecture of the hosts composing the CE
The operating system of the hosts composing the CE
The minimum value of the physical memory among the hosts composing the CE
The minimum local disk footprint
Number of SMP hosts
The minimum number of SPU processors (for SMP hosts)
The Maximum number of SPU processors (for SMP hosts
The Average of the SpecInt2000 benchmark of the nodes associated with the CE
The minimum value of the SpecInt2000 benchmark of the nodes associated with the CE
The maximum value of the SpecInt2000 benchmark of the nodes associated with the CE
A List of software/packages installed on this CE
A List of software/packages installed on this CE
Defines if AFS is installed
Defines if outbound connectivity is allowed
Defines if inbound connectivity is allowed
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 13
Static Information – Replica Catalogue
makes use of static information /opt/edg/info/mds/etc/ldif/rc-static.ldif
this will be changing to /opt/edg/etc/info/mds/rc-static.ldif
ldif file can be customized for a virtual organization /opt/edg/info/mds/etc/ldif/rc-static-vo.ldif
Rcport: 2001RCmanagerDN: cn=manager,rc=AliceReplicaCatalogue,dc=eu-
datagrid,dc=orgRcurl:
ldap://grid-vo.nikhef.nl:10389/rc=AliceReplicaCatalog,dc=eu-datagrid,dc-org
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 14
Starting Ftree
/etc/rc.d/init.d/edginfo-mds start stop restart status
use information provided in /etc/edg/info-mds.conf
produces 2 ldif files one for ftree one for Globus MDS both point to the same information providers
starts/stops ftree
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 15
Configuration of the GRIS/GIIS Registration
GRIS Grid Resource Information Server
GIIS Grid Index Information Server
there is a GRIS on any machine running an information provider
there is a GIIS at site level
the GRIS’s register with the site GIIS
the site GIIS registers with the country GIIS/VO GIIS
registration is controlled via /etc/globus.conf
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 16
globus.conf - Resource
GRID_INFO_DEBUG_LEVEL=0
GRID_INFO_USER=infouserGRID_INFO_GRIS=yesGRID_INFO_EDG=yes
GRID_INFO_GRIS_REG_GIIS=ralGRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 17
globus.conf - Site
GRID_INFO_DEBUG_LEVEL=0
GRID_INFO_USER=infouserGRID_INFO_GRIS=yesGRID_INFO_EDG=yes
GRID_INFO_GRIS_REG_GIIS=ralGRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk
GRID_INFO_GIIS_1=ral#Register with the country GIISGRID_INFO_REG_GIIS_1=ukGRID_INFO_REG_HOST_1=gppinfo.gridpp.rl.ac.uk
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 18
globus.conf - Country
GRID_INFO_DEBUG_LEVEL=0
GRID_INFO_USER=infouserGRID_INFO_GRIS=yesGRID_INFO_EDG=yes
GRID_INFO_GRIS_REG_GIIS=ukGRID_INFO_GRIS_REG_HOST=gppinfo.gridpp.rl.ac.uk
GRID_INFO_GIIS_1=uk#Register with the top level GIIs for the testbedGRID_INFO_REG_GIIS_1=datagridGRID_INFO_REG_HOST_1=lxshare0225.cern.ch
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 19
Starting Globus MDS
/etc/rc.d/init.d/globus-mds start stop restart status
use information provided in /etc/globus.conf
starts/stops Globus MDS
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 20
Example Searches
Ftree is on port 2171 Globus MDS is on 2135
search a resource:ldapsearch -x -H ldap://gppse05.gridpp.rl.ac.uk:2135-b 'Mds-Vo-
name=local,o=grid‘ objectclass=*
search a site:ldapsearch -x -H ldap://gppce05.gridpp.rl.ac.uk:2135-b 'Mds-Vo-
name=ral,o=grid‘ objectclass=*
search a country/VO:ldapsearch -x -H ldap://gppinfo.gridpp.rl.ac.uk:2135-b 'Mds-Vo-
name=uk,o=grid‘ objectclass=*
or use an LDAP browser such as mapcentre as provided by WP7 http://ccwp7.in2p3.fr/mapcenter/
Antony Wilson –SysMan Meeting- 22 April 2002 - n° 21
Summary
edit /etc/edg/info-mds.conf /etc/globus.conf
/opt/edg/info/mds/etc/ldif/*.ldif this will be changing to /opt/edg/etc/info/mds/*.ldif
produce ldifs and start ftree /etc/rc.d/init.d/edginfo-mds
start Globus MDS /etc/rc.d/init.d/globus-mds
documentation available at: http://hepunx.rl.ac.uk/edg/wp3/