hands-on on information system antonio juan rubio montero ciemat 10 th eela tutorial. madrid, may 7...

Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).


Hands-on on Information System

Antonio Juan Rubio MonteroCIEMAT

10th EELA Tutorial.Madrid, May 7th-11th,2007.

2



lcg-infosites

3



Exercise 1

Get CE information

$ lcg-infosites - -vo gilda ce

4



$ lcg-infosites --vo gilda ce****************************************************************

These are the related data for gilda: (in terms of queues and CPUs)

****************************************************************

#CPU Free Total Jobs Running Waiting ComputingElement

------------------------------------------------------------------------------------------

4 3 0 0 0 cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-long

4 3 0 0 0 cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-short

34 33 0 0 0 grid010.ct.infn.it:2119/jobmanager-lcgpbs-long

16 16 0 0 0 grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long

1 1 0 0 0 grid006.cecalc.ula.ve:2119/jobmanager-lcgpbs-log

[..]

5



Exercise 2

Get SE information

$ lcg-infosites - -vo gilda se

6



$ lcg-infosites --vo gilda se

**************************************************************These are the related data for gilda: (in terms of SE)**************************************************************

Avail Space(Kb) Used Space(Kb) Type SEs--------------------------------------------------------------------------------------143547680 2472756 disk cn02.be.itu.edu.tr168727984 118549624 disk grid009.ct.infn.it13908644 2819288 disk grid003.cecalc.ula.ve108741124 2442872 disk gildase.oact.inaf.it28211488 2948292 disk testbed005.cnaf.infn.it349001680 33028 disk gilda-se-01.pd.infn.it31724384 2819596 disk cna03.cna.unicamp.br387834656 629136 disk grid-se.bio.dist.unige.it

7



Exercise 3

Get information about installed software

$ lcg-infosites - -vo gilda tag

8



$ lcg-infosites --vo gilda tag

*************************************************************************Information for gilda relative to their software tags included in each CE*************************************************************************

Name of the TAG: VO-gilda-GEANTName of the TAG: VO-gilda-GKS05Name of the CE:cn01.be.itu.edu.tr

Name of the TAG: VO-gilda-slc3_ia32_gcc323Name of the TAG: VO-gilda-CMKIN_5_1_1Name of the TAG: VO-gilda-GEANTName of the TAG: VO-gilda-GKS05Name of the CE:grid010.ct.infn.it

[..]

9



lcg-infosites options

10



lcg-info

11



lcg-info

We can use this command to list which CE and SE satisfies a set of given conditions. We can also show values of a set of given attributes.

Information is taken from BDII especified in LCG_GFAL_INFOSYS variable.

Request sintax is: attr1 op1 valueN, ... attrN opN valueN

12



lcg-info options

13



Exercise 5

Get supported attributed list

$ lcg-info --list-attrs

14



$ lcg-info --list-attrsAttribute name Glue object class Glue attribute name

MaxTime GlueCE GlueCEPolicyMaxWallClockTimeCEStatus GlueCE GlueCEStateStatusTotalJobs GlueCE GlueCEStateTotalJobsCEVOs GlueCE GlueCEAccessControlBaseRuleTotalCPUs GlueCE GlueCEInfoTotalCPUsFreeCPUs GlueCE GlueCEStateFreeCPUsCE GlueCE GlueCEUniqueIDWaitingJobs GlueCE GlueCEStateWaitingJobsRunningJobs GlueCE GlueCEStateRunningJobsCloseCE GlueCESEBindGroup GlueCESEBindGroupCEUniqueIDCloseSE GlueCESEBindGroup GlueCESEBindGroupSEUniqueIDSEVOs GlueSA GlueSAAccessControlBaseRuleUsedSpace GlueSA GlueSAStateUsedSpaceAvailableSpace GlueSA GlueSAStateAvailableSpaceType GlueSE GlueSETypeSE GlueSE GlueSEUniqueIDProtocol GlueSEAccessProtocol GlueSEAccessProtocolTypeArchType GlueSL GlueSLArchitectureTypeProcessor GlueSubCluster GlueHostProcessorModelOS GlueSubCluster GlueHostOperatingSystemNameCluster GlueSubCluster GlueSubClusterUniqueIDTag GlueSubCluster GlueHostApplicationSoftwareRunTimeEnvironmentMemory GlueSubCluster GlueHostMainMemoryRAMSize

15



Exercise 6

Show all CEs on BDII satisfiying some given

conditions

$ lcg-info --list-ce --query 'TotalCPUs>=30,OS=SL*' --attrs 'RunningJobs,FreeCPUs‘

16



$ lcg-info --list-ce --query 'TotalCPUs>=30,OS=SL*' --attrs 'RunningJobs,FreeCPUs‘

- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-long - RunningJobs 0 - FreeCPUs 33

- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-short - RunningJobs 0 - FreeCPUs 33

- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-infinite - RunningJobs 1 - FreeCPUs 33

- CE: skurut1.cesnet.cz:2119/jobmanager-lcgpbs-long - RunningJobs 0 - FreeCPUs 26[..]

17



R-GMA

18



To start R-GMA command line type:>rgma

On begin this message appears.

R-GMA – Command line (1)

19



Command history is managed with “up” and

“down” keys.

For quick access to a command type it’s

first characters and press “CTRL-R”

Use TAB key to complete the command

input.

Command input

20



help Shows general help

help <command> Show specific help

exit or quitQuit RGMA command line.

Show tablesShow all table names of the schema. (Schema)

Describe <tablename>Show table structure information.

General commands

21



To obtain data use SQL SELECT clause: rgma> SELECT * FROM GlueService

SELECT behaviour is according to the request type. There are three request types of SELECT:

LATEST. Return most recents rows for each primary key.HISTORY. Return all historic rows for each primaty key.CONTINUOUS Return rows as soon are being inserter.

Querying data (1)

22



To change request type use SET QUERY :

rgma> SET QUERY LATEST or rgma> SET QUERY CONTINUOUS

To show current request type:

rgma> SHOW QUERY

Querying data (2)

23



1. Show all schema tables: rgma>show tables

2. Show information about GlueSite table: rgma>describe GlueSite

3. Make a query about GlueSite table:rgma>set query latestrgma>show query rgma>select Name,Latitude,Longitude from GlueSite

Exercises

24



Rows max age can be configured. To limit latest or history rows age use SET MAXAGE

rgma> SET MAXAGE 2 minutesrgma> SET MAXAGE 120

To show row max age:rgma> SHOW MAXAGE

To unable max age: rgma> SET MAXAGE none

Row max age

25



Another property of requests is “timeout” We can use timeout to prevent network failure

or other situations In continuous type, timeout means how long

the request will continue returning new rows.

Default timeout it’s 1 minute.

rgma>SET TIMEOUT 3 minutes or rgma>SET TIMEOUT 180

To show current timeout rgma>SHOW TIMEOUT

Timeout property

26



We can use SQL INSERT to add new data:

rgma>INSERT INTO userTable VALUES (’a’, ’b’, ’c’, ’d’)

Producer component inserts data on R-GMA. This component manages INSERT clause.

Data production and insertion (1)

27



To show the current producer type:

rgma>show producer

To set the producer type:

rgma>set producer latest

Data production and insertion (2)

28



1. Insert and select one row using a contiuous producer to support Continuous and historic querys.

rgma>set producer continuousrgma>insert into userTable values('cod','string',1.4,66)rgma>set query continuousrgma>set maxage 1 minutesrgma>set timeout 5 secondsrgma>select * from userTable

Exercise

29



To set the secondary producer for consume from userTable table:rgma>SECONDARYPRODUCER userTable

Secondary producer can be set for latest or history request.rgma>SET SECONDARYPRODUCER latest

To show current secondary producer type: rgma>SHOW SECONDARYPRODUCER

Secondary producer

30



Insert and select data using a secondary producer supporting latest querys.

rgma>set secondaryproducer latestrgma>secondaryproducer userTablergma>show producers of userTablergma>set producer continuousrgma>insert into userTable values ('cod','string',5.2,44) rgma>set query latestrgma>select * from userTable

Exercise

31

Edificio BroncePlaza Manuel Gómez Moreno s/n28020 Madrid. España

Tel.: 91 212 76 20 / 25Fax: 91 212 76 35www.red.es



hands-on on information system antonio juan rubio montero ciemat 10 th eela tutorial. madrid, may 7...

Documents