monitoring and discovery in a web services framework: functionality and performance of globus...
TRANSCRIPT
![Page 1: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/1.jpg)
Monitoring and Discovery in a Web Services Framework:
Functionality and Performance of Globus Toolkit MDS4
Jennifer M. Schopf
Argonne National Laboratory
UK National eScience Centre (NeSC)
Sept 11, 2006
![Page 2: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/2.jpg)
2
What is a Grid
Resource sharing Computers, storage, sensors, networks, … Sharing always conditional: issues of trust, policy,
negotiation, payment, … Coordinated problem solving
Beyond client-server: distributed data analysis, computation, collaboration, …
Dynamic, multi-institutional virtual orgs Community overlays on classic org structures Large or small, static or dynamic
![Page 3: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/3.jpg)
3
Why is this hard/different?
Lack of central control Where things run When they run
Shared resources Contention, variability
Communication Different sites implies different sys admins,
users, institutional goals, and often “strong personalities”
![Page 4: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/4.jpg)
4
So why do it?
Computations that need to be done with a time limit
Data that can’t fit on one site Data owned by multiple sites
Applications that need to be run bigger, faster, more
![Page 5: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/5.jpg)
5
What Is Grid Monitoring?
Sharing of community data between sites using a standard interface for querying and notification Data of interest to more than one site Data of interest to more than one person Summary data is possible to help scalability
Must deal with failures Both of information sources and servers
Data likely to be inaccurate Generally needs to be acceptable for data to be
dated
![Page 6: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/6.jpg)
6
Common Use Cases
Decide what resource to submit a job to, or to transfer a file from
Keep track of services and be warned of failures
Run common actions to track performance behavior
Validate sites meet a (configuration) guideline
![Page 7: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/7.jpg)
7
OUTLINE
Grid Monitoring and Use Cases MDS4
Information Providers Higher level services WebMDS
Deployments Metascheduling data for TeraGrid Service failure warning for ESG
Performance Numbers MDS For You!
![Page 8: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/8.jpg)
8
What is MDS4? Grid-level monitoring system used most often for
resource selection and error notification Aid user/agent to identify host(s) on which to run an
application Make sure that they are up and running correctly
Uses standard interfaces to provide publishing of data, discovery, and data access, including subscription/notification WS-ResourceProperties, WS-BaseNotification, WS-
ServiceGroup Functions as an hourglass to provide a common
interface to lower-level monitoring tools
![Page 9: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/9.jpg)
9
Standard Schemas(GLUE schema, eg)
Information Users :Schedulers, Portals, Warning Systems, etc.
Cluster monitors(Ganglia, Hawkeye,Clumon, and Nagios) Services
(GRAM, RFT, RLS)
Queuing systems(PBS, LSF, Torque)
WS standard interfaces for subscription, registration, notification
![Page 10: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/10.jpg)
10
Web ServiceResource Framework (WS-RF)
Defines standard interfaces and behaviors for distributed system integration, especially (for us): Standard XML-based service information
model Standard interfaces for push and pull mode
access to service data Notification and subscription
![Page 11: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/11.jpg)
11
MDS4 UsesWeb Service Standards
WS-ResourceProperties Defines a mechanism by which Web Services can
describe and publish resource properties, or sets of information about a resource
Resource property types defined in service’s WSDL Resource properties can be retrieved using WS-
ResourceProperties query operations WS-BaseNotification
Defines a subscription/notification interface for accessing resource property information
WS-ServiceGroup Defines a mechanism for grouping related resources
and/or services together as service groups
![Page 12: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/12.jpg)
12
MDS4 Components Information providers
Monitoring is a part of every WSRF service Non-WS services are also be used
Higher level services Index Service – a way to aggregate data Trigger Service – a way to be notified of changes Both built on common aggregator framework
Clients WebMDS
All of the tool are schema-agnostic, but interoperability needs a well-understood common language
![Page 13: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/13.jpg)
13
Information Providers Data sources for the higher-level services Some are built into services
Any WSRF-compliant service publishes some data automatically
WS-RF gives us standard Query/Subscribe/Notify interfaces
GT4 services: ServiceMetaDataInfo element includes start time, version, and service type name
Most of them also publish additional useful information as resource properties
![Page 14: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/14.jpg)
14
Information Providers:GT4 Services
Reliable File Transfer Service (RFT) Service status data, number of active transfers,
transfer status, information about the resource running the service
Community Authorization Service (CAS) Identifies the VO served by the service instance
Replica Location Service (RLS) Note: not a WS Location of replicas on physical storage systems
(based on user registrations) for later queries
![Page 15: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/15.jpg)
15
Information Providers (2)
Other sources of data Any executables Other (non-WS) services Interface to another archive or data
store File scraping
Just need to produce a valid XML document
![Page 16: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/16.jpg)
16
Information Providers:Cluster and Queue Data
Interfaces to Hawkeye, Ganglia, CluMon, Nagios Basic host data (name, ID), processor information,
memory size, OS name and version, file system data, processor load data
Some condor/cluster specific data This can also be done for sub-clusters, not just at the
host level Interfaces to PBS, Torque, LSF
Queue information, number of CPUs available and free, job count information, some memory statistics and host info for head node of cluster
![Page 17: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/17.jpg)
17
Other Information Providers
File Scraping Mostly used for data you can’t find
programmatically System downtime, contact info for sys
admins, online help web pages, etc. Others as contributed by the community!
![Page 18: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/18.jpg)
18
Higher-Level Services
Index Service Caching registry
Trigger Service Warn on error conditions
All of these have common needs, and are built on a common framework
![Page 19: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/19.jpg)
19
MDS4 Index Service Index Service is both registry and cache
Datatype and data provider info, like a registry (UDDI)
Last value of data, like a cache Subscribes to information providers In memory default approach
DB backing store currently being discussed to allow for very large indexes
Can be set up for a site or set of sites, a specific set of project data, or for user-specific data only
Can be a multi-rooted hierarchy No *global* index
![Page 20: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/20.jpg)
20
MDS4 Trigger Service
Subscribe to a set of resource properties Evaluate that data against a set of pre-
configured conditions (triggers) When a condition matches, action occurs
Email is sent to pre-defined address Website updated
![Page 21: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/21.jpg)
21
Common Aspects
1) Collect information from information providers Java class that implements an interface to collect
XML-formatted data “Query” uses WS-ResourceProperty mechanisms to
poll a WSRF service “Subscription” uses WS-Notification
subscription/notification “Execution” executes an administrator-supplied
program to collect information2) Common interfaces to external services
These should all have the standard WS-RF service interfaces
![Page 22: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/22.jpg)
22
Common Aspects (2)3) Common configuration mechanism
Maintain information about which information providers to use and their associated parameters
Specify what data to get, and from where 4) Services are self-cleaning
Each registration has a lifetime If a registration expires without being refreshed, it and its
associated data are removed from the server5) Soft consistency model
Flexible update rates from different IPs Published information is recent, but not guaranteed to be the
absolute latest Load caused by information updates is reduced at the expense
of having slightly older information Free disk space on a system 5 minutes ago rather than 2
seconds ago
![Page 23: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/23.jpg)
24
Aggregator Frameworkis a General Service
This can be used for other higher-level services that want to Subscribe to Information Provider Do some action Present standard interfaces
Archive Service Subscribe to data, put it in a database, query to retrieve,
currently in discussion for development Prediction Service
Subscribe to data, run a predictor on it, publish results Compliance Service
Subscribe to data, verify a software stack match to definition, publish yes or no
![Page 24: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/24.jpg)
25
WebMDS User Interface Web-based interface to WSRF resource
property information User-friendly front-end to Index Service Uses standard resource property requests to
query resource property data XSLT transforms to format and display them Customized pages are simply done by using
HTML form options and creating your own XSLT transforms
Sample page: http://mds.globus.org:8080/webmds/webmds?
info=indexinfo&xsl=servicegroupxsl
![Page 25: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/25.jpg)
26
WebMDS Service
![Page 26: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/26.jpg)
27
![Page 27: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/27.jpg)
28
![Page 28: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/28.jpg)
29
![Page 29: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/29.jpg)
31
WebMDS
Site 3
App BIndexApp BIndex
Site 3IndexSite 3Index
Rsc 3.a
RLS
I
Rsc 3.b
RLS
II
Rsc 3.b
Site 1
West CoastIndex
West CoastIndex
TriggerService
Rsc 2.a
HawkeyeHawkeye
Rsc 2.b
GRAMGRAMII
Site 2IndexSite 2IndexSite 2Index
Ganglia/LSF
Rsc 1.c
GRAM(LSF)
I
Ganglia/LSFGanglia/LSF
Rsc 1.c
GRAM(LSF)GRAM(LSF)
II
Rsc 1.a
Ganglia/PBS
Rsc 1.b
GRAM(PBS)
I
Ganglia/PBSGanglia/PBS
Rsc 1.b
GRAM(PBS)GRAM(PBS)
II
Site 1IndexSite 1IndexSite 1Index
RFTRFT
Rsc 1.d
II
AA
BB
CC
DD
EE
VO Index
FF
Trigger action
![Page 30: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/30.jpg)
32
Site 1
Ganglia/LSF
Rsc 1.c
GRAM(LSF)
I
Ganglia/LSFGanglia/LSF
Rsc 1.c
GRAM(LSF)GRAM(LSF)
II
Rsc 1.a
Ganglia/PBS
Rsc 1.b
GRAM(PBS)
I
Ganglia/PBSGanglia/PBS
Rsc 1.b
GRAM(PBS)GRAM(PBS)
II
Site 1IndexSite 1IndexSite 1Index
RFTRFT
Rsc 1.d
II
AA
WebMDS
Site 3
App BIndexApp BIndex
Site 3IndexSite 3Index
Rsc3.a
RLS
I
Rsc3.b
RLS
II
Rsc3.b
West CoastIndex
West CoastIndex
TriggerService
Rsc2.a
HawkeyeHawkeye
Rsc2.b
GRAMGRAMII
Site 2IndexSite 2IndexSite 2Index
BB
CC
DD
EE
VO Index
FF
Trigger action
Index
Container
Service
Registration
II
RFTABC
![Page 31: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/31.jpg)
33
WebMDS
Site 3
App BIndexApp BIndex
Site 3IndexSite 3Index
Rsc 3.a
RLS
I
Rsc 3.b
RLS
II
Rsc 3.b
Site 1
West CoastIndex
West CoastIndex
TriggerService
Rsc 2.a
HawkeyeHawkeye
Rsc 2.b
GRAMGRAMII
Site 2IndexSite 2IndexSite 2Index
Ganglia/LSF
Rsc 1.c
GRAM(LSF)
I
Ganglia/LSFGanglia/LSF
Rsc 1.c
GRAM(LSF)GRAM(LSF)
II
Rsc 1.a
Ganglia/PBS
Rsc 1.b
GRAM(PBS)
I
Ganglia/PBSGanglia/PBS
Rsc 1.b
GRAM(PBS)GRAM(PBS)
II
Site 1IndexSite 1IndexSite 1Index
RFTRFT
Rsc 1.d
II
AA
BB
CC
DD
EE
VO Index
FF
Trigger action
![Page 32: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/32.jpg)
34
WebMDS
Site 3
App BIndexApp BIndex
Site 3IndexSite 3Index
Rsc 3.a
RLS
I
Rsc 3.b
RLS
II
Rsc 3.b
Site 1
West CoastIndex
West CoastIndex
TriggerService
Rsc 2.a
HawkeyeHawkeye
Rsc 2.b
GRAMGRAMII
Site 2IndexSite 2IndexSite 2Index
Ganglia/LSF
Rsc 1.c
GRAM(LSF)
I
Ganglia/LSFGanglia/LSF
Rsc 1.c
GRAM(LSF)GRAM(LSF)
II
Rsc 1.a
Ganglia/PBS
Rsc 1.b
GRAM(PBS)
I
Ganglia/PBSGanglia/PBS
Rsc 1.b
GRAM(PBS)GRAM(PBS)
II
Site 1IndexSite 1IndexSite 1Index
RFTRFT
Rsc 1.d
II
AA
BB
CC
DD
EE
VO Index
FF
Trigger action
![Page 33: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/33.jpg)
35
WebMDS
Site 3
App BIndexApp BIndex
Site 3IndexSite 3Index
Rsc 3.a
RLS
I
Rsc 3.b
RLS
II
Rsc 3.b
Site 1
West CoastIndex
West CoastIndex
TriggerService
Rsc 2.a
HawkeyeHawkeye
Rsc 2.b
GRAMGRAMII
Site 2IndexSite 2IndexSite 2Index
Ganglia/LSF
Rsc 1.c
GRAM(LSF)
I
Ganglia/LSFGanglia/LSF
Rsc 1.c
GRAM(LSF)GRAM(LSF)
II
Rsc 1.a
Ganglia/PBS
Rsc 1.b
GRAM(PBS)
I
Ganglia/PBSGanglia/PBS
Rsc 1.b
GRAM(PBS)GRAM(PBS)
II
Site 1IndexSite 1IndexSite 1Index
RFTRFT
Rsc 1.d
II
AA
BB
CC
DD
EE
VO Index
FF
Trigger action
![Page 34: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/34.jpg)
36
Any questions before I walk through two current deployments?
Grid Monitoring and Use Cases MDS4
Information Providers Higher-level services WebMDS
Deployments Metascheduling Data for TeraGrid Service Failure warning for ESG
Performance Numbers MDS for You!
![Page 35: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/35.jpg)
37
Working with TeraGrid
Large US project across 9 different sites Different hardware, queuing systems and
lower level monitoring packages Starting to explore MetaScheduling
approaches Currently evaluating almost 20 approaches
Need a common source of data with a standard interface for basic scheduling info
![Page 36: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/36.jpg)
38
Cluster Data
Provide data at the subcluster level Sys admin defines a subcluster, we query
one node of it to dynamically retrieve relevant data
Can also list per-host details Interfaces to Ganglia, Hawkeye, CluMon,
and Nagios available now Other cluster monitoring systems can write
into a .html file that we then scrape
![Page 37: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/37.jpg)
39
Cluster Info UniqueID Benchmark/Clock
speed Processor MainMemory OperatingSystem Architecture
Number of nodes in a cluster/subcluster
StorageDevice Disk names, mount
point, space available
TG specific Node properties
![Page 38: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/38.jpg)
40
Data to collect: Queue info
LRMSType LRMSVersion DefaultGRAMVersion
and port and host TotalCPUs Status (up/down) TotalJobs (in the
queue)
RunningJobs WaitingJobs FreeCPUs MaxWallClockTime MaxCPUTime MaxTotalJobs MaxRunningJobs
Interface to PBS (Pro, Open, Torque), LSF
![Page 39: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/39.jpg)
41
How will the data be accessed?
Java and command line APIs to a common TG-wide Index server Alternatively each site can be queried
directly One common web page for TG
http://mds.teragrid.org Query page is next!
![Page 40: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/40.jpg)
42
![Page 41: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/41.jpg)
43
Status
Demo system running since Autumn ‘05 Queuing data from SDSC and NCSA Cluster data using CluMon interface
All sites in process of deployment Queue data from 7 sites reporting in Cluster data still coming online
![Page 42: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/42.jpg)
44
Earth Systems Grid Deployment
Supports the next generation of climate modeling research
Provides the infrastructure and services that allow climate scientists to publish and access key data sets generated from climate simulation models
Datasets including simulations generated using the Community Climate System Model (CCSM) and the Parallel Climate Model (PCM
Accessed by scientists throughout the world.
![Page 43: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/43.jpg)
45
Who uses ESG?
In 2005 ESG web portal issued 37,285 requests to
download 10.25 terabytes of data By the fourth quarter of 2005
Approximately two terabytes of data downloaded per month
1881 registered users in 2005 Currently adding users at a rate of more than
150 per month
![Page 44: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/44.jpg)
46
What are the ESG resources? Resources at seven sites
Argonne National Laboratory (ANL) Lawrence Berkeley National Laboratory (LBNL) Lawrence Livermore National Laboratory (LLNL) Los Alamos National Laboratory (LANL) National Center for Atmospheric Research (NCAR) Oak Ridge National Laboratory (ORNL) USC Information Sciences Institute (ISI)
Resources include Web portal HTTP data servers Hierarchical mass storage systems OPeNDAP system Storage Resource Manager (SRM) GridFTP data transfer service [ Metadata and replica management catalogs
![Page 45: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/45.jpg)
47
![Page 46: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/46.jpg)
48
The Problem:
Users are 24/7 Administrative support was not! Any failure of ESG components or services can
severely disrupt the work of many scientists
The Solution Detect failures quickly and minimize
infrastructure downtime by deploying MDS4 for error notification
![Page 47: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/47.jpg)
49
ESG Services Being MonitoredService Being Monitored ESG Location
GridFTP server NCAR
OPeNDAP server NCAR
Web Portal NCAR
HTTP Dataserver LANL, NCAR
Replica Location Service (RLS) servers
LANL , LBNL, LLNL, NCAR, ORNL
Storage Resource Managers LANL, LBNL, NCAR, ORNL
Hierarchical Mass Storage Systems
LBNL, NCAR, ORNL
![Page 48: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/48.jpg)
50
Index Service
Site-wide index service is queried by the ESG web portal Generate an overall picture of the state of
ESG resources displayed on the Web
![Page 49: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/49.jpg)
51
![Page 50: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/50.jpg)
52
Trigger Service
Site-wide trigger service collects data and sends email upon errors Information providers are polled at pre-
defined services Value must be matched for set number of
intervals for trigger to occur to avoid false positives
Trigger has a delay associated for vacillating values
Used for offline debugging as well
![Page 51: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/51.jpg)
53
1 Month of Error Messages
Total error messages for May 2006 47
Messages related to certificate and configuration problems at LANL
38
Failure messages due to brief interruption in network service at ORNL on 5/13
2
HTTP data server failure at NCAR 5/17 1
RLS failure at LLNL 5/22 1
Simultaneous error messages for SRM services at NCAR, ORNL, LBNL on 5/23
3
RLS failure at ORNL 5/24 1
RLS failure at LBNL 5/31 1
![Page 52: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/52.jpg)
54
1 Month of Error Messages
Total error messages for May 2006 47
Messages related to certificate and configuration problems at LANL
38
Failure messages due to brief interruption in network service at ORNL on 5/13
2
HTTP data server failure at NCAR 5/17 1
RLS failure at LLNL 5/22 1
Simultaneous error messages for SRM services at NCAR, ORNL, LBNL on 5/23
3
RLS failure at ORNL 5/24 1
RLS failure at LBNL 5/31 1
![Page 53: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/53.jpg)
56
Benefits Overview of current system state for users and system administrators
At a glance info on resources and services availability Uniform interface to monitoring data
Failure notification System admins can identify and quickly address failed components and
services Before this deployment, services would fail and might not be detected until
a user tried to access an ESG dataset Validation of new deployments
Verify the correctness of the service configurations and deployment with the common trigger tests
Failure deduction A failure examined in isolation may not accurately reflect the state of the
system or the actual cause of a failure System-wide monitoring data can show a pattern of failure messages that
occur close together in time can be used to deduce a problem at a different level of the system
Eg. 3 SRM failures EG. Use of MDS4 to evaluate file descriptor leak
![Page 54: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/54.jpg)
57
OUTLINE
Grid Monitoring and Use Cases MDS4
Index Service Trigger Service Information Providers
Deployments Metascheduling Data for TeraGrid Service Failure warning for ESG
Performance Numbers MDS for You!
![Page 55: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/55.jpg)
58
Scalability Experiments MDS index
Dual 2.4GHz Xeon processors, 3.5 GB RAM Sizes: 1, 10, 25, 50, 100
Clients 20 nodes also dual 2.6 GHz Xeon, 3.5 GB RAM 1, 2, 3, 4, 5, 6, 7, 8, 16, 32, 64, 128, 256, 384, 512, 640,
768, 800 Nodes connected via 1Gb/s network Each data point is average of 8 minutes
Ran for 10 mins but first 2 spent getting clients up and running
Error bars are SD over 8 mins Experiments by Ioan Raicu, U of Chicago, using DiPerf
![Page 56: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/56.jpg)
59
Size Comparison
In our current TeraGrid demo 17 attributes from 10 queues at SDSC and NCSA Host data - 3 attributes for approx 900 nodes 12 attributes of sub-cluster data for 7 subclusters ~3,000 attributes, ~1900 XML elements, ~192KB.
Tests here- 50 sample entries element count of 1113 ~94KB in size
![Page 57: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/57.jpg)
60
MDS4 Query Response Time
1
10
100
1,000
10,000
100,000
1,000,000
1 10 100 1,000
Concurent Load (# of clients)
Res
po
nse
Tim
e (m
s)
Index Size = 500Index Size = 250Index Size = 100Index Size = 50Index Size = 25Index Size = 10Index Size = 100 (MDS2)Index Size = 1
![Page 58: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/58.jpg)
61
MDS4 Index Performance: Throughput
1
10
100
1,000
10,000
100,000
1 10 100 1,000Concurent Load (# of clients)
Th
rou
gh
pu
t (q
uer
ies
/ min
)
Index Size = 1Index Size = 100 (MDS2)Index Size = 10Index Size = 25Index Size = 50Index Size = 100Index Size = 250Index Size = 500
![Page 59: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/59.jpg)
62
MDS4 Stability
Vers. IndexSize
Time up
(Days)
QueriesProcessed
QueryPerSec.
Round-trip
Time (ms)
4.0.1 25 66+ 81,701,925 14 69
4.0.1 50 66+ 49,306,104 8 115
4.0.1 100 33 14,686,638 5 194
4.0.0 1 14 93,890,248 76 13
4.0.0 1 96 623,395,877 74 13
![Page 60: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/60.jpg)
63
Index Maximum Size
HeapSize (MB)
Approx. Max.Index Entries
IndexSize (MB)
64 600 1.0
128 1275 2.2
256 2650 4.5
512 5400 9.1
1024 10800 17.7
1536 16200 26.18
![Page 61: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/61.jpg)
64
Performance
Is this enough? We don’t know! Currently gathering up usage statistics to find
out what people need Bottleneck examination
In the process of doing in depth performance analysis of what happens during a query
MDS code, implementation of WS-N, WS-RP, etc
![Page 62: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/62.jpg)
65
MDS For You
Grid Monitoring and Use Cases MDS4
Information Providers Higher-level services WebMDS
Deployments Metascheduling Data for TeraGrid Service Failure warning for ESG
Performance Numbers MDS for You!
![Page 63: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/63.jpg)
66
How Should You Deploy MDS4?
Ask: Do you need a Grid monitoring system?
Sharing of community data between sites using a standard interface for querying and notification Data of interest to more than one site Data of interest to more than one person Summary data is possible to help scalability
![Page 64: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/64.jpg)
67
What does your projectmean by monitoring?
Display site data to make resource selection decisions
Job tracking Error notification Site validation Utilization statistics Accounting data
![Page 65: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/65.jpg)
68
What does your projectmean by monitoring?
Display site data to make resource selection decisions
Job tracking Error notification Site validation Utilization statistics Accounting data
MDS4 a Good Choice!
![Page 66: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/66.jpg)
69
What does your projectmean by monitoring?
Display site data to make resource selection decisions
Job tracking – generally application specific Error notification Site validation Utilization statistics – use local info Accounting data- use local info and reliable
messaging – AMIE from TG is one option
Think aboutother tools
![Page 67: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/67.jpg)
70
What data do you need
There is no generally agreed upon list of data every site should collect
Two possible examples What TG is deploying
http://mds.teragrid.org/docs/mds4-TG-overview.pdf
What GIN-Info is collecting http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/G
INInfoWiki
Make sure the data you want is actually theoretically possible to collect!
Worry about the schema later
![Page 68: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/68.jpg)
71
Building your own info providers See the developer session! Some pointers… List of new providers
http://www.globus.org/toolkit/docs/development/4.2-drafts/info/providers/index.html
How to write info providers: http://www.globus.org/toolkit/docs/4.0/info/usefulrp/
rpprovider-overview.html http://www-unix.mcs.anl.gov/~neillm/mds/rp-
provider-documentation.html http://globus.org/toolkit/docs/4.0/info/index/
WS_MDS_Index_HOWTO_Execution_Aggregator.html
![Page 69: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/69.jpg)
72
How many Index Servers?
Generally one at each site, one for full project
Can be cross referenced and duplicated Can also set them up for an application
group or any subset
![Page 70: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/70.jpg)
73
What Triggers?
What are your critical services?
![Page 71: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/71.jpg)
74
What Interfaces?
Command line, Java, C, and Python come for free
WebMDS give you the simepl one out of the box
Can stylize- like TG and ESG did – very straight forward
![Page 72: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/72.jpg)
75
What will you be able to do?
Decide what resource to submit a job to, or to transfer a file from
Keep track of services and be warned of failures
Run common actions to track performance behavior
Validate sites meet a (configuration) guideline
![Page 73: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/73.jpg)
76
Summary
MDS4 is a WS-based Grid monitoring system that uses current standards for interfaces and mechanisms
Available as part of the GT4 release Currently in use for resource selection and
fault notification Initial performance results aren’t awful –
we need to do more work to determine bottlenecks
![Page 74: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/74.jpg)
77
Where do we go next?
Extend MDS4 information providers More data from GT4 services Interface to other data sources
Inca, GRASP, PinGER Archive, NetLogger
Additional deployments Additional scalability testing and development
Database backend to Index service to allow for very large indexes
Performance improvements to queries – partial result return
![Page 75: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/75.jpg)
78
Other Possible HigherLevel Services
Archiving service The next high level service we’ll build Currently a design document internally,
should be made external shortly Site Validation Service (ala Inca) Prediction service (ala NWS) What else do you think we need?
Contribute to the roadmap! http://bugzilla.globus.org
![Page 76: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/76.jpg)
79
Other Ways To Contribute
Join the mailing lists and offer your thoughts! [email protected] [email protected] [email protected]
Offer to contribute your information providers, higher level service, or visualization system
If you’ve got a complementary monitoring system – think about being an Incubator project (contact [email protected], or come to the talk on Thursday)
![Page 77: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/77.jpg)
80
Thanks MDS4 Core Team: Mike D’Arcy (ISI), Laura Pearlman
(ISI), Neill Miller (UC), Jennifer Schopf (ANL) MDS4 Additional Development help: Eric Blau, John
Bresnahan, Mike Link, Ioan Raicu, Xuehai Zhang This work was supported in part by the Mathematical,
Information, and Computational Sciences Division subprogram of the Office of Advanced Scientific Computing Research, U.S. Department of Energy, under contract W-31-109-Eng-38, and NSF NMI Award SCI-0438372. ESG work was supported by U.S. Depart ment of Energy under the Scientific Discovery Through Advanced Computation (SciDAC) Program Grant DE-FC02-01ER25453. This work also supported by DOESG SciDAC Grant, iVDGL from NSF, and others.
![Page 78: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/78.jpg)
81
Say YES to Great Career Opportunities
SOFTWARE ENGINEER/ARCHITECTMathematics and Computer Science Division, Argonne National LaboratoryThe Grid is one of today's hottest technologies, and our team in the Distributed Systems Laboratory (www.mcs.anl.gov/dsl) is at the heart of it. Send us a resume through the Argonne site (www.anl.gov/Careers/), requisition number MCS-310886.
SOFTWARE DEVELOPERSComputation Institute, University of Chicago Join a world-class team developing pioneering eScience technologies and applications. Apply using the University's online employment application (http://jobs.uchicago.edu/, click "Job Opportunities" and search for requisition numbers 072817 and 072442).
See our Posting on the GlobusWorld Job Board or Talk to Any of our Globus Folks.
Question: Do you see a Fun & Exciting
Career in my future?
Magic 8 Ball: All Signs Point to YES
![Page 79: Monitoring and Discovery in a Web Services Framework: Functionality and Performance of Globus Toolkit MDS4 Jennifer M. Schopf Argonne National Laboratory](https://reader036.vdocuments.us/reader036/viewer/2022081518/5514ba79550346ea6e8b660b/html5/thumbnails/79.jpg)
82
For More Information
Jennifer Schopf [email protected] http://www.mcs.anl.gov/~jms
Globus Toolkit MDS4 http://www.globus.org/toolkit/mds
MDS-related events at GridWorld MDS for Developers
Monday 4:00-5:30, 149 A/B
MDS “Meet the Developers” session Tuesday 12:30-1:30, Globus Booth