advanced techniques for scheduling, reservation, and access management for remote laboratories...
TRANSCRIPT
Advanced Techniques for Scheduling, Reservation, and Access Management for
Remote Laboratories
Wolfgang Ziegler, Oliver WäldrichFraunhofer Institute SCAI
Philipp WiederResearch Centre Jülich
Workshop on Collaborative Remote Laboratories In conjunction with e-Science 2006
Amsterdam, December 4, 2006
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 2
Acknowledgements
Some of the work reported in this presentation is funded by the German Federal Ministry of Education and Research through the VIOLA project under grant #01AK605F. This presentation also includes work carried out jointly within the CoreGRID Network of Excellence funded by the European Commission’s IST programme under grant
#004265.
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 3
Content
• Motivation• Meta-Scheduling in Grids
– The VIOLA environment– WS-Agreement
• Integrating Remote Laboratories• Perspectives
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 4
Motivation
• Obvious commonalities managing Collaborative Remote Laboratories (CRLs) and Grid resources– Advance reservation allows usage at a defined
point in time– Negotiation of usage conditions– SLAs as reliable contracts between provider &
consumer– Access control based on roles
Evaluate potential of integrating CRLs as resourcesinto existing Grid environments
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 5
VIOLA project
• German project founded by BMBF• Duration June 2004 – April 2007• http://www.viola-testbed.de/• Goals
– Test of advanced network equipment & network architectures
– Development & test of software tools for the user-driven dynamical provision of bandwidth
– Enhancement and test of new advanced applications (e.g. Grid, Virtual Reality)
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 6
The VIOLA MetaScheduling Service
Site 1 Site n
Local Scheduler
Site n
Adapter
HTTPS
Partial job n
MetaScheduling Service
…
HTTPS
Local Scheduler
Site 1
Adapter
Partial job 1
Network
NetworkRMS
Adapter
Switch/Router
ClientSubmission of job dataWS-Agreement
HTTPS
WS-Agreement
• Goal: Co-allocation of MPI jobs
• Client initiates the reservation (WS-Agreement) and submits the job-data
• Negotiation of timeslot with local schedulers
• Interface between MetaScheduling Service and local RMS realised through Adapter pattern
• Interface MetaScheduling Service / Adapters based on HTTPS/XML (SOAP)
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 7
Negotiation Protocol
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 8
WS-Agreement StructureWS-Agreement characteristics• Protocol for dynamic agreement
management• Terms can relate to:
– functional description– non-functional properties
• WS-Agreement is domain-agnostic• Agreement can involve 4 parties:
– agreement initiator and provider– service consumer and provider
• State can be published and monitored via agreement properties
• Can be chained or nested to represent complex relationships
Service Layer
ConsumerOperations
Server
Service
Agreement Layer Provider
Initiator
Create /Query/Terminate
Agreement
Term Compositor
Creation constraint.
Guarantees
Service Descriptions
Context
Service Properties
Service References
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 9
Virtual Organisation Management
• VOs are used for authorisation in Grids– Already in Globus Toolkit & LCG/gLite – UNICORE in transition
• VOs allow the definition of roles and role based authorisation for resource access and usage
• However, mostly X.509 certificate based (VOMS/VOMRS)• Shibboleth could be an interesting option for CRLs• Interoperability with existing Grid Infrastructures seems to
be a major advantage of using VO technology also for CRLs• Would allow seamless integration
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 10
Integrating Remote Laboratories
Site 1 Site n
Local Scheduler
Site n
Adapter
HTTPS
Partial job n
MetaScheduling Service
…
HTTPS
Local Scheduler
Site 1
Adapter
Partial job 1
Network
NetworkRMS
Adapter
Switch/Router
ClientSubmission of job dataWS-Agreement
HTTPS
WS-Agreement
Laboratory
HTTPS
Local Scheduler
Adapter
Instruments
CollaborationTool
WS-Agreement
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 11
The Role of the MetaScheduling Service
• Negotiation of not only computers and network, but also instruments and people
• Consideration of additional domain-specific SLA terms
• Provision of authorisation information for the initial setup of the collaborative environment
• Service orchestration: launching and managing of services, tools, and applications
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 12
Domain-specific tasks
• Specification of WS-Agreement SLA terms for CRLs
• Connection of the Collaboration Tool to the MetaScheduling Service
• Realisation of adaptors towards– laboratories or instruments (possibly via
Common Instrument Middleware Arch. (CIMA))– people to negotiate common time-slot for
performing the experiment
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 13
Status Quo Vadis?
• Meta-scheduling demonstration– at IST 2006 & CoreGRID Industrial Conf. 2006– Groundwater pollution simulation (& steering)– Co-scheduling of clusters & network
• Ongoing work– From co-allocation to workflow scheduling
• Plans for prototype implementation– Integrating an CRL - looking for volunteers ;-)– Evaluation compared to other approaches