middleware for campus grids steven newhouse, etf chair (& deputy director, omii)
TRANSCRIPT
Middleware forCampus Grids
Steven Newhouse, ETF Chair
(& Deputy Director, OMII)
©
Which Grid Middleware? gLite (EGEE) OMII GT4 UnitedDevices GridSystems CROWN ….
©
What are your requirements? Research vs. supporting research Bleeding edge vs. production Your potential user community:
‘Intelligence’ Pain threshold
Upfront cost vs. medium/long term costs
©
ETF: Historical Role Started September 2001 Technical forum to build the UK Grid:
GSC DTI/EPSRC Regional Centres Working Groups in 10+ areas
Achievements: Established UK expertise Level 1 Grid: Basic compute/file grid Level 2 Grid: L1 + Application users
©
ETF: Current Activities Integrated with GOSC
0.5 FTE from each regional centre Total 4 FTEs over ~12 people
Leverage wider expertise within the community Evaluating software for production deployment
Continue plenary meetings Focussed short–term ‘action lines’ Evaluation Criteria
©
‘Standard’ Evaluation Criteria Collect the same information Try and answer the same questions Focus on:
General Background Information Systems Management User’s Experience Developer’s Experience Technical
Relate to NGS environment
©
ETF: In context
OMIIETF NGS
Distribution
Other Software Services
Prototypes &
Specifications
Software with proven
capability & realistic
deployment experience
Feedback &
future requirements
EGEE Services
©
ETF: Broader context
UKCampus
andother Grids
NGS
Operations
Providerrequirements
GOSC Board
Userrequirements
ETFSoftwareproviders
Softwareproviders
Softwareproviders
©
Secured Condor Pool Authorised Condor Flocking Use GSI to control access to daemons Flocking through firewalls
©
UDDI Explore use of UDDI v2 Replication of registry
No support at UDDI level Very hard to do at the database level
Poor support for provenance & meta-data Grimoires from OMII to address some issues
©
GridSystems Commercial product InnerGrid: Within the firewall OuterGrid: Between systems (not evaluated) Use of Tomcat/Axis as server
Agents represent resources Modules represent applications Tasks represent modules running on agents
©
GT4 Major new release of the Globus Toolkit
Implementation of WSRF Improved GridFTP Improved WS-GRAM w.r.t. GT3.x
Straightforward portable source & binary installers High quality structured documentation for installation
& development Pure Java code OK on both Linux and Windows
©
GT4 Components
©
GT4 Migration From GT3:
A few straight forward changes to service interfaces.
Improved service performance & reliability From GT2.4:
Pre WS components interoperate
©
GT4 Issues No migration guide for GT2 developers
BUT compatibility library for API Developing Grid systems
As opposed to just GridServices Integration of new DRM into system
Sun Grid Engine
©
OMII 1:Basic Services Services to meet the needs of stakeholders
Service Provider: I have something to share Users: I want to use these shared resources
Functional: Data & Application execution Running jobs using pre-installed applications Movement of input and output data files
Management: Account and Resources Must have an account with a service provider Or delegated access to someone else’s account
©
OMII 1: Architecture
databaseof
accountsresources
applications
resources
computationdata storageapplications
Web Services
Accounting
Resource Mgmt
Data Staging
Job Submission
Client Application
Admin Application
Application
Application
Management(Browser)
Application
WS Security
Tomcat & Axis
©
OMII 1: Stack
WS-Security
AXIS
HappyAxis
TOMCAT
Static Webpage
AcctMgmt
Servlet
ResourceMgmt
Servlet
Account
Allocation
Data
Job
TestS
ervice
Exam
pleService
Application
USER
PBAC
©
OMII 1: Summary Robust and straightforward deployment on
supported platforms Applications need to be installed on the
machine Does what it says on the tin What it does it does well
©
gLite Early releases have been deployed OK Suggested deployment requires ~6 machines Package install OK (but gHeavy!) Configuration complex Evaluation on hold
©
Summary Complete
UDDI Registry Condor
Finishing GridSystems GT4 OMII 1
Underway GridMP Distributed visualisation (RAVE) gLite (hibernating) CROWN
Reports will go on the ETF websitewhen complete.Feed into NGS deployment decisions