egi: a european distributed computing infrastructure
DESCRIPTION
EGI: A European Distributed Computing Infrastructure. Steven Newhouse Interim EGI.eu Director. The EGI Context. EGI Collaboration. Research Community. Research Community. Research Community. N G I. Research Community. N G I. Research Community. E I R O. E I R O. N G - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/1.jpg)
EGI: A European Distributed Computing Infrastructure
Steven NewhouseInterim EGI.eu Director
![Page 2: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/2.jpg)
The EGI Context
EGICollaboration
NGI
NGI
NGI
NGI
ResearchCommunity
ResearchCommunity
ResearchCommunity
ResearchCommunity
EIRO
EIRO EGI.eu
ResearchCommunity
![Page 3: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/3.jpg)
EGI.eu• Coordination for European HTC
– Policy & services needed to run a grid• Governance by its stakeholders
– EGI Council votes proportional to GDP• Owned by its stakeholders
– EGI Council fees proportional to votes• Location selected to be Amsterdam
– Distributed staffing model– Approximately 51 staff, 4.59M€/year
![Page 4: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/4.jpg)
How much does it cost?
24
25
Annual Running Costs EGEE-III (M€)Staff (EC & National)
Hardware (National)
5127
14
8
% Staff Effort in EGEE-III
Operations User CommunityMiddleware Coordination
![Page 5: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/5.jpg)
How to make e-Infrastructure sustainable?
• Minimise what you need to sustain!– Be a middleware customer, not a developer– Be a service provider, not a research organisation– Don’t control resources, work with resource providers
• What does that leave for EGI.eu?– Services that do not fit nationally or in a community– Management & technical expertise for it all to work!
• Recognise that we are transitioning to this goal!– Process started in EGEE-III
![Page 6: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/6.jpg)
DANGERProposal Under Construction
![Page 7: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/7.jpg)
The EGI-InSPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe
• A proposal for an FP7 project– Work in progress..., i.e. this may all change!
• Targeting call objectives:– 1.2.1.1: European Grid Initiative– 1.2.1.2: Service deployment for heavy users
• Targeting a 3 year project• Seeking a total 25M€ EC contribution
![Page 8: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/8.jpg)
EGI-InSPIRE Objectives• Transition to a sustainable federated European
e-infrastructure built from national resources• Deliver production quality services to all its
user communities and users• Provide a scalable user support model for
international research communities within Europe and their worldwide collaborators
• Interoperation and interoperability with other e-infrastructures
![Page 9: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/9.jpg)
EGI Project Ecosystem
EGI
SoftwareProviders
SoftwareProviders
SoftwareProviders
Comm
unityCom
munity
SSC
SSC
SSC
SSC
EC Projects
SSC
SupportCentres
SupportingProjects
![Page 10: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/10.jpg)
Project Structure
Project Management
External Relations: Policy, Dissemination and Standards
SA3SoftwareSupport
SA2Middleware
Unit
SA1Operations
JRA1Operational
Tools
SA4Services for
HUCs
NA3User
SupportSoftwareProvisioning
andSupport
Operations and Tools
User Support and
Services
![Page 11: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/11.jpg)
Project Structure
EGI-InSPIRE
Managerial Collaborations (e.g. EC, DEISA, OSG, ...)
Technical Collaborations(e.g. CHAIN, GISELR, OGF-EUROPE-II, ...)
SSCProjects
(e.g. ROSCOE, SAFE, CUE, Application
Porting SSC, ...)
SoftwareProjects
(e.g. EMI, ...)
![Page 12: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/12.jpg)
External Relations: Policy, Dissemination and Standards• Dissemination internally & externally to EGI• Development of EGI’s sustainability model• Co-ordinating EGI’s standards activity• EGI Policy development for governance,
middleware, security, operations & user communities
• Two large annual events to promote collaboration within European DCI– In collaboration with PRACE/DEISA & others
![Page 13: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/13.jpg)
User Community Coordination & Support
• Coordination of effective, responsive support for the EGI user communities (reactive)
• Coordination of training, documentation and technical requirements from the user communities (proactive)
• Technical services to:– Support the management and establishment of
virtual organisations– Deployment and Support of services & tools to
support Heavy User Communities (HUCs)
![Page 14: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/14.jpg)
Operations• Providing a Reliable Grid Infrastructure • Availability of Skilled Support Teams• Service Deployment Validation• Providing a Secure Infrastructure • Accounting for Resource Usage• Helpdesk Infrastructure• Infrastructure for Grid Management• Regionalisation of the Operational Tools
![Page 15: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/15.jpg)
Who does what in EGI?• Internal National Infrastructure & Activities
– Infrastructure that is not visible internationally– Activities with no external dependency
• NGI International Tasks– The ‘service’ interface to your national grid– Community defined that EGI will enforce
• EGI Global Tasks– Provided by EGI.eu through community partners– Services needed for the whole EGI community
![Page 16: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/16.jpg)
EGI Software Infrastructure• Recall some design facts:
– EGI federation of national grid activities– EGI is not developing middleware– EGI does not control the resources its users use
• As a consequence:– EGI will need to integrate different middleware– EGI needs to identify interoperable solutions
• EGI must work with multiple software providers and deployments to achieve its goals
![Page 17: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/17.jpg)
EGI Software InfrastructureSoftware Provider
EGISoftware
Repository
Software ProviderSoftware Provider
SoftwareComponent
SoftwareComponent
SoftwareComponent
SoftwareComponent
Unified Middleware Distribution
Fully SupportedSoftware Component
Community Supported Software Component
Rejected:Failed quality
criteria
Other Middleware Distributions
3rd Line Support
Agreement
CompatibleComponent
2nd Line Support
SoftwareComponent
Middleware Collaboration Board• End-Users• Software Providers• Resource Providers
![Page 18: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/18.jpg)
Software Infrastructure Provision
• Define and maintain the UMD roadmap and the relationship with the software providers
• Define the quality criteria that will be applied to all and specific software components and verify they are achieved
• Provide a repository for the software components within UMD and the related support tools and structures
• Second line support for deployed software
![Page 19: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/19.jpg)
EGI @ EGEE’09• Tuesday:
– 11am: EGI InSPIRE Workshop– 2.30pm: EGI Governance models– 7pm: EGI Gateways Project
• Wednesday:– 9am: SSC Project Plenary– 2.30pm: Heavy User Communities (in HEP SSC Session)
• Thursday:– 9am: EMI Project Plenary– 11am & 2.30pm: EMI & UMD Workshop
• Friday:– 8.30am: SSC Projects Workshop
![Page 20: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/20.jpg)
EGI Timeline• 30/9/09: Feedback from current draft & EGEE’09
due• 16/10/09: Deadline for submitting requests for
Letter of Support– Process being finalised this week
• 23/10/09: EGI Council meeting– Letters of support approved
• 24/11/09: Final proposal submission• Spring 2010: Launch of EGI.eu• May 1st 2010: EGI project starts
![Page 21: EGI: A European Distributed Computing Infrastructure](https://reader036.vdocuments.us/reader036/viewer/2022062323/56815ea8550346895dcd35c9/html5/thumbnails/21.jpg)
Summary• EGI is a collaboration for HTC in Europe
– Provide a sustainable European e-Infrastructure– Strengthen support for HPC user communities
• EGI.eu is the coordinating organisation– Being established in Amsterdam– Launch Spring 2010
• 3yr FP7 Project being prepared for 25M€– Continue and complete the transition to EGI