egee-iii infso-ri-222667 enabling grids for e-science antonio retico cern, geneva 19 jan 2009 pps...

EGEE-III INFSO-RI-222667

Enabling Grids for E-sciencE

www.eu-egee.org

Antonio Retico

CERN, Geneva 19 Jan 2009

PPS in EGEEIII: Some Points



From the EGEE public web

• Preproduction Service: This service consists of a limited number of sites running a preview of the next release of the gLite software. This should be used to test existing applications against the new release, and to understand new gLite services.

• (http://technical.eu-egee.com/index.php?id=134)

2EGEE – 19th January 2009



Mandate in EGEEII

• The EGEE Pre-Production Service (PPS) is a distributed service whose goal is to give early access to new services to WLCG/EGEE users in order to evaluate new features and changes in the release.

• As a contribution to the overall quality of the gLite middleware the PPS provides – Evaluation of the deployment procedure and software in real

operational conditions– Evaluation and debugging of new functionality done by the

applications/VOs before they move into the production service– Feedback for early bug fix to the release before moving to

production

EGEE – 19th January 2009 3



Mandate in EGEEIII

• The EGEE Pre-Production provides access to grid services in preview to WLCG/EGEE interested users, in order to test, evaluate and give feedback to changes and new features of the middleware.

• In addition to that, the pre-production extends the middleware certification activity, helping to evaluate deployment procedures, [inter]operability and basic functionality of the software against operational scenarios reflecting real production conditions




Drivers For Change

• Promote Usage

• Optimise Work

• Reduce Costs




One Key Change


• The EGEE Pre-Production provides access to grid services in preview to WLCG/EGEE interested users in order to test, evaluate and give feedback to changes and new features of the middleware.

6

Key change: not EVERY user at EVERY time.

Setup and usage conditions of previews to be agreed with users in advance

EGEE – 19th January 2009



One Key Change


• The EGEE Pre-Production provides access to grid services in preview to WLCG/EGEE interested users in order to test, evaluate and give feedback to changes and new features of the middleware.

7

•Promote Usage A service is set-up only when a real interest in testing is expressed by the VOs

•Optimise Work The preview (or pilot) services are successful and they would be set-up anyway out of PPS

•Reduce Costs No more permanent platform with all services




Two Service Classes + Support

• Corresponding to the two statements in the mandate

• Middleware Quality Services – MQS

• Middleware Pilot Services – MPS

• PPS Support - SUP




Middleware Quality Services

Mission: “To test the middleware deployment tools (packaging, documentation) against scenarios relevant for production”

• Workload distributed among 'PPS' sites (not registered as production)

• Services published in pre-production IS• Testing interaction with different platforms, batch and storage

systems• Contributing to interoperability testing• Providing additional info and advice for deployment in production• Dedicated monitoring infrastructure for validation• "service-oriented" testing: several deployment test managers

sharing the tools• NOT production-like service --> pre-deployment runs on-demand

with releases




Middleware Preview Services

10

Mission: “To provision previews of new middleware functionality”• Distribution of clients tools in preview mostly automated• Instances of pilot services created on-demand• Close interactions with the VOs for the definition of scope and

goals of the pilots • Workload distributed among partner sites in production • Services published in production IS• Production-like service of limited duration• Pre-registration of sites to sets of tasks (PPS Partner Sites)

– Silver Partners (or Silver Sites): Sites supporting the installation of non-backward-compatible client updates

– Gold Partners (or Gold Sites): Sites providing support for pilots services in case of backward-compatible server updates or new services

– Platinum Partners (or Platinum Sites): Sites providing support for pilots services in

case of non-backward-compatible server updates • Details in

https://twiki.cern.ch/twiki/bin/view/LCG/PreProductionServiceDescription




Service breakdown

PPS in EGEEII

• General coordination (CERN)• pre-dep test coordinator (LIP-SWE)• pre-deployment tests (6 sites from

CERN(1), CE(1), RU(1), SWE(3)• A few PPS sites running basic

service (decommissioning)• SAM service (2 sites from CERN and

CE)• PPS release managers (2 sites from

SWE, IT)• EMT: release to production (CERN)• Cream pilot service (IT, DECH,

+ROCs)• Pilot coordination (CERN)

MQS (PPS grid)• pre-deployment tests (~12 sites from all ROCs)

– test coordinators per service• SAM service (1 site)• Release testing

11

MPS (prod grid)• List of production sites available to support

pilots (‘PPS partners’)• Pilot Services in production … (on demand)

– Pilot coordinators to be appointed

PPS support• PPS release management• EMT: release to production (CERN)• Activity management• Metrics and quality• Communication

PPS on Sept2008




PPS Support

Mission: “To support the work of the MPS and MQS and be the interface of PPS with the external world”

• MQS:– Maintain the release procedure

– Set requirements for deployment scenarios coming from middleware development/certification and "global" VOs

– Interface to EMT for release to production

• MPS– Interface with VOs, regions, sites and middleware providers to start-up pilots

– Access point for PPS users

• Technical coordination – Activity tracking and statistics

– Reporting

• Communication and outreach




Partners in MPS

• www.cern.ch/pps




Partners in MQS

• www.cern.ch/pps




Partners in Support

• www.cern.ch/pps




For Further Reading

16

• WLCG/EGEE Pre Production: Use Cases (EGEEIII)

https://twiki.cern.ch/twiki/bin/view/LCG/PreProductionUseCases

• WLCG/EGEE Pre Production: Service Description (EGEEIII)https://twiki.cern.ch/twiki/bin/view/LCG/PreProductionServiceDescription

• PPS task tracker https://savannah.cern.ch/task/?group=sa1dep

• All Available in the PPS web site

www.cern.ch/pps/index.php?dir=./PPSrocs/




Effort breackdown (excl.deployment testing)


egee-iii infso-ri-222667 enabling grids for e-science antonio retico cern, geneva 19 jan 2009 pps...

Documents