the scaling and validation programme poc david groep & vle-pfour-team vl-e workshop 2005.04.05...

The Scaling and Validation Programme PoC

David Groep & vle-pfour-teamVL-e Workshop 2005.04.05

NIKHEFSARALogicaCMGIBM

PoC ToC

• What is the Scaling and Validation Program?• Activities in the S&V programme

• Environments & infrastructure Rapid Prototyping environment Certification test bed PoC: stable systems

• Need Help?

Positioning of the PoC in VL-E

Grid Middleware

Surf net Network Service (lambda networking)

Application specificservice

Application Potential

Generic service &

Virtual Lab. services

Grid &

NetworkServices

Virtual Laboratory

VL-e Experimental Environment

VL-e Proof of concept Environment

Telescience Medical Application Bio ASP

Virtual Lab.rapid prototyping

(interactive simulation)

Additional Grid Services

(OGSA services)

Scaling & Validation (S&V) Aims

• Build environments for experimentation different scales, with a variety of resources stable quasi-production Proof-of-Concept (PoC)

• Support applications stable, but also extend (and improve) continuously deploy VL software and components from elsewhere

• Disseminate knowledge about them tutorials, events, helpdesk

• Learn ourselves from the deployment close the cycle, improve with developers and users S&V needs applications for a realistic workload

Three activity tracks

• Software engineering: a timeline Rapid Prototyping

o basic research & evaluating innovative ideas Certification

o quality control and engineering process: Ronald So testing: Chris Schotanus

PoCo stable environment for application developmento common base for incremental developmento Deploying a national-scale infrastructure

• Dissemination and knowledge import

Implementation the process

Application development

NL-Grid production clusterCentral mass-storage facilities

+SURFnetInitial compute

platform

Stable, reliable, testedCert. releases Grid MW & VL-

software

VL-e Proof of Concept EnvironmentVL-e Rapid Prototyping Environment

DAS-2, local resources

VL-e Certification Environment

NL-Grid FabricResearch Cluster

Test & Cert.Grid MW & VL-software

Compatibility

Flexible, test environment

Environments

Usage

Characteristics

Virtual Lab.rapid prototyping

(interactive simulation)

Flexible, ‘unstable’

Download RepositoryPoC InstallerCluster Tools

Developer CVSNightly builds

Unit testsstable, tested

releases

Integration testsFunctionality testsAdventurous application people

PoC Release n Release Candidaten+1

Developers environment

Tagged Release Candidates

RapidPrototypingEnvironment

Rapid Prototyping Environment

• Central services: DAS-2 distributed clusters VU, UvA, Leiden, TUDelft, Utrecht

• Specific services database servers (Oracle, Matisse)

integrated in UvA DAS-2 cluster~1.3 TByte storage available.

core VL services on dedicated nodes

• Local systems Your own workstations, test clusters &c.

Certification test bed

• Smallish setup to validate new releases core: ~10 node dual-CPU cluster some test disk space (as needed) extensible with many more systems

• Characteristics highly flexible but managed the same as the ‘real thing’ same network/typology constraints

validate release n+1 of the PoC s/w suite

P4CTB configuration via Quattor

• Managed software know exactly what is installed where central configuration control (via Quattor)

higher availabilityre-assign nodes on demand to stand in for failures & capacity problems

flexible environmentcan run older versions on-demandreinstalls in ~15 min including grid software & configuration!

Same system is used for real PoC

PoC: Resources and systems

• Central resource sites today SARA: NCF NL-Grid Matrix cluster SARA: Storage (Teras), SRB Matrix NIKHEF: NDPF LCG2PROD + NCF GFRC IBM: in preparationUser Help Needed? SARA can get you up-and-running.

• Access node install via PoC Installer ‘keep pressing enter and you get there…’

• Supported OS’s RedHat Enterprise 3 + clones (CentOS, SL)

(legacy support: RedHat 7.3) Subject to change

coordinated and managed

with fixed cut-ff

dates (timeboxed)

Dissemination & Support

• Core Grid and GT2 tutorials

• Hands-on web services event:Grid Admin Nerd Group (GANG)

mmv.

• User help-desk for the PoC (020) 592 8008 and grid.support@sara.nl

• Technology pilots: Storage Resource Broker, …

Dutc hG rid

Summary

• Infrastructure: the PoC is there for you hardware, Grid software, DBs, VLAM-G s/w

• Software engineering HEAR ALL ABOUT IT IN THE NEXT TWO TALKS

• Support and dissemination

type of support, tools, … we could take the PoC to your site (if you want to) work together on common central services you need

Contacts

Reach all of us atvle-pfour-team@sara.nl

poc.vl-e.nlor via the internal web site

• Other contact addresses davidg@nikhef.nl – services, PoC, web, PoC-installer ronalds@nikhef.nl – certification, testing, tooling, … maurice.bouwhuis@sara.nl – PoC@SARA, SRB pilot, … grid.support@{sara,nikhef}.nl – user questions