the scaling and validation programme poc david groep & vle-pfour-team vl-e workshop 2005.04.05...
TRANSCRIPT
The Scaling and Validation Programme PoC
David Groep & vle-pfour-teamVL-e Workshop 2005.04.05
NIKHEFSARALogicaCMGIBM
PoC ToC
• What is the Scaling and Validation Program?• Activities in the S&V programme
• Environments & infrastructure Rapid Prototyping environment Certification test bed PoC: stable systems
• Need Help?
Positioning of the PoC in VL-E
Grid Middleware
Surf net Network Service (lambda networking)
Application specificservice
Application Potential
Generic service &
Virtual Lab. services
Grid &
NetworkServices
Virtual Laboratory
VL-e Experimental Environment
VL-e Proof of concept Environment
Telescience Medical Application Bio ASP
Virtual Lab.rapid prototyping
(interactive simulation)
Additional Grid Services
(OGSA services)
Scaling & Validation (S&V) Aims
• Build environments for experimentation different scales, with a variety of resources stable quasi-production Proof-of-Concept (PoC)
• Support applications stable, but also extend (and improve) continuously deploy VL software and components from elsewhere
• Disseminate knowledge about them tutorials, events, helpdesk
• Learn ourselves from the deployment close the cycle, improve with developers and users S&V needs applications for a realistic workload
Three activity tracks
• Software engineering: a timeline Rapid Prototyping
o basic research & evaluating innovative ideas Certification
o quality control and engineering process: Ronald So testing: Chris Schotanus
PoCo stable environment for application developmento common base for incremental developmento Deploying a national-scale infrastructure
• Dissemination and knowledge import
Implementation the process
Application development
NL-Grid production clusterCentral mass-storage facilities
+SURFnetInitial compute
platform
Stable, reliable, testedCert. releases Grid MW & VL-
software
VL-e Proof of Concept EnvironmentVL-e Rapid Prototyping Environment
DAS-2, local resources
VL-e Certification Environment
NL-Grid FabricResearch Cluster
Test & Cert.Grid MW & VL-software
Compatibility
Flexible, test environment
Environments
Usage
Characteristics
Virtual Lab.rapid prototyping
(interactive simulation)
Flexible, ‘unstable’
Download RepositoryPoC InstallerCluster Tools
Developer CVSNightly builds
Unit testsstable, tested
releases
Integration testsFunctionality testsAdventurous application people
PoC Release n Release Candidaten+1
Developers environment
Tagged Release Candidates
RapidPrototypingEnvironment
Rapid Prototyping Environment
• Central services: DAS-2 distributed clusters VU, UvA, Leiden, TUDelft, Utrecht
• Specific services database servers (Oracle, Matisse)
integrated in UvA DAS-2 cluster~1.3 TByte storage available.
core VL services on dedicated nodes
• Local systems Your own workstations, test clusters &c.
Certification test bed
• Smallish setup to validate new releases core: ~10 node dual-CPU cluster some test disk space (as needed) extensible with many more systems
• Characteristics highly flexible but managed the same as the ‘real thing’ same network/typology constraints
validate release n+1 of the PoC s/w suite
P4CTB configuration via Quattor
• Managed software know exactly what is installed where central configuration control (via Quattor)
higher availabilityre-assign nodes on demand to stand in for failures & capacity problems
flexible environmentcan run older versions on-demandreinstalls in ~15 min including grid software & configuration!
Same system is used for real PoC
PoC: Resources and systems
• Central resource sites today SARA: NCF NL-Grid Matrix cluster SARA: Storage (Teras), SRB Matrix NIKHEF: NDPF LCG2PROD + NCF GFRC IBM: in preparationUser Help Needed? SARA can get you up-and-running.
• Access node install via PoC Installer ‘keep pressing enter and you get there…’
• Supported OS’s RedHat Enterprise 3 + clones (CentOS, SL)
(legacy support: RedHat 7.3) Subject to change
coordinated and managed
with fixed cut-ff
dates (timeboxed)
Dissemination & Support
• Core Grid and GT2 tutorials
• Hands-on web services event:Grid Admin Nerd Group (GANG)
mmv.
• User help-desk for the PoC (020) 592 8008 and [email protected]
• Technology pilots: Storage Resource Broker, …
Dutc hG rid
Summary
• Infrastructure: the PoC is there for you hardware, Grid software, DBs, VLAM-G s/w
• Software engineering HEAR ALL ABOUT IT IN THE NEXT TWO TALKS
• Support and dissemination
type of support, tools, … we could take the PoC to your site (if you want to) work together on common central services you need
Contacts
Reach all of us [email protected]
poc.vl-e.nlor via the internal web site
• Other contact addresses [email protected] – services, PoC, web, PoC-installer [email protected] – certification, testing, tooling, … [email protected] – PoC@SARA, SRB pilot, … grid.support@{sara,nikhef}.nl – user questions