dorii review deployment and management of production infrastructure sa2 ioannis liabotis...
TRANSCRIPT
DORII review
Deployment and management of production infrastructure
SA2
Ioannis [email protected]
Greek Research and Technology Network - GRNET
October 21, 2009, Munich
Introduction to SA2
Objectives
Deliverables and Milestones
Activities and Schedule
SA2 Activities and Work performed
Action Points
Conclusions
Outline
2
SA2: Deployment and management of production infrastructure
Duration: 30M, from M1 to M30 PMs: Funded 66, Unfunded 26 Partners:
Introduction
Institute Effort in PMs Institute Effort in PMs
PSNC 5 CSIC 5
CNIT 22 ELETTRA 5
EUCENTRE 5 OGS 5
ECOHYDROS 5 GRNET 9
UC 5
3
To create, operate, support and manage of a production quality grid infrastructure integrating computational, storage and instrument resources
To describe an operational layer on top of existing Grid infrastructures, which will allow for easy integration of instruments and relevant applications with the Grid
To assemble a new testbed infrastructure by incorporating and exploiting existing expertise and experience in deploying, supporting and operating prototype instrumentation grids
To integrate scientific instrumentation and sensors and deploy them on the available infrastructure
To co-ordinate and manage the relationships with resource and network providers, through negotiation of service-level agreements, and to negotiate with wider grid communities
To keep a production level infrastructure to be able to support the daily work of selected DORII scientific communities
Objectives
4
DSA2.1 Analysis of technical and functional requirements (M5) - Done
DSA2.2 Description of the framework of the management infrastructure (M10) – Done MSA2.1 Infrastructure for applications and
instrumentation (First Version) (M10)– Done
DSA2.3 Deployment and test of selected applications on the infrastructure (M13) - Done MSA2.2 First Deployment of applications on the
infrastructure (M13) - Done
Deliverables and Milestones
5
Deliverables and Milestones
DSA2.3.a Deployment Deployment and test of selected applications on the infrastructure - Update (M18) - Done MSA 2.3 Infrastructure for applications and instrumentation
(Second Version) (M18) – Done
DSA2.4. Final description of the deployed management infrastructure (M24) – Do be done Define the final framework for a production
instrumentation infrastructure
TSA2.1: Analysis of Existing Resources (CNIT, GRNET) - Finished
TSA2.2: Definition of the framework of the support and management infrastructure (CNIT, GRNET) - Finished
TSA2.3: Implementation and management of testbeds (CNIT, GRNET, PSNC, CSIC, ELETTRA, EUCENTRE, OGS, ECOHYDROS, UC) - Ongoing
TSA2.4: Finalisation of the framework of the support and management infrastructure (CNIT, GRNET) - Ongoing
Overall schedule
7
Earthquake CommunityActuators - eucentre (ncss) - a set of actuators and
sensors of the building simulatorSeismic sensors - eucentre (eews) - a set of sensor
that will be distributed in a hot zone
Instrument Resources (1/3)
8
Environmental CommunityFLOATS, GLIDERS - ogs (ocom-moon) - 4 floats, 1
gliderCameras -UC (horus-bench) - 2 camerasWater Reservoir sensors – CSIC (echohydros) 3
sensors
Instrument Resources (2/3)
9
Experimental Science Community SAXS: Small Angle X-ray Scattering -ELETTRAXRD: X-Ray Diffraction - ELETTRA SYRMEP: SYnchrotron Radiation for MEdical Physics -
ELETTRA Demos: elettra (demo) - 3 robots, 1 robocam
Instrument Resources (3/3)
10
Infrastructure Status – Computational and Storage Resources
Support the vo.dorii.eu catch-all VO
Other DORII Related VOs supported in various sites in Italy and Spain Ihydra ienvmod gridats lights.infn.it
11
IE Accounting
Design for IE accounting• The total number of IE users (by time interval, by time) • The total number of hours in which an IE has been used (by time interval and/or by an
user) • How many actions have been executed on the IE (by time interval, by a user, by an action
type and by whichever mix of previous filters) • Instrument/sensor system administrator • Total number of IM users (by time interval, by time) • How many times a specific attribute/parameter has been read/wrote (by time interval
and/or by a user) • How many times a specific command has been executed (by time interval and/or by a
user) • How many times an IM has been locked (by time interval and/or by a user) • How many hours an IM has been locked (by time interval and/or by a user) • The total number of hours in which an IM has been used (by time interval and/or by a
user)
18
Resource Availability
Computational and Storage resources availability ~ 90% IE Resources availability:
Job success rate ~ 97%
19
Integration with Network Resource Provisioning
Collaborate closely with SA1 to identify network related problemsUse of HelpdeskUse of Network Monitoring tools Liaison with NRENs
21
Future Plans Long Term
Continue the infrastructure operations and provide services to DORII users Finalize the design of the management framework or the e-Infrastructure
Short TermDeploy Secondary VOMS ServerProvide IE accounting data on a periodic basisHelpDesk is not used Installation of OpenMPI in all HG sites (almost ready)
This task took a long time Register DORII VO to CIC portalPerform infrastructure evaluation?
22