www.consorzio-cometa.it fesr consorzio cometa - progetto pi2s2 the cometa consortium and its...
TRANSCRIPT
www.consorzio-cometa.it
FESR
Consorzio COMETA - Progetto PI2S2
The COMETA consortium and its activities for Grid adoption by Industry in the context of the PI2S2 Project
Roberto Barbera
University of Catania and INFN
Business Track at EGEE’07
Budapest, 02.10.2007
Budapest, Business Track at EGEE’07, 02.10.2007 2
Outline
• Introduction
• The PI2S2 Project…
• … and its activities related to Industry
• Summary and Conclusions
Budapest, Business Track at EGEE’07, 02.10.2007 3
The Pillars of the Italian e-Infrastructure
The
NetworkThe Grid
FESR
Budapest, Business Track at EGEE’07, 02.10.2007 4
Objectives of an e-Infrastructure in Sicily
• Create a Virtual Laboratory in Sicily, both for scientific and industrial applications, built on top of a grid infrastructure
• Connect the Sicilian e-Infrastructure to those already existing in Italy, in Europe, and in the rest of the world improving the scientific collaboration and increasing the “competitiveness” of e-Science and e-Industry “made in Sicily”
• Disseminate the “grid paradigm” through the organization of dedicated events and training courses
• Trigger/foster the creation of spin-offs in the ICT area in order to reduce the “brain drain” of brilliant young people to other parts of Italy and beyond
Budapest, Business Track at EGEE’07, 02.10.2007 5
~15.000.000 € in 3 years!~300 FTE’s ! (2/3 new hired staff)
2500+ CPUs4+ TFlops250+ TBytes
The Sicilian Grid in one slide
Budapest, Business Track at EGEE’07, 02.10.2007 6
The Sicilian Grid Projects
Budapest, Business Track at EGEE’07, 02.10.2007 7
The PI2S2 Project’s budget
• Total budget: € 11,338,250 (€ 8,503,687 from EC and € 2,834,563 from Consorzio COMETA)
PI2S2 Budget
MIUR75%
Consorzio COMETA
25%
PI2S2 Budget
Internal staff24%
External staff37%
Technological services
1%
R&D indirect costs4%
Infrastructure29%
Counselling4%
Softw are1%
Budapest, Business Track at EGEE’07, 02.10.2007 8
The COMETA Consortium(http://www.consorzio-cometa.it)
Budapest, Business Track at EGEE’07, 02.10.2007 9
Project Workplan
Work Packages
WP1 Design and creation of a GRID infrastructure
WP2Middleware integration with design and development of test procedures
WP3Hardware and software platforms for dissemination and training
WP4Development and integration of applications in the GRID
Budapest, Business Track at EGEE’07, 02.10.2007 10
The PI2S2 Production Service (1/3)
Catania
Budapest, Business Track at EGEE’07, 02.10.2007 11
The PI2S2 Production Service (2/3)
1. ~300 cores AMD Opteron 2218
2. 2 GB of memory per core
3. LSF 6.2 as LRMS everywhere
4. Infiniband-4X at all sites
1. ~60 TB of raw disk storage
2. Distributed/parallel GPFS filesystem
gLite v3.0 middleware everywhere !New delivery of ~1600 cores and ~140 TB
of storage expected by the end of October
Budapest, Business Track at EGEE’07, 02.10.2007 12
The PI2S2 Production Service (3/3)
350 jobs/day – 10 CPU years in 1 month
Budapest, Business Track at EGEE’07, 02.10.2007 13
Relationships with Private Companies
• Official agreement signed with ORACLE for the S-Sicilia Project aiming at setting-up a Competence Centre in Sicily for QoS accounting on a grid environment in collaboration with the Consorzio COMETA and a University of Messina spin-off SME (see ORACLE presentation in the plenary session of yesterday).
• Agreement finalized with MICROSOFT for the adoption of Conference-XP as a platform to be used for/during grid training events.
• Other agreements under formalization with Ferrari, FIAT, and Technipetrol.
Budapest, Business Track at EGEE’07, 02.10.2007 14
The S-Sicilia Project
Budapest, Business Track at EGEE’07, 02.10.2007 15
• Presently on gLite– Users use the gLite middleware
services from Linux-based User Interfaces via a CLI
– (almost) All gLite resources are Linux-based
• This implies– Grid users need to be trained– Only Linux-based applications
can be deployed onto the Grid
• Porting of gLite to Windows– User Interface– Computing Element (farm of
WNs)
Gatekeeper + LRMS
User Interface
Linux WNs
WMProxy
User Interface
WindowsXP Wns
new users can use the grid !
windows applications can run on the grid !
Porting of gLite on Windows platform (1/2)
Budapest, Business Track at EGEE’07, 02.10.2007 16
Porting of gLite on Windows platform (2/2)
Gatekeeper + LRMS
User Interface
Linux WNs
WMProxy
User Interface
WindowsXP Wns
new users can use the grid !
Windows applications can run on the grid !
Stable prototype of a GUI
for Windows available.
Windows sites already available .
Budapest, Business Track at EGEE’07, 02.10.2007 17
Grid2Win User Interface
Local file system explorer
Grid file system explorer
Budapest, Business Track at EGEE’07, 02.10.2007 18
A gLite site running Windows !
Budapest, Business Track at EGEE’07, 02.10.2007 19
SE
Key Repository
SE
USER VIRTUAL ORGANIZATION
Key
File Encryption /Decryption
Encrypted File
Encrypted File
The Problem of Insider Abuse and the Secure Storage
SECURE ENVIRONMENTSECURE ENVIRONMENT
Budapest, Business Track at EGEE’07, 02.10.2007 20
Encryption and Storage (lcg-scr)
1) Create random “Key” and “IV”
2) Encrypt “File” using the Key (AES 256 bit)
3) Store “Key”, “IV” and
UI
Keystore
KeyFileE )(
SE
IVKeyKeyFileE )(
Budapest, Business Track at EGEE’07, 02.10.2007 21
Retrieval and Decryption (lcg-scp)
1) Retrieve “Key”, “IV” and
2) Decrypt “File” using Key
UI
Keystore
KeyFileE )(
KeyFileE )(
SE
KeyFileE )(
File
IVKey
Budapest, Business Track at EGEE’07, 02.10.2007 22
Secure Storage vs. EDS (Hydra)
Budapest, Business Track at EGEE’07, 02.10.2007 23
The GENIUS Grid Portal
NICE is one of the companies officially
collaborating with the Consorzio COMETA
Budapest, Business Track at EGEE’07, 02.10.2007 24
The GENIUS Job Wizard(“à la Sun Grid”)
1
3
2
4First prototype ready by Q1/2008
Budapest, Business Track at EGEE’07, 02.10.2007 25
Other middleware developments
• Development of methods for grid advance reservation/allocation and access to data and computing resources.
• Storage Accounting in a grid environment.
• Creation of a grid-security-enabled license server (based on FlexLM) for commercial software.
• Seamless integration of gLite WMS with MPICH-2 (with and without native Infiniband support).
Budapest, Business Track at EGEE’07, 02.10.2007 26
• Co-organized by Consorzio COMETA and EGEE• 2 full days; more than 80 participants• Participation of many Companies. Among them:
– APC– DATAMAT– FERRARI– FIAT– HP– IBM– MICROSOFT– ORACLE– RITTAL
• Concrete interest of Industry to “try” grid infrastructures for on-demand computing
The Grid Industry Day(http://indico.ct.infn.it/conferenceDisplay.py?confId=a066)
Budapest, Business Track at EGEE’07, 02.10.2007 27
Other Dissemination&Training eventsThe First International Grid School for Industrial Applications
Budapest, Business Track at EGEE’07, 02.10.2007 28
The PI2S2 Application Questionnaire(http://www.consorzio-cometa.it/questionario/quest.php)
http://www.pi2s2.it/tc/show_quest_2006.php
Industrial Partners willing to submit use cases are welcome!
Budapest, Business Track at EGEE’07, 02.10.2007 29
Summary and Conclusions
• Sicilian grid projects are the first ones in Italy at a true regional level.
• The PI2S2 Infrastructure is available for users (it will reach its nominal size by the end of year) and many services/developments target Industry involvment and uptake.
• We are open to collaborate with Industrial Partners and I hope that this Conference will be very useful in this respect.
Budapest, Business Track at EGEE’07, 02.10.2007 30
Any Questions ?
Thank you very much for your kind attention!