Advanced Computing Services for Research Organisations

Bob JonesHead of openlabIT deptCERN

This document produced by Members of the Helix Nebula consortium is licensed under a Creative Commons Attribution 3.0 Unported License.Permissions beyond the scope of this license may be available at http://helix-nebula.eu/. The Helix Nebula project is co-funded by the European Community Seventh Framework Programme (FP7/2007-2013) under Grant Agreement no 312301

Accelerating Science and Innovation2

3

200-400 MB/sec

Data flow to permanent storage: 4-6 GB/sec

1.25 GB/sec

1-2 GB/sec

1-2 GB/sec

• A distributed computing infrastructure to provide the production and analysis environments for the LHC experiments

• Managed and operated by a worldwide collaboration between the experiments and the participating computer centres

• The resources are distributed – for funding and sociological reasons

• Our task was to make use of the resources available to us – no matter where they are located

• Secure access via X509 certificates issued by network of national authorities - International Grid Trust Federation (IGTF)

– http://www.igtf.net/

WLCG – what and why?

Tier-0 (CERN):• Data recording• Initial data reconstruction• Data distribution

Tier-1 (11 centres):• Permanent storage• Re-processing• Analysis

Tier-2 (~130 centres):• Simulation• End-user analysis

4

Click to edit the outline text format Second Outline Level

Third Outline Level Fourth Outline

LevelFifth Outline

LevelSixth Outline

LevelSeventh

Outline LevelEighth Outline

Level• Ninth Outline LevelClick

to edit Master text styles

– Second level

• Third level

– Fourth level

» Fifth level

• WLCG has been leveraged on both sides of the Atlantic, to benefit the wider scientific community

– Europe (EC FP7):

• Enabling Grids for E-sciencE (EGEE) 2004-2010

• European Grid Infrastructure (EGI) 2010--

– USA (NSF):

• Open Science Grid (OSG) 2006-2012 (+ extension?)

• Many scientific applications

Broader Impact of the LHC Computing Grid

ArcheologyAstronomyAstrophysicsCivil ProtectionComp. ChemistryEarth SciencesFinanceFusionGeophysicsHigh Energy PhysicsLife SciencesMultimediaMaterial Sciences…

5

How to evolve WLCG?

A distributed computing infrastructure to provide the production and analysis environments for the LHC experiments

• Collaboration - The resources are distributed and provided “in-kind”

• Service - Managed and operated by a worldwide collaboration between the experiments and the participating computer centres

• Implementation - Today general grid technology with high-energy physics specific higher-level services

Evolve the Implementation while preserving the collaboration & service

6

CERN openlab in a nutshell

• A science – industry partnership to drive R&D and innovation with over a decade of success

• Evaluate state-of-the-art technologies in a challenging environment and improve them

• Test in a research environment today what will be used in many business sectors tomorrow

• Train next generation of engineers/employees

• Disseminate results and outreach to new audiences

Contributor (2012)

7

http://openlab.cern.ch

A European Cloud Computing Partnership

big science teams up with big business

8

Email:contact@helix-nebula.eu Twitter: HelixNebulaSC Website: http://www.helix-nebula.eu/

Open to new members

Users

ServiceProviders

Adopters

Interested Parties

9 http://www.helix-nebula.eu

Looking to the future• Massive adoption of virtualisation techniques by e-Science centres

– To reduce operation costs & simplify deployment of applications using images• Federated identity system

– network of trust across public & private organisationssee paper https://cdsweb.cern.ch/record/1442597

• “Grid extensions” added to clouds (first private then public)– Federated identity system, support for virtual organisations, etc. – Use of commercial cloud services as extensions to in-house resources

• Blurring of the borders between elements of e-infrastructure (networking, grid & supercomputing)

– Because the users & funding agencies demand it• Emergence of a data e-infrastructure

– Such systems are helping to create the Digital European research Area by ensuring secure access to and preservation of research data

10