hnscicloud update tender evaluation & design phase

HNSciCloud UpdateTender Evaluation & Design PhaseD. Giordano / CERN

GDB9 November 2016

D. Giordano HNSciCloud Update 9/11/2016

HNSciCloud Joint Pre-Commercial ProcurementHNSciCloud: Helix Nebula Science Cloud

Build a hybrid cloud platform for the European research community

Procurers: CERN, CNRS, DESY, EMBL-EBI, ESRF, IFAE, INFN, KIT, STFC, SURFSaraExperts: Trust-IT & EGI.eu

The group of procurers have committed• Procurement funds• Manpower for testing/evaluation• Use-cases with applications & data• In-house IT resources

Resulting services will be made available to end-users from many research communities

Co-funded via H2020 Grant Agreement 687614Total procurement budget >5.3M€

1


HNSciCloud Project Phases

2


What will be procuredInnovative IaaS level cloud services integrated with procurers’ in-house resources and public e-infrastructures to support a range of scientific workloads

3


ChallengesCompute and Storage

– Support a range of virtual machine and container configurations including HPC working with datasets in the petabyte range

• Support for Container Orchestration Engines• Large-scale data management & Transparent data access

Network Connectivity and Federated Identity Management– Provide high-end network capacity via GEANT for the whole platform with

common identity and access management• SAML 2.0 based (Ex. : eduGAIN)

Service Payment Models– Explore a range of purchasing options to determine those most appropriate for

the scientific application workloads to be deployed

4


Network capacity via GEANT• a

5

CERN<-> T-Systems network throughput during last cloud procurement


The Story So Far ...

6

OpenMarketConsultation17March2016

Tenderpublished21July200+downloads

InformationDay7SeptemberResponseto70+questions aboutthetendermaterial

TenderDeadline19SeptemberBidsreceivedfrom28internationalcompanies,SMEsandpublicorganisations

ContractAwardCeremony2NovemberBasedontenderevaluationagainstpublishedcriteriabyexpertsfromtheBuyersgroup


The Evaluation Process

7


Tender Results

4 winning consortia1. T-Systems, Huawei, Cyfronet, Divia2. IBM3. RHEA Group, T-Systems, Exoscale, SixSq4. Indra, HP, Advania, SixSq

8


Dissemination of the Award Ceremony

• HNSciCloud web site• Twitter: @HelixNebulaSC

#HNtenderawards• Webcast

>45 distinct connections>30 views of the recorded videos

9


A non-exhaustive overview of the Contractors and their Offers

10


T-Systems Consortiumhnscicloud - starting point.

T-Systems / Jurry de la Mar 302/11/2016

public cloud

Open Telekom Cloud is a leading public cloud service from Germany, scalable, secure and cost-effective.

SIMPLE, SECURE, AFFORDABLE.

community

World wide leading and thriving community of developers, in collaboration with users.

STRONGEST TEAM.

networks

Registered GÉANT IaaS provider and established nx10G network peering.

BEST ACCESS.

experience

Founding member of the Helix Nebula Initiative. Multiple pilots. HPC for Science provider.

STATE-OF-THE-ART.

11

hnscicloud - r&d focus.

T-Systems / Jurry de la Mar 602/11/2016

large-scale data

Integration of leading transparent access and data handling functions in a hybrid cloud with full accountability of resource consumption.

UNIFIED AND EFFICIENT ACCESS.

sla

Extending the SLA with further service components, metrics and commitments according to the ISO/IEC 19086 series of standards.

TRUSTED AND PERFORMING.

business

Developing new purchasing options for Science users, integrating large-scale data access and handling functions and reflecting typical organisational structures.

SIMPLE AND AFFORDABLE.

privacy and security

Identity and access management in the hybrid cloud for eduGain and other identity providers.Extend certifications with ISO 27017 and 27018.

PROTECTED AND PRIVATE.


IBM

12

3

Our approach for HelixNebula

• Build the base solution on top of existing proven IBM technologies– Important in order to achieve a solid and stable solution

• Focus the project on HNSciCloud unique requirements– Explore innovative ways to extend existing solutions and bridging technology gaps

– Push back innovations to IBM technologies ÆMake available to the market

• Focus on open technologies and public available services– Strong contributor to open communities (e.g., OpenStack, Docker, Kubernets, etc..)

7

Data Access using the IBM Spectrum scale

• Provides a high performance parallel and distributed filesystem,

• Supports standard POSIX file system interface

• Has seamless capacity and performance scaling

• Able to cache data on demand asynchronously (using AFM)– The cashing mechanism is highly configurable through policy engine and policies

• Well suited for handling very large datasets – With a lot of concurrent accesses for a large number of client servers.

Storage Resource Pools

Global Namespace


RHEA Consortium

Helix Nebula Science Cloud Award Unclassified 2

Established Partnerships

OUR TEAM

RHEA: Prime contractor, proven management of

large contracts for institutional customers, cyber

security experts

T-Systems: Leading European Public Cloud

provider working with CERN and other

institutions, GÉANT connection

ExoScale: Dynamic, innovative cloud provider

worked with CERN, GÉANT connection

SixSq: SlipStream/Nuvla; brokerage and

automated multi-cloud application deployment

13

Helix Nebula Science Cloud Award Unclassified 5

Support all connection means

Direct, libcloud, jcloud, terraform, native API

Reporting, Accounting & Management

By User, Project, Organisation

Service Level Agreement Monitoring

Define SLA using SLALOM

Identity & Access Management

SAML 2.0, eduGAIN integration

GÉANT Data Protection Code of Conduct

Complementary partners, coherent solution, flexible implementation…

PUTTING IT ALL TOGETHER

Nuvla(Management)

User

Open Telekom Cloud(IaaS)

Exoscale(IaaS)

<manage>

<provision>

<provision><provision>

<provision>

HPCaaS

<interface>


Indra Consortium

Helix Nebula 3

Projects in +140 countries

Complete offering for all industries

R&D 6-8% of sales +200 deals with research centres

and universities

Leading clients in key geographies and

industries

37,000 employees €2.850M

Sales 2015

INDRA IS A GLOBAL TECHNOLOGY COMPANY

14

Helix Nebula 5

WE DELIVER CORE BUSINESS OPERATIONS TECHNOLOGY FOR OUR CLIENTS:

Defense & Security Spanish Department of Defense, NATO, European Space Agency (ESA), Eurofighter, Army of the United Kingdom, Airbus

Financial Services Grupo BBVA Grupo Santander MAPFRE Bank of Spain Banco Espirito Santo

Public Admin & Healthcare State Departments of Venezuela, Argentina and Portugal Department of Health in Chile Philippines Supreme Court Algeria General Tax Directorate, Spanish State Department

Transport & Traffic Railroad: Saudi Railways, ADIF, Renfe Highway operators and road network government authorities in Spain, Portugal, Ireland, Montenegro, United States, Canada, Mexico, Chile, Brazil, Argentina, Colombia, Morocco, China

Energy & Industry Gas Natural Fenosa, Enel, Iberdrola, CEZ, EDP, Electrobras, CFE, Exelon, KPLC, Eskom, Meralco, etc.

Telecom & Media Telefonica/O2/VIVO, Orange/Meditel,Vodafone, Telecom Italia, Portugal Telecom, Claro, Globe, Grupo PRISA, Mediaset

Sales 2015

Main Clients

Helix Nebula 9 |

OPEN COMMUNITY OF PARTNERS AND CUSTOMERS

The community is a collection cloud leaders working together to make an impact on in-market cloud adoption. Here, partners and customers share insights on products, services, case studies, market research and best practices.

280+ Cloud28+ partners

3,000+ LinkedIn followers

100+ Articles

1,000+ Approved services

15,000+ Twitter followers

10,000+ Website visits/month

Helix Nebula 14 |

HPC AS A SERVICE Avoid rushed, planned hardware procurements due to sudden workload peaks. Advania offers you the possibility to seamlessly burst into our HPC cloud when needed.

COLOCATION Racks for approx.18-kw Long term, fixed energy prices and PUE of 1,02. Run your IT green, clean and lean.

CLOUD SERVICES Choose your specification. Choose green. Advania datacenter keeps up the good work with even more efficient equipment utilization.

BACKUP Advanias backup is known for simplicity and ease of use, whether you are backing a single computer or a whole network


Design phase: The next three months

15


Timeline of the Design Phase• Nov. 1st

– Design Phase starts – Publication of the contract award notice

• Dec. 1st

– Project abstract to be sent to EU – List of background IP to be sent to Lead

Procurer (CERN) • Jan. 30th

– Deadline for End of Phase Report (including all deliverables and milestones)

• Feb 20th

– Deadline for the assessment of the results• Feb. 23rd

– Design Phase contractors notified whether satisfactory & successful

– End of Design Phase & payment

• Evaluation board– Consists of experts in the buyers group – Lead by CNRS: Renaud Vernet (CC-IN2P3)

• Assessment of the outcome in two steps

16


T-Systems Consortium

18

onedata multi-cloud filesystem

02/11/2016T-Systems / Jurry de la Mar 7

� Eventually consistent distributed filesystem working in multi-cloud environments with POSIX and HTTP interfaces

� High-throughput data access� Data replication on demand or on the fly� Working with heterogeneous

storage backends including: POSIX, S3, Ceph, OpenStack Swift

� Unified data access � Support for secure data sharing and

collaboration based on ACL’s


IBM

6

Leveraging IBM containers capabilities (Cont.)

• Take advantage of the deep knowledge gained in building container service

• Explore the best fit of containers to HPC workloads

• Network capabilities, isolation model, storage connectivity, etc.

• Build on top of different server types to match special needs

• Bare-Metal, VMs, etc..

• Support different management frameworks (Kubernetes, etc..)

• According to the specific workload need E.g., deploy complex services, self-healing, etc..

Docker Swarm

19

hnscicloud update tender evaluation & design phase

Documents