cern clouds and culture at gigaom london 2013
DESCRIPTION
TRANSCRIPT
@noggin143
19/09/2013 CERN Infrastructure Evolution 2
19/09/2013 CERN Infrastructure Evolution 3
CERN was founded 1954: CERN was founded 1954: 12 European States12 European States “ “Science for Peace”Science for Peace”
Today: 20 Member StatesToday: 20 Member States
Member States:Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway, Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland and Poland, Portugal, Slovakia, Spain, Sweden, Switzerland and the United Kingdom the United Kingdom
Candidate for Accession: Candidate for Accession: RomaniaRomania
Associate Members in Pre-Stage to Membership: Associate Members in Pre-Stage to Membership: Israel, SerbiaIsrael, Serbia
Applicant States for Membership or Associate Membership:Applicant States for Membership or Associate Membership:Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine
Observers to Council:Observers to Council: India, Japan, Russia, Turkey, United States of America; India, Japan, Russia, Turkey, United States of America; European Commission and UNESCO European Commission and UNESCO
Member States:Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway, Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland and Poland, Portugal, Slovakia, Spain, Sweden, Switzerland and the United Kingdom the United Kingdom
Candidate for Accession: Candidate for Accession: RomaniaRomania
Associate Members in Pre-Stage to Membership: Associate Members in Pre-Stage to Membership: Israel, SerbiaIsrael, Serbia
Applicant States for Membership or Associate Membership:Applicant States for Membership or Associate Membership:Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine
Observers to Council:Observers to Council: India, Japan, Russia, Turkey, United States of America; India, Japan, Russia, Turkey, United States of America; European Commission and UNESCO European Commission and UNESCO
~ 2,300 staff~ 2,300 staff ~ 1,000 other paid personnel~ 1,000 other paid personnel > 11,000 users> 11,000 users
Budget (2013) ~1,000 MCHFBudget (2013) ~1,000 MCHF
~ 2,300 staff~ 2,300 staff ~ 1,000 other paid personnel~ 1,000 other paid personnel > 11,000 users> 11,000 users
Budget (2013) ~1,000 MCHFBudget (2013) ~1,000 MCHF
What are the Origins of Mass ?
19/09/2013 CERN Infrastructure Evolution 4
Matter/Anti Matter Symmetric?
19/09/2013 CERN Infrastructure Evolution 5
Where is 95% of the Universe?
19/09/2013 CERN Infrastructure Evolution 6
19/09/2013 CERN Infrastructure Evolution 7
19/09/2013 CERN Infrastructure Evolution 8
19/09/2013 CERN Infrastructure Evolution 9
Collisions
19/09/2013 CERN Infrastructure Evolution 10
A Big Data Challenge
19/09/2013 CERN Infrastructure Evolution 11
The CERN Meyrin Data Centre
19/09/2013 CERN Infrastructure Evolution 12
New Data Centre in Budapest
19/09/2013 CERN Infrastructure Evolution 13
Good News, Bad News
19/09/2013 CERN Infrastructure Evolution 14
We’re Not Special
19/09/2013 CERN Infrastructure Evolution 15
19/09/2013
Bamboo
Koji, Mock
AIMS/PXEForeman
Yum repoPulp
Puppet-DB
mcollective, yum
JIRA
Lemon /Hadoop /
LogStash /Kibana
OpenStack Nova
Hardware database
Puppet
Active Directory /LDAP
CERN Infrastructure Evolution 16
The Agile Experience
19/09/2013 CERN Infrastructure Evolution 17
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution 18
Status• Toolchain implemented in 18 months with
enhancements and bug fixes submitted back to the community
• Now in production in 3 OpenStack clouds (over 50,000 cores in total) in Geneva and Budapest managed by Puppet
• Target is more than 300,000 cores by 2015 and 90% compute resources in the private cloud
19/09/2013 CERN Infrastructure Evolution 19
Summary• Constraints on resources have led to major
technology transformations at CERN• Open source community participation helps
drive cultural change and motivates staff• CERN benefits and contributes back through
code and outreach
19/09/2013 CERN Infrastructure Evolution 20
Questions ?
19/09/2013 CERN Infrastructure Evolution 21
19/09/2013 CERN Infrastructure Evolution 22
Service Models
19/09/2013 CERN Infrastructure Evolution 23
• Pets are given names like pussinboots.cern.ch • They are unique, lovingly hand raised and cared for• When they get ill, you nurse them back to health
• Cattle are given numbers like vm0042.cern.ch• They are almost identical to other cattle• When they get ill, you get another one
19/09/2013 CERN Infrastructure Evolution 24
19/09/2013 CERN Infrastructure Evolution 25
http://www.eucalyptus.com/blog/2013/04/02/cy13-q1-community-analysis-%E2%80%94-openstack-vs-opennebula-vs-eucalyptus-vs-cloudstack
19/09/2013 CERN Infrastructure Evolution 26
19/09/2013 CERN Infrastructure Evolution 27
Tier-1 (11 centres):•Permanent storage•Re-processing•Analysis
Tier-0 (CERN):•Data recording• Initial data reconstruction•Data distribution
Tier-2 (~200 centres):• Simulation• End-user analysis
• Data is recorded at CERN and Tier-1s and analysed in the Worldwide LHC Computing Grid
• In a normal day, the grid provides 100,000 CPU days executing over 2 million jobs
19/09/2013 CERN Infrastructure Evolution 28
19/09/2013 CERN Infrastructure Evolution 29
Microsoft Active Directory
CERN DB on Demand
CERN Network Database
Account mgmt system
Horizon
Keystone
NetworkCompute
Glance
Scheduler
Cinder
Nova
Block Storage Provider
Training for Newcomers
19/09/2013 CERN Infrastructure Evolution 30
Buy the book rather than guru mentoring