cern's grand collision experiment: cloud from structure:europe 2013
DESCRIPTION
Presentation from Tim Bell, CERN #structureeurope More at http://event.gigaom.com/structureeurope/TRANSCRIPT
Tuesday, October 1, 13
CERN’S GRAND COLLISION EXPERIMENT: CLOUD
SPEAKER: Tim BellInfrastructure ManagerCERN
Tuesday, October 1, 13
Tuesday, October 1, 13
@noggin143
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
CERN was founded 1954: 12 European States “Science for Peace”
Today: 20 Member States
Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland and the United Kingdom Candidate for Accession: RomaniaAssociate Members in Pre-Stage to Membership: Israel, SerbiaApplicant States for Membership or Associate Membership:Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine Observers to Council: India, Japan, Russia, Turkey, United States of America; European Commission and UNESCO
~ 2,300 staff ~ 1,000 other paid personnel > 11,000 users Budget (2013) ~1,000 MCHF
Tuesday, October 1, 13
What are the Origins of Mass ?
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Matter/Anti Matter Symmetric?
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Where is 95% of the Universe?
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Collisions
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
A Big Data Challenge
19/09/2013 CERN Infrastructure Evolution 11
Tuesday, October 1, 13
The CERN Meyrin Data Centre
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
New Data Centre in Budapest
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Good News, Bad News
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
We’re Not Special
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
19/09/2013
Bamboo
Koji, Mock
AIMS/PXEForeman
Yum repoPulp
Puppet-DB
mcollective, yum
JIRA
Lemon /Hadoop /
LogStash /Kibana
OpenStack Nova
Hardware database
Puppet
Active Directory /LDAP
CERN Infrastructure Evolution
Tuesday, October 1, 13
The Agile Experience
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Status• Toolchain implemented in 18 months with
enhancements and bug fixes submitted back to the community
• Now in production in 3 OpenStack clouds (over 50,000 cores in total) in Geneva and Budapest managed by Puppet
• Target is more than 300,000 cores by 2015 and 90% compute resources in the private cloud
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Summary• Constraints on resources have led to major
technology transformations at CERN• Open source community participation helps
drive cultural change and motivates staff• CERN benefits and contributes back through
code and outreach
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Questions ?
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
Service Models
19/09/2013 CERN Infrastructure Evolution
• Pets are given names like pussinboots.cern.ch • They are unique, lovingly hand raised and cared for• When they get ill, you nurse them back to health
• Cattle are given numbers like vm0042.cern.ch• They are almost identical to other cattle• When they get ill, you get another one
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
http://www.eucalyptus.com/blog/2013/04/02/cy13-q1-community-analysis-%E2%80%94-openstack-vs-opennebula-vs-eucalyptus-vs-cloudstack
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
Tier-‐1 (11 centres):•Permanent storage•Re-‐processing•Analysis
Tier-‐0 (CERN):•Data recording•Ini7al data reconstruc7on•Data distribu7on
Tier-‐2 (~200 centres):• Simula7on• End-‐user analysis
• Data is recorded at CERN and Tier-1s and analysed in the Worldwide LHC Computing Grid• In a normal day, the grid provides 100,000 CPU days executing over 2 million jobs
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
Tuesday, October 1, 13
19/09/2013 CERN Infrastructure Evolution
Microsoft Active Directory
CERN DB on Demand
CERN Network Database
Account mgmt system
Horizon
Keystone
NetworkCompute
Glance
Scheduler
Cinder
Nova
Block Storage Provider
Tuesday, October 1, 13
Training for Newcomers
19/09/2013 CERN Infrastructure Evolution
Buy the book rather than guru mentoring
Tuesday, October 1, 13
Tuesday, October 1, 13