opennebulaconf 2013 - opennebula in a multi-customer-environment by bernd erk

www.netways.de // blog.netways.de // @netways

We love Open Source #opennebulaconf

OPENNEBULACONF – 25TH OCTOBER 2013

OPENNEBULA IN A MULTI- CUSTOMER ENVIRONMENT

BERND ERK | NETWAYS GMBH



AGENDA

￭  Introduction ￭  Use case & Requirements ￭  History ￭  Today‘s Architecture ￭  Configuration Management ￭  Monitoring & Reporting ￭  Coming up ￭  Questions & Answers



INTRODUCTION NETWAYS

•  Founded 1995 •  Open Source since 1997

•  40 Employees

•  Specialized in Open Source Systems Management and Open Source Datacenter Infrastructure

Searching for awesome people!



NETWAYS COMPETENCIES

•  Monitoring & Reporting

•  Configuration Management

•  Service Management

•  Knowledge Management

•  Backup & Recovery

•  High Availability & Clustering

•  Cloud Computing

•  Load Balancing

•  Virtualization

•  Database Management

OPEN SOURCE SYSTEMS MANAGEMENT

OPEN SOURCE DATA CENTER

MANAGED SERVICES MONITORING HARDWARE CONFERENCES



PuppetCamp 2013/2014 •  28th November Munich •  11th April Berlin •  CfP is still open

Open Source Datacenter Conference •  8th – 10th April 2014 •  125 Attendees (2012) •  Datacenter | Automation | DevOps •  CfP open until 31th December 2013

OpenNebulaConf 2014 •  opennebulaconf.com •  2nd – 4th December 2014 •  Berlin

NETWAYS CONFERENCES



INTRODUCTION OPENNEBULA



USE CASE & REQUIREMENTS



USE CASE



REQUIREMENTS

￭  High Availability •  Automatic Failover

￭  Flexible Resources •  Resource allocation and accounting •  Isolation of noisy neighbours

￭  Independent Storage Architecture •  Persistent Images on existing technologies

￭  Client isolation •  Networking •  Monitoring



HISTORY



ARCHITECTURE - 2007

100% BareMetal



ARCHITECTURE - 2010

XEN

XEN

XEN

XEN

XEN

XEN

XEN

XEN

XEN

NFS on NetApp Filer



ARCHITECTURE – 2010 - PROBLEMS

￭  Missing overview •  Monitoring driven reboot •  Missing priorities •  No logic grouping on servers

￭  XEN-Problems •  Kernel in Debian •  Sometimes compatibility issues with Dell-HW

￭  No API •  Missing accounting •  Clear path for Puppet integration

XEN

XEN

XEN

XEN

XEN

XEN

XEN

XEN

XEN

NFS on NetApp Filer



WHAT NOW?

OpenStack

OpenNebula

Nigel Beighton (Rackspace)



DEPENDS ON THE PERSPECTIVE

￭  Technical Guy •  There is a tool for every customer

￭  Sales Guy •  There is a customer for every tool



WHAT WE DID?



TODAY’S ARCHITECTURE



ARCHITECTURE - 2012



ARCHITECTURE - 2012

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

NFS on NetApp Filer



ARCHITECTURE – 2012- CHALLENGES

￭  Failover •  Split-Brain situation

￭  NetApp •  We want to get rid of it •  No financial scaling

￭  Choosing the right filesystem •  OCFS2 sucks (sometimes) •  Ceph is nearly stable •  GlusterFS implementation is not (yet) ready

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

NFS on NetApp Filer



ARCHITECTURE – 2012- SOLUTIONS

￭  Pacemaker is controlling the stack •  Checking libvirt is important!

￭  Stonith – if something looks creepy ￭  Still working on NetAPP-NFS ￭  GlusterFS seems to be good for now •  Working on better integration in ONE •  First tests are promising

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

NFS on NetApp Filer



REPORTING & MONITORING



MONITORING - ICINGA



MONITORING - GRAPHING



REPORTING & ACCOUNTING



CONFIGURATION MANAGEMENT



PUPPET

￭  Puppet •  Configuration Management based on Ruby •  Life-Cylce-Management and Provisioning •  Live Management using MCollective

￭  How it works •  Puppet DSL (Domain Specific Language) •  Abstracted through Resource Abstraction Layer •  Define -> Simulate -> Enforce - > Report



PUPPET ENTERPRISE / FOREMAN

￭  Puppet Enterprise •  Graphical Interface •  Great Live Management

￭  Foreman •  Open Source interface for Puppet •  http://theforeman.org •  Great interface and additional features like •  Unattended Installation •  Integration of cloud frameworks



FOREMAN – VIRT-HOSTS



FOREMAN – PUPPET-CLASSES



FOREMAN – PUPPET - LIFECYLE

Configuration (Hiera, PuppetDB)

Dry Run using MCollective

Continuous Testing

Merge Environm

ents

Final Test

Rollout



FOREMAN – PUPPET - LOADBALANCER

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

KVM

NFS on NetApp Filer

LB 1 LB 2



COMING UP



WHAT’S NEXT?

￭  Update OpenNebula to 4.2 ￭  Using GlusterFS •  Did some first tests with new qemu-versions •  GlusterFS-Support since version 1.3

￭  Fully automated provisioning of all systems including networking, backup and monitoring -> Software Defined Infrastructure

￭  Kicking out NetApp-Filer ￭  Adding new Nodes :-)



QUESTIONS & ANSWERS



NETWAYS GmbH Deutschherrnstrasse 15-19 90429 Nuremberg

Tel: +49 911 92885-0

Fax: +49 911 92885-77 Email: [email protected]

Website: www.netways.de Twitter: twitter.com/netways Facebook: facebook.com/netways

Blog: blog.netways.de

QUESTIONS & ANSWERS

THANK YOU

SEE YOU NEXT YEAR 2ND – 4TH

DECEMBER 2014

opennebulaconf 2013 - opennebula in a multi-customer-environment by bernd erk

Technology