opennebulaconf 2013 - making clouds: turning opennebula into a product by carlo dafara
DESCRIPTION
What does it takes to bring innovations like private clouds to small and medium enterprises? In the course of this talk we will present our experience in creating a self-service toolkit for creating a complete virtualization and cloud platform based on OpenNebula, as well as our experience gathered in tens of installations of all sizes. From scalable storage (with benchmarks!) to autonomic optimization, we will present what in our view is needed to bring private clouds to everyone, what components and additions we created to better solve our customers’ problems (from replacing industrial control systems to medium scale virtual desktop infrastructures), and why OpenNebula has been chosen over other competing cloud toolkits. Bio: Carlo Daffara the Technical director of Cloudweavers, and formerly head of research and development at Conecta, a consulting firm specializing in open source systems and distributed computing; Italian member of the European Working Group on Libre Software and co-coordinator of the working group on SMEs of the EU ICT task force on competitiveness. Since 1999, works as evaluator for IST programme submissions in the field of component-based software engineering, GRIDs and international cooperation. Coordinator of the open source platforms technical area of the IEEE technical committee on scalable computing, co-chair of the SIENA EU cloud initiative roadmap editorial board and part of the editorial review board of the International Journal of Open Source Software & Processes (IJOSSP).TRANSCRIPT
Making clouds:turning OpenNebula into a product
Carlo Daffara, CloudWeavers
The Cloud extends the traditional advantages of “ ”virtualization platforms to scale-out software. It is an opportunity to rethink hardware deployment ...
…it does not means that all clouds need to be public
http: blippex.github.io updates 2013 09 23 why-we-moved-away-from-aws.html// / / / / /
Why OpenNebula?
Four major platforms:•CloudStack•Eucalyptus•OpenNebula•OpenStack
Lots of minor ones:Proxmox, Ovirt, Ganeti, OpenQRM, Enomaly, Archipel...
Let's debate first about what architecture we are aiming for. OpenStack & Eucalyptus are modeled and structured around AWS EC2, that is the clear market leader in /the public cloud market.
Service Manager database 8-core 2.66 gigahertz (GHz) CPU 8 gigabytes (GB) of RAM 80 GB of available disk space RAID Level 1 or Level 10 drive*
Service Manager management server 4-Core 2.66 GHz CPU 8 GB of RAM 10 GB of available disk space
Service Manager console 2-core 2.0 GHz CPU 4 GB of RAM 10 GB of available disk space
Data warehouse management server 4-Core 2.66 GHz CPU 8 GB of RAM 10 GB of available disk space
Data warehouse databases 8-core 2.66 GHz CPU 8 GB of RAM 400 GB of available disk space RAID Level 1 or Level (1+0) drive
Self-Service Portal: Web Content Server with SharePoint Web Parts
8-Core 2.66 GHz CPU 8-core, 16GB RAM, 80 GB of available hard disk space
http: technet.microsoft.com en-us library hh524328.aspx// / / /
CloudStack 3.22MLoc
Eucalyptus 1.43MLoc
OpenStack 1.67MLoc
OpenNebula 190KLoc
I O Access pattern/ I O Characteristics/ Typical Applications
Streaming Reads 100 Reads; Large contiguous requests; 1-64 %concurrent requests. May be threaded.
Media Servers ( ideo on-demand, etc.). Virtual Tape Libraries ( TL), Application V V
Servers
Streaming Writes 100 Writes; Large contiguous requests; 1-64 %concurrent requests. May be threaded.
Media Capture, TL, Medical Imaging, VArchiving, Backup, ideo Surveillance, VReference Data
OLTP Typically 2KB 16KB request sizes; Read modify, –write, verify operations resulting in 2 reads for every write; Primarily random accesses. Large number of concurrent requests. When running SQL statements in parallel, Database will perform typically large random I Os./
Databases (SAP, Oracle, SQL), Online Transaction Servers
File Server Moderate distribution of request sizes from 4KB to 64KB, however 4KB and 64KB comprise 70 of %requests; Primarily random; Generally 4 reads for every write operation. Large number of concurrent requests during peak operational periods.
File and Printer Servers, e-mail (Exchange, Notes), Decision Support Systems
Web Server Wide distribution of request sizes from 512 bytes to 512KB; Primarily random accesses; Large number of concurrent requests during peak operational periods
Web Services, Blogs, RSS Feeds, Shopping Carts, Search Engines, Storage Services
Workstations Primarily small to medium request sizes; 80 %sequential and 20 random; Generally 4 reads for %every write operation. 1-4 concurrent requests.
Business Productivity, Scientific Engineering /Applications
http: gerardnico.com wiki data storage input output access pattern// / / _ / _ _ _
Some additional tips for Windows:
• K M badly interacts with Windows 7 8 clock drivers, causing high cpu V /consumption. Use:bcdedit /set {default} useplatformclock trueand RAW = [ type= "KVM", data = "<clock offset='localtime'/>" ]
• “Default cirrus GA driver unsuitable for Windows due to pathological Vperformance issues in text mode”This is not a problem in latest K M, however having vga std is better V =anyway
• For Windows servers with lots of small files:fsutil behaviour set disablelastaccess 1(equivalent to noatime on linux)fsutil behaviour set mftzone 2(adds another 12.5 disk space to the MFT zone)%
• Disable 8.3 namespace creation:fsutil.exe behavior set disable8dot3 1(huge boost for dirs, files with matching initial names)
Some useful additions:GateOne (https: github.com liftoff GateOne// / / ) a very efficient web SSH interface, similar to vncproxy. Works well added as a link in Sunstone.
M ray (https: github.com coriolis vmxray): a pure javascript M V X // / / Vexplorer, allows to enter inside of an image, view and extract files.
Some additional tools:
LibGuestFS (http: libguestfs.org// /) the swiss army knife of M images. Allows Vfor copy in and out of a M, file operations, mount guest filesystem on host, VWindows registry editing...
S3QL (http: code.google.com p s3ql// / / /) a FUSE filesystem that mounts and operates on Amazon S3, Google storage and OpenStack-compatible storage. Supports compression, encryption and deduplication. Quite useful if you want to move images to-from Amazon or Google.
IPOP (http: www.grid-appliance.org wiki index.php IPOP// / / / ) IPOP (IP over P2P) is an open-source research development project that provides a decentralized, /distributed overlay virtual network. It allows users to easily deploy PNs Vacross multiple domains, and is used in applications including virtual private clusters for cloud grid computing./
Only thin features added directly to the platform...“ ”
We use Ms to provide additional features:V
Guacamole (http: sourceforge.net projects guacamole// / / /) exceptional gateway that turns RDP into HTML5. Allows for pure web-based access to Windows desktops from everywhere:
Other examples: Zenoss for agentless monitoring (or Hyperic for agent-based monitors), backup tools like OpenDedup...
A special note on DI:V
Jerry Chen of Mware is generally credited with coining the term DI which V “V ”led to the redefinition of an entire industry. Mware had 10,400 employees. VOf that group, about one-third of them use DI-based virtual desktops as their Vprimary production work desktops. About 1,000 of them use a thin-client device as their only corporate-issued client device.
First problem: Microsoft licensing. “dedicating an entire Remote Desktop virtual server to just one single user is cheaper than most DI scenarios and gives users the same benefits, namely Vhaving their own Desktop M where they can do what they want. This single ‘ ’ V ‘user terminal server scenario is with about 475 per user (6 years) not only ’ – $60 cheaper, but less complicated and legally more safe than standard MS %
DI licensing. Decoding the Microsoft DI Licensing Arcanum, Login V " VConsulting
A useful trick: on hook RUNNING increase the readahead of the rotative “ ”medium (blockdev --setra 2048 or higher); you can reduce the boot time of a Windows7 machine by 35 . You time it to return to much lower values %after a predetermined interval.
Apps are moving to be pure webapps, no client installation needed so “ ” –you can skip Windows. Having the M ready to use also facilitates the Vadoption of new tools, and lots of experimentation. Locally hosted Ms that Vexport a web application are becoming the norm, and you can remote the remaining Windows apps through RDP, so you are actually free to build your desktop as you like. Royal Academy of Engineering, The future of computing , 2012“ ”
We have our own thin desktop based on Linux called EveryDesk (http://sourceforge.net/projects/everydesk/) that requires just 90MB of ram per desktop, or for the more daring users:
..you can use ChromeOS from Google. There is an unofficial build for 86 Xand x86 64 available daily here (_ http://chromium.arnoldthebat.co.uk/) that runs perfectly within OpenNebula. You create the images as non-persistent, and destroy them later on.Bt using a WB cache and snapshots to create the non-persistent images you end up with most of the pages already in cache, so boot is nearly instantaneous. Write are small and sparse, so you are basically CPU-bound and can run reasonably well 10-15 ChromeOS desktops per core.
38 , 5W, no moving part. Use Android aSPICE as a client+Autostart$
The MTBF of a standard PC is 30,000 hours or 3.4 years; for every 10c temperature increase, MTBF is cut in half. Since in many pc closet the “ ”temperature is 10 to 20 degrees higher, we assume a MTBF of 1yr.
4pc cloud: 4 failures yr, Ms on failed node are down for 5-10 mins - 20 / V >to 40 min year, 99.99 assuming available power/ %
Availability per day per month per year
99.999% 00:00:00.4 00:00:26 00:05:15
99.99% 00:00:08 00:04:22 00:52:35
99.9% 00:01:26 00:43:49 08:45:56
99% 00:14:23 07:18:17 87:39:29
