open vstorage meetup - santa clara 04/16
TRANSCRIPT
![Page 1: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/1.jpg)
Wim Provoost (@wimpers_be)Open vStorage (@openvstorage)
http://www.openvstorage.com
A product by CloudFounders
![Page 2: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/2.jpg)
CloudFounders
vRUNConverged infrastructure that combines the benefits of the
hyperconverged approach yet offers independent compute
and storage scaling.
Open vStorage Core Storage Technology
FlexCloudA hosted private cloud based
on the vRun technology available at multiple data
centers world-wide.
A product by CloudFounders
![Page 3: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/3.jpg)
2 Types of StorageBlock Storage:•EMC, Netapp, ...•Virtual Machines•High perfomance, low latency •Small capacity, typically fixed size•Expensive•Zero-copy snapshots, linked clones•$/IOPS
Object Storage:•Swift, Cleversafe, ...•Unstructured data•Low performance, high latency•Large capacity, scalable •Inexpensive, commodity hardware•No high-end datamanagement features•$/GB
What is needed is a technology which offers Virtual Machines the performance and high-end features of a SAN but also the benefits
of the low cost and scale-out capabilities of object storage!
What is needed is a technology which offers Virtual Machines the performance and high-end features of a SAN but also the benefits
of the low cost and scale-out capabilities of object storage!
![Page 4: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/4.jpg)
What is Open vStorage
Open vStorage is an open-source superfast, scalable, VM-centric block storage solution for OpenStack on top of a pool of disks or Object Storage.
• Software-defined storage that runs on the host• Fault Tolerance and Reliability in software (no
dual controller needed)• VM centric architecture• Unlimited Snapshots• Tier 1 in flash/SSD on host (deduplicated)
• Flexible Storage Layout– HyperConverged– JBOD– Kinetic – Open Ethernet Drives– Object Storage
• Massive Scalability (100s of nodes 10,000+ VMs in a single cluster)
![Page 5: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/5.jpg)
The architecture
OpenStack
Scale-outVM VM
VM VM
SSDSSDSSDSSD
OpenvStorageOpenvStorage
OpenStack
VM VM
VM VM
SSDSSDSSDSSD
OpenvStorageOpenvStorage
OpenStack
VM VM
VM VM
SSDSSDSSDSSD
OpenvStorageOpenvStorage
Unified Namespace
S3 compatible Object Storageor a pool of (ethernet) drives
S3 compatible Object Storageor a pool of (ethernet) drives
Tier 1 - Location Based•Read/Write cache on SSD•Block based storage•Thin provisioning•VM Centric•Distributed Transaction Log
Tier 1 - Location Based•Read/Write cache on SSD•Block based storage•Thin provisioning•VM Centric•Distributed Transaction Log
Tier 2 -Time Based •Zero Copy Snapshot•Zero Copy Cloning•Continuous data protection•Redundant storage•Scale-out
Tier 2 -Time Based •Zero Copy Snapshot•Zero Copy Cloning•Continuous data protection•Redundant storage•Scale-out
![Page 6: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/6.jpg)
Changes in Open vStorage 2.1
• Improved performance – 50-70k iops per host– Multiple caching devices
• HyperConverged!!!!!!– Encryption, compression, forward error correction– Manage a pool of SATA drives as Tier2 storage
• Focus on OpenStack/KVM• Improved hardening against failure
– Seamless volume migration (no metadata rebuild)
Release date: now!
![Page 7: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/7.jpg)
How does OpenStack and Open vStorage play along
![Page 8: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/8.jpg)
2 Types of StorageBlock Storage:•EMC, Netapp, ...•Virtual Machines•High perfomance, low latency •Small capacity, typically fixed size•Expensive•Zero-copy snapshots, linked clones•$/IOPS
Object Storage:•Swift, Cleversafe, ...•Unstructured data•Low performance, high latency•Large capacity, scalable •Inexpensive, commodity hardware•No high-end datamanagement features•$/GB
What is needed is a technology which offers Virtual Machines the performance and high-end features of a SAN but also the benefits
of the low cost and scale-out capabilities of object storage!
What is needed is a technology which offers Virtual Machines the performance and high-end features of a SAN but also the benefits
of the low cost and scale-out capabilities of object storage!
![Page 9: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/9.jpg)
OpenStack Swift: some highlights
• Designed to store unstructered data in a cost-effictive way– Use low cost, large capacity SATA disks– Increase capacity by adding more disk/servers when needed– Increase performance by adding spindles/proxies
• High reliability by distributing content across disks– 3 way replication– Erasure coding (on the roadmap)
• Easy to manage (no knowledge needed about RAID or volumes)
ProxyProxy ProxyProxy
StorageNode
StorageNode
StorageNode
StorageNode
StorageNode
StorageNode
![Page 10: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/10.jpg)
Cinder: some highlights
• Cinder provides an infrastructure/API for managing volumes on OpenStack. – Volume create, delete, list, show, attach, detach, extend– Snapshot create, delete, list, show – Backups create, restore, delete, list, show – Manage volume types, quotas– Migration
• By default Cinder uses local disks but plugins allow additional storage solutions to be used:– External appliances: EMC, Netapp, SolidFire– Software solutions: GlusterFS, Ceph, …
![Page 11: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/11.jpg)
Cinder with local disks has some problems ...
I S C S I
Nova
Cinder
ManagementNightmare!
![Page 12: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/12.jpg)
A traditional OpenStack setup
NovaInstance
Management
NovaInstance
Management
SwiftObject Storage
SwiftObject Storage
CinderBlock Storage
CinderBlock Storage
GlanceImage store
GlanceImage store
VMVM
Provides volume for
Provisions
Stores image in
Stores backups in
Provides image for
SAN, NAS, ...SAN,
NAS, ...
Provides disk space
2 storage platforms?! 2 storage platforms?!
![Page 13: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/13.jpg)
“Swift under Cinder”?
• Eventual consistency (the CAP Theorem)
• Latency & performance– VMs require low latency and high performance– Object stores are developed to contain lots of data
(large disks, low performance)– Additional latency as Object Store is on the Local LAN instead of attached to the host like DAS
• Different Management Paradigms– Object Stores understand Objects <> Hypervisors understand blocks, files
![Page 14: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/14.jpg)
Open vStorage & OpenStack
NovaInstance
Management
NovaInstance
Management
SwiftObject Storage
SwiftObject Storage
CinderBlock Storage
CinderBlock Storage
GlanceImage store
GlanceImage store
VMVM
Provides volume for
Provisions
Stores image in
Stores backups in
Provides image for
Provides disk space Open vStorage Open vStorageConverts Object Storage
into Block Storage
![Page 15: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/15.jpg)
Get Started with Open vStorage
![Page 16: Open vStorage Meetup - Santa Clara 04/16](https://reader030.vdocuments.us/reader030/viewer/2022032714/55abd6841a28ab334b8b45c0/html5/thumbnails/16.jpg)
Get the software
• The unrestricted open-source version– Open vStorage as open-source software is released under the Apache License, Version 2.0– Backends: S3 compatible object storage (Swift, Ceph, ...)– Free community help-forum : https://groups.google.com/forum/?hl=en#!forum/open-vstorage– You can contribute: https://bitbucket.org/openvstorage/
• Free community version– Open-source version + limited hyperconverged backend (max. 49 volumes, 4 nodes, 16 disks)– Free community help-forum : https://groups.google.com/forum/?hl=en#!forum/open-vstorage
• Paying version with 24/7 support (Open vStorage & OpenStack)– GA release June 2015