![Page 2: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/2.jpg)
FOSDEM, 31 January 2015 2
Agenda
● Introduction into GlusterFS
● Quick Start
● Current stable releases
● History of feature additions
● Plans for the upcoming 3.7 release
● Expectations of the next major release
![Page 3: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/3.jpg)
FOSDEM, 31 January 2015 3
What is GlusterFS?
● Scalable, general-purpose storage platform
● POSIX-y Distributed File System● Object storage (swift)● Distributed block storage (qemu)● Flexible storage (libgfapi)
● No Metadata Server
● Heterogeneous Commodity Hardware
● Flexible and Agile Scaling
● Capacity – Petabytes and beyond● Performance – Thousands of Clients
![Page 4: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/4.jpg)
FOSDEM, 31 January 2015 4
Terminology
● Brick
● Fundamentally, a filesystem mountpoint● A unit of storage used as a capacity building block
● Translator
● Logic between the file bits and the Global Namespace● Layered to provide GlusterFS functionality
![Page 5: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/5.jpg)
FOSDEM, 31 January 2015 5
Terminology
● Volume
● Bricks combined and passed through translators● Ultimately, what's presented to the end user
● Peer / Node
● Server hosting the brick filesystems● Runs the Gluster daemons and participates in
volumes● Trusted Storage Pool
● A group of peers, like a “Gluster cluster”
![Page 6: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/6.jpg)
FOSDEM, 31 January 2015 6
Distributed Volume
● Files “evenly” spread across bricks
● Similar to file-level RAID 0
● Server/Disk failure could be catastrophic
![Page 7: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/7.jpg)
FOSDEM, 31 January 2015 7
Replicated Volume
● Copies files to multiple bricks
● Similar to file-level RAID 1
![Page 8: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/8.jpg)
FOSDEM, 31 January 2015 8
Distributed Replicated Volume
● Distributes files across replicated bricks
![Page 9: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/9.jpg)
FOSDEM, 31 January 2015 9
Data Access Overview
● GlusterFS Native Client
● Filesystem in Userspace (FUSE)● NFS
● Built-in Service, NFS-Ganesha with libgfapi● SMB/CIFS
● Samba server required (libgfapi based module)● Gluster For OpenStack (Swift-on-file)
● Simultaneous object-based access via Swift● libgfapi flexible abstracted storage
● Integrated with QEMU, Bareos and others
![Page 10: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/10.jpg)
FOSDEM, 31 January 2015 10
Quick Start
● Available in Fedora, Debian, NetBSD and others
● Community packages in multiple versions for different distributions on http://download.gluster.org/
● CentOS Storage SIG packages and add-ons
● Quick Start guides on http://gluster.org and CentOS wiki
![Page 11: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/11.jpg)
FOSDEM, 31 January 2015 11
Quick Start
1.Install the packages (on all storage servers)
2.Start the GlusterD service (on all storage servers)
3.Peer probe other storage servers
4.Create and mount a filesystem to host a brick
5.Create a volume
6.Start the new volume
7.Mount the volume
![Page 12: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/12.jpg)
FOSDEM, 31 January 2015 12
Current stable releases
● Maintenance of three minor releases
● 3.6, 3.5 and 3.4● Bugfixes only, non-intrusive features on high demand
● No fixed release schedule (yet?)
● Patches get backported to fix reported bugs
![Page 13: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/13.jpg)
FOSDEM, 31 January 2015 13
Features included in version 3.4
● WORM: Write Once Read Many
● Operating versions for GlusterD
● Block device translator
● Duplicate Request Cache (used with NFS)
● Server Quorum
● libgfapi for native GlusterFS support in applications
● Eager Locking
● NFSv3 ACL support
![Page 14: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/14.jpg)
FOSDEM, 31 January 2015 14
Features included in version 3.5
● File Snapshot for qcow2 files
● GFID access
● On-Wire (de)compression
● Quota Scalability
● Readdir ahead
● Zerofill
● Brick Failure Detection
● Parallel geo-replication
![Page 15: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/15.jpg)
FOSDEM, 31 January 2015 15
Features included in version 3.6
● Improved SSL support
● Heterogeneous bricks
● Volume wide locks for GlusterD
● Volume Snapshots
● User Serviceable Snapshots
● AFR refactor
● RDMA improvements
● Disperse translator for Erasure Coding
![Page 16: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/16.jpg)
FOSDEM, 31 January 2015 16
Plans for the upcoming 3.7 release
Feature freeze at the end of February
● Small-file performance enhancements
● Tiering, rack-aware placement and more
● Trash translator for undelete operations
● Netgroups and advanced exports configuration (NFS)
● BitRot detection
● Support for NFS Ganesha clusters
![Page 17: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/17.jpg)
FOSDEM, 31 January 2015 17
Data Classification in 3.7
● Mapping file characteristics to subvolume characteristics
● File characteristics:
● Size, age, access rate, type (filename extension)● Subvolume characteristics:
● Physical location, storage type, encoding method● User provided mapping via 'tags'
● Implemented using 'DHT over DHT' pattern
![Page 18: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/18.jpg)
FOSDEM, 31 January 2015 18
Netgroups and Exports for NFS in 3.7
● More advanced configuration for authentication based on /etc/exports like syntax
● Support for netgroups
● Patches written by Facebook developers
● Forward ported from 3.4 to 3.7
● Cleanups and posted for review
![Page 19: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/19.jpg)
FOSDEM, 31 January 2015 19
NFS Ganesha support in 3.7
● Optionally replaces Gluster/NFS
● Supports NFSv4 with Kerberos
● pNFS support for Gluster Volumes follows later● Modifications to Gluster internals
● Upcall infrastructure● Gluster CLI to manage NFS Genesha● libgfapi improvements
● High-Availability based on Pacemaker and Corosync
![Page 20: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/20.jpg)
FOSDEM, 31 January 2015 20
Plans for the next 4.0 release
● Intended for scalability and manageability improvements
● Support for multiple networks
● New Style Replication
● Improved Distributed hashing Translator
● Composite operations in the GlusterFS RPC protocol
● Coherent client-side caching
● Native ReST APIs for management and monitoring
● ... and much more
![Page 21: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/21.jpg)
FOSDEM, 31 January 2015 21
GlusterFS 4.0 – What's next?
● Code name for the release? Open to suggestions
● Submissions for feature proposals is still open!
● Implementing of key features has started
● Voting on feature proposals during design summit
● Tentatively planned for March/April timeframe
![Page 22: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/22.jpg)
FOSDEM, 31 January 2015 22
Integration in other projects
● oVirt for easier installation, management and monitoring
● Nagios for improved monitoring and alerting
● OpenStack Manila (filesystem service)
● Hadoop plugin offers an alternative for HDFS
● Bareos Gluster File Daemon plugin
● … and many others
![Page 23: GlusterFS Current Features & Roadmap - FOSDEM · PDF fileFOSDEM, 31 January 2015 2 Agenda Introduction into GlusterFS Quick Start Current stable releases History of feature additions](https://reader036.vdocuments.us/reader036/viewer/2022062907/5aaac76c7f8b9a6c188ea6a1/html5/thumbnails/23.jpg)
FOSDEM, 31 January 2015 23
Resources
Mailing lists:[email protected]@gluster.org
IRC:#gluster and #gluster-dev on Freenode
Links:http://gluster.org/http://forge.gluster.org/http://www.gluster.org/community/documentation/http://gluster.org/presos.php