introduce leofs
TRANSCRIPT
![Page 1: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/1.jpg)
27th July 2012Yosuke Hara
You can rely on whenever you need.
Yosuke HaraJuly 28th, 2012
![Page 2: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/2.jpg)
We launched LeoFS as OSS on July 4th.LeoFS - http://www.leofs.org
![Page 3: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/3.jpg)
Motivation
![Page 4: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/4.jpg)
1. Low ROI2. Possibility of SPOF3. Storage Expansion is difficult during increasing data
?
Motivation
NFS - Very Expensive
![Page 5: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/5.jpg)
X 3.5 762B
220B
Motivation
![Page 6: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/6.jpg)
Object Storage Farm
![Page 7: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/7.jpg)
S3FS-C
Object Storage Farm
Unstructured data
![Page 8: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/8.jpg)
8
Object Storage Farm
![Page 9: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/9.jpg)
Overview
![Page 10: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/10.jpg)
LeoFS Overview
![Page 11: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/11.jpg)
LeoFS-Manager
LeoFS-Gateway
LeoFS-Storage
REST over HTTP
RPC
Request from Web Application(s) or Browser
META Object Store
Storage Engine/Router
META Object Store META Object Store
RPC
Storage Engine/Router Storage Engine/Router
Load Balancer
S3-API
SNMP
GUI Console
LeoFS Overview
GatewayHTTP
Request/Response Handling+
w/Object Cache(AWS S3-API)
ManagerCluster
Management
Ring WatcherNode Watcher
StorageObject Storage, Meta data Storage
+Replicator/Recoverer
LeoFS Overview
![Page 12: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/12.jpg)
LeoFS-Manager
LeoFS-Gateway
LeoFS-Storage
REST over HTTP
RPC
Request from Web Application(s) or Browser
META Object Store
Storage Engine/Router
META Object Store META Object Store
RPC
Storage Engine/Router Storage Engine/Router
[Load Balancer]
S3-API
SNMP
GUI Console
LeoFS Overview
![Page 13: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/13.jpg)
Minimum for Service (App) Dev
Manager x 1 Gateway x 1 Storage x 1
50TB Storage System (# of replicas = 3)
Manager x 2 Gateway x 3 .. Storage x 8 - 15
10TB .. 20TB / server
300TB Storage System (# of replicas = 3)
Manager x 2 Gateway x 4 .. Storage x 45 - 90
10TB .. 20TB / server
LeoFS Overview - Example of System layouts
XEN, VMWare,...
XEN, VMWare,...
![Page 14: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/14.jpg)
Inside LeoFS
![Page 15: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/15.jpg)
Manager Cluster
Storage Cluster
Gateway
Process Monitor
Erlang RPC
HTTP
Erlang RPC
Erlang RPC
LeoFS Architecture
Object Cache
![Page 16: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/16.jpg)
Erlang/OTP Runtime
Gateway REST over HTTP (S3-API)
membership (fault-detection)
redundant-manager replicator
queue
Storage Engine
Object Storage Metadata
Storage
read-repairer
redundant-manager membership (fault-detection)
get put delete head
RPC
RPC RPC
LeoFS Architecture - Gateway / Storage
![Page 17: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/17.jpg)
Erlang Mnesia
Gateway(s) / Storage Cluster
RING, Member / Cluster State, AuthProcess Monitor
LeoFS Architecture - Manager
![Page 18: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/18.jpg)
LeoFS Gateway
![Page 19: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/19.jpg)
Gateway
From Applications (Clients)
replicate when using RPC
Consistent Hashing - Horizontal Distribution
Erlang RPC
S3-API
Object Cache
Storage Nodes
LeoFS Gateway
![Page 20: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/20.jpg)
Storage Engine
![Page 21: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/21.jpg)
...
LeoFS Storage
Object Storage
LeoFS Storage Engine
Metadata : Keeps an in-memory index of all data.Object Storage : Log structured (append-only) object store.
Request From Gateway
replicatorrepairer
queue
![Page 22: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/22.jpg)
< META DATA >IDFilenameOffsetSizeChecksum Metadata
Data
Object Container
Header
File
Footer
< META DATA >IDFilenameOffsetSizeChecksum
LeoFS Storage Engine
LeoFS Storage Engine - Retrieve an object from the storage
Log Structured File System
![Page 23: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/23.jpg)
Append an object
Data
Add a Metadata
LeoFS Storage Engine - Insert an object into the storage
Metadata
Log Structured File System
![Page 24: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/24.jpg)
Compaction
OLD Object Container
NEW Object Container
LeoFS Storage Engine - Reduce unnecessary objects from the storage
Log Structured File System
![Page 25: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/25.jpg)
LeoFS Manager
![Page 26: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/26.jpg)
Manager
For AdministratorsLeoFS Manager
monitor
operate
RING, Node State
status, suspend,resume, detach, whereis, ...
![Page 27: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/27.jpg)
Future Works
![Page 28: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/28.jpg)
Future Works - Leo Tamer
Operation Center
Log Analyzer / Searcher
![Page 29: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/29.jpg)
Future Works - Integrated HBase with LeoFS
+“Cloud DWH” =
![Page 30: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/30.jpg)
Wrap Up
![Page 31: Introduce LeoFS](https://reader033.vdocuments.us/reader033/viewer/2022052900/55615705d8b42a8a7d8b54b6/html5/thumbnails/31.jpg)
LeoFS can realize 3-HIGHs - HIGH Cost performanceHIGH ReliabilityHIGH Scalability