high availability and file hosting service (owncloud)

Download high availability And File hosting service (OwnCloud)

If you can't read please download the document

Upload: mahdi-ataeyan

Post on 16-Apr-2017

1.334 views

Category:

Internet


2 download

TRANSCRIPT

File hosting service

Mahdi Ataeyan

Website: www.ataeyan.com

Twitter: @kalpase

In simple Cloud computing is using the internet to access someone else's software running on someone else's hardware in someone else's data center.

BaaSdesktop as a service (DaaS)backend as a service (BaaS) MBAASAuthentication as a serviceXAAS

Software as a Service (SaaS) is a software distribution model in which applications are hosted by a vendor or service provider and made available to customers over a network, typically the Internet.

On-demand

Gmail. Google doc. Accounting

Richard Stallman:
It's stupidity. It's worse than stupidity: it's a marketing hype campaign.Cloud computing is a trap

from: www.backblaze.com

Mobile clients for iOS and Android devices

desktop clients for Windows, OS X, FreeBSD or Linux

Web Browser

PHPJavaScriptsabre/dav open-source WebDAV serverSQLiteMariaDBMySQLOracle DatabasePostgreSQL

Sabre Saiber

Web Distributed Authoring and Versioning (WebDAV) is an extension of the HTTP that allows clients to perform remote Web content authoring operations.

The WebDAV protocol provides a framework for users to create, change and move documents on a server, typically a web server or web share.

Apache HTTP Server provides WebDAV modules based on both davfs and Apache Subversion (svn).Microsoft's IIS also has a WebDAV module.

WebDAV

CardDAV

vCard Extensions to WebDAV (CardDAV) is an address book client/server protocol designed to allow users to access and share contact data on a server.

Apple Contacts ServerAtmail,GMail and Google Contacts allow access to user's address book via CardDAVGroup-OfficeZimbra 6 allows access to its address book via CardDAV

CalDAV

Calendaring Extensions to WebDAV, or CalDAV, is an Internet standard allowing a client to access scheduling information on a remote server. It extends WebDAV (HTTP-based protocol for data manipulation) specification and uses iCalendar format for the data.

OwnCloud SMS

Send SMS to cloud

The News app is an RSS/Atom feed reader which can be synced with many mobile devices.

Other

Encryption of user files

Calendar (also as CalDAV)

Task scheduler.

Address book (also as CardDAV)

Music streaming (through Ampache)

Online text editor with syntax highlighting and code folding

Other

Bookmarking

URL shortening Suite

Photo gallery.

Video viewer.

PDF viewer (using PDF.js)

Viewer for ODF Files (.odt, .odp, .ods)

Other

Mozilla Sync hosting

RSS/Atom feed reader.

Connecting external storages

- If you are a Mozilla Firefox user, all history, form data, bookmarks etc. can be stored in your OwnCloud server.

Connecting external storages (if you have accounts on Dropbox, GoogleDrive, or Amazon S3, you can mount those storages into your OwnCloud installation)

High availability

Elimination of single points of failure.

Reliable crossover.

Detection of failures as they occur.

A single point of failure (SPOF) is a part of a system that, if it fails, will stop the entire system from working. SPOF

Reliable crossover in this context means:The ability to switch from a node X (which is broken somehow) to a Node Y without losing data.

Reliable HA-database example: Setting up data replication where (per example) your insert statement only returns as "executed OK" when the transaction is copied to the secundary server. (yes: data replication is more complex then this, this is a simplified example in the context of the question)

Redundancy

In engineering, redundancy is the duplication of critical components or functions of a system with the intention of increasing reliability of the system, usually in the form of a backup or fail-safe.

Redundancy

file storageweb serverdatabase serverload balancer

Redundancy

File Storage

Clustered file system
OR
Distributed file system

location-independent addressingredundancy which improve reliability reduce the complexity of the other parts of the cluster

write once read anywherereplication fault tolerance and redundancyerror correctionscalable horizantally many opensource option avalable narrowed down to tree to evaluate

Parallel file systems

spread data across multiple storage nodes, usually for redundancy or performance

Block storage

Object storage

File system

Local

SAN

Local

NAS

File system

specific folder in fixed order file path file name date

Block storage

Object storage

GlusterFS

GNU cluseternetwork-attached storage

GLUSTER

GlusterFS

Server the server is used to perform all the replication between disks and machine nodes to provide a consistent set of data across all replicas. The server also handles client connections with its built in NFS service. Client this is the software required by all machines which will access the GlusterFS storage volume. Clients can mount storage from one or more servers and employ caching to help with performance.

Hadoop

Hadoop Distributed File System (HDFS)Apache License 2.0.

Hadoop

An HDFS cluster primarily consists of a NameNode and the DataNode. The NameNode manages the file system metadata and DataNodes are used to store the actual data.

Lustre

Linux and cluster GNU General Public License (version 2 only)

it has consistently been used by at least half of the top ten, and more than 60 of the top 100 fastest supercomputers in the world

Ceph

BeeGFS

Parallel Virtual File System
PVFS
OrangeFS

the next generation of Parallel Virtual File System

Performance Reliability Optimized MPI-IO support Hardware Independence Painless Deployment Research Platform

Fedora-commons

open source digital object repository serverFedora-commons is an open source repository (not a Linux distribution)accounts for all changes, so it provides built-in version controlprovides disaster recoveropen standards to mesh with future file formatsprovides open sharing services such as OAI-PMH

DataBase

open source digital object repository serverFedora-commons is an open source repository (not a Linux distribution)accounts for all changes, so it provides built-in version controlprovides disaster recoveropen standards to mesh with future file formatsprovides open sharing services such as OAI-PMH

Galera Cluster

Its generic synchronous multi-master replication plugin for transactional applications.

Galera Cluster

True Multi-master

Synchronous Replication

Tightly Coupled

Multi-threaded Slave

No Master-Slave Failover Operations or Use of VIP

Hot Standby

Automatic Node Provisioning

Supports InnoDB.

Transparent to Applications

No Read and Write Splitting Needed.

MySQL Cluster

Web Server

Load Balance

Poor Man's Load Balance

example.com. IN A 192.168.1.1

example.com. IN A 192.168.1.2

example.com. IN A 192.168.1.3

example.com. IN A 192.168.1.4

NGINX

used by high-traffic websites such as Dropbox, Netflix, and ZyngaNGINX Plus

HAProxy

Example