to provide the world with a next generation storage platform for unstructured data, enabling...

Unigroup: OpenAFS Distributed Storage

To provide the world with a next generation storage platform for unstructured data,

enabling deployment of mobile applications, virtualization solutions, and software.

To support the on-going development of relevant critical path standards and open source

technologies.

The YFS Mission

AFS is:• A global file system name space (/afs)• A family of file system RPCs used to manipulate the

contents of the name space• A class of client and server implementations that

provide access to the name space OpenAFS is:

• One of the oldest open source communities• One of the largest open source projects• The most widely deployed implementation of AFS

What are AFS and OpenAFS?

Andrew File System• Part of the Carnegie Mellon University and IBM

Andrew Project of the 1980s• First reference to “Cloud Storage” in early papers• I.P. owned by IBM not Carnegie Mellon

AFS commercialized by Transarc / IBM• Shifted focus to DCE DFS

Open source era began in 2000

A Very Brief History of AFS

Large active team. • 40 devs in last 12 months. • 249 since formation.

Nearly 1 million lines of code and documentation.

Approaching 10,000 contributions. Basic COCOMO effort analysis

• 217 person years• $23 million

11 Years of Open Source

AFS satisfies Operational RequirementsPlatform Specific

Redirection

Authentication and Privacy

Geographic Data Replication & Data Integrity

Distributed Administration &

Disconnected Operation

Atomic Publishing

Model

One File System for All Clients

Global Accessibility

and Federation

Platfiorm & Location Independence

High Level Architecture

OS

Apps

AFS Cache

Client DeviceDesktop, Laptop, Mobile

AFS cache stores recently accessed file, directory and location data

reducing network traffic

AFS Client

Location Server File Server DataFile ServerData

OS

Apps

AFS Client

AFS Cache

Client Device

Authenticated Callbacks notify clients of changes to data, metadata and lock status

Separate location and data servers allow for strong scalability and

seamless maintenance

Replication of data volumes ensure high availability and

disaster recovery

Rich security services provide secure access on open networks

and federated collaboration

Portable cross platform client

Each has an owner Each belongs to a specific cell which

determines which protection database is used for access control

Each can be migrated, replicated and backed up independently

Each can mount other volumes within the same or different cells

AFS Volumes are File Systems

Graph of Cell Volume Structure

The fastest RPC is the one that is never sent AFS caches data and metadata to avoid

repetitive fetches from the file servers Cached info:

• Object Status (size, timestamps, data version)• Per user permissions• Lock state• Unix mode bits / attributes• Accessed data extents (offset, length)

How to Make Stuff Go Fast

For each read-write object and each read-only volume a callback promise is registered with the file server the data was accessed on.

When any change occurs to the state of the object or volume, the file server notifies all registrants that some change *might* have occurred.

It is up to the client to decide if updated data is required.

What about multi-user access?

Cache Coherency Matters

BulletsTitle

Enhanced user interface integration Troubleshooting wizards Integrated update service OS Vendor certification

• Microsoft Windows only

Products and Services:Enhanced Desktop Clients

Features• File Browser• Integrated document viewing• Open documents with third

party applications• Save documents from third

party applications• Integrated authentication• User to User Document Sharing

Service Core Application Frameworks

available for integration in custom apps

Products and Services:iOS Mobile Clients

Capable of monitoring multiple cells

Collects server performance data

Performs cell consistency checks

Alert generation Cell introspection Browser and mobile

application

Products and Services:Monitoring and Management Service

Integrated Turnkey Storage Appliances offering a superset of OpenAFS functionality

Products and Services:Storage Appliances

24-7 Crisis Resolution Services Troubleshooting and Configuration Services On-site and remote training classes for

system administrators and end users Custom feature development

Services provided for both OpenAFS and YFS

Products and Services:Training and Support

Storage Appliance Road Map1st Gen

2012 Q1

1st Gen

Base file system platform• Large volume support• GSS Authentication• AES-256 RFC3962 encryption• High scalability• R/W replication• IPv6• Parallel reads• Unicode directories• Disaster recovery capabilities• No single points of failure• Departmental file servers• Byte range locks• Authenticated Fine Grained Coherency• Many-to-One Authn to Authz IdsArbitrary file system importAutomated client update servicesAutomated Troubleshooting ToolsMobile clients and SDKs for custom applicationsIntegrated Monitoring and Management Interface

Storage Appliance Road Map1st Gen 2nd Gen

2012 Q1 2013 Q1

1st Gen 2nd Gen

Advanced volume storage• Data integrity• De-duplication• Compression• Self-healing• Snapshots & clones• Storage poolsAdditional features• TCP transport• Disconnected clients• Event driven server arch.• Multiple data streams• Extended Attributes• Peer to peer data sharing• Hypervisor Integration


Storage Appliance Road Map1st Gen 2nd Gen

2012 Q1 2013 Q1

Consumer storage appliance

YFS hosted storage services and facilities build out using YFS rack servers

1st Gen 2nd Gen

Advanced volume storage• Data integrity• De-duplication• Compression• Self-healing• Snapshots & clones• Storage poolsAdditional features• TCP transport• Disconnected clients• Event driven server arch.• Multiple data streams• Extended Attributes• Peer to peer data sharing

Hardware encryption module



Storage Appliance Road Map1st Gen 2nd Gen 3rd Gen

2012 Q1 2013 Q1 2014 Q1

Consumer storage appliance


1st Gen 2nd Gen 3rd Gen

Advanced volume storage• Data integrity• De-duplication• Compression• Self-healing• Snapshots & clones• Storage poolsAdditional features• TCP transport• Disconnected clients• Event driven server arch.• Multiple data streams• Extended Attributes• Peer to peer data sharing• Hypervisor Integration

Hardware encryption module



• Improved Package Management• Namespaces• Volumes• Application deployment

• Hybrid cloud deployments• Integrated Search• Named Pipes

YFS Storage Appliance v1

OEM HardwareHardware RAID

OEM PartnerOn-site Service

Debian kFreeBSD(Linux with BSD Kernel)

Microsoft OEMStorage Server 2008 R2

Volume Location DB

+

Protection DB

File Server

Salvager,Vol Mgmt,

BackupMonitor

YFS Storage Appliance v2

OEM HardwareHardware RAID

OEM Partner On-site Service

Debian kFreeBSD Microsoft OEM Storage Server 2008

Volume Location DB

+

Protection DB

File Server

Salvager,Vol Mgmt,

BackupMonitor

Pooled storage devices

Hypervisor IntegrationGuest

Host

Hypervisor Virtual FS

GuestHypervisor Virtual FS

GuestHypervisor Virtual FS

YFS cache Virtualized cache access

iOS applications Monitoring tools

Demos

255 W 94TH STNew York NY 10025 USA

+1 212 [email protected]

http://www.your-file-system.com

to provide the world with a next generation storage platform for unstructured data, enabling...

Documents