introducing panasas® activestor™ 14 · introducing panasas® activestor™ 14 superior...

16
HPC Advisory Council Switzerland, Lugano 2013 Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE

Upload: others

Post on 05-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013

Introducing Panasas® ActiveStor™ 14

SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS

DEREK BURKE, PANASAS EUROPE

Page 2: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 2

INTRODUCTION TO PANASAS

Storage that accelerates the world’s highest performance and most data-intensive applications

• Tightly integrated parallel file-system & storage hardware solution

• Global shared file-system that accelerates applications performance

Founded 1999, shipping solutions since 2003

• Highly experienced, technically-renowned team

• Software innovation, packaged with industry-standard hardware

European region

• ~150 active customers

• Strong revenue growth(180% in last 3 years)

• Example customers:

• World’s largest offshore oil & gas supplier

• Five formula one teams

• Europe’s largest genomic database

• Europe’s largest hedge fund

• Government customers including RAL (6.6PBs single file system)

• Research customers including ETH (Switzerland), EPFL (Switzerland), Oxford Uni (UK), Genouest (France), Max Planck Institute(Germany) and Moscow State University (Russia)

• Example partners:

• Dalco (Switzerland), E4 (Italy), Transtec (Germany), Megware (Germany), ClusterVision (Europe), HP (EMEA), Dell (EMEA) & SGI (EMEA)

Page 3: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 3

PRODUCT OVERVIEW

Page 4: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 4

ACTIVESTOR BLADE ARCHITECTURE

CPU, cache, network

Orchestrates system activity

Scalable Metadata services

NFS & CIFS access

80TB per 4U shelf

Up to 1.5GB/sec aggregate bandwidth per shelf

Dual Power Supplies & Battery

Dual 10GigE Uplinks

Scales to 100 chassis in a single file system

Over 8 petabytes

150GB/sec

1.4M IOPS

CPU, cache, HDDs & SSDs

Enables parallel reads/writes

Advanced caching algorithms

10GbE networking

InfiniBand Router 2 option

for IB connectivity

Director

Blade

Storage

Blade

800TB & 15GB/s per 40U rack

ActiveStor Appliance

Blade

Switch

Full

Rack

Page 5: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 5

OBJECT STORAGE ARCHITECTURE

File Request

NFS and

CIFS

1.5 GB/sec

per Shelf

Client Nodes

DirectFlow/pNFS

Switched

Network

Director Blades

Storage Blades Unix and Windows Clients

Parallel

Data Path

Object Map

Page 6: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 6

SIMPLE INSTALLATION AND ONLINE

SCALING

– Simple Installation

• Assign IP address,

netmask and default route

to primary DirectorBlade

– Automatic Online

Provisioning

• Configuration is read from

primary blades

• Automatic Software

version matching

• Immediately serving data

DHCP on Private port

- Automatic Capacity Balancing

Target New Writes

Migrate Component Objects in the

background

Page 7: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 7

PANASAS PARALLEL DATA PATH

Data path by-passes RAID controllers and metadata servers

• Application writes data

• DirectFlow/pNFS client layer generates redundant data for each stripe

• Everything is written directly to storage

• All blades work together on RAID rebuild

Client Client Client Client Client Client

Ethernet or IB Network

Director Blades Director Blades Director Blades Director Blades

Storage Blades Storage Blades Storage Blades Storage Blades

Page 8: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 8

Performance • Dual 10GbE delivering 1,500+ MB/s per

chassis

• Up to 14,000 IOPS per Director Blade

• Streaming and IOPS performance scales

linearly as more chassis are added

• Intelligent utilization of SSDs improves small

file & metadata performance

Scalability Within a Single Namespace • Up to 12,000 clients

• Over 8PBs single file system

• 150GB/sec aggregate system bandwidth

• Up to 1.4M NFSv3 IOPS

Manageability • Snapshots

• User & Group Quotas

• Single Management Console

• MyPanasas for updates and patches

• Single Global Namespace

• Automatic Provisioning of New Storage

Capacity

• Automatic RAID Configuration

• Dynamic Load Balancing

• NDMP for backup

• 1 Touch Reports for Capacity Trends, Asset ID

• Disk Migration Utility

Tiered Storage • Drives, SSDs, DRAM

• ActiveStor Product Family

Interoperability

• DirectFlow®, pNFS, NFS & CIFS

• Connectivity

Connectivity

• 2 x 10GbE (or 4 x 1GbE for legacy networks)

• QDR InfiniBand (with Panasas IB Router 2)

Reliability • Panasas Tiered Parity

• Object RAID

• NFS Failover

• Full Storage Network Failover

• Director Blade Metadata Failover

• Parallel Reconstructions

PANASAS ACTIVESTOR FEATURE SET

Page 9: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 9

POST SALES SUPPORT

Customer Your local Panasas Partner

Level 1-2 Technical

Support Staff &

Parts Replacement

Panasas Knowledge Base Extensive Database of

Proven Solutions Panasas Level 3-

Escalations Support

Engineers

Local Language

5 x9 or 24 x 7

Solution Knowledge

Page 10: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 10

INTRODUCING ACTIVESTOR™ 14

Page 11: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 11

CHALLENGE WITH HPC DATA

Mixed workloads require bandwidth performance and IOPS

performance from a single storage system • Even data sets for “large file, throughput workloads” are actually mixed workloads

consisting predominantly of small files

Many critical file system tasks mean heavy metadata workloads • File system directory listings, data replication / backup, file system consistency

checking, object RAID rebuild

Source: Panasas analysis of file system data sets from customers and prospects (Jan-Aug 2012)

File size distributions back up this approach - fsstats: http://www.pdsi-scidac.org/fsstats/index.html

Page 12: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 12

INTRODUCING ACTIVESTOR 14

Intelligent, unified, and cost-effective SSD/SATA tier • Storage blade contains 2 x enterprise-class SATA drives, SSD

& DRAM cache • SSD’s accelerate metadata and small file performance • 2 or 4TB hard drives deliver high streaming throughput

performance • Optimized for real-world, mixed file size workloads

Intelligent use of SSD to balance performance and cost • Store all metadata and <60KB files on SSD • First 12KB of file stored with metadata • Speeds small file performance, directory listings,

file system responsiveness, data reconstructions

AS14 is strong at throughput and IOPS • Ideal for mixed file workloads • Up to 1.5GB/s throughput per AS14 shelf • Up to 14,000 NFS v3 IOPS per AS 14 shelf

Easy to use appliance • Online in minutes • Modular scalability with zero downtime

ActiveStor 14

Storage Blade

120-

480GB

SSD

8-16GB

Cache

2-4TB

HDD x2

CPU

Page 13: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 13

ACTIVESTOR 14 PERFORMANCE

ActiveStor 14 delivers consistent performance improvements

across all small file & metadata-related workloads

ActiveStor 14 vs. ActiveStor 12

• 9x faster small-file reads/s

• 6x faster directory listings

• 5x faster metadata (stats)

• 4x faster deletes

• >2x faster NFS ops/s

• >30% faster RAID reconstruction rate

• High large file throughput capability maintained

Two different ActiveStor 14 models

• ActiveStor 14: 4TB-drive with small SSDs optimize for large-file workloads

that are particularly $/TB sensitive

• ActiveStor 14T: 2TB-drive configuration optimizes for $/IOP performance

Page 14: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 14

ACTIVESTOR PRODUCT FAMILY

Note: A single 1+10 shelf configuration is assumed throughout except that the ActiveStor 14 4KB file

reads/s and metadata performance numbers are based on a single 2+9 shelf of ActiveStor 14T (a 1+10

shelf of ActiveStor 14 would be lower than shown but still much higher than AS11 or 12). Volume fail-over

was on for all configurations.

ActiveStor

14

ActiveStor

12

ActiveStor

11

ActiveStor Generation Fifth Fourth Fourth

Product Focus

Highest

Throughput and

High IOPS

Very High

Throughput

High

Throughput

Capacity (TB) 83 / 81 / 45 60 / 40 60 / 40

SSD Acceleration Yes No No

Throughput,

Write/Read (MB/sec) 1,600 / 1,500 1,600 / 1,500 950 / 1,150

4KB File Reads/s 14,150 1,350 1,300

Metadata Performance

(Stats/s) 14,150 2,750 2,650

Cache (GB) 92 / 172 92 48

High Availability

Network Failover Standard Standard Optional

Link Aggregation Yes Yes No

ActiveStor 14

ActiveStor 11 & 12

Highest throughput and IOPS

Intelligent Use of SATA + SSD

Great for mixed workloads

Best $/TB and price/performance

High throughput

ActiveStor 11 ideal for entry

configurations

Scale out existing ActiveStor 11 &

12 systems

Page 15: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 15

SUMMARY

Panasas is a high-performance storage ‘appliance’ − Modular architecture with linear capacity and performance scalability

− Great performance for mixed file workloads

− Scale metadata and file system services with multiple director blades

Panasas is designed for stability as well as performance − Easy to install, manage & scale

− Novel/unique ObjectRAID with enhanced data protection capabilities

− Components are hot-swappable with built-in redundancy

− Failover as standard

− Online scalability

− 24x7 support team

− Panasas knowledgebase

Panasas is unique amongst parallel storage − Intelligent use of SSD’s

− Protection against URE’s

− Highly parallel data reconstruction

− Active/active metadata failover

− Scalable metadata

− and much more……

Page 16: Introducing Panasas® ActiveStor™ 14 · Introducing Panasas® ActiveStor™ 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE . HPC Advisory Council

HPC Advisory Council Switzerland, Lugano 2013 16

THANK YOU

For more information:

emeainfo[at]panasas.com

www.panasas.com

Panasas, Inc.

7200 The Quorum

Oxford Business Park North

OX4 2JZ

United Kingdom