introducing panasas® activestor™ 14 · introducing panasas® activestor™ 14 superior...
TRANSCRIPT
HPC Advisory Council Switzerland, Lugano 2013
Introducing Panasas® ActiveStor™ 14
SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS
DEREK BURKE, PANASAS EUROPE
HPC Advisory Council Switzerland, Lugano 2013 2
INTRODUCTION TO PANASAS
Storage that accelerates the world’s highest performance and most data-intensive applications
• Tightly integrated parallel file-system & storage hardware solution
• Global shared file-system that accelerates applications performance
Founded 1999, shipping solutions since 2003
• Highly experienced, technically-renowned team
• Software innovation, packaged with industry-standard hardware
European region
• ~150 active customers
• Strong revenue growth(180% in last 3 years)
• Example customers:
• World’s largest offshore oil & gas supplier
• Five formula one teams
• Europe’s largest genomic database
• Europe’s largest hedge fund
• Government customers including RAL (6.6PBs single file system)
• Research customers including ETH (Switzerland), EPFL (Switzerland), Oxford Uni (UK), Genouest (France), Max Planck Institute(Germany) and Moscow State University (Russia)
• Example partners:
• Dalco (Switzerland), E4 (Italy), Transtec (Germany), Megware (Germany), ClusterVision (Europe), HP (EMEA), Dell (EMEA) & SGI (EMEA)
HPC Advisory Council Switzerland, Lugano 2013 3
PRODUCT OVERVIEW
HPC Advisory Council Switzerland, Lugano 2013 4
ACTIVESTOR BLADE ARCHITECTURE
CPU, cache, network
Orchestrates system activity
Scalable Metadata services
NFS & CIFS access
80TB per 4U shelf
Up to 1.5GB/sec aggregate bandwidth per shelf
Dual Power Supplies & Battery
Dual 10GigE Uplinks
Scales to 100 chassis in a single file system
Over 8 petabytes
150GB/sec
1.4M IOPS
CPU, cache, HDDs & SSDs
Enables parallel reads/writes
Advanced caching algorithms
10GbE networking
InfiniBand Router 2 option
for IB connectivity
Director
Blade
Storage
Blade
800TB & 15GB/s per 40U rack
ActiveStor Appliance
Blade
Switch
Full
Rack
HPC Advisory Council Switzerland, Lugano 2013 5
OBJECT STORAGE ARCHITECTURE
File Request
NFS and
CIFS
1.5 GB/sec
per Shelf
Client Nodes
DirectFlow/pNFS
Switched
Network
Director Blades
Storage Blades Unix and Windows Clients
Parallel
Data Path
Object Map
HPC Advisory Council Switzerland, Lugano 2013 6
SIMPLE INSTALLATION AND ONLINE
SCALING
– Simple Installation
• Assign IP address,
netmask and default route
to primary DirectorBlade
– Automatic Online
Provisioning
• Configuration is read from
primary blades
• Automatic Software
version matching
• Immediately serving data
DHCP on Private port
- Automatic Capacity Balancing
Target New Writes
Migrate Component Objects in the
background
HPC Advisory Council Switzerland, Lugano 2013 7
PANASAS PARALLEL DATA PATH
Data path by-passes RAID controllers and metadata servers
• Application writes data
• DirectFlow/pNFS client layer generates redundant data for each stripe
• Everything is written directly to storage
• All blades work together on RAID rebuild
Client Client Client Client Client Client
Ethernet or IB Network
Director Blades Director Blades Director Blades Director Blades
Storage Blades Storage Blades Storage Blades Storage Blades
HPC Advisory Council Switzerland, Lugano 2013 8
Performance • Dual 10GbE delivering 1,500+ MB/s per
chassis
• Up to 14,000 IOPS per Director Blade
• Streaming and IOPS performance scales
linearly as more chassis are added
• Intelligent utilization of SSDs improves small
file & metadata performance
Scalability Within a Single Namespace • Up to 12,000 clients
• Over 8PBs single file system
• 150GB/sec aggregate system bandwidth
• Up to 1.4M NFSv3 IOPS
Manageability • Snapshots
• User & Group Quotas
• Single Management Console
• MyPanasas for updates and patches
• Single Global Namespace
• Automatic Provisioning of New Storage
Capacity
• Automatic RAID Configuration
• Dynamic Load Balancing
• NDMP for backup
• 1 Touch Reports for Capacity Trends, Asset ID
• Disk Migration Utility
Tiered Storage • Drives, SSDs, DRAM
• ActiveStor Product Family
Interoperability
• DirectFlow®, pNFS, NFS & CIFS
• Connectivity
Connectivity
• 2 x 10GbE (or 4 x 1GbE for legacy networks)
• QDR InfiniBand (with Panasas IB Router 2)
Reliability • Panasas Tiered Parity
• Object RAID
• NFS Failover
• Full Storage Network Failover
• Director Blade Metadata Failover
• Parallel Reconstructions
PANASAS ACTIVESTOR FEATURE SET
HPC Advisory Council Switzerland, Lugano 2013 9
POST SALES SUPPORT
Customer Your local Panasas Partner
Level 1-2 Technical
Support Staff &
Parts Replacement
Panasas Knowledge Base Extensive Database of
Proven Solutions Panasas Level 3-
Escalations Support
Engineers
Local Language
5 x9 or 24 x 7
Solution Knowledge
HPC Advisory Council Switzerland, Lugano 2013 10
INTRODUCING ACTIVESTOR™ 14
HPC Advisory Council Switzerland, Lugano 2013 11
CHALLENGE WITH HPC DATA
Mixed workloads require bandwidth performance and IOPS
performance from a single storage system • Even data sets for “large file, throughput workloads” are actually mixed workloads
consisting predominantly of small files
Many critical file system tasks mean heavy metadata workloads • File system directory listings, data replication / backup, file system consistency
checking, object RAID rebuild
Source: Panasas analysis of file system data sets from customers and prospects (Jan-Aug 2012)
File size distributions back up this approach - fsstats: http://www.pdsi-scidac.org/fsstats/index.html
HPC Advisory Council Switzerland, Lugano 2013 12
INTRODUCING ACTIVESTOR 14
Intelligent, unified, and cost-effective SSD/SATA tier • Storage blade contains 2 x enterprise-class SATA drives, SSD
& DRAM cache • SSD’s accelerate metadata and small file performance • 2 or 4TB hard drives deliver high streaming throughput
performance • Optimized for real-world, mixed file size workloads
Intelligent use of SSD to balance performance and cost • Store all metadata and <60KB files on SSD • First 12KB of file stored with metadata • Speeds small file performance, directory listings,
file system responsiveness, data reconstructions
AS14 is strong at throughput and IOPS • Ideal for mixed file workloads • Up to 1.5GB/s throughput per AS14 shelf • Up to 14,000 NFS v3 IOPS per AS 14 shelf
Easy to use appliance • Online in minutes • Modular scalability with zero downtime
ActiveStor 14
Storage Blade
120-
480GB
SSD
8-16GB
Cache
2-4TB
HDD x2
CPU
HPC Advisory Council Switzerland, Lugano 2013 13
ACTIVESTOR 14 PERFORMANCE
ActiveStor 14 delivers consistent performance improvements
across all small file & metadata-related workloads
ActiveStor 14 vs. ActiveStor 12
• 9x faster small-file reads/s
• 6x faster directory listings
• 5x faster metadata (stats)
• 4x faster deletes
• >2x faster NFS ops/s
• >30% faster RAID reconstruction rate
• High large file throughput capability maintained
Two different ActiveStor 14 models
• ActiveStor 14: 4TB-drive with small SSDs optimize for large-file workloads
that are particularly $/TB sensitive
• ActiveStor 14T: 2TB-drive configuration optimizes for $/IOP performance
HPC Advisory Council Switzerland, Lugano 2013 14
ACTIVESTOR PRODUCT FAMILY
Note: A single 1+10 shelf configuration is assumed throughout except that the ActiveStor 14 4KB file
reads/s and metadata performance numbers are based on a single 2+9 shelf of ActiveStor 14T (a 1+10
shelf of ActiveStor 14 would be lower than shown but still much higher than AS11 or 12). Volume fail-over
was on for all configurations.
ActiveStor
14
ActiveStor
12
ActiveStor
11
ActiveStor Generation Fifth Fourth Fourth
Product Focus
Highest
Throughput and
High IOPS
Very High
Throughput
High
Throughput
Capacity (TB) 83 / 81 / 45 60 / 40 60 / 40
SSD Acceleration Yes No No
Throughput,
Write/Read (MB/sec) 1,600 / 1,500 1,600 / 1,500 950 / 1,150
4KB File Reads/s 14,150 1,350 1,300
Metadata Performance
(Stats/s) 14,150 2,750 2,650
Cache (GB) 92 / 172 92 48
High Availability
Network Failover Standard Standard Optional
Link Aggregation Yes Yes No
ActiveStor 14
ActiveStor 11 & 12
Highest throughput and IOPS
Intelligent Use of SATA + SSD
Great for mixed workloads
Best $/TB and price/performance
High throughput
ActiveStor 11 ideal for entry
configurations
Scale out existing ActiveStor 11 &
12 systems
HPC Advisory Council Switzerland, Lugano 2013 15
SUMMARY
Panasas is a high-performance storage ‘appliance’ − Modular architecture with linear capacity and performance scalability
− Great performance for mixed file workloads
− Scale metadata and file system services with multiple director blades
Panasas is designed for stability as well as performance − Easy to install, manage & scale
− Novel/unique ObjectRAID with enhanced data protection capabilities
− Components are hot-swappable with built-in redundancy
− Failover as standard
− Online scalability
− 24x7 support team
− Panasas knowledgebase
Panasas is unique amongst parallel storage − Intelligent use of SSD’s
− Protection against URE’s
− Highly parallel data reconstruction
− Active/active metadata failover
− Scalable metadata
− and much more……
HPC Advisory Council Switzerland, Lugano 2013 16
THANK YOU
For more information:
emeainfo[at]panasas.com
www.panasas.com
Panasas, Inc.
7200 The Quorum
Oxford Business Park North
OX4 2JZ
United Kingdom