accelerated, any-scale ai solutions from...
TRANSCRIPT
©2018 DataDirect Networks, Inc. DDN Confidential
How Would it Impact Your Business if You Could
Seamlessly Extract a Lot More Answers per
Hour From Your Data at Any Scale?
A3IACCELERATED, ANY-SCALE AI SOLUTIONS FROM DDN
Ran Pergamin, Storage Solution Architect
[email protected] - 052-722-0080
DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
Enterprise Analytics & Big Data
Digital Content Solutions
Energy ExplorationOpenstack,
Containers, VM at Scale
Govt. and Digital Security
AI & Machine Learning
Research Big Data
Technical Computing
Supercomputing
Scalable Storage Platforms
Data-at-Scale Services
► Performance Storage Platforms designed for scale
► All Aspects of Scale: IOPs, Throughput, Latency, Capacity, Distribution
► Flexible Architecture Design
► Global Services and Support from Storage Specialists
World-Renowned & Award Winning
DDN | Scalable Storage Solutions for Your Specific Applications
©2018 DataDirect Networks, Inc. DDN Confidential
DDN Parallel AI solutions are all-round
performers able to saturate GPUs for training
at the same time as inference and data
movements and preparation
DDN COMPLETE AI DATA LIFECYCLE SOLUTIONS
YOUR AI WORKFLOW
CONCURRENTLY,
CONTINUOUSLY,
IN-PLACE
©2018 DataDirect Networks, Inc. DDN Confidential
FLEXIBLE SCALING
ULTIMATE FLEXIBILITY
DDN
Disk
DDN Flash
Competitor limitations
With data volumes continuing to rise, AI is getting
smarter and learning faster, enabling organizations
such as yours to leverage more-advanced Machine
Learning (ML) and Deep Learning (DL) solutions.
Match your business growth
with flexible all flash or
hybrid scale-out
Pe
rfo
rman
ce
Capacity
©2018 DataDirect Networks, Inc.
ACCELERATED ANY-SCALE AI SOLUTIONS FROM DDN
Optimized and integrated data
solutions for your AI
frameworks
x
AI Frameworks
A3I
DDN brings you to production faster by creating
a fully optimized and integrated data platform
for AI frameworks, managing data efficiently
whatever your choice of AI framework
©2018 DataDirect Networks, Inc.
BUILD YOUR AI DATACENTER WITH DDN’S DATA PLATFORMS FOR AI
AI200 - 20GB/S
2RU, 24 NVME DRIVES AI200
Capacities: 20TB to 368TB in 2-RU
Start with 1 system, Scale out to 100+
InfiniBand - EDR or Ethernet 100Gb
©2018 DataDirect Networks, Inc.
BUILD YOUR AI DATACENTER WITH DDN’S DATA PLATFORMS FOR AI
Hybrid Configurations : SSDs and NL-SAS
Start with 1 system, Scale to 100+
InfiniBand - EDR or Ethernet 100Gb
AI7900 - 20GB/S
4RU
90 DRIVES IN BASE + 360 MORE
6.3PB RAW IN 20-US
AI7990
DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
DGX-1 server
DDN AI200Simple, Fully-Packaged Solution
for DGX
Start with a single AI200 storage appliance
and a single DGX-1 server
Pre-configured solutions that are easy to
deploy and manage, fully-integrated and
optimized for maximum DGX server
productivity
support: EDR IB and 100 GbE networking
DDN A3I Solutions: Turnkey, integrated and optimized for NVIDIA DGX-1
DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc. 4 or more DGX-1 servers
8
8
8
8
DDN AI200
Scalable, End-to-End
Solution for DGX
Flexible architecture scales seamlessly in
capacity, performance and capacity to match
evolving workflow requirements
Additional DGX-1 servers and AI200 storage
appliances can be integrated rapidly, and
immediately provisioned to applications
Architecture performance scales linearly and
delivers optimized, extremely cost-effective
solution with multi-DGX deployments
DDN A3I Solutions: Massive scale with multiple NVIDIA DGX-1
DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
Full NVMe Performance,
In-Container
Extreme amounts of performance and
capacity through a tight integration between
DDN and NVIDIA platforms
Every layer of hardware and software
engaged is optimized for fast, responsive and
reliable file access
Highly optimized parallel data paths run from
containerized applications, all the way to disk
drives
DDN A3I Solutions: Fully integrated and optimized for NVIDIA DGX-1
DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
Over 100K IOPs and
10GB/s to 1 Container
EXAScaler client demonstrates over 10GB
per second to a singlecontainer and over
100K IOPs.
Typical Deep Learning Codes will perform IOs
around 128K IOs – Scale up to 38GB/s with
4 Containers in a single DGX-1 System.
DDN A3I Solutions: Performance to a single container
DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
60% Faster - Consistent, Linear AI PerformanceAI benchmarking of AI Frameworks with popular test sets demonstrates images per second rates
60% higher than competing systems
DDN A3I Solutions: Fully-optimized and Qualified with Popular AI Frameworks
DDN Confidential DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
DDN PARALLEL ARCHITECTURE AND PROTOCOL vs NFS
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
GPU GPU
FULL GPU SATURATION
MAXIMUM AI PRODUCTIVITY
GPU STARVATION
CRIPPLED AI PERFORMANCE
DDN AI200NFS
DDN Confidential DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
DDN FULL GPU
SATURATION
MAX GPUUTILIZATION
DGX-1 GPU UTILIZATION (%) AI200 READ (MB/S)
DGX-1 GPU UTILIZATION (%) NFS STORAGE READ (MB/S)
2X FASTER
Consistent DL performance
Achieves full GPU utilization
Efficient loading of data set
NFS GPU
STARVATION
MAX GPUUTILIZATION
DDN PARALLEL ARCHITECTURE AND PROTOCOL vs NFS
DDN Confidential DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
73
543
0 100 200 300 400 500 600
Ima
ges
Per
Se
con
d
CAFFE GOOGLENET TRAINING THROUGHPUT7.5X MORE IMAGES WITH DDN STORAGE
DDN Storage NFS Storage
16
3
0 2 4 6 8 10 12 14 16 18
Tim
e (
in m
inu
tes)
CAFFE GOOGLENETTRAINING TIME5.5X FASTER WITH DDN STORAGE
DDN Storage NFS Storage
DDN PARALLEL ARCHITECTURE AND PROTOCOL vs NFS
DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
AI Benchmarking: Optimized TensorFlow Data Sets
67
23
0 10 20 30 40 50 60 70 80
Tim
e (in
min
utes
)
TFRECORD CONVERSION BENCHMARK3X FASTER WITH DDN STORAGE
DDN Storage Other Storage Products
1614
671
0 200 400 600 800 1000 1200 1400 1600 1800
Tim
e (in
se
cond
s)
TENSORFLOW RESNET-50 TRAINING PERFORMANCE2.5X FASTER WITH TFRECORDS
TFRecord Data Set Discrete Data Set
Optimized Data Sets,
Accelerated Training
Convert discrete data and metadata asset
collections into series of streamlined binary
files for TensorFlow
Maximize DL training and validation
efficiency while minimizing data
management and preparation overhead
Achieve more accurate results by
eliminating manual data shuffle bias
DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
DDN – Large Autonomous car company deplyoment
©2018 DataDirect Networks, Inc. DDN Confidential
DDN A3I SOLUTIONS FOR END-TO-END AI ENABLEMENT
Maximize efficiencyProfit from greatest technical and economic benefits
Accelerate AI performanceAchieve full GPU saturation for greatest AI productivity
Ensure data availabilityTrust in robust data protection, integrity and access
Scale seamlesslyIncrease performance, capacity and capability at any scale
Streamline DL workflowsEngage all workloads concurrently and continuously
Deploy and manage easilyFully-integrated and optimized solutions from DDN
©2018 DataDirect Networks, Inc. DDN Confidential
THANK YOU
CONTACTS:
NIR TALMOR, REGIONAL SALES DIRECTOR, [email protected] – 052-722-0070
RAN PERGAMIN, SOLUTION ARCHITECT, [email protected] - – 052-722-0080