welcome to the waitless world high performance computing ... · “de-mystifying cognitive: ......
TRANSCRIPT
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
High Performance Computing & Analytics...“De-Mystifying Cognitive: HPC/HPDA/AI”
Georgia Power User Group Atlanta, GA, 20 April 2017
Stuart AlexanderCognitive Systems Sales Manager, N. America
(919) 280-1956
20 April 2017
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
The Broader HPC Market ($ Millions)
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Data holds competitive valueFull system and stack
open innovation required
You are here
44 zettabytes
unstructured data
2010 2020
structured data
Data
Gro
wth
Pri
ce/P
erf
orm
ance
Moore’s Law
Processor
Technology
2000 2020
Firmware / OS
Accelerators
Software
Storage
Network
Today’s challenges demand innovation
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Accelerated innovation through
collaboration of partners
Amplified capabilities driving
industry performance leadership
Vibrant ecosystem through open
development
Cloud ComputingHyperscale & Large scale
Datacenters
High PerformanceComputing & Analytics
Domestic
IT Agendas
Industry adoption, Open choice
OpenPOWER Strategy
Moore’s law no longer satisfies
performance gain
Numerous IT consumption
models
Growing workload
demands
Mature Open software
ecosystem
Market Shifts
OpenPOWER is an open development community,
using the POWER Architecture to serve the evolving needs of customers.
OpenPOWER, a catalyst for Open Innovation
© 2016 IBM Corporation
Welcome to the waitless world
5
330+ OpenPOWER Foundation Members
Implementation, HPC & Research
Software
System Integration
I/O, Storage & Acceleration
Boards & Systems
Chips & SoCs
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
HPC Touches Our Everyday Lives
HPC is a critical element of product
development, research, discovery and
breakthrough science.
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Defining HPC…and How It Is Changing
o “High Performance Computing most generally refers to the practice of aggregating computing
power in a way that delivers much higher performance than one could get out of a typical
desktop computer or workstation in order to solve large problems in science, engineering, or
business.” – insideHPC.com
o “Classic HPC”: large, powerful, mathematical modeling systems• Used for running large, complex physics codes, etc.; still largely true
• Linux clusters: “commodity-level” supercomputing – each processor/core does its piece of the total
compute job (many hands make light work), aggregate the results for analysis on workstations
o HPC Today: Evolving rapidly• HPC technology now being used in other areas such as data analytics (HPDA) and AI/DL/ML
o HPC/HPDA/AI – gives us more to sell, broader basis for discussions with prospects
o HPC consolidation in play…..important industry changes• HPE: post-split “uproar” not over; SGI acquisition, possibly others; Dell’s EMC acquisition, etc.
• Fewer players all dealing with such corporate changes plus “Intel fatigue” among users: opportunity
for IBM and POWER
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
What do HPC, HPDA, AI, Accelerated db’s, etc. have in
common?
They largely draw upon the same technologies to accomplish their tasks….technologies honed
over the years in “classic” HPC.
Three different cars built for different purposes…..but with the same
chassis, drive train
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
The IBM HPC Evolution
Data-Centric
Cognitive
Data Analytics Business Intelligence
Social AnalyticsFinancial Analytics
High Performance Data
Analysis
Life SciencesMaterial Science
Research ClustersOil and Gas
HPC Simulation
(Acceleration)
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Your Clients Use HPC for a Competitive Advantage …and So Do Their Competitors
Oil & Gas
Seismic Data Processing, Reservoir Simulation &
Modeling, Geospatial analytics, Terrain/ topology
mapping, CFD-aerodynamic modeling, Wind
simulation
Retail
Inventory analysis, logistics & supply chain
optimization, sentiment analysis, marketing offers
Film, Media & Gaming
Rendering, Computer Aided Graphics, Computer
Generated Images (CGI), Transcoding/ Encoding,
Image Analysis and Processing
Telecommunications
High Performance Data Analytics
Derive Insights From Vast Volumes Of Data &
Streaming Data In Milliseconds.
Fast Location-based Data Analytics – Reducing
Customer Churn, Network Optimization, & Subscriber
Monetization
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
HPC is Not Just for Rocket Scientists…
Utilities
Processing streaming data from smart meters &
multi-billion row datasets in real time to optimize
energy generation and uptime, predict & prevent
power outages, chart energy trends, understand
customer energy usage, and improve load
forecasts.
Banking, Financial Markets &
Insurance
Monte Carlo simulations, Risk analysis, Fraud
detection.
Calculate this now! 100,000s scenarios,
100s of instruments & time steps
Government & Defense
Intelligence agency, fraud analysis, climate modeling,
weather forecasting, energy, nuclear
stewardship, exploration
Life Sciences
Genome processing & sequencing, Drug design,
Molecular modeling & biology simulation, Protein
docking.
Assemble & map large genomes in hours
instead of days & weeks
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Main Components of Representative HPC Systems
Compute nodes and
High Performance Switch
Support:
Management
Servers
Support:
Login Nodes
Primary
Network
SAN, Direct Connect
or Storage Nodes
Storage
(Disk and Tape)
Management
Network
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
• Spectrum Compute (LSF, Conductor) Cluster Management Tools• Compilers: gcc, IBM XLC, LLVM OpenMP4, PGI Fortran/C/C++, Java,
OpenACC, OpenMP• Debuggers, Profilers, Math libraries, MPI & HPC apps
Processors &
Systems
HPC
Software
High Performance
File System &
Storage
• High Performance Processors & Systems• Accelerator, networking, storage integration via NVLink & OpenCAPI• Highest memory throughput
• Highest Performance HPC Storage: Elastic Storage Server• High Performance Spectrum Scale (GPFS) Parallel File System
High Speed
Interconnect
• High speed network fabric from Mellanox• MPI acceleration in the IB fabric, reducing CPU overhead• Support for GPUDirect, NVMe over fabric
IBM: Complete Portfolio of HPC Solutions
High Performance Computing
Accelerated Databases Machine Learning
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Why All the Hype About Minsky (S822LC)?
P100GPU
POWER8CPU
GPUMemory
System Memory
P100GPU
80 GB/s
GPUMemory
NVLink
115 GB/s
P100GPU
POWER8CPU
GPUMemory
System Memory
P100GPU
80 GB/s
GPUMemory
115 GB/s
http://www.nvidia.com/object/nvlink.html
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
High Performance Data Analytics
Sometimes requires 1/10 the hardware & 1/20 the
power compared to other in memory analytics solutions
www.kinetica.com/
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Advanced HPC in the Cloud o Public Cloud For High Performance Workloads & Cloud Supercomputing
o World’s Fastest & Easiest To Use Cloud For Machine Learning, AI, & HPC Applications
o Operates Industry Leading HPC Infrastructure In Multiple Datacenters
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
How We Sell…Positioning Positioning Positioning
o We focus on IBM’s strengthsWe avoid “chip level” discussions, at least initially (“shift the customers’ eyes upward”)
• Customers want and need stability in their technology provider (~400K employees =
“depth on the bench”; in business over 100 years, etc.)
• What we do best, we do better than anyone……demonstrably
• IBM will be a true technology partner, walking the journey with them the entire way
• HPC shops being asked to be “experts” on HPDA, AI/DL/ML, accelerated db’s,
even cloud…..we can do it all
o We fight where we can win• Workloads (codes/apps) that take advantage of our superior memory bandwidth
(~4X over x86)
• Workloads that take advantage of our superior multi-threaded capability
(SMT8; 8 threads per core vs. 2 for x86; great for codes like Hadoop/Spark, etc.)
• Accelerated computing….NVIDIA GPUs or FPGAs…..NVLink technology a huge edge for us
• Look for home-grown, Open Source codes
o “What about my workloads/codes that don’t run on Power?”• Very common….Solution: hybrid (Power/x86) clusters; we offer choice beyond commodity
• Same Mellanox IB, same cluster mgmt. environment (Platform), same parallel file system (Spectrum)
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Let’s talk some AI: Through experience, exposure, and
repetition, we learn to perceive the world around us
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
PowerAI…allows systems to learn much as we do
World’s Fastest AI Platform for Enterprise
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Machine Learning (ML) vs. Deep Learning (DL)
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Target Industries – Deep Learning
Utilities Security and PublicSafety
Consumer Web, Mobile, Retail
Medicine and Biology Broadcast, Media and Entertainment
• Visual inspections of transmission towers to identify maintenance issues (improving worker safety & productivity)
Utility companies that own and operate large power grids and transmission networks.
Titles: Directors of Maintenance, Employee Safety,
• Video Surveillance• Image analysis• Facial recognition and
detection
Local and national police, public and private safety/ security (ADT, IViz, Pinkerton, Sentry)
Titles: Head of Analytics
• Image tagging• Speech recognition• Natural language • Sentiment analysis
Hyperscale web companies, large retail (Google photos, Twitter, Woolworths, Aeon)
Titles: VP/Dir Marketing, Chief Customer Officer, New Application Research
• Drug discovery• Diagnostic assistance• Cancer cell detection
Pharmaceutical, Medical equipment, Diagnostic labs (Takeda, Asian Pharma, Pfizer)
Titles: Principal investigators, Dir of Scientific research
• Captioning• Search• Recommendations• Real time translation
Consumer facing companies with large streaming of existing media, or real time content
Titles: VP/Dir of Marketing, Closed captioning roles, Dir Translation services
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
More Industry-Specific Use Cases for PowerAI
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
N. America HPC/HPDA Sales Team Contactso Stuart Alexander, HPC Sales Manager, N. America
[email protected] (919) 280-1956
o Terry Duff, Public Sector
[email protected] (919) 426-6151
o Cynthia Hanssen, Federal
[email protected] (401) 369-6504
o Ian Watts, Industrial and Canada
[email protected] (512) 537-1377
o Harry Parks, Distribution and Comm/CSI
[email protected] (541) 231-4455
o Dave Parker, Storage (ESS), FSS
[email protected] (301) 520-3066
o Steve Edel, Spectrum and Platform
[email protected] (408) 655-1003
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Summary
o We’re back in the game…..and totally committed to it
o We focus on IBM’s strengths; we know our positioning
in this space
o We fight where we can win
o HPC has evolved, continues to evolve (“classic” HPC, HPDA, AI, accelerated db’s, etc.)
o IBM continues to innovate; we control our own destiny (unlike our competitors)
o Identify opportunities, ask for help (& don’t forget your NVIDIA, Mellanox reps!)…we need you
o Let’s take maximum advantage of consolidation, confusion in the industry to capture market
share
o No one wins alone in this business! Let’s work together and WIN!
© 2016 IBM Corporation
Welcome to the waitless world
© 2017 OpenPOWER Foundation
Questions?