hpc technical workshop björn tromsdorf product & solutions manager, microsoft emea london...
Post on 22-Dec-2015
215 views
TRANSCRIPT
Agenda• Defining High Performance Computing
(HPC)
• Industry and Market Trends
• Customer Challenges
• Windows Compute Cluster Server 2003
High Performance Computing
• Cutting edge problems in science, engineering and business always demand capabilities beyond those of the fastest computers
• Market pressures demand accelerated innovation cycle, overall cost reduction and thorough outcome modeling– Aircraft design utilizing composite materials– Vehicle fuel efficiency and safety improvements– Simulations of enzyme catalysis, protein folding– Targeted material and drug design– Simulation of nanoscale electronic devices– Financial portfolio risk modeling– Digital content creation and enhancement– Supply chain modeling and optimization
• Volume economics of industry standard hardware and commercial software applications are rapidly bringing HPC capabilities to a broader number of users
• Microsoft HPC Strategy – taking HPC to the mainstream– Enabling broad HPC adoption and making HPC into a high volume market
HPC Market TrendsTop Challenges to Implementing Clusters
System management capability 18%
Apps availability 17%
Parallel algorithm complexity 14%
Space, power, cooling 11%
Interconnect BW/latency 10%
I/O performance 9%
Interconnect complexity 9%
Other 12%
Source: IDC, 2005
-3%
2005 Systems
30%
981
4,988
21,733
163,441
2005 Growth
36%
33%
<$250K – 97% of systems, 55% of revenue
Cluster Market Penetration
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
03Q1 03Q2 03Q3 03Q4 04Q1 04Q2 04Q3 04Q4 05Q1 05Q2 05Q3 05Q4
ClustersNon-Clustered
Top 500 Supercomputer Trends
Industry usage rising
GigE is gaining (50% of
systems)
Clusters over 70%
x86 is leading
(Pentium 41%,
EM64T 16%,
Opteron 11%)
Market Perspective
1991 1998 2005
System
Cray Y-MP C916 Sun HPC10000 Small Form Factor PCs
Architecture16 x Vector4GB, Bus
24 x 333MHz Ultra-SPARCII, 24GB, SBus
4 x 2.2GHz Athlon644GB, GigE
OS UNICOS Solaris 2.5.1 Windows Server 2003 SP1
GFlops ~10 ~10 ~10
Top500 # 1 500 N/A
Price $40,000,000 $1,000,000 (40x drop) < $4,000 (250x drop)
Customers Government Labs Large Enterprises Every Engineer and Scientist
ApplicationsClassified, Climate, Physics Research
Manufacturing, Energy, Finance, Telecom
Bioinformatics, Materials Sciences, Digital Media
Top Challenges“Make high-end computing easier and more productive to use. Emphasis should be placed on time to solution, the major metric of value to high-end computing users… A common software environment for scientific computation encompassing desktop to high-end systems will enhance productivity gains by promoting ease of use and manageability of systems.”
High-End Computing Revitalization Task Force, 2004
(Office of Science and Technology Policy, Executive Office of the President)
• Setup is painful• Takes a long time to get clusters up
and running• Keeping systems updated is difficult
• Lack of integration into IT infrastructure
• Job management• Lack of integration into end-user
apps• Application availability
• Limited eco-system of application that can exploit parallel processing capabilities
Windows Compute Cluster Server 2003
• Accelerates time-to-insight by providing a High-Performance Computing (HPC) platform that is simple to deploy, operate, and integrate with existing infrastructure and tools.– Faster Time to Insight– Better Integration with Existing Tools– Familiar Development Environment
Leveraging Existing Windows Infrastructure Active DirectoryActive Directory
Microsoft Enterprise Microsoft Enterprise Management ToolsManagement Tools
Windows SecurityWindows Security
Compute Cluster Built-Compute Cluster Built-in Toolsin Tools
Operations Manager
Systems Management Server
Windows Update Services
Secure Job Execution
Remote Installation Services
Admin Console
Performance Monitor
Command Line Interface
Kerberos Authentication
Resource Management
Group Policies
Integration with IT Infrastructure
Job Scheduler
Secure MPI
Cornell Theory CenterIthaca, NY USA
University of TennesseeKnoxville, TN USA
University of VirginiaCharlottesville, VA USA
University of UtahSalt Lake City, UT USA
TACC – University of TexasAustin, TX USA
Southampton UniversitySouthampton, UK
HLRS – University of StuttgartStuttgart, Germany
Shanghai Jiao Tong UniversityShanghai, PRC
Tokyo Institute of TechnologyTokyo, Japan
Nizhni Novgorod University
Nizhni Novgorod, Russia
Institutes for High Performance Computing
Summary• Windows Compute Cluster Server 2003 removes
administrative barriers preventing broad adoption of HPC solutions– Familiar environment and integration with standard
tools
– Convenient job scheduler
– Parallel debugging capabilities and full support of MPI standards
• Windows Compute Cluster Server 2003 makes HPC accessible to all scientists, engineers, and businesses