chapter 5b: top500 - freie universität · chapter 5b: top500 top 500 blades ... eserver blue gene...

Computer Architecture Summer 2005 5b.1

Chapter 5b: top500

Top 500BladesGoogle PC cluster

Computer Architecture Summer 2005 5b.2

top500: top 10Rank Site

Country/YearComputer / ProcessorsManufacturer

Computer FamilyModel

Inst. typeInstallation Area

RmaxRpeak

Nmaxnhalf

1 DOE/NNSA/LLNLUnited States/2005

BlueGene/LeServer Blue Gene Solution / 65536IBM

IBM BlueGene/LeServer Blue Gene Solution

Research 136800183500

1277951

2 IBM Thomas J. Watson Research CenterUnited States/2005

BGWeServer Blue Gene Solution / 40960IBM

IBM BlueGene/LeServer Blue Gene Solution

ResearchInformation Processing Service

91290114688

983039

3 NASA/Ames Research Center/NASUnited States/2004

ColumbiaSGI Altix 1.5 GHz, Voltaire Infiniband / 10160SGI

SGI AltixSGI Altix 3700

Research 5187060960

1290240

4 The Earth Simulator CenterJapan/2002

Earth-Simulator / 5120NEC

NEC VectorSX6

Research 3586040960

1075200266240

5 Barcelona Supercomputer CenterSpain/2005

MareNostrumJS20 Cluster, PPC 970, 2.2 GHz, Myrinet / 4800IBM

IBM ClusterJS20 CLuster

Academic 2791042144

977816

6 ASTRON/University GroningenNetherlands/2005

eServer Blue Gene Solution / 12288IBM

IBM BlueGene/LeServer Blue Gene Solution

Academic 2745034406.4

516095

7 Lawrence Livermore National LaboratoryUnited States/2004

ThunderIntel Itanium2 Tiger4 1.4GHz - Quadrics / 4096California Digital Corporation

NOW - Intel ItaniumItanium2 Tiger4 Cluster

Research 1994022938

975000110000

8 Computational Biology Research Center, AISTJapan/2005

eServer Blue Gene Solution / 8192IBM

IBM BlueGene/LeServer Blue Gene Solution

Research 1820022937.6

442367

9 Ecole Polytechnique Federale de LausanneSwitzerland/2005

eServer Blue Gene Solution / 8192IBM

IBM BlueGene/LeServer Blue Gene Solution

Academic 1820022937.6

442367

10 Sandia National LaboratoriesUnited States/2005

Red Storm, Cray XT3, 2.0 GHz / 5000Cray Inc.

Cray XT3Cray XT3

Research 1525020000

Computer Architecture Summer 2005 5b.3

top500: mare nostrum

2282 blade servers in 27 racks, < 50 m2

blades:very small, slim like a bookminimalistic PC (processor, memory, hard drive)

without power unitwithout USB, peripherals supportwithout video support

typically hot pluggable

energy dissipation of a single blade much smaller than of a PCBUT: higher density in a rack

5 Barcelona Supercomputer CenterSpain/2005

MareNostrumJS20 Cluster, PPC 970, 2.2 GHz, Myrinet / 4800IBM

IBM ClusterJS20 CLuster

Academic 2791042144

977816

Computer Architecture Summer 2005 5b.4

blades vs. regular server rack

..\marenostrum\BSC_Outside.mp4

blades classical approach

Computer Architecture Summer 2005 5b.5

marenostrum installation

Computer Architecture Summer 2005 5b.6

Germany

576 NEC-SX8 processorsbinary compatibility to Earth

Simulator

27 HWW/UniversitaetStuttgartGermany/2005

SX8/576M72 / 576NEC

NEC VectorSX8

IndustryInformation Processing Service

89239216

82944055296

Rank

SiteCountry/Year

Computer / ProcessorsManufacturer

Computer FamilyModel

Inst. typeInstallation Area

RmaxRpeak

Nmaxnhalf

Computer Architecture Summer 2005 5b.7

Industry82 Bank

United Kingdom/2004BladeCenter HS20 Xeon 3.06 GHz, Gig-Ethernet / 3200IBM

IBM ClusterxSeries Cluster Xeon

Industry 375519584

83 WestgridCanada/2005

BladeCenter Xeon 3.06 GHz, Gig-Ethernet / 1680IBM

IBM ClusterxSeries Cluster Xeon

Academic 375510281.6

84 Petroleum Company (G)Saudia Arabia/2004

BladeCenter HS20 Xeon 3.2 GHz, Gig-Ethernet / 1536IBM

IBM ClusterxSeries Cluster Xeon

IndustryGeophysics

37559830.4

85 Credit Suisse/First BostonUnited Kingdom/2004

BladeCenter HS20 Xeon 3.06 GHz, Gig-Ethernet / 1500IBM

IBM ClusterxSeries Cluster Xeon

IndustryFinance

37559180

86 Animal LogicAustralia/2005

BladeCenter HS20 Xeon 3.06 GHz, Gig-Ethernet / 1148IBM

IBM ClusterxSeries Cluster Xeon

IndustryDigital Media

37557025.76

87 Geoscience (B)India/2005

HS20 Cluster, Xeon EM64T 3.4 GHz - Gig-Ethernet / 1024IBM

IBM ClusterHS20 Cluster

ResearchGeophysics

37556963.2

88 Geoscience (C)United Kingdom/2004

xSeries Xeon 3.06 GHz - Gig-E / 1128IBM

IBM ClusterxSeries Cluster Xeon

IndustryGeophysics

37556903.36

89 Geoscience (C)United Kingdom/2004

xSeries Xeon 3.06 GHz - Gig-E / 1128IBM

IBM ClusterxSeries Cluster Xeon

IndustryGeophysics

37556903.36

90 Semiconductor Company (D)Israel/2004

xSeries Xeon 3.06 GHz - Gig-E / 1120IBM

IBM ClusterxSeries Cluster Xeon

IndustrySemiconductor

37556854.4

91 Financial Services (H)United States/2005

BladeCenter HS20 Xeon 3.2 GHz, Gig-Ethernet / 1024IBM

IBM ClusterxSeries Cluster Xeon

IndustryFinance

37556553.6

92 Bank (H)Germany/2004

BladeCenter Xeon 3.06 GHz, Gig-Ethernet / 1064IBM

IBM ClusterxSeries Cluster Xeon

IndustryFinance

37556511.68

Computer Architecture Summer 2005 5b.8

Germany

d110 Adam Opel AGGermany/2005

eServer pSeries p5 575 1.9 GHz, GigEth / 720IBM

IBM SPSP Power5

IndustryAutomotive

30685472

112 Max-Planck-Gesellschaft MPI/IPPGermany/2005

eServer pSeries p5 575 1.9 GHz, GigEth / 720IBM

IBM SPSP Power5

Research 30685472

165 Deutscher WetterdienstGermany/2003

SP Power3 375 MHz 16 way / 1920IBM

IBM SPSP Power3 375 MHz high node

ResearchWeather and Climate Research

21062880

366 Robert BoschGermany/2005

Cluster Platform 3000 DL360G4 Xeon3.4 GHz, GigEthernet / 360Hewlett-Packard

HP ClusterHP DL360 Cluster

IndustryDatabase

1395.42448

Computer Architecture Summer 2005 5b.9

HLRN: virtual supercomputing cluster

368 HLRN at UniversitaetHannover / RRZNGermany/2004

pSeries 690 Turbo 1.3GHz / 512IBM

IBM SPSP Power4

Academic 13842662.4

369 HLRN at ZIB/Konrad Zuse-Zentrum fuerInformationstechnikGermany/2004

pSeries 690 Turbo 1.3GHz / 512IBM

IBM SPSP Power4

Academic 13842662.4

Computer Architecture Summer 2005 5b.10

statistics

Computer Architecture Summer 2005 5b.11

statistics

Computer Architecture Summer 2005 5b.12

statistics

Computer Architecture Summer 2005 5b.13

case study: google

goal: no search takes longer than 0.5 seconds (incl. network delays)

1000 queries / second on average

6000 processors, 12.000 disks, 1 petabyte storage

source: Patterson, Hennessy: Computer Organization and Design, Morgan Kaufmann, 2005

Computer Architecture Summer 2005 5b.14

google cluster site

40 racks, each 80 PCsfail-over Ethernet switchfail-over network connection (OC48: 2.4 Gbit/s, OC12: 600 Mbit/s)

Computer Architecture Summer 2005 5b.15

google PC rack

one 100 Mbit Ethernet switch inthe center

front and back 40 PCs each

Computer Architecture Summer 2005 5b.16

google rack-unit PC

PC contains:hard disks256 MB RAMpower supplyIntel processor

⇒ not a real blade

energy:55 Watt/PC, 4500 Watt/rack