bucharest, 27.jul.2k4

Bucharest, 27.Jul.2k4

Grid ComputingGrid Computing

Alexandru IOSUP

To Grid or Not, TodayTo Grid or Not, Today

Coordinator:Prof. Nicolae Tapus

PARALLEL AND DISTRIBUTED SYSTEMS GROUP

Agenda

1. Introduction2. Sharks v. Piranhas3. National projects4. Continental projects5. Global projects6. Conclusions

i

Agenda

1. Introduction2. Sharks v. Piranhas3. National projects4. Continental projects5. Global projects6. Conclusions

i

Introduction

• Idea The Grid is to computing what

Internet is to information Importance of summed resources is

greater than sum of resources Metcalfe’s law adapted

• What are the current projects? Computing resources types? Location? Size?

1

Agenda

1. Introduction2. Sharks v. Piranhas3. National projects4. Continental projects5. Global projects6. Conclusions

i

Sharks v. Piranhas

2

Buyya

Mainframe

Vector Supercomputer MPP

WorkstationPC

Mini Computer(hitting wall soon)

(future is bleak)

Sharks v. Piranhas

2

BuyyaClusters replacing big irons

Sharks v. Piranhas

2

Now, really?

Supercomputers? Clusters?

Agenda

1. Introduction2. Sharks v. Piranhas3. National projects4. Continental projects5. Global projects6. Conclusions

i

National projects

• Europe• North America• Asia• Australia• South America• Africa

3

National projects

• EuropeClusters, clusters, clusters… Germany The Netherlands France Ireland & UK Romania others

• North America• Asia• Australia• South America• Africa

4

Germany

5

Max Planck I.

To USA

Amsterdam

UtrechtDelft

Nijmegen

TELINLeiden

ASTRONJIVE

KNMI

The Netherlands

6

DAS• System

Clusters Inter-networks DM, DSM single machine

• Homogenous Each cluster

- Similar nodes; numbers vary

- Same LAN technology Each node

- Same processor(s)- Same operating system

• Wide-area distributed Amsterdam, Leiden,

Delft, Utrecht Links to US

DAS Timeline• 1 cluster, 8 nodes, 8 procs

Amsterdam (8 nodes)

7

February 1997

Idea came-up

DAS Timeline

7

June 1997

DASFirst installed

• 4 clusters, 200 nodes, 200 procs Amsterdam (128+24 nodes), Delft

(24), Leiden (24)

• Each node 200 MHz Pentium Pro processor Memory: 64/128 MB EDO-RAM OS: BSD LAN: Myrinet

• Wide-are network 155 Mbps, NRN 6 Mbps ATM; latency 4ms

February 1997

DAS Timeline

• DAS kept growing…

7

June 1997

March 1998

First installed Opening workshop

June 2000

ASCI obtains NWO funding

1999

BSD to Linux

DAS Timeline

7

June ‘97

March ‘98

June 2000

November 2001

DAS-2IBM installation

• 5 clusters, 200 nodes, 400 procs Amsterdam (72+32 nodes), Delft

(32), Leiden (32), Utrecht (32)

• Each node 2x1GHz Pentium III SMPs Memory: 1-2 GB OS: Linux LAN: Myrinet-2000

France

8

FrenchResearch Network

VTHD2.5Gbps

Research laboratories LIP Lyon IRIT/CERFACS Toulouse LORIA Nancy PRISM Versailles 7 others: Lille, Nice, Bordeaux, Besancon,

Rennes, Grenoble, Orsay

ACI-GRID Timeline

• National request for proposals 25 proposals 18 accepted 1-3 years per project

9

March 2001

First call

ACI-GRID Timeline

• National request for proposals 12 projects accepted 2-3 years per project

9

March 2001

First call

March 2002

Second call

ACI-GRID Timeline

• National request for proposals 7 projects accepted 3 years per project

9

March 2001

First call

March 2002

Second call

March 2003

Third call

ACI-GRID Timeline

• GRID’5000 project Target: 5000 nodes Grid in 3 years

• National request for proposals

9

March 2001

First call

March 2002

Second call

March 2003

Third call

March 2004

Fourth call

Ireland & UK

10

Romania

11

Timişoara

Tg-Mureş

Craiova

Iasi

Galaţi

Bucureşti

Cluj

2 Mbps(backup)

8 Mbps

34 Mbps

2 Mbps - POP

155 Mbps

GEANT Link

Satu MareBaia Mare

OradeaZalău

Arad

Reşiţa

Tr. Severin

Tîrgu Jiu Rm.VîlcaePiteşti

Alexandria

Slatina

Alba Iulia

Sibiu

Mircurea Ciuc

Sf. Gheorghe

Braşov

Bistriţa

Suceava

Botoşani

Piatra Neamţ

Bacău Vaslui

Focşani

Buzău

Ploieşti

Slobozia

ConstanţaCălăraşi

Giurgiu

Tîrgovişte BrăilaTulcea

Hunedoara

National projects

• Europe• North America

Supercomputers, clusters… USA Canada

• Asia• Australia• South America• Africa

12

SUA

13

SC’98

Hawaii Caltech

Australia

Europe

Japan

Back in ’98…

SUA – Networks

14

Asia

EuropeNordNET

Others

SUA – Sites

15

Nowadays…

National projects

• Europe• North America• Asia

Supercomputers, clusters, clusters… Japan China Russia Singapore others

• Australia• South America• Africa

16

Japan

17

JapanResearch Network

China

18

Russia

19

Singapore

20

SingaporeClusterGrids

NangyangTechnicalUniversity

National projects

• Europe• North America• Asia• Australia

Clusters, clusters, clusters… Australia New Zealand

• South America• Africa

21

Australia

22

Monash University

To US

National projects

• Europe• North America• Asia• Australia• South America

Clusters, clusters, clusters… Brazil others

• Africa

23

National projects

• Europe• North America• Asia• Australia• South America

• Africanone… Africa has the poorest Internet performanceInternet Performance to Africa Cotrell, Canessa, 2003

24

Agenda

1. Introduction2. Sharks v. Piranhas3. National projects4. Continental projects5. Global projects6. Conclusions

i

Continental projects

• Europe European DataGrid CrossGrid

• North America TeraGrid

• Asia APAN

25

European DataGrid

26

• European DataGridTest Bed 1 14 countries 21 major sites CrossGrid

CrossGrid

27

TeraGrid

28

APAN

29

Access PointExchange PointCurrent Status2004 (plan)

USA

Europe

Australia

Indonesia

Vietnam

Sri Lanka

Korea

Thailand

Malaysia

Singapore

Taiwan

Russia

Philippines

China

Hong Kong

Japan

TWHK

Russia

South Asia Net

Central Asia Net

China

PH

AU

MY SG

CN

KR

Oceania Net

South East Asia Net

North Asia Net

CentralAsia

West

Asia

LK

SouthAsia Net

JP

TH

Clusters Map

Network Map

Agenda

1. Introduction2. Sharks v. Piranhas3. National projects4. Continental projects5. Global projects6. Conclusions

i

Global projects

• Globus GUSTO Testbed• GLORIAD• PRAGMA• LBone• DataTAG• LCG• PlanetLAB

30

Globus GUSTO Testbed

31

GLORIAD

32

GLObal Ring network for advanced Applications Development

USA-China-Russia

PRAGMA

33

Pacific Rim Application and Grid Middleware Assembly

USA-Australia-Singapore-Japan-China-Korea-Malaysia

LBone

34

DataTAG

35

LCG

36

PlanetLab

37

Agenda

1. Introduction2. Sharks v. Piranhas3. National projects4. Continental projects5. Global projects6. Conclusions

i

Conclusions• The Grid is to computing what

Internet is to information many global projects (too) many continental projects Grid has been born

• Trends? Clusters in Europe Supercomputers, clusters in US Clusters in rest of North America Supercomputers in Japan Clusters in rest of Asia

• What to do? homogenous/heterogenous resources supercomputers/clusters

38

Thank you!

Questions? Observations? All welcome…

• These slides at:http://rodica.pub.ro/upbgrid

• Alexandru IOSUP [aiosup@cs.pub.ro]

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid

Grid