© copyright 2003 the australian nimrod testbed slavisa garic (dstc) colin enticott (dstc)...

© Copyright 2003

The Australian Nimrod The Australian Nimrod TestbedTestbed

Slavisa Garic (DSTC)Slavisa Garic (DSTC)Colin Enticott (DSTC)Colin Enticott (DSTC)

Supervisor:Supervisor:David Abramson (Monash)David Abramson (Monash)

Utilising GrangeNetUtilising GrangeNet

Speaker: Colin EnticottSpeaker: Colin Enticott

© Copyright 2003

IndexIndex

DSTC/GrangeNetDSTC/GrangeNet ProjectsProjects ANT/Enhancement of Nimrod/G V2.0 ANT/Enhancement of Nimrod/G V2.0

for GrangeNetfor GrangeNet• The Nimrod PortalThe Nimrod Portal

Pragma 4Pragma 4• Resources and resultsResources and results

© Copyright 2003

DDistributed istributed SSystems ystems TTechnology echnology CCentreentre The DSTC is a National IT Research and The DSTC is a National IT Research and

Development Centre focussing on the Development Centre focussing on the needs of the Government, Defence, needs of the Government, Defence, Health, Finance, Telecommunications and Health, Finance, Telecommunications and Education Sectors.Education Sectors.

© Copyright 2003

GrangeNetGrangeNet

GrGrid id aand nd nnext ext gegeneration neration NetNetworkwork Develop and operate a multi-gigabit Develop and operate a multi-gigabit

networknetwork Support grid and advanced Support grid and advanced

communications servicescommunications services 3 year program3 year program GrangeNet is 'open' to participation of GrangeNet is 'open' to participation of

organisationsorganisations

© Copyright 2003

InitialInitial GrangeNet LocationsGrangeNet LocationsBrisbaneMegapop

SydneyMegapop

CanberraMegapop

MelbourneMegapop

DSTCQPSF

Uni of Queensland

Boeing HQ

UTSDSTC@UTS

ANUAPAC

AARNet

Uni of Melbourne

VPACI-cubed

RMIT

AC3@ATPeBioinformatics

CRCSIT

CSIROBoM

SCCNUSA link

Dual 155M STM-1 link

2.5G PoS link

1 GbE link

Monash UniDSTC@MU

QUTQMI

GriffithU

UniSydUNSWCSIRO

IVECSAPACTPAC

© Copyright 2003

IndexIndex

DSTC/GrangeNetDSTC/GrangeNet ProjectsProjects ANT/Enhancement of Nimrod/G V2.0 ANT/Enhancement of Nimrod/G V2.0



© Copyright 2003

NimrodNimrod

A A hunterhunter for computational resources for computational resources on the gridon the grid

Designed to assist parametric problemsDesigned to assist parametric problems Launching platformLaunching platform Performs file copying, execution and Performs file copying, execution and

maintains parameter setsmaintains parameter sets

© Copyright 2003

NimrodNimrod

Prof. David AbramsonProf. David Abramson Rok SosicRok Sosic Jon GiddyJon Giddy Slavisa GaricSlavisa Garic

© Copyright 2003

Parametric ExecutionParametric Execution

Study the Study the behaviourbehaviour of some of the of some of the output variables against a range of output variables against a range of different input scenarios.different input scenarios.

Computations are uncoupled (file Computations are uncoupled (file transfer)transfer)

Allows real time analysis for many Allows real time analysis for many applicationsapplications

More realistic simulationsMore realistic simulations

© Copyright 2003

Dr Dinelli MatherMonash University &MacFarlane Burnett

Public Health Policy

Genetic Algorithms

Dr Shane Dunn,AMRL, DSTO

Network Simulation

Mahbub Hasan, Monash University

Case Studies ...Case Studies ...

Dr Kate Smith,Monash University

Neural Network Optimization

Cattle Tick

© Copyright 2003



Genetic Algorithms


Network Simulation





Cattle Tick


Financial Services

Rendering Movies

CAD SimulationParallel MP3 Encoder

© Copyright 2003



Genetic Algorithms


Network Simulation





Cattle Tick


Financial Services

Rendering Movies

CAD SimulationParallel MP3 Encoder


Health Standards

Lew KotlerAustralian Radiation Protection and Nuclear Safety Agency

Factory Simulation

John Betts, Monash University

Simulated AnnealingOptimization

Marcus Randall,Bond University

Ad-hoc Wireless

© Copyright 2003

Nimrod case studiesNimrod case studies

Particles ejecting from a supernovaParticles ejecting from a supernova Kuiper belt simulationsKuiper belt simulations Chemical docking. 100000Chemical docking. 10000022's of 's of

combinationscombinations GAMESSGAMESS

© Copyright 2003

parameter A1 float range from 1 to 4 step 0.1;parameter A2 float range from -1 to 0 step 0.1;parameter B1 float range from 0.5 to 2 step 0.1;parameter B2 float range from 0 to 1 step 0.1;

task main copy cart_eth.inp.sub node:. copy spher_eth.inp.sub node:. copy cart_rad.inp.sub node:. copy spher_rad.inp.sub node:. copy pragma4.$OS node:pragma4 copy pragma4.dat node:. substitute cart_eth.inp.sub cart_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute spher_eth.inp.sub spher_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute cart_rad.inp.sub cart_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute spher_rad.inp.sub spher_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp node:execute $HOME/bin/cleanrungms cart_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > cart_eth.out node:execute $HOME/bin/cleanrungms spher_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > spher_eth.out node:execute $HOME/bin/cleanrungms cart_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > cart_rad.out node:execute $HOME/bin/cleanrungms spher_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > spher_rad.out node:execute ./pragma4 > pragma4.out

node:execute /bin/tar cvf results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar cart_eth.out spher_eth.out cart_rad.out spher_rad.out pragma4.out node:execute /bin/gzip results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar copy node:results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar.gz results/results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar.gzendtask

How does a user develop an How does a user develop an application using application using NimrodNimrod??

Job 1 Job 2 Job 3

Job 4 Job 5 Job 6

Job 7 Job 8 Job 9

Job 10 Job 11 Job 12



Description of ParametersPLAN FILE

© Copyright 2003

Nimrod/G 2.0 ArchitectureNimrod/G 2.0 ArchitectureNimrod/G Client Rsrc. SchedulerNimrod/G Client

Grid Information Server(s)

RM & TS

RM: Local Resource Manager, TS: Trade Server

G

L

Legion enabled node. CCondor enabled node.

Nimrod/G GUI

Enfuzion API +

Database

Level 3

Level 2

Level 1

GeneratorCreator

Run File

Plan File

Job SchedulerAgent Scheduler

DB Server

Agent

Globus Actuator Condor ActuatorLegion Actuator

Globus enabled node

RM & TS

RM & TS

AgentAgent

Grid Middleware

© Copyright 2003

Nimrod/ONimrod/O

Performs optimisationsPerforms optimisations Uses Nimrod or EnFuzionUses Nimrod or EnFuzion Simplex, Gradient Decent, B.G.F.S., Simplex, Gradient Decent, B.G.F.S.,

Genetic algorithms, …Genetic algorithms, …

Prof. David AbramsonProf. David Abramson Andrew LewisAndrew Lewis Tom PeachyTom Peachy

© Copyright 2003

Nimrod DependenciesNimrod Dependencies

One job cannot start until its One job cannot start until its dependency jobs have completeddependency jobs have completed

David AbramsonDavid Abramson Shahaan AyyubShahaan Ayyub

© Copyright 2003

Active SheetsActive Sheets

© Copyright 2003

Active SheetsActive Sheets

Prof. David AbramsonProf. David Abramson Paul RoePaul Roe Gavin CheukGavin Cheuk

© Copyright 2003

GriddLeSGriddLeS Legacy Applications are ComponentsLegacy Applications are Components

• Cannot necessarily modify themCannot necessarily modify them GriddLeSGriddLeS

• SSpecification of the interconnections between pecification of the interconnections between componentscomponents

• IInterfaces for discovering resources and mapping the nterfaces for discovering resources and mapping the computations to themcomputations to them

• LoLocate data files in the grid and connect the cate data files in the grid and connect the applications to them; applications to them;

• SSchedule computations on the underlying platforms chedule computations on the underlying platforms and making sure the network bandwidth is available and making sure the network bandwidth is available and and

• MMonitor the progress of the grid computation and onitor the progress of the grid computation and reassign work to other parts of the Grid as necessary.reassign work to other parts of the Grid as necessary.

© Copyright 2003

Standard ImplementationStandard Implementation

GASS

Real time data

Data Fusion

General Circulation model

Regional weather model

Photo-chemical pollution model Particle dispersion model

TopographyDatabase

TopographyDatabase

VegetationDatabase

VegetationDatabase

Emissions Inventory

Emissions Inventory

MPIMPI

MPI

GASS/GridFTP/GRC

MPI

MPI

Bushfire model GASS

© Copyright 2003

GriddLeSGriddLeS

Prof. David AbramsonProf. David Abramson Jagan KommineniJagan Kommineni

© Copyright 2003

IndexIndex

DSTC/GrangeNetDSTC/GrangeNet

ProjectsProjects ANT/Enhancement of Nimrod/G V2.0 ANT/Enhancement of Nimrod/G V2.0



© Copyright 2003

ANTANT

Australian Australian NimrodNimrod Testbed Testbed A DSTC project for GrangeNetA DSTC project for GrangeNet Lead by Prof. David AbramsonLead by Prof. David Abramson

© Copyright 2003

parameter A1 float range from 1 to 4 step 0.1;parameter A2 float range from -1 to 0 step 0.1;parameter B1 float range from 0.5 to 2 step 0.1;parameter B2 float range from 0 to 1 step 0.1;

task main copy cart_eth.inp.sub node:. copy spher_eth.inp.sub node:. copy cart_rad.inp.sub node:. copy spher_rad.inp.sub node:. copy pragma4.$OS node:pragma4 copy pragma4.dat node:. substitute cart_eth.inp.sub cart_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute spher_eth.inp.sub spher_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute cart_rad.inp.sub cart_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute spher_rad.inp.sub spher_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp node:execute $HOME/bin/cleanrungms cart_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > cart_eth.out node:execute $HOME/bin/cleanrungms spher_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > spher_eth.out node:execute $HOME/bin/cleanrungms cart_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > cart_rad.out node:execute $HOME/bin/cleanrungms spher_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > spher_rad.out node:execute ./pragma4 > pragma4.out

node:execute /bin/tar cvf results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar cart_eth.out spher_eth.out cart_rad.out spher_rad.out pragma4.out node:execute /bin/gzip results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar copy node:results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar.gz results/results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar.gzendtask

How does a user develop an How does a user develop an application using application using NimrodNimrod??

Job 1 Job 2 Job 3

Job 4 Job 5 Job 6

Job 7 Job 8 Job 9




Description of ParametersPLAN FILE

NimrodNimrodPortalPortal

© Copyright 2003

Nimrod PortalNimrod Portal

The portal allows a quick and The portal allows a quick and powerful display of powerful display of experiments.experiments.

The status of each experiment The status of each experiment can be seen in a glance:can be seen in a glance:

Useable via any web browser Useable via any web browser that supports secure that supports secure connections. Shell access not connections. Shell access not required but is also available.required but is also available.

All experiment information on All experiment information on the experiment summary the experiment summary page: page:

© Copyright 2003

Plan file editorPlan file editor

© Copyright 2003

IndexIndex

DSTC/GrangeNetDSTC/GrangeNet

ProjectsProjects

ANT/Enhancement of Nimrod/G V2.0 ANT/Enhancement of Nimrod/G V2.0 for GrangeNetfor GrangeNet

The Nimrod PortalThe Nimrod Portal Pragma 4Pragma 4

• Resources and resultsResources and results

© Copyright 2003

Pragma 4Pragma 4

Held on the 5Held on the 5thth and 6 and 6thth June June Parameter Scan of an Effective Group Parameter Scan of an Effective Group

Difference Pseudopotential Using Difference Pseudopotential Using Grid ComputingGrid Computing

An experiment by Kim Baldridge and An experiment by Kim Baldridge and Wibke Sudholt at the University of Wibke Sudholt at the University of California, San DiegoCalifornia, San Diego

Using GAMESSUsing GAMESS

© Copyright 2003

Experiment ResourcesExperiment ResourcesMachine Name

Queue Manager

Processors Availa

ble

OS & Architecture

Location

hathor.csse.monash.edu.au PBS 24 Linux x86 Melbourne

brecca-2.vpac.org PBS 30 Linux x86 Melbourne

koume.hpcc.jp Grid Engine 4 Linux x86 Japan

ume.hpcc.jp Grid Engine 64 Linux x86 Japan

amata1.cpe.ku.ac.th SQMS 15 Linux x86 Thailand

erikson.ucsd.edu PBS 74 Linux x86 San Diego

slic00.sdsc.edu PBS 148 Linux x86 San Diego

hpc420.hpcc.jp PBS 14 Solaris Sparc Japan

tardis.eng.monash.edu.au NQE 1 Cray SV1 Melbourne

sn9280.cray.co.jp NQE 1 Cray SV1 Japan

venus.gridcenter.or.kr PBS 64 Linux x86 Korea

jupiter.gridcenter.or.kr PBS 16 Linux x86 Korea

apbs.rocksclusters.org PBS 12 Linux x86 San Diego

chemcca40.ucsd.edu PBS 36 Linux x86 San Diego

© Copyright 2003

0

10

20

30

40

50

60

Experiment time

# o

f C

PU

s

ume.hpcc.jp

slic00.sdsc.edu

koume.hpcc.jp

hathor.csse.monash.edu.au

erikson.ucsd.edu

chemcca40.ucsd.edu

brecca-2.vpac.org

apbs.rocksclusters.org

Number of CPUsNumber of CPUs

© Copyright 2003

New Experiment ResourcesNew Experiment Resources

Machine NameQueue Manager

Processors Availa

ble

OS & Architecture

Location

lc0.apac.edu.au PBS 152 Linux x86 Canberra

bouscat.cs.cf.ac.uk Fork 2 Linux x86 U.K.

bg02n100e00.hpc.cmc.osaka-u.ac.jp PBS 156 Linux x86 Japan

altix16.hpcu.uq.edu.au PBS 16 Linux ia64 Brisbane

globus.is.titech.ac.jp PBS 512 Linux x86 Japan

sputnik.earth.monash.edu.au PBS 16 Linux x86 Melbourne

cmsdgrid.uohyd.ernet.in Fork 1 Linux x86 India

nazgul.qpsf.edu.au SGE 7 Linux x86 Brisbane

wesc9-comsc.grid.cf.ac.uk Condor 64 IRIX MIPS U.K.

grid011.cs.usm.my PBS Linux Malaysia

horizon.sdsc.edu SP3 San Diego

hypnos.engin.umich.edu 254 Michigan

© copyright 2003 the australian nimrod testbed slavisa garic (dstc) colin enticott (dstc)...

Documents

monash university case

grangenet grid

wireless slide

parameter a1 float range

parameter b1 float range

parameter a2 float range

nimrod case studies

generation network grid