garuda - the national grid computing initiative of india

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

GARUDA - The National Grid Computing Initiative of India

Subrata ChattopadhyayC-DAC, Bangalore, India

[email protected]


Outline

•GARUDA Overview•Architecture & Network •Resources •Partners •Applications for PoC• Interoperability


Motivation for GARUDA• Sharing of high-end computational resources

with the larger scientific and engineering community across the country

• Emerging High Performance Computing (HPC) applications require integration of geographically distributed resources

• Collaborative Framework for solving applications which are interdisciplinary requiring experts from multiple domains and distributed locations

• Universal (location-independence, ubiquitous) access to resources

Computational Grids effectively address the above application requirements


Project Overview• Precursor to the National Grid Computing Initiative

– Test Bed for grid technology/concepts and applications leading to the plan for the main grid initiative

• Project initiated by the Dept. of IT in November 2004 • Major Deliverables

– Technologies, Architectures, Standards & Research Initiatives

– Nation-wide high-speed communication fabric– Aggregation of Grid Resources– Deployment of Select applications of National

Importance– Grid Strategic User Group

• High-speed Networking Component in collaboration with ERNET


Garuda Component Architecture

Resources

• Compute, Data, Storage,

• Scientific Instruments,

• Softwares,..

Access Methods

• Access Portal

• Problem Solving Environments

Data Management

• Storage Resource Broker

Development Environment

• DIViA for Grid

Management & Monitoring

• Paryaveekshanam

Collaborative Environment

• Video Conferencing over IP

• Access Grid

Resource Mgmt & Scheduling

• Moab from Cluster Resources

• Load Leveler, Torque

• Globus 2.x

Application (PoC)

• Disaster Management

• Bioinformatics


GARUDA Component Deployment Scenario`

CC -- D A C , D A C , B a n g a l o r eB a n g a l o r eL A N

L o c a l U s e r

H e a dN o d e

C o m p u t e N o d e s

I n t e r n e tA c c e s sG e n e r i c

U s e r

L o c a l U s e r

H e a dN o d e


L A N

CC -- D A C , P u n eD A C , P u n e

P a r t n e r P a r t n e r w i t h o u t r e s o u r c e sw i t h o u t r e s o u r c e s

A c c e s s T e r m i n a l s

P a r t n e rP a r t n e rw i t h r e s o u r c e sw i t h r e s o u r c e s

U s e rH e a dN o d e

T e l e s c o p e

L A N

S t o r a g e

H e a dN o d e


L A N

A c c e s s T e r m i n a l

G a t e w a y

S u b m i t N o d e

S u b m i t N o d e

G a t e w a y

A c c e s sT e r m i n a l



M P L S M P L S

A c c e s sA c c e s s

G a t e w a y

G a t e w a y

CC -- D A C , D A C , B a n g a l o r eB a n g a l o r eL A N

L o c a l U s e r

H e a dN o d e


H e a dN o d e


I n t e r n e tA c c e s s

I n t e r n e tA c c e s sG e n e r i c

U s e r

L o c a l U s e r

H e a dN o d e


H e a dN o d e


L A N

CC -- D A C , P u n eD A C , P u n e

P a r t n e r P a r t n e r w i t h o u t r e s o u r c e sw i t h o u t r e s o u r c e s

A c c e s s T e r m i n a l s

P a r t n e rP a r t n e rw i t h r e s o u r c e sw i t h r e s o u r c e s

U s e rH e a dN o d e

T e l e s c o p e

L A N

S t o r a g e

H e a dN o d e


L A N


G a t e w a yG a t e w a y

S u b m i t N o d e

S u b m i t N o d e

S u b m i t N o d e

S u b m i t N o d e


A c c e s sT e r m i n a l



M P L S M P L S

A c c e s sA c c e s s




Cyber Infrastructure – Network Fabric

• The Proof of Concept network has been established in collaboration with ERNET

• The MPLS Virtual Private Network (VPN) connects 22 institutions at 100 Mbps and 23 institutions at 10 Mbps across 17 Indian cities with SLA agreements

• Collaborative environment enabled through Video Conferencing over IP at the following centres of C-DAC : Bangalore, Pune, Chennai, Hyderabad, Mumbai and Trivandrum


Cyber Infrastructure – Resources

• In addition to PARAM Padma, Linux Clusters have been setup at Pune, Hyderabad & Chennai

• Grid Labs have been setup at Bangalore, Pune & Hyderabad

• Fourteen of the partner institutions are contributing resources including satellite terminals (compute aggregating to more than 300 CPUs)


Resource Details• HPC Clusters from C-DAC

Bangalore : AIX Cluster

Pune, Chennai, Hyderabad : Linux Clusters

• Linux Clusters from

• IISc & RRI, Bangalore

• IMSc & MIT, Chennai

• IIT, Guwahati

• IIT, Kharagpur• AIX SMP from University of

Hyderabad • SAC, Ahmedabad is contributing

GSAT3 terminals (GSAT4 when launched) and Satellite bandwidth


Job submission flow

AIXCluster

Shared User SpaceShared Data Space

Linux Cluster

Bangalore

Solaris Cluster

LinuxCluster

Shared User SpaceShared Data Space

Pune

Chennai HyderabadResource

Manager for Grids

Linux Cluster

ResourceManager for Grids

Garuda Access Portal

Other UsersPune Users

End Users access the grid through the Garuda Access Portal

HighAvailability

HighAvailability

Resource Manager for Grids

HighAvailability

HighAvailability

Resource Manager for Grids

Bangalore Users


Grid Management & Monitoring Centre

• An integrated Resource Management & Monitoring Framework

• Network Traffic Analysis and Congestion Management

• Help desk for Grid Users


GARUDA Partners• Motivation– To Collaborate on

Research and Engineering of Technologies, Architectures, Standards and Applications in Grid Computing

– To Contribute to the aggregation of resources in the Grid

• Current Participation– 36 research & academic

institutions in the 17 cities

– ERNET-HQ in Delhi– 8 centres of C-DAC– Total of 45 institutions


GARUDA Partners (contd..)C-DAC Centres (8):• Pune (2)• Bangalore(2)• Hyderabad• Mumbai• Chennai• Thiruvananthapuram

Academia• Motilal Nehru National Institute of Technology, Allahabad• Indian Institute of Science, Bangalore• Punjab Engineering College, Chandigarh• Madras Institute of Technology, Chennai• Jawaharlal Nehru University, Delhi• Guwahati University, Guwahati• University of Hyderabad, Hyderabad• Indian Institute of Technology at :

• Chennai• Delhi• Guwahati• Kanpur• Kharagpur • Mumbai• Roorkee

• University of Pune, Pune• Institute of Technology, Banaras Hindu University, Varanasi

Government Collaborators• ERNET India


GARUDA Partners (contd..)Research Labs & Institutions• Institute for Plasma Research, Ahmedabad• Physical Research Laboratory, Ahmedabad• Space Application Centre, Ahmedabad• Harish Chandra Research Institute, Allahabad• Indian Institute of Astrophysics, Bangalore• National Centre for Biological Sciences, Bangalore • Raman Research Institute, Bangalore• Institute of Mathematical Sciences, Chennai• Institute of Microbial Technology, Chandigarh• Institute of Genomics and Integrative Biology, Delhi• Centre for DNA fingerprinting and Diagnostics, Hyderabad• Saha Institute of Nuclear Physics, Kolkatta• Sanjay Gandhi Post Graduate Institute of Medical Sciences,

Lucknow• Bhabha Atomic Research Centre, Mumbai• Tata Institute of Fundamental Research, Mumbai• Inter-University Centre for Astronomy and Astrophysics, Pune• National Chemical Laboratory, Pune• National Centre for Radio Astrophysics, Pune• Regional Cancer Centre, Thiruvananthapuram• Vikram Sarabhai Space Centre, Thiruvananthapuram


Illustrative Applications


Objectives and Deliverables• Objectives

– Enable applications of national importance requiring aggregation of geographically distributed resources

• Deliverables– Grid enablement of

illustrative applications and some demonstrations such as • Bioinformatics• Disaster

Management


Bioinformatics• Bioinformatics Resources

& Applications Facility (BRAF) on PARAM Padma

• Supports highly optimized Bioinformatics codes on the PARAM Padma

• Web computing portal providing all computational facility to solve related problems


Disaster Management

PARAM Padma

at Bangalore

Flight data transmission from

nearby Airport

Grid Partner Resource

at Pune

User Agencies

GRID Communication

Fabric

High Speed Communicati

on

UserAgenci

es


Virtual User Community

• Astrophysics• High Energy Physics & Astronomy• Grid Technology• Disaster Management• Earth Science• Bioinformatics (Genome)• Network Technology


Garuda – EGEE Interoperability

• Garuda components • EGEE components• Options for interoperability• Discussion


Job Submission Flow Through Grid PortalLogin to

Portal

PSEDevelop Application

Use resource browser and identify the platform

Write Application

Compile

If Erro

r

Get & Match Requirement and identify resources

Use Debugger View O/P files

The files get transferred to the execution

machine(s)

The job executes

The job completes execution

The files get transferred to the Grid Head Node

Yes

No

Submit Job with its

requirements

Get & Match Requirement and identify resources

Upload Input

datasets

The files get transferred to the Grid Head Node


Genome Grid

10 Mbps

PUNEBangalore

8 Node Dual CPU Xeon Cluster




100 Mbps 10 Mbps

Chennai

Hyderabad

Garuda Portal

Dynamic Resource Scheduling

User

User

Client GARUDA

Globus middleware

100 Mbps


EGEE Services

API Access

Job Mgmt. Services

ComputingElement

WorkloadManagement

MetadataCatalog

Data Management

StorageElement

DataMovement

File & ReplicaCatalog

Authorization

Security Services

Authentication

Information &Monitoring

Information & Monitoring Services

Service

Discovering

Accounting

Auditing

JobProvenance

PackageManager

CLI

Network

Monitoring


Basic Interop. Job submission

PBS-LikeMaster Node

WN-1

WN-2

WN-n

lcg-CE(PBS submission)

Mixed WN:GARUDA + gLite TAR-WN

GARUDA Submission (Portal)

gLite Submission (WMS)

GARUDA LinuxResources

GARUDAPortal Submission

gLite (TAR)UI or subset(WMProxy APIs)

JDL creation & Job submission

gLite WMS

glIteResources

cloud

WNs must supportGARUDA ENV.

In case of AIX sys.could be evaluatedAIX-ENEA solution

gLite WN & UI TARavailable on SLC3/4


Job Submission Flow for EGEE Grid User


Job Submission Flow for GARUDA Grid User


Challenges !

• Multiple components – evolving• User authentication mechanisms• Complexity and stability• Open source and commercial

license• Accounting


Thank you! www.garudaindia.in

garuda - the national grid computing initiative of india

Documents