grid computing - collection of computer resources from multiple locations

27
Grid Computing 1 Presented by : Presented by : Dibyadip Das Dibyadip Das Dnyaneshwar Magar Dnyaneshwar Magar June 6, 2022

Upload: dibyadip-das

Post on 29-Aug-2014

454 views

Category:

Technology


1 download

DESCRIPTION

Grid computing is the collection of computer resources from multiple locations to reach a common goal. The grid can be thought of as a distributed system with non-interactive workloads that involve a large number of files.

TRANSCRIPT

Page 1: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 1

Presented by :Presented by :Dibyadip Das Dibyadip Das Dnyaneshwar Magar Dnyaneshwar Magar

April 7, 2023

Page 2: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 2

What Grid Computing isWhat Grid Computing is• Allows sharing and coordinated use of diverse

resources in dynamic, distributed “virtual organizations”.

Page 3: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 3

Electrical Power Grid AnalogyElectrical Power Grid Analogy Electrical power grid • users (or electrical appliances)

get access to electricity through wall sockets with no care or consideration for where or how the electricity is actually generated.

• “The power grid” links together power plants of many different kinds

The Grid• users (or client applications) gain

access to computing resources (processors, storage, data, applications, and so on) as needed with little or no knowledge of where those resources are located or what the underlying technologies, hardware, operating system, and so on are

• "the Grid" links together computing resources (PCs, workstations, servers, storage elements) and provides the mechanism needed to access them.

Page 4: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 4

Why need Grid Computing?Why need Grid Computing?• Core networking technology now accelerates at a

much faster rate than advances in microprocessor speeds

• Exploiting under utilized resources• Parallel CPU capacity• Virtual resources and virtual organizations for

collaboration• Access to additional resources

Page 5: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 5

Who needs Grid Computing?Who needs Grid Computing?• Not just computer scientists…• scientists “hit the wall” when faced with

situations:– The amount of data they need is huge and the data is

stored in different institutions. – The amount of similar calculations the scientist has to do

is huge. • Other areas:

– Government– Business– Education– Industrial design – ……

Page 6: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 6

Types of resources

• Computation• Storage• Communications• Software and licenses• Special equipment, capacities,

architectures, and policies

Page 7: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 7

Job SchedulingJob Scheduling

Page 8: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 8

SecuritySecurity• Access policy - What is shared? Who is

allowed to share? When can sharing occur?

• Authentication - How do you identify a user or resource?

• Authorization -How do you determine whether a certain operation is consistent with the rules?

Page 9: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 9

Grid Security ModelGrid Security Model

Page 10: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 10

Grid User RolesGrid User Roles ---A User’s Perspective---A User’s Perspective

• Enrolling and installing grid software• Logging onto the grid• Queries and submitting jobs• Data configuration• Monitoring progress and recovery• Reserving resources

Page 11: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 11

Grid User RolesGrid User Roles---An Administrator’s Perspective---An Administrator’s Perspective• Planning• Installation• Managing enrollment of donors and

users• Certificate authority• Resource management• Data sharing

Page 12: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 12

Grid ArchitectureGrid Architecture

Application

Collective

Resource

Connectivity

Fabric

Application

TransportInternet

Link

GRID

Internet

Page 13: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 13

Grid ArchitectureGrid Architecture• Fabric layer: Provides the resources to which shared

access is mediated by Grid protocols.• Connectivity layer: Defines the core communication and

authentication protocols required for grid-specific network functions.

• Resource layer: Defines protocols, APIs, and SDKs for secure negotiations, initiation, monitoring control, accounting and payment of sharing operations on individual resources.

• Collective Layer: Contains protocols and services that capture interactions among a collection of resources.

• Application Layer: These are user applications that operate within VO environment.

Page 14: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 14

Key ComponentsKey Components• Portal/user interface

Page 15: Grid Computing - Collection of computer resources from multiple locations

Grid PortalGrid Portal

• Provides uniform access to the grid resources. For example, capabilities for Grid Computing resource authentication, remote resource access, scheduling capabilities, and monitoring status information.

Grid Computing 15

Page 16: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 16

Key ComponentsKey Components• Security

– Grid Security Infrastructure (GSI)

Page 17: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 17

Key ComponentsKey Components• Broker

– Monitoring and Discovery Service (MDS)

Page 18: Grid Computing - Collection of computer resources from multiple locations

BrokerBroker

• It provides pairing services between the service requester and the service provider.

• This pairing enables the selection of best available resources from the service provider for the execution of a specific task

Grid Computing 18

Page 19: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 19

Key ComponentsKey Components• Scheduler

Page 20: Grid Computing - Collection of computer resources from multiple locations

SchedulerScheduler• Schedulers are types of applications

responsible for the management of jobs.

• Allocation of resources needed for any specific job.

• Partitioning of jobs to schedule parallel execution of tasks, data management

Grid Computing 20

Page 21: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 21

Globus Toolkit 4 Globus Toolkit 4

Page 22: Grid Computing - Collection of computer resources from multiple locations

October 12, 2001 Intro to Grid Computing and Globus Toolkit™

22DOE X-ray grand challenge: ANL, USC/ISI, NIST, U.Chicagotomographic reconstruction

real-timecollection

wide-areadissemination

desktop & VR clients with shared controls

Advanced Photon Source

Online Access to Online Access to Scientific InstrumentsScientific Instruments

archival storage

Page 23: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 23

Applications• The Southern California Earthquake Center uses

Globus software to visualize earthquake simulation data.

Page 24: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 24

Applications• Scientists in the Earth System Grid (ESG) are producing,

archiving, and providing access to climate data that advances our understanding of global climate change. ESG uses Globus software for security, data movement, and system monitoring.

Page 25: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 25

Applications• Globus Toolkit-driven Grid computing is central to

management of large datasets generated by colliders such as those at CERN. This simulation shows two colliding lead ions just after impact, with quarks in red, blue, and green and hadrons in white.

Page 26: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 26

Prospect of Grid computingProspect of Grid computing• The Grid aims ultimately to turn the global

network of computers into one vast computational resource.

• Related to many areas in computer science• Being developed by hundreds of researchers and

software engineers around the world. • Still “work in process”• Potentially revolutionary.

Page 27: Grid Computing - Collection of computer resources from multiple locations

Grid Computing 27

Thank You!Thank You!“You may say I'm a dreamer

But I'm not the only oneI hope someday you'll join usAnd the world will be as one”

~ Beatles