using gui's to open up your hpc environment

33
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013 1 Using GUI's to Open Up Your HPC Environment Wil Wellington Professional Services (EMEA) MoabCon 2013

Upload: insidehpc

Post on 04-Jul-2015

818 views

Category:

Technology


1 download

DESCRIPTION

In this presentation from Moabcon 2013, Wil Wellington fron Adaptive Computing describes how to Use GUI's to Open Up Your HPC Environment. "In this session we will demonstrate how to start migrating away from using the CLI to using GUI's via MWS to interact with Moab. We will desmontrate how easy it is to make the jump and open up your HPC environment for more projects and departments in your organisation, as well as making life easier for your System Administrators." Learn more at: http://www.adaptivecomputing.com/company/news-and-events/events/moabcon-2013/moabcon-2013-full-agenda/ View the video of this talk at: http://insidehpc.com/?p=36395

TRANSCRIPT

Page 1: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

1

Using GUI's to Open Up Your HPC Environment

Wil Wellington Professional Services (EMEA)

MoabCon 2013

Page 2: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

2

Agenda

▪  Comparison (GUI vs CLI) ▪  Moab Web Services (MWS) ▪  What is MWS ▪  RESTful Web Services ▪  Integration with Moab

▪  Build simple GUI with MWS ▪  Viewpoint ▪  HP Insight CMU Integration ▪  Questions

Page 3: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

3

Comparison - CLI

▪  Ease of use ▪  Difficult to successfully navigate CLI.

▪  Control ▪  More control of O/S using CLI

▪  Multitasking ▪  No ability to view multiple things at once

▪  Appearance ▪  Rarely change in appearance

Page 4: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

4

Comparison - CLI

▪  Speed ▪  Few keystrokes to perform advance actions &

smaller textual information

▪  Resources ▪  Less computing resources

▪  Scripting ▪  Easy to compile a sequence of commands

Page 5: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

5

Comparison - GUI

▪  Ease of use ▪  users pick up interface much easier when

compared to CLI.

▪  Control ▪  Plenty of control, but advance users resort to CLI

▪  Multitasking ▪  Easy to view, control and manipulate multiple

things

▪  Appearance ▪  Aesthetically pleasing to the eye

Page 6: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

6

Comparison - GUI

▪  Speed ▪  Easier and faster to perform certain actions

with just one click

▪  Resources ▪  More system resources (ie, icons, fonts etc..)

▪  Scripting ▪  No comparison to CLI

Page 7: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

7

Conclusion - GUI

ü  Beautiful

ü  Easy to use

ü  In-built multitasking capability

ü  Fun

Page 8: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

8

What is Moab Web Services

▪  Moab Web Services (MWS) is part of Moab Workload Manager that allows programmatic access to (at least) all services offered by Moab Workload Manager through the command line. ▪  MWS is simply a

protocol through which 3rd parties may communicate with Moab

8

Page 9: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

9

RESTful Web Services

▪  RESTful Web Service Advantages ▪  Simple and uses standard methods

▪  Reduces client/server coupling

▪  Access resources with multiple representations

▪  Give every “thing” an ID

▪  Enables access to HTTP cache and proxy server

▪  Allows organisation of very complex applications into simple resource

▪  Communicate statelessly

▪  Easy for existing and new applications to interface

▪  Easy to evolve a REST interface without breaking existing clients

▪  Etc…

9

Page 10: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

10 © 2012 ADAPTIVE COMPUTING, INC. 10

RESTful Web Services

Moab

Jobs Server Nodes

Reservations

Etc.

Resources

Page 11: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

11 © 2012 ADAPTIVE COMPUTING, INC. 11

RESTful Web Services

Moab

Nodes

Reservations

Etc.

Jobs

POST Create/Submit

PUT Modify/Update

GET Read

DELETE Delete

Page 12: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

12 © 2012 ADAPTIVE COMPUTING, INC. 12

RESTful Web Services

Moab

Nodes

Reservations

Etc.

HPC Portal

MWS API

User Input

Job Converter

Run a Monte Carlo

Simulation with this Input!

Jobs

POST

Page 13: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

13 © 2012 ADAPTIVE COMPUTING, INC. 13

MWS Integrated with Moab

Client Interface

Moa

b S

erve

r Resource Managers

Triggers

Statistics

Allocation Mgr

Moab Database

Events Files

Client Commands

Moab Services Manager

Gold (Moab Accounting Mgr)

Moab Viewpoint

Integration Scripts

Page 14: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

14 © 2012 ADAPTIVE COMPUTING, INC.

Moab Web Services Layer Moab Web Services and flexible interfaces, Operations DB

14

The Big Picture

Showback & Chargeback

Intelligence Engine

Decisions, policies, resource scheduling, allocation, workflow & automation orchestration

Admin Dashboard API Calls User Service Portal CLI

Resources  

Storage Manager

Provisioning Manager

Network Manager

Health Monitor

Non-traditional Resource Managers

Other Resources: •  Licenses •  Chillers •  NFS Servers •  Database

Servers •  Equipment •  Etc.

Workload Job

Queue

Multi-vendor Resource Manager

Heterogeneous Resources

Job Manager

Page 15: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

15

MWS Configuration (post install)

15

Page 16: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

16

MWS Configuration

16

Page 17: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

17

MWS Configuration

17

Page 18: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

18

Moab Web Services Configuration

18

Page 19: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

19

Lets build a simple GUI with MWS

Page 20: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

20

Viewpoint

Accelerate user and admin productivity ▪  Simplified job submission and

management

▪  Option: Application Portal Edition

How do I make submitting and managing jobs faster and easier for users?

Page 21: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

21

Simple Job Submit & Management

Moab Viewpoint HPC Portal

▪  Users can easily submit jobs anytime, anywhere

▪  Reduces end-user training

▪  Simplifies and speeds job submission

▪  Simplifies job tracking and self-management

▪  Application Portal Edition for integrated specific application access and templates for guided submission

Easily track job status

Page 22: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

22

Easy Job Submission for Users

Simplified, guided submission

Page 23: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

23

Easy Job Tracking/Self-Management for Users

Quick easy filters

Quick easy actions

Page 24: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

24

Easy Click Drill-down for Specific Node Details

Page 25: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

25

Admins Can Easily Manage User Access

Easily add or modify users and access privileges Synchronize with existing LDAP users and groups Assign user or admin role privileges to control data view, actions and management access

Page 26: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

26

Admins Can Easily Create Reservations for User Access to Resources

Easily create user or admin maintenance reservations Control reservation workload settings Assign reservation access Schedule specific time and resources

Page 27: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

27

Admins Can Easily Manage Reservations for User Access to Resources

Quick click drill downs for details

Page 28: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

28

Easy, Visual Configuration of the Portal

Page 29: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

29

Easy, Visual Node Management for Admins

Quick easy filters

Quick click drill downs for details easy actions

Page 30: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

30

Seamless HP Insight CMU Integration

Streamlined management between workload management and cluster administration ▪  CMU management capabilities automated via policies

▪  Rich monitoring data in CMU powers Moab policies

▪  Single point administration for key workload data and management actions in CMU console

Workload Management

Cluster Administration

Page 31: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

31

View Moab Jobs and Metrics in HP Insight CMU

Select job(s) or their nodes and initiate actions with simple right click menu

Page 32: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

32

View Workload CPUload and Memory Use in Timeline View

Page 33: Using GUI's to Open Up Your HPC Environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

33

Questions?