using gui's to open up your hpc environment

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

1

Using GUI's to Open Up Your HPC Environment

Wil Wellington Professional Services (EMEA)

MoabCon 2013

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

2

Agenda

▪  Comparison (GUI vs CLI) ▪  Moab Web Services (MWS) ▪  What is MWS ▪  RESTful Web Services ▪  Integration with Moab

▪  Build simple GUI with MWS ▪  Viewpoint ▪  HP Insight CMU Integration ▪  Questions

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

3

Comparison - CLI

▪  Ease of use ▪  Difficult to successfully navigate CLI.

▪  Control ▪  More control of O/S using CLI

▪  Multitasking ▪  No ability to view multiple things at once

▪  Appearance ▪  Rarely change in appearance

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

4

Comparison - CLI

▪  Speed ▪  Few keystrokes to perform advance actions &

smaller textual information

▪  Resources ▪  Less computing resources

▪  Scripting ▪  Easy to compile a sequence of commands

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

5

Comparison - GUI

▪  Ease of use ▪  users pick up interface much easier when

compared to CLI.

▪  Control ▪  Plenty of control, but advance users resort to CLI

▪  Multitasking ▪  Easy to view, control and manipulate multiple

things

▪  Appearance ▪  Aesthetically pleasing to the eye

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

6

Comparison - GUI

▪  Speed ▪  Easier and faster to perform certain actions

with just one click

▪  Resources ▪  More system resources (ie, icons, fonts etc..)

▪  Scripting ▪  No comparison to CLI

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

7

Conclusion - GUI

ü  Beautiful

ü  Easy to use

ü  In-built multitasking capability

ü  Fun

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

8

What is Moab Web Services

▪  Moab Web Services (MWS) is part of Moab Workload Manager that allows programmatic access to (at least) all services offered by Moab Workload Manager through the command line. ▪  MWS is simply a

protocol through which 3rd parties may communicate with Moab

8

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

9

RESTful Web Services

▪  RESTful Web Service Advantages ▪  Simple and uses standard methods

▪  Reduces client/server coupling

▪  Access resources with multiple representations

▪  Give every “thing” an ID

▪  Enables access to HTTP cache and proxy server

▪  Allows organisation of very complex applications into simple resource

▪  Communicate statelessly

▪  Easy for existing and new applications to interface

▪  Easy to evolve a REST interface without breaking existing clients

▪  Etc…

9

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

10 © 2012 ADAPTIVE COMPUTING, INC. 10

RESTful Web Services

Moab

Jobs Server Nodes

Reservations

Etc.

Resources

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

11 © 2012 ADAPTIVE COMPUTING, INC. 11

RESTful Web Services

Moab

Nodes

Reservations

Etc.

Jobs

POST Create/Submit

PUT Modify/Update

GET Read

DELETE Delete

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

12 © 2012 ADAPTIVE COMPUTING, INC. 12

RESTful Web Services

Moab

Nodes

Reservations

Etc.

HPC Portal

MWS API

User Input

Job Converter

Run a Monte Carlo

Simulation with this Input!

Jobs

POST

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

13 © 2012 ADAPTIVE COMPUTING, INC. 13

MWS Integrated with Moab

Client Interface

Moa

b S

erve

r Resource Managers

Triggers

Statistics

Allocation Mgr

Moab Database

Events Files

Client Commands

Moab Services Manager

Gold (Moab Accounting Mgr)

Moab Viewpoint

Integration Scripts

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

14 © 2012 ADAPTIVE COMPUTING, INC.

Moab Web Services Layer Moab Web Services and flexible interfaces, Operations DB

14

The Big Picture

Showback & Chargeback

Intelligence Engine

Decisions, policies, resource scheduling, allocation, workflow & automation orchestration

Admin Dashboard API Calls User Service Portal CLI

Resources  

Storage Manager

Provisioning Manager

Network Manager

Health Monitor

Non-traditional Resource Managers

Other Resources: •  Licenses •  Chillers •  NFS Servers •  Database

Servers •  Equipment •  Etc.

Workload Job

Queue

Multi-vendor Resource Manager

Heterogeneous Resources

Job Manager

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

15

MWS Configuration (post install)

15

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

16

MWS Configuration

16

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

17

MWS Configuration

17

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

18

Moab Web Services Configuration

18

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

19

Lets build a simple GUI with MWS

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

20

Viewpoint

Accelerate user and admin productivity ▪  Simplified job submission and

management

▪  Option: Application Portal Edition

How do I make submitting and managing jobs faster and easier for users?

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

21

Simple Job Submit & Management

Moab Viewpoint HPC Portal

▪  Users can easily submit jobs anytime, anywhere

▪  Reduces end-user training

▪  Simplifies and speeds job submission

▪  Simplifies job tracking and self-management

▪  Application Portal Edition for integrated specific application access and templates for guided submission

Easily track job status

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

22

Easy Job Submission for Users

Simplified, guided submission

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

23

Easy Job Tracking/Self-Management for Users

Quick easy filters

Quick easy actions

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

24

Easy Click Drill-down for Specific Node Details

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

25

Admins Can Easily Manage User Access

Easily add or modify users and access privileges Synchronize with existing LDAP users and groups Assign user or admin role privileges to control data view, actions and management access

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

26

Admins Can Easily Create Reservations for User Access to Resources

Easily create user or admin maintenance reservations Control reservation workload settings Assign reservation access Schedule specific time and resources

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

27

Admins Can Easily Manage Reservations for User Access to Resources

Quick click drill downs for details

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

28

Easy, Visual Configuration of the Portal

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

29

Easy, Visual Node Management for Admins

Quick easy filters

Quick click drill downs for details easy actions

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

30

Seamless HP Insight CMU Integration

Streamlined management between workload management and cluster administration ▪  CMU management capabilities automated via policies

▪  Rich monitoring data in CMU powers Moab policies

▪  Single point administration for key workload data and management actions in CMU console

Workload Management

Cluster Administration

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

31

View Moab Jobs and Metrics in HP Insight CMU

Select job(s) or their nodes and initiate actions with simple right click menu

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

32

View Workload CPUload and Memory Use in Timeline View

© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013

33

Questions?