using gui's to open up your hpc environment
DESCRIPTION
In this presentation from Moabcon 2013, Wil Wellington fron Adaptive Computing describes how to Use GUI's to Open Up Your HPC Environment. "In this session we will demonstrate how to start migrating away from using the CLI to using GUI's via MWS to interact with Moab. We will desmontrate how easy it is to make the jump and open up your HPC environment for more projects and departments in your organisation, as well as making life easier for your System Administrators." Learn more at: http://www.adaptivecomputing.com/company/news-and-events/events/moabcon-2013/moabcon-2013-full-agenda/ View the video of this talk at: http://insidehpc.com/?p=36395TRANSCRIPT
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
1
Using GUI's to Open Up Your HPC Environment
Wil Wellington Professional Services (EMEA)
MoabCon 2013
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
2
Agenda
▪ Comparison (GUI vs CLI) ▪ Moab Web Services (MWS) ▪ What is MWS ▪ RESTful Web Services ▪ Integration with Moab
▪ Build simple GUI with MWS ▪ Viewpoint ▪ HP Insight CMU Integration ▪ Questions
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
3
Comparison - CLI
▪ Ease of use ▪ Difficult to successfully navigate CLI.
▪ Control ▪ More control of O/S using CLI
▪ Multitasking ▪ No ability to view multiple things at once
▪ Appearance ▪ Rarely change in appearance
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
4
Comparison - CLI
▪ Speed ▪ Few keystrokes to perform advance actions &
smaller textual information
▪ Resources ▪ Less computing resources
▪ Scripting ▪ Easy to compile a sequence of commands
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
5
Comparison - GUI
▪ Ease of use ▪ users pick up interface much easier when
compared to CLI.
▪ Control ▪ Plenty of control, but advance users resort to CLI
▪ Multitasking ▪ Easy to view, control and manipulate multiple
things
▪ Appearance ▪ Aesthetically pleasing to the eye
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
6
Comparison - GUI
▪ Speed ▪ Easier and faster to perform certain actions
with just one click
▪ Resources ▪ More system resources (ie, icons, fonts etc..)
▪ Scripting ▪ No comparison to CLI
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
7
Conclusion - GUI
ü Beautiful
ü Easy to use
ü In-built multitasking capability
ü Fun
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
8
What is Moab Web Services
▪ Moab Web Services (MWS) is part of Moab Workload Manager that allows programmatic access to (at least) all services offered by Moab Workload Manager through the command line. ▪ MWS is simply a
protocol through which 3rd parties may communicate with Moab
8
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
9
RESTful Web Services
▪ RESTful Web Service Advantages ▪ Simple and uses standard methods
▪ Reduces client/server coupling
▪ Access resources with multiple representations
▪ Give every “thing” an ID
▪ Enables access to HTTP cache and proxy server
▪ Allows organisation of very complex applications into simple resource
▪ Communicate statelessly
▪ Easy for existing and new applications to interface
▪ Easy to evolve a REST interface without breaking existing clients
▪ Etc…
9
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
10 © 2012 ADAPTIVE COMPUTING, INC. 10
RESTful Web Services
Moab
Jobs Server Nodes
Reservations
Etc.
Resources
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
11 © 2012 ADAPTIVE COMPUTING, INC. 11
RESTful Web Services
Moab
Nodes
Reservations
Etc.
Jobs
POST Create/Submit
PUT Modify/Update
GET Read
DELETE Delete
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
12 © 2012 ADAPTIVE COMPUTING, INC. 12
RESTful Web Services
Moab
Nodes
Reservations
Etc.
HPC Portal
MWS API
User Input
Job Converter
Run a Monte Carlo
Simulation with this Input!
Jobs
POST
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
13 © 2012 ADAPTIVE COMPUTING, INC. 13
MWS Integrated with Moab
Client Interface
Moa
b S
erve
r Resource Managers
Triggers
Statistics
Allocation Mgr
Moab Database
Events Files
Client Commands
Moab Services Manager
Gold (Moab Accounting Mgr)
Moab Viewpoint
Integration Scripts
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
14 © 2012 ADAPTIVE COMPUTING, INC.
Moab Web Services Layer Moab Web Services and flexible interfaces, Operations DB
14
The Big Picture
Showback & Chargeback
Intelligence Engine
Decisions, policies, resource scheduling, allocation, workflow & automation orchestration
Admin Dashboard API Calls User Service Portal CLI
Resources
Storage Manager
Provisioning Manager
Network Manager
Health Monitor
Non-traditional Resource Managers
Other Resources: • Licenses • Chillers • NFS Servers • Database
Servers • Equipment • Etc.
Workload Job
Queue
Multi-vendor Resource Manager
Heterogeneous Resources
Job Manager
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
15
MWS Configuration (post install)
15
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
16
MWS Configuration
16
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
17
MWS Configuration
17
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
18
Moab Web Services Configuration
18
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
19
Lets build a simple GUI with MWS
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
20
Viewpoint
Accelerate user and admin productivity ▪ Simplified job submission and
management
▪ Option: Application Portal Edition
How do I make submitting and managing jobs faster and easier for users?
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
21
Simple Job Submit & Management
Moab Viewpoint HPC Portal
▪ Users can easily submit jobs anytime, anywhere
▪ Reduces end-user training
▪ Simplifies and speeds job submission
▪ Simplifies job tracking and self-management
▪ Application Portal Edition for integrated specific application access and templates for guided submission
Easily track job status
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
22
Easy Job Submission for Users
Simplified, guided submission
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
23
Easy Job Tracking/Self-Management for Users
Quick easy filters
Quick easy actions
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
24
Easy Click Drill-down for Specific Node Details
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
25
Admins Can Easily Manage User Access
Easily add or modify users and access privileges Synchronize with existing LDAP users and groups Assign user or admin role privileges to control data view, actions and management access
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
26
Admins Can Easily Create Reservations for User Access to Resources
Easily create user or admin maintenance reservations Control reservation workload settings Assign reservation access Schedule specific time and resources
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
27
Admins Can Easily Manage Reservations for User Access to Resources
Quick click drill downs for details
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
28
Easy, Visual Configuration of the Portal
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
29
Easy, Visual Node Management for Admins
Quick easy filters
Quick click drill downs for details easy actions
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
30
Seamless HP Insight CMU Integration
Streamlined management between workload management and cluster administration ▪ CMU management capabilities automated via policies
▪ Rich monitoring data in CMU powers Moab policies
▪ Single point administration for key workload data and management actions in CMU console
Workload Management
Cluster Administration
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
31
View Moab Jobs and Metrics in HP Insight CMU
Select job(s) or their nodes and initiate actions with simple right click menu
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
32
View Workload CPUload and Memory Use in Timeline View
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
33
Questions?