Moonshot Case Study: HPC Midlands Martin Hamilton hpc-midlands.ac.uk

Contents• Introducing HPC

Midlands• Motivations for

Moonshot• Early Moonshot Pilot

Findings• Next Steps

Contents• Introducing HPC

Midlands• Motivations for

Moonshot• Early Moonshot Pilot

Findings• Next Steps

Introducing HPC Midlands

• BIS/EPSRC e-Infrastructure Centre• Supercomputing for research and industry• On demand access to HPC capacity

– Licensed software from leading vendors, including ANSYS, CD-adapco and MSC Software

• See hpc-midlands.ac.uk/launch-event for case studies from E.ON, Rolls Royce and Tata Steel

Hera cluster:3,000 cores (48 Teraflops)

15TB RAM

120TB Lustre storage

Non-blocking QDR Infiniband

188 compute node blades• 2 x 2.0GHz (8 core) Sandy Bridge • 140 with 64GB RAM (4GB/core)• 48 with 128GB RAM (8GB/core)

Introducing HPC Midlands

Introducing HPC Midlands

Note the 50 node (800 core) and 25 node (400 core) jobs!

HPC Midlands Applications

HPC Midlands Applications

CFD Based Study of Unconventional Aeroengine Exhaust Systems

T. CoatesG. J. Page

30th AIAA Applied Aerodynamics Conference

DOI: 10.2514/6.2012-2775

Contents• Introducing HPC

Midlands• Motivations for

Moonshot• Early Moonshot Pilot

Findings• Next Steps

Motivations for Moonshot• Desire to avoid separate HPC Midlands

credentials for service users• Use organizational credentials for multiple

services, e.g. OpenSSH, Apache, Samba• Delegated authority for managing user

identities and access to services• Services built around the user not the service

providers (see next slide)• Comfort zones: ssh keys, CLI etc

Slide credit: Gary Page / Leigh Lapworth

Motivations for Moonshot

Contents• Introducing HPC

Midlands• Motivations for

Moonshot• Early Moonshot Pilot

Findings• Next Steps

Early Moonshot Pilot Findings• Dedicated HPC Midlands login node

allocated for development work– Live DVD image also available for testing

• Moonshot RPMs from yum.dev.ja.net– Patched versions of FreeRADIUS, OpenSSH,

Shibboleth SP, GSS Server, libraries etc– (Mostly) Install into /opt/moonshot– RPM package dependency fun and games with

vendor respins (common for HPC)

Yum… (github coming soon)

Early Moonshot Pilot Findings

Moonshot up and running in test mode:

hera12# /opt/moonshot/bin/ssh -p 2222 -l "" 127.0.0.1CTRL-EVENT-EAP-STARTED EAP authentication startedCTRL-EVENT-EAP-PROPOSED-METHOD vendor=0 method=21CTRL-EVENT-EAP-METHOD EAP vendor 0 method 21 (TTLS) selectedCTRL-EVENT-EAP-SUCCESS EAP authentication completed successfully[comth@hera12 ~]$

This proves that Moonshot enabled ssh, sshd, gss-server, radiusd and shibd are all talking to each other.

Contents• Introducing HPC

Midlands• Motivations for

Moonshot• Early Moonshot Pilot

Findings• Next Steps

Next Steps

• Get Moonshot installation up and running with institutional RADIUS servers / Trust Router– Loughborough contracted to JANET(UK) to provide

technical support for the Moonshot Pilot– Leicester also working on Moonshot for DiRAC (HPC

for Particle Physics, Astronomy + Cosmology)

• Discussions with industrial collaborators– Firewall holes, VPNs, SOCKS proxies etc– Hosted Moonshot portal to manage access?– JANET connectivity?

Next Steps

Next Steps

Next Steps

www.hpc-midlands.ac.ukmartin@hpc-midlands.ac.uk