Innovation in clusterdeployment and management

Presented by Heather L Stephens

Computing Insight UK, 13 December 2018

Manchester Central

ClusterVision designs, builds, and manages HPC clusters

High Performance Computing accelerates scientific discovery

How can we consistently deploy and manage

highly customised HPC clusters?

• Vendor agnostic

• Flexible and modular

• Compatible with industry standards

• Ease of use

We are Open Source

Innovation thrives in the open

• Adaptable

• Freedom

• Compatible

• Secure and transparent

• Collaboration

TrinityX is our modular, flexible, open source HPC ecosystem

• 2nd major release

• Delivered 30+ clusters

• Including the AMD benchmark cluster hosted in Austin

Image-based provisioning

Based on BitTorrent

Traditional deployment With TrinityX & Luna using peer-to-peer transfer

Boot your 500+ node cluster in 5 minutes

Configuration management via Ansible

• Provision servers

• Configure applications, databases, web-servers, switches

• Reboot, stop/start servers, VM

• Update software, firmware

• Run benchmarks

• Disaster recovery

• Make backups

• Automated configuration updates

TrinityX in the cloud

We are working in partnership with Amazon Web Services on a cloud offering due out early next year

• Dynamic, heterogenous cluster in the cloud

• Or burst into a cloud to accommodate spikes in demand

• Now seeking pilot sites!

Roadmap

Enhanced support for ARM & Open PowerProvide the ability to analyze user jobs for

efficiency

Automated backups Software defined storage (ZFS)

Cloud bursting Rack layouts / network visualization

Integrated singularity containers Exascale support

Check us out on GitHub!

Github.com/clustervision/trinityx

Github.com/clustervision/luna