![Page 1: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/1.jpg)
LLNL-PRES-XXXXXX
This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344. Lawrence Livermore National Security, LLC
Kubernetes Implementation into HPCLivermore Computing
Jessica Gomes, Jonathan Victorino, Harry YeeHPC CEA Interns
August 10, 2017
![Page 2: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/2.jpg)
LLNL-PRES-xxxxxx
2
Meet Team Kubes
Jessica GomesUniversity of Illinois at
Urbana-Champaign
Jonathan VictorinoStanford University
Harry YeeUCLA
![Page 3: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/3.jpg)
LLNL-PRES-xxxxxx
3
I. Setup a Kubernetes cluster using Docker containers
II. Run LINPACK benchmark tests comparing Kubernetes and bare metal cluster
III. Determine performance overhead of running the cluster in Kubernetes
IV. Automate Kubernetes builds and deployments using Puppet
Objectives
![Page 4: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/4.jpg)
LLNL-PRES-xxxxxx
4
Our Project
![Page 5: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/5.jpg)
LLNL-PRES-xxxxxx
5
▪ World’s leading software container platform
▪ Container: stand-alone package that includes everything needed to run it
▪ Easily create images for containers using Dockerfiles
▪ Use Docker Hub to automatically update the containers
Docker
![Page 6: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/6.jpg)
LLNL-PRES-xxxxxx
6
▪ Open-source system for automating deployment, scaling, and management of containerized applications
▪ Schedule and deploy any number of Docker container replicas onto a node cluster
What is Kubernetes?
![Page 7: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/7.jpg)
LLNL-PRES-xxxxxx
7
Kubernetes Container Visualization
![Page 8: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/8.jpg)
LLNL-PRES-xxxxxx
8
Kubernetes Architectural Overview
![Page 9: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/9.jpg)
LLNL-PRES-xxxxxx
9
Installation Process
Puppet Manifest File
Kubernetes Packages
Installation Script
Docker Installation Script
![Page 10: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/10.jpg)
LLNL-PRES-xxxxxx
10
.yaml Files
![Page 11: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/11.jpg)
LLNL-PRES-xxxxxx
11
LINPACK Benchmarks
Time (seconds) G-flops
Bare Metal 15.39 3.47E+02
Kubernetes 1796.654 2.99E+00
![Page 12: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/12.jpg)
LLNL-PRES-xxxxxx
12
Conclusion
▪ Kubernetes
— Large performance overhead on clusters
— Extra setup steps
— Not ideal for HPC
▪ Use bare metal cluster
▪ After further testing, the bottleneck was found to be due to a networking issue
▪ Time and G-flops were comparable for containers running on the same node to the bare metal configuration
![Page 13: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/13.jpg)
LLNL-PRES-xxxxxx
13
Future Plans
▪ Use Puppet to automate builds and deployments
▪ Automatically ssh from worker to master
▪ Run more Benchmark tests on Kubernetes cluster
▪ Find out how to fix the bottleneck and improve communication between containers
![Page 14: Kubernetes Implementation into HPC - Computing...Kubernetes —Large performance overhead on clusters —Extra setup steps —Not ideal for HPC Use bare metal cluster After further](https://reader034.vdocuments.us/reader034/viewer/2022051916/6007fe4c122d707cdb6a58f3/html5/thumbnails/14.jpg)