docker for hpc: how e4 is using it
TRANSCRIPT
![Page 1: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/1.jpg)
Docker for HPC
![Page 2: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/2.jpg)
Docker enables to build, ship and run any app, anywhere:
• HPC apps
• Web apps
• DBs
• Others
Very useful in HPC environment to align and simplify deployment of HPC apps on clusters.
![Page 3: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/3.jpg)
Problem solved:- Deploy several version of one app on
the same node (e.g. Ansys 15 and Ansys 14)
- Deploy an old version of an HPC appbased on legacy environment
- Keep cluster nodes aligned with the same version of libriaries and binaries
3
![Page 4: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/4.jpg)
• When images are updated, only ship relevant layers
• Easy of move HPC apps thanks to Image distribution protocol
• Images are broken down into layers
• Dependency between images (eg: web app depends on DB)
![Page 5: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/5.jpg)
• On VMs or physical machine (or on your laptop!)
• Available on OS X and Windows (boot2docker)
• Benchmarks show no difference between containers and bare metal
Development
VMQA server Public Cloud Contributor’s
laptop
Mu
ltip
licit
y o
f h
ard
war
e en
viro
nm
en
ts
Production
ClusterCustomer Data
Center
Can
I migrate
smo
oth
ly and
qu
ickly
Configure Once, Run Anything
![Page 6: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/6.jpg)
Static website
MPI libraries
CFD code
User DB
Ansys
HPC solver
V1 V1.5 V2 V2.5 V3 V3.5 V4
• Containers are created from an image
• Image creation is easy
• Image upgrade is fast
• Immutable infrastructure is easy to implement
• Legacy App image library
![Page 7: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/7.jpg)
AppA
Hypervisor
Host OS
Server
GuestOS
Bins/Libs
AppA’
GuestOS
Bins/Libs
AppB
GuestOS
Bins/Libs
Ap
p A
’
Do
cker
Host OS
Server
Bins/Libs
Ap
p A
Bins/Libs
Ap
p B
Ap
p B
’
Ap
p B
’
Ap
p B
’
VM
Container
Containers are isolated,but share OS and, whereappropriate, bins/libraries
GuestOS
GuestOS
![Page 8: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/8.jpg)
![Page 9: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/9.jpg)
![Page 10: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/10.jpg)
![Page 11: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/11.jpg)
![Page 12: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/12.jpg)
![Page 13: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/13.jpg)
• Simplify HPC app deployment in cluster environment
• Standardize HPC configuration among nodes in a cluster
• Isolate HPC apps to eliminate inconsistency
• Run legacy HPC app and keep a library of images
• No virtualization overhead
![Page 14: Docker for HPC: how E4 is using it](https://reader030.vdocuments.us/reader030/viewer/2022032506/55cd998cbb61eb865e8b4594/html5/thumbnails/14.jpg)