Scibiana distro for industrial R&D and engineering

Fosdem 2016January 30th, 2016

Alexis BEZVERKHYYMehdi DOGGUYEDF

Intro

Since 2003, EDF has been using a custom distro on scientificworkstations, HPC clusters and servers for industrial R&D andengineering.

In 2016 we want to turn our distro into an Open Sourcecommunity project.

I business context and needs

I our solution

I workstations

I HPC

I what’s next ?

1 / 13

About EDF

I world nuclear energy leaderI 73 B euros revenue, 38.5 M custommersI 623 TWh produced annuallyI 136 GW production capacityI 73 nuclear reactors, 77% of productionI 5 EPR reactors in construction

I 158 000 employees

I large R&D and enginneering divisions

2 / 13

Scientific IT needs

I modelingI approximate reality with a modelI often need for a modeler

I simulationI execution of a numerical code computing

the behavior of the model systemI a whole area of software developmentI need for the fastest hardware to work on

large arrays of floats

I visualizationI results exploration and analysisI need for the best graphics hardware and

displays

3 / 13

Scibian

HPC cluster

HPC cluster

Server

Workstation

Workstation

Server

Application

Application

Application

Business needs

User Developper

+customizations

4 / 13

Life cycle

Scibian 6Scibian 7

Scibian 8Scibian 9

201620142012 2018 2020

hardwarehardware

hardwarehardware

hardware

business appbusiness app

business app

5 / 13

Solutions

I longer support for each major release

I strict packaging rules

I backports and workaroundsI compatibility environments

I install and maintain schrootsI wrap business applications

6 / 13

Workstations

I managed gnome 3 desktop

I no root access required for the user

I corporate networking (NAC, VPN, 802.1X WiFi)

I user-friendly crypto (full disk and directories)

7 / 13

HPC with Scibian

I Full Open Source stack

, but:I OFED StackI Parallel and Distributed File Systems

I Push manufacturers and software editors to support Debian(more)

I Support beyond oldstableI Develop and provide new tools for HPC users and

administrators

I Clara, an administration tool designed for Debian clustersI Slurm DashboardI Job MetricsI Custom Deployment System for diskless nodes

I Generic Puppet configuration set for large installationsI Large deployment using Bittorrent

I NeosI . . .

Checkout our github space: http://github.com/edf-hpc

8 / 13

HPC with Scibian

I Full Open Source stack, but:I OFED StackI Parallel and Distributed File Systems

I Push manufacturers and software editors to support Debian(more)

I Support beyond oldstableI Develop and provide new tools for HPC users and

administrators

I Clara, an administration tool designed for Debian clustersI Slurm DashboardI Job MetricsI Custom Deployment System for diskless nodes

I Generic Puppet configuration set for large installationsI Large deployment using Bittorrent

I NeosI . . .

Checkout our github space: http://github.com/edf-hpc

8 / 13

HPC with Scibian

I Full Open Source stack, but:I OFED StackI Parallel and Distributed File Systems

I Push manufacturers and software editors to support Debian(more)

I Support beyond oldstableI Develop and provide new tools for HPC users and

administrators

I Clara, an administration tool designed for Debian clustersI Slurm DashboardI Job MetricsI Custom Deployment System for diskless nodes

I Generic Puppet configuration set for large installationsI Large deployment using Bittorrent

I NeosI . . .

Checkout our github space: http://github.com/edf-hpc

8 / 13

HPC with Scibian

I Full Open Source stack, but:I OFED StackI Parallel and Distributed File Systems

I Push manufacturers and software editors to support Debian(more)

I Support beyond oldstable

I Develop and provide new tools for HPC users andadministrators

I Clara, an administration tool designed for Debian clustersI Slurm DashboardI Job MetricsI Custom Deployment System for diskless nodes

I Generic Puppet configuration set for large installationsI Large deployment using Bittorrent

I NeosI . . .

Checkout our github space: http://github.com/edf-hpc

8 / 13

HPC with Scibian

I Full Open Source stack, but:I OFED StackI Parallel and Distributed File Systems

I Push manufacturers and software editors to support Debian(more)

I Support beyond oldstableI Develop and provide new tools for HPC users and

administratorsI Clara, an administration tool designed for Debian clustersI Slurm DashboardI Job MetricsI Custom Deployment System for diskless nodes

I Generic Puppet configuration set for large installationsI Large deployment using Bittorrent

I NeosI . . .

Checkout our github space: http://github.com/edf-hpc8 / 13

HPC with Scibian : Slurm Dashboard

http://edf-hpc.github.io/slurm-web/

9 / 13

HPC with Scibian : Job Metrics

https://github.com/edf-hpc/jobmetrics

10 / 13

Our goals

I switch to collaborative development of Scibian

I share, build and maintain specific tools

I become a reference distro for industrial R&D and engineering

I create a community around the use of Linux for business R&D

11 / 13

Why do we need a derivative ?

I 6-year support

I custom security suppport

I workstation and HPC hardware support

I support of some libs removed from Debian

I integration of our patches into Debian whenever possible

12 / 13

What’s next ?

I community site in construction, collaboration through githubpull requests

I platform to automatically build and publish packages

I kick off event in May 2016 in Paris

I presentations about scientific computing

I Scibian demos of workstations and various tools

I https://twitter.com/ScibianLinux

I https://github.com/edf-hpc

I https://github.com/scibian

13 / 13