simulation and visualization of the airflow in clean … and visualization of the airflow in clean...

Simulation and Visualization of the Airflow in Clean Rooms Bärbel Große-Wöhrmann, Uwe Wössner, High Performance Computing Center Stuttgart (HLRS)

Ralph Eisenschmid, OPTIMA pharma GmbH

Pharma Forum 2013 – Schwäbisch Hall

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

OVERVIEW

Pharma Forum 2013

• Why simulations? • Open source CFD software OpenFOAM® • HPC systems at HLRS, Stuttgart • Visualization in Virtual- and

Augmented Reality (Dr. Uwe Wössner)

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

WHY SIMULATING THE AIRFLOW IN CLEAN ROOMS?

Pharma Forum 2013

Design:

How to avoid the

• pollution of vails?

• contamination of staff?

Testing and justification

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

WHY SIMULATING THE AIRFLOW IN CLEAN ROOMS?

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

Introduction to

Computational Fluid Dynamics (CFD)

OpenFOAM®

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

OPENFOAM® - A TOOLBOX FOR CFD

Pharma Forum 2013

Mesh generation

Initial and boundary conditions

Surface data in STL format

Solver

Post-processing

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

OPENFOAM® - A TOOLBOX FOR CFD

Pharma Forum 2013

Mesh generation

Initial and boundary conditions

Solver

Post-processing

/*--------------------------------*- C++ -*-------------------------*\

| ========= | |

| \\ / F ield | OpenFOAM: The Open Source CFD Toolbox |

| \\ / O peration | Version: 2.1.1 |

| \\ / A nd | Web: www.OpenFOAM.org |

| \\/ M anipulation | |

\*------------------------------------------------------------------*/

FoamFile

{

version 2.0;

format ascii;

class volScalarField;

object p;

}

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //

dimensions [0 2 -2 0 0 0 0];

internalField uniform 0;

boundaryField

{

inlet

{

type zeroGradient;

}

outlet

{

type fixedValue;

value $internalField;

}

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

OPENFOAM® - A TOOLBOX FOR CFD

Pharma Forum 2013

Mesh generation

Initial and boundary conditions

Solver

Post-processing

/*--------------------------------*- C++ -*-------------------------*\

| ========= | |

| \\ / F ield | OpenFOAM: The Open Source CFD Toolbox |

| \\ / O peration | Version: 2.1.1 |

| \\ / A nd | Web: www.OpenFOAM.org |

| \\/ M anipulation | |

\*------------------------------------------------------------------*/

FoamFile

{

version 2.0;

format ascii;

class dictionary;

object controlDict;

}

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //

application simpleFoam;

startFrom startTime;

startTime 0;

stopAt endTime;

endTime 500;

deltaT 1;

writeControl timeStep;

writeInterval 100;

Steady-state solver for incompressible, turbulent flow

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

OPENFOAM® - A TOOLBOX FOR CFD

Pharma Forum 2013

Mesh generation

Initial and boundary conditions

Solver

Post-processing Paraview

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

OPENFOAM® - RUNNING IN PARALLEL

Pharma Forum 2013

Parallel solver

Domain decomposition

Parallel mesh generation

Reconstruction

Mesh generation

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

OPENFOAM® - RUNNING IN PARALLEL

Pharma Forum 2013

Parallel solver

Domain decomposition

Parallel mesh generation

Reconstruction

Mesh generation

20 min

20 min

Serial tools: 40 min

Clean room simulations example, one run: • 12 million mesh cells • Memory requirement: 96 GByte • 64 compute cores • Queuing time: 5 ... 600 minutes

High Performance Computing Center Stuttgart (HLRS)

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

HPC SYSTEMS AT HLRS:

Pharma Forum 2013

• Cray XE6 „Hermit“ with

3552 compute nodes (113 664 compute cores)

• Cray XC30 „Hornet“ (2015)

~300 000 compute cores

• NEC Cluster Nehalem „Laki“ with ~ 900 compute nodes

• pre- and postprocessing nodes • HPSS data management

~ 1 PFLOP/s peak

performance

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

INDUSTRIAL SERVICES AT HLRS

Access to HPC systems:

• Hardware and software

• Training courses

• Direct consulting

• First contact: SICOS-BW, http://www.sicos-bw.de

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

Simulation and visualization in Virtual- and Augmented Reality

Uwe Wössner, HLRS

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

COVISE COLLABORATIVE VISUALIZATION AND SIMULATION ENVIRONMENT

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

:: Pharma Forum 2013

Virtual Reality

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

COAL PARTICLE VISUALIZATION

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

OPENCOVER COVISE VIRTUAL ENVIRONMENT RENDERER

Pharma Forum 2013

Features:

– Flexible plugin system

– Support for projection based VR, tiled Displays and HMDs

– Augmented Reality

– CSCW

– Volume rendering

– VRML97

– 3D VR GUI (VRUI)

– Parallel rendering

covise_lib

OpenCOVER

VRUI

VRBClient

OpenSceneGraph

Volumen- Rendering

render_lib

Vic

ARToolKit

Plugin- Support

VRML97

Tracker

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

VRUI USERINTERFACE

Pharma Forum 2013

• The API resembles that of QT, AWT,…

• Supports hierarchical menu systems.

• Supports concurrent interaction in collaborative VEs

– Automatic synchronization of values

– Kontext dependend GUIs for collaborative work

– Locking to support concurrent interaction

Transferfunktionseditor Toolbar

Menu system

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

TABLET-PC USER INTERFACE

Pharma Forum 2013

• Easy input of Text and numbers

• Precise interaction

• Independent of frame rate

• Development of optimized complex GUIs (Material editor, transfer function editor, scene graph browser)

• Scalable from smart boards over tablet PCs to mobile phones

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

VR VISUALIZATION OF CFD RESULTS

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

VR VISUALIZATION OF A CAPPER

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

INTERACTIVE SIMULATIONS

Pharma Forum 2013

Mesh generation

Geometry generation

Domain decomposition

Simulation

Post Processing

Visualization

Geometry modification

Mesh refinement

Number of domains / algorithm

Boundary condition

Interactive visualization

< 1

Min

ute

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

SIMULATION COUPLING

Pharma Forum 2013

Code Type Coupling mode

StarCD CFD SimLib, Fortran user subroutine, Loose

CFX CFD SimLib, Fortran user subroutine, Loose

Fluent CFD SimLib, C user subroutine, Loose

OpenFoam CFD SimLib, C++ user subroutine, Loose

Fidap CFD Script, Black-Box, Loose

Fenfloss CFD SimLib, C Plugin, Loose

Diablo Diffusion in metal alloys Script, Black-Box, Loose

Trans3D Laser ablation COVISE Modul C++, Tight

Uranus CFD Socket interface, coupling module, C++, Loose

SunFace Radiation COM/DCOM, coupling module, C++, Hybrid

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

INTERACTIVE SIMULATION IN COVISE

Pharma Forum 2013

Grid generation

Domain decomposition Simulation

Post processing

Rendering

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

VIRTUAL WATER TURBINE TEST-BED

Pharma Forum 2013

Simulation of the river power

station Kiebingen, Neckar

Through interactive simulation,

the output could be increased by

30%, simply by substituting the

runner and wicked gate

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

VIRTUAL TURBINE TEST-BED

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

INTERACTIVE SIMULATION IN ARCHITECTURE

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

AIR CONDITIONING

Pharma Forum 2013

Simulation of Racks in the HLRS server room

•5MW of Power

•1.5MW cooled by air

•Temperature distribution has to be optimized

•Simulation using Ansys CFX

Tangible interface on a

Microsoft Surface

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

AUGMENTED REALITY

Pharma Forum 2013

Mixed Reality

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

DEEP DRAWING OF A CUP

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

COMPUTATIONAL ELECTRODYNAMICS

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

FREIGHTLINER CASCADIA (SC11)

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

MINI / RS 1200 GS (SC 09)

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

PANAMERA (SC 10)

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

MODELL WIND TUNNEL AT THE FKFS

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

WIND TUNNEL AT FKFS

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

COLLABORATIVE WIND TUNNEL

Pharma Forum 2013

01.10.2013 :: ::

::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :::::

::

THE HLRS VIS-TEAM

Pharma Forum 2013

• Martin Aumüller – Parallel Rendering;Parallel Visualization,Remote Rendering (CRESTA)

• Nico Eichhorn – Cloud Visualization, Virtualization of Graphics hardware, Remote Rendering(GAIA-Cloud)

• Andreas Gottlieb – Automatic optimization (Daimler CFD)

• Daniel Rathgeb – Interactive Simulation, Air conditioning; (CoolEmAll)

• Jutta Sauer – Video streaming; Video Conferencing; COVISE Dev.; 3D Modeling

• Jörg Scheurich – Virtual Reality, VRML, X3D

• Wolfgang Schotte – Virtual Reality, CSI-Stuttgart (VISIONAIR);

• Aihong Yin – Web services, Web GUIs, (GAIA-Cloud)

• Uwe Zimmat – Video service

Aumueller-eichhorn-gottlieb-rathgeb-sauer-scheurich-schotte-woessner-yin-zimmat@hlrs.de