maritime graphics - norwegen.ahk.de · one stop shop for subsea technology our offer ... managed by...

© Fraunhofer IGD

Maritime GraphicsVisual Computing for Offshore Applications

Uwe Freiherr von Lukas

Fraunhofer-Institut für Graphische Datenverarbeitung - IGDJoachim-Jungius-Str. 1118059 Rostock - GERMANY

Tel.: +49 381 4024 100Fax: +49 381 4024 199

Email: [email protected]://www.igd.fraunhofer.de/en

07.11.2017

Maritime Graphics, November 20171

https://www.igd.fraunhofer.de/en

© Fraunhofer IGD

67 institutes and independent research units

More than 23,000 staff

€2 billion annual research budget totalling

Roughly two thirds of this sum is generated through contract research on behalf of industry and publicly funded research projects

Roughly one third is contributed by the German federal and Ländergovernments in the form of base funding

International cooperation

Fraunhofer-Gesellschaft, the largest organization for applied research in Europe

“Fraunhofer lines”

2

© Fraunhofer IGD

The German Research Landscape

Private fundingPublic funding

Ba

sic

rese

arc

hA

pp

lie

d re

sea

rch

Source: BMBF Germany (simplified)

Max PlanckSociety

Universities

IndustrialResearch

(Companies)

The Fraunhofer-Gesellschaftundertakes applied research of direct utility to private and public enterprise and of wide benefit to society.


Contracted R&D LicensingJoint Research Our Offer

© Fraunhofer IGD

Subsea@FraunhoferMultidisciplinary community

13 involved Fraunhofer Institutes

Sensors

ICT

Material

Energy

…

Broad range of

underwater technologies

test facilities

Initiated and coordinated byProf. von Lukas

Wertheim/Bronnbach

Mannheim

Karlsruhe

Pfinztal

Ettlingen Stuttgart

Freiburg

Kandern

Efringen-Kirchen

Alzenau

Würzburg

Bayreuth

Erlangen

Regensburg

Deggendorf

Augsburg

Weßling

München, Garching

Freising

Prien

Holzkirchen

Bremen

Teltow

WildauPotsdam-Golm

Cottbus

BremerhavenHamburg

Kassel

Frankfurt

Darmstadt

Rostock

Oldenburg

Hannover

Braunschweig

Goslar

Göttingen

MünsterLemgo

PaderbornDortmund

Schmallenberg

Gelsenkirchen

Duisburg

Oberhausen

Köln

Euskirchen

AachenWachtberg

Bonn

Kaiserslautern

Saarbrücken

St. IngbertSulzbach

Leipzig

Chemnitz

Freiberg

Dresden

Zittau

Magdeburg

Halle

Schkopau

Leuna

Itzehoe

Lübeck

ErfurtJena

Hermsdorf

Ilmenau

Berlin

Sulzbach-Rosenberg

Remagen

Wolfsburg

Moritzburg

Gießen

Aschaffenburg

Coburg

Nürnberg, Fürth

Straubing

Rosenheim

Esslingen

Sankt Augustin

4

© Fraunhofer IGD

Subsea navigatorStructuring multidisciplinary expertise

One stop shop for subsea technology

Our offer

Consulting

Technologies

Systems (e.g. ROV)

Complete solutions

5

© Fraunhofer IGD

Rely on digital data

in all processes

over the whole lifecycle

Advantages of digital data

Instant access

Worldwide availability

Flexible usage

Benefits for the end users

Increased efficiency

Higher quality

Chance for new business models / revenue streams

Our focus: Digital Transformation of the Offshore Industry

6

© Fraunhofer IGD

Cyber-physical EquivalenceFoundation for Digital Transformation of the Offshore Industry

7

Reale Welt Digital

Twin

Actuators

Sensors

Simulation/Prediction/Planning

Analysis/Modelling

Interact. Visualization

Validation

3D- PrintingMonitoringInspection

Repair/Overhaul

Production/operation

Mari

tim

e G

rap

hic

s, N

ove

mb

er

2017

© Fraunhofer IGD

Applying Expertise in Visual Computing


Underwater Image Enhancement

AugmentedReality

3D Reconstruction

Large Model Visualization

MachineLearning

© Fraunhofer IGD

Fast generation of 3D interior ship models for AR training Feasibility Study


Augmented Reality

3D Reconstruction

Tango device for mobile 3D capturing and AR application

Reconstructed3D world

3D object library

© Fraunhofer IGD

Underwater computer vision

Our goal: Automatic extraction of information out of images or image sequences

Challenges

Poor quality of available images

Real-time requirements

Necessary robustness

Applications

Monitoring and observation

Technical structures (piles, quay walls,…)

Biology (fish, mussels, algae,…

Visual assistance

Underwater operations (diver, ROV, AUV)


© Fraunhofer IGD

11

Low-resolution High-resolution

Super Resolution for underwater image enhancement

Low-resolution Blur estimation High-resolution


© Fraunhofer IGD

Underwater Video Processing ToolCustomer: German Navy

Flexible combination of different algorithms for underwater image enhancement

Usable as stand-alone tool or as a library for integration

Video up to 4k

PC (Windows, Linux)or embedded system

Hardware acceleration


© Fraunhofer IGD

Convolutional Neuronal NetworksFish Detection

14

5 classes (species) are trained and can be detected in real-time

Robust detection even with partial occlusion


© Fraunhofer IGD

Offshore SurveillanceUsing AIS data

Pan/Tilt/Zoom-

Camera

Coupled with AIS-

Tracks

3D world as a

basis for

visualization

Alignment of

virtual camera

and real camera

15

Source: Signalis/Fraunhofer IGD

© Fraunhofer IGD


Near-realtime monitoring dashboard

Post-mortem data analysis

Visual forecast of gas leakage situations

Fully web-based (HTML5), distributed displays

Multi-touch interaction and navigation

Subsea environmental monitoring

© Fraunhofer IGD

Exploration of heterogeneous Sensor Data Software solution for a Subsea Lander


© Fraunhofer IGD

Our strategy: VisualComputing as a Service

20

Powerful platform

Initially developed for 3D data in product development (CAD, CFD,…)

Now extended for other application scenarios (GIS, city models, sensor data,…)

Open interfacesfor easy integrat.

Supporting all relevant opera-ting systems

High scalability


© Fraunhofer IGD

Support Data Analysis with Virtual Reality Displays

21

Select appropriate hardware

Use our VR software

Data preparation

Integrate interaction concepts

Optional coupling with (physical) simulation


© Fraunhofer IGD

Visual Analytics allows the exploration of extremely large and complexdata repositories through interactive user interface

The passive observer of condensed analysis results becomes an active userof visual analytics tools to guide the analysis process

Combination of the strengths of human and machine

Visual AnalyticsOverview of massive amounts of data

22.1

1.2

017

22

© Fraunhofer IGD

Analysis of large amounts of sensor data over time

Detection of similar sensor behaviour

Combination of visualization and automatic clustering algorithms

Sensor analysis over time

© Fraunhofer IGD

Technology Network Mini-ROV

Joining forces for developing modular inspection ROV

Focal areas

Modular platform

Sensor integration

Propulsion and Energy

Manneuovering

Data services

10 companies, 4 research institutes

Managed by Fraunhofer IGD

www.mini-rov.de

Ma

risc

op

e

Mari

tim

e G

rap

hic

s, N

ove

mb

er

2017

26

http://www.mini-rov.de/

© Fraunhofer IGD

Technology Network Munitect

Developing new technologies for efficientdetection of underwater unexplodedordnance device

Focal Areas

Improving specific sensors

Sensor fusion and integration

Datenmanagement und -analyse

Aufbau reales Munitions-Testfeld

10 comapnies and 5 resarch institutes

Managed by Fraunhofer IGD

UXO (Estimation)Baltic Sea: 300.000 t conventional5.000 t chemical

North Sea: 1,3 Mio t conventional90 t chemical


maritime graphics - norwegen.ahk.de · one stop shop for subsea technology our offer ... managed by...

Documents