scheduled meteorological product creation using ninjo batch 1.3 sören kalesse deutscher...

Scheduled Meteorological Product Scheduled Meteorological Product Creation using NinJo Batch 1.3Creation using NinJo Batch 1.3

Sören KalesseDeutscher Wetterdienst

soeren.kalesse@dwd.de, http://www.dwd.de

SMPC using NinJo Batch 1.3 (2)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Agenda

• What are SMPC and NinJo Batch?

• Example products

• Architectural overview

• Runtime parametrization

• Conclusions & Outlook

SMPC using NinJo Batch 1.3 (3)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

What is SMPC?

• concept: Scheduled Meteorological Product Creation

typical time constraints of a meteorological product:

model runbased on a

issue timewill be issued at a

valid time/rangewill be valid at a

time

manipulate and create the product

issue and distribute the product

• products might be:» forecast chart, diagram, analysis plot, ...

SMPC using NinJo Batch 1.3 (4)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

What is SMPC? (2)

• NinJo 1.3 knows two ways of approaching SMPC

non-interactiveNinJo Batch

concept: parametrization

interactiveProductWorkbench

concept: interactive editing

SMPC using NinJo Batch 1.3 (5)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

What is NinJo Batch?

Bundle of NinJo client/server components used fornon-interactive Scheduled Meteorological Product Creation

• main goal:» automated production of maps of meteorological data

» key concept: runtime parametrization of NinJo– product properties changed at runtime by an external source

– multiple scenes stacked into one single product

– extensive annotations through legend framework

• What NinJo Batch is not» no data manipulation, no animations, no webpages

» distribution is not part of NinJo Batch

» no user interaction

SMPC using NinJo Batch 1.3 (6)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Agenda

• What are SMPC and NinJo Batch?

• Example products

• Architectural overview

• Runtime parametrization

• Conclusions & Outlook

SMPC using NinJo Batch 1.3 (8)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

NinJo Batch – Example Products (1)

• observations and derived products

satellite images

sat composite maps

radar/SCIT composite maps

SMPC using NinJo Batch 1.3 (9)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

NinJo Batch – Example Products (2)

• model output

NWP grid fields

meteograms

cross-sections

SMPC using NinJo Batch 1.3 (10)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

• custom plots

composite NWP grid field

model comparison

NinJo Batch – Example Products (3)

SMPC using NinJo Batch 1.3 (11)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Agenda

• What are SMPC and NinJo Batch?

• Example products

• Architectural overview

• Runtime parametrization

• Conclusions & Outlook

SMPC using NinJo Batch 1.3 (12)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

distributed server environment

Architectural Overview

BatchScripts

WebBrowser

ext. Schedulers

NinJo Data Servers

BatchProductDesigner–GUI

Batch Favorite

Bat

chW

ebR

eque

stH

andl

er

Batch Processor.1

Batch Processor.N ...

request handling + logging + client export

BatchServiceHTTP request

operating system functionality + job creation/management + scheduling + load balancing

NinJo client functionality + job processing + caching + export

SMPC using NinJo Batch 1.3 (13)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Agenda

• What are SMPC and NinJo Batch?

• Example products

• Architectural overview

• Runtime parametrization

• Conclusions & Outlook

SMPC using NinJo Batch 1.3 (14)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

BatchProcessor

Runtime Parametrization

Batch Favorite

scene configuration by templates

runtime parametersrequest

1

ModelRun: 2009.05.30#00:00ForecastTime: +24hModel: GMEElement: rel. HumidityLevel: 700hpaLevelType: gpm

setting scene properties from an external source

2

3render and export

NinJo client

• Example

» loop over forecast time in 3h steps to produce forecast animations

SMPC using NinJo Batch 1.3 (15)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Conclusion and Outlook

• operational launch at DWD is underway» towards an operational product management system

• WMS support is currently been worked on» GeoTIFF export of maps to support raster coverages

» SpatialFile and GML may be used for exporting model output as vector data coverage

• NinJo Batch as client/server component bundle provides» scalable/distributed architecture for non-interactive SMPC

» theoretically everything that can be displayed in NinJo is batchable

» key-concept: runtime parametrization and configuration

» uniform and flexible request language

mid term goals:

Thank You for Your attention!

SMPC using NinJo Batch 1.3 (17)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Example request

• form a Batch request to the BatchWebRequestHandler

./request -D 2008.11.24#16:00 // displaytime: 00+16h -o 600 -bl // request options -p BatchProcessor.0 // use Processor 0 -d BatchProcessor.0 // force Processor 0

-V path.PATH_PROPERTY=gme~surfpressure~01-016-2008-11-24-00-00.png -V dimension.DIMENSION_PROPERTY=800#800 // 800x800px

-V grid.GRID_ELEMENT.ModelRun=..#00:00 // model run: midnight -V grid.GRID_ELEMENT.ForecastTime=H=16 // forecastime: +16h -V grid.GRID_ELEMENT.Model=GME // global model

test~gme~surfpressure // favorite

('request' is part of the Batch-Scripts tool-chain for the Unix command line)