workshop on information access enablers météo france strategy
DESCRIPTION
Workshop on Information Access Enablers Météo France Strategy. Geneva 17-18 May 2010 Jacques Roumilhac. Information access in Météo France. Stage 1: Current status Okapi production platform (finalized products) with a Web portal - PowerPoint PPT PresentationTRANSCRIPT
Workshop on Information Access EnablersMétéo France Strategy
Geneva
17-18 May 2010
Jacques Roumilhac
Information access in Météo France
Stage 1: Current status– Okapi production platform (finalized products) with a Web portal
– IAA (Random Access on Legacy databases) with a bespoke language via ftp
Stage 2: Information system evolution– SOA (with a part of OGC services)
– Information model with geographic references
– Spatial databases
– Light and smart client (forecaster station project)
Stage 2 bis: WIS solution– OpenWIS developed with UKMO
– Metadata generator
Stage 1: Production Service Okapi - IAA
OKAPI: Three software bricks, loosely linked :
– Okapi production platform (products factory).
– Internal production portal : Okapimet (For web and webservice customers).
– production portal : Climatheque (For web and webservice customers).
IAA– Random access– On the legacy databases– Archive access possible– With a bespoke language
System schema
orchestration, traffic shaping
Traffic shaping mechanisms Balanced charge. Product factory (close WTS) Identity management (authorization,
authentication)
Stage 2: New project Synopsis: Forecaster tools based on SOA
Two main requirements SOA
– Development efforts factorization
– Processing and data pool access
– Standard interfaces
– Management of different topologies (local or remote server, standalone)
– WMO needs and INSPIRE recommendation
Client station– Last technologies
– Deployment and support easy
– Light or smart client
– Scalable, efficient
– Multi-platforms
Technical choices
Synopsis Server :
– Linux 64 bits :• Re-use of current services in different systems• Use of programs and libraries of ECMWF
– Use of bricks OpenSource• Databases: PostgreSQL, PostGIS• Image processing: GDAL, Proj4• Mapserver : services OGC• Geonetwork for the catalogue
The services
Different service levels– Metadata access (catalogue)– Data access– Business processing (graphic processing)– Presentation services (images, maps, graphics…);
Interoperability for the map services– So : WMS (Web Map Service) et CSW (Web Catalog Service)
For INSPIRE, interoperability also on data and processing services (transformation and downloading)
– So : WCS (Web Coverage Service) WFS (Web feature Service), WPS (Wep processing Service) ….
SOA : Reference architecture
Application composite
Business process
Engine Orchestration
BPM
Supervision
SAM BAM
Data access
CRUD CRUD CRUD
Application composite
Administration Plate-Form
Business services
Processing / Transformation
Bus for messages
Legacy databases
Application composite
Services Registry
SAM : Service Activity Monitoring
BAM : Business Activity Monitoring
BPM : Business Process Management
CRUD : Create Read Update Delete
Interoperability
Strategic target Use of the standards OGC standards for geo-referenced data
Web MapServer
Web CoverageServer
Web FeatureServer
Web Map Service (WMS) Web Feature Service (WFS)Web Coverage Service (WCS)Catalogue (CSW)Geography Markup Language (GML) Web Map Context (WMC)OGC KMLOthers…
SOA : Architecture interoperability on legacy databases with geographic extension
Client SYNOPSIS Java Web StartSupervision
Plate form
Interface HPOV
Data Service
WFS WCS
Client SYNOPIS Full Web
Administration Plate-Form
Bus of messages JMS
Other applications composites Catalogue
CSW
SOS
Processing service Presentation service
FPSWMSWPS SPS
BDMO
Geo-extension
BDMO
Ref)
Legacy databases
BDAP
Ref
BDI
Ref
BDEPI
Ref
BDE
Ref
BDI BDEPI BDE BDAP
Geo-ext
Data Access Services
Services de DONNEES
WCS WFS SOS
WFS
Web Feature
Service
Coast map lines
Objects : Anasyg
Pi, Sympo2,
Aeronautic
OACI Annex 3
Portrayal Services
Services PRESENTATION
FPSWMS
Observation
Objects : Anasyg
Pi, Sympo2,
WMS
Web Map
Service
Static geographic layers
Models plots
Aeronautic
OACI Annex 3
Images
Radar, Sat
Different clients
Client SYNOSIS Smart
Data access services
(CRUD)
WCS WFS
Client SYNOPIS
Light (Full Web)
Presentation services
WMSFPSSOS
Processing services
WPS SPS
CATALOGUE Service
CSW
OKAPI
BDMO
Extension
BDMO
Ref)
Legacy databases
BDAP
Ref
BDI
Ref
BDEPI
Ref
BDE
Ref
BDI
Extension
BDEPI
Extension
BDE
Extension
BDAP
Extension
VGISC
Client VGISCAdvanced Production INSPIRE
answer
General Architecture
Data and services catalogue (standard)– On line products and services discovery.– Message bus
• Balanced flow (cluster services)• Loosely link between server and client
Spatial database– Using MapServer and other OGC implementations
Standard interfaces used by the clients– Possibility to access to extern services (without guarantee of
performances)– Useful for a wandering forecaster
Prototype Architecture
Middleware ( bus JMS )Middleware ( bus JMS )
Frontal SYNOPSIS (SynFront) HTTP -> JMS
Network (IP)Network (IP)
MetadataISO 19115ISO 19119
BD Spatiale(SynBase)
PosGIS
Services on Services on clustercluster
WMSWMS
(cartes)(cartes)
CATALOGUEGeonetwork
ISO 19115-19119
CSWCSW
MapServerM
agics+
+M
agics+
+
Business serviceMapScript Servlet
Executable CGI
Server SYNOPSIS (SynServ) JMSWMSWMS
SopranoSoprano
TransmetTransmet
RetimRetim
File System
Client Client SYNOPSIS SYNOPSIS Full WebFull Web
Client SYNOPSIS Client SYNOPSIS JAVA Web StartJAVA Web Start
Alimentation BD (SynDATA)
Premières maquettes
Premières maquettes
Architecture Target (Back Office)
““Backbone” of servicesBackbone” of services(ESB ?)(ESB ?)MonitoringMonitoring
AdministrationAdministrationSécuritySécurity
Front End
WMSWMSPrésentationPrésentation
cartescartes
WPSWPSProcessingProcessing
CRS transf.CRS transf.
… …
CATALOGUEGeonetwork
ISO 19115-19119
CSWCSW
Serveur SYNOPSIS Serveur SYNOPSIS
Servers
CEP WEB High availability
Obs Front End
WMS WMS PrésentationPrésentation
Cartes Cartes
SOS SOS SPSSPS
bus JMS internalbus JMS internal
BD’s SOPRANO
BDMBDCLIMBDAP
BDI
Front End CBD [OKAPI ?]
SOS SOS AccessAccess
Obs Obs validatedvalidated
BD spatiale(SynBase)
PostGIS
BD’s Spatiales PostGIS
BDEPIBDE
BDI « new »
ClientsClientsWCSWCSAccess Access
ImagesImages
ModèlesModèles
WMS WMS PrésentationPrésentation
Maps Maps
WPSWPSProcessingProcessing
StatsStats
Client Synopsis Client Synopsis JAVAJAVA
Client Client Synopsis Synopsis WEBWEB
Client Client ProductionProduction
Obs & time seriesObs & time series
CLUSTER CLUSTER
WFSWFSObject accessObject access
PI, SYMPO2PI, SYMPO2
AERO (WXXM)AERO (WXXM)
RMDCNRMDCN
Stage 2 bis: WIS Approach
OpenWIS development :
– Information fetching: Different use cases
– OpenWIS: Open interfaces
– Request or subscription
– Météo France use two diffusion systems
Metadata GTS generator– To populate the WIS catalogue– Mapping between Volume C1 and Core Metadata Profile– Close the prompting question on information sources
5: Storage in the shopping cart for an online distrbution, or preparation of the dissemination instructions: they are constructed from the user profile, among other elements.
DAR
3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options.
Portal
subscriptions(user profile)
4: The product type is part of the global dataset. The requested products are extracted from the Cache.
Routing
MSS FSS
6: the products and instructions are forwarded.
7: Dissemination according to instructions.
7bis: the user receives the products.
Ad-hoc Request for a product in the Cache – dissemination via the FSS (GISC function)
OpenWIS
1: the user discovers local product type in the catalogue
2: the user is authenticated (several steps)
5bis: the user obtains the products from the shopping cart.
6: Storage in the online shopping cart, or preparation for dissemination.
DAR
Portal
subscriptions(user profile)
4: the product type is owned by a local NC or DCPC.
Routing
MSS FSS
6bis: the user obtains the products from the shopping cart.
SOURCE
5: the required products are extracted and returned.
Ad-hoc Request for a local product – dissemination via the FSS (NC or DCPC function)
OpenWIS
1: the user discovers local product type in the catalogue
2: the user is authenticated (several steps)
3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options.
8bis: the user receives the products.
7: the products and instructions are forwarded.
8: Dissemination according to instructions.
4: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions.
DAR
Portail
subscriptions(user profile)
3: Is someone subscribed to this type of product ?
Routing
MSS FSS
1: the MSS receives a new product
5: the product and instructions are forwarded
2: the MSS routes the product according to its
routing table
2bis: the product is collected and inserted in the GISC Cache
4bis: the user obtains the product from the shopping cart.
6: Dissemination according to instructions.
6bis: the user receives the product.Arrival of a new GTS product at the MSS (GISC function)
OpenWIS
5: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions.
OpenWIS
DAR
Portal
subscriptions(user profile)
3: Is someone subscribed to this type of product ?
Routage
TRANSMET FSS
6: the product and instructions are forwarded
2: Notification of the product availability
5bis: the user obtains the product from the shopping cart.
7: Dissemination according to instructions.
7bis: the user receives the product.
SOURCE
1: New local product
4: the required products are extracted and returned.
New local product available (NC or DCPC WIS function)
External Interface
Metadata service Data service
User Interface (web portal)
DARMet
User & Data Policies
MetadataCatalogue
Cache
A7
A1 A3 A5 A1 A3
A1 A3 A5
A2 A4 A6
A1 A5 A5A1
Make / FollowRequest
Browse /Search DAR
Admin /Monitoring
Authentication
Authorisation
ManageRequests
CatalogueAccess
Monitoring
Administration
CollectionSynchro &Harvesting « Ad Hoc »
Routine« Push »
DIFFMSS/FSS
Local System
POSSIBLE CHOICES
SIMDAT base
Sun OpenSSO baseGeoNetwork base
MSSSMART / GEMS
OpenWISUK MetOffice
Replication
GTS Metadata GeneratorClose to prompting question on digitization