1 exchange of data between oecd and statistics norway marianne vik dysterud, statistics norway...

9
1 Exchange of data between Exchange of data between OECD and Statistics Norway OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway [email protected] Meeting of the OECD Expert Group on Statistical Data and Metadata Exchange, 10- 11 May 2007, Geneva, Switzerland

Upload: rachel-shaw

Post on 05-Jan-2016

221 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: 1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway mvd@ssb.no Meeting of the OECD Expert Group on Statistical

1

Exchange of data between Exchange of data between OECD and Statistics Norway OECD and Statistics Norway

Marianne Vik Dysterud, Statistics [email protected]

Meeting of the OECD Expert Group on Statistical Data and Metadata Exchange, 10-11 May 2007, Geneva, Switzerland

Page 2: 1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway mvd@ssb.no Meeting of the OECD Expert Group on Statistical

OECD Expert Group on SDMX 2007, Geneva 10 – 11 May 2007, Marianne Vik Dysterud - [email protected]

SDMX approach in Statistics Norwaytopics

• Experiences creating SDMX-ML files in SN• Reporting methods considered• Brief overview of the system architecture• Experiences implementing SDMX-Registry• Wishes and needs from an NSI

Page 3: 1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway mvd@ssb.no Meeting of the OECD Expert Group on Statistical

OECD Expert Group on SDMX 2007, Geneva 10 – 11 May 2007, Marianne Vik Dysterud - [email protected]

SDMX approach in Statistics Norway Experiences creating SDMX-ML files

• A challenge to find readable data descriptions which is essential for creating metadata structure in our SQL DB (Statbank)

• A DSD in XML format is not sufficient for this purpose

• Example of what we ask for from Eurostat for PEII: - D1.2.3 Design and Implementation of SDMX

Structural Definitions & D5.5.3 MIG for the SDMX structure definition message (for PEEI Set 3) v.1.1

- this document describes the files (including code lists) we are supposed to report - the document reminds of a GESMES key-family MIG

Page 4: 1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway mvd@ssb.no Meeting of the OECD Expert Group on Statistical

OECD Expert Group on SDMX 2007, Geneva 10 – 11 May 2007, Marianne Vik Dysterud - [email protected]

SDMX approach in Statistics Norway Experiences creating SDMX-ML files

• Loading data (incl. reporting date) into Statbank (SQL DB) in advance

• When reporting date occurs:

- SDMX-ML files are automatically produced by a PL/SQL routine in the Statbank system

• The SDMX-ML files can be routed to different folders/catalogues

Page 5: 1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway mvd@ssb.no Meeting of the OECD Expert Group on Statistical

OECD Expert Group on SDMX 2007, Geneva 10 – 11 May 2007, Marianne Vik Dysterud - [email protected]

SDMX approach in Statistics Norway 2 reporting methods considered:

1. RSS-feed including an URL to a specific SDMX-ML file – simple solution, but requires in-house development

2. Implementation of tools from SDMX.org

– test of ready-to-use software

Page 6: 1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway mvd@ssb.no Meeting of the OECD Expert Group on Statistical

OECD Expert Group on SDMX 2007, Geneva 10 – 11 May 2007, Marianne Vik Dysterud - [email protected]

OECD

StatbankNorway

WSOutput

WS

export

SDMX-ML files

OECD Stat

SDMX-MLQuery Message

SDMX-ML

SECURE ZONE

DMZ

DEDICATED PROTECTED ZONE

Internet

SDMX-Registry

?RSS incl.

URL to SDMX SDMX

Page 7: 1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway mvd@ssb.no Meeting of the OECD Expert Group on Statistical

OECD Expert Group on SDMX 2007, Geneva 10 – 11 May 2007, Marianne Vik Dysterud - [email protected]

SDMX approach in Statistics Norway Experiences implementing SDMX Registry

• Where to find the right tools and the right version

• SDMX.org includes 2 links – both point to the same page (www.metadatatechnology.com/tools.html)

• Download site has 2 links – one for beta version – one for version 1.0– beta versions use to be newer, but …

• We downloaded version 1.0 of the tools (Keymaster, Data Provisioning, Data Set Registration and SDMX Registry) + instruction and user guides

Page 8: 1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway mvd@ssb.no Meeting of the OECD Expert Group on Statistical

OECD Expert Group on SDMX 2007, Geneva 10 – 11 May 2007, Marianne Vik Dysterud - [email protected]

• different problems during first attempt of installation– SDMX Registry requires specific versions of third party applications

• new try - looking for possible news – Link to the Registry installation was dead – One version of InstallRegistry.tar.gz found under third party folder

Is this what we are looking for ?

– Inconsistency in SDMX_tools_Installation_instructions-v-2_0.pdf

Example:

SDMXRegistry2.war is this the same as

ftp://www.metadatatechnology.com/pub/downloads/registry/

installregistry.tar.gz ?

SDMX approach in Statistics Norway Experiences implementing SDMX Registry

Page 9: 1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway mvd@ssb.no Meeting of the OECD Expert Group on Statistical

OECD Expert Group on SDMX 2007, Geneva 10 – 11 May 2007, Marianne Vik Dysterud - [email protected]

SDMX approach in Statistics NorwayWishes and needs from an NSI

• Readable Data Structure Definitions

• Consistent installation and user guides

• Windows installation

• .NET environment