implementing ess standards for reference metadata and quality reporting at istat work session on...

Implementing ESS standards for reference metadata and quality reporting at Istat

Work Session on Statistical MetadataTopic (i): Metadata standards and models

Giorgia Simeoni, IstatUnit «Quality, audit and harmonisation»[email protected]

6 May 2013

Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013

Contents

1. Project background

2. SIDI/SIQual architecture and contents

3. ESS standards for reference metadata and quality reporting

4. Project objectives and outline

5. The quality reports subsystem design

2


Project background

ESS reference metadata and quality reporting conceptual harmonisation: - Euro-SDMX Metadata Structure (ESMS)- ESS Standard for Quality Reports Structure (ESQRS)

National implementation in progresssupported by SDMX compliant IT tools (Metadata Handler)

SIDI/SIQual - Istat official system for reference metadata and quality indicators documentation – includes a lot of information required from ESMS and ESQRS

3

Project: to enhance SIDI/SIQual in order to produce ESS standard metadata files and quality reports in compliance with SDMX technical standards


Istat official information system for documenting quality and reference metadata of the statistical production processes

SIDI «input» system, SIQual for consultation

SIDI first implementation in 2001, later converted in a web-based architecture

SIQual first release in 2005, English version released in 2008

SIDI/SIQual is the reference metadata component of the Unified System of Metadata currently under development at Istat

SIDI/SIQual

4


SIDI/SIQual architecture

Quality indicatorsReference metadata

Staff Management

ETL

Quality indicators

Reference metadata

Reference metadata

SIDI

SIQual internet

SIQual intranet

National Statistical

Programme

Management metadata

DARC(Administrative

archive)

Dissemination website

IT Application Catalogue

ARMIDA(Validated microdata)

Input GUI

Quality reporting

Process quality report

Product quality report

Short method. note

5


CONCEPTUAL METADATAThemesUnits….

SIDI/SIQual contents

6

OPERATIONSPhases Operations Sub-operations

GENERALISED SOFTWARE Phases Software QUALITY CONTROL ACTIONS

Phase/Non sampling ErrorsPreventingMonitoring Evaluating

IN-DEPTH DOCUMENTATION:Sampling design Index production methodology…

STANDARD QUALITY INDICATORSProcess orientedProduct oriented

DOCUMENTS REPOSITORYRegulations, ManualsQuestionnairesDocuments (field operations, methods, standards, …)


ESS standards for reference metadata and quality reporting

7

Euro SDMX Metadata Structure

Concept Name Concept Name Concept Name1 Contact 7 Confidentiality 15 Timeliness and punctuality

1.1 Contact organisation 7.1 Confidentiality - policy 15.1 Timeliness

1.2 Contact organisation unit 7.2 Confidentiality - data treatment 15.2 Punctuality

1.3 Contact name 8 Release policy 16 Comparability1.4 Contact person function 8.1 Release calendar 16.1 Comparability - geographical

1.5 Contact mail address 8.2 Release calendar access 16.2 Comparability - over time

1.6 Contact email address 8.3 User access 17 Coherence1.7 Contact phone number 9 Frequency of dissemination 17.1 Coherence - cross domain

1.8 Contact fax number 10 Dissemination format 17.2 Coherence - internal

2 Metadata update 10.1 News release 18 Cost and burden

2.1 Metadata last certified 10.2 Publications 19 Data revision2.2 Metadata last posted 10.3 On-line database 19.1 Data revision - policy

2.3 Metadata last update 10.4 Micro-data access 19.2 Data revision - practice

3 Statistical presentation 10.5 Other 20 Statistical processing3.1 Data description 11 Accessibility of documentation 20.1 Source data

3.2 Classification system 11.1 Documentation on methodology 20.2 Frequency of data collection

3.3 Sector coverage 11.2 Quality documentation 20.3 Data collection

3.4 Statistical concepts and definitions 12 Quality management 20.4 Data validation

3.5 Statistical unit 12.1 Quality assurance 20.5 Data compilation

3.6 Statistical population 12.2 Quality assessment 20.6 Adjustment

3.7 Reference area 13 Relevance 21 Comment3.8 Time coverage 13.1 User needs

3.9 Base period 13.2 User satisfaction

4 Unit of measure 13.3 Completeness

5 Reference period 14 Accuracy and reliability6 Institutional mandate 14.1 Overall accuracy

6.1 Legal acts and other agreements 14.2 Sampling error

6.2 Data sharing 14.3 Non-sampling error

ESMS Example

http://epp.eurostat.ec.europa.eu/cache/ITY_SDDS/EN/prc_hicp_nesms_it.htm




ESS standards for reference metadata and quality reporting

8

ESS Standard for Quality Reports Structure


Project:• Enhancing SIDI/SIQual in order to be compliant with the ESS conceptual

and technical standards for reference metadata files and quality reports.

Frameworks:• Istat multi-year innovation strategy Stat2015• Eurostat Grant co-funding “Implementing the SDMX Istat strategy”

Organisation:• Start: second half of December 2012• Duration: for 2 years• Main phases:

1. The design phase. Main output expected: the document of requirements for the SIDI/SIQual enhancement (6 months devoted);

2. The software development, including requirement analysis, detailed design, realisation and test (1 year devoted)

3. The implementation process, the first metadata files and quality reports will be produced via the new subsystem

9

Project objectives and outline


Main advantages:

10


Exploit the already available information

Reduce reporting burden for survey managers

Avoid inconsistencies in metadata and quality reporting

Improve the metadata asset

Enhance internal system to be compliant to international technical standards

Facilitate next re-use

Improve internal coordination, harmonisation and centralised monitoring


1.The design phase: four steps to collect requirements

The first step: mapping between ESMS and ESQRS and SIDI/SIQual contents- Based on standard ESS Guidelines- Exercise of compilation from SIDI/SIQual

11


Example for ESMS concept «Statistical Unit»

ESMS SIDI

Concept Name

Concept Code

DescriptionsRepresen

tation ESS Guidelines

Sidi concept, if available

SQL Query Output example

(LFS)

3,5 Statistical unit STAT_UNIT

Entity for which information is sought and

for which statistics are ultimately compiled.

Text

List the basic units of statistical observation for which data are

provided. These observation units (e.g. the enterprise, the local

unit, private households,...) can be different from the reporting units used in the underlying

statistical surveys.

Observation units

select R3_T_UN_STAT.NOME_UNITA_ENG from r6_indagine, r3_t_un_stat, r17_ind_t_ust where R3_T_UN_STAT.CODICE_UNIT_STTSTC=R17_IND_T_UST.CODICE_UNIT_STTSTC and r6_indagine.codice_indagine=r17_ind_t_ust.codice_indagine and R17_IND_T_UST.TIPO_UNITA_STATISTICA in (2,3,4,5,7,8) and r6_indagine.codice_indagine="Survey_code"

Persons, Persons aged 15

and over

ESMS SIDI


1.The design phase

The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports

12


Main inputs obtained:

- «Input» compliance with SDMX artifacts and concepts is needed

- Functionalities to be implemented to support compilation (e.g: copy of a previous edition, re-use of single items, …)

- …


1.The design phase


13


Difficulties: two levels “Domain” customisation

1. At Metadata Structure Definition level: introduction of Domain specific concepts Example

This case can be managed through a more generalised software implementation, that will also facilitate the software reuse and higher its flexibility for changing requirements


1.The design phase


14


Difficulties: two levels “Domain” customisation

2. Within sub-concept level: introduction of different html tables in different domains

10.2. Dissemination format - Publications 10.2. Dissemination format - Publications

Dissemination at national level

Dissemination at national level : publications

Reference year

Statistical yearbook

Thematic publications

XXXX

XXXX

For XXXX, please report any scheduled action plan, specifying the implementation date.

Name of national paper publications

Text

Name of national electronic dissemination

Text

Example

The solution to this issue is still under evaluation, suggestions?


1.The design phase

The third step: involvement of stakeholders

• At national level• Contacts with Eurostat

The fourth step: drafting the requirements’ document

15



2. The software development:• Design by Istat IT experts• Realisation outsourced

3. The implementation process:• Under definition a proposal for the governance to be then approved by the

top management• The production of metadata files and quality reports with the new

subsystem should be centrally supported

16



Quality reporting subsystem building blocks

17

SIDI Reference Metadata & Quality indicators DB

SIDI Metadata & quality indicators

GUI

Enhancement for ESMS/ESQRS contents not

included (1)

GUI Enhancement (1)

Enhancement to be compliant to SDMX

artifacts (3)

GUI for metadata files compilation (4)

Euro-SDMX registry

SDMX Metadata set (5)

Eurostat (NRME or EDAMIS)

WS (8)

SEP

ETL Web Browser

SIQual (8)

GUI template management (7)

Pulling out procedures (2)

SDMX artifacts import

functionalities (6)

Quality reports (8)


Thank you for your attention!

Comments and suggestions are welcome

[email protected]

18

mailto:[email protected]

implementing ess standards for reference metadata and quality reporting at istat work session on...

Documents

metadata standards

istatunit quality

reference metadata files

contents ess standards

ess standard metadata

ess conceptual

istatgiorgia simeoni

sdmx compliant