data validation concepts and techniques -...

22
Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016 Data validation concepts and techniques KEN Validation Workshop

Upload: lexuyen

Post on 05-Feb-2018

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

Richard MITANCHEY, CEREMA – COVADIS secretary

Date : 03 juin 2016

Data validation concepts and techniques

KEN Validation Workshop

Page 2: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

203 juin 2016 KEN Validation Workshop

Outline

● COVADIS (objectives, productions)● INSPIRE / COVADIS● Geo-IDE Catalogue component and tools

Templates repository server Dataset validator

● Conclusion

Page 3: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

303 juin 2016 KEN Validation Workshop

COVADIS Validation Committee

INSPIRE

GIS convergencebetweenAgricultureand EnvironmentCOVADIS

(since 2008)

GISheterogeneous data and uses

alignment

experience of CNV records

(small one class only GIS national

standards)

produce geographical standards adapted to the

needs of the two ministers

Page 4: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

403 juin 2016 KEN Validation Workshop

Anatomy of COVADIS geostandards

A) Perimeter

B) Concepts

C) Implementation

WHY

is it relevant to my needs ?

WHAT

data definition ?

HOW TO

exchange or store my data ?

3 parts

Page 5: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016
Page 6: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

603 juin 2016 KEN Validation Workshop

COVADIS geostandard qualities

Réunion régionale Information Géographique Ile-de-France 6

Kernel

Consensus

Pragmatisman operational (ready to use) data structure

ExtensibilityGeostandard = kernel that can be enriched

CompatibilityData models to prepare INSPIRE compliance

SDI aSDI b

Page 7: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

703 juin 2016 KEN Validation Workshop

INSPIRE versus COVADISRisk management case

● Existing hazard areas‒ Observations / Models

● 3 spatial features‒ Hazard area

‒ Risk area

‒ Vullnerability

● Vulnerability evaluation

COVADIS PPR (2012)● PPR document +

regulations‒ Hazard area

‒ Regulation zone

‒ Vulnerable to the risk issue

● 2 usages / themes

III.8Land Use

III.12 Natural Risk zones

Page 8: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

803 juin 2016 KEN Validation Workshop

INSPIRE class mapping :Water and Sewer networks (2016)

Page 9: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016
Page 10: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

(Frontoffice)

Page 11: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

1103 juin 2016 KEN Validation Workshop

(Backoffice)

Page 12: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

1203 juin 2016 KEN Validation Workshop

Validation ToolUse and test cases

Page 13: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

1303 juin 2016 KEN Validation Workshop

Dataset Validator : input parameters

1. Test name (useful for history)2. Select standard

3. Add or remove directories of datasets4. Launch the validation process

Page 14: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

1403 juin 2016 KEN Validation Workshop

Dataset Validator : passed or not ?

Test (by name) with last date and result

Show detailed resultsOr load/delete older tests

Page 15: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

Timestamp Elementary check

Page 16: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

(rudimentary diagnostic : FATAL - enumerated value not allowed

Page 17: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

1703 juin 2016 KEN Validation Workshop

Lets look at the xml rules...

Page 18: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

1803 juin 2016 KEN Validation Workshop

The same, more human readable !

Page 19: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

1903 juin 2016 KEN Validation Workshop

Complete (manual) error resolution

Page 20: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

2003 juin 2016 KEN Validation Workshop

Validator characteristics

✔ Central and local deployment✗ Need to contact the template repository server✔ Global an detailed but rudimentary reporting

(test run progress and results, timestamps)✔ Including history✗ No API, No workflow, No links to resolve errors✔ Java implementation, with GUI✗ Governance unclear

Page 21: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

2103 juin 2016 KEN Validation Workshop

Conclusion

● COVADIS geostandards should by design be compatible with INSPIRE...

now starting to include explicit INSPIRE mapping !→● Focused on implementation,

if necessary(?) compliant INSPIRE GML might be →produced by reverse mapping...

● Geo-IDE Catalogue comes with interesting railing tools (templates, standard metadata guidance, datasets validator with standalone version...)

Page 22: Data validation concepts and techniques - …eurogeographics.org/sites/default/files/20160603CEREMA_COVADIS.pdf · Richard MITANCHEY, CEREMA – COVADIS secretary Date : 03 juin 2016

Richard MITANCHEY, CEREMA [email protected] secretary

Thank you

Centre d'études et d'expertise sur les risques, l'environnement, la mobilité et l'aménagement - www.cerema.frDirection technique Territoires et ville - 2 rue Antoine Charial - 69426 LYON Cedex 03 - Tél. : +33 (0)4 72 74 58 00Siège social : Cité des mobilités - 25 avenue François Mitterrand - 69674 BRON Cedex - Tél. : +33 (0)4 72 14 30 30

http://www.geoinformations.developpement-durable.gouv.fr/la-covadis-r425.html