hale @foss4g2013

Create and Use INSPIRE Harmonised Geodata with

HALE

S. Franceschi1, A. Antonello1, T. Reitz2, S. Templer31HydroloGIS, Bozen, Italy, 2Esri R&D Center Zurich, Switzerland, 3Fraunhofer IGD, Darmstadt,

Germany

FOSS4G - Nottingham 19th September 2013

HUMBOLDT Alignment Editor (HALE) is a tool to create mappings between different data models/schemes

Distributed under Open Source GNU LGPL licence.

INTRODUCTION TO HALE

Initially developed in the HUMBOLDT project

Work is continued in other research projects and in the data harmonisation panel

INTRODUCTION TO HALE

INTRODUCTION TO HALE

● HALE enables to transform and harmonise spatial data, with a focus on highly complex data sets

● HALE can be used for defining and evaluating conceptual schema mappings, to create logically and semantically consistent mappings, that makes mappings easier to understand and to maintain;

● HALE documents the schema transformation process and its impact on data quality

● HALE provides a unique declarative approach to making interactive schema mapping a less daunting task;

INTRODUCTION TO HALE

✔ HALE provides a rich, textual and graphical interface specifically adopted for GIS Experts;

INTRODUCTION TO HALE

✔ HALE provides a rich, textual and graphical interface specifically adopted for GIS Experts;

✔ HALE gives instant feedback about the progress of mapping data from one schema to another, enabling the understanding of the transformation process;

INTRODUCTION TO HALE

✔ direct transformation of sample dataset✔ visual feedbacks:

✔ completeness of mapping✔ geometry transformation

INTRODUCTION TO HALE

✔ on line validation step by step✔ comparison between source and target

data

EXAMPLE OF APPLICATION

This use case shows a real example of mapping and transformation of the data of a regional plan of land use between the original (national) and the requested Insprire format.

EXAMPLE OF APPLICATION

The plan is the PGUAP plan of the Province of Trento, approved in February 2006.

Available data:

shapefile of land use: two different updates of this layer are considered, one is the most recent one, approved with a regional decree of February 2013 and the other one was the previous one, approved in July 2011

shapefile of hydro-geomorphological risk maps: only the geometries of the last update

main official documentation

EXAMPLE OF APPLICATION

COMPLETE TARGET SCHEMAgeometries of

Land Use

official plan

additional regulation which supplement the

zoning

links and reference for the available documentation

EXAMPLE OF APPLICATION

Inspire requires to classify PLU data following the categories of the HILUCS classification (Hierarchical Inspire Land Use Classification).

PLU of the Province of Trento is classified with a local classification.

We did the reclassification of all the local (specific) land use classes to hilucs and stored this classification in a CSV file.

COD_TOT DESCRIPTION HILUCS CLASSIFICATION1 Aree Residenziali 5_1_PermanentResidentialUse

2 Aree Produttive 2_SecondaryProduction

3 Aree Ricreative 3_4_4_OpenAirRecreationalArea

4 Aree Agricole 1_1_1_CommercialAgriculturalProduction

5 Improduttivo 6_3_1_LandAreasNotInOtherEconomicUse

6 Campeggi 5_3_OtherResidentialUse

7 Depuratori e Discariche 4_3_3_WasteTreatment

8 Aree Sciabili 3_4_3_SportsInfrastructure

9 Aree a bosco, prato e prateria alpina

1_2_Forestry

101 Strade di importanza primaria 4_1_1_RoadTransport

102 Ferrovie 4_1_2_RailwayTransport

103 Strade di importanza secondaria

4_1_1_RoadTransport

EXAMPLE OF APPLICATION

Another preliminary operation that would help us during the mapping process is the creation of the CSV file containing the information about the documentation.

We need to store the basic information requested from the Insprire schema for OfficialDocumentation, in particular:

● an identifier● legislationCitation: reference to the document that

contains the text of the regulation● DocumentCitation: citation of scanned plans and

structural drawings being sometimes georeferenced and sometimes not (raster images, vector drawings or scanned text).

EXAMPLE OF APPLICATION

ID DOCUMENTCITATION LEGISLATIONCITATIONDoc_1 http://pguap.provincia.tn.it/GIS/tiff/

uso.htmlhttp://www.delibere.provincia.tn.it/CercaSpecifica.asp?Modalita=Delibere&anno=2013&numero=228

Doc_2 http://www.delibere.provincia.tn.it/CercaSpecifica.asp?Modalita=Delibere&anno=2011&numero=1551

Doc_3 http://pguap.provincia.tn.it/pdf/Piano/0IndiceGenerale.pdf

EXAMPLE OF APPLICATION

EXAMPLE OF APPLICATION

PLU TN source schema

INSPIRE PLUtarget schema

XML schema

import source and target schema and sample data in HALE

EXAMPLE OF APPLICATION

PLU TN source schema

INSPIRE PLUtarget schema

determinate the relevant target object types

All the mapping is based on the retype operation.

Retype function expresses that a source and a target type are semantically equal: for each instance of the source type, an instance of the target type is created.

Property relation only take effect in the context of a type relation: first a type relation must be defined, then property relations between the involved types can be specified.An other possible operation between types is the merge operation.This function merges multiple instances of the source type into one instance of the target type based on one or more matching properties.

EXAMPLE OF APPLICATION

EXAMPLE OF APPLICATION

EXAMPLE OF APPLICATION

EXAMPLE OF APPLICATION

base mapping of types

EXAMPLE OF APPLICATION

Properties mapping:

rename to just rename the propertie with the possibility to select structural rename to rename also the sub-properties

date extraction extract dates from local formats to required ones

create Inspire Identifier and generate inspireId

assigns predefined properties as for regulationNature (definedInLegislation)

generate unique ID for the id of the features

EXAMPLE OF APPLICATION

rename properties with the possibility to use structural rename

EXAMPLE OF APPLICATION

extract dates from local date formats

EXAMPLE OF APPLICATION

creation of an Inspire Identifier

EXAMPLE OF APPLICATION

generate sequential ID

EXAMPLE OF APPLICATION

assign an Inspire predefined property

EXAMPLE OF APPLICATION

reclassification using the CSV list between the shapefile attribute and hilucsLandUse

use groovy script to assign the validTo property to the features of the two different updates: the validTo property is defined as the date before the date of the new update, so it is based on the shapefile attribute field of validFrom of the land use and the syntax is like the following:

if(AGGIORN_6.equals("2011-07-18")) { return "2013-02-26"; } else { return null;}

EXAMPLE OF APPLICATION

landuse classification

EXAMPLE OF APPLICATION

landuse classification

EXAMPLE OF APPLICATION

do operation with Groovy scripts

EXAMPLE OF APPLICATION

final mapping of ZoningElement

EXAMPLE OF APPLICATION

final mapping of SpatialPlan

EXAMPLE OF APPLICATION

final mapping of OfficialDocumentation

EXAMPLE OF APPLICATION

final mapping of SupplementaryRegulations

EXAMPLE OF APPLICATION

and the transformed data

EXAMPLE OF APPLICATION

export data and alignment

HOW TO CONTRIBUTE TO HALE

You‘re a developer?

1.if you don’t have a GitHub account already, create one

2.go to the hale repository on GitHub & Fork it

3.clone the repo, set up your local development environment

4.perform any changes to your local copy, commit them and push them to your remote repository

5.send to the development team a pull request via GitHub to let us know that you have a change you’d like to contribute!

NEXT RELEASES

Release 2.6.1 – 30.09.2013● join Type Transformations● new INSPIRE/GML 3.3 Code List Support● JSON/GeoJSON Support

Release 2.7.0 – 15.12.2013●new CST Web Service●schema Editing●direct Database (PostGIS, ODBC/JDBC) support

Release 3.0.0 – Q2/2014New, focused, UI to improve work with complex contexts

Ongoing development ensured to ~2016

USEFUL LINKS

hale is Open Source Software and licensed using the LGPL 3.0.

Find out more about the data harmonisation panel:http://www.dhpanel.eu

HALE community site:http://www.esdi-community.eu/projects/show/hale

Public user and developer mailing list:dev@esdi-humboldt.eu