cerba ppt gi2011-harmonization-of-spatial-planning-data_final
Post on 15-Nov-2014
766 Views
Preview:
DESCRIPTION
TRANSCRIPT
Spatial Data HarmonizationOn how to realize it in Spatial Planning
1http://portal.sdi-edu.zcu.cz
University of West Bohemia
Karel JANECKA, Otakar CERBA,
Karel JEDLICKA, Jan JEZEK
Harmonization and its role in spatial planning
Spatial data harmonization
• Providing access to data through network services in arepresentation that allows for combining it with other INSPIRE datain a coherent way by using within the European Spatial DataInfrastructure (ESDI) a common set of data product specifications.
• This includes agreements about coordinate reference systems,classification systems, application schemes, etc.
3http://portal.sdi-edu.zcu.cz
Spatial data harmonization
4http://portal.sdi-edu.zcu.cz
Spatial data harmonization
Components of harmonization:
• INSPIRE principles
• Reference model
• Data translation model
• Portrayal model
• Application schemes and feature catalogues
• Dictionaries
• Metadata
• Maintenance
• Quality
• Data transfer
• Derived reporting & multiple representations
• Consistency between data
• Data Capturing
5http://portal.sdi-edu.zcu.cz
An example of Spatial Data Harmonization using PostgreSQL + PostGIS
6http://portal.sdi-edu.zcu.cz
HARMONIZATION
Source data model Target data model
Zemgale urban
planing
(specific data model)
CORINE land
cover
Geometry
Reclassification
HARMONIZATION
7http://portal.sdi-edu.zcu.cz
HARMONIZATION STEPS
Definition of reclassification rules
Data reclassification
Union of touching geometries in same class
Transformation from multipolygon to polygons
8http://portal.sdi-edu.zcu.cz
HARMONIZATION STEPS IN
Definition of reclassification rules → Create mapping table
Data reclassification → SQL JOIN using mapping table
Union of touching geometries in same class → Spatial aggregatefunction Union
Transformation from multipolygon to polygons → Spatial functiondump for converting multipolygon to polygon
9http://portal.sdi-edu.zcu.cz
ZEMGALE DATA MODEL
Atribute Field Explanation Type
VEIDS Planed land use type (see possible values down) Text 50
INDEKSS Area with speciffic restrictions Text 10
PLATIBA Area(m2) Long Integer
TER_VIEN territorial unit Text 50
ADM_TER administrative area Text 50
LAYER Layer number in CAD systems Text 50
PIEZIMES notes Text 100
10http://portal.sdi-edu.zcu.cz
LAND COVER DATA MODEL
CORINE land
cover11http://portal.sdi-edu.zcu.cz
RECLASSIFICATION RULES
1 DzM Low-rise residential dwellings → 11 Urban fabric
2 DzV Multi-residential dwellings → 11 Urban fabric
3 P Public Building → 11 Urban fabric
4 RR Production facilities and warehouses → 121 Industrial or commercial units
5 RD Mining area → 131 Mineral extraction sites
6 T Technical Building → 12 Industrial, commercial...
7 Ū Waters → 5 Water bodies
8 M Forests → 31 Forests
9 ZĪ Outstanding foliage sites No corresponding class
10 ZC Other groomed greenery space → 141 Green urban areas
11 L Rural Land → 2 Agriculture areas
12 No data No corresponding class
ZEMGALE CLASSIFICATION → CORINE NOMENCLATURE
12http://portal.sdi-edu.zcu.cz
Database tables
plan_zonejums_part – orginal dataset (imported from
shapefile)
lc_original - original classification for land cover
lc_standardized – standardized classification for land cover
standardized_to_original – classification mapping
plan_zonejums_part_harm – reclassified data
13http://portal.sdi-edu.zcu.cz
Database schema
14http://portal.sdi-edu.zcu.cz
Harmonization query
We have: plan_zonejums_part, lc_original, lc_standardized,
standardized_to_original
We need: plan_zonejums_part_harm
SQL Query:
CREATE TABLE plan_zonejums_part_harm AS
SELECT nextval('gid_seq'::regclass) AS gid, orig.gid AS original_gid,
orig.the_geom, orig.veids, orig.standardized_cl, lc_standardized.lc_class
FROM lc_standardized, ( SELECT plan_zonejums_part.gid,
plan_zonejums_part.the_geom, plan_zonejums_part.veids,
standardized_to_original.standardized_cl
FROM plan_zonejums_part
RIGHT JOIN standardized_to_original ON plan_zonejums_part.veids =
standardized_to_original.original_cl) orig
WHERE orig.standardized_cl::text = lc_standardized.classification::text;
15http://portal.sdi-edu.zcu.cz
Database tables
plan_zonejums_part – orginal dataset (imported from
shapefile)
lc_original – original classification for land cover
lc_standardized – standardized classification for land cover
standardized_to_original – classification mapping
plan_zonejums_part_harm – reclassified data
16http://portal.sdi-edu.zcu.cz
RECLASSIFIED DATA SET
17http://portal.sdi-edu.zcu.cz
Next step – union of adjacent features with same class
SELECT
NEXTVAL('gid_seq'::regclass)::integer AS gid,
(ST_Dump(foo.the_geom)).geom AS the_geom, standardized_cl,
lc_class FROM (
SELECT
ST_union(the_geom) AS the_geom, standardized_cl, lc_class
FROM plan_zonejums_part_harm
WHERE the_geom IS NOT NULL
GROUP BY standardized_cl, lc_class) AS foo
WHERE foo.the_geom IS NOT NULL;
18http://portal.sdi-edu.zcu.cz
Final dataset
19http://portal.sdi-edu.zcu.cz
An example of Spatial Data Harmonization using commercial
GIS software - ArcGIS
20http://portal.sdi-edu.zcu.cz
Using ArcGIS Model Builder for transformations between
data modelsP4A Land Cover example
21http://portal.sdi-edu.zcu.cz
Understanding target data
• Plan4all Land Cover data model
22http://portal.sdi-edu.zcu.cz
Understanding target data
Simple feature classLandCoverOriginalArea Contains Z values
Contains M valuesGeometry Polygon
NoYes
Data typeField namePrec-ision Scale LengthDomainDefault value
Allow nulls
OBJECTID Object ID
SHAPE Geometry Yes
inspireId String Yes 15
source String Yes 50
classification String Yes 21
classificationLink String Yes 50
SHAPE_Length Double Yes 0 0
SHAPE_Area Double Yes 0 0
Simple feature classLandCoverStandardisedArea Contains Z values
Contains M valuesGeometry Polygon
NoYes
Data typeField namePrec-ision Scale LengthDomainDefault value
Allow nulls
OBJECTID Object ID
SHAPE Geometry Yes
inspireId String Yes 15
source String Yes 50
classification String Yes CorineLandCoverCode 21
beginLifespanVersion Date Yes 0 0 8
endLifespanVersion Date Yes 0 0 8
SHAPE_Length Double Yes 0 0
SHAPE_Area Double Yes 0 0
Relationship class
Name
Primary key
Foreign key
Type
Cardinality
Notification
Forward label
Backward label
No relationship rules defined.
StandardisedArea_OriginalArea
Origin feature class Destination feature class
Simple
One to many
None
OriginalArea
StandardArea
StandardArea
inspireId
inspireId
OriginalAreaName
Coded value domain
CorineLandCoverCodeDescription
Field type
Split policy
Merge policy
CorineLandCoverCod
e
String
Default value
Default value DescriptionCode
1 Artificial surfaces
2 Agricultural areas
3 Forest and semi natural areas
4 Wetlands
5 Water bodies
11 Urban fabric
12Industrial, commercial and
transport units13
Mine, dump and construction
sites14
Artificial, non-agricultural
vegetated areas21 Arable land
22 Permanent crops
23 Pastures
24 Heterogeneous agricultural areas
31 Forests
32Scrub and/or herbaceous
vegetation associations33
Open spaces with little or no
vegetation41 Inland wetlands
42 Maritime wetlands
51 Inland waters
52 Marine waters
111 Continuous urban fabric
112 Discontinuous urban fabric
121 Industrial or commercial units
122Road and rail networks and
associated land123 Port areas
124 Airports
131 Mineral extraction sites
132 Dump sites
133 Construction sites
141 Green urban areas
142 Sport and leisure facilities
211 Non-irrigated arable land
212 Permanently irrigated land
213 Rice fields
221 Vineyards
222 Fruit trees and berry plantations
223 Olive groves
231 Pastures
241Annual crops associated with
permanent crops242 Complex cultivation patterns
243
Land principally occupied by
agriculture, with significant areas
of natural vegetation244 Agro-forestry areas
311 Broad-leaved forest
312 Coniferous forest
313 Mixed forest
321 Natural grasslands
322 Moors and heathland
323 Sclerophyllous vegetation
324 Transitional woodland-shrub
331 Beaches, dunes, sands
332 Bare rocks
333 Sparsely vegetated areas
334 Burnt areas
335 Glaciers and perpetual snow
411 Inland marshes
412 Peat bogs
421 Salt marshes
422 Salines
423 Intertidal flats
511 Water courses
512 Water bodies
521 Coastal lagoons
522 Estuaries
523 Sea and ocean
No corresponding cla* No corresponding class
• Plan4all Land Cover data model – ERA diagram of database schema in ESRI Geodatabase.
23http://portal.sdi-edu.zcu.cz
Understanding target data
Simple feature classLandCoverOriginalArea Contains Z values
Contains M valuesGeometry Polygon
NoYes
Data typeField namePrec-ision Scale LengthDomainDefault value
Allow nulls
OBJECTID Object ID
SHAPE Geometry Yes
inspireId String Yes 15
source String Yes 50
classification String Yes 21
classificationLink String Yes 50
SHAPE_Length Double Yes 0 0
SHAPE_Area Double Yes 0 0
Simple feature classLandCoverStandardisedArea Contains Z values
Contains M valuesGeometry Polygon
NoYes
Data typeField namePrec-ision Scale LengthDomainDefault value
Allow nulls
OBJECTID Object ID
SHAPE Geometry Yes
inspireId String Yes 15
source String Yes 50
classification String Yes CorineLandCoverCode 21
beginLifespanVersion Date Yes 0 0 8
endLifespanVersion Date Yes 0 0 8
SHAPE_Length Double Yes 0 0
SHAPE_Area Double Yes 0 0
Relationship class
Name
Primary key
Foreign key
Type
Cardinality
Notification
Forward label
Backward label
No relationship rules defined.
StandardisedArea_OriginalArea
Origin feature class Destination feature class
Simple
One to many
None
OriginalArea
StandardArea
StandardArea
inspireId
inspireId
OriginalAreaName
Coded value domain
CorineLandCoverCodeDescription
Field type
Split policy
Merge policy
CorineLandCoverCod
e
String
Default value
Default value DescriptionCode
1 Artificial surfaces
2 Agricultural areas
3 Forest and semi natural areas
4 Wetlands
5 Water bodies
11 Urban fabric
12Industrial, commercial and
transport units13
Mine, dump and construction
sites14
Artificial, non-agricultural
vegetated areas21 Arable land
22 Permanent crops
23 Pastures
24 Heterogeneous agricultural areas
31 Forests
32Scrub and/or herbaceous
vegetation associations33
Open spaces with little or no
vegetation41 Inland wetlands
42 Maritime wetlands
51 Inland waters
52 Marine waters
111 Continuous urban fabric
112 Discontinuous urban fabric
121 Industrial or commercial units
122Road and rail networks and
associated land123 Port areas
124 Airports
131 Mineral extraction sites
132 Dump sites
133 Construction sites
141 Green urban areas
142 Sport and leisure facilities
211 Non-irrigated arable land
212 Permanently irrigated land
213 Rice fields
221 Vineyards
222 Fruit trees and berry plantations
223 Olive groves
231 Pastures
241Annual crops associated with
permanent crops242 Complex cultivation patterns
243
Land principally occupied by
agriculture, with significant areas
of natural vegetation244 Agro-forestry areas
311 Broad-leaved forest
312 Coniferous forest
313 Mixed forest
321 Natural grasslands
322 Moors and heathland
323 Sclerophyllous vegetation
324 Transitional woodland-shrub
331 Beaches, dunes, sands
332 Bare rocks
333 Sparsely vegetated areas
334 Burnt areas
335 Glaciers and perpetual snow
411 Inland marshes
412 Peat bogs
421 Salt marshes
422 Salines
423 Intertidal flats
511 Water courses
512 Water bodies
521 Coastal lagoons
522 Estuaries
523 Sea and ocean
No corresponding cla* No corresponding class
• Plan4all Land Cover data model
24http://portal.sdi-edu.zcu.cz
Simple feature classLandCoverOriginalArea Contains Z values
Contains M valuesGeometry Polygon
NoYes
Data typeField namePrec-ision Scale LengthDomainDefault value
Allow nulls
OBJECTID Object ID
SHAPE Geometry Yes
inspireId String Yes 15
source String Yes 50
classification String Yes 21
classificationLink String Yes 50
SHAPE_Length Double Yes 0 0
SHAPE_Area Double Yes 0 0
Simple feature classLandCoverStandardisedArea Contains Z values
Contains M valuesGeometry Polygon
NoYes
Data typeField namePrec-ision Scale LengthDomainDefault value
Allow nulls
OBJECTID Object ID
SHAPE Geometry Yes
inspireId String Yes 15
source String Yes 50
classification String Yes CorineLandCoverCode 21
beginLifespanVersion Date Yes 0 0 8
endLifespanVersion Date Yes 0 0 8
SHAPE_Length Double Yes 0 0
SHAPE_Area Double Yes 0 0
Relationship class
Name
Primary key
Foreign key
Type
Cardinality
Notification
Forward label
Backward label
No relationship rules defined.
StandardisedArea_OriginalArea
Origin feature class Destination feature class
Simple
One to many
None
OriginalArea
StandardArea
StandardArea
inspireId
inspireId
OriginalAreaName
Coded value domain
CorineLandCoverCodeDescription
Field type
Split policy
Merge policy
CorineLandCoverCod
e
String
Default value
Default value DescriptionCode
1 Artificial surfaces
2 Agricultural areas
3 Forest and semi natural areas
4 Wetlands
5 Water bodies
11 Urban fabric
12Industrial, commercial and
transport units13
Mine, dump and construction
sites14
Artificial, non-agricultural
vegetated areas21 Arable land
22 Permanent crops
23 Pastures
24 Heterogeneous agricultural areas
31 Forests
32Scrub and/or herbaceous
vegetation associations33
Open spaces with little or no
vegetation41 Inland wetlands
42 Maritime wetlands
51 Inland waters
52 Marine waters
111 Continuous urban fabric
112 Discontinuous urban fabric
121 Industrial or commercial units
122Road and rail networks and
associated land123 Port areas
124 Airports
131 Mineral extraction sites
132 Dump sites
133 Construction sites
141 Green urban areas
142 Sport and leisure facilities
211 Non-irrigated arable land
212 Permanently irrigated land
213 Rice fields
221 Vineyards
222 Fruit trees and berry plantations
223 Olive groves
231 Pastures
241Annual crops associated with
permanent crops242 Complex cultivation patterns
243
Land principally occupied by
agriculture, with significant areas
of natural vegetation244 Agro-forestry areas
311 Broad-leaved forest
312 Coniferous forest
313 Mixed forest
321 Natural grasslands
322 Moors and heathland
323 Sclerophyllous vegetation
324 Transitional woodland-shrub
331 Beaches, dunes, sands
332 Bare rocks
333 Sparsely vegetated areas
334 Burnt areas
335 Glaciers and perpetual snow
411 Inland marshes
412 Peat bogs
421 Salt marshes
422 Salines
423 Intertidal flats
511 Water courses
512 Water bodies
521 Coastal lagoons
522 Estuaries
523 Sea and ocean
No corresponding cla* No corresponding class
Understanding source data
• Zemgale (Latvia) data model
Simple feature classplan_zonejums_JelgavaSurroundings Contains Z values
Contains M valuesGeometry Polygon
NoNo
Data typeField namePrec-ision Scale LengthDomainDefault value
Allow nulls
OBJECTID Object ID
Shape Geometry Yes
gid Double Yes 0 0
veids String Yes 21
indekss String Yes 254
platiba String Yes 21
pasv String Yes 254
piezimes String Yes 254
map_leaf String Yes 254
dept String Yes 254
Shape_Length Double Yes 0 0
Shape_Area Double Yes 0 0
Atribute Field Explanation Type
VEIDS Planed land use type (see possible values down) Text 50
INDEKSS Area with speciffic restrictions Text 10
PLATIBA Area(m2) Long Integer
TER_VIEN territorial unit Text 50
ADM_TER administrative area Text 50
LAYER Layer number in CAD systems Text 50
PIEZIMES notes Text 100
25http://portal.sdi-edu.zcu.cz
Attribute mapping
1 DzM Low-rise residential dwellings → 11 Urban fabric
2 DzV Multi-residential dwellings → 11 Urban fabric
3 P Public Building → 11 Urban fabric
4 RR Production facilities and warehouses → 121 Industrial or commercial units
5 RD Mining area → 131 Mineral extraction sites
6 T Technical Building → 12 Industrial, commercial...
7 Ū Waters → 5 Water bodies
8 M Forests → 31 Forests
9 ZĪ Outstanding foliage sites No corresponding class
10 ZC Other groomed greenery space → 141 Green urban areas
11 L Rural Land → 2 Agriculture areas
12 No data No corresponding class
ZEMGALE CLASSIFICATION → CORINE NOMENCLATUREZEMGALE CLASSIFICATION → CORINE NOMENCLATURE
26http://portal.sdi-edu.zcu.cz
Transformation steps
• Understanding both source and target data– A necessary condition!
1. Transform source data to WGS 84.
2. Transform the source data geometry and attributes to match the target scheme.
3. Apply domain.
27http://portal.sdi-edu.zcu.cz
Transformation of coordinate system
1. Transform source data to WGS 84.– Explore source coordinate system,
– Run transformation
28http://portal.sdi-edu.zcu.cz
Transformation of geometry and attributes
2. Transform the source data geometry and attributes to match the target scheme.
– Create classes:
• LandCoverOriginalArea,
• LandCoverStandardisedArea.
– Fill them with data.
– Create relationship between them.
29http://portal.sdi-edu.zcu.cz
Transformation of geometry and attributes
30http://portal.sdi-edu.zcu.cz
Applying a domain
3. Apply a StandardClassification domain to LandCoverStandardisedArea.
31http://portal.sdi-edu.zcu.cz
Result
32http://portal.sdi-edu.zcu.cz
References
• JEDLICKA, K.: Using ArcGIS Model Builder for transformations between data models- P4A Land Cover example. In: PLAN4ALL workshop on spatial data harmonization.Riga, 2011.
• JEZEK, J.: Technological aspect of spatial data harmonization.
[ONLINE] http://prezi.com/ro8cfb114n2d/harmonization/
• Project HUMBOLDT
http://www.esdi-humboldt.eu/home.html
• Project PLAN4ALL
http://portal.plan4all.eu
• Project SDI-EDU
http://portal.sdi-edu.zcu.cz
http://portal.sdi-edu.zcu.cz 33
top related