building geo-spatial data portal for optimal user experience with … · 2019. 10. 2. · building...

15
Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers Library λ Software Research and Development Unit, CISS ® TDI GmbH, Sinzig(Rhein), Rheinland-Palatinate, Germany Ethelbert Obinna λ , Richard Figura λ , Markus Lindner λ , Alexander Tobisch λ , Prof. Dr. Dietmar Möller φ Email: { e.obinna, r.figura, m.lindner, a.tobisch }@ciss.de, [email protected] Speaker: Ethelbert Obinna Location: European Commission – Joint Research Center, Ispra, Italy Date: Thursday, 04 July, 2019 φ Institute for Applied Stochastics and Operations Research, TU Clausthal, Clausthal-Zellerfeld, Germany

Upload: others

Post on 06-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers Library

λ Software Research and Development Unit, CISS® TDI GmbH, Sinzig(Rhein), Rheinland-Palatinate, Germany

Ethelbert Obinnaλ, Richard Figura λ , Markus Lindner λ, Alexander Tobisch λ, Prof. Dr. Dietmar Möllerφ

Email: { e.obinna, r.figura, m.lindner, a.tobisch }@ciss.de, [email protected]

Speaker: Ethelbert Obinna

Location: European Commission – Joint Research Center, Ispra, Italy

Date: Thursday, 04 July, 2019

φInstitute for Applied Stochastics and Operations Research, TU Clausthal, Clausthal-Zellerfeld, Germany

Page 2: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 2 of 15

Founded: 1982 HeadOffice: Sinzig(Rhein)

Core Services & Solutions: Geodata Format Conversion Geodata Migration Geodata Warehouse Geodata Distribution Geodata Sales Geodata Quality Assurance

Contact Us: https://www.ciss.de/ +49 (0) 2642 9780 – 11 [email protected]

Some reference sites with our deployed GeoSolutions https://lvermgeo.rlp.de/de/startseite/ https://www.sit.nrw/ https://www.itk-rheinland.de/ https://www.kreis-re.de/Inhalte/index.asp

Page 3: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

Synopsis

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 3 of 15

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Architecture Core Module

Dependencies

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

Page 4: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

X - 4.0

X-4.0 ( 𝛅𝒚

𝛅𝒙)[BMVI] [1.2] = LIMBO[1.0][1.1]

( 𝛅𝒚

𝛅𝒙)[LIMBO research works] = mCLOUD[1.3]

CISS® Open-Data Portal stems from the concept of mCLOUD, plus Integration with the CISS® GeoShop - ecommerce perspective Metadata quality check on the datasets via the CISS® Quality Assurance Center (CISS® - QAC) API

References:[1.0] https://www.limbo-project.org/[1.1] https://www.ciss.de/forschung/limbo/[1.2] https://www.bmvi.de[1.3] https://www.mcloud.de/

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 4 of 15

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Architecture Core Modules

Dependencies

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

Page 5: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 5 of 15

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Architecture Core Modules

Dependencies

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

SHOP SYSTEMS CKAN

Customer_Data ∝ Lat-Lng positionDataset ∝ User_Data ∃ Metadata {{ Dataset }}

Product_Data ∝ Lat-Lng position

. . . . . .

{ In the context of Spatial Data & Geographical Locations }

Page 6: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 6 of 15

References:[2.0] https://contao.org/en/[2.1] https://shop.ciss.de/home.html

Core Module → Contao-CMS[2.0]

Extension – CISS® Geo-shop Module[2.1] → GeoData conversion services Real-Estate Cadastral Information Systems

Topographic Map services

Orthophotos/Aerial Maps

a:1:{s:3:"wkt";s:223:

"POLYGON((373511.34681746

99 5567243.12439547,380841.08706572774

5567243.12439547,380841.08706572774

5573962.0529563725,373511.3468174699

5573962.0529563725,373511.3468174699

5567243.12439547))";}

Serialized PHP

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Architecture Core Modules

Dependencies

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

Page 7: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

CURRENT ARCHITECTURE

= Addon/plugins

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 7 of 15

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Architecture Core Modules

Dependencies

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

Hardware and Middleware Architecture

Application Platform

Contao CMS Core Bundle

CISS® GeoShopSystem Module

OpenLayers Map &Geometry APIs

Other Apps

Page 8: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

References:[2.0] https://contao.org/en/[2.1] https://shop.ciss.de/home.html

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Architecture Core Modules

Dependencies

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 8 of 15

Page 9: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

Blueprint Design Methodology

Use what > 80% of current users already know – Our Shop

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

Text Search Input Spatial Search /Selection Response Query

Building Blocks

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 9 of 15

Page 10: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

ARCHITECTURE (Work-in-progress)

Hardware and Middleware Architecture

Application Platform

Contao CMS Core Bundle

CISS® GeoShopSystem Module

OpenLayers Map &Geometry APIs

Other Apps

CKAN Instance

CISS®

OpenData Portal

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 10 of 15

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

Page 11: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

POLYGON ((373511.3468174699

5567243.12439547,380841.08706572774

5567243.12439547,380841.08706572774

5573962.0529563725,373511.3468174699

5573962.0529563725,373511.3468174699

5567243.12439547))

Unserialized PHP (an Array)

unserialize(string $Str)htmlentities(string $str)

geoJSON = {

“type“: “POLYGON“,

“coordinates“: [[ 373511.3468174699

5567243.12439547,380841.08706572774

5567243.12439547,380841.08706572774

5573962.0529563725,373511.3468174699

5573962.0529563725,373511.3468174699

5567243.12439547]]

}

geoJSON = {}

GeoJSON

Crawl CKAN Instance

http://localhost:5000/api/3/action/package_search?q=geoJSON

Add a new index into CKAN based on the crawled dataset

(venv).../src/ckan$ paster Paster search-index geoJSONcrawled_dataset_{{geo_name}}]

Harvest Dataset from external sources

harvester gather_consumer

harvester fetch_consumer

Harvester purge_consumer

a:1:{s:3:"wkt";s:223:

"POLYGON((373511.3468174699

5567243.12439547,380841.08706572774

5567243.12439547,380841.08706572774

5573962.0529563725,373511.3468174699

5573962.0529563725,373511.3468174699

5567243.12439547))";}

Serialized PHP

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 11 of 15

Page 12: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

The Alpha Intros, Goad, and Genesis

X-4.0

LIMBO

The Architecture Core Modules

Dependencies

The Blueprint Baseline modules

Transformations and Indexing (Serialize PHP → Unserialize PHP → GeoJSON → Spatial Search)

Metadata Quality Check – CISS® QAC API

{{ Query_response 1 }}

{{ Query_response 2 }}

{{ Query_response 3 }}

{{ Query_response 4 }}

Crawl, harvest & Display [QAC Options]

{{ Dataset_Metrics }}

{{ Dataset_QAC Value }}

...

QAC API

QAC{{ Query_1 }}

{{ Query_2 }}

{{ Query_3 }}

{{ Query_4 }}

User Search Query

{{ IHarvester, spatial_query, spatial_metadata }}

IHarvester Spatial_search QAC API

Implementation Blocks

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 12 of 15

Page 13: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

Summary & Conclusion

The Alphas LIMBO → mCLOUD → CISS® OpenData Portal

The Architecture CISS® GeoShop → Architecture, Core Modules, Dependencies

The Blueprint CISS® Open-Data Portal → Architecture, Transformation, Indexing & CISS® Quality Assurance Center API

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 13 of 15

Page 14: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

04.07.2019 BUILDING GEO-SPATIAL DATA PORTAL FOR OPTIMAL USER EXPERIENCE WITH CKAN CORE-BUNDLE AND OPEN-LAYER LIBRARY page 14 of 15

. . . Dankeschön | Je vous remercie | GRAZIE |Thank You|Kiitos|Gracias |Obrigado |Gratias ago tibi | Shukraan jazilaan | Xièxiè . . .

Page 15: Building Geo-Spatial Data Portal for Optimal User Experience with … · 2019. 10. 2. · Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and OpenLayers

Fragen?

04.07.2019 Building Geo-Spatial Data Portal for Optimal User Experience with CKAN Core-Bundle and Open-Layer Library page 15 of 15