the challenge: making use of inspire services - …...2016/09/26 · “pitch”: participants...
TRANSCRIPT
The Challenge:Making Use of INSPIRE Services –INSPIREd by Open Data Hackathons
INSPIRE Conference, Barcelona 26.09.2016
Antje Kügeler (con terra) Thomas Wojaczek (con terra)
IntroductionThe idea behind our INSPIRE HackathonResults of the INSPIRE Hackathon> Searching for INSPIRE data
> 2 Apps developed in 4 hours
> View behind the scenes - Using INSPIRE Services / data or alternatives, Technologies
Participants’ ideas for Use Cases> Work in groups: 15 min. brainstorming, 3 min. presentation per group
Lessons learned and discussion
Overview
con terra is a leading provider of solutions for spatial data infrastructures in Europe, e.g. INSPIREFounded in 1993 > Spin-off of the University of Münster, Institute of GeoinformaticsHeadquarter: Münster, Germany – Branch Office: BerlinCo-founder of 52°North Initiative for Open Source Software in 2004Member of the Esri Deutschland Group since 2006Platinum Partner of Safe SoftwareNumber of employees: 120
con terra
Münster
http://click-that-hood.com/europe“Click that Hood” is a game based on open data, built by Code for America’s 2013 Louisville fellowship team.The player is challenged to identify the polygon of a named “neighborhood”.We would like to use it as an introduction to fun use of data and to find out:
> Where are you from?
Getting to know each other
The idea behind the INSPIRE Hackathon
Hackathon> from „hack“ and „marathon“> aka hack day, hackfest or codefest> "hack" is used in the sense of exploratory
programming
Programmers come together to collaborate on software projects
> …to meet
> …to learn
> …to create something
> …to have fun
Focus on INSPIRE> use INSPIRE data to create something
The idea behind the INSPIRE Hackathon
Con terra invited staff members and “Code for Münster“ for an INSPIRE Hackathon> to see what happens when a group of developers are encouraged to play around INSPIRE data
http://codeformuenster.org/
“Code for Münster“ is a regional group which is part of ”Code for Germany”. The goal of the program is to promote developments in transparency, open data, and civic technology.
Focus on INSPIRE in a local context> A cross-border context would have been interesting in a more international setting
The Hackathon took place August 31, 2016, 5 p.m. to 10 p.m. in Münster, Germanny
Our INSPIRE Hackathon
During the Hackathon:1. “Pitch”: Participants suggest ideas
> a problem statement, the solution, the data and the skills needed to make it happen
2. Participants form teams based on their interests and skills
3. Collaborative work on projects
4. Wrap-up session
Before the Hackathon: Preparation - finding ideas and data> con terra started with a brain storming session a few weeks before the event
> Volunteers searched for INSPIRE data to use for implementing the ideas
INSPIRE Hackathon
Hackathon Preparation: Ideas Ozone Levels:Too high for
outdooractivitiestoday?
Traffic Accidents:Where is itdangerous?
What‘spolluting my
neighbourhood?
Something to do with
Demography & Elections
A Game like“Click that Hood“http://click-that-hood.com/muenster
Bio WeatherForecastAsthma,
RheumatismAllergies,… ?
Hackathon Preparation: INSPIRE data Ozone Levels:Too high for
outdooractivitiestoday?
Traffic Accidents:Where is itdangerous?
What‘spolluting my
neighbourhood?
Something to do with
Demography & Elections
A Game like“Click that Hood“
Bio WeatherForecastAsthma,
RheumatismAllergies,… ?
Pollutant Release Transfer Register (PRTR)
Production and Industrial Facilities
Air Quality Data (AQD)Regulation zones & reporting unitsEnvironmental Monitoring Facilities
Weather Data (DWD)Athmospheric conditions
Census 2011Open data on regional elections
Population distribution – demography
Administrative units (state NRW)Administrative Units
Open data on accidentsTransport Networks
© con terra GmbH
Results of the INSPIRE Hackathon
© con terra GmbH
Hackathon Pitch of Ideas Ozone Levels:Too high for
outdooractivitiestoday?
Traffic Accidents:Where is itdangerous?
What‘spolluting my
neighbourhood?
Something to do with
Demography & Elections
A Game like“Click that Hood“http://click-that-hood.com/muenster
Bio WeatherForecast
Asthma, RheumaAllergy,… ?
© con terra GmbH
Pitch of ideas and Formation of Teams
What‘spolluting my
neighbourhood?
A Game like“Click that Hood“http://click-that-hood.com/muenster
Ozone Levels:Too high for
outdooractivitiestoday?
An app that providesyou with excuses
An educational game
Bio WeatherForecast
Asthma, RheumaAllergy,… ?
© con terra GmbH
The app that helps you find the perfect excuse for not leaving the house
App for „good excuses“!
14
© con terra GmbH
What‘spolluting my
neighbourhood?
Ozone Levels:Too high for
outdooractivitiestoday?
An app that provides youwith „good excuses“
…… for not leaving the house
If the weather is fine ?!
Bio WeatherForecast
Asthma, RheumaAllergy,… ?Clara
FME Data TransformationDennis
Web App Design, FME Service
KristinaArcGIS
JS-Development
ThoreModeratorOpen Data ExperDesign, ArchitectureJS Development
ThomasMotivation, Logistics (drinks, food), Data discovery, Design, map.apps
App for „good excuses“Team 1
MarcOpen Data ExpertModeratorLogistics (drinks, food)
App for „good excuses“: Design
General> Simple smartphone App without a map
Data sources> Air Quality, Bio Weather,
Pollution from Industrial Facilities
Functionality> LBS - current health-relevant environmental data
> Interpretation of values and definitionof comprehensible „excuses“
> Link to a map App
Geo-IT> ArcGIS, FME Server, map.apps
© con terra GmbH
Preparing DataSearch and Discovery
The goal of the INSPIRE Hackathon> We want to use INSPIRE Data –
maybe enriched by additional open data
Key data topic> health-relevant environmental data
Researching data in different INSPIRE metadata catalogues> … with different user interfaces
> … with different search functionalities
> … with different metadata content
© con terra GmbH
Preparing DataSearch and Discovery
That‘s why we prepared con terra‘sSDI Solution> Connect different
INSPIRE cataloguesto 1 application
> Smart Index Search
> Refine Resultsvia Faceted Filter
> Add Service
> Download Data
© con terra GmbH
Data Topics> Air Quality - ozone
> Pollution from Facilities
> Weather Warnings
View Service URLs> INSPIRE View, WMS,
ArcGIS Services
Download Service URLs> Atom Feed, WFS,
Linked File, REST
> Websites
19
Preparing DataSearch and Discovery
© con terra GmbH 20
SDI Solution – LIVE demo
© con terra GmbH
What we have accomplished in 4 hours
> Create the App icons
> Design the website template (based on flatfy –Free flat and responsive HTML5 Template)
> Prepare data with ArcMap and FME Desktop
> Setup ArcGIS for Server map.Services
> Setup FME Process and FME Server REST Service to identifythe relevant information at the requested position and generate the answer
> Configure a simple map.apps App (facilities causing pollution)
21
App for „good excuses“: Scope of work
© con terra GmbH 22
App for „good excuses“
© con terra GmbH 23
App for „good excuses“
© con terra GmbH
Architecture
24
App for „good excuses“: Behind the scenes
FME ServerFME Desktop
App
User
UBA AQD: OZON
DWDBio Weather
UBAPRTR
FME Rest Service
REST
sqllite DBEsri Geodatabse
INSPIRE gml
Download INSPIREPredefined Datasets
Data Preparation
FME DesktopArcMap
ArcGIS for Server
INSPIRE View Service
REST Service
© con terra GmbH
UBA Air Quality Data (AQD) - ozone (O3)[what we wanted to do]> Download AQD datastreams - D (Stations),
E1a (validated single values per hour) via INSPIRE PDD Service (*.gml)
> Setup an FME Process:Read GML, find next station, identify currentozone value at this station
> Problem: data not up to dateValidated ozone values (every hour a day) from 2014Any alternatives ??
25
App for „good excuses“: Behind the scenes
© con terra GmbH
UBA Air Quality ozone (O3)[What we have done]> Request all AQD stations measuring ozone values
via REST Service and save all Stations with current O3 values as csv-file
> Prepare the station data with ArcMap: geo-referencing stations(point data) and convert to area data (Voronoj-Interpolation)
> Setting up an ArcGIS for Server map.service to identify nearest station (id)
> Setup FME Process:Request Request current Air Quality Data (Substance, Data_Type, Date & Time) via REST Service, parse the result and get current O3 value
> Classification of the results and definition of comprehensible answers
> Publish FME Process as FME Rest Service
26
App for „good excuses“: Behind the scenes
© con terra GmbH
DWD – Bio Weather> Request current Bio Weather via
INSPRE View Service and get the currentimpacts on hypertension, asthma, rheumatism(positive / no influence, low / high health hazard)
> Parse the result
> Classification of the results and definition of comprehensible answers
> Publish FME Process asFME Rest Service
27
App for „good excuses“: Behind the scenes
© con terra GmbH
UBA Pollutant Release and Transfer Register (PRTR)> Download PRTR Data as sqllite DB or
Esri Geodatabase
> Setup FME Process:Read the PRTR sqllite DB or Esri Geodabase and find PRTR industrial facilities within 10km
> Classification of the results and definition of comprehensible answers
> Publish FME Process as FME Rest Service
28
App for „good excuses“: Behind the scenes
© con terra GmbH
Linked map App> Polluting facilities CO2 und NO2 / NOx
– all over Europe
> Navigation by „Locate Me“ (current location),a special Location or industrial facility name
> Layer selection
> Legend
> „Feature Info“
Feel free to test it – enter the following link
29
App for „good excuses“: Behind the scenes
https://mapapps.de/sandbox/resources/apps/INSPIRE_Con/index.html?lang=en&preview=true
© con terra GmbH
Congratulations to the Team> Clara, Dennis, Kristina, Thore, Thomas, Marc
30
App for „good excuses“
https://mapapps.de/sandbox/resources/apps/INSPIRE_Con/index.html?lang=en&preview=true
© con terra GmbH
An educational game to study geography
Geo Quiz
© con terra GmbH
Team> 5 Code for Münster developers
> 1 con terra developer (web/mobile)
> 1 con terra FME expert
> 1 con terra project manager (SDI)
New idea for a game> The “click that hood“ game would have been too easy to implement
Geo Quiz: Team
© con terra GmbH
An educational game to study geography:> The player is prompted to locate a place on a map
> The distance to the correct location is calculated and displayed
> The player can play until the distance add up to 1000 km
Geo Quiz
© con terra GmbH
We needed „places“ for the players to locate INSPIRE Geographical NamesINSPIRE Geoportal: Search for „Geographische Namen“ (in German), filter “Origin“
Searching for Data: Geographical Names
WFS for Germany
© con terra GmbH
Suitable data from the BKG (Federal Agency for Cartography and Geodesy)
Searching for Data: Licensehttp://inspire-geoportal.ec.europa.eu/resources/INSPIRE-e70f8705-e89d-11e2-9634-52540004b857_20160909-114543/services/1/PullResults/2751-2800/datasets/36/
© con terra GmbH
Searching for Data: License
© con terra GmbH
…(GeoJSON)
Islands(GeoJSON)
Geographical Names: Point shape (250 MB) with features of different types (cities, airports, islands, …)
Input data and transformation using FME
Shape
Cities(GeoJSON)
http://sg.geodatenzentrum.de/web_download/gn/gn250/gk3/shape/gn250.gk3.shape.zip
© con terra GmbH
GeoJSON> format for encoding geographic data structures
> http://geojson.org/
> The data was transformed with FME Desktop
Leaflet> open-source JavaScript library for interactive maps
> https://github.com/Leaflet/Leaflet
Esri Leaflet> set of tools for using ArcGIS services with Leaflet
> https://esri.github.io/esri-leaflet/examples/
ArcGIS Basemap> freely available map services (we used World Imagery)
> http://services.arcgisonline.com/ArcGIS/rest/services/World_Imagery/MapServer
Geo Quiz: Technology
© con terra GmbH
Demo: http://codeformuenster.org/geo-quiz/Code: https://github.com/codeformuenster/geo-quiz
Geo Quiz: Results
© con terra GmbH
Lessons learned from the Hackathon
© con terra GmbH
The different approaches of the Hackathon teams led to impressive results> “Excuses“-team used powerful technology to create a complex solution
> “Geo Quiz“-team used Open Source Frameworks and no own serverside technology
INSPIRE data is useful even at a local level It was surprisingly time-consuming to find suitable data It was difficult to find current data (especially daily updated measurements) A lot of data is available, that possibly would not be available without INSPIRE INSPIRE data usually needs to be processed for further use Alternative data sources (REST, shape, …) seem easier to use than INSPIRE data We are keen on trying this on a European level
… maybe next year at the INSPIRE conference?
41
Conclusions
© con terra GmbH42
Participants’ suggestions for Use Cases
© con terra GmbH
Please work in groups 15 min. brainstorming for ideas for using INSPIRE data
3 min. presentation per group
Your idea could include:> Idea or problem statement
> A possible solution
> What data to use
> Skills needed to make it happen
43
Suggestions for Use Cases
…
…
…
© con terra GmbH44
Lessons learned and discussion
© con terra GmbH
Please visit us at Booth C2 in the Exhibition Hall.
Antje Kügeler and Thomas Wojaczekcon terraMartin-Luther-King-Weg 2448155 Muenster, Germanywww.conterra.de
45
Thank you for participating!