OSGEO.Wageningen

Pitch Slides - first OSGEO.Wageningen meeting - nov 2013

Slides of 5 minute pitches by

GeoCatProigia

Isric (3*)Alterra

JustObjects

GeoCat BV

Paul van Genuchten

Overview

• Small Software development firm from Bennekom (employees in Nice, Valencia, Seville)

• Founder/Main Contributer GeoNetwork-OpenSource.org

• Related SDI-services

• GeoCat bridge

• OpenGeoSuite

• OpenLayers/GeoExt development

• Metadata catalog

• Search Interface (CSW)

• Pluggable national profiles/schemes

• Edit interface (workflow/versioning)

• Harvesting (CSW,OWS,ArcSDE,Filesystem)

Geonetwork-opensource.org

GeoCat Bridge

Desktop ArcInfo/ArcView

GeoServer or MapServer

GeoNetwork

OWSContext / OpenLayers

PostGis

Bolsena Code Sprint

• Each summer hacking event in Bolsena (near Rome)

• (european) Communities meet up:

• Geonetwork • deegree • Grass• Mapbender • Mapproxy• Flamingo

• Open Source Spatial developers welcome to join

Visit us at http://geocat.net

Dolf Andringa

Wat

•Management informatie voor huisartsen

•Begonnen in 2005 met pilot webgis

•Sinds 2011 GIS weer belangrijk

•Proigia GIS

Proigia GIS

Proigia GIS

DataData

DataProvider

DataProvider

UserUserClick

“maps”

Redirect to webgis

Send data

Proigia GIS

Technieken

•OpenLayers

•Postgis

•Geoserver

•GeoExt

•Pylons (Mapfish)

•Apache, Linux

Open data

• Open Streetmap• CBS• BAG

Mister Jesus Versus OSGeo(personal story)

Jorge Samuel Mendes de Jesus

~$>whoami

34 years old Caucasian male, Portuguese

Ph.D. Obtained in Ben-Gurion University. IsraelBasic studies in Geostatistcs, Agriculture and Remote sensing

Licenciatura (Master) in Agricultural Engineering. Uni do Algarve “Trust me I'm an Engineer ...the irrigation system will work”

 

~$> ls -l -t -r

1st Job: INTAMAP project, doing web services (JRC-Ispra)

2nd Job: EuroGEOSS project, more web services and spatial database with biodiversity (JRC-Ispra)

3rd Job: Plymouth Marine Laboratory, even more web services and openLayers !!!! Long live pyWPS !!!!

3rd Job: Plymouth Marine Laboratory, even more web services and openLayers !!!! Long live pyWPS !!!! Lets deal with WSDL

 

~$> man pywps & man taverna

PyWPS –> Python implementation of WPS 1.0.0 (Web Processing Service)http://pywps.wald.intevation.org/http://wiki.rsg.pml.ac.uk/pywps/Main_Page

Personal objectives: better interoperability between WPS and WSDL

 

~$> man pywps & man taverna

http://www.taverna.org.uk/

 

~$> man pywps & man taverna

 

~$> at now

http://www.isric.org

WOSIS DB – 36481 soil profile records

~$> at now + 365 days

Extended WOSIS functionality, public access data

Web Services Wrappers for Database

Support for platforms/websites (world soild profiles)

Support for geonetworks

More and better data and of course lots of spatial queries

Use of OSGeo Software to address functionalities for ISRIC World Soil Information

HI Reuter

Material from: T Hengl G Heuvelink NH Batjes J Leenaars P Tempel P Bindraban

myself

• Geo-ecology in Potsdam (DE)• University of Guelph (CA)• PhD in Precision Ag @ ZALF Müncheberg (DE)• Joint Research Center (IT) (ESBN)

• ISRIC World Soil Information (NL)

Food security

Climate change

Biofuels

Water scarcity

Meat production

Land valuation

….

Policy domain

DATA ENTRY by• ISRIC Personnel• WWW• In Field

Quality A & C (WPS)

Harmonization (WPS)

Methods and infrastructure

ISRIC enterprise database

GlobalSoilMap.net properties

Avail. Water Content

SOC

P (?)

(…)

Web Processing Services

Fertilization strategy

Water mngt

C sequestration

Soil productivity

Soil degradation

Soil data & information

User interaction and agenda setting

Linking ISRIC soil information to policy

SC:Reuter&Bindraban, 2011

www.isric.org

Global Soil Information Facilities

ISRIC – Data Discovery What kind of data holds ISRIC ? e.g. Scanned Maps, GIS datasets & Reports

OGC conforming MetaDataService http://meta.isric.org

Geoserver/Mapserver

ISRIC – Data VisualizationHow to visualize Data ? Goggle Earth / GIS / WEB 2.0

OGC conforming WMS/WFS

OpenLayers (WWW)

QGIS/ArcGIS

Google Earth

SC:Hannes I.Reuter, 2011

Web service for point data entry

The web service for soil profile data entry is a facility for the collection of soil profile information. Users can enter individual profile observations as well as large datasets consisting of hundreds or thousands of profiles.

http://worldsoilprofiles.org/

Overview

http://worldsoilprofiles.org/

ISRIC – Data Processing What kind of soil/ soil property do we find at any location in the world?

http://wps.isric.eu/pywps/pywps.cgi?service=wps&version=1.0.0&request=Execute&identifier=sampler_hir&datainputs=InGMLdata=http://isric.eu/wps/testdata/random_points.gml;inRastername=http://isric.eu/testdata/elev_srtm_30m.tif;pause=0&

OGC conforming web processing serviceSC:Hannes I.Reuter, 2011

Soil mapsSoil maps Soil samplesSoil samples

Reports, literatureReports, literature Soil data and informationSoil data and information

Slide Credit: A.Hartemink

Think globally – Act locally

We can do this – through collaboration and sharing of information

Database storage and control

• Database developed and externally reviewed

• Binary Schema, Data Transformation and Standardisation Schema, UUID-generation introduced, tested in production

• AfSPD loaded, AfSIS sentinel sites next

Facilitating Soil Map Production - DSM any arbitrary soil map production process - which uses auxiliary information

SC:Reuter, Lennars, Inakwu 2011

www.globalsoilmap.net

Functionality to access

• querying for a single value from a defined covariate map (sample)

– http://wps.worldgrids.org/pywps.cgi?service=wps&version=1.0.0&request=execute&identifier=sampler_local1pt_nogml&datainputs=[x=11.3;y=12.1;inRastername=biocl15]

• querying for millions of values from a defined covariate map

• extraction of a defined subset from a defined covariate map (subset)

– http://wps.worldgrids.org/pywps.cgi?service=wps&version=1.0.0&request=execute&identifier=subset&datainputs=[bbox=25,25,40,40;inRastername=biocl15]&responsedocument=OutData=@asreference=true

• creating of an overlay of a user specified zone grid and a defined covariate map (zonalstats).

– http://wps.worldgrids.org/pywps.cgi?service=wps&version=1.0.0&request=execute&identifier=overlay&datainputs=[inRastername=globedem;inZone=http://ftp.isric.org/short/ztest.tif;stype=sd]&responsedocument=OutData=@asreference=true

Alterra CGI

Bas Vanmeulebrouk

ETS Manager

Geoportaal Bibliotheek Wageningen UR

Taming Rich GMLwith sETL

Just van den Broecke5 minute presentation at OSGeo.nl Stammtisch Wageningen

November 7, 2012

We have a Problem

The Rich GML Problem

Rich GML = Complex Mess

INSPIREBAGBGT

Top10NL.

The The Streetname!Streetname!

Complex Model

Transformations

Millionsof

Objects

10s of Millionsof

<Elements>

MultipleTransformation

Steps

Solution is Spatial ETL

A.K.A.

Thank You for your

Attention!

But.......FOSS (s)ETL...?

FOSS ETL - High Level

FOSS ETL - Lower Level

But Each Powerful by Itself

ogr2ogr

FOSS ETL - DYI ? (No!)

FOSS ETL - How to Combine?

=+ + ?ogr2ogr

FOSS ETL - Add Python to Equation

=+ + ?( )ogr2ogr

=+ +

sETL

( )ogr2ogr

sETL=

SimpleStreaming

SpatialSpeedy

ETL

Process Chain

InpuInputt

FilterFilter OutpOutpututgmlgml

FilterFilter

Speed: Streaming

InputInput FilterFilter OutpuOutputt

gmlgml

Speed: Going Native

InputInput FilterFilter OutpuOutputt

gmlgml

ogr2ogr sETsETLL

sETLsETL

Native C Native C Libs/ProgsLibs/Progs

Calls

Example: GML to PostGIS

ReadeReaderr

XMLXMLSplitteSplitte

rr

ogr2oogr2ogrgr

gmlgml

Example: INSPIRE Model Transform

ogr2oogr2ogrgr XSLTXSLT WriterWriter

gmlgml

Example: deegree Store

ogr2oogr2ogrgr XSLTXSLT

deegrdeegreeWrieeWri

terter

Process Chain - How?

InputInput FiltersFilters OutpuOutputt

Example: XML to Shape

The Source

Example: XML to Shape

First: XSLT Transform to GML

Example: XML to Shape

XMLXMLInputInput XSLTXSLT ogr2oogr2o

grgr

Example: XML to Shape

The SETL Chain Config File

ProcessProcessChainChain

ReadeReaderr

XSLTXSLT

ogr2oogr2ogrgr

Thank You !

github.com/justb4/setl

Thank you for visiting

OSGEO.WageningenIsric, Alterra, Wageningen University, Proigia,

Nieuwland, Gima, GeoSpace, JustObjects, OpenGeoGroep, GeoCat, Water Insight, Geodan

Dealing with

Geonetwork, Geoserver, OpenLayers, pyWPS, GeoExt, PostGis, R, sETL, OGR, deegree,

Mapfish, Taverna

CU Next time