available data sources & real-time data collection

Available data sources&

Real-time data collectionJari Silander & Teemu Näykki & Sami Korhonen & Jari Koskiaho & Harri

Lauri Arvola & Timo Vesala, HY (10 min talk)Pekko Ilvessalo, FMI

Myllyniemi, SYKEMauno Rönkkö, UEFTimo Toivanen, VTTHanna Huitu, LUKE

Ympäristötiedosta palveluihin –seminaariVaisala 23.09.2015

MMEA Testbed (19.8.2010)

Content1. Available data sources

– Participatory sensing– Remote sensing– Automatic station– Forecasts

Use cases

2. Real time data collection– Sensors– Quality control– Data service

Use cases (real time data in use: data, usages,availabilitiy)

3. Conclusion

Available data sources

• Global http://index.okfn.org/• EU http://open-data.europa.eu/en/data/• USA https://www.data.gov/open-gov/• Worldbank http://data.worldbank.org/• Suomi www.avoindata.fi

Use case 1: In-situ data in action(MMEA with SYKE Rapa-project(YM), MMEA team effort

Available data sources

Use case: Hi, what is nutrientloading rigth now?

Real time data collection

Use case:Hello: What is nutrientloading now? – data system

Example Environmentof OData• What is Odata?• Why to use Odata?• What formats?• What resources are availble?• What was MMEA role in this?• How to use it?• What is the best practice?

Available data sources

AVOIN DATA ESIMERKKI SUOMESTA – MISTÄ APUA?Suomi www.avoindata.fi - Suomen ympäristökeskus

http://pivetodatademo.appspot.com/gv3/

2011 2013 2015

ROADMAP DIY-SENSORDISSERTATIONES CHIMICAE UNIVERSITATIS TARTUENSIS 140 TEEMU NÄYKKI Novel Tools forWater Quality Monitoring – From Field to Laboratory

QUALITY CONTROLDISSERTATIONES CHIMICAE UNIVERSITATIS TARTUENSIS 140 TEEMU NÄYKKI Novel Tools forWater Quality Monitoring – From Field to Laboratory

Use case 2:Lauri Arvola, HY

Available data sources

The catchment of Vanaja (2700 km2)Met stationAWQM stationHydr stationEDDY stationChemMon station

City ofHämeenlinna

Lammi BiologicalStation,Univ. of Helsinki

EMMI - System for Environmental MonitoringPowered by Masinotek Ltd

”Real time data collection”

• In-situ (automatic stations)• Satellite• Radar• Forecasts• Participatory sensing

Use case 3: Air Quality(Pekko Ilvessalo, FMI)

Available data sources

Use case 1: Air quality in Helsinki metropolitan areais worsened in the morning. Should people bewarned?

• Air quality observations from Helsinki monitoring stations (open data interface available in beta.fmi.fi:• http://beta.fmi.fi/wfs?request=getFeature&storedQuery_id=urban::observations::airquality::hourly::mu

ltipointcoverage&place=Helsinki)• are showing that nitrogen dioxide concentrations have been raised in the morning. (Observations

coming to open data October 2015).

• Observed temperature and wind profile from mast data in Espoo Kivenlahti available in open data• (http://data.fmi.fi/fmi-apikey/insert-your-apikey-

here/wfs?request=GetFeature&storedquery_id=fmi::observations::weather::mast::multipointcoverage&place=Helsinki&parameters=TA,ws) are monitored in real-time every 10 minutes and atmosphericstability (Richardson number) is calculated.

• Atmosphere is at first very stabile and ground surface inversion seems to be the reason forweakened air quality. Next observations however show that inversion is weakening and air quality isexpected to get better. Warning won’t be given.

Real time data collection

ECMWF,ECHAM

HIRLAMRCR 0.068

HARMONIE0.022o

AROME,LAPS

Weather predictionmodels

Dispersion models -long-range, regional

Dispersion and effectsmodels – urban, local

FLUENT, CFD code

SILAM LRT,meso, radioactivity

Modelling system - FMI

OSPM (NERI), streetcanyon

UDM-FMI, urban

CAR-FMI, roadside

HILATARLRT, meso

Aerosol process models:UHMA (U Helsinki, FMI)

MONO32 (U Helsinki, Stadia)

MPP-FMI, Meteorologicalpre-processing model

ESCAPE, chemicalaccidents

BUOYANT, fires

EXPAND (FMI, YTV)population exposure

Meteorologicalmeasurements

Use case: Satellite data, MMEA-teamwork

Available data sources

Satellite Data Centre, developed e.g. underCleen/MMEA

SYKE will adapt its snow mapping method to new satellite sensors andwill operate the service via direct connection to the Satellite Data Centrecomputing facilities. The data delivery through Standard Data interfacecontinues, to enable different web&desktop GIS-applications.

OPEN DATA• OGC standards compliant interfaces• Web Coverage Service (WCS)• Web Map Service (WMS)• Data is browsable using APOLLO www-client• Metadata descriptions are made available through APOLLO

Today you can use uncertainty of snow maps (develop in MMEA)

S FSC , t =(FSC)

(FSC) S +(FSC)

t S +(FSC)

S

+(FSC)

S +(FSC)

S

• Web maps services induce the Private sector• For example, SYKE’s web map service was tested in piloting the

services of Spatineo Ltd.

21

Monitoring and quality-controlling of the Web map service utilizingthe standard data interfaces

CONCLUSIONSTo reduce implementation time and cost and increase product value/functionality

focus on open standardsuse more open source tools and SDKs

OKFN.ORG & AVOINDATA.FI

• OData interface first step towards global open source standards.• Satellite data interface chl-a -products etc. (WMS)• FMI open data interface makes it possible to monitor air urban quality in real-

time and estimate pollutant concentration levels in very near future.

FUTUREMONITOR2020 program (20 Me, Kärkihanke etc.) – has initiated over 20 project toenhance datas’ information value (Co: Kettunen, Development: Silander)

• one of them is the ENVIBASE –project (7,5 Me SYKE coordination) toincrease data interoperatbility & providen satellite products, e.g. “Sentinel” waterquality products in 2017 operationally

More information: http://www.syke.fi/hankkeet/monitor2020

CONCLUSIONSTo reduce implementation time and cost and increase product value/functionality

focus on open standardsuse more open source tools and SDKs

OKFN.ORG & AVOINDATA.FI

• OData interface first step towards global open source standards.• Satellite data interface chl-a -products etc. (WMS)• FMI open data interface makes it possible to monitor air urban quality in real-

time and estimate pollutant concentration levels in very near future.

FUTUREMONITOR2020 program (20 Me, Kärkihanke etc.) – has initiated over 20 project toenhance datas’ information value (Co: Kettunen, Development: Silander)

• one of them is the ENVIBASE –project (7,5 Me SYKE coordination) toincrease data interoperatbility & providen satellite products, e.g. “Sentinel” waterquality products in 2017 operationally

More information: http://www.syke.fi/hankkeet/monitor2020

TIEDON ARVO SYNTYY KÄYTÖSTÄ:LUOTETTAVAA INFORMAATIOTA JA PÄÄTÖKSIÄ 2020Ympäristötiedon tuotanto

Ympäristötiedon tuotannon tiekartta osoittaa seurannan kehittymisen suunnanlähitulevaisuudessa.

2015 2016 2017 2018 2020

Hyö

dynn

että

vän

tiedo

nm

äärä

kasv

aa

Yhteiset,läpinäkyvät &mitattavattavoitteet.- 20 % seurannankarsiminen

Maastotyön ulkoistaminen

Uusien toimintamallien kehittäminen1. Uudet menetelmät2. Toimintamallit

Velvoitetarkkailun uudistuu

Uusien toimintamallien juurruttaminen:1. Uusia menetelmiä testataan säännöllisesti2. Velvoitetarkkailu uusiutuu3. Seuranta sähköistyy

Tiedon yksikkökustannus pienenee ->Informaation vaikuttavuus kasvaa ->

Velvoitteiden keventäminen lait,asetutkset direktiivitEU-vaikuttaminen

Satelliittikeskus 2017vedenlaatutuotteitasisävesille

Data fuusio

Optimization

CHANGES IN FIELD WORK

23.9.2015 MONITOR202025

2020

2013

YRITYKSET

KANSALAISETJULKINENSEKTORI

KANSALAISET

Uudet toiminnotLABORATORIO

KENTTÄTYÖ

VARASTOINTI

KÄYTTÖALKU-KÄSITTELY