sentinel 2 image delivery platform - wordpress.com...sentinel 2 image delivery platform forest...

32
Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon, Jonathan Dash March 2017

Upload: others

Post on 10-Oct-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Sentinel 2 Image Delivery Platform

Forest Industry Informatics - SCION

Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon, Jonathan Dash

March 2017

Page 2: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Imagine

Page 3: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Currently not possible

National natural resource descriptions are inadequate

on a national scale:

• Frequently not spatial

• Of insufficient resolution

• Incomplete

• Out of date

• Difficult and expensive to acquire

This leads to poor decision making, inefficiency, lost

productivity and reduced profit.

Page 4: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

New technologies provide opportunities

New satellites Sentinel 2A (2015)

and 2B (2016 2017)

• European Space Agency

• Free access

• Multi-spectral with 13 bands

• Spatial resolution up to 10 m

• Covering NZ every 5 days

Page 5: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

New technologies provide opportunities

New satellites Sentinel 2A (2015)

and 2B (2016 2017)

• European Space Agency

• Free access

• Multi-spectral with 13 bands

• Spatial resolution up to 10 m

• Covering NZ every 5 days

BUT – There is no easy mechanism

to access, process, and store this

imagery.

Page 6: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Project details & Context

Page 7: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

This project: proof of concept

Objectives:

▪ Deliver imagery in an easy-to-use manner for forestry companies

and scientists

• Enable further processing and analysis

• Compatible with existing tools and workflow

▪ Gauge interest for future development

Technical information:

▪ Build with Python and GDAL (Geospatial Data

Abstraction Library) for pre-processing steps

▪ Cloud infrastructure: 2-3 servers on Amazon

AWS, S3 storage

▪ Use GeoServer WMS (Web Map Service) for

publishing

Page 8: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Automated data processing pipeline

1. Download

• Get imagery for NZ

• Only cloud free 0-40%

2. Pre-process

• 4 bands

Red, Green, Blue and NIR

• For every collection day

Reprojection and multi-bands mosaic

3. Publish (WMS)

• Daily mosaic (capture day)

With gaps

• Monthly most recent mosaic

No gaps

Not ready yet!

4. Analyze

• Apply cutover detection algorithm as a proof of concept

Page 9: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

The longer term vision

1. Data capture

Sentinel 2A and 2B

2. Pre-Processing

Automated download

Radiometric correction

Ortho correction

Cloud mask

Mosaicing

3. Storage and access

Cataloguing

Access

4. Processing

Classification

Texture

Spectral Indices

© esa

Page 10: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Potential derived products & users

Digital Surface and

Terrain model

NDVI

Natural forests

Exotic forests

Yields, age, species

classification

Change detection

• Local and central

government

• Forest owners

(large and small)

• Consultants

• Wood processors

• Log buyers

• Iwi

• Researchers

Page 11: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Web Map Service

Page 12: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Server hosting

▪ High bandwidth cloud server on Amazon Web

Service (EC2)

▪ Layers storage on Amazon Web Service (S3)

▪ GeoServer Web Mapping Service

• Open source, standard

Page 13: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Easy access

Page 14: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Example

Page 15: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Example

Page 16: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Land classification & cutover detection

Page 17: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Datasets

▪ Sentinel 2 imagery

▪ Central North Island

▪ 3 dates:

• Nov. 2016

• Dec. 2016

• Feb. 2017

▪ 4 bands at 10m resolution:

• Red, Blue, Green

• Near Infra-Red

Page 18: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Datasets

▪ Sentinel 2 imagery

▪ Central North Island

▪ 3 dates:

• Nov. 2016

• Dec. 2016

• Feb. 2017

▪ 4 bands at 10m resolution:

• Red, Blue, Green

• Near Infra-Red

▪ 2 study sites

Page 19: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Step 1: Machine learning training

▪ Python code

▪ Supervised machine

learning

▪ Random forest classifier

▪ 5 classes:

• Clouds

• Grassland/Farmland

• Harvested area

• Forested area:

young tree

• Forested area:

mature tree

Page 20: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Step 2: Machine learning classification

▪ November 2016

Page 21: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Step 2: Machine learning classification

▪ November 2016

Page 22: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Step 2: Machine learning classification

▪ December 2016

Page 23: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Step 2: Machine learning classification

▪ February 2017

Page 24: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Step 3: study sites

Page 25: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Step 3: study sites

Page 26: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Cutover detection application, validation

▪ Accuracy validation

• Manual definition of

validation subset (see

polygons on the right)

• Manual classes

assignment

• 98% accuracy for this

subset

Page 27: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Cutover detection application

▪ Band importance for the classification

• Band 1 (Red) importance: 31%

• Band 3 (Blue) importance: 24%

• Band 4 (NIR) importance: 22%

• Band 2 (Green) importance: 21%

▪ Successfully classify 5 classes on a small dataset

• Clouds

• Grassland/Farmland

• Harvested area

• Forested area: young tree

• Forested area: mature tree

Page 28: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Conclusion and next steps

Page 29: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Current status

▪ Operational prototype system

• Automatic pre-processing and storage

• Daily mosaic of cloud free New Zealand (sensing day)

− Between 0 and 40% cloud coverage

− Bands: Red, Green, Blue and NIR at 10m resolution

− Gaps for cloudy area

• Monthly up to date mosaic (not ready yet!)

− No gaps: most recent images used

• Hosted on Amazon Web Service using GeoServer

• Published via Web Map Service (standard service)

− Easily accessible via ArcGIS, QGIS and other GIS software

Page 30: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Future work

▪ Internal use for current and future research work, potentially new

product development

▪ Potentially further develop cutover detection algorithm

▪ Seeking feedback from industry on:

• Level of interest – who would access it?

• What products are of interest?

• Pathway to support ongoing access?

Page 31: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

Acknowledgements

▪ Michael Watt, Bryan Graham:

approval and funding

▪ Jonathan Dash, Grant

Pearse: idea and active

participation

▪ Andrew Gordon, Ralf

Gommers: technical inputs

Page 32: Sentinel 2 Image Delivery Platform - WordPress.com...Sentinel 2 Image Delivery Platform Forest Industry Informatics - SCION Sam Damesin, Grant Pearse, Ralf Gommers, Andrew Gordon,

www.scionresearch.com

Scion is the trading name of the New Zealand Forest Research Institute Limited

Prosperity from trees Mai i te ngahere oranga