on-line monitoring of harvesting operations using ... · sentinel 2 optic data •due to optic data...

18
www.bitcomp.com ON-LINE MONITORING OF HARVESTING OPERATIONS USING SATELLITE DATA AND AI FOREST & PHOTONICS 8.10.2019 Sanna Härkönen, Bitcomp Oy

Upload: others

Post on 10-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.com

ON-LINE MONITORING OF HARVESTING OPERATIONS USING SATELLITE DATA AND AI

FOREST & PHOTONICS 8.10.2019

Sanna Härkönen, Bitcomp Oy

Page 2: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

ABOUT USWe are experts in GIS based web and mobile

solutions with over 20 years experience on

natural resources business sector.

UNIQUE EXPERTISE IN BIOECONOMY

SECTORWe combine AI, satellite data and modern

cloud solutions for creating targeted services

for accelerating business potential in forestry,

agriculture and insurance sectors.

BITCOMP OY

Offices in Jyväskylä, Joensuu, Seinäjoki and Vimpeli

Subsidiaries in Poznan, Poland and Munchen,

Germany.

Turnover

3 milj euroEmployees

>50

WIDE INTERNATIONAL NETWORKSWe have subsidiaries in Poland and Germany.

We have ongoing ESA project related to

satellite monitoring services with close

collaboration with organizations in Central

Europe.

Page 3: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

EXAMPLES OF BITCOMP CUSTOMERS

Page 4: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

EXAMPLES OF BITCOMP SERVICES

APPS COMBINING OPEN FOREST DATA, MAPS AND ENRICHENED GIS DATA• Web and mobile apps for targeted customer segments. For

example WoodsApp for wood procurement companies.

SATELLITE-BASED MONITORING SERVICES• Change detection of cuttings• Estimation of storm damages for forestry• Vegetation mapping for agriculture• Based on combination of satellite images/other remote

sensing data, machine learning and field reference data as training data.

ERP APPLICATIONS• TornaApps for Tornator Oy, ForestKit for work

management of forestry organizations etc.

Page 5: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

01 02 03

ENVINAVIGATOR PROJECTFUNDED BY EUROPEAN SPACE AGENCY

What: Business development project (feasibility study) funded started in winter 2019.

Main focus: services combining satellite images and other data sources with machine learning/AI for change detection of e.g. forests

Participants: organizations from forestry and insurance sector in Finland and Germany

Page 6: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.com

Demand:Need for minimizing expensive field work and for getting quickly updated data on changes and possible damages in forests

ENVINAVIGATOR: SERVICES FOR MONITORING CHANGES IN FORESTS

BASED ON SATELLITE IMAGES

Outcomes:Changed areas as maps enriched with customer-tailored data

Solution:Satellite-data based detection of changes in forest status:• Cuttings

• Storm damages

• Insect damages

Page 7: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

BITCOMP SERVICE FOR MONITORING HARVESTING OPERATIONS BASED ON SATELLITE DATA

• Service is used byFinnish Forest Centre for legislation monitoring

• In production since 6/2019

Page 8: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

AUTOMATIC MONITORING OF FOREST OPERATIONS -BACKGROUND

• Forest owner must always fill a notification of forest use before commercial logging

• Finnish Forest Centre monitors, that the actual cuttings are in line with the given notificationsto prevent illegal loggings of e.g. important habitats

• Due to automatic monitoring service, authorities can directly focus their resources on the target areas where violations have been detected

Page 9: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

CHANGE DETECTION SERVICE IN NUTSHELL

• Service detects changes caused by thinnings and final cuttings

• Covers whole Finland

• Uses Sentinel 2 optic images - comparison of time series

Page 10: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

CHANGE DETECTION SERVICE -USE OF ARTIFICIAL INTELLIGENCE

• Machine learning is applied for estimating the status of changed areas• Harvesting type and cutting intensity

• Training data for the models: field reference data + satellite image features

• Implemented as cloud service, allows parallel processing in short time span

Page 11: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

CHANGE DETECTION BASED ON SENTINEL 2 OPTIC DATA

• Due to optic data change detection can be done only for cloud-free areas

• Detection with 10 x 10 m resolution

• Images per scene (100 x 100 km) available with ~ 1 week interval.

• Cloudy/rainy climate is usual in Finland → fully cloudfree images are available rarely (might be only couple of times per summer) → using only images with low cloud percentage + applying cloud masking, detection only for cloud-free areas

• Detections can be run reliably only in summer time

Full scene usable Partly usable, cloud percentage ~10 %

Not usable, cloud percentage ~45%

Page 12: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.com

Outputs:

• Geometries of detected cuttings

• Estimated operation type (thinning/cutting)

• Estimated remaining basal area

• Period when the change has happened

CHANGE DETECTION SERVICE – EXAMPLE OUTCOMES

Page 13: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.com

Aerial image after cut

Forest use declaration

Cut area detected by automatic change detection service

Page 14: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.com

• Clear-cuts are detected well, also the intense thinnings get detected

• Low intensity thinnings are more challenging to detect

• Even though detection process is run weekly in summer time, the detection results for certain area are not available with same interval due to poor availability of cloudfree images

CHANGE DETECTION SERVICE CONCLUSIONS

Page 15: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.com

• Radar data (e.g. Sentinel 1)

• Analysis possible under differing weather/light conditions and also in winter time

• Analysis is trickier than with optic data

• Machine learning applied for estimating damage severity using field reference data + radar intensities as training material

• Examples:

• Detecting forest damages caused by storms/snow using radar data → Suitable for detecting large damages

• Detecting vegetation on agricultural land→ Good results achieved with time series data from whole growing season

E XAMPLES OF OTHER BITCOMP

PROJECTS USING RADAR SATELLITE

DATA & MACHINE LEARNING

Page 16: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

POSSIBILITIES OF AI & MACHINE LEARNING FROM BITCOMP POINT OF VIEW

01 Updating forest data using satellite monitoring +

creating thematic maps for applications e.g.

WoodsApp

02Combining open data to business-specific data

sources

For example open sample plot data + satellite features as training data for machine learning

Mobile observation data for

enrichening/evaluating forest data03

Page 17: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

FUTURE STEPS

• Satellite data is continuously getting available more frequently & with higher resolution→ Possibilities to use also commercial satellite data (e.g. Airbus, Iceye) into monitoring services

• Current change detection service (cuttings) running in production for whole Finland → Possibilities to extend to abroad

• Further services e.g. for detecting insect damages based on satellite monitoring

Page 18: ON-LINE MONITORING OF HARVESTING OPERATIONS USING ... · SENTINEL 2 OPTIC DATA •Due to optic data change detection can be done only for cloud-free areas •Detection with 10 x 10

www.bitcomp.comwww.bitcomp.com

THANK YOU!

Bitcomp web site: www.bitcomp.com