feature extraction from imagery & lidar - esri · large collections of stereo pairs •...

29
Feature Extraction from Imagery & Lidar Kurt Schwoppe, Esri Mark Romero, Esri Gregory Bacon, Fairfax County

Upload: others

Post on 28-Jun-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Feature Extraction from Imagery & LidarKurt Schwoppe, Esri

Mark Romero, Esri

Gregory Bacon, Fairfax County

Page 2: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Today’s SpeakersImage Processing Experts and Good Colleagues

Gregory Bacon

GIS Analyst III

Fairfax County

GISP

Mark Romero

Imagery Specialist

Esri

Kurt Schwoppe

Imagery Industry Lead

Esri

Page 3: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

I oT

The Science of WhereIntegrates Dynamic Data About Everything

Built Environment Natural Environment

Page 4: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Think Big - National Imagery Programs

ArcGIS Image Server

Page 5: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Think Small – Micro Geographies

Drone2Map

Page 6: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Aerial Photos

High-Resolution Satellites

Small Sats

All Major Sensors

Dynamic Image

Processing Server

Advanced Imagery

Workstation

Full-Motion Video

Classification

Change Analysis

Stereo View

Image Analysis

Image Space and

Mensuration

DTM

Generation Seamless

Orthophotos

Ortho Mapping

Drone Mapping

. . . New Image Analyst Extension

Drone2Map

It Leverages All Types of Remotely Sensed Data

Turning imagery into information

Page 7: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Imagery is Not an Addition to GIS - It is Part of One

Faster (10x+)

Power

Outages

(50+ Million)

Density

Imagery

Lidar:

Bare Earth

Hot Spots

Riparian AreasSpace-Time Cube

Lidar:

First Return

. . . Accessible from ArcGIS Pro and Python APILeveraging Distributed Computing and Parallel Processing

Image ServerLarge Imagery Collection

Raster AnalyticsFeature Analytics

GeoAnalytics ServerLarge Observation Collections

Page 8: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Built Upon an Enterprise Model

See the Earth, Find the Patterns, Share with Others

GIS

Professionals

Server

Modernizing

Imagery

ArcGIS Pro

Image Analyst

Extension

Image Server

Web App Builder

Imagery Services

(WABIS)

Page 9: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Enterprise

Server(s)

Image

Server(s)

GeoDataBases

(Mosaic Dataset)

Portal

Clients

2D & 3D• ArcGIS Pro

• Excalibur

• Web Maps

• Scenes

Desktop Web Device

Imagery

Specialist

ArcGIS Pro

Data

Store

Configured

for Raster

In Highly Scalable ConfigurationsModernizing

Imagery

Page 10: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

GIS Data

Oblique Imagery

Photogrammetry

The Science of Where is Multidimensional

Lidar

CAD/BIM

Delineating both 3D Space and Time

Page 11: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Image Server “Hyper Extends” Imagery in ProModernizing

Imagery

Raster Analytics

• Deploy to as many Servers as Needed

• Full Distributed Processing

• Elastic Pricing Model*

Infinite

Scalability

=

Page 12: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Imagery Bundles Support Implementation PatternsModernizing

Imagery

ArcGIS Pro 2.1 &

Image Analyst

Extension

Robust Image Processing

OrthoMapping and

Stereo

Image Management

Make massive

collections of imagery

accessible

Ortho Mapping

Accurate basemaps and

Elevation products

Image Analytics

Extracting Features &

Change Detection

Page 13: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

The Image Analyst Extension extends ArcGIS Pro with advanced tools and user experiences for Image Analysts who perform:

• Image interpretation and exploitation of imagery

• Creation of information products from imagery

• Advanced feature interpretation and measurements from imagery

• Detailed data capture and measurement on stereo imagery

• Advanced raster and image analysis workflows for machine learning and feature extraction

Improved UI & Display for Imagery

- View imagery undistorted, with vectors transformed to the image

- Image coordinate system based measurement

- Improved UX for oblique imagery

Mensuration

- Sensor model based measurements based on sensor orientation from high resolution satellite imagery and oblique aerial imagery

Raster Analytics

- Workflows and tools for image classification and machine learning

- All raster functions that currently require the SA extension, will be available through the Image Analyst extension

Stereo

- Stereo visualization and data capture capabilities, enabling detailed and accurate elevations and height measurements

Ortho Mapping Workflow & 3D

- Production level photogrammetry including triangulation, block bundle adjustments, DEM extraction, and ortho rectification

- Extraction of features from point cloud data

Image Analyst Extension for Pro 2.1Modernizing

Imagery

Page 14: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Image Centric ViewModernizing

Imagery

Improved UI:

• ELT Like

• Linked Views

• Ribbon(s) for Imagery

• Dedicated Workflows

Image Coordinate Space:

• Up is Up!

• Oblique Viewing

- Overlay feature layers

- Create and Edit feature layers

Page 15: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Precise MeasurementsModernizing

Imagery

Capabilities:

• Measure distance, area, centroid, azimuth – with georeferenced imagery

• Measure height – requires sensor model

• Measure height from shadow – requires sun angle

• Measure 3D objects

• Style and annotate measurements

• Track, store, and manage measurements

• Report generation for decision makers

Page 16: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Raster Analytics Feature ExtractionModernizing

Imagery

Page 17: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Raster Analytics for Land Cover Mapping

CBP Land Cover Classification

Barren

Impervious Roads

Impervious Surfaces

Low Vegetation

Shrubland

Structures

Tree Canopy

Tree Canopy over Impervious Roads

Tree Canopy over Impervious Surfaces

Tree Canopy over Structures

Water

Wetlands

Modernizing

Imagery

Page 18: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Step 1:

Call up an Image Service

Step 2:

Define your AOI

Step 3:

Run Classification

Wizard

Step 4:

Vectorize the results

Feature Extraction Workflow Modernizing

Imagery

Step 5:

Publish

Page 19: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Imagery Identifies Changes

It shows where we’ve been and the direction we are going

Raster Analytics for Change DetectionModernizing

Imagery

Page 20: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Capabilities:

• Works with aerial, satellite, and drone

imagery

• Leverages Mosaic Datasets to work with

large collections of stereo pairs

• Consistent Pro editing UX – familiar tools,

feature template support, etc.

• New cursor modes, and shapes

• Shutter glass, and anaglyph stereo viewing

Application:

• Accurate 3D Mapping

• Improved Image Analysis and Targeting

• 3D Modeling for Mission Rehearsal

Working with StereoModernizing

Imagery

Page 21: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Modernizing

ImageryProduction Ortho Mapping

Raw

Imagery

Source

Mosaic

Dataset

Refined

Bundled

Adjustment

Block

Bundle

Adjust

Ortho

DTM

Point

Cloud

Image

Server

Mobile

Apps

Computer

Added

Design

ArcGIS

DSM

Derived

Mosaic

Datasets

New

Web

UI

ArcGIS

Pro

Page 22: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Accurate and AuthoritativeModernizing

Imagery

Page 23: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Digital Surface

Model (DSM)

Orthomosaics

(.TIFF & .TPK)

NDVI Inspection Viewer

Annotate Images

Site Modeling

Scene Layer Package

(.SLPK)

Point Cloud (LAS)

(imagery derived)

3D GeoPDF

3D Mesh (.OBJ)

Base Mapping Inspect & Measure

3D Measure*

Volumetric

Contours

Ortho Mapping Information ProductsModernizing

Imagery

Page 24: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

DEM DSM ContoursHillshade Slope Aspect Hydro Solar Features

Working with LIDARModernizing

Imagery

Page 26: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Extend Imagery Capabilities to the WebModernizing

Imagery

Web App Builder for Imagery Services:

Page 27: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

ArcGIS ProFeature Extraction Demo

Mark Romero

Page 28: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

Gregory Bacon

Dissemination & Applications

Page 29: Feature Extraction from Imagery & Lidar - Esri · large collections of stereo pairs • Consistent Pro editing UX –familiar tools, feature template support, etc. • New cursor

The Science of

Where