Image Management and Dissemination

Peter Becker

OUTLINE

• Requirements• Intro to Mosaic Datasets• Workflows & Demo• Dynamic Mosaicking, On-the-fly processing• Properties• Differentiator Raster Catalog, ISDef, Mosaic Datasets• Summary• Questions

ImageryImagery

Field UsersField Users

GeoreferencedGeoreferencedContentContent

Knowledge BaseKnowledge Base

++ Sensor NetworksSensor Networks

Base MapsBase Maps& Globes& Globes

AnalystsAnalysts

Data ManagersData Managers

Decision MakersDecision Makers

•• Geospatial workflowsGeospatial workflows•• Actionable information & knowledgeActionable information & knowledge

GISGIS

Geospatial Information, Integrated & AccessibleGeospatial Information, Integrated & Accessible

Imagery is Core to GISImagery is Core to GIS

CloudCloud

EnterpriseEnterprise

LocalLocal

•• ManageManage•• VisualizeVisualize•• AnalyzeAnalyze•• DisseminateDisseminate

––DiscoverDiscover––CollaborateCollaborate

WebWeb

MobileMobile

DesktopDesktop

ArcGIS 10 A Complete System for Geographic Knowledge

Transforming GISTransforming GIS

Manage, Disseminate, Visualize, Analyze

• ArcGIS enables you to:

Manage, Disseminate, Visualize and Analyze

all forms of imagery

• Platform for complete Imagery Solutions

• Mosaic Datasets are the optimum model of managing and serving imagery and rasters

• Maximizing the Value of Imagery

Imagery is Core to GIS

Trends in ImageryTrends in ImageryEntering the Platinum Age of ImageryEntering the Platinum Age of Imagery

AccuracyAccuracy

20122012

20092009

20052005

CurrencyCurrencyCurrentCurrent

2424

66

1212

1818

20092009

2424

1212

2424

1212

20152015

AnyAny

DayDay

EOEO AGIAGI

SensorSensorAnyAny

DayDay

SpaceSpace••AirAir

••GroundGround••SpaceSpace

••InternetInternet

PlatformPlatform

VarietyVariety

00

2020

4040

6060

20052005 20092009 2015201500

2020

4040

20052005 20092009 20152015

AnyAny

DayDay

VolumeVolume

00

2020

4040

6060

8080

100100

120120

20052005 20092009 20152015

Amount of imagery storedAmount of imagery stored

Improved positional accuracy and pixel resolutionImproved positional accuracy and pixel resolutionDemand for current dataDemand for current data

6

x

x

x

ArcGIS – Maximizing the Value of Imagery

• Providing Image Accessibility:- Timely- Quickly- Accurately- Collectively- Simply

• Exploiting Rich Information Content:- Resolution- Temporal change- Spectral range- Dynamic range

Three Differentiators of Imagery

•• Volume:Volume:-- Magnitudes larger then other dataMagnitudes larger then other data

•• Value:Value:-- High operational valueHigh operational value-- High strategic valueHigh strategic value

•• Fixed:Fixed:-- A snapshot in timeA snapshot in time

$$

timetimeOperational Strategic

• Direct Access- Raster- Mosaic Dataset

Image AccessibilityTo Multiple Applications

• Direct Access- Raster- Mosaic Dataset

• Static Web Services- Map Cache- Compact Cache- JPGPNG

Image Accessibility

ArcGIS provides image accessibilityArcGIS provides image accessibility

CacheTiles

To Multiple Applications

Pre-Process

• Direct Access- Raster- Mosaic Dataset

• Static Web Services- Map Cache- Compact Cache- JPGPNG

• Dynamic Image Services- Server based processing- Image Services, WMS, WCS, KML- SOAP, REST interfaces

Image Accessibility

ArcGIS provides image accessibilityArcGIS provides image accessibility

CacheTiles

Image Service

To Multiple Applications

Pre-Process

Wide Variety of Imagery

•• Multiple SourcesMultiple Sources-- Satellites, Aerial ,Terrestrial, ScanningSatellites, Aerial ,Terrestrial, Scanning

•• Multiple FormsMultiple Forms-- Ortho Images TilesOrtho Images Tiles

-- Image StripsImage Strips

-- Processed RastersProcessed Rasters-- Elevation models / LidarElevation models / Lidar

-- Analysis resultsAnalysis results

-- Thematic mapsThematic maps

-- ScenesScenes

-- Sensor ImagesSensor Images

•• Multiple FormatsMultiple Formats-- TIF, NITF, JP2,TIF, NITF, JP2,……

Procured as Procured as BackgroundBackground

Acquired forAcquired forAnalysisAnalysis

Management and Dissemination Requirements

• Imagery as Background• Imagery for Analysis• Catalog• Define processing• Provide Accessibility

- Direct Access- Serve- Cache ?

• Importance of time, temporal• Simple Workflows

Mosaic DatasetMosaic Dataset

• Within ArcGIS Desktop• Quickly Catalog

- All raster datasets- Imagery from different sensors

• Define – In Geodatabase- Metadata- Processing to be applied- Default viewing rules

• Access – In all ArcGIS applications- As Image

- Dynamic Mosaic , Processed on the fly

- As Catalog- Footprints, Detailed metadata

Optimum Model for Image Data Management

Workflow overview

Workflow overview

Workflow overview

Workflow overview

Image Service

Workflow overview

Image Service

+

Workflow overview

Image Service

+Reference MD

Workflow overview

CacheTiles

Image Service

Cache?

+Reference MD

Creating a Mosaic Dataset

• GDB, Personal or Enterprise Geodatabase

• Name• Coordinate System

- For management and overviews- Web Mercator ?

• Bands, Pixel Type – Data will internally be converted to this

Mosaic Dataset in ArcMap

• Visible as Group Layer- Boundary – Extent of Mosaic Dataset- Footprints – Extent of raster + Attributes

(inc Raster & Function)- Image – Processed and mosaicked image- Seamline – Extents used for Seamline mosaic method

Mosaic Dataset – Properties and Tools

• Properties- Properties of Mosaic Dataset

• Tools- Data Management, Mosaic Dataset- Data Management, Raster Catalog

Demo – Simple workflow

Image Preparation / Pre-Processing

• Generally not required• Conversion – Optimization of some formats

- ASCII DEM- Large non tiled rasters- Compression (Lossy or Lossless)

• Pyramids – Reduced Resolution Datasets- When NCols >5000

• Stats – Enable automated enhancement- For non enhanced imagery

• Consider also as a post process. Create service quickly, then replace

Raster Types

• Raster Dataset- For common rasters

• Sensor Specific- Loads Product specific Metadata

and defines processing- Often combine multiple rasters

(PanSharpening)

• Table- More advanced workflows

(Catalogs, RPDefs, Derived MD)

• Templates- Store setting for future use

• Custom- Automate ingest of other imagery

and rasters

Overviews

• Provide fast small scale access• Similar to Cache for small scale• Optional

- Often better to use other imagery

• Define Overview• Build Overview

Cell/Pixel Sizes

• Define usable sizes of cells• Attributes of Footprint Table• LoPS, HiPS

- Range of cells size for the raster- Set when rasters added

• MinPS,MaxPS- Range to display rasters- Set when added or Compute Cell size

• Direct relation to scale: Scale=PixelSize * 96 / 0.0254• Compute Cell Size tool – Computed MinPS,MaxPS

based on imagery overlap• Optionally used Table Calculate

Properties, Metadata and Attributes

• Raster Properties- For each raster

• Raster Metadata- Directly from Raster Dataset- Sstored with Raster- Available using identify

• Table Attributes- From raster type- Added by Author- For query & ordering / sorting

Dynamic Mosaicking

• Order of imagery is changed as required• Imagery clipped by Footprint• Mosaic Methods

- None – Order of records, for tiled images- Nearest Center – Image Center closest to screen center- By Attribute – Order based on attribute. Eg SunAngle- ViewPoints– Order based on location of sensor- Most Northwest – Fixed- Lock Raster – Defined list- Seamline – Sorder + Seamline polygons

• Query Definition – Any SQL statement• Mosaic Dataset Property define default• End User can refine

t1t1t2t2

t3t3t4t4t5t5

On-The-Fly Processing

• Process image as accessed• Stretch, Extract Bands

• Clip, Mask

• Reproject,

• Orthorectify

• Pan Sharpen

• Vegetation Index, Classify

• Shaded Relief, Slope, Aspect

• Color Correction

• …

QuickBird Scenes Tehran, Iran

Credit: Imagery Courtesy of Digital Globe & MDA FederalCredit: Imagery Courtesy of Digital Globe & MDA Federal

Color Corrected

Color Correction onColor Correction on--thethe--fly fly Without Color Correction

No Data and Clipping Footprints

• Exclude non required pixels• Clip out non required pixels

- Legends borders, clouds, sea,…

• NoData- Specific data values (eg -999)- No Data Mask- Define valid pixel range

• Clip by footprints- All rasters clipped by footprints- Build Footprints- Manually Edit- Define

Mosaic Dataset Properties

• Compression for transmission• Mosaic Methods• MaxRows/Cols• Time• Stats• …

Updating thousands of images in minutes.

Credit: Imagery Courtesy of GeoEyeCredit: Imagery Courtesy of GeoEye

Synchronizing & Update

• Syncrhonize- Update Mosaic Dataset when source changes- Updates overviews

• Use Model Builder

Updating thousands of image in minutes

Demo – More Advanced Workflow

Reference and Derived Mosaic Datasets

• Reference Mosaic Dataset- Create different services using same base mosaic

datasets- Globally add functions – Eg HillShade or NDVI- Define Queries – Refine accessible rasters- Refine boundary – Exclude Areas- Change properties – Allowed mosaic methods,…

• Derived Mosaic Datasets- Replicates records- Add raster functions- Uses Table Raster Type- Synchronize with source

Customizing

• Model Builder – Automate using standard tools• Raster Types – Custom to automated image product

creation• XForms – Image To Ground transform. Eg Sensor

models• Functions – Pixel based processes• ArcObjects – Advanced

Changing Workflows for Linear to Transactional

• Conventional Image Processing Workflows are Linear- Multiple processes create intermediate results- Products created as static mosaic

• Mosaic Datasets Enable Transactional Workflows- Processes applied on demand- Products created on demand

Imagery Dynamically Processed and Served

BenefitsBenefits•• Simpler access Simpler access •• Image IntegrationImage Integration•• Fast VisualizationFast Visualization•• Lowers CostLowers Cost•• Dynamic AnalysisDynamic Analysis

• Image Libraries

• Image Services

StandardStandardClientsClients

Mosaics DatasetsMosaics Datasets

ArcGIS ArcGIS Server

Using Image Server Technology

Shorten the time from sensor to use

Differences to Raster Catalog, Image Server

Publishing Image Services

• Dynamic Imagery Service• Client make request : Server processes as required• Image Services – Core to ArcGIS Server

- Single Raster – Single Service- Compression for transmission – Low bandwidth networks- Functions (as LYR or user definable)- Export

• Image Extension – Extends Image Services- Mosaic Dataset – Large Collections with OTF processing- Mosaic Rules- Query- Catalog & raster Metadata- Download (with clipping)

Using Image Services

• ArcGIS Desktop• ArcGIS Explorer• Web

- APIs- WMS,WCS,KML

• Mobile (via map document)• 3rd Party – AutoCAD, Microstation (promoting use of

WMS)

GeoProcessing

• Directly use in ArcGIS tools• Use in Models

- MakeImageServer Layer – Set Max Rows/Cols very large- Resample- Download

ArcGIS – A Platform for Complete Imagery Solutions

•• ESRI works closely with its partnersESRI works closely with its partners

•• ArcGIS provides THE platformArcGIS provides THE platform

•• Partners provide domain expertisePartners provide domain expertise

•• Automated Feature ExtractionAutomated Feature Extraction•• Multispectral AnalysisMultispectral Analysis•• Hyperspectral AnalysisHyperspectral Analysis•• RadarRadar•• Specialized Sensor SupportSpecialized Sensor Support•• Stereo DisplayStereo Display•• ……

Trimble (Applanix)Trimble (Applanix)Microsoft (Vexcel)Microsoft (Vexcel)DigitalGlobeDigitalGlobePictometryPictometryRapidEyeRapidEyeGeoEyeGeoEyeSPOTSPOT

PCI GeomaticsPCI GeomaticsTrimble (Inpho)Trimble (Inpho)

LizardTechLizardTechii--cubedcubed

MDAMDA

DAT/EMDAT/EMPurVIEWPurVIEWTerraGoTerraGo

QcoherentQcoherent

ITT VISITT VISDefiniensDefiniensClark LabsClark LabsOverwatchOverwatchBAE SystemsBAE Systems

Service partners not listedService partners not listed

Information Centric Workflows Enable Efficiency & Interoperability

Summary

• Mosaic Dataset - Optimum scalable model for Image Data Management

• Image Services – Serve to large numbers of users• Dynamic Mosaicking and On-The-Fly Processing

- Reduces time to make image accessible- Remove a lot of pre-processing

• Image Extension- Extends Image Services to serve Mosaic Datasets

Please Fill Out Evaluation Forms Your comments help us meet your conference needs each year.

Reminder: National Museum of Natural History - Tonight- Buses start loading at 6:00pm at L:street entrance- Rotate till 9:30pm

Thank you…

Any Questions?