NIC Sea Ice Mapping SystemNIC Sea Ice Mapping System

Archive

BrowserInterface

Distribution

Ingest Production

Ice AnalystApplication

DatabaseDatabase

Database

Kelly TaylorPaul Seymour

Satellite Imagery Processing and Satellite Imagery Processing and Analysis System (SIPAS)Analysis System (SIPAS)

Henrik Steen Anderson

IntroductionIntroductionSystem Development HistorySystem Development HistorySystem OverviewSystem Overview

Ingest and Ingest ProductionIngest and Ingest ProductionAncillary DataAncillary DataDatabaseDatabaseBrowser InterfaceBrowser InterfaceAnalyst ApplicationAnalyst ApplicationChart ProductionChart ProductionDisseminationDisseminationArchive and On-line Access Archive and On-line Access

Lessons LearnedLessons LearnedSummary       Summary       

Module From Virtual SIMS Architecture

Archive

BrowserInterface

Distribution

Ingest Production

Ice AnalystApplication

DatabaseDatabase

Database

Henrik Steen Anderson

SIPAS System HistorySIPAS System HistoryPaper Transitioned to Paper ReplicatedPaper Transitioned to Paper Replicated– GRASS, NSIPS, TerascanGRASS, NSIPS, Terascan

Public Systems – except Terascan: from Navy METOCPublic Systems – except Terascan: from Navy METOC

Transition to ESRI SoftwareTransition to ESRI SoftwareCARTERRACARTERRA– COTS but not so COTS: ESRI and Remote ViewCOTS but not so COTS: ESRI and Remote View

Too much custom coding – Vendor, not applications developer of Too much custom coding – Vendor, not applications developer of imagery analysis or GIS softwareimagery analysis or GIS software

SIPASSIPAS– Remote View, ESRI and ESRI Developed ScriptsRemote View, ESRI and ESRI Developed Scripts

COTS with interface developed by ESRI contractorCOTS with interface developed by ESRI contractorOngoing investment is to maintain ESRI custom scriptsOngoing investment is to maintain ESRI custom scripts

RISK: Un-funded or ESRI Will Not Support Us RISK: Un-funded or ESRI Will Not Support Us Mitigating Factor: There Are Lots of ESRI Programmers Mitigating Factor: There Are Lots of ESRI Programmers and the System Is Almost Entirely Standard ESRI and the System Is Almost Entirely Standard ESRI Applications     Applications     

SIPAS System OverviewSIPAS System Overview

HardwareHardware– Mixture of Solaris UNIX, Linux and Windows ServersMixture of Solaris UNIX, Linux and Windows Servers– Remote View and ESRI on PC’s with dual processorsRemote View and ESRI on PC’s with dual processors– Dual MonitorsDual Monitors– Laptop VersionLaptop Version

Workstations - Windows Operating System on PCsWorkstations - Windows Operating System on PCsCustom Ingest SoftwareCustom Ingest Software– Imagine and Terascan are availableImagine and Terascan are available

Sensor Systems’ Remote View Imagery Analysis Sensor Systems’ Remote View Imagery Analysis Application (COTS)Application (COTS)ESRI GIS SoftwareESRI GIS Software– ARCGIS, ARCMAP, SDE, IMSARCGIS, ARCMAP, SDE, IMS

DISSEMINATION BY ESRI       DISSEMINATION BY ESRI       

SIPAS –Phase I Data Ingest

ENVISAT(Under Development)

IngestIngestIce Analysts have no time to do custom ingestIce Analysts have no time to do custom ingestWhat Software? – Little In-house ExpertiseWhat Software? – Little In-house ExpertiseImagine, Terascan, Both Or Something Else?Imagine, Terascan, Both Or Something Else?Requirements: Modular And UpgradableRequirements: Modular And UpgradableSolution:Solution:– Custom Modules By ACT And Custom In-houseCustom Modules By ACT And Custom In-house– All Modules Planned to be Written By ACT SoonAll Modules Planned to be Written By ACT Soon– Still Retain ERDAS Imagine And Terascan License Still Retain ERDAS Imagine And Terascan License

Summary: Processing the 57 Gigs Per Day of Summary: Processing the 57 Gigs Per Day of Incoming Data To a Standard Format Used By Incoming Data To a Standard Format Used By Applications Was the Single Hardest Hurdle and Applications Was the Single Hardest Hurdle and We Are Not Over It YetWe Are Not Over It Yet              

Ancillary DataAncillary Data

Met, Ocean, Ice Model Fields into SIPASMet, Ocean, Ice Model Fields into SIPAS

Goal Is To Have the Data in the Same Goal Is To Have the Data in the Same Format as the Imagery and Spatial DataFormat as the Imagery and Spatial Data

Ongoing ProcessOngoing Process

Not Fully DocumentedNot Fully Documented

Point of Contact Point of Contact hannam@natice.noaa.govhannam@natice.noaa.gov

Satellite-Derived Ice MotionSatellite-Derived Ice Motion

PIPS 2.0 and 85Ghz SSM/IPIPS 2.0 and 85Ghz SSM/I

Scatterometer and Scatterometer and radiometer data radiometer data complement each other in complement each other in estimating ice motionestimating ice motion– Where radiometer has Where radiometer has

difficulties, scatterometer difficulties, scatterometer does well and visa versadoes well and visa versa

– Enables complete Enables complete coverage motion mapscoverage motion maps

Banks Island

Canada

PIPS

SSM/I

Weather Data into SIMSWeather Data into SIMS

Temperature and pressure contours created in ArcInfo from FNMOC gridded data. Shapefile can be used as a layer in

chart production.

•Data is received from FNMOC in GRIB, cut into N and S Hemispheres

•Registered in TeraScan and Sent to ArcInfo with a header•Re-projected to Polar Stereographic•Contours produced

*Automated process is command line driven

Weather Data Process

Sea Ice Thickness Data from Sea Ice Thickness Data from the Gerson Ice Modelthe Gerson Ice Model

Database and BrowsingDatabase and Browsing

ARCGIS GeodatabaseARCGIS Geodatabase

MSSQLSERVERMSSQLSERVER

Spatial Data Engine (SDE) Front EndSpatial Data Engine (SDE) Front End

ARCIMS To Produce MapsARCIMS To Produce Maps

RemoteView Has A Browser With Thumbnails RemoteView Has A Browser With Thumbnails

Draw a Box on a Map and Retrieve Available Draw a Box on a Map and Retrieve Available DataData

Analysis ModuleAnalysis Module

Sensor Systems’ Remote ViewSensor Systems’ Remote View

Improved By Vendor For UsImproved By Vendor For Us

Improvement Based On Our Improvement Based On Our RequirementsRequirements

Still COTS – Not A Custom PackageStill COTS – Not A Custom Package

File Formats Completely Compatible With File Formats Completely Compatible With ESRI GIS ApplicationsESRI GIS Applications

Remote View - Sensor SystemsRemote View - Sensor Systems

Remote View Pro - Version 2.4Remote View Pro - Version 2.4

Easily integrates with ARCViewEasily integrates with ARCView

Create, import, display and edit vector Create, import, display and edit vector overlays (Shapefiles)overlays (Shapefiles)

Supported formats:GeoTIFF, JPEG, Supported formats:GeoTIFF, JPEG, ERDAS img, MrSID, RSAT, ESRI ERDAS img, MrSID, RSAT, ESRI Shapefiles, DTED, etc.Shapefiles, DTED, etc.

The Analysis System contains 3 Parts

1- Query of Available images based on

AOI selection

2- Image Analysis

3- Attributing

Create 2 shape files

1- Ice lines

2- Egg attributes

SIPAS Phase II Analysis

Chart ProductionChart Production

Currently Use ESRI GIS Package and Old Currently Use ESRI GIS Package and Old Custom Avenue and ARC AML Scripts To Custom Avenue and ARC AML Scripts To Produce .jpegsProduce .jpegs

Legacy Method Based On Old TechnologyLegacy Method Based On Old Technology

Moving Towards New Code Based On ARC/GIS Moving Towards New Code Based On ARC/GIS – VISUAL BASIC– VISUAL BASIC

Eventually; Automatic Chart Production Using Eventually; Automatic Chart Production Using ESRI Geodatabase, ARC/MAP, IMS, SDEESRI Geodatabase, ARC/MAP, IMS, SDE

Deploying “Zip and Ship” of Shapes Based on Deploying “Zip and Ship” of Shapes Based on International Color Codes This Year International Color Codes This Year

The Dissemination System :

1- On Demand

2- Subscription

3- On-the-Fly Ice chart

SIPAS Phase III Dissemination

Archive and On-line AccessArchive and On-line Access

Online AccessOnline Access– NIC: 1995-Current on WWW Site NIC: 1995-Current on WWW Site – NSIDCNSIDC

Weekly or Bi-weekly “Sea” ChartsWeekly or Bi-weekly “Sea” Charts– JPEG, .e00 Transfer Format, JPEG, .e00 Transfer Format, – International Color StandardInternational Color Standard

Every Two Weeks Arctic/Antarctic Hemispheric Every Two Weeks Arctic/Antarctic Hemispheric CoverageCoverage

– .e00 Transfer, SIGRID 3 Archive Formats.e00 Transfer, SIGRID 3 Archive Formats

Deep ArchiveDeep Archive– Hemispherics to NCDC in .e00 formatHemispherics to NCDC in .e00 format

Sea Ice Mapping SystemSea Ice Mapping SystemLessons LearnedLessons Learned

No No Turnkey SystemsTurnkey Systems– Rapid Prototyping with user participationRapid Prototyping with user participation– Custom Software by Applications VendorsCustom Software by Applications Vendors

It is not easy to adopt a new systemIt is not easy to adopt a new system– Resistance for changes from usersResistance for changes from users

Users participate in development/requirementsUsers participate in development/requirements

Must be obviously more accurate, better, fasterMust be obviously more accurate, better, faster

Find a championFind a champion

– Difficulties of the learning curveDifficulties of the learning curveVendor training using YOUR DATAVendor training using YOUR DATA

As little customized code as possible in a de-facto As little customized code as possible in a de-facto

standard languagestandard language

Sea Ice Mapping SystemSea Ice Mapping SystemLessons LearnedLessons Learned

Overwhelming complexityOverwhelming complexity– Modular DesignModular Design– DocumentationDocumentation

Transformations, Conversions, Re-formats . . .Transformations, Conversions, Re-formats . . .– Insist on the same format for imagery analysis and Insist on the same format for imagery analysis and

spatial data filesspatial data files– Insist on using standardsInsist on using standards

Spatial data, imagery, graphic, archive, colors, attributes etcSpatial data, imagery, graphic, archive, colors, attributes etc

Business Resumption and PortabilityBusiness Resumption and Portability– Ability to function as a stand aloneAbility to function as a stand alone– Laptop VersionLaptop Version

SummarySummary

COTSCOTSModular DesignModular Design– Ingest, Analysis, Production, DisseminationIngest, Analysis, Production, Dissemination

Same file formats throughoutSame file formats throughoutUser input in developmentUser input in developmentTraining Using Actual DataTraining Using Actual DataAvailability of programming assetsAvailability of programming assetsAbility to upgrade with legacy supportAbility to upgrade with legacy supportUse StandardsUse StandardsNetworked or Stand-aloneNetworked or Stand-alone

NOAA Satellite Operations Facility

Opening September 2005

Questions?