esri's support for standards in arcgis: building gis ......esri's support for standards in...

ESRI's Support for Standards in ArcGIS: Building GIS Standards and their Role in Interoperability

David Dankoddanko@esri.com

Jeanne Foustjfoust@esri.comSatish Sankaran

ssankaran@esri.com

What we are going to talk about

Interoperability and standardsGeowebESRI activities

Interoperability – exchanging and using knowledge

3

Technical interoperability

Semantic interoperability

?

the ability of two or more systems or components to exchange information and to use the information that has been exchanged *

* IEEE

4

Four types of interoperability

• Technical– Machine to machine connections– Software module interaction– APIs– Formats…

• Semantic*– Understanding concepts, terms– Special disciplinary vocabularies…

• Human– Cooperation– Education…

• Legal /Policy– Intellectual property rights, ownership– Exchange agreements, …

=

5

ESRI - Understanding the importance of Interoperability• Technical

– Multiple platforms– Focus on broad-based IT standards– Published APIs & formats – Support multiple formats & projections– Unrivaled support for relevant geospatial standards

• Semantic– Encourage, coordinate, publish community data models– Facilitate metadata standardization and management– Interoperability Extension

• Human– Training– Publications– Promoting geographic awareness

• Legal /Policy– Geography network and data programs– Support security and geo-rights

management community

UNIX®XML

SOAP

WSDL

UDDI

Things that make interoperability succeed

• Laws– Copyright– Business

Agreements– Authorization

• Infrastructure– Networks– Interfaces– Hardware

• Knowledge– Metadata– Quality– Exposure– Training

STANDARDS

A standard is an agreementbetween a provider and a consumera reference document enabling interoperability

CONSENSUS TECHNICALSOLUTION

mechanism

Standardsa floor to innovation

DEMOCRATICMECHANISM

TECHNOLOGYTRANSFER

Standards make things workIncrease efficiency

global standards = global efficiency

UC2008 Technical Workshop 11

Standards for Geographic Interoperability

Thun Riyadh

Santa Monica mountainsFirenze

UC2008 Technical Workshop 12Arima valleyValparaiso

Managua Badaling

Standards for Geographic Interoperability

13… an Information System for Geography

GIS Abstracts Geography into a Modern InformationTechnology Framework

Metadata

ModelsMapsMaps

GeodataSets

DataModels

Geodatabase

EncapsulatingReal World Knowledge

Data Management

1. GeoVisualization2. Decision Support3. Serve to others

ps

GIS

1…Abstracting Geographic Knowledge

. . . Together They Represent the Building Blocks of Geographic Knowledge

Geodata Sets

Process and Workflow Models

Maps and Globes

Metadata

Data Models

GIS abstracts geography into five basic elements

Process and Workflow Models

Metadata

Geodata Sets

Data Models

GIS Standardization functional areas

Maps and Globes

Basic Geographic StructuresGeometry, topology, coordinate

reference systems

Content DescriptionStandardized Data Models, Feature

Catalog Modeling languages, Application

schemasMetadata

Data ManagementDatabase management

Data Formats Structure, Syntax, language, API

VisualizationSymbology, cartography, display

GeoWeb ServicesWeb Catalog, Web Services, SOA

Building blocks ofgeographic knowledge

… building the foundation of the geospatial infrastructure, brick by brick ...

ESRI participates through ANSI/INCITS L1

www.ISOTC211.ORG

Basic Geographic StructureISO 19107 Spatial Schema (Geometry)

Content DescriptionSchemas for defining the Rules, Relationships, Definitions, and Behavior ISO 19109 Rules for application schemas

<element name="Building" substitutionGroup="gml:AbstractFeature"><complexType>

<complexContent><extension base="gml:AbstractFeatureType">

<sequence><element name="extent" type="gml:SurfacePropertyType"/><element name="address">

<complexType><sequence>

<element name="Address" type="ex:AddressType"/></sequence>

</complexType></element><element name="type" type="ex:BuildingTypeType"/>

</sequence></extension>

</complexContent></complexType>

</element><complexType name="BuildingPropertyType">

<sequence minOccurs="0"><element ref="ex:Building"/>

</sequence><attributeGroup ref="gml:AssociationAttributeGroup"/><attributeGroup ref="gml:OwnershipAttributeGroup" />

</complexType>

UML</ l

GML

UML/GML Data Model/Application Schema

Content DescriptionData Format ISO 19136 GML

Geography Markup Language (GML)

XML schema for representing geographic features (attributes, geometries, relationships, etc).

XML based encoding standard for geographic information

Leverages a wealth of mainstream (beyond the geographic community) standards, tools and practices

Content DescriptionData Format

UC2008 Technical Workshop 23

Different disciplines view/understand the world very differently

Managua, 1972

• Volcán Masaya–Tourist attraction–National park–Biological reserve–Disaster mitigation area–Geological formation–Volcanologist study area

Street

Name

Content DescriptionCommunity standardized schemas to define rules, relationships, definitions, behavior

ESRI and ANSI Standardized GIS Data Models

• Address• Agricultural• Atmospheric• Base Map• Biodiversity• Census-Admin• Boundaries• Defense-Intel• Energy Utilities• Environmental • Forestry• Geology• Groundwater• Health

• Historic Preservation & Archaeology

• Homeland Security• Hydro• IHO• Land Parcels• Local Government• Marine• National Cadastre• Petroleum• Pipeline• Telecommunications• Transportation• Water Utilities

••Water

Simple feature classHaul Contains Z values

Contains M valuesGeometry Point

NoNo

Data typeField namePrec-ision Scale LengthDomainDefault value

Allownulls

OBJECTID Object IDSHAPE Geometry Yes

HAULJOIN Long integer No 0VESSELCODE Long integer No 0

CRUISE Long integer No 0HAUL Long integer No 0

STATION_ID String No 7SSTEMP Float No 0 0

BOTTOMTEMP Float No 0 0EFFORT Float No 0 0

DataSourceID String Yes 50

TableDataSource

Data typeField namePrec-ision Scale LengthDomainDefault value

Allownulls

OBJECTID Object IDDESC_ String Yes 35

SOURCE String Yes 35CONTACT String Yes 20

PREC String Yes 20CREATE_DATE Long integer Yes 0LAST_UPDATED Long integer Yes 0

DataSourceID String Yes 50

TableFishCatch

Data typeField namePrec-ision Scale LengthDomainDefault value

Allownulls

OBJECTID Object IDHAULJOIN Long integer No 0

SPECIESCODE Long integer No 0LATINNAME String No 28

COMMONNAME String No 21WEIGHTCPUE Double No 0 0NUMBERCPUE Double No 0 0

Relationship class

NamePrimary keyForeign key

TypeCardinalityNotification

Forward labelBackward label

No relationship rules defined.

DataSourceHasHaul

Origin table Destination feature class

SimpleOne to manyNone

HaulDataSource

DataSourceDataSourceIDDataSourceID

HaulName

Relationship class

NamePrimary keyForeign key

TypeCardinalityNotification

Forward labelBackward label

No relationship rules defined.

HaulHasFishCatch

Origin feature class Destination table

SimpleOne to manyNone

FishCatchHaul

HaulHAULJOINHAULJOIN

FishCatchName

Local government

Homeland security

Agriculture

Cadastre

http://www.esri.com/software/arcgis/geodatabase/about/data-models.html

Created locally, regionally, nationally, globally by community Subject Matter Experts

1. Digital orthoimagery2. Cadastral data 3. Geodetic control4. Elevation 5. Hydrography6. Transportation7. Government Units

Candidate ANSI/INCITS-L1FGDC Framework Theme models

Semantic interoperability – standardizing content description

My view Your view

ArcGIS Data Interoperability ExtensionMapping my lexicon to yours

Content descriptionGeographic Metadata - ISO 19115:2003

• Metadata - Data about Data– Information that describes a resource (data, service, etc)

so it can be understood–Ensures we find and use the right data for the right

purpose and use it correctly• Geographic metadata

–Geographic area covered–Currency–Rules of use–Positional accuracy–Data dictionary–Means of encoding–Datum–Map projection

• A Key interoperability technology:–Producers explain their product–Users learn about products

28

Metadata provides meaning to geographic information

Recent activities in ISO TC 211• Newly published standards

– ISO 19115-2 Extensions for imagery and gridded data– ISO 6709 Standard representation of geographic point location by coordinates– ISO/TS 19104:2008 - Geographic information - Terminology

• Emerging standards (sample selection)– ISO 19110 Amd 1 Methodology for feature cataloguing - Amendment 1 – ISO 19142/3 Web Feature Service/Filter encoding – ISO 19144 Classification Systems – Part 2: Land Cover Classification System

LCCS– ISO 19148 Linear referencing– ISO 19150 Ontology– ISO 19152 Land Administration Domain Model (LADM)– ISO 19156 Observations and measurements

• New work and upcoming revisions– ISO 19113 Data Quality– ISO 19115 Metadata– ISO 19117 Portrayal– ISO 19119 Services – NWIP Quality assurance of data supply

GIS - Evolving to a web service environment

. . . Dynamically Integrating Our Common Geospatial Knowledge

• Viewing services• Data Services• Application Services

GeoWeb

GISServices

Web Services Networks

Open Geospatial ConsortiumSpatial connectivity

Vision

A world in which everyone benefits from geographic information and services made available across any network, application, or platform

Mission

Deliver spatial interface specifications that are openly available for global use

33

OASIS/IETF / W3CInfrastructure:

o WSDLo UDDIo SOAPo XML

ISO & Other NationalDomains: o Object/Abstract o Modelso Content o Vocabulary

nal

t

Where does OGC fit in the ‘standards’ world?

OGC Web Services

35

Global Map http://wwAbstract: vector data

NOAA Weather httAbstract: point featur

Landsat http://www.NAbstract: 30m satelli

Catalog Service-WebMetadata publishing/search service

Web Coverage ServiceImagery and gridded data publishing/processing service

Web Map Service Geospatial “picture” publishing/viewing service

I-295

Web Feature ServiceGeospatial feature publishing/streaming service

GetCapabilitiesCapabilities

GetMapMap Image(PNG, GIF, JPEG)

(HTTP protocol)

…<LayerLimit>16</LayerLimit>

<MaxWidth>2048</MaxWidth><MaxHeight>2048</MaxHeight>

</Service><Capability>

<Request><GetCapabilities>

<Format>text/xml</Format><DCPType>

<HTTP><Get>

<OnlineResource xmlns:

…

WMS ClientArcGIS Server

Web Map Service - WMS

OGC Web Services providing an open interface

WebServer

ArcGIS

ArcGISServer

ArcView

Minnesotamapserver

WMSservices

Nativeservices

Web Browser

AutoCAD

GeoMedia

Oracle

MapExtreme

“getMap” WMS Request

Request (HTTP CGI form)

Response (JPEG file)

OGC interface

One data file… …many different maps!

OpenGIS Styled Layer Descriptor ( WMS-SLD)

… and non-graphicportrayals!

Web Feature Service - WFS

GetCapabilitiesCapabilities

DescribeFeatureType

Feature Schema

GetFeaturesFeatures

2.

(GML Schema)

(SF GML)

(HTTP protocol)

WFS Client

222

ArcGIS Server

GetCapabilitiesCapabilities

DescribeCoverageType

Coverage Schema

GetCoverageCoverage

2.

(GeoTiff, HDF-EOS, DTED, NITF, GML)

(HTTP protocol)

WCS Client

22

ArcGIS Server

Web Coverage Service - WCS

Catalog Service – Web ( CS-W)

GetCapabilitiesCapabilities

DescribeRecord

Schema of catalog Info Model

GetRecordsRecords

(HTTP protocol)

CS-W ClientArcGIS Server

OGC Catalog Services - Web

Catalog

Specific Data Model

Registry Information Model

describes

Mapped to

Stored By Serves

Uses

Based On

eb-RIMISO

FGDCDublin Core

EO

FGDCISO ISO 19115,19119

Metadata

DataService (WMS,WFS,WCS, …)

Resource

Global Map http://wwAbstract: vector data

NOAA Weather httAbstract: point featur

Landsat http://www.NAbstract: 30m satelli

Catalog Services in A GeoPortalGateway for your GIS enterprise/SDI

3-D BaseMap

(Cache)

2-D Base Map

(Cache)

OGC Web

Services

TrackingServices

GIS DataData

Streams

BrowserMobile

Desktop GIS

Geo-processing

Services • Search• Channels • Link Browser Map• Download:

• ArcGIS Explorer• Toolbar for ArcMap• …

• Collaboration

Web Services Platform

2-D &* 3-DDesktop Viewers

Enterprise GeoPortal Data Warehouse

Client Applications

Service Provider

ServiceService Provider

DataService Broker

DataDescription

2 D &* 3 D

Service Requester

Client

Catalog Services

Catalog

Catalog Services

Catalog

GIS Portal Toolkit

ServiceDescription

Recent activities in OGC

• Newly published– WCS 1.1.2 Coverage service– WCS T 1.1.4 Coverage service –Transaction extension– SOS 1.0.0 Sensor Observation Service– OpenLS Core services 1.2.0– CityGML 1.0.0– OpenLS Tracking Service 1.0– KML 2.2.0– GeoXACML 1.0 eXtensable Access Control Markup Language– CS-W ebRIM registry service

• Best practices– EO Extension for CSW ebRIM– KML Standard Development– SWE Architecture

• OGC testbeds– EC 08 OGC web and sensor services for ISR in support of command and control– GEOSS GEOportal in support of disaster management and Society Benefit Areas– OWS -6 SWE, GPW, DSS, AIM

• Revision– Almost all are being revised

45

Standards DevelopmentESRI provides leadership in the development of many standards and contributes to over 50 more

• ESRI serves many roles within OGC–Principal member–Actively participates:

• Technical Committee • Planning Committee • Board of Directors• All three OGC programs

– Interoperability program–Standards program–Community Outreach and Adoption program

–Current chair or co-chair• Metadata Working Group (WG)• Web Map Service WG

–Sponsors • Open Location Services Initiative

https://empirechallenge.net/Pages/Default.aspx

SOS-T

SPS WNS

SPSClient

SOS Producer

SOS Producer

SOS Producer

SOS-T

SOS WCS WFS CSW

WNSClient

WNSSOSClient

SDIClient

WNSClient

TPEDApplications

Analysis/ExploitationApplications

SOS Producer

WMS

Observations FeaturesCoverages

WPS

WPSClient

ObservationsObservation Processing Node

t//PP //D

Information Management / Processing Node

Resource Management Node

Analyze / Exploit Node

Discover sensor (availability, coverage, capability, capacity)Nominate, task and cross-cue sensor collectionRetrieve sensor observation, alert and forward

Store and process [and catalog] observationsAccess and distribute

CSW SOS

Access and distributeDiscover resources (sensors, observations and products)View, measure and analyze observationsRetrieve findings

SOSClient

Leica

DIA SensorWeb

DIA SensorWeb

ESRILeica DIA SensorWebDIA SensorWeb ESRI

CompusultESRI ESRI

ESRITASCLeica

Retrieve sensor observation, alert and forward

Compusult

ESRI

ESRITASCLeica

Compusult

Projects/TestbedsEmpire Challenge 2008

Projects/TestbedsGEOSS GEOSS (global earth observation system

of systems) is a technical architecture to share data & services

80+ countries officially sponsor (US Government team led by NOAA, USGS, NASA , …)

ttp://earthobservations.org/geoss.shtml

The vision for GEOSS is to realize a future wherein decisions and actions for the benefit of humankindare informed by coordinated, comprehensive and sustained Earth observations and information.

49

Projects/TestbedsINSPIRE

The INfrastructure for SPatial InfoRmation in Europe (INSPIRE) creates a legal framework for the establishment and operation of a European SDI.

The INSPIRE Directive defines a set of requirements which cover the topics metadata, network services, data specifications, data and service sharing, and monitoring and reporting.

http://sdi.jrc.ec.europa.eu/

• Registered SDIC member• ESRI/JRC CRADA• Drafting Teams for Implementation

Rules• Participate in Technical Workshops• Develop prototype portal

NSG Doctrine, Policies,Standards, and Guidance

50

GEOINT Standards Working Group Inaugurated Jan 05

ctrine, Policies,NSG DoctrinStandards and Guidance

• Mission–Populating the DoD IT Standards Registry (DISR) with

GEOINT Standards–Community forum for evolving GEOINT standards

and vetting issues

• Goals–Advance GEOINT interoperability across the National

System for Geospatial Intelligence (NSG)– Mandating relevant standards using the DISR–Advocate other standards relevant to the NSG

DGIWG

51

• ESRI Participation–Attend TP meetings

when possible–Review and comment

on developing documents

–Test developing standards

SecretariatDGIWG

PlenaryDGIWG

DirectorDGIWG

Policy & Technical Strategy Group

Requirements & Outreach Group

Data StructuresTechnical Panel

Services and InterfacesTechnical Panel

Data AccessTechnical Panel

Project Teams Project Teams Project Teams

Technical Coordinator

Thematic Coordinator Imagery

Thematic Coordinator Portrayal

52

Conclusion: WHO are the Players?• ISO TC211 – Geographic information= international

• OGC – Open Geospatial Consortium = international

• GWG – Geospatial-intelligence Standards Working Group=US DoD & IC –DISR.

• Digital/Defense Geographic Information WG – DGIWG = Defense standards process

• NATO/NSA - IGEOWG = MC&G related STANAGs

• INCITS-L1/ANSI – InterNational Committee for Information Technology Standards – Geographic information

• FGDC – in the US (data content standards, metadata…guidance)

• IHO-Transfer Standard Maintenance and Application Development Working Group=Hydrographic Standards

• INSPIRE –– Implementation Rules based on ISO, OGC, CEN TC 287 standards and specifications

• The United States Board on Geographic Names – geographic names

• ‘Industry Standards’ – NIEM, etc.

• W3C & OASIS – web IT standards (xml, SOAP, REST….)

Supporting interoperability through active participation:

Implementations–Platform–GIS standards–IT/industry standards

Development–International Standards–Regional Standards–National Standards–Information Community Standards

UNIX®

Projects/Testbeds– Empire Challenge 2008– GEOSS :– INSPIRE– Kentucky Watershed Modeling Information

Portal– Geospatial One-Stop– NATO Core GIS

Organizations– ISO TC 211– OGC– ANSI/INCITS –L1– CEN– Global Map– GSDI– DGIWG– IHO– GWG

Supporting interoperability through active implementation:

. . . Providing An Open & Standards-based Environment. . . And Enabling Successful Collaborative Systems

Simple feature classHaul Contains Z values

Contains M valuesGeometry Point

NoNo

Data typeField namePrec-ision Scale LengthDomainDefault value

Allownulls

OBJECTID Object IDSHAPE Geometry Yes

HAULJOIN Long integer No 0VESSELCODE Long integer No 0

CRUISE Long integer No 0HAUL Long integer No 0

STATION_ID String No 7SSTEMP Float No 0 0

BOTTOMTEMP Float No 0 0EFFORT Float No 0 0

DataSourceID String Yes 50

TableDataSource

Data typeField namePrec-ision Scale LengthDomainDefault value

Allownulls

OBJECTID Object IDDESC_ String Yes 35

SOURCE String Yes 35CONTACT String Yes 20

PREC String Yes 20CREATE_DATE Long integer Yes 0LAST_UPDATED Long integer Yes 0

DataSourceID String Yes 50

TableFishCatch

Data typeField namePrec-ision Scale LengthDomainDefault value

Allownulls

OBJECTID Object IDHAULJOIN Long integer No 0

SPECIESCODE Long integer No 0LATINNAME String No 28

COMMONNAME String No 21WEIGHTCPUE Double No 0 0NUMBERCPUE Double No 0 0

Relationship class

NamePrimary keyForeign key

TypeCardinalityNotification

Forward labelBackward label

No relationship rules defined.

DataSourceHasHaul

Origin table Destination feature class

SimpleOne to manyNone

HaulDataSource

DataSourceDataSourceIDDataSourceID

HaulName

Relationship class

NamePrimary keyForeign key

TypeCardinalityNotification

Forward labelBackward label

No relationship rules defined.

HaulHasFishCatch

Origin feature class Destination table

SimpleOne to manyNone

FishCatchHaul

HaulHAULJOINHAULJOIN

FishCatchName

• Content Standards

Data Models

Metadata (19115/19139)

ETL = Extract, Transform & Load Data

Transformation Procedures (ETL)Formats

Schema

Semantic

T

• Web Services Standards

Web Services

OGC/ISO

DXF, KML . . .

WMS WFS WCS

WMS WFS WCS Catalog

ArcGIS Desktop

ArcIMS / ArcGIS Server

WFS-TGML

• Management Standards

• Visualization Standards

• Standards Organizations•Development•Advice

• GIS Education• Providing Data and Services• ESRI Press

• Basic Structure Standards• WWWWWWWeeebbbbbbb SSSSSSeeerrrvviic

Thanks!