geographic information systems and geospatial metadata csci 373: advanced database unc asheville...

Geographic Information Systems and Geospatial Metadata

CSCI 373: Advanced Database • UNC Asheville • April 27, 2006

Lynda Wayne US Federal Geographic Data Committee / GeoMaxim

CSCI 373 GIS and Geospatial Metadata 20060424

What so special about spatial?

Geospatial Data Components:

entities and attributes

location

extent

‘geographic footprint’

most data IS geospatial….

How does GIS enable geospatial data?

Geographic Information Systems: capture

display

analyze

manage

geospatial data

esri.com

GIS Functions

Geospatial data capture and display:entities/attributes via a database

location via a coordinate/referencing system

extent via graphic objectsarcs

nodes/points

polygons

esri.com

GIS Functions

Geospatial data analysislocation and extent enable entity/attribute:

Multi-level analysis:coincidence

deviation

proximity

temporal patterns

Graphic developed by Kenneth E. Foote and Margaret Lynch, Department of Geography, University of Texas

GIS Functions

Geospatial data analysislocation and extent enable entity/attribute:

Single-level (feature) analysiscontiguity

dispersion

spatial patterns

GIS Functions

Geospatial data analysis

location and extent enable entity/attribute:

Feature characterizationsize

smoothness

salient points

GIS Functions

Geospatial data management access

assess

update

organize

geospatial data

What is geospatial metadata?

Data ‘reporting’ WHO created the data?

WHAT is the content of the data?

WHEN was it created?

WHERE is it geographically?

HOW was the data developed?

WHY was the data developed?

supplemental information

abstract

time period

author

sources

(file) size

entity

attributes

Metadata as a Data Component

MetadataTitleOriginatorPurposeAbstractGeographic ExtentTime Period of ContentSources UsedProcess DescriptionPositional AccuracyEntities and Attributes…….

phenomenaphenomena map / image / databasemap / image / database metadatametadata

abstraction abstraction

content context

etadata

(context)

Metadata as a Data Component

access

• search• download

• describe• publish

• assess• apply

Data Management

Metadata the Awful

Geospatial Data Producers perceive metadata as:

time consumingexcessivefor the benefits of others

Geospatial Managers perceive metadata as:

non-productivecostly (time, training, software)

derive classify

collect

planimetric imagery

analysis

alternativecommittee

review

charette

metadata?

Metadata the Magnificent

Metadata can support:data management

project management

If it is:considered a component of the data

created during data development

populated with rich content

derive classify

collect

planimetric imagery

analysis

alternativecommittee

review

charette

Data Management via Metadata

DataAccountability

Discovery

& Re-use

Maintenance

& Update

DataLiability

Data Management:Data Maintenance and Update

MaintenanceAre the data current?

• older than?• prior to significant change?

Are the data valid?• newer sources?• better methods?

UpdateContact informationDistribution policies, availability, pricingURLSNew derivations

Data Management:Data Discovery and Re-use

Marketing metadata in the past…

If you create metadata, other people can discover your data

If you create metadata, you can find your own data

New and improved message…

Data Management:Data Discovery and Re-use

Data discovery bythemes / attributes

geographic extent

temporal character

methods

sources

quality

Discoverable data is usable data

Data Management:Data Accountability

Exercise in data comprehension:

What do you know?

What don’t you know?

What should you know?

Are you willing to associate yourself with the metadata record?

Data Management:Data Accountability

Repeatable process:methodsvariablesparameters

Defensible process:public participationdecision-making

GIS-savvy public

Metadata can be crafted to preserve individual accountability in team projects

Data Management:Data Liability

Metadata is declaration of:Purpose

originator’s application of the data? ontological pedigree ?

Use Constraintsappropriate and inappropriate utility of the data

Completenesswhat is missing from the data

Distribution Liabilityexplicit liability of the producer and assumed liability of

the consumer

What to do…

What not to do…

Project Management via Metadata

PROJECTPLANNING

DELIVERABLES

COMMON LANGUAGE

PROJECT MONITORING

Project Management:Project Planning

Project design document:description / intentgeo & temporal extentsource dataattribute requirements

Benefits:expectations outlinedintegrated into processprovide medium to record progress

Project Management:Project Monitoring

Monitor:

status

QA/QC measures

changes

Requires that the metadata be actively maintained and reviewed.

Project Management:Common Language for Multi-participants

Common reference for:descriptors & parameterskeywords, vocabularies & thesauricontact informationattributesdistribution information

If reviewed regularly by all participants,improved opportunity for coordinating:

source dataanalytical methodsnew information

Project Management:Contract Deliverables

Metadata is a data component therefore part of any data deliverable

Clearly specify your metadata requirement via a metadata:

classification/validation schema, e.g. ‘level’ of metadata

template

specification manual

Provide a sample record if possible

Metadata Roles

If created with utility in mind, metadata can serve multiple roles:

and this is only human utility of metadata…

archivist preserve lineage

accountant preserve investment

developer document process

manager track progress

contributors communicate

consumer locate, assess, access data

How do I create geospatial metadata?

To create geospatial metadata you must:

1. make metadata part of the process

2. be familiar with the US metadata standard

3. utilize a metadata editor tool

Make Metadata Part of the Process

New tools enable us to better integrate metadata creation into the data development process

If metadata were collected throughout the data process…

1. more accurate (no guessing)

2. more details

3. better decision-making.

Build templatesidentify pertinent fieldspopulate fixed fields

standardized languagedistribution methodsstandards used

build source and contact libraries

templates can be built at multiple levels: organization, project, themes….

• title

• abs

• pur

• tim

• key

• com

Attrib

• attr

Attrib

• com

• sou

• fie

• ana

lytica

es• a

Data Processing Data Planning Data Analysis

manager technicians analysts

Map metadata to the workflow

Establish policiesmandate use of standards and templates

develop boilerplate metadata deliverable language for data contractors

include metadata as a performance measure

require units to publish their metadata

publish metadata SOP to document policies and procedures

Content Standard for Digital Geospatial Metadata (CSDGM)imagery digital land surveys

GIS files geographic databases

required for use by:federal agenciesfederally-sponsored researchsome state/county/city governments

info at:http://www.fgdc.gov/metadata/

US Federal Metadata Standard

CSDGM Overview

Organized into seven primary sections:

1. Identification InformationGeneral bibliographic information including:

title, originator, data contact, status, date, time period of content, abstract, purpose, keywords, geographic location

2. Data Quality InformationLineage and data assessments

sources, process methods, accuracy, data processing contact

CSDGM Overview

3. Spatial Data OrganizationData format:

vector, point, raster

4. Spatial Reference InformationCoordinate system parameters:

horizontal / vertical coordinate system, projection, datum

5. Entity and Attribute InformationDatabase design

entities, attributes, domains, description of data values

6. Distribution InformationHow to acquire the data

distribution contact, available formats, online distribution website, costs

CSDGM Overview

7. Metadata Reference InformationGeneral information about the metadata record itself

metadata contact, metadata standard used, metadata creation date, metadata review date

CSDGM Overview

But that wasn’t enough for some people...

Extensions:added elements to the CSDGM

• Remote Sensing Extension

Profilescontent requirements for specific elements

may included added elements as well• Biological Profile

• Shoreline Profile

Transition to ISO Metadata

Standardized Metadata

Content Standard for Digital Geospatial Metadata (CSDGM) Vers. 2.0

remains current US standard

International Geospatial Metadata Standard (ISO 19115)

standard completed

US (ANSI) adoption in progress

1. Content

CSDGM similar and new elements

Domains and conditionality

Essential or core metadata

2. Format

UML / XML

Multi-level metadata

What’s new with ISO metadata?

Metadata Tools

How do I determine the best metadata tool?Does your organization provide a tool?Does your GIS software provide an internal editor?Do you use a CSDGM Profile or Extension? Do you need to document data resource beyond those managed within your GIS? Do you need a tool that is easily distributed to partners? What features are most important to you?

auto-capture of information bundling of metadata with data creation and use of templates easy to use interface robust help systems and tutorials

Metadata Tools

What metadata editors are available?Freeware

tkme/xtmeUSGS, supports all profiles/extensions, well-maintained

MetaVistUSFS, desktop, supports biological profile

MERMAidNOAA CSC, online utility supports biological and shoreline profiles

Metadata Tools

What metadata editors are available?Commercial

SMMS (Intergraph GeoMedia and stand-alone)

auto capture from multiple file types, contact/source libraries, data exploration utilities

ArcCatalogmetadata ‘synchronized’ w/data, ability to enclose

documents, metadata bundled with data export

Blue Angelhighly customizable, supports non-geospatial metadata

Metadata Tools

What other metadata tools are available?Parsing and Validation

Metadata Parser (mp)checks for conformance to CSDGM specified:

• conditionality (are all mandatory elements are populated?) • data formats • element domains

mp batchbatch processor shareware from Intergraph

Chew N Spit (cns)• Rectifies indentation• Inserts capitalization and underbars

FGDC ‘compliant’ metadata must pass mp!

Metadata Tools

What other metadata tools are available?Conversion

error2htmprovides user-friendly interpretation of mp error report

dbfmetaconverts dbase to CSDGM Entity Attribute elements

mq provides interface for editing large, diverse collections of

metadata

How is metadata used to distribute geospatial data?

Geospatial data portals, online systems and catalogs:Geospatial One-Stop US Federal geospatial data portal

NC OneMapState geospatial data portal

Buncombe County GISCounty GIS

National Biological Information InfrastructureThematic Metadata Catalog

Geospatial OneStop http://www.geodata.gov

NC OneMap http://www.NCOneMap.org

Buncombe County GIS http://www.buncombecounty.org/governing/depts/GIS

NBII Metadata Catalog http://mercury.ornl.gov/nbii/

Future Role of Metadata

External Utility

distribution role will be limited to exact vs. general queries with improvements to context-based search utilities (MetaCarta)

Internal Utility

management role will increase with shift to OOP-based GIS (hierarchy, relations, etc.)

Geospatial Metadata is a GIS Best Practice

Questions?

Lynda WayneLwayne@fgdc.gov

FGDC Metadata Website www.fgdc.gov/metadata

ESRI GIS Primer http://www.gis.com/whatisgis/

geographic information systems and geospatial metadata csci 373: advanced database unc asheville...

data valid

data maintenance

data current

data reporting

geospatial data components

awfulgeospatial data

reusemarketing metadata

geospatial metadatacsci

Documents

asheville, nc: 2011

project management asheville

unc asheville

2015 asheville...

lynda garrett

geospatial one-stop data stewardship lynda wayne geomaxim...

asheville new brief

creating geospatial metadata for the long-term lynda wayne...

happy 19th lynda

presenter: lynda dolan

asheville new year’s resolution run - idaph...

lynda + james

asheville vertical winery

asheville fire department

sneak preview: sneak preview: the new us geospatial metadata...

lynda ann blanchard

asheville security

lynda braddick kangaroos

dko - caroline werner gannett project · graphic essay by...

welcome to asheville