mastering geospatial metadata with fme

FME and MetadataMastering Metadata with FME 2012

Don MurrayDean Hintz

FME ® Desktop 2012 Version

Agenda

FMEMetadataMetadata StandardsReadingUpdatingWritingHarvestingValidatingPublishing

Safe Software Facts

Private company Founded in 1993 Headquarters in

Vancouver, BC, Canada 90+ employees

50+ value-added resellers &system integrators in 35 countries

~100 FME Certified Professionals & Trainers around the globe

Thousands of customersacross 116 countries

IT Service Case Distribution

4

Introduction to FME

What is FME?

How Does FME Work? Centralized Semantic Transformational

Data Translation Basics FME Desktop Training 2012

FME Moves Data

FME is all about …

Barriers to Interoperability

Web

Data Types

Data Translation Basics FME Desktop Training 2012

Translation

FME supports reading from a wide array of data formats and types 275+ formats, with more added each year CAD, GIS, XML, raster, database, non-spatial, 3D

9

Poll Question #1: FME

How long have you been using FME?

?

Metadata – What is it?

Metadata – What it is

Metadata provides information about whatever types of data you have:

12

Metadata – Data about data

Describes data structures• tables• geometry types• data types• fields

Describes data content• coordinate system• extent• modification date• quality, ownership, etc.

Metadata - Purpose

Common Metadata Questions

What does the data set describe?Who produced the data set?Why was the data set created?How was the data set created?How reliable are the data; what problems remain

in the data set?How can someone get a copy of the data set?Who wrote the metadata?

geology.usgs.gov/tools/metadata/tools/doc/ctc/

?

Poll Question 2: Metadata

How often do you work with metadata?

?

Metadata Standards

FGDC & ISO 19115 • describes geographical

information and services

• contents, spatial-temporal, data quality, access and rights to use

• 400 metadata elements, 20 core

ISO / OGC Standards

ISO/TS 19139• defines Geographic Meta Data XML (gmd) • XML Schema implementation derived from ISO

19115• Version "2007-04-17" uses GML 3.2.1

(http://www.opengis.net/gml/3.2)• Version "2006-06-04" use GML 3.2.0 (http://

www.opengis.net/gml)• ISO 19119 – web services

Bottom line: need to know what GML version and what ISO standard you need to comply with

Poll Question #3: Standards

Which metadata standards/types are interested in?

?

Key FME Metadata Capabilities

• Reading

• Writing

• Updating

• Harvesting

• Validating

• Integration with web services

Demos

Reading

Writing

Updating

Harvesting

Validation (Syntax, Schema)

Demo: Reading

Metadata attributes

XML Reader / Fragmenter with Feature Paths and flattening

HTTPFetcher

Reading from database

Demo: Reading Metadata Attributes

Demo: Reading Geodatabase Metadata

expose the geodb_metadata_string attribute

Demo: Writing

XMLTemplaterTemplates for • FGDC• ISO 19115

Database write mode: geodatabase

Demo: Harvesting and Writing

Demo: Writing Geodatabase Metadata

Geometry:geodb_metadataExpose: geodb_metadata_string

Demo: Updating

XMLUpdater, XQueryTimeStamperXMLFormatter

Demo: Updating

XMLUpdater: Insert, Delete, Replace, Replace Contents

Poll Question 4: XML

What XML tools do you use?

?

Validation – What to validate against?

ISO 19139 with GML 3.2.0:http://schemas.opengis.net/iso/19139/20060504/gmd/gmd.xsd

To Validate XML against ISO 19139 with GML 3.2.1:http://standards.iso.org/ittf/PubliclyAvailableStandards/ISO_19139_Schemas/

See page 13 of:http://

inspire.jrc.ec.europa.eu/reports/ImplementingRules/metadata/MD_IR_and_ISO_20090218.pdf

Or Google and click top link: “inspire metadata implementing rules technical guidelines”

Key takeaway: to validate gmd:MD_Metadata you need to validate against gmd.xsd

Demo: Validation

XMLValidator• Syntax• Schema

Validation Report – Bad Syntax

Validation Report – Bad Schema

Validation Report – Good Metadata

Validation Workspace

Other Validation Options

• Tester• Field names• Data types (numeric, date etc)• IDs

• CoordinateSystemExtractor• GeometryFilter• GeometryOGCvalidator• SpatialFilter (check extents)

CSW: Catalog Service for the Web

• Deegree

• GeoNetwork

• OpenGIS

• TerraCatalog

Metadata Services: CSW

• Reading• Writing / Publishing• Updating

Poll Question #5: CSW

What CSW tools do you use?

?

Arkansas Geostor: Download

Customer Implementations: LGII – Lithuania Geospatial Portal

File Formats: AutoCAD DXF / DWG ESRI Personal Geodatabase Shape MapInfo TAB Microstation Design V8 GML GIF / PNG JPEG TIFF ERDAS IMG ECW

Coordinate systems: LKS94 WGS84 ETRS89 1963 Pulkovo 1942 UTM (34, 35 zones)

Other data sources: WFS SDE Files

Summary

Metadata describes your dataHelps with searches and

managementFME can help drive your metadata: • Read / write and update• Harvest• Validate• Automate maintenance tasks• Integrate with CSWSwitch from manual to automatic by

using FME to power your metadata

Online Training

Upcoming Online Courses in 2012 Online FME Desktop:

May 16/17 June 20/21 Sept 19/20 Oct 17/18 Dec 5/6

FME Server Authoring: May 24 Sept 27

Online Advanced FME Desktop: XML Reading May 16 or 17 XML Writing May

23 or 24 Oracle Spatial June 7 or Sept

26 Esri (demo only) Sept 6 KML Nov

14 Raster Nov

29

Poll Question 6: Training

Would you like to enter for a chance to win a free seat of online FME training?

?

FME 2012 World Tour

http://fme.safe.com/content/FME-2012-World-Tour

Twitter Hashtag: #FMEWT

Thank You

Questions?

don@safe.com

www.safe.com/support

www.youtube.com/fmechannel

fmepedia.safe.com/knowledgeSearch?k=metadata

dean@safe.com