northumbria university geospatial metadata workshop 20110505
Post on 26-Jan-2015
112 Views
Preview:
DESCRIPTION
TRANSCRIPT
Geospatial Metadata and Spatial Data Workshop Geospatial Metadata and Spatial Data Workshop NorthumbriaNorthumbria UniversityUniversity
School of the Built and Natural Environment School of the Built and Natural Environment School of the Built and Natural Environment School of the Built and Natural Environment
Workshop ProgrammeWorkshop ProgrammePRESENTATION SESSION:PRESENTATION SESSION:
Background information
Metadata, standards and application profiles
UK Academic Geospatial Metadata Application Profile, Version 2.1 (UK AGMAP 2.1) and guidelines
Geodoc Metadata Editor tool, Go-Geo! portal and other resources
ShareGeo Open spatial data repository
Look at current and future activities
DEMONSTRATION/HANDS-ON SESSION: DEMONSTRATION/HANDS-ON SESSION:
Geodoc Metadata Editor tool, Go-Geo! portal and ShareGeo Open spatial data repository
LUNCH
BackgroundBackground three decades of GIS and spatial
data capture technology
an eclectic range of academic disciplines using GIS as a research and teaching tool
considerable cost and time invested in spatial data creation
*2006 spatial data audit at 4 universities: +500 dataset files, 100s of orphan datasets
Requires a spatial data management, discovery and sharing solution delivered through portal technology and metadata metadata.
So what is So what is METADATAMETADATA?The word appears to be of Greek and Latin origin……
but metadatametadata represents something completely different……
Photographic Images copyright: Jupiter Images 2006
Photographic Images copyright: Jupiter Images 2006
and it’s not sun and holiday
Represents a documented and ordered summary of information that describes something, in this case, spatial data.
Provides the What, Where, When What, Where, When and WhyWhy for a spatial dataset.
Includes its Ownership Ownership and and Contact (Who)Contact (Who) details and Access Access andand Use Use conditions.
Metadata (data describing data)Metadata (data describing data)
WhatWhat are the ingredients?
WhereWhere wereingredientsproduced?
WhoWho sells theingredients?
WhatWhat are thebrewing steps?
WhenWhen does the fermentation process end?
Photographic Images copyright: Jupiter Images 2006
Think of metadata as a recipe for making beer.Think of metadata as a recipe for making beer.Think of metadata as a recipe for making beer.Think of metadata as a recipe for making beer.
metadatametadatametadatametadata
Think of metadata as food product labelling.Think of metadata as food product labelling.Think of metadata as food product labelling.Think of metadata as food product labelling.
WhatWhat are the ingredients?
WhatWhat is the nutritional value?
HowHow many calories and howhow much fat?
WhenWhen is this product’sexpiry date?
WhereWhere was it produced?
WhoWho produced it?
WhatWhat are the ingredients?
WhatWhat is the nutritional value?
HowHow many calories and howhow much fat?
WhenWhen is this product’sexpiry date?
WhereWhere was it produced?
WhoWho produced it?
metadatametadatametadatametadata
WhereWhere is the dataset’s study area?
WhenWhen were the data collected?
WhyWhy was this dataset created?
type of application?spatial reference system?
spatial accuracy?processes or algorithms used?
WhoWho created the dataset?
Can you tell me from any of these files…..Can you tell me from any of these files…..
Now think of metadata as spatial data labelling.Now think of metadata as spatial data labelling.
WhatWhat do these polygons represent?
WhatWhat attribute information is associated with these
polygons?
WhatWhat do these polygons represent?
WhatWhat attribute information is associated with these
polygons?
WhatWhat do these SOILCLASS
values mean?
WhatWhat does this attribute mean?
metadatametadatametadatametadata
The importance of geospatial metadataThe importance of geospatial metadata
Local Data Management
MetadataMetadata RecordRecord
Spatial Dataset Spatial Dataset Directory or Directory or RepositoryRepository
SpatialSpatialDatasetsDatasets
MetadataMetadataDirectoryDirectory
GeoportalGeoportal: an interface to run searches on the internet and local catalogues to locate geographical resources, and to discover metadata records representing spatial data and geo services.
GeoportalGeoportal Metadata Metadata RecordRecord
Spatial DatasetsSpatial Datasetsand Geo-servicesand Geo-services
Spatial Data Discovery via a Geoportal Spatial Data Discovery via a Geoportal
A geoportalgeoportal enables users to search and discover spatial data via metadata using free textfree text, resource typeresource type, geographic locationgeographic location (co-ordinate and placename) and datedate.
A geoportalgeoportal enables users to search and discover spatial data via metadata using free textfree text, resource typeresource type, geographic locationgeographic location (co-ordinate and placename) and datedate.
Discovering spatial data through metadata offers the Discovering spatial data through metadata offers the prospect of developing new applicationsprospect of developing new applications
Contours
Raster Map
Draped 3D Model
and creating new datasetsand creating new datasets
© Crown Copyright/database right 2008
© Crown Copyright/database right 2008© Crown Copyright/database right 2008
© Crown Copyright/database right 2008© Crown Copyright/database right 2008
Other benefits: data protectionOther benefits: data protection
Photographic Images copyright: Jupiter Images 2006
protects investments of time and cost dedicated to dataset creation and development;
maintains an inventory of datasets to reduce time required to re-assess existing datasets for new and future applications;
ensures integrity of existing and new datasets using metadata as a tracking mechanism to monitor changes and edits to datasets;
reduces and minimises the disruptive effects of staff turnover;
eliminates or reduces the risk of redundancy in dataset collection;
saves against accidental deletion of dataset files.
Metadata creationMetadata creation
1. Intellectual Property Rights (IPR)2. residual licensed data rights for derived data 3. concerns over data quality (data creator and user)4. liability fears5. privacy and security6. time and cost for data delivery7. data transformation and harmonisation (scale, positional accuracy
projections, formats)8. legacy data9. time and cost to anonymise data for release10. time and cost for metadata record (descriptive level) updates11. portal and repository performance, maintenance and enhancement
costs 12. data archiving13. data and software warehousing issues14. long-term commitment and investment in the infrastructure15. revisions to changes in standards16. confusion about standards compliance and which standard to use
1. Intellectual Property Rights (IPR)2. residual licensed data rights for derived data 3. concerns over data quality (data creator and user)4. liability fears5. privacy and security6. time and cost for data delivery7. data transformation and harmonisation (scale, positional accuracy
projections, formats)8. legacy data9. time and cost to anonymise data for release10. time and cost for metadata record (descriptive level) updates11. portal and repository performance, maintenance and enhancement
costs 12. data archiving13. data and software warehousing issues14. long-term commitment and investment in the infrastructure15. revisions to changes in standards16. confusion about standards compliance and which standard to use
Many concerns remain (metadata and data)Many concerns remain (metadata and data)Many concerns remain (metadata and data)Many concerns remain (metadata and data)
Metadata standardsMetadata standards provide precise specifications; enforce and ensure consistency and interoperability; define and describe metadata entities and data elements; classify and group relevant metadata elements with entities; assign structure and conditions (obligations, data type, domain).
Dublin Core (ISO 15836)Dublin Core (ISO 15836) Dublin Core: 15 elements to facilitate simple resource discovery
in a networked environment (e.g. internet or library)
Photographic Images copyright: Jupiter Images 2006
Geospatial metadata standardsGeospatial metadata standards
Federal Geographic Data Committee (FGDC) Content Standard Federal Geographic Data Committee (FGDC) Content Standard for Digital Geospatial Metadata (CSDGM)for Digital Geospatial Metadata (CSDGM) introduced in mid 1990s for documenting spatial datasets.
ISO 19115 Metadata Standard for Geographic InformationISO 19115 Metadata Standard for Geographic Information was ratified in 2003 and supersedes FGDC.
Geospatial metadata standards are critical for supporting Geospatial metadata standards are critical for supporting metadata creation and………………………… metadata creation and…………………………
OtherContent Providers
UK Location Programme
Network
Geo-data Gateway
Local Go-Geo!database
Geoportal
portal interoperability and search capabilities across the internet.
User
Centre for Ecology and Hydrology (CEH)Centre for Ecology
and Hydrology (CEH)
National Environment Research Council (NERC)
National Environment Research Council (NERC)
National Soil Resources Institute (NSRI)
National Soil Resources Institute (NSRI)
Geospatial Metadata Application ProfilesGeospatial Metadata Application ProfilesISO 19115 standard has too many elements (300+)
* An application profile is derived from a standard and represents a reduction of the number of entities and elements.
* It should include the core element set of a standard to support interoperability across the wider geospatial community (DiscoveryDiscovery level level metadata).
* Perhaps include elements for DescriptiveDescriptive level metadata?
* A profile can be extended to include elements which are best suited for a working group’s specific applications.
Example: The Biological Data Profile (BDP)The Biological Data Profile (BDP)
An approved profile with additional elements to document biological information such as taxonomytaxonomy, , methodologymethodology and analytical toolsanalytical tools.
* An application profile is derived from a standard and represents a reduction of the number of entities and elements.
* It should include the core element set of a standard to support interoperability across the wider geospatial community (DiscoveryDiscovery level level metadata).
* Perhaps include elements for DescriptiveDescriptive level metadata?
* A profile can be extended to include elements which are best suited for a working group’s specific applications.
Example: The Biological Data Profile (BDP)The Biological Data Profile (BDP)
An approved profile with additional elements to document biological information such as taxonomytaxonomy, , methodologymethodology and analytical toolsanalytical tools.
http://www.flickr.com/photos/f10n4/186861991/http://www.flickr.com/photos/f10n4/186861991/
Creating application profiles from ISO 19115Creating application profiles from ISO 19115
ISO 19115Metadata Standard
ISO 19115 Core Element Set
Application
Profiles
Academia (43 + 47=90)
Public Sector(43 + 62=105)
Private Sector(43 + 12=55)300+
elements
43 elements
EnvironmentalSciences
EnvironmentalSciences
SpecialisedAPs
* INSPIRE Directive Metadata Guidelines* INSPIRE Directive Metadata Guidelines
* UK GEMINI 2.1* UK GEMINI 2.1, an INSPIRE compliant geospatial metadata standard for the UK
* ANZLIC Metadata Profile
* North American Application Profile (NAP), Canada and the US
* INSPIRE Directive Metadata Guidelines* INSPIRE Directive Metadata Guidelines
* UK GEMINI 2.1* UK GEMINI 2.1, an INSPIRE compliant geospatial metadata standard for the UK
* ANZLIC Metadata Profile
* North American Application Profile (NAP), Canada and the US
ArchaeologyArchaeology
BiologicalSciences
BiologicalSciences
GeoSciences
GeoSciences
HistoryHistory
HealthInformatics
HealthInformatics
Infrastructure for Spatial Information
in the European Community (INSPIRE)
Infrastructure for Spatial Information
in the European Community (INSPIRE)
*European Commission (EC)
*European Environment Agency (EEA)
*Representatives from Member States (Mapping/GIS)
*European Commission (EC)
*European Environment Agency (EEA)
*Representatives from Member States (Mapping/GIS)
INSPIRE Directive Metadata GuidelinesINSPIRE Directive Metadata Guidelines
INSPIRE Directive [2007 /2/ EC]INSPIRE Directive [2007 /2/ EC]INSPIRE Directive [2007 /2/ EC]INSPIRE Directive [2007 /2/ EC] Targets electronic spatial data and services for environmental information.
Aims to create a European Spatial Data Infrastructure (SDI) based on Member States’ infrastructures, to improve interoperability of spatial information.
These data and services to be delivered through initiatives across Europe.
INSPIRE Regulations 2009 No 3157 came into force on 31 December 2009 and applies to England, Northern Ireland and Wales.
Scotland’s Parliament enacted a complementary regulation which came into force on the same date.
Public authorities will be obliged to produce and keep up to date ‘metadata’ for describing datasets, dataset series and geo services.
Includes UK academia as it must comply with the Freedom of Information Act, 2000.
Targets electronic spatial data and services for environmental information.
Aims to create a European Spatial Data Infrastructure (SDI) based on Member States’ infrastructures, to improve interoperability of spatial information.
These data and services to be delivered through initiatives across Europe.
INSPIRE Regulations 2009 No 3157 came into force on 31 December 2009 and applies to England, Northern Ireland and Wales.
Scotland’s Parliament enacted a complementary regulation which came into force on the same date.
Public authorities will be obliged to produce and keep up to date ‘metadata’ for describing datasets, dataset series and geo services.
Includes UK academia as it must comply with the Freedom of Information Act, 2000.
• Provide metadata catalogues to reveal what information is available.
• Provide online data discoverydiscovery, viewview, downloaddownload and transformationtransformation (interoperability) services.
• Licensing arrangements to allow for information sharing, access and use in accordance with state regulations.
• Set up e-commerce arrangements where charging is applicable.
• Introduce monitoring mechanisms to show that information is being made available.
• Introduce co-ordination mechanisms to ensure effective operation of the infrastructure.
• Comply with the 34 spatial data specifications in three annexes (reference geographies, environmental datasets).
• Provide metadata catalogues to reveal what information is available.
• Provide online data discoverydiscovery, viewview, downloaddownload and transformationtransformation (interoperability) services.
• Licensing arrangements to allow for information sharing, access and use in accordance with state regulations.
• Set up e-commerce arrangements where charging is applicable.
• Introduce monitoring mechanisms to show that information is being made available.
• Introduce co-ordination mechanisms to ensure effective operation of the infrastructure.
• Comply with the 34 spatial data specifications in three annexes (reference geographies, environmental datasets).
INSPIRE Regulations for member statesINSPIRE Regulations for member statesINSPIRE Regulations for member statesINSPIRE Regulations for member states
INSPIRE spatial data themes and deadlines for creating metadataINSPIRE spatial data themes and deadlines for creating metadata
INSPIRE Metadata Editor tool and GeoportalINSPIRE Metadata Editor tool and Geoportal
* First released in 2004 to support creation of ISO 19115 and e-GMS compliant metadata - supersedes the National Geospatial Data Framework (NGDF)
* Targeting the UK public sector
* 2010: UK Location Programme (UKLP) revised UK GEMINI 2.1 to meet the requirements of the EU INSPIRE Directive.
* First released in 2004 to support creation of ISO 19115 and e-GMS compliant metadata - supersedes the National Geospatial Data Framework (NGDF)
* Targeting the UK public sector
* 2010: UK Location Programme (UKLP) revised UK GEMINI 2.1 to meet the requirements of the EU INSPIRE Directive.
UK GEMINIUK GEMINI
UK Location Programme (UKLP) is a pan-government
collaborative initiative with theresponsibility to develop and implement
the INSPIRE Directive 2007/2/EC and the UK Location Strategy.
UK Location Programme (UKLP) is a pan-government
collaborative initiative with theresponsibility to develop and implement
the INSPIRE Directive 2007/2/EC and the UK Location Strategy.
UK Location Metadata Editor and Catalogue conform to UK GEMINI 2.1
UK Location Metadata Editor and Catalogue conform to UK GEMINI 2.1
http://www.flickr.com/photos/musebrarian/3289649684/#/http://www.flickr.com/photos/musebrarian/3289649684/#/
Metadata and spatial data resources forMetadata and spatial data resources forUK academiaUK academia
UK Academic Geospatial Metadata Application UK Academic Geospatial Metadata Application Profile, Version 2.1 (UK AGMAP 2.1)Profile, Version 2.1 (UK AGMAP 2.1)
UK AGMAP 2.1 created to support the specific needs of the UK H&FE communities.
Comprises elements from ISO 19115, UK GEMINI 2.1 and INSPIRE.
Supports documentation of a dataset, dataset series or geo service for the purpose of discovery and description.
Mapped to Dublin Core, FGDC, INSPIRE, UK GEMINI 2.1 and DDI.
UK AGMAP 2.1 profile for datasets and dataset series
UK AGMAP 2.1 profile for datasets and dataset series
Contact details = 7
Drop down lists = 9
Contact details = 7
Drop down lists = 9
Red: MandatoryRed: Mandatory
Green: ConditionalGreen: Conditional
29 mandatory29 mandatory
90 elements 90 elements
UK AGMAP 2.1 profile for
Geo-services
UK AGMAP 2.1 profile for
Geo-services
Contact details: 7
Drop down lists: 6
Contact details: 7
Drop down lists: 6
Red: MandatoryRed: MandatoryGreen: ConditionalGreen: Conditional
22 mandatory22 mandatory
39 elements 39 elements
Contain descriptions and examples to assist metadata creators and Go-Geo! portal users from eclectic range of academic disciplines.
UK AGMAP 2.1 GuidelinesUK AGMAP 2.1 Guidelines
Most spatial data information is stored in our heads.
We need to move it from there to electronic files.
Metadata CreationMetadata Creation
Photographic Images copyright: Jupiter Images 2006
Mind reading aliens?
Solutions?Solutions?Solutions?Solutions?
Spatial data extraction device?
Geodoc Metadata Editor ToolGeodoc Metadata Editor ToolGeodoc Metadata Editor ToolGeodoc Metadata Editor Tool
Geodoc design and functionality• Java-built online tool
• authentication required
• text fields and drop-down lists for entering information
• validation (red fields)
access to metadata guidelines and Geodoc reference guide.
Direct links at click of button to metadata guidelines ‘Help’ pages Direct links at click of button to metadata guidelines ‘Help’ pages
MyGoGeo! automation and customisation tool
Geodoc coordinate extent toolGeodoc coordinate extent toolMap tool captures co-ordinate values for bounding box elements used to define the extent of a dataset’s study area.
Extents for Nations at the click of the mouse
Extents for Nations at the click of the mouse
Personal and secure directory for storing, editing and exporting metadata records.
Geodoc exports UK AGMAP 2.1metadata records in
PDF format
Geodoc exports UK AGMAP 2.1metadata records in
PDF format
Publication on open or private (institutional) nodesPublication on open or private (institutional) nodes
1) create and validate record;2) submit record for review; 3) metadata creator is contacted; and4) record is published on the Go-Geo! portal.
11 22
33
A few easy steps to publication A few easy steps to publication of a geospatial metadata recordof a geospatial metadata record
44
Photographic Images copyright: Jupiter Images 2006
A simple interface designed for UK academia to run queries to discover metadata for spatial datasets.
The portal enables searching by the use of various options including
-free text -date -resource type -geographic location
www.gogeo.ac.ukwww.gogeo.ac.uk
Go-Geo! PortalGo-Geo! PortalGo-Geo! PortalGo-Geo! Portal
Go-Geo! simple searchPlacename
search using Unlock middleware gazetteer
Placename search
using Unlock middleware gazetteer
Search results page and extents display
Metadata record published on Go-Geo!
Links between Go-Geo! portal elements to UK AGMAP 2.1 guidelines
Advanced search
- Data Type- Location- Text- Date Range
- Data Type- Location- Text- Date Range
*BGS JIDI Photo Collection
*COPAC
*BGS JIDI Photo Collection
*COPAC
Access to metadata records published on institutional (private) nodeAccess to metadata records published on institutional (private) node
Why publish metadata on the Go-Geo! portal?Why publish metadata on the Go-Geo! portal?
a repository for you to store and manage your metadata thus savings in cost and time;
use metadata to announce your data and applications;
advertise (and sell?) your spatial datasets to other interested parties in academia and in the private and public sectors;
metadata in the portal can be referenced and cited for project proposals;
could be configured as an internal resource to access and share datasets.
* Cambridge, Edinburgh, Kingston, Leeds, Leicester, Sheffield and Southampton universities have created and published +200 metadata records on Go-Geo! portal (global and private).
Geo resource channelsover 3,000 resources and daily updates
MyGoGeo!: bookmark resources
Other geospatial metadata resources
Geospatial Metadata Workshops July 2007 Aberdeen University Marine/ECO-IMAGINE
Geospatial Technologies Course
2008 Sheffield University
Southampton University
May 2010Plymouth University
2003 Durham University
City University
2004University of Essex
York UniversityStrathclyde University
Bradford University Oxford Brookes
University Coventry UniversityEdinburgh University
Oxford University Kingston University
Sheffield University
2006 Aberdeen University
Leeds UniversityCambridge University
Oxford UniversityStirling University
Glasgow University Heriot-Watt University Strathclyde University
Kingston UniversityGISRUK Conference
(Nottingham)Edinburgh University
Autumn 2010 Cardiff University
Aberdeen UniversityLancaster UniversityGlasgow University
Civil Engineering
Biological Sciences
Planning
Environmental Sciences
Architecture
Information Technology
Retailing
Climate
Sociology
Library Science Landscape Planning
Archaeology
Mathematics
Health
Ecology
Geosciences
Computing Spring 2011
Oxford University Northumbria University
Stirling University Strathclyde University
Leeds UniversityCambridge University
ShareGeo OpenShareGeo Open Key to delivering a Spatial Data Infrastructure (SDI) for the UK academic GI community.
A repository for deposit and extraction of spatial data.
Supports access to and sharing of spatial data.
Holds national and international spatial datasets (raster, vector and tabular).
ArcGIS plugin to create metadata to deposit with data.
Spatial dataset extractionSpatial dataset extraction
Spatial data submission: simple metadata record form to complete with extents extracted from datasetSpatial data submission: simple metadata record form to complete with extents extracted from dataset
Ordnance Survey (OS OpenData)
ShareGeo DigimapShareGeo Digimap Addresses issues pertaining to spatial data derived from
licensed data.
Addresses issues pertaining to spatial data derived from
licensed data.
Current and future activitiesCurrent and future activities
Rebuild Go-Geo! portal with GeoNetworkRebuild Go-Geo! portal with GeoNetworkGeoNetwork: A standards based, free and open source catalogue application to manage spatially referenced resources through the web.
Provides metadata editing and search functions as well as an embedded interactive web map viewer.
Rebuild Go-Geo! portal with GeoNetworkRebuild Go-Geo! portal with GeoNetworkGeoNetwork: A standards based, free and open source catalogue application to manage spatially referenced resources through the web.
Provides metadata editing and search functions as well as an embedded interactive web map viewer. http://www.flickr.com/photos/
mndrix/4203609704/http://www.flickr.com/photos/
mndrix/4203609704/
-UK AGMAP 2.1-Guidelines
-Geodoc metadata tool-Go-Geo! portal nodes
-Workshops-eLearning objects
Geography
Archaeology
Geological Sciences
Biological Sciences
Research
Offer Go-Geo! resources for local spatial data management
UK AGMAP 2Guidelines
Geodoc tadata toolCustomised Go-Geo! Portal
NodesTraining
Geography
Archaeology
Geological Sciences
Biological Sciences
Go-Geo!
Go-Go!
Go-Geo!
University A
UK AGMAP 2 Guidelines
Geodoc metadata toolCustomised Go-Geo! Portal
NodesTraining
Geography
Archaeology
Geological Sciences
Biological Sciences
Go-Geo!
Go-Go!
Go-Geo!
University B
UK AGMAP 2Guidelines
Geodoc metadata toolCustomised Go-Geo! Portal
NodesTraining
Geography
Archaeology
Geological Sciences
Biological Sciences
Go-Geo!
Go-Go!
Go-Geo!
University C
UK AGMAP 2Guidelines
Geodoc metadata tool Customised Go-Geo! Portal
NodesTraining
Geography
Archaeology
Geological Sciences
Biological Sciences
Go-Geo!
Go-Go!
University D
Go-Geo!
Open Spatial Data Infrastructure (SDI) Open Spatial Data Infrastructure (SDI) for UK academiafor UK academia
Otherresources and portals
Spatial Data Spatial Data RepositoryRepository
Spatial data
Metadata
Search
Datauser
Metadata
Discover
Locate
Access
Use
Publish
Fit for purpose?
Preserve
Steps to data immortality
Questions?
Using the Geodoc Metadata Editor Tool to create a valid geospatial metadata record
Practical 1
Access MyGoGeo! to enter contact details.
Read description of CORONA satellite image dataset.
Access Geodoc Metadata Editor tool and open reference documents on home page.
Create and save a valid metadata record referencing the information provided for the CORONA satellite image dataset.
Export the metadata record into UK AGMAP 2.1 format using XML and PDF output.
Publish metadata record.
Using the Go-Geo portal to access a ShareGeo Open spatial dataset
Practical 2
Conduct a search using the Go-Geo! portal.
Open and read the metadata record.
Access the ShareGeo Open spatial dataset via link provided in metadata record.
top related