extensible catalog - afternoon session - tilburg

eXtensible CatalogDavid Lindahl

University of Rochester

Metadata Management and Connectivity

• XC OAI Toolkit– Make metadata available from a repository or ILS that does not

already have a standard interface– Once added, any OAI-PMH harvester can maintain a

synchronized copy of data in that repository• XC NCIP Toolkit

– Access to local authentication system (ILS, LDAP)– Access to circulation system in an ILS for status and placing

requests• XC Metadata Services Toolkit

– Metadata management tools– Pluggable services including aggregation, FRBR-ization and

record cleanup

XC OAI Toolkit

• Moves metadata with OAI-PMH– OAI Toolkit + ILS– OAI Toolkit + repository– OAI-PMH works with any metadata schema– Performance

• All XC components can talk OAI-PMH

XC NCIP Toolkit

• Integrates circulation with NCIP – NCIP Toolkit + ILS– XC discovery interface uses NCIP– Live circulation status– Authentication– Places circulation requests (hold, recall, etc)

ILS RepositoryILS RepositorySources

XC Software Overview

XC Metadata Services Toolkit

Aggregation

Normalization

FRBRization

Authority Control

Metadata management

software

XC Drupal Toolkit

XC LMS Toolkit

Web application platforms

OAI NCIP OAI

Web ContentManagement

System

Next-GenerationCatalog Software

OAI Harvester OAI Harvester

XC OAI Toolkit

ConnectivitySoftware

XC NCIP Toolkit

XC OAI Toolkit

XC Software Overview

ILS RepositoryILS RepositorySources

XC Metadata Services Toolkit

Aggregation

Normalization

FRBRization

Authority Control

Metadata management

software

XC Drupal Toolkit

XC LMS Toolkit

Web application platforms

OAI NCIP OAI

Web ContentManagement

System

Next-GenerationCatalog Software

OAI Harvester OAI Harvester

XC OAI Toolkit

ConnectivitySoftware

XC NCIP Toolkit

XC OAI Toolkit

OAI Toolkit Software

Convertto XC-item

OAI-PMH Provider

Convert

Database(XML records)

Modify

OAI Toolkit Server Machine

Load

MARCXML records and XC-item records available for harvest via

OAI-PMH protocol

ILS software

MARC HoldingRecords

MARC AuthorityRecords

Item Data

MARC Bibliographic Records

ILS Server Machine

These records are stored in folders

setup by OAI Toolkit

MARCXML

MARCXML

Scheduleto run nightly

XC item

Convert, Modify and Load Script

RAW MARC

Raw item data export file

ILS Export Script

Scheduleto run nightly

ILS Item-data Export Script

ILSSources

XC OAI Toolkit

ConnectivitySoftware

NCIP Toolkit

ILS (Voyager)

Aleph Interface

III Interface

Illiad Interface

Voyager Interface

Request Listener

Request Handler

ILS Interface

Configuration File

ILSSources

ConnectivitySoftware

XC NCIP Toolkit

ILS RepositoryILS RepositorySources

XC Software Overview

XC Metadata Services Toolkit

Aggregation

Normalization

FRBRization

Authority Control

Metadata management

software

XC Drupal Toolkit

XC LMS Toolkit

Web application platforms

OAI NCIP OAI

Web ContentManagement

System

Next-GenerationCatalog Software

OAI Harvester OAI Harvester

XC OAI Toolkit

ConnectivitySoftware

XC NCIP Toolkit

XC OAI Toolkit

XC Metadata Services Toolkit

• Enables libraries to aggregate metadata and run services on it

• User interface for library staff, not end users• NOT a metadata editor (but can eventually

incorporate one)• Services– Automated– Configurable– Pluggable

10

How the XC MST works• OAI-PMH Harvester– Register remote OAI-PMH repositories to pull

metadata from, select subsets– Schedule harvests to pull incremental changes

• Local storage– Stores harvested metadata in any XML format– Stores results of processing by services

• OAI-PMH providers (repositories)– Makes all locally stored metadata available to other

harvesters– Make improved metadata available

11

How the XC MST works• Services

– Downloadable, plug-in services that process metadata and make new versions of the metadata

– XC provides some services, or build your own• Orchestration

– Select metadata for processing and sequence it through services• Faceted browse interface

– Library staff can browse harvested and processed metadata– Works with any XML schema

• Logs– Debug issues with harvested or processed metadata

12

XC advantages for metadata

• Enables automated handling of metadata changes:– New records, updates, deletes– Propagates changes throughout the system

• Web interfaces for trouble-shooting• Low risk of data corruption (easy to fix)• Ideal platform for experimentation

13

New roles for catalogers

• Design and test metadata services• Manage flow of metadata • System/application design• User research

14

XC metadata services

• Normalization– Transform metadata so that it can be displayed

• Schema transformation: – MARCXML to XC, DC to XC

• “FRBRization”• Authority control matching• Aggregation

15

Normalization Services

• MARCXML, Dublin Core• Stays in same schema• Prepares metadata for use in web applications

(faceted browse interface) or back into an ILS• Examples of normalized coded data:– Location codes– Languages– Type of material

16

Transformation Services

• MARCXML to XC Schema; DC to XC Schema• Parses data into FRBR Group 1 entity structure

(work, expression, manifestation, item, plus holdings)

• Creates additional works and expressions for MARC analytics (7XX fields)

17

Authority Control Services

• MARCXML, Dublin Core• Match headings against MARCXML authority

resource file• Populate records with authority control

identifier• Tool for debugging probable, unlikely matches• Prototype developed by RIT students

18

Aggregation Service

• Prepares metadata for use in XC user interfaces (Drupal and LMS Toolkits)

• Aggregates records that represent the same resource

• Manages relationships between records• Will give us experience managing FRBRized

records

19

eXtensibleCatalog.orgDavid.Lindahl@rochester.edu

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

21

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

22

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

23

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

24

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

25

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

26

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

27

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

28

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

29

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

Error Info

30

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

31

Metadata Services Toolkit

• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available

Metadata Services Toolkit

Record CleanupFRBRization

Authority ControlAggregation

• Metadata Tools:

32