Slide 1

Jennifer Bowen, University of RochesterCLA Preconference, Shaping Tomorrows Metadata with RDA June 2, 2010, Edmonton, Alberta

The eXtensible Catalog

Preparing Library Metadata for New Environments and Standards

11AgendaAbout the eXtensible Catalog (XC)Library metadata issues that XC can addressOverview of XC SoftwareXC Metadata Services Toolkit (MST) and Services XCs User InterfaceStatus of XC Development22What does XC have to do with RDA?33What is XC? eXtensible Catalog is open source, user-centered, next generation software for libraries.

Four XC software components: used together, provide an end-to-end discovery system to connect library users with resources

or components can be used independently to address a particular need.

44XC Project Partners, SupportersUniversity of RochesterThe Andrew W. Mellon FoundationConsortium of Academic and Research Libraries in Illinois (CARLI)University of Notre Dame Rochester Institute of TechnologyKyushu University working with NTT-DataUniversity of North Carolina at CharlotteSerials SolutionsUniversity at BuffaloCornell UniversityYale UniversityOhio State UniversityNylink5

XC - Worldwide

XCO Meeting ParticipantsOCLCLibrary of CongressOhioLINKVUFind (Villanova)LYRASISOLE (Penn, Duke, NC State)Rice UniversityRDA development (IMT)

77Current Metadata SituationMetadata experts disagree about how to/whether to make changes

Making major changes to library metadata and systems is expensive

Legacy MARC metadata is holding us back

88Pressing Metadata Questions Do we need a replacement for the MARC formats? Who will design it? Maintain it? Implement it?How do we migrate legacy metadata into a new format/schema?What will be the impact of RDA? How can we make library metadata function independently on the web, outside of library systems?99Regarding MetadataHow do we even get started?1010XC Software: A Place to Start Opportunities to make the best possible re-use of library metadata An architecture for moving and managing metadata A low-risk way to try new things while also maintaining the status quo

1111Metadata goals for XCEnable harvesting and aggregating metadata from multiple repositories Define a FRBR-based metadata schema to support XCs user-interface functionalityDesign a new type of staff client for processing large batches of metadata through an orchestrated set of services

1212XC Metadata OpportunitiesFRBRization

RDA in a non-MARC Environment

Linked Data (Semantic Web)

1313XC Software OverviewUser InterfaceFaceted, FRBRized, customizable search interfaceBuilt on a web application framework (Drupal)Metadata ToolsAutomated processing of large batches of metadata Connectivity ToolsBetween XC and an ILSHarvest and synchronize metadata with OAI-PMHCirculation and authentication with NCIP

1414MARCXMLDCXC Software ComponentsUser Interface for searching and browsingLibrary Website (on Drupal)Integrated Library SystemRepositoryXC Drupal ToolkitTools for automated processing of large batches of metadataXC Metadata Services ToolkitTools for connectivity between XC and an ILSXCCirc. Status/Req.AuthenticationXC NCIP Toolkit15XC OAI Toolkit3 categories[click] Existing repositories (gray)[click] OAI & NCIP[click] Harvest MARCXML and DC and MST batch processing on metadata[click] Converts to XC Schema and k] Drupal Toolkit XC User Interface and Drupal (grey box)[click] dotted NCIP arrow

15User Interface for searching and browsingTools for automated processing of large batches of metadataTools for connectivity between XC and an ILSMARCXMLDCLibrary Website (on Drupal)Integrated Library SystemRepositoryXC Drupal ToolkitXC Metadata Services ToolkitCirc. Status/Req.AuthenticationXC NCIP ToolkitXC OAI ToolkitMetadata Services ToolkitXC16Library Website (on Drupal)Integrated Library SystemRepositoryXC Drupal ToolkitCirc. Status/Req.AuthenticationXC NCIP ToolkitXC OAI Toolkit16Metadata Services ToolkitServices clean up/normalize inconsistent metadataAggregate metadata from multiple repositoriesConverts MARC/Dublin Core metadata into XC Schema metadata for use in XC User InterfaceMST is not a metadata editor (but can eventually incorporate one)

1717 XC Metadata ServicesNormalization Transformation Aggregation Authority Control

1818Normalization ServiceMetadata stays in same schemaCorrects frequent errorsPrepares metadata for use in other applicationsNow available: MARCXML NormalizationIn development: Dublin Core NormalizationServices for any XML data possible!

1919Transformation ServiceAutomates the transformation of metadata from one schema to anotherAny XSLT schema crosswalk can be incorporated into the Transformation ServiceCreates XC Schema records for use within a complete XC SystemNow available: MARCXML to XC SchemaIn development: DC to XC Schema2020Creating XC Schema Records Transformation Service parses flat MARC records into linked FRBR-based records (work, expression, etc.)One input record results in several output recordsMaintains relationships between input records

2121MARC to XC Schema TransformationXC WorkXC ExpressionXC ManifestationXC Holdings MARC BibliographicMARC Holdings 22Uplinks maintain relationshipsXC WorkXC ExpressionXC ManifestationXC Holdings MARC BibliographicMARC Holdings 004 uplinkWork ExpressedExpression ManifestedManifestation Held23More About the XC SchemaFlexible, extensibleOptimized to enable XC functionalityNot intended for general useCan be as complex as it needs to be Will give us experience manipulating separate records that represent individual FRBR levels

24Whats in the XC Schema? Dublin Core termsRDA elementsRDA rolesMARC vocabulariesXC elements Newly-defined2525Metadata shopping Dublin Core termsRDA elementsRDA rolesMARC vocabulariesXC elements Newly-defined26

26XC Schema Elements: RDA22 RDA elements 11 RDA role designators Retain granularity in current MARC data:FrequencyNumbering of SerialsCoordinates of Cartographic ContentPlate number (music)

2727Aggregation ServiceAggregates records that represent the same resource (manifestation-level identifiers)Manages relationships between records (FRBR entities, etc.)Enables automated synchronization of updates for records at each FRBR level Sets stage for future non-MARC RDA implementation 2828Authority Control ServiceMARCXML, Dublin CoreMatch headings against MARCXML authority resource filePopulate records with authority control identifierTool for debugging probable, unlikely matchesPrototype developed by RIT studentsDevelopment planned for 20102929User Interface for searching and browsingTools for automated processing of large batches of metadataTools for connectivity between XC and an ILSMARCXMLDCLibrary Website (on Drupal)Integrated Library SystemRepositoryXC Drupal ToolkitXC Metadata Services ToolkitCirc. Status/Req.AuthenticationXC NCIP ToolkitXC OAI ToolkitMetadata Services Toolkit FunctionalityXC30Library Website (on Drupal)Integrated Library SystemRepositoryXC Drupal ToolkitCirc. Status/Req.AuthenticationXC NCIP ToolkitXC OAI Toolkit30Metadata Services Toolkit TasksAdd RepositoriesSchedule HarvestsAdd Metadata ServicesAdd Processing RulesBrowse RecordsView LogsSet up Users/Groups

31Get metadataVerify results/ TroubleshootingTell MST what to do with metadataAdmin functions31MST Add Repositories32

To tell the MST about a repository, give it a name of your choice and enter the URL.

The MST will automatically do a handshake with it and provide Success or Error messages for each step .When successful, the MST reports on available formats and sets in the remote database.

[click] name and URL[click] - handshake[click] - success or error messages[click] - tells you sets and formats supported[click]

32MST Schedule Harvests33

Functions:

Add RepositoriesSchedule HarvestsAdd Metadata ServicesAdd Processing RulesBrowse RecordsView LogsSet up Users/Groups33MST Add Metadata Services34

Functions:

Add RepositoriesSchedule HarvestsAdd Metadata ServicesAdd Processing RulesBrowse RecordsView LogsSet up Users/Groups34MST - Add Processing Rules35

Functions:

Add RepositoriesSchedule HarvestsAdd Metadata ServicesAdd Processing RulesBrowse RecordsView LogsSet up Users/Groups35MST - Add Processing Rules36

36MST - Browse Records37

Browse Records includes full-text search and faceted browse Examples of Facets:RepositoryService SchemaErrors 37MST - Browse Records38

Library staff use Browse Records to verify that services are functioning properly and to debug any issues.

The MST preserves the original record and new records produced by each metadata service.Navigation links take you to predecessor and successor records.

38MST - Browse Records39

Navigation to full record display

39MST - Browse Records40

ErrorsEach service can register error messages and attach errors to specific records.

Errors are facets in the MST.

40MST Full Record Display41

Full Record Display: MARC Holding Record

Administrative metadata managed by the MST

XML viewer (supports any XML schema)

Predecessor and Successor links

41MARCXMLDCXC Software ComponentsUser Interface for searching and browsingLibrary Website (on Drupal)Integrated Library SystemRepositoryXC Drupal ToolkitTools for automated processing of large batches of metadataXC Metadata Services ToolkitTools for connectivity between XC and an ILSXCCirc. Status/Req.AuthenticationXC NCIP Toolkit42XC OAI Toolkit42User Interface for searching and browsingTools for automated processing of large batches of metadataTools for connectivity between XC and an ILSDrupal Toolkit (User Interface)43Integrated Library SystemMARCXMLDCLibrary Website (on Drupal)RepositoryXC Drupal ToolkitXC Metadata Services ToolkitXCCirc. Status/Req.AuthenticationXC NCIP ToolkitXC OAI ToolkitIntegrated Library SystemMARCXMLDCRepositoryXC Metadata Services ToolkitXCCirc. Status/Req.AuthenticationXC NCIP ToolkitXC OAI Toolkit43XC User Interface FeaturesExtensive Customization of ThemesFacet definitionsDisplaysIndexesTakes advantage of XC Schema, metadata granularity, FRBRized metadata structure4444Kyushu University Library Drupal UI

45Top page is designed, customizing the Drupal theme.45Kyushu - Search results in Japanese

Reasons why these items are shownQuery : America JapanTranslated : Faceted navigation46NICHIGAIs Book Database supplying ToCs of Japanese items has been merged.46Faceted browsing of search results47

47Customizable Facet Definitions 48

48Edit Authors/Contributors Facet49

49Edit Format Facets50

50Customizable Result Lists51

51Customizable Full Record Display 52

52Custom Browse pagesConfigured using menus, no programmingCustomize a page for particular users, collectionsPre-set a limit based upon metadata values, e.g. DVDs and Videos Electronic Journals/Databases Juvenile Materials Search a specific location5353Find DVDs and Videos54

54Find DVDs and Videos Genre Browse55

55XCs ContributionMore Control over MetadataMore Options for Customizing the User Interface 5656XC Metadata OpportunitiesFRBRization

RDA in a non-MARC Environment

Linked Data (Semantic Web)

5757Moving toward Linked DataSemantic WebURIs for all vocabularies, metadata elementsEnables library metadata to be used/understood outside of specific silos and outside of record structuresLinked data is understandable by web applications as well as by humansXC Schema, MST provide a way to get started

5858Metadata Opportunities59

What if weve gotten this ALL WRONG?

59XC Enables ExperimentationHarvests a copy of metadata from an ILS or repositoryVery low risk of data corruptionXC propagates changes throughout the systemWeb interfaces for trouble-shootingSandbox for experimentation

60

60Status of XC DevelopmentXC software available for free download via www.extensiblecatalog.org Ongoing XC development includes:testing with a range of dataperformance workcode refinementdocumentation

6161eXtensible Catalog Organization, LLC New funding/governance structureMaintains and improve XC softwareProvides guidance and direction for XCFosters a community of XC users/developers

Become an XCO sponsor!

6262XC Metadata Opportunities63

Redesigning from the Inside Out63www.eXtensiblecatalog.org Jennifer Bowenjbowen@library.rochester.edu64