Breeding – NASIG June 6, 2008

La Nueva Generación en La Nueva Generación en Automatización de BibliotecasAutomatización de Bibliotecas

Marshall BreedingMarshall BreedingDirector for Innovative Technologies and ResearchDirector for Innovative Technologies and ResearchVanderbilt UniversityVanderbilt University

http://staffweb.library.vanderbilt.edu/breedinghttp://www.librarytechnology.org/

AbstractAbstract

““Next Generation Library Automation” Next Generation Library Automation” gives a forward-looking view of some of the gives a forward-looking view of some of the initiatives currently underway that stand to initiatives currently underway that stand to substantially revise the models of substantially revise the models of automation for libraries.automation for libraries.

Rethinking the ILSRethinking the ILS

Fundamental assumption: Print + Digital = Hybrid librariesFundamental assumption: Print + Digital = Hybrid libraries Traditional ILS model not adequate for hybrid librariesTraditional ILS model not adequate for hybrid libraries Libraries currently moving toward surrounding core ILS Libraries currently moving toward surrounding core ILS

with additional modules to handle electronic contentwith additional modules to handle electronic content New discovery layer interfaces replacing or supplementing New discovery layer interfaces replacing or supplementing

ILS OPACSILS OPACS Working toward a new model of library automationWorking toward a new model of library automation

– Monolithic legacy architectures replaced by fabric of SOA Monolithic legacy architectures replaced by fabric of SOA applicationsapplications

– Comprehensive Resource ManagementComprehensive Resource Management

“It's Time to Break the Mold of the Original ILS” Computers in Libraries Nov/Dec 2007

ILS: a legacy conceptILS: a legacy concept

ILS = Integrated Library System ILS = Integrated Library System (Cataloging + Circulation + OPAC + Serials + (Cataloging + Circulation + OPAC + Serials +

Acquisitions)Acquisitions) Focused on print and physical inventoryFocused on print and physical inventory Electronic content at the Journal Title or collection Electronic content at the Journal Title or collection

levellevel Emerged in the 1960’s – 1970’sEmerged in the 1960’s – 1970’s Functionality has evolved and expanded, but basic Functionality has evolved and expanded, but basic

concepts and modules remain intactconcepts and modules remain intact Note: Some companies work toward evolving the ILS to Note: Some companies work toward evolving the ILS to

competently handle both print and digital content (e.g. competently handle both print and digital content (e.g. Innovative Interfaces)Innovative Interfaces)

ILS: ever diminishing roleILS: ever diminishing role

Many libraries putting much less emphasis on ILSMany libraries putting much less emphasis on ILS Just an inventory system for physical materialsJust an inventory system for physical materials Investments in electronic content increasingInvestments in electronic content increasing Management of e-content handled outside of the Management of e-content handled outside of the

ILSILS Yet: libraries need comprehensive business Yet: libraries need comprehensive business

automation more than ever. Mandate for more automation more than ever. Mandate for more efficient operations. Do more with less.efficient operations. Do more with less.

Dis-integration of Library Automation Dis-integration of Library Automation FunctionalityFunctionality

ILS -- Print and Physical inventoryILS -- Print and Physical inventory OpenURL Link resolverOpenURL Link resolver Federated SearchFederated Search Electronic Resource Management ModuleElectronic Resource Management Module

– More about this laterMore about this later

Discovery layer interfaceDiscovery layer interface

Is non-integrated automation Is non-integrated automation sustainable?sustainable?

Major burden on library personnelMajor burden on library personnel Serial procurement / installation / Serial procurement / installation /

configuration / maintenance cycles take configuration / maintenance cycles take many years to result in a comprehensive many years to result in a comprehensive environmentenvironment

Inefficient data modelsInefficient data models Disjointed interfaces for library usersDisjointed interfaces for library users Very long cycle to gain comprehensive Very long cycle to gain comprehensive

automationautomation

Electronic Resource Management Electronic Resource Management SystemsSystems

Automation Module specifically designed to Automation Module specifically designed to manage a library’s subscriptions to electronic manage a library’s subscriptions to electronic contentcontent

Managed approach for all aspects of electronic Managed approach for all aspects of electronic subscription contentsubscription content– Product coverage, license terms, cost, payment and Product coverage, license terms, cost, payment and

procurement data, vendor data, use dataprocurement data, vendor data, use data COUNTER compliant use statisticsCOUNTER compliant use statistics SUSHI for automated gathering of use statisticsSUSHI for automated gathering of use statistics

Electronic Resource Management Electronic Resource Management SystemsSystems

Promising but troubled genre of software designed Promising but troubled genre of software designed to manage e-contentto manage e-content

Extending ILS acquisitions to handle license terms Extending ILS acquisitions to handle license terms and other aspects of electronic subscriptionsand other aspects of electronic subscriptions

Very slow adoption by librariesVery slow adoption by libraries Complex integration issuesComplex integration issues Products launched in 2002-2004Products launched in 2002-2004 Increased adoption expected in next 2 yearsIncreased adoption expected in next 2 years

Profile-based e-content Profile-based e-content managementmanagement

Reliance on a knowledgebase that describes the contents Reliance on a knowledgebase that describes the contents of all available publisher packages and aggregated content of all available publisher packages and aggregated content offeringsofferings

Ability to identify individual titles and articles available to Ability to identify individual titles and articles available to library users based on a profile of the library’s current library users based on a profile of the library’s current subscriptionssubscriptions

OpenURL link resolvers and ERM products both depend OpenURL link resolvers and ERM products both depend on the knowledgebaseon the knowledgebase

Synchronization of ILS through MARC update servicesSynchronization of ILS through MARC update services Efficacy of these products depends as much on the Efficacy of these products depends as much on the

accuracy and currency of the knowledgebase than the accuracy and currency of the knowledgebase than the quality of the softwarequality of the software

ERM DeploymentsERM Deployments

ProductProduct InnovativInnovative ERMe ERM

VerdeVerde 360 360 ResourceResource

ManagerManager

TDNet TDNet Open Open ERAMERAM

CompanyCompany InnovativeInnovativeInterfacesInterfaces

Ex LibrisEx Libris SerialsSerialsSolutionsSolutions

TDNetTDNet

IntroducedIntroduced June June 20022002

June June 20042004

October October 20052005

Number SoldNumber Sold 275275 169169 227227 Not Not discloseddisclosed

Number inNumber inProduction Production

UseUse

235235 2525 174174 Not Not discloseddisclosed

“Helping you buy: Electronic Resource Management Systems”Computers in Libraries: July 2008 issue

E-Journal Knowledge basesE-Journal Knowledge bases

CommercialCommercial Serials SolutionsSerials Solutions

– (KnowledgeWorks)(KnowledgeWorks) Ex LibrisEx Libris

– (SFX Global (SFX Global Knowledgebase)Knowledgebase)

TD NetTD Net Openly Informatics / Openly Informatics /

OCLCOCLC

CommunityCommunity JAKE: jointly JAKE: jointly

administered knowledge administered knowledge environment was an environment was an collaborative projectcollaborative project

Now defunct. Displaced Now defunct. Displaced by commercial ventures.by commercial ventures.

New genre of discovery layer New genre of discovery layer interfacesinterfaces

Traditional ILS OPAC inadequate for today’s Traditional ILS OPAC inadequate for today’s Web-savvy library usersWeb-savvy library users

Scope too narrowScope too narrow Complex, non-intuitive interfaceComplex, non-intuitive interface Yet: Necessary for some types of researchYet: Necessary for some types of research Working toward a single point of entry for all Working toward a single point of entry for all

the content and services offered by the the content and services offered by the librarylibrary

Common Next-Gen Interface Common Next-Gen Interface featuresfeatures

Decoupled interfaceDecoupled interface Advanced search enginesAdvanced search engines Relevancy ranked resultsRelevancy ranked results Faceted NavigationFaceted Navigation Graphically enriched displaysGraphically enriched displays Real-time interaction with ILSReal-time interaction with ILS Advanced user services and information Advanced user services and information

delivery featuresdelivery features

Current ProductsCurrent Products

Primo (Ex Libris)Primo (Ex Libris) Encore (Innovative Interfaces)Encore (Innovative Interfaces) Aquabrowser (Bowker / Serials Solutions)Aquabrowser (Bowker / Serials Solutions) WorldCat Local (OCLC)WorldCat Local (OCLC) Visualizer (VTLS)Visualizer (VTLS) eXtensive Catalog (University of Rochester)eXtensive Catalog (University of Rochester) VUFind (open source / Villanova University)VUFind (open source / Villanova University) Scriblio (open source)Scriblio (open source)

http://www.librarytechnology.org/discovery.plhttp://www.librarytechnology.org/discovery.pl

Deep searchDeep search

Entering post-metadata search eraEntering post-metadata search era Increasing opportunities to search the full contentsIncreasing opportunities to search the full contents

– Google Library Print, Google Publisher, Open Content Google Library Print, Google Publisher, Open Content Alliance, Microsoft Live Book Search, etc.Alliance, Microsoft Live Book Search, etc.

– High-quality metadata will improve search precisionHigh-quality metadata will improve search precision Commercial search providers already offer “search inside the Commercial search providers already offer “search inside the

book”book” No comprehensive full text search for books quite yetNo comprehensive full text search for books quite yet Beginning to appear in library search environmentsBeginning to appear in library search environments

– U of Mich (U of Mich (http://mblog.lib.umich.edu/blt/archives/2008/05/search_full-tex.htmlhttp://mblog.lib.umich.edu/blt/archives/2008/05/search_full-tex.html ) ) Deep search highly improved by high-quality metadataDeep search highly improved by high-quality metadataSee: Systems Librarian, May 2008 “Beyond the current generation of next-generation interfaces: deeper search”See: Systems Librarian, May 2008 “Beyond the current generation of next-generation interfaces: deeper search”

Advancement of Federated Advancement of Federated SearchSearch

Shift from Distributed Query to Centralized SearchShift from Distributed Query to Centralized Search Federated search based on distributed query:Federated search based on distributed query:

– Shallow resultsShallow results– Limited scalabilityLimited scalability– Slow performanceSlow performance

Harvest metadata or full text for creating comprehensive Harvest metadata or full text for creating comprehensive consolidated indexesconsolidated indexes– E.g. Google ScholarE.g. Google Scholar– Non-commercial efforts?Non-commercial efforts?– The Royal Library of using the Deep Search architecture to present The Royal Library of using the Deep Search architecture to present

items found in the Digital Article Database Service repository of 65 items found in the Digital Article Database Service repository of 65 million articles, housed in the Technical Information Center of million articles, housed in the Technical Information Center of Denmark. Denmark.

Architecture and StandardsArchitecture and Standards

Need to have an standard approach for Need to have an standard approach for connecting new generation interfaces with ILS connecting new generation interfaces with ILS and other repositoriesand other repositories

Proprietary and Proprietary and ad hocad hoc methods currently prevail methods currently prevail Digital Library FederationDigital Library Federation

– ILS-Discovery Interface GroupILS-Discovery Interface Grouphttp://www.librarytechnology.org/blog.pl?ThreadID=43 http://www.librarytechnology.org/blog.pl?ThreadID=43

Initial foray into a broader set of protocols that Initial foray into a broader set of protocols that open up other aspects of the ILSopen up other aspects of the ILS

For more informationFor more information

Next Generation Library Next Generation Library Catalogs by Marshall Catalogs by Marshall BreedingBreeding

Library Technology Library Technology Reports June/July Reports June/July 20072007

ALA TechSourceALA TechSource

Moving toward a new Generation of Moving toward a new Generation of Library AutomationLibrary Automation

Legacy ILS concepts not sustainableLegacy ILS concepts not sustainable New automation environment based on New automation environment based on

current library realities and modern current library realities and modern technology platformstechnology platforms

Equal footing for digital and printEqual footing for digital and print Service oriented architectureService oriented architecture

Breaking down the modulesBreaking down the modules

Traditional ILSTraditional ILS– CatalogingCataloging– CirculationCirculation– Online CatalogOnline Catalog– AcquisitionsAcquisitions– Serials controlSerials control– ReportingReporting

Modern approach: SOAModern approach: SOA

Service Oriented ArchitectureService Oriented Architecture

http://www.sun.com/products/soa/benefits.jsp

Legacy ILS + e-content modulesLegacy ILS + e-content modules

FederatedSearch

FederatedSearch

Circulation Acquisitions

Cataloging Serials

OpenURLLinking

OpenURLLinking

Electronic Resource

MgmtSystem

Electronic Resource

MgmtSystem

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

SOA model for business automationSOA model for business automation

Underlying data repositoriesUnderlying data repositories– Local or GlobalLocal or Global

Reusable business servicesReusable business services Composite business applicationsComposite business applications

SOA for library workflow processesSOA for library workflow processes

Data Stores:

ReusableBusiness Services

CompositeApplications

Granulartasks:

Web Services and the Service-Web Services and the Service-Oriented ArchitectureOriented Architecture

Library Technology Reports Library Technology Reports – May / June 2006May / June 2006

By Marshall BreedingBy Marshall Breeding ALA TechSourceALA TechSource The report includes conceptual descriptions of the The report includes conceptual descriptions of the

technology as well as some technical information on how technology as well as some technical information on how Web services are implemented. Library administrators or Web services are implemented. Library administrators or others that need to make decisions regarding library-others that need to make decisions regarding library-related technology systems or issues will gain a related technology systems or issues will gain a perspective on the importance of this technology as well as perspective on the importance of this technology as well as how the implementation of Web services may relate to how the implementation of Web services may relate to other library trends and initiatives. other library trends and initiatives.

More Open SystemsMore Open Systems

Pressure for traditionally licensed products to become more openPressure for traditionally licensed products to become more open APIs (Application Programming Interfaces) let libraries access and APIs (Application Programming Interfaces) let libraries access and

manipulate their data outside of delivered softwaremanipulate their data outside of delivered software A comprehensive set of APIs potentially give libraries more flexibility A comprehensive set of APIs potentially give libraries more flexibility

and control in accessing data and services and in extending and control in accessing data and services and in extending functionality than having access to the source code.functionality than having access to the source code.

Customer access to APIs does not involve as much risk to breaking Customer access to APIs does not involve as much risk to breaking core system functions, avoids issues of version management and code core system functions, avoids issues of version management and code forking associated with open source models.forking associated with open source models.

Breeding – NASIG June 6, 2008

A Continuum of OpennessA Continuum of Openness

Closed SystemsClosed Systems

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

No programmable Access to the system.

Captive to the userInterfaces supplied by the developer

Programmer access:

Standard RDBM SystemsStandard RDBM Systems

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

Database administrators can access data stores involved with the system:

Read-only?Read/write?

Developer shares database schema

Programmer access:

Open Source ModelOpen Source Model

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

All aspects of the system available to inspection and modification.

Programmer access:

Open API ModelOpen API Model

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

Core application closed.

Third party developers code against the published APIs or RDBMS tables.

Programmer access:

Published APIs

Open Source / Open API ModelOpen Source / Open API Model

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

Core application closed.

Third party developers code against the published APIs or RDBMS tables.

Programmer access:

Published APIs

Depth of OpennessDepth of Openness

Evaluate level of access to a products data stores Evaluate level of access to a products data stores and functional elements:and functional elements:– Open source vs Traditional licensesOpen source vs Traditional licenses

Some traditional vendors have well established API Some traditional vendors have well established API implementationsimplementations– SirsiDynix Unicorn (API available to authorized customer SirsiDynix Unicorn (API available to authorized customer

sites that take training program)sites that take training program)– Ex Libris: consistent deployment of APIs in major Ex Libris: consistent deployment of APIs in major

products, recent strategic initiative: “Open Platform products, recent strategic initiative: “Open Platform Program”Program”

– Innovative Interfaces: Patron APIInnovative Interfaces: Patron API

Universal open APIs?Universal open APIs?

Some progress on API to support discovery layer interfaces, but no Some progress on API to support discovery layer interfaces, but no comprehensive framework yet.comprehensive framework yet.

Many industry protocols work like APIs: Many industry protocols work like APIs: – Z39.50, SRU/W, NCIP, OAI-PMH, OpenURL, etdZ39.50, SRU/W, NCIP, OAI-PMH, OpenURL, etd

It would be ideal if there were an open set of APIs that were It would be ideal if there were an open set of APIs that were implemented by all automation system products.implemented by all automation system products.– Third party components and add-ons would then work across all products.Third party components and add-ons would then work across all products.

DLF ILS-Discovery Interface protocol. Targets interoperability between DLF ILS-Discovery Interface protocol. Targets interoperability between ILS and new genre of interfacesILS and new genre of interfaces

AKA: Berkeley AccordsAKA: Berkeley Accords

Breeding – NASIG June 6, 2008

Current initiativesCurrent initiatives

Comprehensive Resource Comprehensive Resource Management Management

Broad conceptual approach that proposes a library Broad conceptual approach that proposes a library automation environment that spans all types of automation environment that spans all types of content that comprise library collections.content that comprise library collections.

Traditional ILS vendors: Under development but Traditional ILS vendors: Under development but no public announcementsno public announcements

Open Source projects in early phasesOpen Source projects in early phases Projection: 2-3 years until we begin see library Projection: 2-3 years until we begin see library

automation systems that follow this approach. 5-7 automation systems that follow this approach. 5-7 years for wider adoption.years for wider adoption.

Open Library Management Open Library Management SystemSystem

Andrew W. Mellon Foundation Andrew W. Mellon Foundation – Research in Information Technology programResearch in Information Technology program– Solicited proposal / Lead institutionSolicited proposal / Lead institution

Duke University selected to lead projectDuke University selected to lead project Core Participants: Kansas University, Lehigh University, Core Participants: Kansas University, Lehigh University,

National Library of Australia, Library and Archives Canada, National Library of Australia, Library and Archives Canada, University of Pennsylvania, Marshall BreedingUniversity of Pennsylvania, Marshall Breeding

Advisory Participants: University of Chicago, Wittier Advisory Participants: University of Chicago, Wittier College, University of Maryland, Orbis Cascade Alliance, College, University of Maryland, Orbis Cascade Alliance, Rutgers UniversityRutgers University

Status: Proposal complete, pending consideration from the Status: Proposal complete, pending consideration from the Andrew W. Mellon FoundationAndrew W. Mellon Foundation

http://www.mellon.org/grant_programs/programs/rit

Breeding – NASIG June 6, 2008

Questions and DiscussionQuestions and Discussion