open source software for libraries

Open Source Open Source Software for LibrariesSoftware for Libraries

Issues for Large Scale Issues for Large Scale librarieslibraries

Marshall BreedingMarshall BreedingDirector for Innovative Technologies and ResearchDirector for Innovative Technologies and ResearchVanderbilt UniversityVanderbilt Universityhttp://staffweb.library.vanderbilt.edu/breedinghttp://www.librarytechnology.org/

Library and Archives CanadaDecember 7, 2007

Open Source Open Source SoftwareSoftware

Broad TrendsBroad Trends

IT InfrastructureIT Infrastructure

LinuxLinux ApacheApache

– LuceneLucene– SolrSolr

MySqlMySql PostgreSQLPostgreSQL

Apache FoundationApache Foundation The Apache Software Foundation provides The Apache Software Foundation provides

support for the Apache community of open-support for the Apache community of open-source software projects. The source software projects. The Apache projectsApache projects are characterized by a are characterized by a collaborative, consensus based development collaborative, consensus based development process, an open and pragmatic software process, an open and pragmatic software license, and a desire to create high quality license, and a desire to create high quality software that leads the way in its field. We software that leads the way in its field. We consider ourselves not simply a group of consider ourselves not simply a group of projects sharing a server, but rather a projects sharing a server, but rather a community of developers and users.community of developers and users.

http://www.apache.org/http://www.apache.org/

Web Server deploymentWeb Server deployment

Source: Netcraft www.netcraft.com

Operating System Market Operating System Market ShareShare

IDC figures for OS on new server IDC figures for OS on new server shipments 3Q 2007:shipments 3Q 2007:

Windows Server: Windows Server: 67.1% 67.1% Linux: Linux: 22.8% 22.8%

– Slight gain for Windows/loss for Linux Slight gain for Windows/loss for Linux over previous quarterover previous quarter

TrendsTrends

Open Source Software well Open Source Software well established in for general IT established in for general IT infrastructureinfrastructure

Linux emerging as the dominant Linux emerging as the dominant flavor of Unixflavor of Unix

Commercial options continue to Commercial options continue to prosperprosper

Open Source Library Open Source Library SoftwareSoftware

(non-ILS)(non-ILS)

General Infrastructure General Infrastructure ComponentsComponents

Index DataIndex Data– YAZ toolkitYAZ toolkit

Z39.50Z39.50 SRU/WSRU/W

– Zebra XML Search EngineZebra XML Search Engine– MetaproxyMetaproxy

““metasearching proxy front end server for metasearching proxy front end server for integrating access to multiple back-end integrating access to multiple back-end Z39.50-compliant databases”Z39.50-compliant databases”

Open source software from Open source software from OCLCOCLC

http://www.oclc.org/research/softwarhttp://www.oclc.org/research/software/e/

Several OAI utilitiesSeveral OAI utilities– OAIcatOAIcat– OAIHarvesterOAIHarvester

SRU/WSRU/W OpenURL 1.0OpenURL 1.0 Pears: text storage and indexingPears: text storage and indexing

Digital Repository Digital Repository ApplicationsApplications

FedoraFedora

Open source digital repository engineOpen source digital repository engine Not an out-of-the-box solutionNot an out-of-the-box solution

– Many organizations have developed Many organizations have developed their own interfaces and applications their own interfaces and applications built on top of Fedorabuilt on top of Fedora

VTLS Vital product based on FedoraVTLS Vital product based on Fedora Supported by Fedora CommonsSupported by Fedora Commons

– http://www.fedora-commons.org/http://www.fedora-commons.org/

DspaceDspace

Institutional Repository ApplicationInstitutional Repository Application Originally developed by Hewlett Originally developed by Hewlett

Packard and MITPackard and MIT http://www.dspace.orghttp://www.dspace.org Widely deployed by Universities for Widely deployed by Universities for

institutional repository projectsinstitutional repository projects

KeystoneKeystone

Developed by Index DataDeveloped by Index Data Open source digital repository Open source digital repository

applicationapplication– Digital content managementDigital content management– Federated searchFederated search– OAI harvestingOAI harvesting– Link resolver servicesLink resolver services

LibraryFindLibraryFind

Open source federated searchOpen source federated search Built-in OpenURL resolverBuilt-in OpenURL resolver 3-teired caching 3-teired caching Customizable interfaceCustomizable interface Developed by the University of Developed by the University of

Oregon LibrariesOregon Libraries

Open source Open source discovery productsdiscovery products

Aka: Next Generation Aka: Next Generation CatalogsCatalogs

VUFind – Villanova VUFind – Villanova UniversityUniversity

Based on Apache Solr search Based on Apache Solr search toolkittoolkit

http://www.vufind.org/http://www.vufind.org/

eXtensible CatalogeXtensible Catalog

University of Rochester – River Campus University of Rochester – River Campus LibrariesLibraries

Financial support from the Andrew W. Financial support from the Andrew W. Mellon FoundationMellon Foundation

http://www.extensiblecatalog.info/http://www.extensiblecatalog.info/– Just received a second round of funding from Just received a second round of funding from

MellonMellon $283,000 (April 2006)$283,000 (April 2006) $749,000 (October 2007)$749,000 (October 2007)

– Wider institutional participationWider institutional participation

Fac-Back-OPAC Fac-Back-OPAC

Initially developed Dan Scott Initially developed Dan Scott Laurentian University Laurentian University

Further work by Casey Durfee at the Further work by Casey Durfee at the Seattle Public LibrarySeattle Public Library

Based on:Based on:– MARCXMLMARCXML– SolrSolr– Django (Python-based Web application Django (Python-based Web application

framework)framework)

Open Source in the Open Source in the ILS arenaILS arena

Products and trendsProducts and trends

Koha: first Open Source ILSKoha: first Open Source ILS

Koha + Index Data Zebra = Koha Koha + Index Data Zebra = Koha ZOOMZOOM

Components:Components:– PerlPerl– ApacheApache– MySqlMySql– Zebra: search engine option for larger Zebra: search engine option for larger

installationsinstallations

Libraries using KohaLibraries using Koha ~300 (mostly small) libraries~300 (mostly small) libraries

Horowhenua Library TrustHorowhenua Library Trust Nelsonville Public LibraryNelsonville Public Library

– Athens County, OHAthens County, OH Crawford County Federated Library SystemCrawford County Federated Library System

– 10 Libraries in PA10 Libraries in PA Howard County, MDHoward County, MD

– Service area population: Service area population: 266300266300 – 4.7 million circulation transactions in 20064.7 million circulation transactions in 2006– 1 million volumes1 million volumes

Central Kansas Library SystemCentral Kansas Library System Near East University LibraryNear East University Library

– 1.5 million volumes1.5 million volumes

KohaKoha

EvergreenEvergreen

Developed by the Georgia Public Developed by the Georgia Public Library ServiceLibrary Service

Small development teamSmall development team June 2004 – development beginsJune 2004 – development begins Sept 5, 2006 – live productionSept 5, 2006 – live production Streamlined environment: single Streamlined environment: single

shared implementation, all libraries shared implementation, all libraries follow the same policies, one library follow the same policies, one library cardcard

Libraries using EvergreenLibraries using Evergreen

Georgia PINESGeorgia PINES– http://gapines.orghttp://gapines.org

260 libraries in Georgia260 libraries in Georgia– Does not include municipal systems: Atlanta-Does not include municipal systems: Atlanta-

Fulton County, Cobb CountyFulton County, Cobb County Province of British Columbia in Canada – Province of British Columbia in Canada –

Northern PINESNorthern PINES Experimental evaluationExperimental evaluation

– King County Library System in WA state.King County Library System in WA state. Under consideration by academic Under consideration by academic

libraries in Canadalibraries in Canada

EvergreenEvergreen

Learning Access ILSLearning Access ILS

Learning Access InstituteLearning Access Institute Turnkey Open Source ILSTurnkey Open Source ILS Designed for underserved rural Designed for underserved rural

public librariespublic libraries http://www.learningaccess.orghttp://www.learningaccess.org

LearningAccess ILSLearningAccess ILS

SCOOLSSCOOLS

South Central Organization of South Central Organization of (School) Libraries(School) Libraries

consortium of K-12 school libraries in consortium of K-12 school libraries in NYNY

Koha derivativeKoha derivative Supported by Media FlexSupported by Media Flex

SCOOLSSCOOLS

Commercial Commercial Involvement Involvement

Companies formed to support Companies formed to support open source library productsopen source library products

The Open Source FrontThe Open Source Front Index DataIndex Data

– Founded 1994; No ILS; A variety of other open source Founded 1994; No ILS; A variety of other open source products to support libraries: search engines, federated products to support libraries: search engines, federated search, Z39.50 toolkit, etcsearch, Z39.50 toolkit, etc

LibLimeLibLime– Founded 2005. Provides development and support Founded 2005. Provides development and support

services for Koha ILS. Acquired original developers of services for Koha ILS. Acquired original developers of Koha in Feb 2007.Koha in Feb 2007.

Equinox. Equinox. – Founded Feb 2007; staff formerly associated with GPLS Founded Feb 2007; staff formerly associated with GPLS

Pines development teamPines development team Care AffiliatesCare Affiliates

– Founded June 2007; headed by industry veteran Carl Founded June 2007; headed by industry veteran Carl Grant.Grant.

LibLimeLibLime

Small private company formed in early Small private company formed in early 20052005

Devoted to support of Koha and other open Devoted to support of Koha and other open source softwaresource software

Launched by individuals involved with the Launched by individuals involved with the Koha implementation at the Nelsonville Koha implementation at the Nelsonville Public LibraryPublic Library

Recently acquired the Koha activities of Recently acquired the Koha activities of Katipo Communications (Feb 2007)Katipo Communications (Feb 2007)

Total of 9-10 FTETotal of 9-10 FTE

Equinox SoftwareEquinox Software

Small companySmall company Devoted to facilitating libraries implement Devoted to facilitating libraries implement

Evergreen the open source ILS developed for Evergreen the open source ILS developed for PINESPINES

Launched by individuals related to the Launched by individuals related to the development and implementation of Evergreen development and implementation of Evergreen at the Georgia Public Library Systemat the Georgia Public Library System

Contracts to GPLS and other libraries for the Contracts to GPLS and other libraries for the ongoing development and support of ongoing development and support of EvergreenEvergreen

Care AffiliatesCare Affiliates

Recently formed company to provide Recently formed company to provide support for Open Source library support for Open Source library automation products.automation products.

Carl Grant – Former COO of VTLS, Carl Grant – Former COO of VTLS, President of Ex Libris (USA), President of Ex Libris (USA), Innovative Interfaces, DRA, etc.Innovative Interfaces, DRA, etc.

Other Open Source Other Open Source Development effortsDevelopment efforts

Andrew W. Mellon foundationAndrew W. Mellon foundation Sponsoring project to design/build an Sponsoring project to design/build an

enterprise level automation system enterprise level automation system for libraries in higher educationfor libraries in higher education

Effort will be led by Duke UniversityEffort will be led by Duke University

Open Source AlternativesOpen Source Alternatives

Explosive interest in Open Source driven Explosive interest in Open Source driven by disillusionment with current vendorsby disillusionment with current vendors

Beginning to emerge as a practical optionBeginning to emerge as a practical option TOC (Total Cost of Ownership) still roughly TOC (Total Cost of Ownership) still roughly

equal to proprietary commercial modelequal to proprietary commercial model Open Source still a risky AlternativeOpen Source still a risky Alternative Commercial/Proprietary options also a riskCommercial/Proprietary options also a risk

Open source ILS Open source ILS BenchmarksBenchmarks

Most decisions to adopt Open Source ILS Most decisions to adopt Open Source ILS based on philosophical reasonsbased on philosophical reasons

Open Source ILS will enter the main stream Open Source ILS will enter the main stream once its products begin to win through once its products begin to win through objective procurement processesobjective procurement processes– Hold open source ILS to the same standards as the Hold open source ILS to the same standards as the

commercial productscommercial products– Hold the open source ILS companies to the same Hold the open source ILS companies to the same

standards:standards: Adequate customer support ratios, financial stability, Adequate customer support ratios, financial stability,

service level agreements, etc.service level agreements, etc. Well-document total cost of ownership Well-document total cost of ownership

statements that can be compared to other statements that can be compared to other vendor price quotesvendor price quotes

Open Source Market shareOpen Source Market share

Open Source ILS implementations still a Open Source ILS implementations still a very small percentage of the total picturevery small percentage of the total picture

Initial set of successful implementations Initial set of successful implementations will likely serve as a catalyst to pave the will likely serve as a catalyst to pave the way for othersway for others

Successful implementations in wider range Successful implementations in wider range of libraries:of libraries:– State-wide consortium (Evergreen)State-wide consortium (Evergreen)– Multi-site public library systems (Koha)Multi-site public library systems (Koha)– School district consortia (OPALS-NA)School district consortia (OPALS-NA)

Open Source perspectiveOpen Source perspective

Developer community still fairly small Developer community still fairly small relative to that in place for relative to that in place for infrastructure components (Linux, infrastructure components (Linux, Apache, etc)Apache, etc)

Are existing systems ready for large-Are existing systems ready for large-scale enterprise implementations?scale enterprise implementations?

Functionality not yet in place for Functionality not yet in place for complex libraries?complex libraries?– Yet to break into ARL library arenaYet to break into ARL library arena

Enterprise operability?Enterprise operability?