federated search: the good, the bad and the ugly
DESCRIPTION
Presented at the SLA 2007 Annual Conference in Denver, CO to the Science and Technology Division (Sci-Tech) on a program entitled: "Federated Searching: The Good, The Bad and the Ugly." Based on an article in Searcher and with additional contributions from Kathy Dabbour and Lynn Lampert on user and librarian assessment of Federated Searching.TRANSCRIPT
![Page 1: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/1.jpg)
The Good, The Bad and the Ugly of Federated
SearchingBy
Doris Helfer, Chair, Library Technical Services, and Science Librarian, CSU
NorthridgeJina Wakimoto, Faculty Director for Cataloging
and Metadata Services Dept., University of Colorado at Boulder
SLA Annual ConferenceJune 5, 2007
![Page 2: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/2.jpg)
Background• CSU system - 23 campuses• History of consortial purchases• CSU Council of Library Directors (COLD)
• CSU Chancellor’s Office purchased one MetaLib server accessible to all 23 CSU campuses.
![Page 3: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/3.jpg)
Implementation Teams
• CSU System Implementation Team– UIAS Project Manager
• Northridge Implementation Team– Systems, Cataloging, Reference, Collection Development
![Page 4: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/4.jpg)
Implementation Process• Coordination with consortium (CSU System)
• Data population– MetaLib Global KnowledgeBase– Consortium (CSU System) – Campus
• Customization– Subject categories and resources– Interface
• Promotion and training
![Page 5: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/5.jpg)
First Version
![Page 6: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/6.jpg)
Next Version
![Page 7: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/7.jpg)
The Good• Simultaneous search
– Heterogeneous resource types
• Define user attributes• Personal portal
– Search history and alerts from multiple resources
– Personal database and E-journal lists
• Integration with OpenURL– Discovery and Delivery
![Page 8: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/8.jpg)
The Bad• Cross-database search• Limited search capability• Intermixes meta-searchable with non- meta-searchable resources
• Differences in thesauri, index• De-duping
![Page 9: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/9.jpg)
lke
![Page 10: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/10.jpg)
![Page 11: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/11.jpg)
The Ugly
• Time-outs and extreme slowness
• Interface too complex
• Not intuitive to follow & no help offered
![Page 12: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/12.jpg)
![Page 13: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/13.jpg)
Hopeful Signs
• More searching methods
• Clustering of Results
• X-Server to allow separation of front-end interface with back-end MetaLib
![Page 14: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/14.jpg)
X-Server Experiment• MetaLib X-Server
– XML Server– Application Programming Interface (API)
• Xerxes.calstate.edu– http://library.csusm.edu/search/– http://pharos.sjsu.edu/sanjose/databases/ElementaryEducation
![Page 15: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/15.jpg)
![Page 16: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/16.jpg)
![Page 17: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/17.jpg)
![Page 18: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/18.jpg)
Xerxes• Requires knowledge of programming, PHP 5, XML, XSLT
• Server to host the application
• Still requires MetaLib management
![Page 19: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/19.jpg)
Advantages• Customize for local needs
– Information for your users– Features for your users– Structure options for your library and users
• Interface easier to change and maintain
• Integration with campus systems
![Page 20: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/20.jpg)
Ideal Federated Search• Google Universal Search
– All content sources (no silos)– Local indexing of full text– Weakness - lack of licensed content
• USASearch.gov– Clustering of results
![Page 21: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/21.jpg)
![Page 22: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/22.jpg)
![Page 23: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/23.jpg)
Falling Down the Portal: Adventures in Federated Metasearch Technology at California State University
Northridge
Full Presentation by
Lynn Lampert, Coordinator of Instruction & Information
Literacy, Metalib Implementation Task Force Member at
California State University Northridge
Katherine Strober Dabbour, Library Assessment Coordinator and HSI Grant Project Director at
California State University, Northridge
at LITA National Forum, San Jose, California
October 1, 2005
![Page 24: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/24.jpg)
User Assessment Focus
• CSUN users• Satisfaction with service• Knowledge of service• Who is using Metasearch
![Page 25: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/25.jpg)
User Assessment Research Questions
• Compare direct database searching with Metasearch
• Ease of Metasearch use• Knowledge of Metasearch• Demographics• Comments
![Page 26: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/26.jpg)
User Assessment Instrument
• Web-based survey• CTL Silhouette Flashlight™ (http://flashlightonline.wsu.edu)
• 18 questions– 16 close-ended– 2 open-ended
• Distributed via Library home page and Metasearch login
![Page 27: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/27.jpg)
User Assessment Findings
• CSUN status– Grad: 62%– Undergrad: 31%– Faculty: 8%
![Page 28: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/28.jpg)
User Assessment Findings
Frequency of Database vs. Metasearch Use
0%
5%
10%
15%
20%
25%
30%
35%
40%
1/week 1/month 1/semester 1/year Never
Frequency
Percent
Databases Metasearch
![Page 29: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/29.jpg)
User Assessment Findings
Expectations of Finding Relevant Resources
0%
10%
20%
30%
40%
50%
60%
70%
Always Mostly Sometimes Rarely Never
Frequency
Percent
Databases Metasearch
![Page 30: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/30.jpg)
User Assessment Findings
Metasearch vs. Databases Ease of Use
0%
10%
20%
30%
40%
50%
60%
Much easier Easier About thesame
More difficult Much moredifficult
Percent
![Page 31: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/31.jpg)
User Assessment Findings
• Metasearch and Info Lit … – Had formal library instruction?
• Yes: 84%• No: 15%
– 62% of users said it does not require librarian training; 38% said it does
– 60% found out about it during a library instruction session; 20% “just by clicking on it”
![Page 32: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/32.jpg)
User Assessment Findings
• Knowledge of Metasearch . . .– Allows limiting to scholarly journals only?: 68% yes; 32% no
– Allows multi-db search with one interface?: 92% true; 8% false
– Allows single db search with one interface?: 80% true; 20% false
![Page 33: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/33.jpg)
User Comments Summary
• Comments from 15 out of 26 (58%) survey respondents– Positive: 66%– Negative: 27%– Neutral: 6%
![Page 34: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/34.jpg)
User Suggestions• Easier navigation to save articles/searches
• Easier navigation from MySpace to current search
• Difficult to refine a search from the beginning. Needs a Boolean “cheat sheet.”
• More difficult to find full text articles than in the individual databases
• Problems logging in since upgrade
![Page 35: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/35.jpg)
User Assessment Summary
• Frequency of use, expectations of finding relevant resources, and importance to research were similar to direct searching of databases.
• Metasearch considered easier to use than databases by majority.
• Majority had IL instruction and considered themselves having very good to excellent IL skills.
• While most found out about Metasearch in an IL session, only 38% felt they needed instruction to learn how to use it.
• However, only 32% realized you could not limit results to scholarly journals.
• Most comments were positive, with constructive criticism.
![Page 36: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/36.jpg)
Librarian Assessment Focus
• Librarians from many academic institutions (33 different institutions in total)
• Experiences using Metasearching
• Used Web based survey with 10 open ended questions
![Page 37: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/37.jpg)
Librarian Assessment Summary
• Most are negative about teaching federated searching
• While not required to teach it, they are confident in their skills to do so, not confident in the technology, and will teach it when appropriate to the question
• Information Literacy impact seen as equally negative or neutral
• Majority prefer to teach the native interface of individual databases
![Page 38: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/38.jpg)
Librarian vs. Patron Summary
• Findings: librarians are more negative than students.
• Librarians may have deeper understanding of the implications of federated searching.
• Patrons seem to consider it another tool in their search arsenal.
![Page 39: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/39.jpg)
Concluding Remarks• Clearly students want one stop shopping experience they get in Google!
• Current federated search software have a long way to go to compete.
• Advantage Google - Speed and Simplicity
• Advantage Federated Search - Deeper scholarly content
![Page 40: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/40.jpg)
Bibliography• Crawford, Walt (2004)
Meta, Federated, Distributed: Search Solutions / by Walt Crawford. American Libraries Online.
• Helfer, Doris Small and Wakimoto, Jina. (2005). “Metasearching: The Good, The Bad, and the
Ugly of Making it Work in Your Library,” Searcher, Vol. 13, No. 2. p.40-41.
• Luther, Judy. (2003). “Trumping Google? Metasearching’s Promise,” Library Journal, Vol.128, No.16 (10/1/03), p.36-39.
• Pace, Andrew. (2004). “Much Ado About Metasearch” American Libraries Online
![Page 41: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/41.jpg)
Bibliography
• Tennant, Roy. (2003). “The Right Solution: Federated Search Tools”. Library Journal, Vol. 128, No. 11. p. 28-29.
• Rochkind, Jonathan. (2007). “(Meta)search Like Google”. Library Journal, Vol.132, No. 3. p. 28-30.
• Tenopir, Carol. (2007). “Can Johnny Search?” Library Journal, Vol.132, No. 2. p. 30.
![Page 42: Federated Search: The Good, The Bad And The Ugly](https://reader038.vdocuments.us/reader038/viewer/2022103109/546d5f49af795963268b523d/html5/thumbnails/42.jpg)
Contact Information• Doris Helfer [email protected]• Jina Wakimoto [email protected]• Kathy Dabbour [email protected]• Lynn Lampert [email protected]