Upload File

a decade of discovery: what we know and where we will go

  • Home
  • Education
  • A Decade of Discovery: What We Know and Where We Will Go
24
A Decade of Discovery: What We Know and Where We Will Go Lisa Hinchliffe, William H. Mischo, Michael A. Norman November 8, 2014

Upload: charleston-conference

Post on 30-Jun-2015

70 views

Category:

Education


1 download

Report

DESCRIPTION

2014 Charleston Conference Friday, Nov 7, 11:45 AM

TRANSCRIPT

Page 1: A Decade of Discovery: What We Know and Where We Will Go

A Decade of Discovery: What We Know and Where We Will Go

Lisa Hinchliffe, William H. Mischo, Michael A. Norman

November 8, 2014

Page 2: A Decade of Discovery: What We Know and Where We Will Go

Collections Context:a distributed, heterogeneous information environment

• Annual collection budget of $15+ million• 200+ specialized article and report databases• 65K online journals• Online is, in many cases, the exclusive access point• Have a legacy online catalog (common search over

metadata, including holdings of books, journals, media, microforms, etc.)

2

Page 3: A Decade of Discovery: What We Know and Where We Will Go

AssessmentIn the book “How to Measure Anything,” Douglas Hubbard encourages working from four assessment assumptions:

1) your problem is not as unique as you think, 2) you have more data than you think, 3) you need less data than you think, and 4) an adequate amount of new data is more accessible than you think.

3

Page 4: A Decade of Discovery: What We Know and Where We Will Go

Evidence-based framework

Taking these as are our starting points, the Library’s Discovery and Delivery Study Team at the University of Illinois at Urbana-Champaign has formulated an evidence-based framework for decision-making relative to future system development.

4

Page 5: A Decade of Discovery: What We Know and Where We Will Go

Assessing Reports Over the Past Decade:• Library’s reports on implementing the

WebFeat federated search system (2005-2006),

• developing and deploying Easy Search, a locally-developed and supported broadcast search, search assistance, and recommender system (2006-present), and

• piloting Primo (2011-2014)

5

Page 6: A Decade of Discovery: What We Know and Where We Will Go

For this presentation, we will particularly concentrate on:

Analysis of user search behavior, search types, and use of assistance features through Easy Search logs (2010-present) with particular examination of Easy Search to Primo transactions and database coverage of user searches.

6

Page 7: A Decade of Discovery: What We Know and Where We Will Go

A Review of Library Reports - We Value:• Transparency• Predictability• Customizability• Co-Development Opportunities

7

Page 8: A Decade of Discovery: What We Know and Where We Will Go

A Review of a Decade of User Surveys - Users Want:

• Seamless Digital Delivery• Coherent Discovery Pathways• As Simple as Possible but Not Simplistic• Not Everything, But “My Everything”• Transparency• Independence

8

Page 9: A Decade of Discovery: What We Know and Where We Will Go

University of Illinois Library Gateway

Gateway portal introduced in September 2007, powered by Easy Search federated search system:

oRecommender and discovery systemo Employs Search Assistance mechanismsoHelps with search strategy modification and

navigationo Takes users into native interfaces at point of

completed searchoWrites out custom transaction logs

Page 10: A Decade of Discovery: What We Know and Where We Will Go

UIUC Library Gateway

Page 11: A Decade of Discovery: What We Know and Where We Will Go

Current Easy Search Results Page

Page 12: A Decade of Discovery: What We Know and Where We Will Go

BETA: Bento Easy Search Top of Screen Results

Page 13: A Decade of Discovery: What We Know and Where We Will Go

BETA: Bento Easy Search Bottom of Screen Results:

Page 14: A Decade of Discovery: What We Know and Where We Will Go

Exploring Discovery via Primo (2011-2014)

• Role of the web-scale system in the Library’s main gateway• Relationship between a web-scale system and Easy Search• Effectiveness of full-text search and relevancy ranking algorithms• Relationship between a web-scale aggregated central index and the

specialty A & I Services• Effectiveness of vendor databases (e.g., EBSCO and Scopus) when

integrated into Primo• Value of blended displays • Instructional issues connected with web-scale systems (Note – See

LOEX paper by Hinchliffe and Avery)

14

Page 15: A Decade of Discovery: What We Know and Where We Will Go

Previous Studies Have Included Custom Transaction Log Data Analysis

• Conducted studies of user behavior in the Easy Search University of Illinois Gateway

• Looked at total of 1.4 million searches and 1.5 million clickthroughs Fall 2010 and Spring 2011 semesters

• Looked at 1 million searches over 10 month period May 2013 to March 2014

• Supported by two grants: NSF and IMLS but continual effort

Page 16: A Decade of Discovery: What We Know and Where We Will Go

Transaction Logs• We have used transaction logs in the

development of context-specific and adaptive search assistance for users

• Transaction log analysis is complemented with user interviews and surveys

• Relational database of two tables with analysis using SQL queries

Page 17: A Decade of Discovery: What We Know and Where We Will Go

Looking at Primo as target in Easy Search• Between 05-01-2014 and 06-21-2014,

users clicked on one of the Primo article, Primo book, or Primo All search result links 15,068 times.

• This is out of a total of 147,326 user result clickthroughs during that 05-01 to 06-21 time period.

17

Page 18: A Decade of Discovery: What We Know and Where We Will Go

Primo clickthrough study• Between 05-01-2014 and 06-21-2014,

users clicked on one of the Primo article, Primo book, or Primo All search result links 15,068 times.

• This is out of a total of 147,326 user result clickthroughs during that 05-01 to 06-21 time period.

18

Page 19: A Decade of Discovery: What We Know and Where We Will Go

Primo Clickthrough study (More)• We looked at a sample of 473 of the 15,068

searches, categorizing searches by known-item or topical then looking at the resulting search matches from a number of targets:

• Included all the Primo results and the ACSE, Scopus, Web of Knowledge, CrossRef, WorldCat Discovery, Vufind, IShare, Summon, Google, and Google Scholar results within Easy Search.

• The success of the searches in these results targets were coded and stored in a relational database.

19

Page 20: A Decade of Discovery: What We Know and Where We Will Go

Out of the sample of 473 results:• There were 245 known-item searches in the

sample (51.8%) and 228 topical searches (48.2%).

• Of the 245 known-item searches, 159 were judged successful in that they brought back the expected results in the first page or as the top item (64.8%)

• Of the 228 topical searches, 194 were judged to have brought back some relevant results.

20

Page 21: A Decade of Discovery: What We Know and Where We Will Go

Finding Known Items:

Looking at the 159 ‘successful’ Primo known-item searches, we found that all of them were also

successfully retrieved in Scopus, EBSCO, CrossRef, WorldCat Discovery, Web of Knowledge, Google,

or Google Discovery searches.

21

Page 22: A Decade of Discovery: What We Know and Where We Will Go

Notes from analyses of Easy Search results:

• Some of the successful Primo searches were full citation searches of the form:Hemenway, D. (2010). Why We don't Spend Enough on Public Health. New England Journal of Medicine, 362(18), 1657

• We found that CrossRef and WorldCat Discovery were very good at retrieving successful search results for these types of searches.

• In general, we found that Scopus and EBSCO overlapped extensively with Primo and that CrossRef, WorldCat Discovery and Google Scholar were very important in and useful in matching the successful Primo results.

22

Page 23: A Decade of Discovery: What We Know and Where We Will Go

Overarching Issues • Understanding and supporting user search

behaviors is important • The effectiveness of full-text search and

relevancy ranking is under question• Some modules (e.g. OPAC) may be better

than central index search/discovery • Important to distinguish between discovery

features and known-item access mechanisms

23

Page 24: A Decade of Discovery: What We Know and Where We Will Go

Next StepsInformed by evidence, the Discovery and Delivery Study Team:• Articulate principles for a discovery/delivery strategy.• Identify discovery system requirements and value proposition

for central index.• Evaluate Easy Search sustainability.• Recommend strategy to Library’s Content Access Policy and

Technology Committee.

24


INDIA’S DECADE OF DEVELOPMENT - Columbia University Decad… · – 2000-2010 - we strongly believe that this decade indeed can be called – India’s Decade of Development. As

DC DISCOVERY - Douglas College · 2020. 7. 21. · DC DISCOVERY | LEARNING CATALOGUE 3 Introduction to DC Discovery Welcome to DC Discovery! With over 50 workshops offered, we are

DEFENSE IN TRANSITION › ndia › ...“We have gone through a decade of war in which the defense budget has more than doubled, and now we have to look at a decade where we have to

The quest for Ubiquitous Computing - Web … Service Discovery Bluetooth Service Discovery (SDP) Interaction Mapping Discovery ... EMI2lets Applications •We have created EMI2lets

Shaping the Future We Want - Macquarie University...Report, Shaping the Future We Want – UN Decade of Education for Sustainable Development (2005 – 2014). The UN Decade of Education

Losing Earth: The Decade We Almost Stopped Climate Change

DISCOVERY AFTER A DECADE: RULE 194 AND OTHER …DISCOVERY AFTER A DECADE: RULE 194 and OTHER DISCOVERY ISSUES MARILEA W. LEWIS Judge, 330th District Court George Allen Courts Building

Clausal Discovery - Springer1007361123060.pdf · we will employ for clausal discovery, and which we will call characteristic induction from interpretations2. In this section, we will

A Decade of Discovery - NIH Common Fundcommonfund.nih.gov/.../ADecadeofDiscoveryNIHRoadmapCF.pdfA Decade of Discovery: The NIH Roadmap and Common Fund 1 Foreword Ten years ago, the

DISCOVERY OF A MAKEMAKEAN MOON ABSTRACT We describe

Discovery A.pdf 1 2017/04/12 16:59 - kairyudo.co.jp · New Discovery Tokyo 2. we a. 4. We waiting Basic Sentences New Discovery English Communication I deer New Discovery Erolish

Shaping the future we want: UN Decade of Education for

€¦  · Web viewThe anti-PLA2R antibody in membranous nephropathy: What we know and what remains a decade after its discovery.. Anne-Els van de Logt¹, Maryline Fresquet², Jack

CRITERION FOUR: Acquisition, Discovery, and … Criterion 4 SS12.pdfAcquisition, Discovery, and Application of Knowledge ... discovery, and application of knowledge defines who we

arXiv:cond-mat/9802020v1 2 Feb 1998 · I. INTRODUCTION After almost one decade from the discovery of High-Tc superconductivity we have cer-tainly understood much more about magnetism

We have different needs and experiences in each decade of life

HISTORY OF RADIO Adam Lundquist. What we will go over today What is radio? Decade by decade look at radio Each decade will have one show or person who

Review of Panulirus argus virus 1—a decade after its discovery

A Decade of Celebration ~ Centuries of Discovery

Oman A secretive land. Contents General Information Historical overview Oil Discovery 1970: Oman’s Renaissance 1980-1990: A decade of economic

EQUINE FRACTURES IN THE NEW DECADE; WHAT CAN WE …€¦ · EQUINE FRACTURES IN THE NEW DECADE; WHAT CAN WE REPAIR? Alan J. Ruggles, DVM, DACVS Rood and Riddle Equine Hospital Lexington,

Bone and Joint Decade Global Network Conference · 2016. 6. 27. · 2 WELCOME MESSAGES Dear Friends of the Bone & Joint Decade, Next year we will reach the end of the Decade. Nevertheless,

Decade by Decade

LEARNING FROM A DECADE OF EXPERIENCE · ... that we introduce “Learning from a Decade of Experience: Québec’s Private ... in the Civil Code of Québec ... LEARNING FROM A DECADE

A Decade of Discovery - Purdue University · Frank Borman, Apollo 8 ... Discovery Park — now consisting of eight interdisciplinary core centers ... books and reports, and spear-

Pluto: the next decade of discovery

New women’s channel part of biggest portfolio rebirth in a decade · New women’s channel part of biggest portfolio rebirth in a decade Discovery Networks Asia Pacific unveils

We are drawing on our survey data collected a decade ago…

We accelerate discovery - NIH Common Fund

HAPPY NEW YEAR! To kick off the new decade, we We wish you ...€¦ · 2020-01-04  · HAPPY NEW YEAR! We wish you all a prosperous New Year as we start off a new decade. January

Decade of Days: 2020 MSC Decade... · 2020. 1. 19. · Welcome As we begin to celebrate this Decade of Days, we turn our thoughts to the theme set forth by our Holy Cross International

Introduction to Ecology: ‘Decade of Discovery’

(and what you can do over the next decade with FAST!) · 2014. 7. 30. · The Double Pulsar: ! A Decade of Discovery! (and what you can do over the next decade with FAST!) Maura McLaughlin

A Decade of Discovery - Brookhaven National Laboratory · A Decade of Discovery 10 years of nanoscience at the Center for Functional Nanomaterials Charles (Chuck) Black January 15,

WESTFIELD HOW WE SHOP THE NEXT DECADE