Finding the best available evidence: how can we know?

Sarah Hayman and Jennifer Tieman,Flinders University

IFLA World Library and Information Congress, August, 2015, Cape Town

About usSarah HaymanResearch Fellow (Evidence), Flinders Filters, Flinders University (formerly with CareSearch)

Jennifer TiemanAssociate Professor, Palliative and Supportive Services; Director of CareSearch; Chief Investigator of Flinders Filters

Searching for Evidence

• The importance of effective searching • Challenges for effective searching • Approaching searching scientifically

–using and understanding search filters–applying some elements of search filter

development methodology • Conclusion: some results and implications

Smart Searching

The Importance of Effective Searching

• Need for evidence• Impact of missing evidence

Challenges for Effective Searching

Volume of information …

• … Complexity of sources

Challenges for Effective Searching … ctd.

Understanding the needs of the userWhat is considered relevant?Sensitive or specific?What level of evidence

is required?

Approaching Searching Scientifically: Search Filters

Search Filters and information about them:• CareSearch• Flinders Filters• Some search filters worldwide

– ISSG Search Filters Resource– BMJ Clinical Evidence– Canadian Agency for Drugs and Technologies in Health (CA

DTH)– HL WIKI International– McMaster University. Health Information Research Unit– Scottish Intercollegiate Guideline Network (SIGN)

A search filter …• is a validated search strategy of known

performance effectiveness• is designed for and built in a particular

bibliographic database• can be methodology- or subject-based• can be expressed as a URL and embedded

in a web page for quick reliable access to evidence

• may be sensitive or specific

Using Search Filters• Understand nature and purpose of the search

filter (not always suitable for systematic reviews?)

• Critically appraise the search filter (see e.g. ISSG Search Filters Resource)

• Use terms in the search filter as a starting point for your search

• Make search filters available to your users as useful tools for accessing evidence reliably

Example: the Heart Failure Search Filter

As a URL:http://www.ncbi.nlm.nih.gov/pubmed?term=((heart+failure[tw]+OR+ventricular+dysfunction,+left[mh:noexp]+OR+cardiomyopathy[tw]+OR+left+ventricular+ejection+fraction[tw])+AND+Medline[sb])+OR+((heart+failure[tw]+OR+left+ventricular+dysfunction[tw]+OR+cardiomyopathy[tw]+OR+left+ventricular+ejection+fraction[tw]+OR+cardiac+resynchronization[tw]+OR+LV+dysfunction[tw]+OR+left+ventricular+systolic+dysfunction[tw]+OR+left+ventricular+diastolic+dysfunction[tw]+OR+cardiac+failure[tw])+NOT+medline[sb])+AND+english[la]

As a PubMed query:

Smart SearchingExpert Advisory Group (EAG)

Subject expertsGold Standard Set

Sample setTerm identification

Term identificationValidation

Testing

https://sites.google.com/site/smartsearchinglogical/home

The Modules

Conclusion• Bias reduction: search results have been

informed by external input– subject experts; known relevant items

• Extra work involved can be captured – publish searches (e.g. as URLs)– set up alerts– share strategies with colleagues and on websites– adapt search strategies for other databases (and

TEST again)

Conclusion … ctd.• Can provide some evidence about searching

effectiveness• Evidence-based approach to our own

searching practice is a powerful tool• Searches are important and deserve the

respect of a scientific approach• We will maintain and develop the free Smart

Searching resource• Please send feedback!

https://sites.google.com/site/smartsearchinglogical/home

Sarah Hayman sarah.hayman@flinders.edu.au

AcknowledgementsThank you to:• Colleagues at CareSearch and Flinders Filters

(Raechel Damarell, Mikaela Lawrence, Yasmine Shaheem)

• Members of the Smart Searching Advisory Group

• Health Libraries Australia and Medical Director (formerly HCN) for support through the Health Informatics Innovation Award 2012