nhs evidence – provided by nice nhs evidence alison turner associate director: commissioned...

NHS Evidence – provided by NICE

NHS EvidenceAlison TurnerAssociate Director: Commissioned Content

14 July 2009


The Darzi report: ‘High quality care for all’stated:

‘NICE will manage the synthesis

and spread of knowledge through

NHS Evidence – a new single

portal through which anyone will be

able to access clinical and non-

clinical evidence and best practice,

both what high quality care looks

like and how to deliver it’


Launched on 30th April 2009 NHS Evidence Release 1 is:

• A single portal which provides clear and easy access to valuable information to develop new services; treatments; knowledge bases; service models

• Built around a powerful search engine – ‘Microsoft FAST’

• Underpinned by a quality based accreditation scheme for multiple content sources

• Is open to all – but the public should visit NHS Choices

• A developing resource involving health and social care staff in its design and development


Informed by user testing

Process• Over 25 users selected to

represent all target groups• Controlled testing process

environment• Testing completed over a total

of 6 days during a 3 week period

• Involved pre-defined search scenarios as well as user-generated scenarios

• Feedback captured on video, audio and written reports

Feedback• Specific comments received

about the use of navigators, search ranking and returns

• Overall feedback confirms that the design succeeds in communicating our intention to provide a ‘simple search’ service (Google) for health and social care professionals and that the search will provide access to authoritative content.

• User testing will be undertaken as a core and ongoing activity.


What are the benefits?

• Provides easy, fast, free, single access to trusted, high quality comprehensive clinical and non-clinical sources of information

• Offers support to healthcare staff in accessing and using best practice

• Accredits sources of information, driving up the quality of evidence produced

• Contributes to increased quality of care due to high quality evidence

• Covers both health and social care • Sorts, sifts and prioritises search results


Sorting, sifting and prioritising

Exclusion - only those sources likely to present significantly biased opinions

Sorting, sifting and prioritising - three approaches:• A formal system for accrediting producers of

‘guidance’, to enable the best, most trusted sources to be easily recognisable through an accreditation mark

• A process for regularly reviewing new publications across a range of topic areas, to highlight significant new evidence on a monthly and annual basis

• An effective approach to searching for information and ranking search returns by relevancy and quality.


NHS Evidence accreditation scheme

NHS Evidence Accreditation

Scheme

Transparent and based on standardised criteria and processes

Unbiased with oversight by an independent Advisory Board

Initially focused on ‘guidelines’ sources of evidence

Based on the process used to develop evidence

Kitemark will become well-known and recognised

Sources will be accredited, rather than individual articles

Key aim: to identify trusted sources of

information and set best practice

standards


Accreditation criteria

• Based on AGREE

• Assesses six domains of guidance

production process:

Scope and purpose

Stakeholder involvement

Rigour of development

Clarity and presentation

Applicability

Editorial independence


Next steps for accreditation

• Accreditation process manual updated and made available following public consultation

• Target of ten guidance producers through the accreditation process by 31 Dec 2009

• First accreditation applications received• First draft accreditation decisions made at Advisory

Committee meeting 18 June• Subsequent accreditation decisions at Advisory Committee

meetings in September, October and December• Increase number of accreditation applications received• Investigate demand and accreditation methods for other

types of content


Categories of information in NHS Evidence

Clinical

• Guidelines

• Systematic Reviews

• Other synthesises content (summaries & overviews)

• Primary research and ongoing trials

Drug & Technologies

• Prescribing & safety information

• Technology appraisals

• Significant new drugs

• Devices, diagnostics & IP guidance

Commissioning

• Service guidance

• Tools & models

• Care pathways

• Indicators & metrics

• Improvement information

Public Health

Social care

• Social care information – assured by SCIE

Education & Learning tools

• On-line learning modules

• Public Health guidance

• Systematic reviews

• Primary research


Num

ber

of o

ur s

ourc

es

Areas of interest

To prepare for going live we ingested and allocated 93 sources of content against our six

areas of interest

Some sources have been allocated across more than one area of interest

Nu

mb

er o

f so

urc

es p

er a

rea

of in

tere

st


We are continually identifying new sources of content based upon user needs

• Understand search behaviours and results from currently available sources of content

• Web-forms to identify new sources of content• Work with organisations that are sharing content to

understand their users and their requirements• Creating user panels with representatives from each

area of interest to identify and prioritise proposed sources of content

• Understand and share information we already hold within NICE and within our 34 Specialist Collections

We are still developing the structures, processes and people we need to support our

goals


Effective searching

Principle objective - to present the user with the most relevant results on the first page.

Relevancy of the information returned is largely informed by the search engine – produces results as close a match as possible to the user’s requirements.

Ranking policy – to promote certain records higher within the list of search returns and improve the searching experience.


Basic Search on NHS Evidence


Sample Search on NHS Evidence


Search results


Additional health information resourcesvia the dropdown menus

Conduct a Specialist Search has a link to Search Specialist Databases HDAS (Healthcare Database advanced search), a link to the Athens authentication system and to the Specialist collections (formerly known as Specialist Libraries).


Access to the 34 Specialist Collections via the conduct a specialist search tab


Access to Healthcare Databases Advanced Search via the conduct a specialist search tab


Further information via About Us

The About Us drop down menu includes information on:

• Selecting Information Sources,

• Sources by interest area,

• Specialist Collections, Accreditation,

• How the search works and a Contact us link


Outline road map for 2009/10

Schedule Release Key features (from R1 TBC)

April 30th 2009 R1 (launch) • Launch NHS Evidence Search Portal V1 (FAST)• Integrate legacy NLH sites & services• Ingest P0, P1 and 50% of P2 sources

Mid June 2009 R1.1 • Refine web service/ feeds• Ingest new P0 and P1 sources•Static content additions

Mid October 2009

R2 • Personalisation•Identity management, •My saved searches, my alerts•My search profile

• Search development•Synonym expansion •Rating quality of results

•Accreditation – boost results

TBC 2010 R3 •Developing new infrastructure/hosting•Community features (local evidence)•Third party syndication •Advanced search developments


Release 2 – Key IT deliverables

DescriptionPersonalisation: users will be able to register online and receive a range of personalised services including a customised home page, alert services, saved searches

Alerts and feeds: Users will be able to subscribe to receive ‘push’ services such as alerts on home page, email alerts – about new content or developments to NHS Evidence for example

Search Development : Users will be provided with a more intelligent search through with an ability to rate results

NLH Transition: Transfer of content and appropriate services to NHS Evidence site. Specialist Collections Evidence Updates Highlighted on NHS Evidence

Accreditation: Implementation of accreditation system – issuing accreditation marks and boosting search returns


Future Developments :highlighting new publications

Alerts through RSS feeds

Significant new information highlighted by topic experts (Specialist Collections) via:

- Web alerts

- Monthly newsletters, in context

- Annual evidence updates


Key functions of NHS Evidence

In summary, NHS Evidence:• Provides comprehensive access to information in

health and social care via a web-based portal• Commissions the development and collation of

evidence-based information from external agencies• Provides a central purchasing function for content • Provides a formal accreditation scheme • Identifies evidence reflecting best practice• Engages with users and stakeholders to support the

use of evidence in decision-making, and to provide feedback to develop the service


Contacting NHS Evidence

If you have an enquiry for NHS Evidence you can contact us at [email protected] or ring us on 0845 003 77 44

nhs evidence – provided by nice nhs evidence alison turner associate director: commissioned...

Documents

quality of evidence

guidelines sources of

evidence kitemark

high quality evidence

significant new evidence

non clinical evidence

nhs choices

nice accreditation criteria