systematic review data repository (srdr) annual report ...2015+annual+report.pdfproviding further...

Systematic Review Data Repository (SRDR) Annual Report

December 2014 to November 2015

Prepared for:

The Agency for Healthcare Research and Quality

Rockville, MD

Prepared by:

Brown Evidence-based Practice Center

Providence, RI

Authors:

Bryant T. Smith, MPH, CPH

Jens Jap, BS

Joseph Lau, MD

Summary

This report summarizes trends in traffic and usage of the Systematic Review Data

Repository Web site (srdr.ahrq.gov) between December 1, 2014 and November 30, 2015. Where

relevant, data is summarized back to June 2012, when SRDR was released to the public.

As of November 2015, a significant jump in the number of visits made to the site was

observed beginning in July, 2015 and extending through November 2015. For example, in June

2015, 7125 visits to SRDR were recorded, compared to 15,524 in July and 36,431 in November.

Coinciding with this jump in the number of visits, the user base of SRDR also grew

significantly as evidenced by the expansion in the number of countries from which requests for

new user accounts originated in 2015. Specifically, in 2015, requests for new user accounts

originated from 144 different countries (up from the 80 countries from which requests originated

in 2014) with the most requests coming from the US (6958 requests), followed by China (3012

requests), and finally, France (509).

Providing further evidence of the expansion of the SRDR user base in 2015, as of

November 2015, 592 project contributor accounts were certified in 2015 (up from 372 as of

December 2014). Furthermore, as of November 2015, 391 projects were initiated in SRDR with

48 published to SRDR (up from 230 project initiated in SRDR as of December 2014, with 20

projects having been published.

! 1!

Table of contents

A.#Introduction#......................................................................................................................................#2!B.#Data#source#and#data#collection#method#.................................................................................#3!C.#Results#..................................................................................................................................................#4!D.#Training#sessions#and#training#site#........................................................................................#26!E.#SRDR#usage#by#Evidence#Based#Practice#Centers#...............................................................#32!Appendix#A!Appendix#A.1.##Complete!list!of!unpublished!projects!(321)!currently!in!SRDR!as!of!November!2015#...................................................................................................................................#AF1!Appendix#A.2.#Complete!list!of!published!projects!(48)!currently!in!SRDR!as!of!November!2015#.......................................................................................................................................................#AF2!

! 2!

A. Introduction

Development of the Systematic Review Data Repository (SRDR) started in July 2010, and the

system was released for general use by EPCs and the public in June 2012. This resource serves as both an

archive and data extraction tool, is shared among organizations and individuals producing systematic

reviews worldwide, and enables the creation of a central database of systematic review data. This

database is collaboratively vetted, is freely accessible, and aims to integrate seamlessly with existing

workflows. The ultimate goal of SRDR is to facilitate the efficient generation and update of evidence

reviews, thus speeding up and improving policymaking with regards to health care. An introductory

article describing the goals, rationale, challenges, and benefits of SRDR has been published.1 During the

report time period, three categories of user access to SRDR have been defined: non-registered public

viewers, registered public commentators, and certified project contributors. A more detailed description

of the system users and their levels of access are provided in each relevant section.

This report describes the usage and growth of SRDR mainly during the last 12 months (December

2014 to November 2015). When possible, we have provided data back to June 2012 when the site was

first launched for public use.

1!Ip!S,!Hadar!N,!Keefe!S,!et!al.!A!WebKbased!archive!of!systematic!review!data.!Syst!Rev!2012;1(1):15.!

! 3!

B. Data source and data collection method

The SRDR database administrators at the Brown EPC wrote custom MySQL queries that were

executed on the SRDR production and training databases to collect information regarding the growth of

the SRDR database on a monthly basis. Using this method, we collected statistics regarding new user

registrations, newly initiated projects, and the number of studies residing in the system. In addition to the

in-house summary data production, we track individual site visit data by parsing webserver log files

obtained from the server on which the SRDR Web site is hosted.

! 4!

C. Results

SRDR usage data is collected by executing MySQL queries directly on the production server.

This method allows us to account for two types of users: those certified as project contributors and those

who have registered public commentator accounts, both of which enable users to download data from

projects published to SRDR, as well as leave comments on published projects. However, users simply

browsing published content do not require registration and therefore are not traceable by our querying

method. In order to account for these users, we parse Web server log files directly. These files contain

data for all visitors to the site (by unique IP address, page requested, and response status), regardless of

account type.

In summary, the number and geographic distribution of visits to the SRDR Web site increased

greatly over the period of December 2014 to November 2015. Over this period, the SRDR site was visited

an average of 13,541 times per month (Range: 7,125 to 36,431 visits) with an average of 445 visits per

day. This represents a two-fold increase in the number of visits recorded to the site over a similar period

last year (December 2013 to November 2014) when SRDR was visited an average of 7500 times per

month (Range: 1506 to 10847 visits) with an average of 246 visits per day. In addition to the increased

traffic on the SRDR site, visits to SRDR over 2015 were recorded from a total of 144 different countries

(up from the 80 countries recorded in 2014).

From these 144 countries, individuals requested 480 public commentator accounts and 1641

project contributor accounts. As of November 2015, 592 researchers had completed the required training

and were certified as project contributors and 391 projects had been initiated in the repository (48

published, 321 ongoing, and 22 initiated for training/demonstration purposes). Users that were not

certified yet were referred to the training site (http://srdr.training.ahrq.gov/) to try out the available tools

and features. Between January 2013 and November 2015, 857 users have explored using SRDR via the

training site (srdr.training.ahrq.gov). The usage of the SRDR site among the Evidence Based Practice

Centers (EPCs) is discussed in section E of this report.

The following information is provided in this report:

!! General statistics (e.g., visits, visitors, site pages, and hits) by month from December

2014 to November 2015 (Table 1)

!! Average visits per day for each month from December 2014 to November 2015 (Figure

1)

!! Number of visits by hour of the day (UTC) by month from December 2014 to November

2015 (Figure 2)

! 5!

!! Total number of visits by hour of the day (UTC) recorded over the period of December

2014 to November 2015 (Figure 3)

!! Geographic distribution of SRDR Users as of December 2015 (Figure 4)

!! Number of requests for SRDR user accounts by country of origin (including requests for

public commentators and project contributor accounts) as of December 2015 (Table 2)

!! The Top-10 Ranked Countries by number of requests for SRDR user accounts as of

December 2015 (Table 3)

!! Cumulative number of requests for public commentator accounts by month from June


!! Cumulative number of requests for project contributor accounts by month from June


!! Cumulative number of certified project contributors by month from June 2012 to

November 2015 (Figure 7)

!! Cumulative number of projects initiated in SRDR by month from June 2012 to November

2015 (Figure 8)

!! Cumulative number of projects published in SRDR by month from June 2012 to


!! Characteristics of SRDR projects currently in SRDR as of November 2015 (Table 4)

!! Characteristics of projects published in SRDR as of November 2015 (Table 5)

!! Cumulative number of requests for training accounts by month from January 2013 to


!! Certified User Training Status of EPCs funded by AHRQ between December 2014-2015

(Table 6)

!! EPC-IV systematic reviews and technical briefs due for submission on or before March

2015 and their status in SRDR as of November 2015 (Table 7)

! 6!

C.1. Public viewers2

C.1.a General Statistic

Table 1. General statistics by month from December 2014 to November 2015

(Data Source: SRDR production log file)

* Site Hits: A "hit" is not a visit to the Web site, but a hit on the Web server. A hit on the Web server can

2This user type can view and download published systematic reviews data. They are not able to comment,

edit, or supplement any deposited data. Registration with SRDR is voluntary.

!

Category Dec 2014

Jan 2015

Feb 2015

Mar 2015

Apr 2015

May 2015

Jun 2015

Site visits statistic

Visits 7569 8642 8455 16736 8641 6984 7125

Average per day 244 279 302 540 288 225 238 Site visitors

Unique visitors 2152 2003 2274 2584 2383 2070 1973

Visitors who visited once 1237 1087 1303 1371 1382 1104 1026

Visitors with >1 visit 915 916 971 1213 1001 966 947

Average number of visitors per day 69 65 81 83 79 67 66

Site Hits*

Total hits 60554 69141 67642 133889 69135 55877 57001

Successful hits (as percent) 100% 100% 100% 100% 100% 100% 100%

Jul 2015

Aug 2015

Sep 2015

Oct 2015

Nov 2015

Site visits statistic

Visits 15524 16452 9282 20646 36431

Average per day 501 531 309 666 1214

Site visitors

Unique visitors 6210 6305 5642 6469 6654

Visitors who visited once 3657 3780 3270 3654 3456

Visitors with >1 visit 2553 2525 2372 2815 3198

Average number of visitors per day 4006 4246 2475 5328 9715

Site Hits*

Total hits 124193 131619 74257 165169 291466

Successful hits (as percent) 100% 100% 100% 100% 100%

! 7!

be a graphic, java applet, the html file, etc. So, if a site has 79 small graphics on the page, every visitor to

the site registers as 80 hits on the server (79 graphics plus the html file). In this case, 80,000 hits

translate to 1,000 visitors;

Figure 1. Average visits per day for each month from December 2014 to November 2015


0

200

400

600

800

1000

1200

1400

Average###visits

! 8!

Figure 2. Number of visits by hour of the day (UTC) for each month from December 2014 to November

2015

December 2014

January 2015

0

5000

10000

15000

20000

25000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

5000

10000

15000

20000

25000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

! 9!

February 2015

March 2015

April 2015

0

5000

10000

15000

20000

25000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

5000

10000

15000

20000

25000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

5000

10000

15000

20000

25000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

! 10!

May 2015

June 2015

July 2015

0

5000

10000

15000

20000

25000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

5000

10000

15000

20000

25000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

0

5000

10000

15000

20000

25000

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

! 11!

August 2015

September 2015

October 2015

0

5000

10000

15000

20000

25000

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

0

5000

10000

15000

20000

25000

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

0

5000

10000

15000

20000

25000

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

! 12!

Note: The peak at 8:00 UTC in October 2015 exceeded 25,000 visits at 39,006 visits. We are confident

that this peak does not the reflect number of visits from SRDR users that were recorded at this hour and

may be artificially inflated by other factors which have yet to be identified.

November 2015

Note: The peak at 9:00 UTC in November 2015 exceeded 25,000 visits at 68,392 visits. We are confident

that this peak does not the reflect number of visits from SRDR users that were recorded at this hour and

may be artificially inflated by other factors which have yet to be identified.


Figure 3. Total number of visits by hour of the day (UTC) recorded over the period of December 2014 to

November 2015


0

5000

10000

15000

20000

25000

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

0

10000

20000

30000

40000

50000

60000

70000

80000

90000

100000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

! 13!

C.1.b Geographic Distribution of SRDR Users

Figure 4. Geographic distribution of SRDR users as of December 2015

Note: Blue shading represents countries in which SRDR users were located when they registered for a

public commentator or project contributor SRDR account)

Table 2. Number of requests for SRDR user accounts by country of origin (including requests for public

commentators and project contributor accounts) as of December 2015

Country # of

Requests Country # of

Requests Country # of

Requests Albania 10 Gibraltar 1 Philippines 28

Algeria 6 Greece 103 Pitcairn 1

Angola 2 Guatemala 2 Poland 105

Antigua and Barbuda

2 Haiti 2 Portugal 17

Argentina 16 Hong Kong 37 Puerto Rico 3

Armenia 9 Hungary 1 Qatar 5

Asia/Pacific Region

2 Iceland 5 Romania 147

! 14!

Australia 114 India 213 Russian Federation 225

Austria 32 Indonesia 28 Rwanda 2

Azerbaijan 4 Iran, Islamic Republic of

25 Saint Lucia 1

Bahamas 9 Iraq 16 Saudi Arabia 17

Bahrain 1 Ireland 40 Senegal 7

Bangladesh 9 Israel 30 Serbia 17

Belarus 4 Italy 78 Seychelles 15

Belgium 42 Jamaica 1 Singapore 33

Bosnia and Herzegowina

3 Japan 91 Slovakia 15

Brazil 227 Jordan 8 Slovenia 13

Brunei Darussalam

1 Kazakhstan 8 Somalia 1

Bulgaria 16 Kenya 10 South Africa 27

Canada 421 Kiribati 1 Spain 86

Cape Verde 9 Korea, Republic of

61 Sri Lanka 6

Chad 7 Latvia 12 Sudan 1

Chile 15 Lebanon 7 Swaziland 1

China 3012 Lithuania 7 Sweden 85

Colombia 26 Luxembourg 3 Switzerland 42

Costa Rica 4 Macao 12 Syrian Arab Republic

2

Côte D'ivoire 3 Macedonia 11 Taiwan, Province of China

58

Croatia 13 Madagascar 1 Tajikistan 1

Cuba 1 Malawi 1 Tanzania, United Republic of

7

Czech Republic 36 Malaysia 48 Thailand 77

! 15!

Denmark 33 Malta 1 Tunisia 2

Djbouti 4 Mexico 17 Turkey 109

Dominica 1 Moldova, Republic of

8 Turkmenistan 1

Dominican Republic

1 Monaco 1 Turks and Caicos Islands

1

Ecuador 5 Montenegro 1 Uganda 3

Egypt 34 Morocco 14 Ukraine 214

Estonia 27 Nepal 1 United Arab Emirates

12

Ethiopia 4 Netherlands 169 United Kingdom 409

European Union 40 New Zealand 23 United States 6958

Falkland Islands 1 Nicaragua 1 Uruguay 8

Fiji 2 Nigeria 8 Uzbekistan 1

Finland 8 Norway 17 Vanuatu 7

France 509 Oman 1 Venezuela 63

French Guiana 4 Pakistan 42 Viet Nam 32

Gambia 1 Palestine, State of

4 Virgin Islands 1

Georgia 4 Panama 2 Yemen 5

Germany 387 Paraguay 3 Zambia 2

Ghana 2 Peru 15 Zimbabwe 3

(Data Source: SRDR site via MySQL queries)

! 16!

Table 3. The Top-10 Ranked Countries by number of requests for SRDR user accounts as of December

2015

Ranking Country # of Requests

1 United States 6958 2 China 3012 3 France 509 4 Canada 421 5 United Kingdom 409 6 Germany 387 7 Brazil 227 8 Russian Federation 225 9 Ukraine 214 10 India 213

(Data Source: SRDR site via MySQL queries)

C.1.c Published data view statistic

Prior to June 2015, we did not record either the identity of users who downloaded data from published

projects or the number of times data has been downloaded. Beginning in June 2015, we incorporated a

feature to keep track of these information and made it available to contributing authors. Building on this

feature, we will develop SQL queries to tabulate the number of times data is download from each

published project and plan to present this data in future SRDR annual reports.

! 17!

C.2. Registered Public Commentator3

C.2.a Registered public commentator accounts growth

Figure 5. Cumulative number of requests for public commentator accounts by month from June 2012 to

November 2015

(Total number of users = 480; Data Source: SRDR site via MySQL queries)

C.2.b Comments on Published Systematic Review project’s data

No comments were posted by any of the registered public commentators.

3 An SRDR user with permission to post comments on published deposited systematic reviews data entries. Such

users would have to register on the SRDR Web site, providing basic identifying and contact information, including

their name, affiliated organization, and a valid email address. Following email verification, newly registered

commentators are asked to accept the terms of use for the repository’s discussion features. All comments are vetted

for clarity and adherence to rules by the SRDR operational team prior to posting. !

0

30

60

90

120

150

180

210

240

270

300

330

360

390

420

450

480

Cumulative#Requests#for#Public#Com

mentator#

Accounts

! 18!

C.3. Registered Project Contributor4

C.3.a Registered project contributor accounts growth

Figure 6. Cumulative number of requests for project contributor accounts by month from June 2012 to

November 2015

(Total number of users = 1641; Data Source: SRDR site via MySQL queries)

4 A registered project contributor is an individual who has been given permission to contribute data to a project in

SRDR. Accounts of this type would initially be assigned via certified groups or organizations rather than through

SRDR’s Web registration. EPCs and other groups would be granted rights to contribute data to the SRDR.

Individual contributors who wish to submit evidence reviews not conducted under the auspices of an SRDR-

recognized or -affiliated sponsoring organization would be granted access separately under policies to be established

with guidance from the SRDR governing board.

!

0

200

400

600

800

1000

1200

1400

1600

1800

Cumulative#Requests#for#Project#Contributor#

Accounts

! 19!

Figure 7. Cumulative number of certified project contributors by month from June 2012 to November

2015

(Total number of certified users = 592; Data Source: SRDR site via MySQL queries)

0

100

200

300

400

500

600

700

Cumulative#Nom

ber#of#Certified#Project#

Contributors

! 20!

C.3. Projects in SRDR

C.3.a Projects published in SRDR from June 2012 to November 2015

1.! Blood Pressure Targets in CKD (3 studies) [Tufts EPC]

2.! The lack of evidence for PET or PET/CT surveillance of patients with treated lymphoma,

colorectal cancer, and head and neck cancer (12 studies) [Brown EPC]

3.! Fructose Consumption and Non-alcoholic Fatty Liver Disease (NAFLD) (23 studies) [ILSI5]

4.! Sling surgery for stress urinary incontinence in women: SGS 2013 (104 studies) [Society of

Gynecologic Surgeons]

5.! SGS: Local Estrogen For Genitourinary Complaints in Post-Menopausal (56 studies) [Society of

Gynecologic Surgeons]

6.! Diet and PA for Prevention of Diabetes-Full Data Extraction (50 studies) [Tufts EPC]

7.! Benefits and Harms of Routine Preoperative Testing: Comparative Effectiveness Review 2013

(220 studies) [Tufts EPC]

8.! Therapeutic Management, Delivery, and Postpartum Risk Assessment and Screening in

Gestational Diabetes (43 studies) [Johns Hopkins University EPC]

9.! Sugars and Health - Evidence Map (213 studies) [ILSI5]

10.!Decision Aids for Cancer Screening and Treatment (74 studies) [Cochrane Complementary and

Alternative Medicine Field]

11.! Therapies for Children with Autism Spectrum Disorders (170 studies) [Vanderbilt EPC]

12.!Off-Label Use of Atypical Antipsychotics: An Update (129 studies) [Tufts EPC]

13.! Treatment of Common Hip Fractures (85 studies) [Minnesota EPC]

14.!Dietary Fiber Database, Version 1 (868 studies) [ILSI]

15.! First- and Second- Generation Antipsychotics for Children and Young Adults (81 studies)

[University of Alberta EPC]

16.!Behavioral programs for diabetes mellitus (166 studies) [Alberta EPC]

17.!Catheter ablation for treatment of atrial fibrillation (50 studies) [Pacific Northwest EPC]

18.! Imaging Techniques for Treatment Evaluation for Metastatic Breast Cancer (17 studies) [Pacific

Northwest EPC]

19.! Interventions to Reduce Antibiotic Prescribing for Uncomplicated Acute Respiratory Tract

Infections (133 studies) [Pacific Northwest EPC]

20.! Imaging Techniques for the Diagnosis and Staging of Hepatocellular Carcinoma (281 studies)

5!ILSI!stands!for!the!International!Life!Sciences!Institute!

! 21!

[Pacific Northwest EPC]

21.! Imaging for the Pretreatment Staging of Small Cell Lung Cancer (7 studies) [ECRI EPC]

22.! Second-Generation Antidepressants in the Pharmacologic Treatment of Adult Depression: An

update of the 2007 Comparative Effectiveness Review [Entered Retrospectively] (221 studies)

[RTI-UNC EPC]

23.! Imaging Tests for the Diagnosis and Staging of Pancreatic Adenocarcinoma (121 studies) [ECRI

Institute-Penn Medicine EPC]

24.! Treatment of Primary and Secondary Osteoarthritis of the Knee (77 studies) [Blue Cross and Blue

Shield Association Technology EPC]

25.! Treatment to Prevent Fractures in Men and Women With Low Bone Density or Osteoporosis:

Update of a 2007 Report (182 studies) [RAND Corporation -Southern California EPC]

26.! Effectiveness of Early Diagnosis, Prevention, and Treatment of Clostridium difficile Infection

(112 studies) [Minnesota EPC]

27.! Treatments for Ankyloglossia and Ankyloglossia with Concomitant Lip-tie (43 studies)

[Vanderbilt EPC]

28.!Venous Thromboembolism Prophylaxis in Orthopedic Surgery (149 studies) [University of

Connecticut-Hartford Hospital EPC]

29.!Oral Diabetes Medications for Adults with Type 2 Diabetes: An Update (176 studies) [Johns

Hopkins University EPC]

30.! Procedures for Managing Postpartum Hemorrhage: A Systematic Review (73 studies) [Vanderbilt

EPC]

31.!Management and Outcomes of Binge-Eating Disorder (BED) (84 studies) [RTI-UNC EPC]

32.! Treatments for Fibromyalgia in Adult Subgroups (75 studies) [Minnesota EPC]

33.!Management Strategies to Reduce Psychiatric Readmissions: Technical Brief (72 studies) [RTI-

UNC EPC]

34.! Strategies to Improve Mental Health Care for Children and Adolescents (16 studies) [RTI-UNC

EPC]

35.! Low-calorie sweeteners and body weight and composition: a meta-analysis of randomized

controlled trials and prospective cohort studies (24 studies) [Exponent, Inc.]

36.! Pain Management Injection Therapies for Low-back Pain (92 studies) [Pacific Northwest EPC]

37.! Treatment of Non-Metastatic Muscle-Invasive Bladder Cancer (40 studies) [Pacific Northwest

EPC]

38.! Psychosocial and Pharmacologic Interventions for Disruptive Behavior in Children and

Adolescents (97 studies) [Vanderbilt EPC]

! 22!

39.!Health Information Exchange Public Project Complete (136 studies) [Pacific Northwest EPC]

40.! Emerging Approaches to Diagnosis and Treatment of Non-Muscle-Invasive Bladder Cancer (199

studies) [Pacific Northwest EPC]

41.!Noninvasive Treatments for Low Back Pain [Entered Retrospectively] (156 studies) [Pacific

Northwest EPC]

42.!Home-Based Primary Care Interventions (20 studies) [Pacific Northwest EPC]

43.!Genetic Testing for Developmental Disabilities, Intellectual Disability, and Autism Spectrum

Disorder (141 studies) [ECRI EPC]

44.! Environmental Cleaning for the Prevention of Healthcare-Associated Infections (70 studies)

[ECRI EPC]

45.! Treatments for Fecal Incontinence (117 studies) [Minnesota EPC]

46.! Improving Cultural Competence to Reduce Health Disparities (86 studies) [Minnesota EPC]

47.! Early Diagnosis, Prevention, and Treatment of C. difficile: Update (112 studies) [Minnesota

EPC]

48.!Management of Insomnia Disorder (139 studies) [Minnesota EPC]

! 23!

C.3.b SRDR projects

Figure 8. Cumulative number of projects initiated in SRDR by month from June 2012 to November 2015

(Total number of projects = 391; Data Source: SRDR site via MySQL queries)

Figure 9. Cumulative number of projects published in SRDR by month from June 2012 to November

2015

0

50

100

150

200

250

300

350

400

Cumulative#Num

ber#of#SRD

R#Projects

0

5

10

15

20

25

30

35

40

45

50

Cumulative#Num

ber#of##Published#

Projects

(Total number of published projects = 48; Data Source: SRDR site via MySQL queries)

! 24!

Table 4. Characteristics of SRDR projects˜ currently in SRDR as of November 2015

Category N (%) Range Additional Information

Total number of projects 321 (100%) - 8 projects in average were initiated

per month since June 24th 2012

Total number of studies for all projects 45881 0-19815 - Average of 143 studies per project

when number of projects = 321ˆ

- Average of 51 studies per project

when number of projects = 313˘

Projects with number of studies = 0* 78 (24%) - -

Projects with number of studies = 1* 37 (12%) - -

Projects with number of studies >1 206 (64%) 2-19815 -

Projects with number of studies ≥ 10 150 (47%) 10-19815 -



Projects with number of studies ≥ 500 15 (5%) 515-19815

Number of extraction form template(s) 411 0-10 Average of 1 extraction form

templates per project

Number of key questions 666 1-13 Average of 2 Key questions per

project

Number of collaborators 998 1-28 Average of 3 collaborator per project

(Data Source: SRDR site via MySQL queries) ˜ Does not include projects that have been published or were created by SRDR staff for testing and demonstration purposes. The status of these projects is tentative as of December 20th 2014. *Projects in SRDR with 0 or 1 study data extractions can indicate one of the following: 1) project is very new and actual data extraction was not started yet; 2) users are just ‘trying out’ the system without an actual project. ˆAll 321 ongoing projects ˘ Only 313 projects were included; the network meta-analysis project with 990 studies, the Perioperative Pregabalin Use Systematic Review and Meta-Analysis with 1501 studies, the Predictive models for Common Cancers project with 930 studies, the Fiber Evidence Map with 918 studies, the InHYPO-DM Systematic Review with 2917 studies, the Alpha Blockade v. Calcium Channel Blockade for Pheochromocytoma Surgery abstract screening project with 1656 studies, the Alpha Blockade v. Calcium Channel Blockade for Pheochromocytoma Surgery full text review project with 1159 studies, and the E-Trials Registry project with 19815 studies were excluded.

See Appendix A.1 for the complete list of projects (321) currently in SRDR. Table 4 data was generated

based on this list.

! 25!

Table 5. Characteristics of projects published˜ in SRDR as of November 2015

Category N (%) Range Additional Information

Total number of projects 48 (100%) - 1 project in average was published per

month since the first project was

published on December 30th 2013

Total number of studies for all projects 5595 3-868 Average of 116 studies per project

Projects with number of studies >1 48 (100%) 3-868 -



Projects with number of studies ≥ 100 21 (44%) 104-868

Projects with number of studies ≥ 500 1 (2%) 868

Number of extraction form template(s) 119 1-10 Average of 2 extraction form templates

per project

Number of key questions 215 1-15 Average of 4 key questions per project

Number of collaborators 140 1-13 Average of 3 collaborator per project

(Data Source: SRDR site via MySQL queries) ˜ Includes projects that have been published in the SRDR Web site and are available for viewing by the public.

See Appendix A.2 for complete list of all projects (48) published to SRDR. Table 5 data was generated

based on this list.

! 26!

D. Training sessions and training site

D.1. Training site usage

Figure 10. Cumulative number of requests for training accounts* by month from January 2013 to

November 2015

(Total number of users trained = 857; Data Source: SRDR site via MySQL queries)

* It is assumed that users who submitted training requests followed through with completing either the

Full Training or Data Extraction tutorials necessary to become a certified project contributor.

D.2. Remote Training/Certification of Project Contributors

The SRDR Administrator remotely trained and certified prospective SRDR users for project contributor

accounts, either by email or through use of live video webinar. The SRDR Administrator only conducted

live training sessions with the Brown EPC. The following is a breakdown, by month, of the organizations

whose members submitted requests for project contributor accounts and were certified as project

contributors between December 2014 and November 2015.

0

100

200

300

400

500

600

700

800

900

Cumulative#Num

ber#of#Training#

Account#Requests#

! 27!

December 2014

−! Cochrane Eye and Vision Group

−! Department of Opthamology, University of Ionnina (Ionnina, Greece)

−! Johns Hopkins Center for Alternatives to Animal Testing

−! Department of Surgery, Yale University

−! The Institute of Medicine (IOM)

January 2015

−! Rutgers University students taking systematic review course led by Dr. Scott Parrott

−! Department of Reproductive Health Protection, Scientific Center of Family Health and Human

Reproductions (Irkutsk, Russian Federation)

−! University of Washington

−! Taura Barr Lab, Prevention Research Center, West Virginia University

February 2015

−! Johns Hopkins University Bloomberg School of Public Health students taking systematic review

course led by Tianjing Li and Kay Dickersin

−! University of Sao Paulo (Sao Paulo, Brazil)

−! Maria Fareri Children’s Hospital at Westchester Medical Center, New York Medical College

−! Pacific Northwest Evidence-based Practice Center

−! Wayne State University

−! Centre for Neuro Skills

−! University of South Florida

−! Exponent, Inc.

March 2015

−! Cedar Associates

−! Portland Evidence-based Synthesis Program

−! Medical College of Wisconsin

−! RTI-UNC Evidence-based Practice Center

−! Connecticut Children’s Medical Center

−! Oregon State University

April 2015

−! Johns Hopkins Evidence Based Practice Center

! 28!

−! Pacific Northwest Evidence Based Practice Center

May 2015

−! University of Louisville

−! Evidera

−! Medical University of Vienna (Vienna, Austria)

−! Johns Hopkins University School of Medicine

June 2015

−! University of Louisville

−! Evidera

−! Medical University of Vienna (Vienna, Austria)


−! Tufts University Human Nutrition Research Center on Aging

−! Department of Veterans Affairs

July 2015

−! Icahn School of Medicine at Mount Sinai

−! Perelman School of Medicine, University of Pennsylvania

−! University of Cincinnati College of Pharmacy

−! University of Florida

−! University of Bristol (UK)

−! Thomas Jefferson University

−! Ottawa Hospital Research Institute (Canada)

−! ECRI-Penn Evidence Based Practice Center

−! Brown University School of Public Health August 2015

−! London School of Hygiene and Tropical Medicine

−! ECRI-Penn Evidence Based Practice Center

−! Rutgers University


−! University of Cincinnati College of Pharmacy

−! Johns Hopkins Bloomberg School of Public Health

−! International Life Sciences Institute – North America branch

! 29!

−! University of Aberdeen (UK)

−! Cochrane EVG

−! Manipal University (India)

−! Perelman School of Medicine, University of Pennsylvania September 2015

−! Rutgers University

−! RTI-UNC Evidence Based Practice Center

−! St George's, University of London (UK)

−! Tufts University CTSI

−! University of Maryland

−! Ottawa Hospital Research Institute (Canada) October 2015

−! Atlas Research, Inc.

−! University of Exeter Medical School (UK)

−! Analgesic Solutions


−! Brown Evidence Based Practice Center

−! University of Minnesota Evidence Based Practice Center

−! Nestle, Nutrition R&D; Rutgers University

−! St George's, University of London

−! CDC, Division of Laboratory Systems

−! Tufts Medical Center

November 2015 −! Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill

−! University of Dundee (Scotland, UK)

−! University of Massachusetts Medical School

−! Geisinger Health Systems

−! Emory University

−! MTL Consulting


−! Doctor Evidence

−! Brown Evidence Based Practice Center

! 30!

D.3. Webinar-based Quarterly Training Sessions

Webinar-based Quarterly Training Sessions hosted by the EPC Learning Network and presented by

SRDR Administrators between April 2013 and December 2015.

April 2013

−! Webinar Topic: "Using SRDR to Develop Data Abstraction Forms for Systematic Review of

RCTs and Observational Studies"

−! Presenter: Nira Hadar

July 2013

−! Webinar Topic: “SRDR Tools for Data Extraction and Creating Summary Tables"


November 2013

−! Webinar Topic: "Using SRDR For Systematic Reviews of Diagnostic Tests"


June 2014

−! Webinar Topic: "Entering Data Retrospectively into SRDR"

−! Presenter: Bryant Smith

September 2014

−! Webinar Topic: "SRDR Data Import Tool: A Tool to Import Data Retrospectively into SRDR"


December 2014

−! Webinar Topic: "SRDR Best Practices: Improving the efficiency, effectiveness, and consistency of

data entry "


June 2015

−! Webinar Topic: "Publishing projects and reusing data and forms in SRDR”


December 2015

−! Webinar Topic: "Forum to improve your experience entering data into SRDR”


! 31!

D.4. Conference Sessions / Workshops presented by SRDR staff

October 2015

−! 2015 AHRQ Research Conference Session: "Tools and Resources for Evidence Synthesis”

−! Presenter: Ethan Balk

! 32!

E. SRDR usage by Evidence Based Practice Centers

During the past year, we prioritized providing training and technical support to current EPCs,

then to major organizations that conduct Systematic Reviews (e.g., Cochrane and researchers based in

academic institutions), before responding to other requests. Since the launch of SRDR in June 2012 and

including the last 12 months of the current contract period, we have provided training to 11 of the 13

EPCs that were funded by AHRQ between December 2013 and December 2014. Table 5 summarizes the

training and Table 6 summarizes the usage status for all EPCs during this time:

Table 6. Certified User Training Status of EPCs funded by AHRQ between December 2014 -2015

EPC Certified Users Training Status Contact Person

Brown University EPC members who requested project contributor accounts were certified

Thomas Trikalinos

Duke University EPC members who requested project contributor accounts were certified

Gillian Schmidler

ECRI Institute-Penn Medicine

EPC members who requested project contributor accounts were certified

Karen Schoelles/Craig Umscheid

Johns Hopkins University


Karen Robinson / Eric B. Bass

Kaiser Permanents Research Affiliates


Jennifer Lin

Mayo Clinic No EPC members have been certified

M. Hassan Murad

Minnesota EPC EPC members who requested project contributor accounts were certified

Mary Butler

Pacific Northwest EPC-Oregon Health & Science University


Elaine Graham

RTI-UNC EPC EPC members who requested project contributor accounts were certified

Nancy Berkman

Southern California EPC-RAND


Aneesa Motala

University of Alberta EPC members who requested project contributor accounts were certified

Jennifer Pillay

University of Connecticut

No EPC members have been certified

Charles White / Craig Coleman

Vanderbilt University EPC members who requested project contributor accounts were certified

Nila Sathe

! 33!

Table 7. EPC-IV systematic review and technical briefs due for submission on or before March 2015 and

their status in SRDR as of November 2015

Report Title AHRQ

Project ID

Final Report

Due Date

EPC Report

Type

In

SRDR?

Published

in SRDR?

Treatments for Ankyloglossia and Ankyloglossia with Concomitant Lip-tie

VBE4500SR

12/10/14

Vanderbilt Systematic Review

Yes Yes

Early Intensive Intervention for

Children with Autism Spectrum

Disorder: A Systematic Review

Update

VBE4200SRU

4/21/14 Vanderbilt Systematic

Review

Yes No

Behavioral Interventions for

anxiety, depression, and agitation

in dementia

MNE4SR3

TBD Minnesota Systematic

Review

Yes No

Behavioral Health Programs for

Diabetes

ABE4200SR 3/10/15 Alberta Systematic

Review

Yes Yes

Treatment of Non-Metastatic

Muscle-Invasive Bladder Cancer

ORE4700SR

1/9/15 Oregon Systematic

Review

Yes Yes

Congestive Heart Failure

Readmissions

RTE4SR2

2/19/14 RTI Systematic

Review

No NA

Core Needle vs Open Bx for Breast

Lesion Update

BWNE4SRU1

2/7/14 Brown Systematic

Review

Yes No

Decision Aid for Advance Care

Planning

MNE4300 2/14/14 Minnesota Technical

Brief

No NA

Decision Aids for Cancer

Screening and Treatment

BWNE4500SR 4/21/14 Brown Systematic

Review

Yes Yes

Diagnosis of Acute Appendicitis BWNE4400SR 7/21/14 Brown Systematic

Review

No No

Imaging Techniques for the

Diagnosis and Staging of

Hepatocellular Carcinoma

ORE4SR1 2/6/14 Oregon Systematic

Review

Yes Yes

Imaging Staging for Colorectal

Cancer

ECE4SR3 12/9/13 ECRI Systematic

Review

No No

Imaging Techniques for Metastatic

Breast Cancer

ORE4500 2/14/14 Oregon Technical

Brief

No No

! 34!

Update of Comparative

Effectiveness of Lipid-Modifying

Agents

JHE4SRU1 9/27/13 JHU Systematic

Review

Yes No

Long-Term Opioid Treatment of

Chronic Pain

ORE4300SR


Review

Yes No

Low Back Pain Treatment MNE4SR4


Review

No No

Oral Mechanical Bowel

Preparation for Colorectal Surgery

BWNE4SR1 9/27/13 Brown Systematic

Review

Yes No

Medication Management Therapy RTE4SR3 2/25/14 RTI Systematic

Review

No No

Myalgic

Encephalomyelitis/Chronic Fatigue

Syndrome (ME/CFS)

ORE4400SR


Review

No No

Imaging Tests for the Diagnosis

and Staging of Pancreatic

Adenocarcinoma

ECE4SR1 2/27/14 ECRI Systematic

Review

Yes Yes

Pharmacokinetic /

Pharmacodynamic Measures for

Guiding Antibiotic Treatment for

Nosocomial Pneumonia

RTE4SR1 2/11/14 RTI Systematic

Review

No No

Prevention of Contrast Induced

Nephropathy

JHE4300SR

7/21/14 JHU Systematic

Review

Yes No

Prostate Cancer Update ECE4SR2 11/6/13 ECRI Systematic

Review

No No

Radiotherapy Treatments for Head

and Neck Cancer Update

BCE41SR 2/18/14 BCBSA Systematic

Review

Yes No

Reducing Inappropriate Antibiotic

Use in Acute Cough Illness

ORE4800SR 12/10/14 Oregon Systematic

Review

Yes Yes

Benefits and Harms of Routine

Preoperative Testing: Comparative

Effectiveness Review 2013

BWNE4SR2 10/11/13 Brown Systematic

Review

Yes Yes

Survivorship Care RTE4TB1 10/11/13 RTI Technical

Brief

No No

Testing for Celiac Disease RDE4400SR

12/10/14 RAND Systematic

Review

No No

! 35!

Transitions of Care for Children

with Special Health Needs

VBE4300 2/14/14 Vanderbilt Technical

Brief

No No

Treatment for ETOH Misuse

(Pharmacotherapy for Adults With

Alcohol-Use Disorders in

Outpatient Settings)

RTE4SR4 1/14/14 RTI Systematic

Review

No No

Treatment of MS MNE4SR1


Review

No No

Troponin Cardiac Marker JHE4SR1 12/13/13 JHU Systematic

Review

Yes No

Chronic Urinary Retention (CUR)

treatment

MNE4SR2 11/13/13 MN Systematic

Review

Yes No

Vitamin D and Calcium: A

Systematic Review of Health

Outcomes (Update)

RDE4SR1 2/18/14 RAND Systematic

Review

Yes No

!

Appendix A

! A#1!

Appendix A.1. Complete list of unpublished projects (321) currently in SRDR as of November 2015 Please Note: This table is available upon request. Included in this table, however, are notable outlier projects that were either created as a way to test the system or were created for purposes other than data extraction, such as data screening or using SRDR as a registry of sorts.

! A#2!

Appendix A.2. Complete list of published projects (48) currently in SRDR as of November 2015

Please Note: The number of collaborators recorded in SRDR for each published project may not accurately reflect the number of contributors who

authored the report. This is because the number of collaborators in a given project, as recorded in SRDR, equals the number of SRDR user

accounts that retain access to edit the project on the SRDR Web site.

Project Title Created Date

Published Date

Name of Organization No. of Collaborators

No. of Extraction Forms

No. of Key Questions

No. of Studies

Therapeutic Management, Delivery, and Postpartum Risk Assessment and Screening in Gestational Diabetes

6/18/13 12/30/13 Johns Hopkins University Evidence Based Practice Center

1 3 3 43

Therapies for Children with Autism Spectrum Disorders

8/2/13 12/30/13 Vanderbilt Evidence Based Practice Center

1 2 2 170

Off-Label Use of Atypical Antipsychotics: An Update

8/18/13 12/30/13 Tufts Evidence Based Practice Center

1 1 4 129

Treatment of Common Hip Fractures

9/20/13 12/30/13 Minnesota Evidence Based Practice Center

1 2 8 85

First- and Second- Generation Antipsychotics for Children and Young Adults

12/2/13 12/30/13 University of Alberta Evidence Based Practice Center

1 1 4 81

Blood Pressure Targets in CKD


3 1 2 3

Sugars and Health - Evidence Map

7/9/13 1/15/14 International Life Sciences Institute

6 2 2 213

Imaging Techniques for Treatment Evaluation for Metastatic Breast Cancer

6/4/14 6/27/14 Pacific Northwest Evidence Based Practice Center

3 1 1 17

Second-Generation Antidepressants in the Pharmacologic Treatment of Adult Depression: An update of the 2007 Comparative Effectiveness Review

7/1/14 7/30/14 RTI-UNC Evidence Based Practice Center

1 2 2 221

! A#3!

Treatment To Prevent Fractures in Men and Women With Low Bone Density or Osteoporosis: Update of a 2007 Report

8/5/14 8/8/14 Southern California Evidence Based Practice Center-RAND Corporation

1 5 5 182

Treatment of Primary and Secondary Osteoarthritis of the Knee

7/25/14 8/14/14 Blue Cross and Blue Shield Association Technology Evidence Based Practice Center

1 5 5 77

The lack of evidence for PET or PET/CT surveillance of patients with treated lymphoma, colorectal cancer, and head and neck cancer

10/25/12 9/5/14 Brown Evidence Based Practice Center

5 1 2 12

Fructose Consumption and Non-alcoholic Fatty Liver Disease (NAFLD)


4 4 5 23

Benefits and Harms of Routine Preoperative Testing: Comparative Effectiveness Review 2013


7 4 4 220

Decision Aids for Cancer Screening and Treatment

7/25/13 9/5/14 Cochrane Complementary and Alternative Medicine Field

6 2 2 74

Imaging Tests for the Diagnosis and Staging of Pancreatic Adenocarcinoma

7/2/14 9/16/14 ECRI Institute-Penn Medicine Evidence Based Practice Center

2 5 6 121

Diet and PA for Prevention of Diabetes-Full Data Extraction


8 1 1 50

Venous Thromboembolism Prophylaxis in Orthopedic Surgery

11/5/14 11/14/14 University of Connecticut-Hartford Hospital Evidence Based Practice Center

1 8 8 149

Effectiveness of Early Diagnosis, Prevention, and Treatment of Clostridium difficile Infection


2 10 10 112

Oral Diabetes Medications for Adults With Type 2 Diabetes: An Update

12/9/14 12/12/14 Johns Hopkins University Evidence Based Practice Center

1 4 4 176

! A#4!

Treatments for Ankyloglossia and Ankyloglossia with Concomitant Lip-tie


4 2 6 43

Procedures for Managing Postpartum Hemorrhage: A Systematic Review


1 2 5 73

Low-calorie sweeteners and body weight and composition: a meta-analysis of randomized controlled trials and prospective cohort studies

3/19/15 3/19/15 Exponent, Inc. 1 2 2 24

Psychosocial and Pharmacologic Interventions for Disruptive Behavior in Children and Adolescents


1 1 2 97

Pain Management Injection Therapies for Low-back Pain


2 1 7 92

Dietary Fiber Database, Version 1


1 1 1 868

Treatments for Fibromyalgia in Adult Subgroups


1 8 12 75

Interventions to Reduce Antibiotic Prescribing for Uncomplicated Acute Respiratory Tract Infections


1 1 6 133

Catheter Ablation for Treatment of Atrial Fibrillation


10 2 7 50

Health Information Exchange 4/24/15 5/20/15 Pacific Northwest Evidence Based Practice Center

2 1 8 136

Treatment of Non-Metastatic Muscle-Invasive Bladder Cancer


2 1 4 40

Emerging Approaches to Diagnosis and Treatment of Non-Muscle-Invasive Bladder Cancer


2 1 8 199

! A#5!

Management and Outcomes of Binge-Eating Disorder (BED)


1 3 15 84

Management Strategies to Reduce Psychiatric Readmissions: Technical Brief


2 4 4 72

Imaging for the Pretreatment Staging of Small Cell Lung Cancer


2 1 3 7

Strategies to Improve Mental Health Care for Children and Adolescents


6 1 3 16

Home-Based Primary Care Interventions


2 1 3 20

Imaging Techniques for the Diagnosis and Staging of Hepatocellular Carcinoma


5 9 9 281

Genetic Testing for Developmental Disabilities, Intellectual Disability, and Autism Spectrum Disorder


1 1 2 141

Behavioral programs for diabetes mellitus

1/29/14 9/21/15 University of Alberta Evidence Based Practice Center

5 2 6 166

Sling surgery for stress urinary incontinence in women: SGS 2013

2/5/13 9/30/15 Society of Gynecologic Surgeons

13 2 2 104

Environmental Cleaning for the Prevention of Healthcare-Associated Infections


1 2 4 70

Treatments for Fecal Incontinence


1 1 2 117

SGS: Local Estrogen For Genitourinary Complaints in Post-Menopausal Women

7/25/13 10/28/15 Society of Gynecologic Surgeons

12 1 1 56

Noninvasive Treatments for Low Back Pain


2 1 2 156

Management of Insomnia Disorder


1 1 2 139

! A#6!

Improving Cultural Competence to Reduce Health Disparities


1 1 5 86

Early Diagnosis, Prevention, and Treatment of C. difficile: Update


1 1 4 92

systematic review data repository (srdr) annual report ...2015+annual+report.pdfproviding further...

Documents