6 sr and meta analysis-ayurved
TRANSCRIPT
![Page 1: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/1.jpg)
Systematic Reviews and
Meta-analysis
Dr Nazli Khatib (MD, PhD)Professor (Physiology)
International Initiative Impact (3ie) Evaluation AwardeeJNMC
DMIMS(DU)
1
![Page 2: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/2.jpg)
Objectives of the talk
• To provide the needs, characteristics and constitution of
systematic review
• To provide an overview of the process of planning,
undertaking and writing a systematic review
• To provide an overview of meta-analysis
2
![Page 3: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/3.jpg)
Levels of evidences in health care
3
![Page 4: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/4.jpg)
The need for SR ??
• Healthcare providers, consumers & policy makers are
inundated with loads of information.
• No time, skills & resources to find, appraise and interpret this
evidence and to incorporate it into healthcare decisions.
• SR respond to this challenge by identifying, appraising and
synthesizing research-based evidence and presenting it in an
accessible format.
4
![Page 5: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/5.jpg)
Systematic review
5
![Page 6: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/6.jpg)
So, a systematic review.....
• ...attempts to pool all pragmatic evidences in order to answer
a specific research question.
• ...uses precise, systematic methods that are selected with a
view to minimizing bias, thus providing reliable findings from
which conclusions can be drawn and decisions made (Antman 1992,
Oxman 1993).
6
![Page 7: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/7.jpg)
Key characteristics of an SR
• An explicit methodology
• A systematic search that identifies all studies
• An assessment of the validity of the findings of the included
studies
• A systematic presentation, and synthesis of the characteristics
and findings of the included studies.
7
![Page 8: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/8.jpg)
Need for an SR....
SR can be conducted in an effort to:
• Resolve conflicting evidence • Help people make practical decisions about health care.• Address questions where clinical practice is uncertain• Establish feasibility of an intervention• Summarize and help people to understand the evidence. • Confirm the appropriateness of current practice or highlight a
need for future research. • Avoiding redundant unnecessary trials
8
![Page 9: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/9.jpg)
SR with Meta-analysis
• Meta-analysis is the use of statistical methods to summarize
the results of independent studies.
• Not every SR leads to a meta-analysis. But it is better if a
meta-analysis is based on an underlying systematic review.
9
![Page 10: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/10.jpg)
Before you start with a SR...
• Need to make sure no other systematic review identical to
yours has recently been conducted
• Need to make sure there is a need for review
10
![Page 11: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/11.jpg)
Steps in SR
1. Define the review question
2. Search for studies
3. Select studies
4. Extract data
5. Assess risk of bias in included studies
6. Analyse data and undertake meta-analyses
7. Address reporting biases
8. Present results and ‘Summary of findings’ tables
11
![Page 12: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/12.jpg)
SR titles
12
Scenario Structure Example Basic structure. [Intervention]
for [health problem].
Antibiotics for acute bronchitis.
Comparing two active interventions.
[Intervention A] versus [intervention B] for [health problem].
Immediate versus delayed treatment for cervical intraepithelial neoplasia.
Type of people being studied or location of intervention mentioned explicitly.
[Intervention] for [health problem] in [participant group/location].
Inhaled nitric oxide for respiratory failure in preterm infants
![Page 13: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/13.jpg)
1. Defining the review question
• A clearly defined, focused review begins with a well framed
question.
• A well-formulated research question increase the efficiency of the
review by limiting the time and cost of identifying and obtaining
relevant literature.
• The review question should be in PICO format.
• SR can focus on broad questions, or be more narrowly defined.
13
![Page 14: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/14.jpg)
Steps in SR
1. Define the review question
2. Search for studies
3. Select studies
4. Extract data
5. Assess risk of bias in included studies
6. Analyse data and undertake meta-analyses
7. Address reporting biases
8. Present results and ‘Summary of findings’ tables
14
![Page 15: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/15.jpg)
2. Searching for studies
• Electronic databases
• “Grey literature” ( thesis, Internal reports, pharmaceutical industry
files)
• Checking reference lists
• Unpublished sources known to experts in the specialty (seek
by personal communication and look in trial registers)
• Hand searching
• Has to be as comprehensive as possible
15
![Page 16: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/16.jpg)
Steps in SR
1. Define the review question
2. Search for studies
3. Select studies
4. Extract data
5. Assess risk of bias in included studies
6. Analyse data and undertake meta-analyses
7. Address reporting biases
8. Present results and ‘Summary of findings’ tables
16
![Page 17: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/17.jpg)
3. Selecting studies(Inclusion and exclusion of studies)
• Scan titles & abstracts to retrieve possibly relevant studies
• Correspond with investigators, where appropriate, to clarify
study
• Decide if studies meet inclusion criteria and record reasons
for exclusion
• Done by two independent review authors
17
![Page 18: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/18.jpg)
Selecting studies: Prisma chart
![Page 19: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/19.jpg)
Steps in SR
1. Define the review question
2. Search for studies
3. Select studies
4. Extract data
5. Assess risk of bias in included studies
6. Analyse data and undertake meta-analyses
7. Address reporting biases
8. Present results and ‘Summary of findings’ tables
19
![Page 20: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/20.jpg)
4. Extracting data
• Data needed from each study
Details of the trial
Numerical data of the outcomes in each group to enter
into meta-analysis
20
![Page 21: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/21.jpg)
21
![Page 22: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/22.jpg)
Steps in SR
1. Define the review question
2. Search for studies
3. Select studies
4. Extract data
5. Assess risk of bias in included studies
6. Analyse data and undertake meta-analyses
7. Address reporting biases
8. Present results and ‘Summary of findings’ tables
22
![Page 23: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/23.jpg)
5. Assessing the risk of bias
• If poor quality trials are the building blocks of a systematic
review, the review may follow high quality methods, but the
quality of evidence may still be poor
• Use of poor quality methods may change the results of a trial
• Inclusion of poor quality studies in meta-analysis is likely to
exaggerate treatment effect
• The evaluation of the validity of the included studies is
therefore an essential.
23
![Page 24: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/24.jpg)
Risk of bias
24
![Page 25: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/25.jpg)
Steps in SR
1. Define the review question
2. Search for studies
3. Select studies
4. Extract data
5. Assess risk of bias in included studies
6. Analyse data and undertake meta-analyses
7. Address reporting biases
8. Present results and ‘Summary of findings’ tables
25
![Page 26: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/26.jpg)
6. Analyse data - Meta-analysis
Principles
• Patients in one trial are NEVER directly compared with those
in another trial
• Each trial is analysed separately
• Summary statistics are collected /calculated for each trial
• Each study is weighted
• These summary statistics are added together to give the
‘meta-analysis’ 26
![Page 27: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/27.jpg)
Why perform a meta-analysis?
• Increase power
• Improve precision of estimate
• Quantify treatment effects and their uncertainty
• Assess consistency of results
• Answer questions not posed by individual studies
• Settle controversies from conflicting studies
• Generate new hypotheses
27
![Page 28: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/28.jpg)
When can you do a meta-analysis?
• When more than one study has estimated an effect
• When characteristics of the studies are sufficiently similar so
it makes sense to combine them
• When the data are available in the form we need to combine
them (e.g. outcome measured in similar ways)
28
![Page 29: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/29.jpg)
When not to do a meta-analysis?
• ‘Mixing apples with oranges’
Not useful for learning about apples
Useful for learning about fruit
Meta-analysis may be meaningless and genuine effects may be
obscured if studies are too clinically diverse
• Meta-analysis in presence of serious
publication and/or reporting biases may produce an
inappropriate summary
29
![Page 30: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/30.jpg)
Steps in doing a meta-analysis
1. Define comparisons for your review
2. Decide on outcomes for each comparison
3. Data retrieval
4. Entering and pooling data
5. Exploring heterogeneity
6. Interpreting results
30
![Page 31: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/31.jpg)
Defining comparisons and outcome
31
![Page 32: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/32.jpg)
Steps in doing a meta-analysis
1. Define comparisons for your review
2. Decide on outcomes for each comparison
3. Data retrieval
4. Entering and pooling data
5. Exploring heterogeneity
6. Interpreting results
32
![Page 33: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/33.jpg)
Retrieving, entering & pooling data
33
![Page 34: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/34.jpg)
Data analysis: Forest plot
Forest plot of comparison: Ghrelin v/s Control; Outcome: Mortality
34
![Page 35: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/35.jpg)
Steps in SR
1. Define the review question
2. Search for studies
3. Select studies
4. Extract data
5. Assess risk of bias in included studies
6. Analyse data and undertake meta-analyses
7. Address reporting biases
8. Present results and ‘Summary of findings’ tables
35
![Page 36: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/36.jpg)
8. Summary of findings table (SoF)
• There are 3 key parts of a SoF table:
Information about the review
Summary of the statistical results
Grade of the quality of evidence.
36
![Page 37: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/37.jpg)
Composition of a SR
37
![Page 38: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/38.jpg)
Grants for SR
• ICMR
• 3ie’s Systematic Review Call 5 is funding 8 systematic reviews.
• Department For International Development, UK Aid are
commissioning 10 new SR on topics such as education, health,
infrastructure and humanitarian assistance.
• NIHR Cochrane Programme Grant Scheme
• NIHR Cochrane Incentive Awards
• USAID funded reviews38
![Page 39: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/39.jpg)
Grants for SR
• 3ie, along with the Canadian International Development
Agency (CIDA), the United States Agency for International
Development (USAID), and the Millennium Challenge
Corporation (MCC) is inviting proposals for SR in international
development. This call will fund up to 15 review questions in
the areas of agriculture, infrastructure, business
development, governance and education interventions.
39
![Page 40: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/40.jpg)
Summary
• SR is “the application of scientific strategies that limit bias by
the systematic assembly, critical appraisal and synthesis of all
relevant studies on a specific topic.” (Cook 1995)
• Help people to resolve conflicting evidence & make practical
decisions about health care.
• Steps in SR: Def RQ Search studies Select studies
Extract data Assess risk of bias Analyse data Address
reporting biases Present results and ‘SoF’ tables Interpret
results and draw conclusions 40
![Page 41: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/41.jpg)
Summary...
• Meta-analysis is the use of statistical methods to summarize
the results of independent studies.
• Steps in meta-analysis: Define comparisons & outcomes
Data retrieval Entering and pooling data Exploring
heterogeneity Interpreting results
41
![Page 42: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/42.jpg)
To increase the power & precision
42
![Page 43: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/43.jpg)
Generate new hypotheses
43
![Page 44: 6 sr and meta analysis-ayurved](https://reader031.vdocuments.us/reader031/viewer/2022020110/55a4afc41a28ab096d8b4896/html5/thumbnails/44.jpg)
44