systematic reviews: the potential of different methods steve higgins henry potts james thomas geoff...
DESCRIPTION
Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012. Introduction. Aims To outline major approaches to systematic reviewing and research synthesis - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/1.jpg)
(1)
Systematic Reviews: The Potential of
Different Methods Steve HigginsHenry Potts
James ThomasGeoff Wong
ESRC Research Methods FestivalOxford, 5 July 2012
![Page 2: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/2.jpg)
(2)
Introduction
• Aims– To outline major approaches to systematic
reviewing and research synthesis– To demystify what on first glance looks like a
bewildering set of overlapping approaches– To examine some of the assumptions that
underpin these approaches– To discuss how these approaches might help in
my (your!) situation
![Page 3: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/3.jpg)
(3)
Introduction
• Session structure:– 20 Minute presentation + 10 minutes discussion
/ clarification of four approaches to synthesis– Coffee break after the 3rd / 4th presentation– Discussion in pairs– Questions + panel discussion
![Page 4: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/4.jpg)
(4)
What is a systematic review?
• Systematic: ‘done or acting according to a fixed plan or system; methodical’
• Review: ‘a critical appraisal of a book, play, or other work’(OED)
![Page 5: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/5.jpg)
(5)
What is systematic research synthesis?
• Synthesis: ‘The process or result of building up separate elements, especially ideas, into a connected whole, especially a theory or system’ (OED)
• Not just a report of the findings of the individual studies in a review
• Involves a transformation of the data from primary studies in some way
• Synthesis of the findings of all the included studies in order to answer the review question
![Page 6: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/6.jpg)
(6)
Aims of synthesis reviews
• Answer questions: what do we want to know and how can we know it?
• Bring together and ‘pool’ the findings of primary research (i.e. clarify what we know)
• Any question so potentially any type of evidence
• Driven by review users to answer relevant questions in relevant ways
![Page 7: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/7.jpg)
(7)
Introduction
• We will look at four main approaches to reviewing:– Meta-analysis– The synthesis of ‘qualitative’ research– Realist review– Meta narrative review
• Each have different disciplinary backgrounds and underlying assumptions
• They all bring together research using two main logics -
![Page 8: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/8.jpg)
(8)
Aggregation in reviews
Aggregation refers to ‘adding up’ (aggregating) findings from primary studies to answer a review question…
… to indicate the direction or size of effect… and our degree of confidence in that finding
![Page 9: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/9.jpg)
(9)
Configuration in reviews
Configuration involves the arrangement (configuration) of the findings of primary studies to answer the review question….
… to offer a meaningful picture of what research is telling us... across a potentially wide area of research
•
![Page 10: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/10.jpg)
(10)
Most reviews contain elements of both, but some patterns are common
Aggregation Configuration
Approach to theory Test Generate
Research question Closed Open
Concepts Secure prior to review Emergent in review
Timing of methods decisions
A priori Iterative / emergent
Search for studies Representative / unbiased / exhaustive
Sufficient / purposive
Quality appraisal Avoiding bias Richness of data
Explore
![Page 11: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/11.jpg)
(11)
The EPPI-Centre is part of the Social Science Research Unit at the Institute of Education, University of London, UK1
Methods for the synthesis of qualitative
researchJames Thomas1
ESRC Research Methods FestivalOxford, 5 July 2012
![Page 12: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/12.jpg)
(12)
Synthesis of qualitative research: outline
• What can qualitative research tell us?
• Current developments/approaches in qualitative review methods
• Examples of syntheses of qualitative
research
![Page 13: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/13.jpg)
(13)
What can qualitative research tell us?
![Page 14: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/14.jpg)
(14)
Qualitative research…
• aims to provide an in-depth understanding of people’s experiences, perspectives and histories in the context of their personal circumstances or settings…*
• with the use of unstructured methods which are sensitive to the social context of the study*
• the capture of data which are detailed, rich and complex…*
• is generalisable on the basis of theory not statistical probability **
* Spencer et al (2003); ** Popay (2006)
![Page 15: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/15.jpg)
(15)
Methods used include*…
• exploratory interviews• focus groups• observation• conversation• discourse and narrative analysis• documentary and video analysis
*Spencer et al (2003)
![Page 16: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/16.jpg)
(16)
Is it simply the analysis of textual data?
“Increasingly, the terms ‘quantitative research’ and ‘qualitative research’ came to signify much more than ways of gathering data; they came to denote divergent assumptions about the nature and purposes of research in the social sciences”
Bryman (1988) Quantity and Quality in Social Research. London: Unwin Hyman. p.3.
![Page 17: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/17.jpg)
(17)
Qualitative research can*
• help to define policy questions• look in detail at how a programme or trial
was actually implemented• help to determine appropriate outcome
measures by looking at ‘subjective’ outcomes
• help to clarify what counts as effective or successful
* Davies (2000) ‘Contributions from qualitative research’ in Davies et al (eds) What works? Evidence-based policy and practice in public services. Bristol: Policy Press. Cited in *Spencer et al (2003). p.36
![Page 18: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/18.jpg)
(18)
…continued
• identify and explore unintended consequences• contribute to service delivery and policy
development by describing processes and contexts
• inform and illuminate quantitative studies, e.g. by contributing to the design of structured instruments, assessing the fairness of comparisons in experimental studies, or unpacking variation within aggregated data
Davies (2000) ‘Contributions from qualitative research’ in Davies et al (eds) What works? Evidence-based policy and practice in public services. Bristol: Policy Press. Cited in *Spencer et al (2003). p.36
![Page 19: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/19.jpg)
(19)
Current developments in synthesising qualitative research
• Growing recognition of the value of qualitative research to inform policy & practice
• Methods developing to facilitate this
![Page 20: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/20.jpg)
(20) Try: http://www.wordle.net/
![Page 21: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/21.jpg)
(21)
Methodological study
• We searched for methodological papers concerning the synthesis of concepts or theories– Purposive, rather than systematic search– Reference ‘chasing’– Google scholar search– Handsearching key journals
• 203 papers retrieved• 9 distinct methods for synthesis
![Page 22: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/22.jpg)
(22)
Methods for the synthesis of qualitative research identified
• Meta narrative synthesis• critical interpretive synthesis• meta-study• meta-ethnography• grounded theory• thematic synthesis• framework synthesis• ecological triangulation
![Page 23: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/23.jpg)
(23)
Many methods: similar or different?
• Examined the methods across different dimensions:– Epistemology– Approach to quality assessment– Attitudes towards problematizing the literature– Use of review question– How similar / different the included studies were– Characteristics of the synthetic product
• Found they fell into two broad camps: ‘idealist’ and ‘realist’
![Page 24: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/24.jpg)
(24)
‘Realist’ approaches
Purpose• To answer a policy relevant questionMethods• Qualitative/ quantitative data analysed with
qualitative/ quantitative methods• Searching linear or iterative• Quality assessment of study methodsProduct • Directly applicable to policy and practice
decisions
![Page 25: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/25.jpg)
(25)
‘Idealist’ approaches
Purpose• To explore and construct concepts from the data• For generating theoryMethods• Qualitative data analysed with qualitative methods• Searching iterative• Qualitative assessment of study content > methodProduct • Complex, requiring further interpretation before being
used for policy or practice
![Page 26: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/26.jpg)
(26)
Conclusions
• Operationally, many methods are very similar
• Underlying principles differ• Product differs in terms of the amount of
additional interpretation required. This may reflect…
• (Barnett-Page and Thomas (2009))
![Page 27: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/27.jpg)
(27)
Perspectives on how evidence informs the policy process
Idealist Realist
Knowledge-driven model; Problem-solving (policy driven) model*
(either researcher disseminates research or policy-maker commissions / requests specific research)
Less suited More suited
Interactive model; Enlightenment model*
(ongoing interactions between researcher and policymaker; ‘gradual sedimentation of insights…’)
More suited Less suited
*Weiss (1979)
![Page 28: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/28.jpg)
(28)
Two examples
• All this is a bit abstract… what do systematic reviews of qualitative research look like?
• Two examples:– The ‘fine grain’ of a synthesis– ‘Mixed methods’ synthesis
![Page 29: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/29.jpg)
(29)
Example 1: Informing policy about the ‘obesity epidemic’
What are children’s views about:
• the meanings of obesity or body size, shape or weight (including their perceptions of their own body size)?
• influences on body size?• changes that may help
them to achieve or maintain a healthy weight?
Views = attitudes, opinions, beliefs, understanding or experiencesAs distinct from health/weight status, behaviour, factual knowledge
Rees et al 2009
![Page 30: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/30.jpg)
(30)
‘Thematic synthesis’
• Similar to other methods of synthesising qualitative research (e.g. ‘meta-ethnography’)
• Source data = text (documents)• Source material = conceptual• Key method = translation• Final product = interpretation
• (Thomas and Harden 2008)
![Page 31: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/31.jpg)
(31)
Stages of thematic synthesis
• Stages one and two: coding text and developing descriptive themes– Identifying the ‘findings’– Line-by-line coding– Developing descriptive themes
• Stage three: generating analytical themes– In the light of the review question
![Page 32: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/32.jpg)
(32)
Screenshot – line-by-line coding
![Page 33: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/33.jpg)
(33)
Screenshot – descriptive codes diagram
![Page 34: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/34.jpg)
(34)
Example 2. adding insights to other existing reviews
• How might a systematic review of qualitative research support or add insight to a meta-analysis?
• Product of qualitative synthesis can form the conceptual framework within which heterogeneity can be explored in a meta-analysis
![Page 35: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/35.jpg)
Searching, screening mapping and user involvement
e.g. Statistical meta-analysis of trials a) Data extraction
b) Quality assessmentc) Effect sizes pooledd) Narrative synthesis
Addresses sub RQ e.g. ‘which interventions are effective?’
e.g. Thematic synthesis of qualitative studies a) Data extraction
b) Quality assessmentc) Descriptive themesd) Analytical themes
Addresses sub RQ e.g. ‘what are people’s perspectives and experiences ?
Synthesis 1 Synthesis 2
Synthesis 3Driven by overall review question
Integration of separate syntheses e.g. a) Matches, mis-matches and gaps
b) Hypotheses generated in synthesis 2 tested amongst trials in synthesis 1
Review Questione.g. ‘What is known about the barriers to, and facilitators of, outcome X (e.g. physical activity)
amongst population A (e.g. young people
![Page 36: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/36.jpg)
(36)
Cross study synthesis: FindingsChildren’s views Outcome evaluations
Recommendation for interventions
Good quality Other
Do not promote fruit and vegetables in the same way
No soundly evaluated
interventions
No other interventions
identified
Brand fruit and vegetables as an ‘exciting’ or child-relevant product, as well as a ‘tasty’ one
5 soundly evaluated
interventions identified
5 other interventions
Reduce health emphasis in messages to promote fruit and vegetables particularly those which concern future health
5 soundly evaluated
interventions identified
6 other interventions identified
![Page 37: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/37.jpg)
(37)
Cross study synthesis: an example of sub-group analysisIncrease (standardised portions per day) in vegetable intake across trials
0
0.1
0.2
0.3
0.4
0.5
0.6
Wardle
Liquo
ri
Henry
Anders
on
Reyno
lds Auld
Auld (b
)
Barano
wski
Perry
Study
Port
ions
Little or no emphasis on health messages
![Page 38: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/38.jpg)
(38)
This method of synthesis across study types:
• preserves the integrity of the findings of the different types of studies
• allows us to integrate ‘quantitative’ estimates of benefit and harm with ‘qualitative’ understanding from people’s lives
• allows the exploration of heterogeneity in ways in which it would be difficult to imagine in advance– protects against ‘data dredging’
![Page 39: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/39.jpg)
(39)
Assumptions / theoretical models
• Mixed methods synthesis can draw on thinking relating to mixed methods in primary research
• In terms of a frequently used taxonomy of paradigm stances (Creswell 2011) e.g.– Incommensurability (cannot be mixed)– A-paradigmatic (can be mixed and matched in different ways)– Complementary strengths (not incompatible, but are different
and should be kept separate)– Dialectic (paradigms are important in different ways leading to
useful tensions & insights)– Alternative paradigm (‘mixed methods’ paradigm; foundation in
e.g. pragmatism)
![Page 40: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/40.jpg)
(40)
Conclusions
• Qualitative research offers valuable insights that can inform policymaking
• Methods for synthesising qualitative research are still being developed
• Selection of a particular method depends on the type of answer required (and the means by which the review will inform policy)
![Page 41: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/41.jpg)
(41)
References
• Barnett-Page E, Thomas J (2009) Methods for the synthesis of qualitative research: a critical review. BMC Medical Research Methodology, 9:59. doi:10.1186/1471-2288-9-59. (http://www.biomedcentral.com/1471-2288/9/59)
• Creswell J (2011) Mapping the Developing Landscape of Mixed Methods Research in Teddlie C, Tashakkori A: SAGE Handbook of Mixed Methods in Social & Behavioral Research. New York: Sage.
• Gough D, Oliver S, Thomas J (2012) An Introduction to Systematic Reviews. London: Sage
• Thomas J, Harden A (2008) Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Medical Research Methodology, 8:45 doi:10.1186/1471-2288-8-45 (http://www.biomedcentral.com/1471-2288/8/45)
• Thomas J, Harden A, Oakley A, Oliver S, Sutcliffe K, Rees R, Brunton G, Kavanagh J (2004) Integrating qualitative research with trials in systematic reviews: an example from public health. British Medical Journal 328: 1010-1012. (http://www.bmj.com/cgi/content/full/328/7446/1010)
![Page 42: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/42.jpg)
(42)
Systematic Reviews: The Potential of
Different Methods Steve HigginsHenry Potts
James ThomasGeoff Wong
ESRC Research Methods FestivalOxford, 5 July 2012
![Page 43: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/43.jpg)
(43)
Summary
Heterogeneity Aggregation / configuration
Meta-analysis A problem in fixed effectAllowance made for in random effectsFor ‘exploration’
Fixed & random effects models are pure aggregationSub-group & meta-regression both aggregate & configure
Synthesis of qualitative research
Expected. Key challenge is judging when contexts / concepts are too dissimilar to be compared.
Similar concepts are ‘aggregated’; most synthesis involves configuration
Realist review Necessary to obtain different contexts etc
Aggregates within CMO configurations; configures between them
Meta narrative review Necessary to obtain diversity in paradigms
Aggregation within paradigms; configuration between them
![Page 44: Systematic Reviews: The Potential of Different Methods Steve Higgins Henry Potts James Thomas Geoff Wong ESRC Research Methods Festival Oxford, 5 July 2012](https://reader030.vdocuments.us/reader030/viewer/2022020323/56816952550346895de0f928/html5/thumbnails/44.jpg)
(44)
Your turn
Research question
Heterogen-eity?
Meta-analysis
Qualitative synthesis
Realist review
Meta narrative review
Research question 1
Research question 2