joshua devine, major, usaf, bsc
DESCRIPTION
Identification and Use of Published Health Economic Evaluations to Support Formulary Decisions at the MTF. Joshua Devine, Major, USAF, BSC. Objective. Outline an effective approach for the systematic searching and use of published health economic evaluations. Outline. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/1.jpg)
Promoting high quality, cost effective drug therapy throughout the Military Health System
Identification and Use of Published Health Economic Evaluations to Support Formulary
Decisions at the MTF
Joshua Devine, Major, USAF, BSC
![Page 2: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/2.jpg)
2DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Objective
• Outline an effective approach for the systematic searching and use of published health economic evaluations
![Page 3: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/3.jpg)
3DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Outline
• Explain the definition and purpose of economic evaluation studies
• Highlight the characteristics of a health economic evaluation
• Examine how economic evaluation studies are indexed in MEDLINE, a major bibliographic database
• Discuss simple methods for determining if the results from economic evaluations are useful in your setting
![Page 4: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/4.jpg)
4DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Purpose of Economic Evaluation Studies
• To ensure that the benefits from a health care program implemented are greater than the opportunity cost of such a program
• Addressing questions of
– technical efficiency or
– allocative efficiency
![Page 5: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/5.jpg)
5DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Economic Evaluation Studies
A FULL economic evaluation compares BOTH the
• costs AND consequences of
• two or more interventions
Requires
– identification
– measurement
– valuation
of both costs and benefits
![Page 6: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/6.jpg)
6DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Economic Evaluation Methodologies
• cost-minimisation analysis (CMA)
• cost-effectiveness analysis (CEA)
• cost-utility analysis (CUA)
• cost-benefit analysis (CBA)
![Page 7: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/7.jpg)
7DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Economic Evaluation Methodologies
Evaluative Technique Benefits Unit of Measurement
cost-effectiveness analysis
quantity of Life
OR
quality of Life
life years gained
OR
natural units
cost-utility analysisquantity +
quality of life
health years
e.g., QALYs, HYE
cost-benefit analysisquantity +
quality of life
money
e.g., willingness to pay
![Page 8: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/8.jpg)
8DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Partial Economic Evaluation Studies
• cost comparison/cost analysis study
• cost of illness study
• cost outcome description
• cost description
![Page 9: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/9.jpg)
9DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Quality of Health Economic Evaluations
• Poor study design
– weak data sources
– failure to define clearly the economic evaluation method used
– use of an inappropriate method if economic evaluation to address the research question
– omission of sensitivity analysis to test robustness of modelling
![Page 10: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/10.jpg)
10DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Quality of Health Economic Evaluations
• Inadequate reporting
– lack of transparency by authors
– journal editorial policy surrounding economic submissions
• Publication bias
– publication bias in the clinical literature
– motivation for conducting an economic evaluation
![Page 11: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/11.jpg)
11DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
• Research by Zarnke and colleagues
• Bibliographic databases searched between 1991-1995 for cost-benefit analyses
• Identified studies were classified according to standard definitions
• The comprehensiveness of identified studies were also evaluated
Mislabeling and Comprehensiveness of Economic Evaluations
Zarnke et al. 1997; Journal of Clinical Epidemiology
![Page 12: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/12.jpg)
12DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
0
5
10
15
20
25
30
35
40
Very Fairly NotVery
Cursory
Mislabeling and Comprehensiveness of Economic Evaluations
68%
32%
Percent of identified studies employing appropriate
methodology
Not Appropriate
Comprehensiveness of analysis
Appropriate
Zarnke et al. 1997; Journal of Clinical Epidemiology
![Page 13: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/13.jpg)
13DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
• Studies labeled as CBAs in the health care literature often offer only partial program evaluation
• Health care decision-makers should apply the results of these studies cautiously
• You must carefully review the methods and assumptions used in this type of analysis
Mislabeling and Comprehensiveness of Economic Evaluations
Zarnke et al. 1997; Journal of Clinical Epidemiology
![Page 14: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/14.jpg)
14DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
• Systematic review of cost-effectiveness studies published in 2006
• Bibliographic databases searched between 1976-2001 for cost-effectiveness analyses
• Identified 494 english language studies
• Examined the distribution of incremental cost effectiveness ratios in dollars
Bias in Published Economic Evaluations
Bell et al. 2006; BMJ
![Page 15: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/15.jpg)
15DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Bias in Published Economic Evaluations
Bell et al. 2006; BMJ
![Page 16: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/16.jpg)
16DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
• Most published analyses report favorable incremental cost effectiveness ratios
• Studies funded by industry were more likely to report ratios below the three thresholds
• Studies of higher methodological quality were less likely to report ratios below $20,000/QALY
Bias in Published Economic Evaluations
Bell et al. 2006; BMJ
![Page 17: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/17.jpg)
17DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Bottom Line
• Use caution when interpreting economic evaluations in the literature
• Critical appraisal is a must
![Page 18: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/18.jpg)
18DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Searching Bibliographic Databases for Economic Evaluations
• Indexing policy
– availability of controlled vocabulary
– specificity of indexing terms
• Indexing accuracy
– clarity of description
– accurate labelling
– consistency
![Page 19: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/19.jpg)
19DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
MEDLINE
• MeSH is the U.S. National Library of Medicine's controlled vocabulary used for indexing articles for MEDLINE/PubMed
• Using this terminology should greatly enhance your efficiency
• Can also use – related links – a command to identify similar articles
![Page 20: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/20.jpg)
20DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Link to MeSH Database of
Search Terms
Brief Tutorial Links on How to
Use MeSH Terms for Searches
![Page 21: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/21.jpg)
21DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Example
• How would you search for relevant articles on nose bleed using MeSH terminology?
![Page 22: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/22.jpg)
22DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 23: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/23.jpg)
23DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 24: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/24.jpg)
24DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 25: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/25.jpg)
25DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 26: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/26.jpg)
26DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 27: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/27.jpg)
27DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
MeSH Terms for Economic Evaluations
• Economics
– Costs and Cost Analysis
• Cost Allocation
• Cost-Benefit Analysis ***Target MeSH Term***
• Cost Control (+)
• Cost of Illness
• Cost Sharing (+)
• Health Care Costs (+)
• Health Expenditures (+)
![Page 28: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/28.jpg)
28DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Example
• How would you identify published economic evaluations for the treatment of glaucoma using MeSH terminology?
![Page 29: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/29.jpg)
29DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 30: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/30.jpg)
30DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 31: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/31.jpg)
31DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 32: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/32.jpg)
32DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 33: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/33.jpg)
33DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 34: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/34.jpg)
34DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 35: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/35.jpg)
35DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 36: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/36.jpg)
36DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 37: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/37.jpg)
37DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
![Page 38: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/38.jpg)
38DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Other Sources for Economic Evaluations
Databases
• CEA Registry Tufts/NEMC (formerly Harvard CUA Database)
• Multiple European Databases (NHS EED, HEED, EURONHEED)
Journals
• Traditional medical journals (JAMA or NEJM)
• Focus on health economics (HSR or MDM)
![Page 39: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/39.jpg)
39DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Using Economic Evaluations for Formulary Decisions
Are the results from an economic evaluation
useful to me in my setting?
1) Is the methodology employed in the study appropriate?
2) If the results are valid, would they apply to my setting?
![Page 40: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/40.jpg)
40DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Guidelines for Economic Evaluations
Conduct– Pharmaceutical Reimbursement (WellpointRx)
– Methodology (NICE, PHS Panel)
Reporting– BMJ Guidelines (Drummond et al. 1996)
Appraisal– BMJ Guidelines (Drummond et al. 1996)
– Methods for the Economic Evaluation of Health Care Programmes (Drummond et al. 2005)
![Page 41: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/41.jpg)
41DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Check-List Example for Appraisal of Economic Evaluations
• Was a well-defined question posed in answerable form?
– Did the study examine both costs and effects of the drug under study?
– Did the study involve a comparison of alternatives?
– Was a viewpoint for the analysis stated and was the study placed in any particular decision-making context?
Drummond et al. 2005
![Page 42: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/42.jpg)
42DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Check-List Example for Appraisal of Economic Evaluations
• Was the effectiveness of the various treatments established?
– Did the study use data from randomized, controlled clinical trials?
– Was the information collected and summarized through a systematic overview?
– Were observational data or assumptions used to establish effectiveness?
Drummond et al. 2005
![Page 43: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/43.jpg)
43DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Check-List Example for Appraisal of Economic Evaluations
• Were all relevant costs and consequences valued accurately and credibly?
– Was the range wide enough for the research question at hand?
– Were the sources of all values clearly identified?
Drummond et al. 2005
![Page 44: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/44.jpg)
44DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Check-List Example for Appraisal of Economic Evaluations
Drummond et al. 2005
• Was an incremental analysis of costs and consequences of alternatives performed?
– Were the additional costs generated by one alternative over another compared to the additional effects, benefits, or utilities generated?
![Page 45: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/45.jpg)
45DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Check-List Appraisals of Economic Evaluations
• Unrealistic to expect every study to satisfy all of the points in a check-list
• However, it can help identify and assess the strengths and weaknesses
![Page 46: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/46.jpg)
46DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Application of Results from Economic Evaluations
• Once deemed valid, the next step is to determine if the study results apply to you
• No clear answers to this question
• However, several factors are worth considering when evaluating results from economic evaluations
![Page 47: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/47.jpg)
47DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Factors Likely to Affect Cost-Effectiveness in the MHS
• Basic demography and epidemiology of disease in the population studied
• Availability of health care resources and variations in clinical practice
• Incentives to health care professionals and institutions
• Relative prices or costs
• Population values
![Page 48: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/48.jpg)
48DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Use of Economic Evaluations
• Momentum for use of economic evaluations continues to build
• Useful as an aid for making comparisons between interventions
• Could provide a framework for evaluating proposals for formulary additions
• In general, can be used as a systematic way of thinking or structuring problems
![Page 49: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/49.jpg)
49DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
Conclusion
• Identification of economic evaluations is easily accomplished through MEDLINE
• The existing literature has shown gaps in quality but is improving
• Appraisal and transferability of these studies are key issues for consideration
• Economic evaluations should play a role in the formulary decision-making process
![Page 50: Joshua Devine, Major, USAF, BSC](https://reader035.vdocuments.us/reader035/viewer/2022062423/568145e7550346895db2e6fa/html5/thumbnails/50.jpg)
50DoD Pharmacoeconomic Centerwww.pec.ha.osd.mil
References
• Health Economics Information Resources: A Self-Study Course – available through the National Information Center on Health Services Research and Health Care Technology (NICHSR)
• Drummond et al. (2005) Methods for the economic evaluation of health care programmes (3rd ed.)
• Gold et al. (1996) Cost-effectiveness in health and medicine