fraud in medical research
TRANSCRIPT
![Page 1: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/1.jpg)
Fraud in Medical Research:
Emphasis on Statistical Aspects
Ted Colton, ScD
Professor & Chair Emeritus
Department of Epidemiology & Biostatistics
![Page 2: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/2.jpg)
A Continuum with Fuzzy Boundaries
Ignorance, NaivetéCarelessness, SloppinessImproper methods Statistical ‘fallacies’
FraudCheating Misconduct
Questionable methodsData torturingData dredging Selective reportingSelective non-reporting
Deliberate!
Either
Unintentional
![Page 3: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/3.jpg)
Types of Fraud
Plagiarism - not dealt with in this talk
Falsification – data alteration
Fabrication – made-up data
![Page 4: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/4.jpg)
Motivation for Fraud
Obtain a desired result, e.g. ‘statistical significance’
Monetary gain, enhancement of prestige
Compensate for laziness, sloppiness in data collection
Include subjects who would otherwise be excluded
![Page 5: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/5.jpg)
Some Historical Instances of Fraud
![Page 6: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/6.jpg)
Gregor Mendel
Sir Ronald FisherSir Ronald Fisher
Date: 1865Place: BohemiaResearch: Genetics of garden peas
![Page 7: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/7.jpg)
Sir Cyril Burt
Date: 1955-66
Place: Great Britain
Research: IQs of identical twins reared apart and reared together
Leon KaminLeon Kamin
![Page 8: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/8.jpg)
Dr. John Darsee
Date: 1981Place: Harvard Medical School, Peter Bent Brigham HospitalResearch: Laboratory and animal studies of cardiovascular disease
![Page 9: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/9.jpg)
Data Items in Clinical TrialsProne to Fraud
Eligibility criteria
Repeated measurements
Adverse events
Compliance
Subject diaries
![Page 10: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/10.jpg)
Questions for Consideration
1. How was fraud detected?
2. Why was fraud committed?
3. What have been the consequences of fraud?
4. Statistically, how do we handle data when some data are suspected or confirmed as fraudulent?
5. Can we use statistical methods to detect or confirm suspected instances of fraud?
6. What measures, if any, can we take to prevent future episodes of fraud?
![Page 11: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/11.jpg)
Dr. Marc Strauss
Date: 1978
Place: Boston University Medical Center
Research: Multi-center clinical trials of cancer, ECOG
![Page 12: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/12.jpg)
Dr. Roger Poisson
Date: 1992Place: St. Luc’s Hospital, MontrealResearch: Multi-center clinical trial of lumpectomy vs. radical mastectomy in treatment of breast cancer, NSABP
![Page 13: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/13.jpg)
![Page 14: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/14.jpg)
![Page 15: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/15.jpg)
![Page 16: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/16.jpg)
![Page 17: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/17.jpg)
Breast Cancer Prevention Trial Accrual by Calendar Quarter
0
500
1000
1500
2000
2500
3000
Jun-Sep92
Oct-Dec92
Jan-Mar93
Apr-Jun93
Jul-Sep93
Oct-Dec93
Jan-Mar94
Apr-Jun94
Jul-Sep94
Oct-Dec94
Jan-Mar95
Apr-Jun95
Jul-Sep95
Oct-Dec95
Jan-Mar96
Apr-Jun96
Jul-Sep96
Oct-Dec96
Jan-Mar93
Apr-Jun97
Jul-Sep93
Nu
mb
er o
f w
om
en r
and
om
ized
![Page 18: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/18.jpg)
Quarterly Rate of Non-complianceby Calendar Time and Randomization Cohort
0
0.02
0.04
0.06
0.08
0.1
0.12
0.14
Jun-Aug 92 Sep-Nov 92 Dec 92-Feb 93 Mar-May 93 Jun-Aug 93 Sep-Nov 93 Dec 93-Feb 94 Mar-May 94 Jun-Aug 94
Qu
art
erl
y ra
te o
n n
on
-co
mp
lia
nc
e
Jun-Aug 92 Sep-Nov 92 Dec 92-Feb 93 Mar-May 93
Jun-Aug 93 Sep-Nov 93 Dec 93-Feb 94 Mar-May 94
![Page 19: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/19.jpg)
St. Mary’s Hospital
Date: 1994
Place: St. Mary’s Hospital, Montreal
Research: Breast Cancer Prevention Trial, NSABP
![Page 20: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/20.jpg)
St. Mary’s Incident – DSMB Recommendations
A thorough audit of all BCPT subjects at St. Mary’s.
Include all St. Mary’s subjects without irregularities in all analyses.
Subjects with data falsification should continue on their assigned regimens unless there are safety issues.
Conduct final analyses with inclusion and with exclusion of subjects with data falsification.
Publication of trial findings should include full disclosure of instances of scientific misconduct.
![Page 21: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/21.jpg)
Mr. Paul H. Kornak
Date: 2001Place: Stratton VA Medical Center, Albany, NYResearch: The Iron (Fe) and Atherosclerosis Study (FeAST), VA Cooperative Studies Program
![Page 22: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/22.jpg)
Dr. Ram Singh
Date: 1992Place: Moradabad, Uttar Pradesh, northern IndiaResearch: “Randomised controlled trial of cardioprotective diet in patients with recent acute myocardial infarction: results of one year follow up”, BMJ, 304: 1015-19 (1992)
Dr. Stephen EvansDr. Stephen Evans
![Page 23: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/23.jpg)
Conclusions
Fraud in medical research has a long history and will undoubtedly continue into the future
![Page 24: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/24.jpg)
Conclusions
Fraud in medical researchFraud in medical research– Tarnishes the public image of medical researchTarnishes the public image of medical research– Tarnishes the reputation of many innocent researchers Tarnishes the reputation of many innocent researchers
and collaboratorsand collaborators– Can impact negatively on other related ongoing Can impact negatively on other related ongoing
researchresearch– Can virtually topple a large research organizationCan virtually topple a large research organization
![Page 25: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/25.jpg)
Conclusions
Statistical methodology can aid in confirming fraud, but is insufficient as the sole detector of fraud.
![Page 26: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/26.jpg)
Conclusions
In multi-center clinical trials, the most common occurrences of fraud more likely produce ‘noise’ (bias towards the null) than invalid study findings.
![Page 27: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/27.jpg)
Conclusions
There is no proven intervention to prevent fraud, but education currently appears to hold promise to reduce its incidence and to moderate its consequences.
![Page 28: Fraud in Medical Research](https://reader035.vdocuments.us/reader035/viewer/2022062307/556223c3d8b42ad44d8b4f0b/html5/thumbnails/28.jpg)
Take-home messages
Never discard original research data.
Missing data and outliers are very real phenomena in contemporary medical research.
Have faith in the wondrously stochastic and random nature of real human data, features most difficult to capture with fraud.