measurementissues&in&short term&clinical&trials&...overview&!...
TRANSCRIPT
![Page 1: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/1.jpg)
Brian Healy, PhD
Measurement Issues in Short Term Clinical Trials
![Page 2: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/2.jpg)
Overview
n In order to iden>fy treatment effects or predictors of disease course, measurement of disease course is required
n Although this sounds straighEorward, measurement of disease worsening is challenging in several neurological diseases – For clinical trials, we require measures that change in the short term
– For phase II trials, surrogate markers are desirable
![Page 3: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/3.jpg)
Common themes
n Mul>ple outcome measures – MS: relapses, EDSS – ALS: ALSFRS, death – Parkinson’s: Mul>ple scales
n Mul>ple mechanisms of ac>on for treatment – MS: Reduce relapse rate (an>-‐inflammatory) or reduce disease worsening (neuroprotec>ve)
– Parkinson’s: Symptoma>c or neuroprotec>ve n Surrogate markers
– MS: Neuroimaging, biomarkers
![Page 4: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/4.jpg)
Mul>ple sclerosis
n In the first talk, the challenges associated with measuring neurodegenera>on over the short term will be discussed – Measurement of disease worsening over the long-‐term in MS has defined endpoints, but short-‐term surrogate measures have performed poorly § Typical trials not long enough to measure outcome of interest
– Treatment effects on inflamma>on have been shown, but measures for neurodegenera>on are uncertain
![Page 5: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/5.jpg)
Parkinson’s disease
n In the second talk, the challenges associated with measuring neurodegenera>on in a clinical trial will be discussed – Symptoma>c vs. neuroprotec>ve effects
§ Modern trial design can dis>nguish between these two types of effects
– Rescue therapy § Subjects who experience specific events are given rescue therapy
§ Simple treatment vs. placebo comparisons may be inappropriate
![Page 6: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/6.jpg)
Ques>ons
n How can we improve measurement of all aspects of the disease?
n Can changes in trial design, outcome, or analysis allow us to measure the parts of the disease we are most interested in?
n Can we iden>fy surrogate markers that allow measurement of treatment effect in short dura>on studies?
![Page 7: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/7.jpg)
Measurement Issues in Short Term Clinical Trials of Mul>ple
Sclerosis
Brian Healy, PhD
![Page 8: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/8.jpg)
Disclosures
n I receive research support from Merck Serono and Novar>s
![Page 9: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/9.jpg)
Outline
n Background – Outcome measures for MS
n Measurement of neurodegenera>on – Long-‐term vs. short-‐term – Confirmed (sustained) disease progression – Sample size considera>ons – MRI outcomes
![Page 10: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/10.jpg)
Background
n MS is the most common neurologic disease among young people
n The typical disease course for over 80% of subjects is to start with a relapsing-‐remi^ng course (inflammatory phase)
n A_er inflammatory phase, pa>ents have more steady disease worsening (neurodegenera>ve phase)
![Page 11: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/11.jpg)
Outcome measures n Inflammatory
– Clinical: Relapse – MRI: Gadolinium enhancing lesions, new T2 lesions
§ Rela>onship between these is strong n Neurodegenera>on
– Clinical: Expanded disability status scale (EDSS) landmarks (EDSS=6), Confirmed worsening on EDSS
– MRI: Brain atrophy § Rela>onship between these is weaker
n Disability – EDSS
![Page 12: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/12.jpg)
Neurodegenera>on
n Despite the availability of and proven effec>veness of treatments, uncertainty remains about the impact of the treatments on neurodegenera>on – How do we measure neurodegenera>on in a short dura>on trial? § How do our present defini>ons perform?
– Does the analysis approach/outcome measure change the power to detect a treatment effect?
– Are alterna>ve outcome measures beeer?
![Page 13: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/13.jpg)
EDSS
n Expanded disability status scale (EDSS) is a 0-‐10 ordinal scale with 0.5 unit steps – At the low end of the scale, the EDSS combines informa>on from 7 func>onal system scales to calculate the EDSS score
– At the higher end of the scale, the EDSS is largely determined by the walking score for the pa>ent
– Changes in EDSS are small over the short term n EDSS score is most commonly used measure of disability by neurologists
![Page 14: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/14.jpg)
Measuring neurodegenera>on-‐long term
n Long-‐term natural history studies have iden>fied important disease landmarks
n EDSS=6 – Requires assistance to walk – When a pa>ent reaches this level, it is generally assumed that they have reached the progressive phase of the disease
n Even though this is a well defined landmark, the median >me to EDSS=6 in our sample is over 25 years – Not a prac>cal endpoint for clinical trials – Even in long term follow-‐up studies, this is not observed sufficiently o_en
![Page 15: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/15.jpg)
Measuring neurodegenera>on-‐short term
n Although the EDSS provides a measure of disability, change in EDSS does not directly provide a measure of neurodegenera>on – EDSS is elevated during a relapse because disability has increased even though pa>ent may recover
– To address this limita>on, the most common measure in clinical trials is to require the increase on the EDSS to be confirmed for a specific amount of >me
– Idea is that if the EDSS is elevated for more than one >me point, the increase on the EDSS is a true measure of disease worsening
![Page 16: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/16.jpg)
Confirmed (sustained) disease progression
n Most common defini>on – Increase on the EDSS of at least 1 point confirmed for 3 or 6 months for subjects with baseline EDSS<5.5
– Increase of at least 0.5 point confirmed for 3 or 6 months for subjects with baseline EDSS>=5.5
n Some>mes, an addi>onal caveat is added that the increase on the EDSS must be at least 1.5 points for subjects with baseline EDSS=0
n No single defini>on is used in all trials/studies
![Page 17: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/17.jpg)
Is sustained progression truly sustained?
n Even though a reasonable number of subjects experience sustained progression, more than half fail to maintain the sustained progression (Healy et al, 2013)
n Interpreta>on: Not truly irreversible disability
![Page 18: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/18.jpg)
Func>onal scales n As described previously, the EDSS in the low end of the scale is determined based on the func>onal system scales
n One poten>al explana>on for the poor performance of sustained progression on the EDSS is that by combining across the func>onal scales, we are losing informa>on
n To assess whether we could just switch to the func>onal scales, we performed a similar set of analyses
n Using FS scales failed to iden>fy irreversible disease progression – Much less than 50% of subjects maintained progression
![Page 19: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/19.jpg)
Recommenda>ons
n Lublin et al (2014) proposed changing the defini>ons of MS disease categories and states to clarify some of the terms – Change from sustained disease progression to confirmed disease worsening will lead to beeer understanding of changes in pa>ents
n Although these changes in terms reduce confusion regarding what is measured, these do not necessarily improve measurement of neurodegenera>on – Alterna>ve analysis approaches using available outcomes – Alterna>ve outcome measures
![Page 20: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/20.jpg)
Alterna>ve analysis approaches
n Although confirmed disease worsening solved one problem (transient increases on the EDSS), it introduces a couple of new problems – Confirmed disease worsening is a dichotomous variable so the amount of change is ignored
– Fails to incorporate any improvement on the EDSS – Unequal likelihood of changing disease state is not incorporated into the model
![Page 21: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/21.jpg)
Comparison of approaches n Given the poten>al problems associated with confirmed
progression, six analysis approaches were compared in terms of power for a 2 year clinical trial (Healy et al 2011) – Logis>c regression for confirmed progression – Cox model for >me to confirmed progression – Stra>fied Wilcoxon test (van Elteren’s test) – Repeated measures propor>onal odds model (GEE) – Markov transi>on model
n Results showed that analyses based on confirmed progression had least power – Alterna>ve analysis approaches could improve power even if no change to the measurement was made
![Page 22: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/22.jpg)
Alterna>ve measures n Could we develop an alterna>ve measure of disability to beeer measure changes in disability/ neurodegenera>on?
n Challenge: Must develop a measure that is highly correlated with the EDSS
n Clinical – MSFC – Other scales in development
n MRI – Whole brain atrophy – Gray maeer atrophy – Spinal cord atrophy
![Page 23: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/23.jpg)
Mul>ple sclerosis func>onal composite (MSFC)
n MSFC was developed as an alterna>ve measure of disability that combined three components – Timed 25 foot walk (Walking func>on) – 9 hole peg test (Hand func>on) – Paced Auditory Serial Addi>on Test (cogni>ve func>on)
– Scores from each component are normalized and summed using equal weights
PASATHPTFWT zzzMSFC ++= 925
![Page 24: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/24.jpg)
MSFC
n Pro – Easy to deal with sta>s>cally – More powerful than sustained progression
n Con – Uncertain clinical meaning
§ Cau>onary tale regarding making new outcome measure
– Lengthy to administer (limited the use of the scale in the clinic)
![Page 25: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/25.jpg)
Atrophy measures n Phase II studies in MS use MRI measures of inflamma>on to reduce sample size required to detect treatment effect
n Several studies have inves>gated the sample size considera>ons for clinical trials using atrophy as a measure – Healy et al (2009) inves>gated whether gray maeer atrophy might provide power advantages over whole brain atrophy
– Although trials have been designed with atrophy as a secondary outcome measure, atrophy is not the gold standard for neurodegenera>on in early trials
![Page 26: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/26.jpg)
Conclusions
n Measurement of neurodegenera>on is one of the major challenges in MS clinical trials
n Tradi>onal short-‐term measure performs poorly n Alterna>ve analysis approaches and measures are available, but these have not become the standard in clinical trials
n Beeer approaches may lead to more success in iden>fica>on of treatments for neurodegenera>on
![Page 27: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/27.jpg)
THANK YOU to our
CLIMB patients!
CLIMB Medical Director Tanuja Chitnis, MD Director, Partners MS Center Howard Weiner, MD
Director, Clinical Research Operations
Bonnie Glanz, PhD Head of Biostatistics Brian Healy, PhD
CLIMB Study Staff
Sandra Cook, RN Mira Weiner
Study Coordinators Grace Little Emily Greeke
Immunology/Biomarkers Head of MS Biomarker Group Head of Biorepository & Assay Development Biomarker Development Translational Genomics & Integrative Analyses
Roopali Gandhi, PhD Pia Kivisäkk, MD PhD Francisco Quintana, PhD Philip De Jager, MD PhD
IT/Database Database Manager Software Architect System Administrator Data Analyst
Mariann Polgar-Turcsanyi, MS Adam Polgar Mark Anderson Alicia Chua, MS
Neuroimaging Research
Rohit Bakshi, MD Charles Guttmann, MD
MRI Analyst Svetlana Egorova, MD PhD
![Page 28: MeasurementIssues&in&Short Term&Clinical&Trials&...Overview&! In&order&to&iden>fy&treatmenteffects&or& predictors&of&disease&course,&measurementof& disease&course&is&required&! Although&this&sounds&straighEorward,&](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d2acd10dbe63f072d95e3/html5/thumbnails/28.jpg)
References n Healy BC, Valsasina P, Filippi M, Bakshi R. Sample size requirements
for treatment effects using gray maeer, white maeer and whole brain volume in relapsing-‐remi^ng mul>ple sclerosis. Journal of Neurology, Neurosurgery and Psychiatry. 2009 Nov;80(11):1218-‐23.
n Healy B, Chitnis T, Engler D. Improving power to detect disease progression in mul>ple sclerosis through alterna>ve analysis strategies. J Neurol. 2011 Oct;258(10):1812-‐9.
n Healy BC, Engler D, Glanz B, Musallam A, Chitnis T. Assessment of defini>ons of sustained disease progression in relapsing-‐remi^ng mul>ple sclerosis. Mult Scler Int. 2013;2013:189624. doi: 10.1155/2013/189624.
n Lublin FD, Reingold SC, Cohen JA et al. Defining the clinical course of mul>ple sclerosis: The 2013 revisions. Neurology. 2014; 83: 278-‐86.