smart experimental designs for developing adaptive treatment strategies
DESCRIPTION
SMART Experimental Designs for Developing Adaptive Treatment Strategies. S.A. Murphy RWJ Clinical Scholars Program, UMich April, 2007. Outline. Why Adaptive Treatment Strategies? Why SMART experimental designs? Design Principles and Analysis Discussion. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/1.jpg)
SMART Experimental Designs for Developing Adaptive
Treatment StrategiesS.A. Murphy
RWJ Clinical Scholars Program, UMich
April, 2007
![Page 2: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/2.jpg)
Outline
• Why Adaptive Treatment Strategies?
• Why SMART experimental designs?
• Design Principles and Analysis
• Discussion
![Page 3: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/3.jpg)
Adaptive Treatment Strategies are individually tailored treatments, with treatment type and dosage changing according to patient outcomes. Operationalize clinical practice.
•Brooner et al. (2002, 2006) Treatment of Opioid Addiction
•Breslin et al. (1999) Treatment of Alcohol Addiction
•Prokaska et al. (2001) Treatment of Tobacco Addiction
•Rush et al. (2003) Treatment of Depression
![Page 4: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/4.jpg)
Why Adaptive Treatment Strategies?
– High heterogeneity in response to any one treatment
• What works for one person may not work for another
• What works now for a person may not work later– Improvement often marred by relapse– Intervals during which more intense treatment
is required alternate with intervals in which less treatment is sufficient
– Co-occurring disorders may be common
![Page 5: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/5.jpg)
Why not combine all possible efficacious therapies and provide all of these to patient now and in the future?
•Treatment incurs side effects and substantial burden, particularly over longer time periods. •Problems with adherence:
•Variations of treatment or different delivery mechanisms may increase adherence•Excessive treatment may lead to non-adherence
•Treatment is costly (Would like to devote additional resources to patients with more severe problems)
More is not always better!
![Page 6: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/6.jpg)
Example of an Adaptive Treatment Strategy
Drug Court Program for drug abusing offenders. Goal is to minimize recidivism and drug use.
High risk offenders are provided biweekly court hearings; low risk offenders are provided “as-needed court hearings.” In either case the offender is provided standard drug counseling. If the offender becomes non-responsive then intensive case management along with assessment and referral for adjunctive services is provided. If the offender becomes noncompliant during the program, the offender is subject to a court determined disposition.
![Page 7: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/7.jpg)
Hypothetical Adaptive Drug Court Program
non-responsiveAs-needed court hearings As-needed court hearings
low risk + standard counseling + ICM
high risk
Bi-weekly court hearings Bi-weekly court hearings + standard counseling + ICM
non-responsive
![Page 8: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/8.jpg)
The Big Questions
•What is the best sequencing of treatments?
•What is the best timings of alterations in treatments?
•What information do we use to make these decisions? (how do we customize the sequence of treatments?)
![Page 9: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/9.jpg)
Why SMART Trials?
What is a sequential multiple assignment randomized trial (SMART)?
These are multi-stage trials; each stage corresponds to a critical decision and conceptually a randomization takes place at each critical decision.
Goal is to inform the construction of an adaptive treatment strategies.
![Page 10: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/10.jpg)
Sequential Multiple Assignment Randomization
Initial Txt Intermediate Outcome Secondary Txt
Relapse
Responder R Prevention
Low-levelMonitoring
Switch toTx C
Tx A
Nonresponder RAugment withTx D
R
Responder Relapse
R Prevention
Low-levelMonitoring
Tx B
Switch toTx C
Nonresponder R
Augment withTx D
![Page 11: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/11.jpg)
Alternate Approach
• Why not use data from multiple trials to construct the adaptive treatment strategy?
• Choose the best initial treatment on the basis of a randomized trial of initial treatments and choose the best secondary treatment on the basis of a randomized trial of secondary treatments.
![Page 12: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/12.jpg)
Delayed Therapeutic Effects
Why not use data from multiple trials to construct the adaptive treatment strategy?
Positive synergies: Treatment A may not appear best initially but may have enhanced long term effectiveness when followed by a particular maintenance treatment. Treatment A may lay the foundation for an enhanced effect of particular subsequent treatments.
![Page 13: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/13.jpg)
Delayed Therapeutic Effects
Why not use data from multiple trials to construct the adaptive treatment strategy?
Negative synergies: Treatment A may produce a higher proportion of responders but also result in side effects that reduce the variety of subsequent treatments for those that do not respond. Or the burden imposed by treatment A may be sufficiently high so that nonresponders are less likely to adhere to subsequent treatments.
![Page 14: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/14.jpg)
Diagnostic Effects
Why not use data from multiple trials to construct the adaptive treatment strategy?
Treatment A may not produce as high a proportion of responders as treatment B but treatment A may elicit symptoms that allow you to better match the subsequent treatment to the patient and thus achieve improved response to the sequence of treatments as compared to initial treatment B.
![Page 15: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/15.jpg)
Cohort Effects
Why not use data from multiple trials to construct the adaptive treatment strategy?
Subjects who will enroll in, who remain in or who are adherent in the trial of the initial treatments may be quite different from the subjects in SMART.
![Page 16: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/16.jpg)
Summary:
•When evaluating and comparing initial treatments, in a sequence of treatments, we need to take into account the effects of the secondary treatments thus SMART
•Standard randomized trials may yield information about different populations from SMART trials.
![Page 17: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/17.jpg)
Sequential Multiple Assignment Randomization
Initial Txt Intermediate Outcome Secondary Txt
Relapse
Responder R Prevention
Low-levelMonitoring
Switch toTx C
Tx A
Nonresponder RAugment withTx D
R
Responder Relapse
R Prevention
Low-levelMonitoring
Tx B
Switch toTx C
Nonresponder R
Augment withTx D
![Page 18: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/18.jpg)
Examples of “SMART” designs:•CATIE (2001) Treatment of Psychosis in Alzheimer’s Patients
•CATIE (2001) Treatment of Psychosis in Schizophrenia
•STAR*D (2003) Treatment of Depression
•Pelham (on-going) Treatment of ADHD
•Oslin (on-going) Treatment of Alcohol Dependence
![Page 19: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/19.jpg)
SMART Designing Principles
![Page 20: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/20.jpg)
SMART Designing Principles •KEEP IT SIMPLE: At each stage, restrict class of treatments only by ethical, feasibility or strong scientific considerations. Use a low dimension summary (responder status) instead of all intermediate outcomes (time until nonresponse, adherence, burden, stress level, etc.) to restrict class of next treatments.
•Collect intermediate outcomes that might be useful in ascertaining for whom each treatment works best; information that might enter into the adaptive treatment strategy.
![Page 21: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/21.jpg)
SMART Designing Principles
•Choose primary hypotheses that are both scientifically important and aid in developing the dynamic treatment regime.
•Power trial to address these hypotheses.
•Choose secondary hypotheses that further develop the dynamic treatment regime and use the randomization to eliminate confounding.
•Trial is not necessarily powered to address these hypotheses.
![Page 22: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/22.jpg)
SMART Designing Principles:Primary Hypothesis
•EXAMPLE 1: (sample size is highly constrained): Hypothesize that given the secondary treatments provided, the initial treatment A results in lower symptoms than the initial treatment B.
•EXAMPLE 2: (sample size is less constrained): Hypothesize that among non-responders a switch to treatment C results in lower symptoms than an augment with treatment D.
![Page 23: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/23.jpg)
EXAMPLE 1
Initial Txt Intermediate Outcome Secondary Txt
Relapse
Responder Prevention
Low-levelMonitoring
Switch toTx C
Tx A
Nonresponder Augment withTx D
Responder Relapse
Prevention
Low-levelMonitoring
Tx B
Switch toTx C
Nonresponder
Augment withTx D
![Page 24: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/24.jpg)
EXAMPLE 2
Initial Txt Intermediate Outcome Secondary Txt
Relapse
Responder Prevention
Low-levelMonitoring
Switch toTx C
Tx A
Nonresponder Augment withTx D
Responder Relapse
Prevention
Low-levelMonitoring
Tx B
Switch toTx C
Nonresponder
Augment withTx D
![Page 25: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/25.jpg)
An analysis that is less useful in the development of adaptive treatment
strategies:
Decide whether treatment A is better than treatment B by comparing intermediate outcomes (proportion of early responders).
![Page 26: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/26.jpg)
SMART Designing Principles:Sample Size Formula
•EXAMPLE 1: (sample size is highly constrained): Hypothesize that given the secondary treatments provided, the initial treatment A results in lower symptoms than the initial treatment B. Sample size formula is same as for a two group comparison.
•EXAMPLE 2: (sample size is less constrained): Hypothesize that among non-responders a switch to treatment C results in lower symptoms than an augment with treatment D. Sample size formula is same as a two group comparison of non-responders.
![Page 27: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/27.jpg)
Sample SizesN=trial size
Example 1 Example 2
Δμ/σ =.3
Δμ/σ =.5
α = .05, power =1 – β=.85
N = 402 N = 402/initial nonresponse rate
N = 146N = 146/initial nonresponse rate
![Page 28: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/28.jpg)
SMART Designing Principles
•Choose secondary hypotheses that further develop the adaptive treatment strategy and use the randomization to eliminate confounding.
•EXAMPLE: Hypothesize that non-adhering non-responders will exhibit lower symptoms if their treatment is augmented with D as compared to an switch to treatment C (e.g. augment D includes motivational interviewing).
![Page 29: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/29.jpg)
EXAMPLE 2
Initial Txt Intermediate Outcome Secondary Txt
Relapse
Responder Prevention
Low-levelMonitoring
Switch toTx C
Tx A
Nonresponder Augment withTx D
Responder Relapse
Prevention
Low-levelMonitoring
Tx B
Switch toTx C
Nonresponder
Augment withTx D
![Page 30: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/30.jpg)
Oslin ExTENd
Late Trigger forNonresponse
8 wks Response
TDM + Naltrexone
CBIRandom
assignment:
CBI +Naltrexone
Nonresponse
Early Trigger for Nonresponse
Randomassignment:
Randomassignment:
Randomassignment:
Naltrexone
8 wks Response
Randomassignment:
CBI +Naltrexone
CBI
TDM + Naltrexone
Naltrexone
Nonresponse
![Page 31: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/31.jpg)
Pelham ADHD Study
B. Begin low dosemedication
8 weeks
Assess-Adequate response?
B1. Continue, reassess monthly; randomize if deteriorate
B2. Increase dose of medication with monthly changes
as neededRandom
assignment:B3. Add behavioral
treatment; medication dose remains stable but intensity
of bemod may increase with adaptive modifications
based on impairment
No
A. Begin low-intensity behavior modification
8 weeks
Assess-Adequate response?
A1. Continue, reassess monthly;randomize if deteriorate
A2. Add medication;bemod remains stable butmedication dose may vary
Randomassignment:
A3. Increase intensity of bemod with adaptive modifi-
cations based on impairment
Yes
No
Randomassignment:
![Page 32: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/32.jpg)
Jones’ Study for Drug-Addicted Pregnant Women
rRBT
2 wks Response
rRBT
tRBTRandom
assignment:
rRBT
Nonresponse
tRBT
Randomassignment:
Randomassignment:
Randomassignment:
aRBT
2 wks Response
Randomassignment:
eRBT
tRBT
tRBT
rRBT
Nonresponse
![Page 33: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/33.jpg)
Discussion• Secondary analyses can use pretreatment variables and
outcomes to provide evidence for a more sophisticated adaptive treatment strategy. (when and for whom?)
• We have a sample size formula that specifies the sample size necessary to detect an adaptive treatment strategy that results in a mean outcome δ standard deviations better than the other strategies with 90% probability (J. Levy is collaborator)
• Aside: Non-adherence is an outcome (like side effects) that indicates need to tailor treatment.
![Page 34: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/34.jpg)
Discussion• Industry should be interested in the SMART
design because:– For some individuals the treatment may require an
adjunctive therapy—when should this therapy be provided and to whom should this therapy be provided?
– Some treatments may be most useful when considered as part of a sequence of treatments (e.g. a treatment may not be effective for all patients but has low side effects/is inexpensive and when it is not effective, patient responses provide an indication of which treatment should be used next.)
![Page 35: SMART Experimental Designs for Developing Adaptive Treatment Strategies](https://reader035.vdocuments.us/reader035/viewer/2022062422/56812ee7550346895d94827e/html5/thumbnails/35.jpg)
This seminar can be found at:
http://www.stat.lsa.umich.edu/~samurphy/
seminars/RWJ0407.ppt
This seminar is based partially on papers with K. Lynch, J. McKay, D. Oslin and T. Ten Have, A. J. Rush, J. Pineau and L. Collins. Email me with questions or if you would like a copy: