goal attainment scaling: a systematic review of its use in rare …€¦ · goal attainment scaling...
TRANSCRIPT
![Page 1: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/1.jpg)
Goal Attainment Scaling
A systematic review of GAS as an outcome measure in
drug trials
ISCB Conference Utrecht Charlotte Gaasterland
August 2015
![Page 2: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/2.jpg)
GAS…?
![Page 3: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/3.jpg)
Imagine 3 boys with Duchenne disease:
Six minute walk test
‘I want to be able to walk’ ‘I want to be able to eat independently’
‘I want to breathe independently’
Adam Brad Chris
![Page 4: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/4.jpg)
-2 Adam is unable to walk -1 Adam can take 3 steps 0 Adam is able to walk for 5 minutes 1 Adam can walk for 15 minutes 2 Adam can walk longer distances
Adam
-2 Chris is unable to breathe independently -1 Chris can breathe for 10 minutes 0 Chris can breathe for one hour 1 Chris can breathe for two hours 2 Chris can breathe for at least three hours
Chris
![Page 5: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/5.jpg)
Adam
‘I want to be able to walk’ ‘I want to be able to get dressed in the morning’
‘I want to be able to use my wheelchair without any help’ ‘I want to be able to play with friends’
T= 50 + 10 Σ𝑤𝑤𝑖𝑖𝑥𝑥𝑖𝑖1−𝜌𝜌 Σ𝑤𝑤𝑖𝑖
2+ 𝜌𝜌 Σ𝑤𝑤𝑖𝑖2
![Page 6: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/6.jpg)
T= 50 + 10 Σ𝑤𝑤𝑖𝑖𝑥𝑥𝑖𝑖1−𝜌𝜌 Σ𝑤𝑤𝑖𝑖
2+ 𝜌𝜌 Σ𝑤𝑤𝑖𝑖2
T = GAS score xi = Original score wi = Weight given to the original score 𝜌𝜌 = Intercorrelation among goal scores (estimated at 0.3)
![Page 7: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/7.jpg)
1. What are your goals, defined in 5 levels of attainment?
2. Which goals are most important to you?
3. Intervention 4. Have you attained your goals?
Adam Dr. X
![Page 8: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/8.jpg)
Adam
Chris
σ = 10
μ = 50
![Page 9: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/9.jpg)
Advances in Small Trials dEsign for Regulatory Innovation and eXcellence
Sounds like a good idea!
![Page 10: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/10.jpg)
Systematic Review Is GAS useful in drug trials?
Is GAS used in drug trials? Has GAS been validated in drug trials? Has GAS been validated in other studies?
![Page 11: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/11.jpg)
Methods Search in Medline, Embase, PsychInfo (with help of a librarian)
Search terms: Trial, RCT, variations of Goal Attainment Scaling
Selection by 2 reviewers independently Data extraction and critical appraisal by 2 reviewers independently
![Page 12: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/12.jpg)
Results Primary search: 5459 titles & abstracts
3818 titles & abstracts assessed for eligibility
307 full text articles assessed for eligibility
58 articles included
1641 duplicates removed
3511 articles excluded based on title & abstract
249 articles excluded based on full text
![Page 13: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/13.jpg)
What did all those papers tell us?
Validation is mainly done in geriatrics/rehabilitation
Usually in non-drug trials
![Page 14: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/14.jpg)
Drug trials Botulinum Toxin (Botox) used in patients with Cerebral Palsy
Donepezil hydrochloride in Alzheimer Disease patients
![Page 15: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/15.jpg)
Data extraction Face validity Content validity Construct validity Intra-rater reliability Inter-rater reliability Responsiveness
![Page 16: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/16.jpg)
Data extraction Face validity Content validity Construct validity Intra-rater reliability Inter-rater reliability Responsiveness
![Page 17: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/17.jpg)
Face validity Content validity Construct validity Inter-rater reliability Responsiveness
![Page 18: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/18.jpg)
Face validity In drug studies: 1
In GAS validity studies: 0
Therapists and intakers evaluated the relevance of the goal area for a patient on a 5-point scale.
‘Goal areas were suitably chosen’
![Page 19: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/19.jpg)
Content validity In drug studies: 0 In validity studies: 3
Different methods were used
‘Goals were grouped in major categories, and reviewed by clinicians’
![Page 20: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/20.jpg)
Construct validity In drug studies: 6 In validity studies: 11
Mainly correlations with other relevant measurement instruments
Correlations between change scores: is that construct validity?
![Page 21: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/21.jpg)
Inter-rater reliability In drug studies: 2 In validity studies: 10
Overall: Good inter-rater reliability (ICC > 0.9, κ >0.5)
Only in one study the ICC calculation was reported
![Page 22: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/22.jpg)
Responsiveness In drug studies: 3 In validity studies: 11
Responsiveness is usually good to very good: ES > 1
![Page 23: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/23.jpg)
To summarize… GAS is an inventive measurement instrument for heterogenous patient groups Validation of GAS in drug trials needs more research.. ..but how?
![Page 24: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/24.jpg)
Questions to consider… Should we validate GAS in drug trials? How should GAS be validated in drug trials? When is GAS ‘valid’?
![Page 25: Goal Attainment Scaling: A systematic review of its use in rare …€¦ · Goal Attainment Scaling A systematic review of GAS as an outcome measure in drug trials ISCB Conference](https://reader035.vdocuments.us/reader035/viewer/2022063015/5fd1a00a9519106caa123fc7/html5/thumbnails/25.jpg)
Thank you for your attention!