comparison of 5 stopping rules and 2 ld50 estimators: appx l
TRANSCRIPT
![Page 1: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/1.jpg)
Comparison of 5 Stopping Rules and 2 LD50 Estimators Using Monte Carlo Simulation
David Farrar, March 2000
Attached are graphs presented at an ICCVAM meeting in January 2000.
Note the following:
1. For these graphs, the maximum number that could be tested was set at 25. Currently we propose to set the maximum at 15.
2. The test doses were not constrained to a range such as 1 to 5000 units, as in later simulations and as in our current guideline proposal.
3. The graphs include consideration of 2 stopping rules that were subsequently abandoned. The number of stopping rules has been retained, so that Rules number 1, 2, and 5 in later work correspond to the procedures here with the same numbers.
4. While here we do illustrate the use of an LR stopping rule, it is not precisely the rule proposed in the current guideline. The procedure in the current guideline is more simple, uses fewer animals, and results in better precision.
D. Farrar - January 2000 H-1
![Page 2: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/2.jpg)
LD50 Estimators Evaluated:
• Maximum likelihood estimator, slope = 2 • • Geometric average dose (animals at/following reversal).
Stopping Rules Evaluated:
1. Fixed nominal sample size of 6
2. Stop after 5 reversals.
3a. Convergence of estimators:
0.5 < [estimate 1] / [estimate 2] < 2
estimate 1 = geometric average dose; estimate 2 = MLE with slope=0.5
3b. Like 3a but "factor" of #5 instead of #2.
4. For H:LD50=GM versus H:LD50=GM/2 (or H:LD50=GM*2),
profile likelihood ratio = 2
• Nominal sample size = 6; Number tested capped at 15 or 25
Performance Measurement based on Monte Carlo
• Bias index
median estimate / true value
?Acceptable . 0.8 - 1.2 X (or .20% bias)
• Spread Index
Ratio of high and low percentiles P95 / P5
?Acceptable . 3-4 X
• Numbers tested (mean, 95th percentile)
2
![Page 3: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/3.jpg)
Design of Monte Carlo Study
• True LD50 = 1500 units
• Inital dose 15, 100, 150, 1000, 1500
• Probit slope 0.5 - 8
• Max. number tested 15, 25
Graph Sets
• Comparision of 2 estimators based on stopping criterion 4 with max tested = 25
• Comparision of stopping criteria 1 and 4 based on geometric mean, max tested = 25
• Comparision of max. tested 15 versus 25 based on stopping criterion 4 and geometric mean.
D. Farrar - January 2000 H-3
![Page 4: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/4.jpg)
Initial Dose = LD50 / 100 sp
read
0
10
20
30
40
50
Geometric Average
MLE, slope = 2
0 2 4 6 8 10
slope
![Page 5: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/5.jpg)
Initial Dose = LD50 / 100 bi
as in
dex
0.2
0.4
0.6
0.8
1.0
1.2
MLE, slope = 2
Geometric Average
0 2 4 6 8 10
slope
![Page 6: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/6.jpg)
Initial Dose = LD50 / 10 sp
read
inde
x
0
5
10 15
20 25
30
35 40
MLE, slope = 2
Geometric Average
0 2 4 6 8 10
slope
![Page 7: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/7.jpg)
Initial Dose = LD50 / 10 bi
as in
dex
0.3
0.4
0.5 0.6
0.7 0.8
0.9
1.0 1.1
MLE, slope = 2
Geometric Average
0 2 4 6 8 10
slope
![Page 8: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/8.jpg)
Initial Dose = LD50 sp
read
inde
x
2 4 6 8
10 12 14 16 18 20 22 24
MLE, slope = 2
Geometric Average
0 2 4 6 8 10
slope
![Page 9: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/9.jpg)
Initial Dose = LD50 bi
as in
dex
0.6
0.7
0.8
0.9
1.0
1.1
1.2
1.3
MLE, slope = 2
Geometric Average
0 2 4 6 8 10
slope
![Page 10: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/10.jpg)
Initial Dose = LD50 / 100 sp
rea
d in
de
x
2.0
4.0
6.0
8.0
10.0
12.0
14.0
16.0
LR stopping
Fixed n stopping
1.0 2.0 3.0 4.0 5.0 6.0 7.0
probit slope
![Page 11: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/11.jpg)
Bia
s in
dex
0.50
0.55
0.60
0.65
0.70
0.75
0.80
0.85
0.90
LR stopping
Fixed n stopping
Initial Dose = LD50 / 100
1.0 2.0 3.0 4.0 5.0 6.0 7.0
probit slope
![Page 12: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/12.jpg)
Initial Dose = LD50 / 100m
ean
num
ber
test
ed
8
9
10
11
12
13
14
15
16
LR stopping
Fixed n stopping
1.0 2.0 3.0 4.0 5.0 6.0 7.0
probit slope
![Page 13: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/13.jpg)
Initial Dose = LD50 / 10 sp
read
inde
x
2
4
6
8
10
12
LR stopping
Fixed n stopping
1.0 2.0 3.0 4.0 5.0 6.0 7.0
probit slope
![Page 14: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/14.jpg)
Initial Dose = LD50 / 10 bi
as in
dex
0.5
0.6
0.7
0.8
0.9
1.0
LR stopping
Fixed n stopping
1.0 2.0 3.0 4.0 5.0 6.0 7.0
probit slope
![Page 15: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/15.jpg)
Initial Dose = LD50 / 10 m
ean
num
ber
test
ed
6
8
10
12
14
16
LR stopping
Fixed n stopping
1.0 2.0 3.0 4.0 5.0 6.0 7.0
probit slope
![Page 16: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/16.jpg)
Initial Dose = LD50sp
read
inde
x
2
3
4
5
6
7
8
9
LR stopping
Fixed n stopping
0.0 1.0 2.0 3.0 4.0 5.0 6.0 7.0
probit slope
![Page 17: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/17.jpg)
Initial Dose = LD50 bi
as in
dex
0.8
0.9
1.0
1.1
1.2
1.3
LR stopping
Fixed n stopping
0.0 1.0 2.0 3.0 4.0 5.0 6.0 7.0
probit slope
![Page 18: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/18.jpg)
Initial Dose = LD50 m
ean
num
ber
test
ed
5
6
7
8
9
10
11
12
LR stopping
Fixed n stopping
1.0 2.0 3.0 4.0 5.0 6.0 7.0
probit slope
![Page 19: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/19.jpg)
spre
ad in
dex
0
10
20
30
40
50
max. tested = 15
max. tested = 25
Initial Dose = LD50 / 100
0 2 4 6 8 10
slope
![Page 20: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/20.jpg)
Initial Dose = LD50 / 100 bi
as in
dex
0.0
0.2
0.4
0.6
0.8
1.0
1.2 max. tested = 15
max. tested = 25
0 2 4 6 8 10
slope
![Page 21: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/21.jpg)
num
ber
test
ed
8
10
12
14
16
18
20
max. tested = 15
max. tested = 25
Initial Dose = LD50 / 100
0 2 4 6 8 10
slope
![Page 22: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/22.jpg)
Initial Dose = LD50 / 10 sp
read
inde
x
0
5
10
15
20
25
30
35
max. tested = 15 max. tested = 25
0 2 4 6 8 10
slope
![Page 23: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/23.jpg)
bias
inde
x
0.3
0.4
0.5 0.6
0.7
0.8 0.9
1.0 1.1
max. tested = 15
max. tested = 25
Initial Dose = LD50 / 10
0 2 4 6 8 10
slope
![Page 24: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/24.jpg)
Initial Dose = LD50 / 10 m
ean
num
ber
test
ed
6
8
10
12
14
16
18
max. tested = 15
max. tested = 25
0 2 4 6 8 10
slope
![Page 25: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/25.jpg)
Initial Dose = LD50 sp
read
inde
x
2
4
6
8
10
12
14
16
max. tested = 15 max. tested = 25
0 2 4 6 8 10
slope
![Page 26: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/26.jpg)
Initial Dose = LD50 bi
as in
dex
0.6
0.7
0.8
0.9
1.0
1.1
1.2
1.3
0 2 4 6 8 10
slope
![Page 27: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/27.jpg)
mea
n nu
mbe
r te
sted
4
6
8
10
12
14
16
18
max. tested = 25
max. tested = 15
Initial Dose = LD50
0 2 4 6 8 10
slope
![Page 28: Comparison of 5 Stopping Rules and 2 LD50 Estimators: Appx L](https://reader031.vdocuments.us/reader031/viewer/2022021923/586b6edb1a28abe7148c2279/html5/thumbnails/28.jpg)