sensitivity analysis in wildlife linkage...

38
1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier, Dan Majka, Northern Arizona University Clint Cabañero, South Coast Wildlands

Upload: others

Post on 12-Apr-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

1

Sensitivity analysisin wildlife linkage design

Shawn Newell, Paul Beier, Dan Majka, Northern Arizona University

Clint Cabañero, South Coast Wildlands

Page 2: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

2

Sensitivity analysisin wildlife linkage design

• Overview of sensitivity analysis as it relates to linkage design

• Illustration of sensitivity analysis for a particular linkage.

Page 3: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

3

As conservation scientists & practitioners, we should worry about 2 things:

(1) Our advice will be ignored.

Why Sensitivity Analysis?

(2) Our advice will be followed.

Page 4: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

4

1. Most important: As scientists, we worry about being wrong.

Why Sensitivity Analysis?

2. Provides transparency for stakeholders, skeptics, and critics.

Page 5: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

5

How badly did I do?I designed this corridor, and it

was implemented…

But the green corridor is the

real optimum…

Sensitivity Analysis: seeing how sensitivethe model output (linkage design) is to uncertainty in the inputs.

Page 6: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

6

…uncertainty in what “inputs”? • Delineation of analysis area• Choice of focal species• Choice of factors to include in

the model• Choice of metric for each

factor• Uncertainty in estimates of

resistance for each class of pixels

• Uncertainty in weighting for each factor

• Choice of weighting algorithm

• How corridor terminus is delineated

• How habitat patches are delineated

• Whether and how corridor dwellers were modeled

• Procedure to identify continuous swaths of low-resistance pixels

• How corridors of multiple focal species are combined

Page 7: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

7

How robust is my model to number of focal species, and uncertainty in resistance estimates & factor weights?

There is NO GENERAL answer to this question.

You can answer it only for a particular linkage area and set of focal species.

Page 8: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

8

Educated guesses!

(resistances)

Educated guesses COMPOUNDED!

weights

Page 9: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

9

1. For most species, predicted least-cost corridors were robust to uncertainty in input parameters.

Conclusions about the Tehachapi Linkage Design

Page 10: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

10

2. Some species models were not robust, capturing as little as 0% of some biologically plausible alternatives, accompanied by potentially large increases in resistance.

Conclusions about the Tehachapi Linkage Design

Page 11: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

11

3. The linkage design for 8 focal species will likely serve all 8 species, even though some individual species models were not robust to uncertainty.

Conclusions about the Tehachapi Linkage Design

Page 12: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

12

4. The carnivores, singly or together, were not good umbrellas for the other species.

Conclusions about the Tehachapi Linkage Design

Page 13: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

13

You should conduct sensitivity analysis and provide investors with maps and graphs illustrating the impact of uncertainty.

Conclusion about your Linkage Design

Page 14: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

14

Case study: an 80-km linkage

Longest, least constrainedWorst-case scenario

Page 15: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

15

8 focal species

• Puma• American badger• San Joaquin kit fox• Mule deer• Western gray squirrel• Tipton kangaroo rat• Tehachapi pocket mouse • California spotted owl

Page 16: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

16

Factor: topography

We compressed & spread out class resistance estimates: Ridgetop

SlopesFlatsCanyon bottom

Classes:

Page 17: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

17

Factor: topography

RidgetopSlopesFlatsCanyon bottom

0 1 2 3 4 5 6 7 8 9 10

Best estimates

0 1 2 3 4 5 6 7 8 9 10

Compressed

We compressed & spread out class resistance estimates:

1. No reversals of rank order

2. Within min/max range

Classes:

1. No reversals of rank order

2. Within min/max range

0 1 2 3 4 5 6 7 8 9 10

Best estimates

0 1 2 3 4 5 6 7 8 9 10

Spread out

Page 18: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

18

0 1 2 3 4 5 6 7 8 9 10

Compress

We tested 17 alternatives for each species.

0 1 2 3 4 5 6 7 8 9 10

Spread out

resistance of topographic classes resistance of road density classes

Page 19: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

19

Proposed LCC Alternative

x (of 17)

How to compare the proposed corridor to each alternative?

Page 20: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

20

If we implement the proposed corridor,

but the alternative is right,

how badly did we do?

Our main response variable: % of alternative overlapped by the proposed corridor.

The proposed corridor

captured 66% of this

plausible alternative.

Page 21: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

21

Second response variable: increase in resistance in the proposed corridor compared to the alternative (using parameter values associated with the alternative)

But a proposed corridor that fails to overlap a plausible alternative might still be as permeable as the alternative!

Page 22: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

22

Species

Mean % of 17 alternative scenarios captured within

proposed corridorPuma 31%American badger 54%San Joaquin kit fox 89%Mule deer 67%Western gray squirrel 79%Tipton kangaroo rat 94%California spotted owl 69%Tehachapi pocket mouse 77%

RESULTS: Most predicted corridors were robust to uncertainty on average

Page 23: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

23

Species

Mean % of alternative captured in proposed corridor

Range

Puma 31% 0-97% (0% of 5 alts)

American badger 54% 0-100% (0% of 4 alts)

San Joaquin kit fox 89% 71-100%

Mule deer 67% 93-98%

Western gray squirrel 79% 63-94%

Tipton kangaroo rat 94% 84-100%

California spotted owl 69% 87-100%

Tehachapi pocket mouse 77% 0-100% (0% of 2 alts)

But some individual species models captured 0% of some alternatives.

Page 24: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

24

But some individual species models captured 0% of some alternatives.

Models for habitat generalists were least robust

Page 25: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

25

But some individual species models captured 0% of some alternatives.

Models for habitat generalists were least robust

25

45

65

85

20 30 40 50 60 70Habitat Generalist Index (% of classes

with resistance < 5)

Rob

ustn

ess

(% o

f alte

rnat

ive

over

lapp

ed b

y co

rrid

or)

Page 26: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

26

But some individual species models captured 0% of some alternatives.

Page 27: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

27

When predicted corridors did not overlap alternatives, resistance in the predicted corridor was typically < 15% worse.

Page 28: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

28

Some single-species models were poor…

But we are implementing multiple-species plans…

How stable is the linkage design (union of proposed corridors) to uncertainty in the individual models?

Page 29: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

29

Union of 8 proposed corridors

Page 30: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

30

The 8 most divergent alternatives

Page 31: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

31

Using multiple species mitigates errors in single-species models

The linkage design (with 3 exceptions) captured

>65% of each alternative (mean: 89%)

Page 32: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

32

The multiple species design is robust to uncertainty in single-species models

Page 33: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

33

How robust is my model?

There is NO GENERAL answer to this question. But you can answer it for a particular linkage area and set of focal species.

Page 34: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

34

1. For most species, predicted least-cost corridors were robust to uncertainty in input parameters.

Conclusions about the Tehachapi Linkage Design

Page 35: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

35

2. Some species models were not robust, capturing as little as 0% of some biologically plausible alternatives, accompanied by 15% increases in resistance.

Conclusions about the Tehachapi Linkage Design

Page 36: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

36

3. The linkage design for 8 focal species will likely serve all 8 species, even though some individual species models were not robust to uncertainty.

Conclusions about the Tehachapi Linkage Design

Page 37: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

37

4. The carnivores, singly or together, were not good umbrellas for the other species (on average they overlapped 32% of the area in each alternative).

Conclusions about the Tehachapi Linkage Design

Page 38: Sensitivity analysis in wildlife linkage designcorridordesign.org/dl/workshops/08.SensitivityAnalysis.pdf1 Sensitivity analysis in wildlife linkage design Shawn Newell, Paul Beier,

38

You should conduct sensitivity analysis and provide investors with maps and graphs illustrating the impact of uncertainty.

Conclusion about your Linkage Design