Processing math: 100%
+ - 0:00:00
Notes for current slide
Notes for next slide

Uncertainty in management
strategy evaluation (MSE):

Case study of the
New England Fishery Management Council Herring MSE

Sarah Gaichas
Ecosystem Dynamics and Assessment
Northeast Fisheries Science Center

1 / 18

Deep Uncertainty and Robust Decision Making (RDM)

  • Decision making under deep uncertainty (DMDU) needed when disagreement on:

    • model of system relating action to consequences
    • probability distributions for model parameters
    • valuation of different outcomes
  • Essential features of DMDU

    • iterate analysis and deliberation
    • many computer simulations of assumptions and scenarios
    • identify scenarios with really bad outcomes
    • plan to adapt as things change

DMDU def slide KeyIdeas slide

2 / 18

RDM and Management Strategy Evaluation (MSE)

  • Robust Decision Making (RDM) used when

    • future uncertainty difficult to characterize
    • diverse stakeholders with different priorities
  • RDM is "deliberation with analysis"

    • model implications of different assumptions
    • support stakeholder deliberations
    • develop robust, adaptive plans

RDMslide

  • Management Strategy Evaluation (MSE)

... involves assessing the consequences of a range of management strategies or options and presenting the results in a way which lays bare the tradeoffs in performance across a range of management objectives. (Smith, 1994)

...is a flexible approach that allows for a balance between multiple objectives and identifies harvest strategies robust to various types of uncertainty. Simulation can accommodate more realistic modeling of the fishery than dynamic optimization, as well as more practically implementable policies. (Holland and Herrera, 2009)

3 / 18

Fishery management in the US: participatory, with wicked problems

Eight regional Fishery Management Councils establish plans for sustainable management of stocks within their jurisdictions. All are governed by the same law, but tailor management to their regional stakeholder needs.

US map highlighting regions for each fishery management council

More information: http://www.fisherycouncils.org/
https://www.fisheries.noaa.gov/topic/laws-policies#magnuson-stevens-act

4 / 18

Are any Atlantic herring harvest control rules good for both fisheries and predators?

Harvest control rules are:

  • plans for changing fishing based on stock status
  • pre-determined

"Which harvest control rules best consider herring's role as forage?"

  • DESIGN a harvest control rule (HCR):
    • balancing fishing benefits and ecological services
    • addressing diverse stakeholder interests
  • TRANSPARENTLY within management time frame!
5 / 18

What is Management Strategy Evaluation?

  • Process to develop fishery management procedures

  • First used in S. Africa, Australia, and at International Whaling Commission late 1980s - early 1990s

Under this approach, management advice is based on a fully specified set of rules that have been tested in simulations of a wide variety of scenarios that specifically take uncertainty into account. The full procedure includes specifications for the data to be collected and how those data are to be used to provide management advice, in a manner that incorporates a feedback mechanism. (Punt and Donovan, 2007)

6 / 18

The Dream and The Reality

First MSE within US Council
(Feeney, Boelke, Deroba, Gaichas, Irwin, and Lee, 2019) Scope: annual stockwide HCR Open stakeholder meetings (2)

  • ID objectives, uncertainties
  • ID acceptable performance
  • more diverse, interactive than "normal" process

Uncertainties identified

  • herring mortality (M)
  • environmental effects on herring
  • predator response to herring abundance
  • assessment uncertainty
7 / 18

Operating models and uncertainties

Operating Model Name Herring Productivity Herring Growth Assessment Bias
LowFastBiased Low: high M, low h (0.44) 1976-1985: fast 60% overestimate
LowSlowBiased Low: high M, low h (0.44) 2005-2014: slow 60% overestimate
LowFastCorrect Low: high M, low h (0.44) 1976-1985: fast None
LowSlowCorrect Low: high M, low h (0.44) 2005-2014: slow None
HighFastBiased High: low M, high h (0.79) 1976-1985: fast 60% overestimate
HighSlowBiased High: low M, high h (0.79) 2005-2014: slow 60% overestimate
HighFastCorrect High: low M, high h (0.79) 1976-1985: fast None
HighSlowCorrect High: low M, high h (0.79) 2005-2014: slow None
   

Implementation error was included as year-specific lognormal random deviations: Fa,y=ˉFySaeεθ,yσ2θ2εθN(0,σ2θ)

Assessment error was modeled similarly, with first-order autocorrelation and an optional bias term ρ: ˆNa,y=[Na,y(ρ+1)]eεϕ,yσ2ϕ2εϕ,y=ϑεϕ,y1+1ϑ2τyτN(0,σ2ϕ)

8 / 18

Linked models matching stakeholder-identified objectives

The Dream:1 Convert the effects of control rules on 4 user groups to dollars:

  1. Users of landed herring (Demand)
    • Lobster industry, aquariums
  2. Herring harvesters (Supply)
  3. Direct users of herring in the ocean (not people)
    • Terns and Whales
    • Striped Bass, Dogfish
  4. Indirect users of herring in the ocean (people, Derived Demand)
    • Bird- and whale-watchers
    • Recreational and Commercial Fishing
The Reality
  • 8 herring operating models linked to simple predator and economic models, developed in parallel
  • limited range of predator response
  • limited economic effects, directed fishery only
(Deroba, Gaichas, Lee, et al., 2019)

1 Credit: Min-Yang Lee

9 / 18

ternpoptrend

Time constraints forced:

  • selection of predators with previous modeling and readily available data
  • selection of single strongest herring-predator relationship
  • models ignoring high variance in prey-predator relationships
10 / 18

Results summary

Three HCR types were rejected at the second stakeholder meeting for poor fishery and predator performance.

11 / 18

Managing tradeoffs under uncertainty: What control rules give us 90% of everything we want?

  • Tern productivity at 1.0 or above more than 90% of the time
  • Herring biomass more than 90% of SSBmsy
  • Fishery yield more than 90% of MSY  
  • AND fishery closures (F=0) less than 1% of the time (plot on right).

12 / 18

Lessons: testing strategies is key, but uncertainty still difficult to convey

Complex food web, generalist predators

  • Herring is one of several important prey
  • Assess multiple prey together for stronger effects on predator productivity
  • Tern/Tuna/Groundfish/Mammal productivity also affected by predators, weather, and other uncertain factors
  • Still showed which herring control rules were poor
  • Managers selected a harvest control rule considering a wide range of factors!

NEUSfw

13 / 18

MSE and uncertainty: incorporate scenario planning?

  • Standalone process with stakeholders

    • salmon example
    • right whale example
    • climate example just starting
    • many others!
  • Scenarios could specify a set of MSE operating models

    • fewer operating models spanning more uncertainty
    • easier to describe
    • limits results dimensionality
  • Climate scenarios for a region could be used in many MSEs

14 / 18

MSE and uncertainty: visualizing many dimensions? Advice from DMDU and RDM?

(Feeney, Boelke, Deroba, et al., 2019)

15 / 18

MSE and uncertainty: visualizing many dimensions? Advice from DMDU and RDM?

(Feeney, Boelke, Deroba, et al., 2019) plots developed later

15 / 18

Conclusions

  • NOAA Fisheries supports MSE

    • Dedicated FTE at each Science Center
    • National working group
  • Climate and EBFM Roadmaps include

    • Scenario planning
    • MSE
  • Enhance with DMDU

16 / 18

References

Deroba, J. J, S. K. Gaichas, M. Lee, et al. (2019). "The dream and the reality: meeting decision-making time frames while incorporating ecosystem and economic models into management strategy evaluation". In: Canadian Journal of Fisheries and Aquatic Sciences. ISSN: 0706-652X. DOI: 10.1139/cjfas-2018-0128. URL: http://www.nrcresearchpress.com/doi/10.1139/cjfas-2018-0128 (visited on Jul. 20, 2018).

Feeney, R. G, D. V. Boelke, J. J. Deroba, et al. (2019). "Integrating Management Strategy Evaluation into fisheries management: advancing best practices for stakeholder inclusion based on an MSE for Northeast U.S. Atlantic herring". In: Canadian Journal of Fisheries and Aquatic Sciences. ISSN: 0706-652X. DOI: 10.1139/cjfas-2018-0125. URL: http://www.nrcresearchpress.com/doi/10.1139/cjfas-2018-0125 (visited on Nov. 09, 2018).

Holland, D. S. and G. E. Herrera (2009). "Uncertainty in the Management of Fisheries: Contradictory Implications and a New Approach". In: Marine Resource Economics 24.3. Publisher: [MRE Foundation, Inc, The University of Chicago Press], pp. 289-299. ISSN: 0738-1360. URL: https://www.jstor.org/stable/42629656 (visited on Jul. 14, 2020).

Punt, A. E. and G. P. Donovan (2007). "Developing management procedures that are robust to uncertainty: lessons from the International Whaling Commission". En. In: ICES Journal of Marine Science 64.4. Publisher: Oxford Academic, pp. 603-612. ISSN: 1054-3139. DOI: 10.1093/icesjms/fsm035. URL: https://academic.oup.com/icesjms/article/64/4/603/641398 (visited on Jul. 14, 2020).

Smith, A. D. M. (1994). "Management strategy evaluation – the light on the hill". In: Population dynamics for fisheries management. Ed. by D. Hancock. Perth: Australian Society for Fish Biology, pp. 249-253.

17 / 18

Deep Uncertainty and Robust Decision Making (RDM)

  • Decision making under deep uncertainty (DMDU) needed when disagreement on:

    • model of system relating action to consequences
    • probability distributions for model parameters
    • valuation of different outcomes
  • Essential features of DMDU

    • iterate analysis and deliberation
    • many computer simulations of assumptions and scenarios
    • identify scenarios with really bad outcomes
    • plan to adapt as things change

DMDU def slide KeyIdeas slide

2 / 18
Paused

Help

Keyboard shortcuts

, , Pg Up, k Go to previous slide
, , Pg Dn, Space, j Go to next slide
Home Go to first slide
End Go to last slide
Number + Return Go to specific slide
b / m / f Toggle blackout / mirrored / fullscreen mode
c Clone slideshow
p Toggle presenter mode
t Restart the presentation timer
?, h Toggle this help
Esc Back to slideshow