Using Ecosystem Information in the Stock Assessment and Advice Processes

class: right, bottom, my-title, title-slide

.title[
# Using Ecosystem Information in the Stock Assessment and Advice Processes
]
.subtitle[
## 9th World Fisheries Congress 5 March 2024
]
.author[
### Sarah Gaichas1, Kimberly Bastille1, Andy Beet1, Brandon Beltz1, Joseph Caracappa1, Lou Carr-Harris1, Geret DePiper1, Gavin Fay2, Kimberly Hyde3, Scott Large1, Sean Lucey1, 4, Brandon Muffley5, Laurel Smith1, Abigail Tyrell1, Tony Wood1
]
.institute[
### 1NOAA NMFS Northeast Fisheries Science Center, Woods Hole, MA, USA 2University of Massachusetts, Dartmouth, MA, USA 3NOAA NMFS Northeast Fisheries Science Center, Narragansett, RI, USA 4RWE Offshore Wind Holdings, LLC, Boston, MA, USA 5Mid-Atlantic Fishery Management Council, Dover, DE, USA
]

---

background-image: url("https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/nes-components-abstracted.png")
background-size: 550px
background-position: right

class: top, left

.center[
# What do *you* think EBFM means?
]
 
--
*"Bad for me because I fish for forage fish"* 
 
 
 
--
*"Increased uncertainty and lower quotas"*

--
*"It's really complex and difficult to implement"* 
 
 
 
--
*"The ocean is changing and we need to account for that"* 
 
 
 
--
*"It could be really effective if done right"*

How can we effectively communicate and use ecosystem information?

---
## Goal: more effective resource management making best use of available science

.pull-left[
*Outline*
- Using ecosystem information at multiple levels

* Stock assessment
    * Ecosystem reporting
    * Ecosystem approach (EAFM) for interactions
    * Multispecies and ecosystem level tradeoffs

- How to support management decisions?

* Management-science collaboration!
    * Key tools: ecosystem indicators, conceptual modeling, risk assessment, management strategy evaluation
    * Iteratively developing decision processes along with science products

.footnote[
Word cloud based on [Mid-Atlantic Fishery Management Council EAFM Guidance Document](https://www.mafmc.org/s/EAFM-Doc-Revised-2019-02-08-palr.pdf)
]
]
.pull-right[
![:img EAFM Policy Guidance Doc Word Cloud](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/MAFMC_EAFMwordcloud.png)
]
???
    * Allocations to fleets or areas
    * Coordination across boundaries and sectors

---
## Background: Federal fishery management in the US

Eight regional Fishery Management Councils establish plans for sustainable management of stocks within their jurisdictions. All are governed by the same law, but tailor management to their regional stakeholder needs.
.center[
![:img US map highlighting regions for each fishery management council, 80%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/USCouncils.png)
] 
.footnote[
More information: http://www.fisherycouncils.org/  
https://www.fisheries.noaa.gov/topic/laws-policies#magnuson-stevens-act
]

---
## The Mid-Atlantic Fishery Management Council (MAFMC)

.pull-left-30[
![:img US East Coast map highlighting Mid-Atlantic council jurisdiction, 90%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/MACouncil.png)
]
.pull-right-70[
![:img MAFMC fishery management plans and species, 90%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/MAFMPs3.png)
]
.footnote[Source: http://www.mafmc.org/fishery-management-plans]

---
## Ecosystem information for fish stocks: Alaska Ecosystem and Socioeconomic Profiles

.pull-left[

![GOA pcod ESP conceptual model](https://media.fisheries.noaa.gov/styles/media_750_x500/s3/2022-03/Working_Conceptual_Model_EBS%20Pcod.png)  
&nbsp;

Ecosystem and Socioeconomic Profiles (ESPs) <a name=cite-shotwell_introducing_2023></a><a name=cite-shotwell_synthesizing_2022></a><a name=cite-haltuch_oceanographic_2020></a><a name=cite-tolimieri_oceanographic_2018></a><a name=cite-dorn_risk_2020></a>([Shotwell, et al., 2023](https://doi.org/10.1080/08920753.2023.2291858); [Shotwell, et al., 2022](https://www.sciencedirect.com/science/article/pii/S0967064522000558); [Haltuch, et al., 2020](https://onlinelibrary.wiley.com/doi/abs/10.1111/fog.12459); [Tolimieri, et al., 2018](https://onlinelibrary.wiley.com/doi/abs/10.1111/fog.12266); [Dorn, et al., 2020](https://doi.org/10.1080/20964129.2020.1813634))
]

.pull-right[
![](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/GOApcodESPrisk.png)
]

.footnote[

Pacific cod example from Alaska: https://www.fisheries.noaa.gov/alaska/2021-alaska-fisheries-science-center-year-review and https://apps-afsc.fisheries.noaa.gov/refm/docs/2021/GOApcod.pdf
]

???
Our ESP process was developed from the AFSC process, but we adjusted things slightly because of how our benchmarks are scheduled and because we are providing scientific advice to multiple Councils.

The ESP framework is an iterative cycle that complements the stock assessment cycle. First I will give you an overview of the ESP cycle, and then I will explain each step in more detail. The ESP begins with the development of the problem statement by identifying the topics that the assessment working group and ESP team want to assess. This process includes a literature review or other method of gathering existing information on the stock, such as reviewing prior assessments and research recommendations. Next, a conceptual model is created that links important processes and pressures to stock performance. From these linkages, we develop indicators that can be used to monitor the system conditions. Next, the indicators are analyzed to determine their status and the likely impacts on the stock. Some indicators may be tested for inclusion in assessment models. Finally, all of these analyses are synthesized into a report card to provide general recommendations for fishery management.

---
## Assessment question: Does prey drive *availability* of bluefish?

.pull-left-70[
<img src="https://media.fisheries.noaa.gov/styles/original/s3/2022-08/640x427-Bluefish-NOAAFisheries.png" width="60%" style="display: block; margin: auto;" />

"... it is perhaps the most ferocious and bloodthirsty fish in the sea, leaving in its wake a trail of dead and mangled mackerel, menhaden, herring, alewives, and other species on which it preys." <a name=cite-collette_bigelow_2002></a>([Collette, et al., 2002](#bib-collette_bigelow_2002))

"From Raritan Bay to Rockaway Inlet, we have had a phenomenal bluefish year with lots of bunker and other bait, ultimately leading to an abundance of bluefish." [Mid-Atlantic Bluefish Fishery Performance Report, 2021](https://www.mafmc.org/s/8_BF-FPR-2021.pdf)
]

.pull-right-30[
*Bluefish diet, Northeast US*

<img src="https://media.fisheries.noaa.gov/styles/original/s3/2022-08/640x427-Squid-Longfin-v1-NOAAFisheries.png" width="33%" /><img src="https://objects.liquidweb.services/images/201909/robert_aguilar,_serc_48650727166_3ce8edc47d_b.jpg" width="33%" /><img src="https://media.fisheries.noaa.gov/styles/original/s3/2022-08/640x427-Butterfish-NOAAFisheries.png" width="33%" /><img src="https://images.marinespecies.org/thumbs/31939_ammodytes.jpg?w=700" width="33%" /><img src="https://media.fisheries.noaa.gov/styles/original/s3/2022-08/640x427-Mackerel-Atlantic-NOAAFisheries.png" width="33%" /><img src="https://media.fisheries.noaa.gov/styles/original/s3/2022-08/640x427-Herring-Atlantic-NOAAFisheries.png" width="33%" /><img src="https://www.fishbase.se/images/thumbnails/jpg/tn_Etter_u2.jpg" width="33%" /><img src="https://media.fisheries.noaa.gov/styles/original/s3/2022-09/640x427-Hake-Silver-NOAAFisheries.png" width="33%" /><img src="https://media.fisheries.noaa.gov/styles/original/s3/2021-03/squid_illex_nb_w_0.png" width="33%" /><img src="https://media.fisheries.noaa.gov/styles/original/s3/2021-01/640x427-Atlantic_Menhaden_NB_W.jpg" width="33%" />
.contrib[
Northeast Fisheries Science Center Diet Data Online: https://fwdp.shinyapps.io/tm2020/
]
]

.center[
New spatial "forage index" of 20 prey groups from stomach contents of 22 predators <a name=cite-gaichas_assessing_2023></a>([Gaichas, et al., 2023](https://cdnsciencepub.com/doi/10.1139/cjfas-2023-0093))
]

???

.center[
![:img Bluefish illustration NOAA Fisheries, 50%](https://media.fisheries.noaa.gov/styles/original/s3/2022-08/640x427-Bluefish-NOAAFisheries.png)

Changing distribution and abundance of small pelagics may drive changes in predator distributions, affecting predator availability to fisheries and surveys. However, small pelagic fish are difficult to survey directly, so we developed a novel method of assessing small pelagic fish aggregate abundance via predator diet data. We used piscivore diet data collected from multiple bottom trawl surveys within a Vector Autoregressive Spatio-Temporal (VAST) model to assess trends of small pelagics on the Northeast US shelf. The goal was to develop a spatial “forage index” to inform survey and/or fishery availability in the bluefish (Pomatomus saltatrix) stock assessment. Using spring and fall surveys from 1973-2020, 20 small pelagic groups were identified as major bluefish prey using the diet data. Then, predators were grouped by diet similarity to identify 19 piscivore species with the most similar diet to bluefish in the region. Diets from all 20 piscivores were combined for the 20 prey groups at each surveyed location, and the total weight of small pelagic prey per predator stomach at each location was input into a Poisson-link delta model to estimate expected prey mass per predator stomach. Best fit models included spatial and spatio-temporal random effects, with predator mean length, number of predator species, and sea surface temperature as catchability covariates. Spring and fall prey indices were split into inshore and offshore areas to reflect changing prey availability over time in areas available to the recreational fishery and the bottom trawl survey, and also to contribute to regional ecosystem reporting

Using NEFSC bottom trawl survey diet data from 1973-2021, 20 small pelagic groups were identified as major bluefish prey with 10 or more observations (in descending order of observations): Longfin squids (*Doryteuthis* formerly *Loligo* sp.), Anchovy family (Engraulidae), bay anchovy (*Anchoa mitchilli*), Atlantic butterfish, (*Peprilus triachanthus*), Cephalopoda, (*Anchoa hepsetus*), red eye round herring (*Etrumeus teres*), Sandlance (*Ammodytes* sp.), scup (*Stenotomus chrysops*), silver hake (*Merluccius bilinearis*), shortfin squids (*Illex* sp.), Atlantic herring (*Clupea harengus*), Herring family (Clupeidae), Bluefish (*Pomatomus saltatrix*), silver anchovy (*Engraulis eurystole*), longfin inshore squid (*Doryteuthis pealeii*), Atlantic mackerel (*Scomber scombrus*), flatfish (Pleuronectiformes), weakfish (*Cynoscion regalis*), and Atlantic menhaden (*Brevoortia tyrannus*).

Prey categories such as fish unidentified, Osteichthyes, and unidentified animal remains were not included in the prey list. Although unidentified fish and Osteichthyes can comprise a significant portion of bluefish stomach contents, we cannot assume that unidentified fish in other predator stomachs represent unidentified fish in bluefish stomachs.

Image credits: Striped and bay anchovy photo--Robert Aguilar, Smithsonian Environmental Research Center; redeye round herring photo--https://diveary.com ; sandlance photo--Virginia Institute of Marine Science; all others NOAA Fisheries.

---
.pull-left[  
## Quotas won't always go down

The bluefish assessment was implemented using the Woods Hole Assessment Model (WHAM) <a name=cite-stock_woods_2021></a>([Stock, et al., 2021](https://www.sciencedirect.com/science/article/pii/S0165783621000953)) with the forage index as a catchability covariate.

]

.pull-right[

*Inclusion of the forage fish index improved model fit.*

]

The recreational index is important in scaling the biomass results, and the lower availability at the end of the time-series led to higher biomass estimates from the assessment including forage fish.

???
WHAM is a state space stock assessment model framework: https://timjmiller.github.io/wham/

The Bigelow index fit with the fall forage fish index did not improve the model fit (AIC), was slightly worse fit and gave identical results
The Albatross index fit with the fall forage fish index did not converge or hessian was not positive definite for any of the models (even when how = 0 for some of them).
The MRIP index fit with the annual forage fish index did not converge or hessian was not positive definite for any of the models

---
background-image: url("https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/SOE-MA-draft-03.16.23_Page_1.png")
background-size: 380px
background-position: right

## Ecosystem reporting in the Northeast US: 
## Focus on the fishery management audience

.pull-left-70[

- Ecosystem indicators linked to management objectives <a name=cite-depiper_operationalizing_2017></a>([DePiper, et al., 2017](https://academic.oup.com/icesjms/article/74/8/2076/3094701))
 + Contextual information
 + Annual reporting since 2016
 + Fishery-relevant subset of full Ecosystem Status Reports

- Open science emphasis <a name=cite-bastille_improving_2021></a>([Bastille, et al., 2021](https://doi.org/10.1080/08920753.2021.1846155))

- Used within Mid-Atlantic Fishery Management Council's Ecosystem Process <a name=cite-muffley_there_2021></a>([Muffley, et al., 2021](https://doi.org/10.1080/08920753.2021.1846156))
 + Risk assessment <a name=cite-gaichas_implementing_2018></a>([Gaichas, et al., 2018](https://www.frontiersin.org/articles/10.3389/fmars.2018.00442/abstract))
 + Conceptual modeling <a name=cite-depiper_learning_2021></a>([DePiper, et al., 2021](https://doi.org/10.1093/icesjms/fsab054))
 + Management strategy evaluation ([MSE](https://www.mafmc.org/actions/summer-flounder-mse))

]

.pull-right-30[]

---
background-image: url("https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/SOE-MA-draft-03.16.23_Page_2.png")
background-size: 500px
background-position: right

## Reporting ecosystem level performance first 
**Performance relative to management objectives**

.pull-left-60[
Seafood production ![:img decreasing arrow icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//decrease.png) ![:img below average icon icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//below long term ave.png)

Profits ![:img decreasing arrow icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//decrease.png) ![:img below average icon icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//below long term ave.png)

Recreational opportunities:  Effort ![:img increasing arrow icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//no trend.png) ![:img above average icon icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//near-long-term-average.png); Effort diversity ![:img decreasing arrow icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//decrease.png) ![:img below average icon icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//below long term ave.png)

Stability: Fishery ![:img no trend icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//no trend.png) ![:img near average icon icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//near-long-term-average.png); Ecological ![:img mixed trend icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//Mixed trends.png) ![:img near average icon icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//near-long-term-average.png)

Social and cultural, trend not evaluated, status of:  
*  Fishing engagement and reliance by community  
*  Environmental Justice (EJ) Vulnerability by community

Protected species: 
*  Maintain bycatch below thresholds ![:img mixed trend icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//Mixed trends.png) ![:img meeting objectives icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//checked.png)  
*  Recover endangered populations (NARW) ![:img decreasing arrow icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//decrease.png) ![:img below average icon icon, 4%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images//below long term ave.png)  
]
.pull-right-40[]

---
background-image: url("https://www.fisheries.noaa.gov/s3/styles/original/s3/2022-08/640x427-Sea-Scallop-Atlantic-NOAAFisheries.png?itok=GTO_x4Wo")
background-size: 150px
background-position: right

.pull-left[
## Reporting ecosystem risks for managers

*2016-2023 Reports*
<img src="20240305_WFC_Gaichas_files/figure-html/unnamed-chunk-6-1.png" width="504" />

]

.pull-right[
*2024 Report*
![:img scallop stress bottom temp, 90%](https://github.com/NOAA-EDAB/ecodata/raw/dev/workshop/images/bottom_temp_threshold_17_19_Elephant_Trunk.png)
]

???

---
## Adapting Integrated Ecosystem Assessment to managers' needs

Diverse stakeholders agreed that an ecosystem approach was necessary. Developing and implementing EAFM is done in collaboration between managers, stakeholders, and scientists. https://www.mafmc.org/eafm

.pull-left[
![:img IEA process from goal setting to assessment to strategy evaluation with feedbacks, 90%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/iea-loop.png)
.footnote[
https://www.integratedecosystemassessment.noaa.gov/national/IEA-approach
]
]
.pull-right[
![:img Mid-Atlantic EAFM framework with full details in speaker notes, 80%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/Framework.png)
   * Direct link between ecosystem reporting and risk assessment
   * Conceptual model links across risk elements for fisheries, species
   * Management strategy evaluation includes key risks

]
???
<a name=cite-gaichas_framework_2016></a>([Gaichas, et al., 2016](https://www.frontiersin.org/articles/10.3389/fmars.2016.00105/full)) The Council’s EAFM framework has similarities to the IEA loop. It uses risk assessment as a first step to prioritize combinations of managed species, fleets, and ecosystem interactions for consideration. Second, a conceptual model is developed identifying key environmental, ecological, social, economic, and management linkages for a high-priority fishery. Third, quantitative modeling addressing Council-specified questions and based on interactions identified in the conceptual model is applied to evaluate alternative management strategies that best balance management objectives. As strategies are implemented, outcomes are monitored and the process is adjusted, and/or another priority identified in risk assessment can be addressed.

---
## State of the Ecosystem &rarr; MAFMC Risk assessent example: Commercial revenue

This element is applied at the ecosystem level. Revenue serves as a proxy for commercial profits.

.table[
.pull-left[

<table>
 <thead>
 <tr>
 <th style="text-align:left;"> Risk Level </th>
 <th style="text-align:left;"> Definition </th>
 </tr>
 </thead>
<tbody>
 <tr>
 <td style="text-align:left;width: 20em; "> Low </td>
 <td style="text-align:left;width: 20em; "> No trend and low variability in revenue </td>
 </tr>
 <tr>
 <td style="text-align:left;width: 20em; "> Low-Moderate </td>
 <td style="text-align:left;width: 20em; "> Increasing or high variability in revenue </td>
 </tr>
 <tr>
 <td style="text-align:left;width: 20em; font-weight: bold;background-color: orange !important;"> Moderate-High </td>
 <td style="text-align:left;width: 20em; font-weight: bold;background-color: orange !important;"> Significant long term revenue decrease </td>
 </tr>
 <tr>
 <td style="text-align:left;width: 20em; "> High </td>
 <td style="text-align:left;width: 20em; "> Significant recent decrease in revenue </td>
 </tr>
</tbody>
</table>

Ranked moderate-high risk due to the significant long term revenue decrease
]
]
.pull-right[
<img src="20240305_WFC_Gaichas_files/figure-html/unnamed-chunk-7-1.png" width="504" />

]

## Risk element: CommRev

**SOE Implications:** Recent change driven by benthos. Monitor changes in climate and landings drivers: 
- Climate risk element: Surfclams and ocean quahogs are sensitive to ocean warming and acidification. 
- pH in surfclam summer habitat is approaching, but not yet at, pH affecting surfclam growth

---
## EAFM Risk Assessment: 2023 Update (all methods in review/revision this year)

.pull-left[
*Species level risk elements*
<table class="risktable table" style="font-size: 9px; margin-left: auto; margin-right: auto;">
 <thead>
 <tr>
 <th style="text-align:left;"> Species </th>
 <th style="text-align:left;"> Assess </th>
 <th style="text-align:left;"> Fstatus </th>
 <th style="text-align:left;"> Bstatus </th>
 <th style="text-align:left;"> FW1Pred </th>
 <th style="text-align:left;"> FW1Prey </th>
 <th style="text-align:left;"> FW2Prey </th>
 <th style="text-align:left;"> Climate </th>
 <th style="text-align:left;"> DistShift </th>
 <th style="text-align:left;"> EstHabitat </th>
 </tr>
 </thead>
<tbody>
 <tr>
 <td style="text-align:left;"> Ocean Quahog </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Surfclam </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Summer flounder </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Scup </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Black sea bass </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Atl. mackerel </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Chub mackerel </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Butterfish </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Longfin squid </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Shortfin squid </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Golden tilefish </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Blueline tilefish </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Bluefish </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Spiny dogfish </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Monkfish </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Unmanaged forage </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Deepsea corals </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 </tr>
</tbody>
</table>
.contrib[
* RT assessment decreased Spiny dogfish **Assess**, risk to low and increased **Fstatus** risk to high
* RT assessment decreased bluefish **Bstatus** risk from high to low-moderate
* RT assessment increased Illex **Assess** risk from low-moderate to high
]

*Ecosystem level risk elements*
<table class="risktable table" style="font-size: 9px; margin-left: auto; margin-right: auto;">
 <thead>
 <tr>
 <th style="text-align:left;"> System </th>
 <th style="text-align:left;"> EcoProd </th>
 <th style="text-align:left;"> CommRev </th>
 <th style="text-align:left;"> RecVal </th>
 <th style="text-align:left;"> FishRes1 </th>
 <th style="text-align:left;"> FishRes4 </th>
 <th style="text-align:left;"> FleetDiv </th>
 <th style="text-align:left;"> Social </th>
 <th style="text-align:left;"> ComFood </th>
 <th style="text-align:left;"> RecFood </th>
 </tr>
 </thead>
<tbody>
 <tr>
 <td style="text-align:left;"> Mid-Atlantic </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> modhigh </td>
 </tr>
</tbody>
</table>
.contrib[
* Recreational value risk decreased from low-moderate to low
] 
]

.pull-right[ 
*Species and Sector level risk elements*
<table class="risktable table" style="font-size: 11px; margin-left: auto; margin-right: auto;">
 <thead>
 <tr>
 <th style="text-align:left;"> Species </th>
 <th style="text-align:left;"> MgtControl </th>
 <th style="text-align:left;"> TecInteract </th>
 <th style="text-align:left;"> OceanUse </th>
 <th style="text-align:left;"> RegComplex </th>
 <th style="text-align:left;"> Discards </th>
 <th style="text-align:left;"> Allocation </th>
 </tr>
 </thead>
<tbody>
 <tr>
 <td style="text-align:left;"> Ocean Quahog-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Surfclam-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Summer flounder-R </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Summer flounder-C </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Scup-R </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Scup-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Black sea bass-R </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Black sea bass-C </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Atl. mackerel-R </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Atl. mackerel-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Butterfish-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Longfin squid-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Shortfin squid-C </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Golden tilefish-R </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Golden tilefish-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Blueline tilefish-R </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Blueline tilefish-C </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Bluefish-R </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> highest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Bluefish-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Spiny dogfish-R </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Spiny dogfish-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Chub mackerel-C </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowmod </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Unmanaged forage </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 <td style="text-align:left;"> lowest </td>
 </tr>
 <tr>
 <td style="text-align:left;"> Deepsea corals </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> modhigh </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 <td style="text-align:left;"> na </td>
 </tr>
</tbody>
</table>
.contrib[
* Management section not updated--to be revised this year 
]
]

???
---
.pull-left[
## How has MAFMC used the risk assessment?

* Based on risk assessment, the Council selected summer flounder as high-risk fishery for conceptual modeling

![:img Mid-Atlantic EAFM framework, 95%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/Framework.png)
* Council proceeding with management strategy evaluation (MSE) addressing [recreational fishery discards](https://www.mafmc.org/actions/summer-flounder-mse) using information from conceptual modeling.
]
.pull-right[
<div id="htmlwidget-510d5b3a743fcec82518" style="width:100%;height:710px;" class="widgetframe html-widget"></div>
<script type="application/json" data-for="htmlwidget-510d5b3a743fcec82518">{"x":{"url":"20240305_WFC_Gaichas_files/figure-html//widgets/widget_sfconceptmod.html","options":{"xdomain":"*","allowfullscreen":false,"lazyload":false}},"evals":[],"jsHooks":[]}</script>

]

???
In this interactive circular graph visualization, model elements identified as important by the Council (through risk assessment) and by the working group (through a range of experience and expertise) are at the perimeter of the circle. Elements are defined in detail in the last section of [this page](https://gdepiper.github.io/Summer_Flounder_Conceptual_Models/sfconsmod_riskfactors_subplots.html). Relationships between elements are represented as links across the center of the circle to other elements on the perimeter. Links from a model element that affect another element start wide at the base and are color coded to match the category of the element they affect.Hover over a perimeter section (an element) to see all relationships for that element, including links from other elements. Hover over a link to see what it connects. Links by default show text for the two elements and the direction of the relationship (1 for relationship, 0 for no relationship--most links are one direction).For example, hovering over the element "Total Landings" in the full model shows that the working group identified the elements affected by landings as Seafood Production, Recreational Value, and Commercial Profits (three links leading out from landings), and the elements affecting landings as Fluke SSB, Fluke Distributional Shift, Risk Buffering, Management Control, Total Discards, and Shoreside Support (6 links leading into Total Landings).

&nbsp;  
&nbsp;  
&nbsp;

![:img static conceptual model discards](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/consmod-discards2.png)

---
## MSE results: can improve on current management, but distribution shifts lower expectations

Results for 2 of 16 performance metrics:

.center[
![:img Summer flounder MSE results by OM, 95%](https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/keepOneNoOFkey.png)
]

.footnote[
[August MAFMC briefing materials](https://www.mafmc.org/s/Tab02_Summer-Flounder-MSE_2022-08.pdf) and [full results on the web](https://gavinfay.github.io/fluke-mafmc-recdisc/summary-metrics.html)
]
???
* Linked recreational demand and population dynamics model
* Alternative operating model included northward distribution shift as change in availability by state
* Rank order of management options maintained, but degraded performance when considering ecosystem change

---
.pull-left[
## Frontiers: multispecies and system level advice

Fish condition

Species in the MAB had low condition 2000-2010. Fish productivity based on surveys and assessments has been below average since then.

]

.pull-right[
Fish productivity anomaly <a name=cite-perretti_regime_2017></a>([Perretti, et al., 2017](http://www.int-res.com/abstracts/meps/v574/p1-11/))
<img src="20240305_WFC_Gaichas_files/figure-html/unnamed-chunk-9-1.png" width="504" />

.contrib[
Black line indicates sum where there are the same number of assessments across years.
]
]

???

---
background-image: url(https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/ecodata.png)
background-size: 300px
background-position: bottom right

## Entry points for ecosystem information in management decisions: where to start?

.pull-left-40[
*Management decisions*
1.  What are our issues and goals?
1.  Current decisions  
    +  Stock assessments
    +  Advice on catch levels
    +  Harvest control rules
1.  New (current) decisions  
    +  Habitat change or restoration
    +  Changing species distribution and interactions
    +  Tradeoffs between fisheries
    +  Tradeoffs between ocean use sectors

]

.pull-right-60[
*Methods and tools*
1.  Stakeholder engagement, surveys, strategic planning  
1.  Add information to current process  
    +  Ecosystem ToRs, overviews, ESP, SOE
    +  Risk or uncertainty assessments
    +  Management strategy evaluation
1.  Integrate across current processes  
    +  Risk assessment
    +  Conceptual models
    +  Scenario planning
    +  MSE (again)
]

Focus on developing *decision processes* that are able to use ecosystem information

*  Collaborative, iterative process between scientists, managers, stakeholders
*  Multispecies and system level indicators of productivity change or overexploitation

.footnote[
State of the Ecosystem data on github https://github.com/NOAA-EDAB/ecodata
]

---

background-image: url("https://github.com/NOAA-EDAB/presentations/raw/master/docs/EDAB_images/IMG_2733.jpg")
background-size: cover

## Additional resources
.pull-left[
* [Northeast US Ecosystem Reports](https://www.fisheries.noaa.gov/new-england-mid-atlantic/ecosystems/state-ecosystem-reports-northeast-us-shelf)  
* [Ecosystem Report Technical Documentation](https://noaa-edab.github.io/tech-doc)  
* [ecodata R package](https://github.com/noaa-edab/ecodata)
* [Ecosystem Indicator Catalog (in development)](https://noaa-edab.github.io/catalog/index.html)
]

.pull-right[
* [MAFMC SSC](https://www.mafmc.org/ssc)
* [MAFMC EAFM](https://www.mafmc.org/eafm)
* [MAFMC EAFM Summer Flounder MSE](https://www.mafmc.org/actions/summer-flounder-mse)
.contrib[

* Slides available at https://noaa-edab.github.io/presentations
* Contact: <Sarah.Gaichas@noaa.gov>
]
]

# Questions?  Thank you

---
.scroll-output[
.contrib[
<a name=bib-bastille_improving_2021></a>[Bastille, K. et
al.](#cite-bastille_improving_2021) (2021). "Improving the IEA Approach
Using Principles of Open Data Science". In: _Coastal Management_ 49.1.
Publisher: Taylor & Francis \_ eprint:
https://doi.org/10.1080/08920753.2021.1846155, pp. 72-89. ISSN:
0892-0753. DOI:
[10.1080/08920753.2021.1846155](https://doi.org/10.1080%2F08920753.2021.1846155).
(Visited on Apr. 16, 2021).

<a name=bib-collette_bigelow_2002></a>[Collette, B. B. et
al.](#cite-collette_bigelow_2002) (2002). _Bigelow and Schroeder's
Fishes of the Gulf of Maine, Third Edition_. 3rd ed. edition.
Washington, DC: Smithsonian Books. ISBN: 978-1-56098-951-6.

<a name=bib-depiper_operationalizing_2017></a>[DePiper, G. S. et
al.](#cite-depiper_operationalizing_2017) (2017). "Operationalizing
integrated ecosystem assessments within a multidisciplinary team:
lessons learned from a worked example". En. In: _ICES Journal of Marine
Science_ 74.8, pp. 2076-2086. ISSN: 1054-3139. DOI:
[10.1093/icesjms/fsx038](https://doi.org/10.1093%2Ficesjms%2Ffsx038).
(Visited on Mar. 09, 2018).

<a name=bib-depiper_learning_2021></a>[DePiper, G. et
al.](#cite-depiper_learning_2021) (2021). "Learning by doing:
collaborative conceptual modelling as a path forward in ecosystem-based
management". In: _ICES Journal of Marine Science_ 78.4, pp. 1217-1228.
ISSN: 1054-3139. DOI:
[10.1093/icesjms/fsab054](https://doi.org/10.1093%2Ficesjms%2Ffsab054).
(Visited on Aug. 08, 2022).

<a name=bib-dorn_risk_2020></a>[Dorn, M. W. et
al.](#cite-dorn_risk_2020) (2020). "A risk table to address concerns
external to stock assessments when developing fisheries harvest
recommendations". In: _Ecosystem Health and Sustainability_ 6.1.
Publisher: Taylor & Francis \_ eprint:
https://doi.org/10.1080/20964129.2020.1813634, p. 1813634. ISSN:
2096-4129. DOI:
[10.1080/20964129.2020.1813634](https://doi.org/10.1080%2F20964129.2020.1813634).
(Visited on Nov. 20, 2020).

<a name=bib-gaichas_implementing_2018></a>[Gaichas, S. K. et
al.](#cite-gaichas_implementing_2018) (2018). "Implementing Ecosystem
Approaches to Fishery Management: Risk Assessment in the US
Mid-Atlantic". In: _Frontiers in Marine Science_ 5. ISSN: 2296-7745.
DOI:
[10.3389/fmars.2018.00442](https://doi.org/10.3389%2Ffmars.2018.00442).
(Visited on Nov. 20, 2018).

<a name=bib-gaichas_assessing_2023></a>[Gaichas, S. K. et
al.](#cite-gaichas_assessing_2023) (2023). "Assessing small pelagic
fish trends in space and time using piscivore stomach contents". En.
In: _Canadian Journal of Fisheries and Aquatic Sciences_, pp.
cjfas-2023-0093. ISSN: 0706-652X, 1205-7533. DOI:
[10.1139/cjfas-2023-0093](https://doi.org/10.1139%2Fcjfas-2023-0093).
(Visited on Feb. 15, 2024).

<a name=bib-gaichas_framework_2016></a>[Gaichas, S. K. et
al.](#cite-gaichas_framework_2016) (2016). "A Framework for
Incorporating Species, Fleet, Habitat, and Climate Interactions into
Fishery Management". In: _Frontiers in Marine Science_ 3. ISSN:
2296-7745. DOI:
[10.3389/fmars.2016.00105](https://doi.org/10.3389%2Ffmars.2016.00105).
(Visited on Apr. 29, 2020).

<a name=bib-haltuch_oceanographic_2020></a>[Haltuch, M. A. et
al.](#cite-haltuch_oceanographic_2020) (2020). "Oceanographic drivers
of petrale sole recruitment in the California Current Ecosystem". En.
In: _Fisheries Oceanography_ 29.2. \_ eprint:
https://onlinelibrary.wiley.com/doi/pdf/10.1111/fog.12459, pp. 122-136.
ISSN: 1365-2419. DOI:
[10.1111/fog.12459](https://doi.org/10.1111%2Ffog.12459). (Visited on
Mar. 10, 2022).

<a name=bib-muffley_there_2021></a>[Muffley, B. et
al.](#cite-muffley_there_2021) (2021). "There Is no I in EAFM Adapting
Integrated Ecosystem Assessment for Mid-Atlantic Fisheries Management".
In: _Coastal Management_ 49.1. Publisher: Taylor & Francis \_ eprint:
https://doi.org/10.1080/08920753.2021.1846156, pp. 90-106. ISSN:
0892-0753. DOI:
[10.1080/08920753.2021.1846156](https://doi.org/10.1080%2F08920753.2021.1846156).
(Visited on Apr. 16, 2021).

<a name=bib-perretti_regime_2017></a>[Perretti, C. et
al.](#cite-perretti_regime_2017) (2017). "Regime shifts in fish
recruitment on the Northeast US Continental Shelf". En. In: _Marine
Ecology Progress Series_ 574, pp. 1-11. ISSN: 0171-8630, 1616-1599.
DOI: [10.3354/meps12183](https://doi.org/10.3354%2Fmeps12183). (Visited
on Feb. 10, 2022).

<a name=bib-shotwell_introducing_2023></a>[Shotwell, S. K. et
al.](#cite-shotwell_introducing_2023) (2023). "Introducing the
Ecosystem and Socioeconomic Profile, a Proving Ground for Next
Generation Stock Assessments". In: _Coastal Management_ 51.5-6.
Publisher: Taylor & Francis \_ eprint:
https://doi.org/10.1080/08920753.2023.2291858, pp. 319-352. ISSN:
0892-0753. DOI:
[10.1080/08920753.2023.2291858](https://doi.org/10.1080%2F08920753.2023.2291858).
(Visited on Feb. 15, 2024).

<a name=bib-shotwell_synthesizing_2022></a>[Shotwell, S. K. et
al.](#cite-shotwell_synthesizing_2022) (2022). "Synthesizing integrated
ecosystem research to create informed stock-specific indicators for
next generation stock assessments". En. In: _Deep Sea Research Part II:
Topical Studies in Oceanography_ 198, p. 105070. ISSN: 0967-0645. DOI:
[10.1016/j.dsr2.2022.105070](https://doi.org/10.1016%2Fj.dsr2.2022.105070).
(Visited on Dec. 05, 2022).

<a name=bib-stock_woods_2021></a>[Stock, B. C. et
al.](#cite-stock_woods_2021) (2021). "The Woods Hole Assessment Model
(WHAM): A general state-space assessment framework that incorporates
time- and age-varying processes via random effects and links to
environmental covariates". En. In: _Fisheries Research_ 240, p. 105967.
ISSN: 0165-7836. DOI:
[10.1016/j.fishres.2021.105967](https://doi.org/10.1016%2Fj.fishres.2021.105967).
(Visited on May. 26, 2021).

<a name=bib-tolimieri_oceanographic_2018></a>[Tolimieri, N. et
al.](#cite-tolimieri_oceanographic_2018) (2018). "Oceanographic drivers
of sablefish recruitment in the California Current". En. In: _Fisheries
Oceanography_ 27.5. \_ eprint:
https://onlinelibrary.wiley.com/doi/pdf/10.1111/fog.12266, pp. 458-474.
ISSN: 1365-2419. DOI:
[10.1111/fog.12266](https://doi.org/10.1111%2Ffog.12266). (Visited on
Mar. 10, 2022).
]
]