Processing math: 100%

KOBE POSTERIORS FOR BLUE SHARK SCRS/2023/143

Verification and Validation of Stock Status and Projections

Laurence Kell

21 September, 2023

Blue Shark Example

Blue Shark Example

All code available as a vignette

e.g. MCMC v MVLN

Generic Method

Provision of Advice

What are the expectations?

  • How to
    • include uncertainties
    • model selectivity
    • combine fisheries
    • derive MSY
  • Stock specific modifications
  • Length of projections
  • Model v estimation error, i.e. Grid v MVLN

Solutions

Verification

  • The process of determining if software is designed and developed as per the specified requirements.

Validation

  • The process of checking if the end product meets the client’s true needs and expectations.

GitHub

  • Cloud-based service for software development and version control, allowing developers to store and manage their code.
  • Provides, bug tracking, software feature requests, task management, continuous integration, and wikis, 


Suggested Approach

  • A cookbook for using model diagnostics in integrated stock assessments Carvalho, F., Winker, H., Courtney, D., Kapur, M., Kell, L., Cardinale, M., Schirripa, M., Kitakado, T., Yemane, D., Piner, K.R. and Maunder, M.N., 2021. Fisheries Research, 240, p.105959.

Github

Peer Review

Reccomendations

  • Verify MVLN by running for a variety of stocks, and compare the simulated covariance matrix from r4ss:::ss_ouput()$Covar
  • Compare estimates from r4ss:::ss_ouput()$Covar with those from MCMC https://github.com/Cole-Monnahan-NOAA/adnuts
  • Validate the projections by conducting a back test, i.e. perform a retrospective analysis with a projection, e.g. ICES Workshop on guidelines and methods for the evaluation of rebuilding plans
  • Combine results from ensembles
  • All code on github
  • Develop code to run on cluster
  • Ensure best science by publishing as peer review paper

Acknowledgements

EuropĂȘche, OPNAPA, ORPAGU and OPROMAR