All code available as a vignette

e.g. MCMC v MVLN

What are the expectations?

• How to
  • include uncertainties
  • model selectivity
  • combine fisheries
  • derive \(MSY\)
• Stock specific modifications
• Length of projections
• Model v estimation error, i.e. Grid v MVLN

Verification

• The process of determining if software is designed and developed as per the specified requirements.

Validation

• The process of checking if the end product meets the client’s true needs and expectations.

GitHub

• Cloud-based service for software development and version control, allowing developers to store and manage their code.
• Provides, bug tracking, software feature requests, task management, continuous integration, and wikis, …

• A \(\color{red}{cookbook}\) for using model diagnostics in integrated stock assessments Carvalho, F., Winker, H., Courtney, D., Kapur, M., Kell, L., Cardinale, M., Schirripa, M., Kitakado, T., Yemane, D., Piner, K.R. and Maunder, M.N., 2021. Fisheries Research, 240, p.105959.

https://github.com/PIFSCstockassessments/ss3diags

https://github.com/jabbamodel/ss3diags

• \(\color{red}{Verify}\) MVLN by running for a variety of stocks, and compare the simulated covariance matrix from r4ss:::ss_ouput()$Covar
• Compare estimates from r4ss:::ss_ouput()$Covar with those from MCMC https://github.com/Cole-Monnahan-NOAA/adnuts
• \(\color{red}{Validate}\) the projections by conducting a back test, i.e. perform a retrospective analysis with a projection, e.g. ICES Workshop on guidelines and methods for the evaluation of rebuilding plans
• Combine results from \(\color{red}{ensembles}\)
• All code on \(\color{red}{github}\)
• Develop code to run on \(\color{red}{cluster}\)
• Ensure best science by publishing as \(\color{red}{peer~review~paper}\)

Europêche, OPNAPA, ORPAGU and OPROMAR