How should sparse marine in situ measurements be compared to a continuous model: an example

This work demonstrates an example of the importance of an adequate method to sub-sample model results when comparing with in situ measurements. A test of model skill was performed by employing a point-to-point method to compare a multi-decadal hindcast against a sparse, unevenly distributed historic in situ dataset. The point-to-point method masked out all hindcast cells that did not have a corresponding in situ measurement in order to match each in situ measurement against its most similar cell from the model. The application of the point-to-point method showed that the model was successful at reproducing the inter-annual variability of the in situ datasets. Furthermore, this success was not immediately apparent when the measurements were aggregated to regional averages. Time series, data density and target diagrams were employed to illustrate the impact of switching from the regional average method to the point-to-point method. The comparison based on regional averages gave significantly different and sometimes contradicting results that could lead to erroneous conclusions on the model performance. Furthermore, the point-to-point technique is a more correct method to exploit sparse uneven in situ data while compensating for the variability of its sampling. We therefore recommend that researchers take into account for the limitations of the in situ datasets and process the model to resemble the data as much as possible.

The assessment of a global marine ecosystem model on the basis of emergent properties and ecosystem function: a case study with ERSEM

Ecosystem models are often assessed using quantitative metrics of absolute ecosystem state, but these model-data comparisons are disproportionately vulnerable to discrepancies in the location of important circulation features. An alternative method is to demonstrate the models capacity to represent ecosystem function; the emergence of a coherent natural relationship in a simulation indicates that the model may have an appropriate representation of the ecosystem functions that lead to the emergent relationship. Furthermore, as emergent properties are large-scale properties of the system, model validation with emergent properties is possible even when there is very little or no appropriate data for the region under study, or when the hydrodynamic component of the model differs significantly from that observed in nature at the same location and time. A selection of published meta-analyses are used to establish the validity of a complex marine ecosystem model and to demonstrate the power of validation with emergent properties. These relationships include the phytoplankton community structure, the ratio of carbon to chlorophyll in phytoplankton and particulate organic matter, the ratio of particulate organic carbon to particulate organic nitrogen and the stoichiometric balance of the ecosystem. These metrics can also inform aspects of the marine ecosystem model not available from traditional quantitative and qualitative methods. For instance, these emergent properties can be used to validate the design decisions of the model, such as the range of phytoplankton functional types and their behaviour, the stoichiometric flexibility with regards to each nutrient, and the choice of fixed or variable carbon to nitrogen ratios.

ERSEM 15.06: a generic model for marine biogeochemistry and the ecosystem dynamics of the lower trophic levels

The European Regional Seas Ecosystem Model (ERSEM) is one of the most established ecosystem models for the lower trophic levels of the marine food web in the scientific literature. Since its original development in the early nineties it has evolved significantly from a coastal ecosystem model for the North Sea to a generic tool for ecosystem simulations from shelf seas to the global ocean. The current model release contains all essential elements for the pelagic and benthic parts of the marine ecosystem, including the microbial food web, the carbonate system, and calcification. Its distribution is accompanied by a testing framework enabling the analysis of individual parts of the model. Here we provide a detailed mathematical description of all ERSEM components along with case studies of mesocosm-type simulations, water column implementations, and a brief example of a full-scale application for the north-western European shelf. Validation against in situ data demonstrates the capability of the model to represent the marine ecosystem in contrasting environments.