 Linking error measures to model questionsBas Jacobs, Hilde Tobi and Geerten M. Hengeveld Ecological Modelling, 2024, vol. 487, issue C Abstract: Models for forecasting various ecosystem properties have great potential that comes with a need for model validation. Before we can perform such validation, we need to define what it means for the model to perform well, which depends on the question being asked. Often, it seems easy to ignore the model question and take a standard well-known error measure for comparing the model to the available data. The question is whether this practice is adequate. Here, we defined different types of model-data mismatches that may be more or less relevant to different types of questions. We show that error measures differ in their sensitivity to the type of mismatch and robustness to sparse and noisy data. The results imply that a careful selection of error measures, using a clearly defined ecological question as a starting point, is vital to proper model evaluation. While we present our results as generally applicable to the validation of any type of forecasting model, we also illustrate them using cyanobacterial bloom modelling as a detailed example of a case where different questions could be asked of the same model. Keywords: Error measures; Model evaluation; Model fit; Goodness of fit; Validation; Research methodology; Cyanobacterial blooms (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:eee:ecomod:v:487:y:2024:i:c:s0304380023002922 DOI: 10.1016/j.ecolmodel.2023.110562 Access Statistics for this article Ecological Modelling is currently edited by Brian D. Fath More articles in Ecological Modelling from Elsevier |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.