Validation and Evaluation of Predictive Models in Hazard Assessment and Risk Management

Santiago Beguería ()

Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, 2006, vol. 37, issue 3, 315-329

Abstract: The paper deals with the validation and evaluation of mathematical models in natural hazard analysis, with a special focus on establishing their predictive power. Although most of the tools and statistics available are common to general classification models, some peculiarities arise in the case of hazard assessment. This is due to the fact that the target for validation, the propensity to develop a dangerous characteristic, is not really known and must be estimated from a (usually) very small sample. This implies that the two types of errors (false positives and false negatives) should be given different meanings. Related to this, a very frequent situation is the presence of prevalence (different proportion of positive and negative cases) in the sample. It is shown that sample prevalence can have a dramatic effect in some very common validation statistics, like the confusion matrix and model efficiency. Here some statistics based on the confusion matrix are presented and discussed, and the use of threshold-independent approaches (especially the ROC plot) is shown. The ROC plot is also proposed as a convenient tool for decision-taking in a risk management context. A general scheme for hazard predictive modeling is finally proposed. Copyright Springer 2006

Keywords: geomorphological hazard modelling; probabilistic models; prediction errors; accuracy assessment; decision support; decision threshold; ROC plot (search for similar items in EconPapers)
Date: 2006
References: View complete reference list from CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
http://hdl.handle.net/10.1007/s11069-005-5182-6 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:nathaz:v:37:y:2006:i:3:p:315-329

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11069

DOI: 10.1007/s11069-005-5182-6

Access Statistics for this article

Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards is currently edited by Thomas Glade, Tad S. Murty and Vladimír Schenk

More articles in Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards from Springer, International Society for the Prevention and Mitigation of Natural Hazards
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().