Validation of Spatial Microsimulation Models: a Proposal to Adopt the Bland-Altman Method

Kate A Timmins () and Kimberley L Edwards ()
Additional contact information
Kate A Timmins: School of Sport and Exercise Science, University of Lincoln, Lincoln LN6 7TS, United Kingdom
Kimberley L Edwards: Arthritis Research UK Centre for Sport Exercise and Osteoarthritis, University of Nottingham, C Floor, South Block, Queens Medical Centre, Nottingham, NG7 2UH, United Kingdom

International Journal of Microsimulation, 2016, vol. 9, issue 2, 106-122

Abstract: Model validation is recognised as crucial to microsimulation modelling. However, modellers encounter difficulty in choosing the most meaningful methods to compare simulated and actual values. The aim of this paper is to introduce and demonstrate a method employed widely in healthcare calibration studies. The Bland-Altman plot consists of a plot of the difference between two methods against the mean (x-y versus x+y/2). A case study is presented to illustrate the method in practice for spatial microsimulation validation. The study features a deterministic combinatorial model (SimObesity), which modelled a synthetic population for England at the ward level using survey (ELSA) and Census 2011 data. Bland-Altman plots were generated, plotting simulated and census ward-level totals for each category of all constraint (benchmark) variables. Other validation metrics, such as R², SEI, TAE and RMSE, are also presented for comparison. The case study demonstrates how the Bland-Altman plots are interpreted. The simple visualisation of both individual- (ward-) level difference and total variation gives the method an advantage over existing tools used in model validation. There still remains the question of what constitutes a valid or well-fitting model. However, the Bland Altman method can usefully be added to the canon of calibration methods.

Keywords: Validation; Bland Altman; Spatial Microsimulation (search for similar items in EconPapers)
JEL-codes: C63 (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.microsimulation.org/IJM/V9_2/IJM_9_2_2016_Timmins.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ijm:journl:v:9:y:2016:i:2:p:106-122

Access Statistics for this article

International Journal of Microsimulation is currently edited by Matteo Richiardi

More articles in International Journal of Microsimulation from International Microsimulation Association
Bibliographic data for series maintained by Jinjing Li ().