PMCALPLOT: Stata module to produce calibration plot of prediction model performance

Joie Ensor (), Kym IE. Snell and Emma C. Martin
Additional contact information
Joie Ensor: Institute of Applied Health Research, University of Birmingham
Kym IE. Snell: Keele University
Emma C. Martin: University of Leicester

Statistical Software Components from Boston College Department of Economics

Abstract: pmcalplot produces a calibration plot of observed against expected probabilities for assessment of prediction model performance. pmcalplot can now handle prediction models with binary, survival or continuous outcome types. Calibration is plotted in groups across the risk spectrum as recommended in the TRIPOD guidelines, and confidence intervals for the groupings can also be displayed (NB: not for continuous outcomes). Further, a spike plot of the distribution of events and non-events can be displayed on the plot, as well as a lowess smoother allowing assessment of the calibration at the individual patient level [NB: Spike plot and lowess smoother for survival outcomes is work in progress]. For continuous outcomes a histogram of observed and expected values can be displayed on the corresponding axes. Additionally, common prediction model performance statistics can also be displayed on the plot, quantifying the models performance. pmcalplot is primarily useful for assessment of model performance in an external validation of an existing model. However it can also be used during model development to check the apparent performance of the model (which should show perfect calibration).

Language: Stata
Requires: Stata version 14.2
Keywords: calibration plot; prediction model performance (search for similar items in EconPapers)
Date: 2018-05-19, Revised 2024-03-08
Note: This module should be installed from within Stata by typing "ssc install pmcalplot". The module is made available under terms of the GPL v3 (https://www.gnu.org/licenses/gpl-3.0.txt). Windows users should not attempt to download these files with a web browser.
References: Add references at CitEc
Citations:

Downloads: (external link)
http://fmwww.bc.edu/repec/bocode/p/pmcalplot.ado program code (text/plain)
http://fmwww.bc.edu/repec/bocode/p/pmcalplot.sthlp help file (text/plain)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:boc:bocode:s458486

Ordering information: This software item can be ordered from
http://repec.org/docs/ssc.php

Access Statistics for this software item

More software in Statistical Software Components from Boston College Department of Economics Boston College, 140 Commonwealth Avenue, Chestnut Hill MA 02467 USA. Contact information at EDIRC.
Bibliographic data for series maintained by Christopher F Baum ().