The Separation Plot: A New Visual Method for Evaluating the Fit of Binary Models

Brian Greenhill, Michael D. Ward and Audrey Sacks

American Journal of Political Science, 2011, vol. 55, issue 4, 991-1002

Abstract: We present a visual method for assessing the predictive power of models with binary outcomes. This technique allows the analyst to evaluate model fit based upon the models’ ability to consistently match high‐probability predictions to actual occurrences of the event of interest, and low‐probability predictions to nonoccurrences of the event of interest. Unlike existing methods for assessing predictive power for logit and probit models such as Percent Correctly Predicted statistics, Brier scores, and the ROC plot, our “separation plot” has the advantage of producing a visual display that is informative and easy to explain to a general audience, while also remaining insensitive to the often arbitrary probability thresholds that are used to distinguish between predicted events and nonevents. We demonstrate the effectiveness of this technique in building predictive models in a number of different areas of political research.

Date: 2011
References: Add references at CitEc
Citations: View citations in EconPapers (30)

Downloads: (external link)
https://doi.org/10.1111/j.1540-5907.2011.00525.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:amposc:v:55:y:2011:i:4:p:991-1002

Access Statistics for this article

More articles in American Journal of Political Science from John Wiley & Sons
Bibliographic data for series maintained by Wiley Content Delivery ().