Cutoff Threshold Decisions for Classification Algorithms with Risk Aversion

Andrea C. Hupman ()
Additional contact information
Andrea C. Hupman: Supply Chain & Analytics Department, University of Missouri-St. Louis, St. Louis, Missouri 63121

Decision Analysis, 2022, vol. 19, issue 1, 63-78

Abstract: Classification algorithms predict the class membership of an unknown record. Methods such as logistic regression or the naïve Bayes algorithm produce a score related to the likelihood that a record belongs to a particular class. A cutoff threshold is then defined to delineate the prediction of one class over another. This paper derives analytic results for the selection of an optimal cutoff threshold for a classification algorithm that is used to inform a two-action decision in the cases of risk aversion and risk neutrality. The results provide insight to how the optimal cutoff thresholds relate to the associated costs and the sensitivity and specificity of the algorithm for both the risk neutral and risk averse decision makers. The optimal risk averse threshold is not reliably above or below the optimal risk neutral threshold, but the relation depends on the parameters of a particular application. The results further show the risk averse optimal threshold is insensitive to the size of the data set or the magnitude of the costs, but instead is sensitive to the proportion of positive records in the data and the ratio of costs. Numeric examples and sensitivity analysis derive further insight. Results show the percent value gap from a misspecified risk attitude increases as the specificity of the classification algorithm decreases.

Keywords: risk aversion/tolerance; data mining; modeling: analytical (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://dx.doi.org/10.1287/deca.2021.0438 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ordeca:v:19:y:2022:i:1:p:63-78

Access Statistics for this article

More articles in Decision Analysis from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().