MLOGITROC: Stata module to calculate multiclass ROC Curves and AUC from Multinomial Logistic Regression

Leif E. Peterson ()
Additional contact information
Leif E. Peterson: Methodist Hospital Research Institute

Statistical Software Components from Boston College Department of Economics

Abstract: mlogitroc generates multiclass ROC curves for classification accuracy based on multinomial logistic regression using mlogit. The algorithm begins by running mlogit B=100 times using bootstrapped records for each run while the original class labels are intact. Class prediction is then performed for records not sampled during bootstrapping, and accuracy for the left out records is determined as the fraction of correct class membership predictions. This results in B=100 realizations of the accuracy for the alternative distribution. Next, B=100 mlogit runs are made again, but this time after shuffling class labels of all records prior to modeling, which results in B=100 realizations of null accuracy. Smoothed probability distributions are obtained for the B=100 alternative and null accuracy values using kernel density estimation (KDE, Gaussian kernel) to obtain 100 smoothed realizations for alternative and null accuracy. The false positive rate (FPR), true positive rate (TPR), and area under the curve (AUC) are determined from the smooth pdfs derived from KDE. Twoway scatter plots of the smoothed pdfs are constructed, followed by plotting the ROC curve.

Language: Stata
Requires: Stata version 11
Keywords: Multinomial logistic regression; ROC curve; multiclass; kernel density estimation; bootstrap (search for similar items in EconPapers)
Date: 2010-09-30
Note: This module should be installed from within Stata by typing "ssc install mlogitroc". The module is made available under terms of the GPL v3 (https://www.gnu.org/licenses/gpl-3.0.txt). Windows users should not attempt to download these files with a web browser.
References: Add references at CitEc
Citations:

Downloads: (external link)
http://fmwww.bc.edu/repec/bocode/m/mlogitroc.ado program code (text/plain)
http://fmwww.bc.edu/repec/bocode/m/mlogitroc.sthlp help file (text/plain)
http://fmwww.bc.edu/repec/bocode/m/mlogitroc.png sample graph (image/png)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:boc:bocode:s457181

Ordering information: This software item can be ordered from
http://repec.org/docs/ssc.php

Access Statistics for this software item

More software in Statistical Software Components from Boston College Department of Economics Boston College, 140 Commonwealth Avenue, Chestnut Hill MA 02467 USA. Contact information at EDIRC.
Bibliographic data for series maintained by Christopher F Baum ().