Quasi-Unimodal Distributions for Ordinal Classification

Tomé Albuquerque, Ricardo Cruz and Jaime S. Cardoso
Additional contact information
Tomé Albuquerque: Institute for Systems and Computer Engineering, Technology and Science, 4200-465 Porto, Portugal
Ricardo Cruz: Institute for Systems and Computer Engineering, Technology and Science, 4200-465 Porto, Portugal
Jaime S. Cardoso: Institute for Systems and Computer Engineering, Technology and Science, 4200-465 Porto, Portugal

Mathematics, 2022, vol. 10, issue 6, 1-13

Abstract: Ordinal classification tasks are present in a large number of different domains. However, common losses for deep neural networks, such as cross-entropy, do not properly weight the relative ordering between classes. For that reason, many losses have been proposed in the literature, which model the output probabilities as following a unimodal distribution. This manuscript reviews many of these losses on three different datasets and suggests a potential improvement that focuses the unimodal constraint on the neighborhood around the true class, allowing for a more flexible distribution, aptly called quasi-unimodal loss. For this purpose, two constraints are proposed: A first constraint concerns the relative order of the top-three probabilities, and a second constraint ensures that the remaining output probabilities are not higher than the top three. Therefore, gradient descent focuses on improving the decision boundary around the true class in detriment to the more distant classes. The proposed loss is found to be competitive in several cases.

Keywords: ordinal classification; ordinal losses; deep learning; optimization (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/6/980/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/6/980/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:6:p:980-:d:774314

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().