A study on relationship between prediction uncertainty and robustness to noisy data

Hufsa Khan, Xizhao Wang and Han Liu

International Journal of Systems Science, 2023, vol. 54, issue 6, 1243-1258

Abstract: The presence of noise results in the decrease of the data quality, and thus affects seriously the learning performance. In this paper, we investigate theoretically and empirically how adjusting the temperature value of the softmax function to control the prediction uncertainty can help improve the model robustness to noise. Moreover, we design a modified loss function, where a regularisation term based on the uncertainty of distinguishing those non-ground truth labels is incorporated in the loss function to simultaneously improve the training accuracy and the model robustness to noise. This study theoretically and experimentally validates that the temperature parameter of the softmax function significantly impacts the classification accuracy and the proposed loss function is effective in improving the performance in the presence of noise. The study provides some practical guidelines for improving classifier performance through clearly expressing and understanding the relationship between uncertainty and noise robustness.

Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207721.2023.2169059 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tsysxx:v:54:y:2023:i:6:p:1243-1258

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TSYS20

DOI: 10.1080/00207721.2023.2169059

Access Statistics for this article

International Journal of Systems Science is currently edited by Visakan Kadirkamanathan

More articles in International Journal of Systems Science from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().