Non-conformal Shortcut

Vladimir Vovk, Alexander Gammerman and Glenn Shafer
Additional contact information
Vladimir Vovk: University of London, Royal Holloway
Alexander Gammerman: University of London, Royal Holloway
Glenn Shafer: Rutgers University

Chapter Chapter 10 in Algorithmic Learning in a Random World, 2022, pp 305-330 from Springer

Abstract: Abstract In Chap. 8 we argued for complementing a prediction rule, i.e., a trained prediction algorithm, with a system for testing deviations from exchangeability. As soon as serious violations of exchangeability are detected, we start retraining the prediction algorithm or take other appropriate measures. In this short chapter we suggest a shortcut: we test directly the predictions output by the prediction rule, and a successful way of testing then automatically translates to improved (“protected”) predictions. In this way we apply methods developed in the first two chapters of this part outside conformal prediction. Our procedures of protected prediction can be used from the very beginning, or after detecting lack of exchangeability (but before retraining is complete). We consider separately the case of regression, in which we combine the probability integral transformation and betting martingales, and classification, in which we move even further from conformal prediction.

Keywords: Protected prediction; Price of protection; Prediction with expert advice; Robustness (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-031-06649-8_10

Ordering information: This item can be ordered from
http://www.springer.com/9783031066498

DOI: 10.1007/978-3-031-06649-8_10

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().