Conformal off-policy prediction

Yingying Zhang, Chengchun Shi and Shikai Luo

LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library

Abstract: Off-policy evaluation is critical in a number of applications where new policies need to be evaluated offline before online deployment. Most existing methods focus on the expected return, define the target parameter through averaging and provide a point estimator only. In this paper, we develop a novel procedure to produce reliable interval estimators for a target policy’s return starting from any initial state. Our proposal accounts for the variability of the return around its expectation, focuses on the individual effect and offers valid uncertainty quantification. Our main idea lies in designing a pseudo policy that generates subsamples as if they were sampled from the target policy so that existing conformal prediction algorithms are applicable to prediction interval construction. Our methods are justified by theories, synthetic data and real data from short-video platforms.

JEL-codes: C1 (search for similar items in EconPapers)
Pages: 18 pages
Date: 2023-04-11
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published in Proceedings of Machine Learning Research, 11, April, 2023, 206, pp. 2751-2768. ISSN: 2640-3498

Downloads: (external link)
http://eprints.lse.ac.uk/118250/ Open access version. (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ehl:lserod:118250

Access Statistics for this paper

More papers in LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library LSE Library Portugal Street London, WC2A 2HD, U.K.. Contact information at EDIRC.
Bibliographic data for series maintained by LSERO Manager ().