A Constructive Method to Maximize Entropy under Marginal Constraints
Pierre Jean-Claude Robert Bertrand
Additional contact information
Pierre Jean-Claude Robert Bertrand: Aix Marseille Univ, CNRS, AMSE, Marseille, France
No 2608, AMSE Working Papers from Aix-Marseille School of Economics, France
Abstract:
We study the problem of maximizing Rényi entropy of order $2$ (equivalently, minimizing the index of coincidence) over the set of joint distributions with prescribed marginals. A closed-form optimizer is known under a feasibility condition on the marginals; we show that this condition is highly restrictive. We then provide an explicit construction of an optimal coupling for arbitrary marginals. Our approach characterizes the optimizer's structure and yields an iterative algorithm that terminates in finite time, returning an exact solution after at most $p-1$ updates, where $p$ is the number of rows.
Keywords: Entropy maximization; Index of coincidence minimization; Coupling; Marginal constraints (search for similar items in EconPapers)
Date: 2026-03-02
Note: Working paper AMSE 2026-08
References: Add references at CitEc
Citations:
Downloads: (external link)
https://hal.science/hal-05457049/document (application/pdf)
no
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:aim:wpaimx:2608
Access Statistics for this paper
More papers in AMSE Working Papers from Aix-Marseille School of Economics, France AMU-AMSE - 5-9 Boulevard Maurice Bourdet, CS 50498 - 13205 Marseille Cedex 1. Contact information at EDIRC.
Bibliographic data for series maintained by Gregory Cornu ().