The Bellman equation and optimal local flipping strategies for kinetic Ising models

F. Caravelli

Physica A: Statistical Mechanics and its Applications, 2024, vol. 649, issue C

Abstract: There is a deep connection between thermodynamics, information and work extraction. Ever since the birth of thermodynamics, various types of Maxwell demons have been introduced in order to deepen our understanding of the second law. Thanks to them, it has been shown that there is a deep connection between thermodynamics and information, and between information and work in a thermal system. In this paper we study the problem of energy extraction from a thermodynamic system satisfying detailed balance by an agent with perfect information, e.g. one that has an optimal strategy, given by the solution of the Bellman equation, in the context of Ising models. We call these agents kobolds, in contrast to Maxwell’s demons which do not necessarily need to satisfy detailed balance. This is in stark contrast with typical Monte Carlo algorithms, which choose an action at random at each time step. It is thus natural to compare the behavior of these kobolds to a Metropolis algorithm. For various Ising models, we study numerically and analytically the properties of the optimal strategies, showing that there is a transition in the behavior of the kobold as a function of the parameter characterizing its strategy.

Keywords: Bellman equation; Kinetic Ising model; Work extraction; Kobolds (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437124004655
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:649:y:2024:i:c:s0378437124004655

DOI: 10.1016/j.physa.2024.129956

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().