An Enquiry on similarities between Renormalization Group and Auto-Encoders using Transfer Learning

Mohak Shukla and Ajay D. Thakur

Physica A: Statistical Mechanics and its Applications, 2022, vol. 608, issue P1

Abstract: Physicists have had a keen interest in the areas of Artificial Intelligence (AI) and Machine Learning (ML) for a while, with a special inclination towards unravelling the fundamental mechanism behind the process of learning. In particular, exploring the underlying mathematical structure of a neural net (NN) is expected to not only help us understand the epistemological meaning of ‘Learning’ but also has the potential to unravel the secrets behind the workings of the brain. Here, it is worthwhile to establish correspondences and draw parallels between methods developed in core areas of Physics and the techniques developed at the forefront of AI and ML. Although recent explorations indicating a mapping between the Renormalization Group (RG) and Deep Learning (DL) have shown valuable insights, we intend to investigate the relationship between RG and Autoencoders (AE) in particular. We use Transfer Learning (TL) to embed the coarse-graining procedure in a NN and compare it with the underlying mechanism of encoding–decoding through a series of tests.

Keywords: Renormalization group; Deep learning; Auto-encoders; Transfer learning; Ising model; Unsupervised learning (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437122008342
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:608:y:2022:i:p1:s0378437122008342

DOI: 10.1016/j.physa.2022.128276

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().