Kaizen: Decomposing cellular images with VQ-VAE

Daniel Majoral and Marharyta Domnich

PLOS ONE, 2025, vol. 20, issue 5, 1-11

Abstract: A fundamental problem in cell and tissue biology is finding cells in microscopy images. Traditionally, this detection has been performed by segmenting the pixel intensities. However, these methods struggle to delineate cells in more densely packed micrographs, where local decisions about boundaries are not trivial. Here, we develop a new methodology to decompose microscopy images into individual cells by making object-level decisions. We formulate the segmentation problem as training a flexible factorized representation of the image. To this end, we introduce Kaizen, an approach inspired by predictive coding in the brain that maintains an internal representation of an image while generating object hypotheses over the external image, and keeping the ones that improve the consistency of internal and external representations. We achieve this by training a Vector Quantised-Variational AutoEncoder (VQ-VAE). During inference, the VQ-VAE is iteratively applied on locations where the internal representation differs from the external image, making new guesses, and keeping only the ones that improve the overall image prediction until the internal representation matches the input. We demonstrate Kaizen’s merits on two fluorescence microscopy datasets, improving the separation of nuclei and neuronal cells in cell culture images.

Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0313549 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 13549&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0313549

DOI: 10.1371/journal.pone.0313549

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().