Unsupervised inter-domain transformation for virtually stained high-resolution mid-infrared photoacoustic microscopy using explainable deep learning

Eunwoo Park, Sampa Misra, Dong Gyu Hwang, Chiho Yoon, Joongho Ahn, Donggyu Kim, Jinah Jang () and Chulhong Kim ()
Additional contact information
Eunwoo Park: Pohang University of Science and Technology (POSTECH)
Sampa Misra: Pohang University of Science and Technology (POSTECH)
Dong Gyu Hwang: Pohang University of Science and Technology (POSTECH)
Chiho Yoon: Pohang University of Science and Technology (POSTECH)
Joongho Ahn: Pohang University of Science and Technology (POSTECH)
Donggyu Kim: Pohang University of Science and Technology (POSTECH)
Jinah Jang: Pohang University of Science and Technology (POSTECH)
Chulhong Kim: Pohang University of Science and Technology (POSTECH)

Nature Communications, 2024, vol. 15, issue 1, 1-12

Abstract: Abstract Mid-infrared photoacoustic microscopy can capture biochemical information without staining. However, the long mid-infrared optical wavelengths make the spatial resolution of photoacoustic microscopy significantly poorer than that of conventional confocal fluorescence microscopy. Here, we demonstrate an explainable deep learning-based unsupervised inter-domain transformation of low-resolution unlabeled mid-infrared photoacoustic microscopy images into confocal-like virtually fluorescence-stained high-resolution images. The explainable deep learning-based framework is proposed for this transformation, wherein an unsupervised generative adversarial network is primarily employed and then a saliency constraint is added for better explainability. We validate the performance of explainable deep learning-based mid-infrared photoacoustic microscopy by identifying cell nuclei and filamentous actins in cultured human cardiac fibroblasts and matching them with the corresponding CFM images. The XDL ensures similar saliency between the two domains, making the transformation process more stable and more reliable than existing networks. Our XDL-MIR-PAM enables label-free high-resolution duplexed cellular imaging, which can significantly benefit many research avenues in cell biology.

Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.nature.com/articles/s41467-024-55262-2 Abstract (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-55262-2

Ordering information: This journal article can be ordered from
https://www.nature.com/ncomms/

DOI: 10.1038/s41467-024-55262-2

Access Statistics for this article

Nature Communications is currently edited by Nathalie Le Bot, Enda Bergin and Fiona Gillespie

More articles in Nature Communications from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().