Adaptive spatial-temporal information processing based on in-memory attention-inspired devices

Jiong Pan, Fan Wu, Kangan Qian, Kun Jiang, Yanming Liu, Zeda Wang, Pengwen Guo, Jiaju Yin, Diange Yang (), He Tian (), Yi Yang () and Tian-Ling Ren ()
Additional contact information
Jiong Pan: Tsinghua University
Fan Wu: Tsinghua University
Kangan Qian: Tsinghua University
Kun Jiang: Tsinghua University
Yanming Liu: Tsinghua University
Zeda Wang: Tsinghua University
Pengwen Guo: Tsinghua University
Jiaju Yin: Tsinghua University
Diange Yang: Tsinghua University
He Tian: Tsinghua University
Yi Yang: Tsinghua University
Tian-Ling Ren: Tsinghua University

Nature Communications, 2025, vol. 16, issue 1, 1-10

Abstract: Abstract Spatial-temporal information perception is widely used for motion processing in dynamic scenes, but present technology requires relatively huge hardware resource consumption. The attention mechanism helps the human brain extract required information from tremendous data at a low cost. Here, we propose an attention-inspired artificial intelligence architecture based on hetero-dimensional modulations between zero-dimensional contact and two-dimensional electrostatic interfaces. An adaptive spatial-temporal information processing primitive is successfully implemented based on in-memory analog computing. Experiments of attention adjustments responding to different situations validate the adaptation capability to environmental changes. A demonstration of 5×5-unit data stream processing is conducted, and intensities of spatial and temporal information are varied with attention distribution from 0% to 100%. The attention-inspired device is applied to autonomous driving edge intelligence scenarios, showing high adaptability to traffic scene variations. The proposed architecture exhibits a tens-fold latency reduction, hundreds-fold area improvement, and thousands-fold energy saving compared to the conventional transistor-based circuit.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.nature.com/articles/s41467-025-62868-7 Abstract (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-62868-7

Ordering information: This journal article can be ordered from
https://www.nature.com/ncomms/

DOI: 10.1038/s41467-025-62868-7

Access Statistics for this article

Nature Communications is currently edited by Nathalie Le Bot, Enda Bergin and Fiona Gillespie

More articles in Nature Communications from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().