Parallel convolutional processing using an integrated photonic tensor core

J. Feldmann, N. Youngblood, M. Karpov, H. Gehring, X. Li, M. Stappers, M. Gallo, X. Fu, A. Lukashchuk, A. S. Raja, J. Liu, C. D. Wright, A. Sebastian (), T. J. Kippenberg (), W. H. P. Pernice () and H. Bhaskaran ()
Additional contact information
J. Feldmann: University of Münster
N. Youngblood: University of Oxford
M. Karpov: Swiss Federal Institute of Technology Lausanne (EPFL)
H. Gehring: University of Münster
X. Li: University of Oxford
M. Stappers: University of Münster
M. Gallo: IBM Research Europe
X. Fu: Swiss Federal Institute of Technology Lausanne (EPFL)
A. Lukashchuk: Swiss Federal Institute of Technology Lausanne (EPFL)
A. S. Raja: Swiss Federal Institute of Technology Lausanne (EPFL)
J. Liu: Swiss Federal Institute of Technology Lausanne (EPFL)
C. D. Wright: University of Exeter
A. Sebastian: IBM Research Europe
T. J. Kippenberg: Swiss Federal Institute of Technology Lausanne (EPFL)
W. H. P. Pernice: University of Münster
H. Bhaskaran: University of Oxford

Nature, 2021, vol. 589, issue 7840, 52-58

Abstract: Abstract With the proliferation of ultrahigh-speed mobile networks and internet-connected devices, along with the rise of artificial intelligence (AI)1, the world is generating exponentially increasing amounts of data that need to be processed in a fast and efficient way. Highly parallelized, fast and scalable hardware is therefore becoming progressively more important2. Here we demonstrate a computationally specific integrated photonic hardware accelerator (tensor core) that is capable of operating at speeds of trillions of multiply-accumulate operations per second (1012 MAC operations per second or tera-MACs per second). The tensor core can be considered as the optical analogue of an application-specific integrated circuit (ASIC). It achieves parallelized photonic in-memory computing using phase-change-material memory arrays and photonic chip-based optical frequency combs (soliton microcombs3). The computation is reduced to measuring the optical transmission of reconfigurable and non-resonant passive components and can operate at a bandwidth exceeding 14 gigahertz, limited only by the speed of the modulators and photodetectors. Given recent advances in hybrid integration of soliton microcombs at microwave line rates3–5, ultralow-loss silicon nitride waveguides6,7, and high-speed on-chip detectors and modulators, our approach provides a path towards full complementary metal–oxide–semiconductor (CMOS) wafer-scale integration of the photonic tensor core. Although we focus on convolutional processing, more generally our results indicate the potential of integrated photonics for parallel, fast, and efficient computational hardware in data-heavy AI applications such as autonomous driving, live video processing, and next-generation cloud computing services.

Date: 2021
References: Add references at CitEc
Citations: View citations in EconPapers (43)

Downloads: (external link)
https://www.nature.com/articles/s41586-020-03070-1 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:nature:v:589:y:2021:i:7840:d:10.1038_s41586-020-03070-1

Ordering information: This journal article can be ordered from
https://www.nature.com/

DOI: 10.1038/s41586-020-03070-1

Access Statistics for this article

Nature is currently edited by Magdalena Skipper

More articles in Nature from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().