An on-chip photonic deep neural network for image classification

Farshid Ashtiani, Alexander J. Geers and Firooz Aflatouni ()
Additional contact information
Farshid Ashtiani: University of Pennsylvania
Alexander J. Geers: University of Pennsylvania
Firooz Aflatouni: University of Pennsylvania

Nature, 2022, vol. 606, issue 7914, 501-506

Abstract: Abstract Deep neural networks with applications from computer vision to medical diagnosis1–5 are commonly implemented using clock-based processors6–14, in which computation speed is mainly limited by the clock frequency and the memory access time. In the optical domain, despite advances in photonic computation15–17, the lack of scalable on-chip optical non-linearity and the loss of photonic devices limit the scalability of optical deep networks. Here we report an integrated end-to-end photonic deep neural network (PDNN) that performs sub-nanosecond image classification through direct processing of the optical waves impinging on the on-chip pixel array as they propagate through layers of neurons. In each neuron, linear computation is performed optically and the non-linear activation function is realized opto-electronically, allowing a classification time of under 570 ps, which is comparable with a single clock cycle of state-of-the-art digital platforms. A uniformly distributed supply light provides the same per-neuron optical output range, allowing scalability to large-scale PDNNs. Two-class and four-class classification of handwritten letters with accuracies higher than 93.8% and 89.8%, respectively, is demonstrated. Direct, clock-less processing of optical data eliminates analogue-to-digital conversion and the requirement for a large memory module, allowing faster and more energy efficient neural networks for the next generations of deep learning systems.

Date: 2022
References: Add references at CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://www.nature.com/articles/s41586-022-04714-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:nature:v:606:y:2022:i:7914:d:10.1038_s41586-022-04714-0

Ordering information: This journal article can be ordered from
https://www.nature.com/

DOI: 10.1038/s41586-022-04714-0

Access Statistics for this article

Nature is currently edited by Magdalena Skipper

More articles in Nature from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().