Abstract

The parallelism of optics and the miniaturization of optical components using nanophotonic structures, such as metasurfaces, present a compelling alternative to electronic implementations of convolutional neural networks. The lack of a low-power optical nonlinearity, however, requires slow and energy-inefficient conversions between the electronic and optical domains. Here, we design an architecture that utilizes a single electrical to optical conversion by designing a free-space optical frontend unit that implements the linear operations of the first layer with the subsequent layers realized electronically. Speed and power analysis of the architecture indicates that the hybrid photonic–electronic architecture outperforms a fully electronic architecture for large image sizes and kernels. Benchmarking of the photonic–electronic architecture on a modified version of AlexNet achieves high classification accuracies on images from the Kaggle’s Cats and Dogs challenge and MNIST databases.

© 2019 Optical Society of America

Knowledge distillation circumvents nonlinearity for optical convolutional neural networks

Jinlin Xiang, Shane Colburn, Arka Majumdar, and Eli Shlizerman
Appl. Opt. 61(9) 2173-2183 (2022)

Optronic convolutional neural networks of multi-layers with different functions executed in optics for image classification

Ziyu Gu, Yesheng Gao, and Xingzhao Liu
Opt. Express 29(4) 5877-5889 (2021)

Training optronic convolutional neural networks on an optical system through backpropagation algorithms

Ziyu Gu, Zicheng Huang, Yesheng Gao, and Xingzhao Liu
Opt. Express 30(11) 19416-19440 (2022)

Optical convolutional neural network with atomic nonlinearity

Mingwei Yang, Elizabeth Robertson, Luisa Esguerra, Kurt Busch, and Janik Wolters
Opt. Express 31(10) 16451-16459 (2023)

High-accuracy optical convolution unit architecture for convolutional neural networks by cascaded acousto-optical modulator arrays

Shaofu Xu, Jing Wang, Rui Wang, Jiangping Chen, and Weiwen Zou
Opt. Express 27(14) 19778-19787 (2019)