Tensorized Optical Multimodal Fusion Network

Yequan Zhao; Xian Xiao; Geza Kurczveil; Raymond G. Beausoleil; Zheng Zhang

doi:10.1364/CLEO_SI.2023.SF3E.3

CLEO 2023
Technical Digest Series (Optica Publishing Group, 2023),
paper SF3E.3
•https://doi.org/10.1364/CLEO_SI.2023.SF3E.3

Tensorized Optical Multimodal Fusion Network

Yequan Zhao, Xian Xiao, Geza Kurczveil, Raymond G. Beausoleil, and Zheng Zhang

CLEO: Science and Innovations 2023

San Jose, CA United States
7–12 May 2023
ISBN: 978-1-957171-25-8

From the session
Novel Applications in Integrated Photonics (SF3E)

Not Accessible

Your library or personal account may give you access

Get PDF
Email
Share
Get Citation
Copy Citation Text
Y. Zhao, X. Xiao, G. Kurczveil, R. G. Beausoleil, and Z. Zhang, "Tensorized Optical Multimodal Fusion Network," in CLEO 2023, Technical Digest Series (Optica Publishing Group, 2023), paper SF3E.3.

Export Citation
- BibTex
- Endnote (RIS)
- HTML
- Plain Text
Citation alert
Save article

Abstract

We propose the first tensorized optical multimodal fusion network architecture with a self-attention mechanism and low-rank tensor fusion. Simulation results show 51.3× less hardware requirement and 3.7× 10¹³ MAC/J energy efficiency.

PDF Article

More Like This

Wavelength-Parallel Photonic Tensor Core Based on Multi-FSR Microring Resonator Crossbar Array

Xian Xiao, Stanley Cheung, Sean Hooten, Yiwei Peng, Bassem Tossoun, Thomas Van Vaerenbergh, Geza Kurczveil, and Raymond G. Beausoleil
W3G.4 Optical Fiber Communication Conference (OFC) 2023

Quantum optics tensor networks in time for the design of nonlinear photonic devices

Quinn M.B Palmer, Jeremy C. Adcock, William J. Munro, and Joshua W. Silverstone
ej_2_4 European Quantum Electronics Conference (EQEC) 2023

Scalable and Compact 3D Tensorized Photonic Neural Networks

Xian Xiao and S. J. Ben Yoo
Tu5H.6 Optical Fiber Communication Conference (OFC) 2021

Previous Article Next Article