IL277607B2 - Optical neural network unit and optical neural network configuration - Google Patents

Optical neural network unit and optical neural network configuration

Info

Publication number
IL277607B2
IL277607B2 IL277607A IL27760720A IL277607B2 IL 277607 B2 IL277607 B2 IL 277607B2 IL 277607 A IL277607 A IL 277607A IL 27760720 A IL27760720 A IL 27760720A IL 277607 B2 IL277607 B2 IL 277607B2
Authority
IL
Israel
Prior art keywords
light
artificial neuron
input
unit
output
Prior art date
Application number
IL277607A
Other languages
English (en)
Hebrew (he)
Other versions
IL277607A (en
IL277607B1 (en
Original Assignee
Univ Bar Ilan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Bar Ilan filed Critical Univ Bar Ilan
Publication of IL277607A publication Critical patent/IL277607A/en
Publication of IL277607B1 publication Critical patent/IL277607B1/en
Publication of IL277607B2 publication Critical patent/IL277607B2/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/067—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using optical means
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/35—Non-linear optics
    • G02F1/353—Frequency conversion, i.e. wherein a light beam is generated with frequency components different from those of the incident light beams
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0499—Feedforward networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/067—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using optical means
    • G06N3/0675—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using optical means using electro-optical, acousto-optical or opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/88—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters
    • G06V10/89—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters using frequency domain filters, e.g. Fourier masks implemented on spatial light modulators
    • G06V10/893—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters using frequency domain filters, e.g. Fourier masks implemented on spatial light modulators characterised by the kind of filter
    • G06V10/898—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters using frequency domain filters, e.g. Fourier masks implemented on spatial light modulators characterised by the kind of filter combination of filters, e.g. phase-only filters
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/18—Extraction of features or characteristics of the image
    • G06V30/1801—Detecting partial patterns, e.g. edges or contours, or configurations, e.g. loops, corners, strokes or intersections
    • G06V30/18019—Detecting partial patterns, e.g. edges or contours, or configurations, e.g. loops, corners, strokes or intersections by matching or filtering
    • G06V30/18038—Biologically-inspired filters, e.g. difference of Gaussians [DoG], Gabor filters
    • G06V30/18048—Biologically-inspired filters, e.g. difference of Gaussians [DoG], Gabor filters with interaction between the responses of different filters, e.g. cortical complex cells
    • G06V30/18057—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/18—Extraction of features or characteristics of the image
    • G06V30/18105—Extraction of features or characteristics of the image related to colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/199—Arrangements for recognition using optical reference masks, e.g. holographic masks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Multimedia (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Nonlinear Science (AREA)
  • Neurology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Optics & Photonics (AREA)
  • Optical Modulation, Optical Deflection, Nonlinear Optics, Optical Demodulation, Optical Logic Elements (AREA)
  • Optical Communication System (AREA)
IL277607A 2018-03-27 2019-03-26 Optical neural network unit and optical neural network configuration IL277607B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862648538P 2018-03-27 2018-03-27
PCT/IL2019/050345 WO2019186548A1 (en) 2018-03-27 2019-03-26 Optical neural network unit and optical neural network configuration

Publications (3)

Publication Number Publication Date
IL277607A IL277607A (en) 2020-11-30
IL277607B1 IL277607B1 (en) 2025-04-01
IL277607B2 true IL277607B2 (en) 2025-08-01

Family

ID=68058119

Family Applications (1)

Application Number Title Priority Date Filing Date
IL277607A IL277607B2 (en) 2018-03-27 2019-03-26 Optical neural network unit and optical neural network configuration

Country Status (6)

Country Link
US (1) US12061978B2 (enExample)
EP (1) EP3776373A4 (enExample)
JP (1) JP7426099B2 (enExample)
CN (1) CN112041857B (enExample)
IL (1) IL277607B2 (enExample)
WO (1) WO2019186548A1 (enExample)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11521055B2 (en) * 2018-04-14 2022-12-06 International Business Machines Corporation Optical synapse
US11321837B2 (en) * 2019-06-12 2022-05-03 University Of Central Florida Research Foundation, Inc. Fiber imaging apparatus, methods, and applications
JP7649559B2 (ja) 2019-10-02 2025-03-21 コグニファイバー リミテッド 人工ニューロンネットワーク
CN110855859B (zh) * 2019-10-16 2021-04-13 中南民族大学 人工光量子视网膜及构建方法
US12007579B2 (en) * 2019-10-30 2024-06-11 Nec Corporation Machine learning based regression of complex coefficients of a linear combination of spatial modes from multimode optical fiber
CN110932809B (zh) * 2019-11-20 2020-10-16 北京邮电大学 光纤信道模型模拟方法、装置、电子设备和存储介质
US12353988B2 (en) * 2020-07-09 2025-07-08 Celestial Ai Inc. Neuromorphic photonics with coherent linear neurons
US11817903B2 (en) 2020-08-06 2023-11-14 Celestial Ai Inc. Coherent photonic computing architectures
DE102020211341A1 (de) 2020-09-09 2022-03-10 Volkswagen Aktiengesellschaft Vorrichtung, System und Verfahren zur Bereitstellung eines künstlichen neuronalen Netzes
DE102020214907A1 (de) 2020-11-27 2022-06-02 Volkswagen Aktiengesellschaft Verfahren zur Bereitstellung eines künstlichen neuronalen Netzes
US12020150B2 (en) * 2020-12-08 2024-06-25 Oxford University Innovation Limited Optical neural network
EP4266092A4 (en) * 2020-12-18 2024-04-17 Fujikura Ltd. OPTICAL CALCULATION SYSTEM
CN114912603B (zh) * 2021-02-08 2025-06-24 清华大学 光人工神经网络增强机器视觉芯片及制备方法
CN114912598B (zh) * 2021-02-08 2025-01-10 清华大学 光人工神经网络智能芯片及制备方法
US12429706B2 (en) 2021-02-18 2025-09-30 Fujikura Ltd. Optical arithmetic device
WO2022176460A1 (ja) * 2021-02-18 2022-08-25 株式会社フジクラ 光演算装置及び光演算方法
CN114967836A (zh) * 2021-02-25 2022-08-30 华为技术有限公司 一种光计算装置、光计算系统以及方法
JP7832658B2 (ja) 2021-03-15 2026-03-18 コグニファイバー リミテッド 光量子論理ゲート
IL291772B2 (en) 2021-03-31 2025-11-01 Cognifiber Ltd Ultra-wide data band optical processor
CN113177074B (zh) * 2021-04-02 2023-09-29 北京科技大学 一种提升环境自适应性的光学性能监测系统及方法
US12339490B2 (en) 2021-06-18 2025-06-24 Celestial Ai Inc. Clock signal distribution using photonic fabric
US12564047B2 (en) 2022-10-28 2026-02-24 Celestial Ai Inc. Thermal control of an optical component
KR102881284B1 (ko) * 2021-07-07 2025-11-05 삼성전자주식회사 뉴런 모듈 회로 장치 및 그 동작 방법
US12216749B2 (en) 2021-08-04 2025-02-04 Q (Cue) Ltd. Using facial skin micromovements to identify a user
CN118235174A (zh) 2021-08-04 2024-06-21 库伊有限公司 无声语音检测
CN114037069B (zh) * 2021-11-18 2024-04-05 中国科学院长春光学精密机械与物理研究所 基于衍射光学的神经网络计算单元
CN114255387B (zh) * 2021-12-28 2024-05-14 山东捷讯通信技术有限公司 一种全光非线性卷积神经网络的图像识别方法
US12436346B2 (en) 2022-03-18 2025-10-07 Celestial Ai Inc. Optically bridged multicomponent package with extended temperature range
US20250189811A1 (en) * 2022-03-24 2025-06-12 The Regents Of The University Of California All-optical implementation of multiple optical transformations through a polarization-encoded diffractive network
CN117114066A (zh) * 2022-05-11 2023-11-24 华为技术有限公司 一种光计算拓扑结构、系统以及系统的调控方法
US20250317658A1 (en) * 2022-05-24 2025-10-09 The Regents Of The University Of California Class-specific diffractive camera with all-optical erasure of undesired objects
WO2023248218A1 (en) * 2022-06-21 2023-12-28 Cognifiber Ltd. Fiber based processing system
IL318490A (en) 2022-07-20 2025-03-01 Q Cue Ltd Identifying and using facial micro-movements
US20240038657A1 (en) 2022-07-26 2024-02-01 Celestial Ai Inc. Via formed using a partial plug that extends into a substrate
US12690438B2 (en) 2022-07-26 2026-07-21 Celestial Ai Inc. Via formed in a wafer using a front-side and a back-side process
CN115631384A (zh) * 2022-11-11 2023-01-20 重庆邮电大学 一种多模光纤模群检测分类方法、系统、终端及介质
CN115933409B (zh) * 2023-01-06 2023-05-05 青岛哈尔滨工程大学创新发展中心 一种基于多物理场弱耦合的自适应调整时间步长的方法
WO2024206841A1 (en) * 2023-03-31 2024-10-03 President And Fellows Of Harvard College Systems and methods for differentiable optical processors
CN116957031B (zh) * 2023-07-24 2024-05-24 浙江大学 一种基于光学多神经元激活函数模块的光电计算机
CN118506159A (zh) * 2024-06-04 2024-08-16 南开大学 基于多模光纤模空间神经网络的全光目标回波编码器
KR102971756B1 (ko) 2024-12-30 2026-06-01 한양대학교 산학협력단 광학적 인코딩 및 디코딩 시스템 및 방법
CN121413684B (zh) * 2025-12-26 2026-07-31 之江实验室 非线性光学神经网络系统及非线性光学计算方法

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5129041A (en) * 1990-06-08 1992-07-07 Grumman Aerospace Corporation Optical neural network processing element with multiple holographic element interconnects

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03167614A (ja) * 1989-11-28 1991-07-19 Nippon Telegr & Teleph Corp <Ntt> 光ニューラルコンピュータ
US6529614B1 (en) * 1998-08-05 2003-03-04 California Institute Of Technology Advanced miniature processing handware for ATR applications
US6819469B1 (en) * 2003-05-05 2004-11-16 Igor M. Koba High-resolution spatial light modulator for 3-dimensional holographic display
CN101835064A (zh) * 2009-03-10 2010-09-15 中国电信股份有限公司 单模多模光纤混合以太网无源光网络系统
US8320769B2 (en) * 2009-06-26 2012-11-27 Alcatel Lucent Transverse-mode multiplexing for optical communication systems
EP2823580B1 (en) * 2012-03-08 2019-06-19 Alcatel Lucent Multi-mode optical communication with mode mixtures
WO2015136572A1 (ja) * 2014-03-13 2015-09-17 日本電気株式会社 空間光受信装置および空間光受信方法
US9971965B2 (en) * 2015-03-18 2018-05-15 International Business Machines Corporation Implementing a neural network algorithm on a neurosynaptic substrate based on metadata associated with the neural network algorithm
CN105046325B (zh) 2015-07-06 2017-12-15 电子科技大学 一种基于类mos发光器件模拟生物神经网络的电路
WO2017033197A1 (en) 2015-08-27 2017-03-02 Bar-Ilan University Multi optically-coupled channels module and related methods of computation
US10268232B2 (en) 2016-06-02 2019-04-23 Massachusetts Institute Of Technology Apparatus and methods for optical neural network

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5129041A (en) * 1990-06-08 1992-07-07 Grumman Aerospace Corporation Optical neural network processing element with multiple holographic element interconnects

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
OPTICAL NEURAL NETWORK, ROGHAYEH, SAEIDI, 17 May 2017 (2017-05-17) *

Also Published As

Publication number Publication date
US20210027154A1 (en) 2021-01-28
EP3776373A1 (en) 2021-02-17
US12061978B2 (en) 2024-08-13
CN112041857A (zh) 2020-12-04
JP7426099B2 (ja) 2024-02-01
EP3776373A4 (en) 2022-01-05
CN112041857B (zh) 2024-10-29
JP2021524952A (ja) 2021-09-16
IL277607A (en) 2020-11-30
WO2019186548A1 (en) 2019-10-03
IL277607B1 (en) 2025-04-01

Similar Documents

Publication Publication Date Title
US12061978B2 (en) Optical neural network unit and optical neural network configuration
US12443838B2 (en) Diffractive deep neural networks with differential and class-specific detection
US11598956B2 (en) Eyeball tracking system and eyeball tracking method
CN110178069B (zh) 显微镜设备、方法和系统
Shabairou et al. Color image identification and reconstruction using artificial neural networks on multimode fiber images: Towards an all-optical design
EP3654824B1 (en) Enhancing imaging by multicore fiber endoscopes
CN114503000B (zh) 光学神经元单元及其网络
WO2021147825A1 (zh) 一种集成瞳孔追踪功能的全息智能显示装置及实现方法
Būtaitė et al. How to build the “optical inverse” of a multimode fibre
US20250389943A1 (en) Method and device for achieving super-resolution microscopic imaging by super-oscillatory diffractive neural network
US12013599B2 (en) Diffractive deep neural network (D2NN) processing using a single modulation layer
WO2022136146A1 (en) Optical computing and reconfiguring with spatiotemporal nonlinearities in waveguides
US20230233057A1 (en) Visual data transfer between the end and side of a multimode fiber
Luan et al. Large-scale, high-parallelism optical tensor processor
Yue et al. Imaging through a multimode optical fiber with principal component analysis and a variational autoencoder
CN118210144A (zh) 一种提升多模光纤成像鲁棒性的方法
CN120200678A (zh) 一种多模方形芯光纤成像系统
CN115790847A (zh) 一种彩色、多光谱或高光谱关联成像方法
Ortín González et al. Optical dendrites for spatio-temporal computing with few-mode fibers
CN120068967A (zh) 一种基于光纤中微结构阵列的全光衍射神经网络
Morisset et al. Multimode fiber-based high-power laser distribution using DLP technology