CN114638349A - Photosensitive neuron, sensor-memory-computing integrated intelligent perception device, method and medium - Google Patents

Photosensitive neuron, sensor-memory-computing integrated intelligent perception device, method and medium Download PDF

Info

Publication number
CN114638349A
CN114638349A CN202210099896.8A CN202210099896A CN114638349A CN 114638349 A CN114638349 A CN 114638349A CN 202210099896 A CN202210099896 A CN 202210099896A CN 114638349 A CN114638349 A CN 114638349A
Authority
CN
China
Prior art keywords
photosensitive
neuron
memory
current
avalanche
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210099896.8A
Other languages
Chinese (zh)
Other versions
CN114638349B (en
Inventor
郑纪元
汪莱
罗毅
吴嘉敏
戴琼海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN202210099896.8A priority Critical patent/CN114638349B/en
Publication of CN114638349A publication Critical patent/CN114638349A/en
Application granted granted Critical
Publication of CN114638349B publication Critical patent/CN114638349B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/061Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using biological neurons, e.g. biological neurons connected to an integrated circuit
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Theoretical Computer Science (AREA)
  • Molecular Biology (AREA)
  • Neurology (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Semiconductor Memories (AREA)

Abstract

本申请涉及半导体技术领域,特别涉及一种光敏神经元、感存算一体化智能感知装置、方法及介质,其中,光敏神经元包括:雪崩探测器,用于在光子入射时,基于光致雪崩效应,输出电压脉冲;与所述雪崩探测器串联的自适应阻变存储器,用于在所述电压脉冲的驱动下,导电离子漂移到导电沟道形成沉积,以感知任一信号光的光场信号,和/或经过训练后,产生最大幅值的电流脉冲。由此,解决了相关技术中感存算一体化架构像素密度低的问题,大大提高光敏神经元网络像素密度,且尺寸小、功耗低和速度快。

Figure 202210099896

The present application relates to the field of semiconductor technology, and in particular to a photosensitive neuron, a sensor-memory-computing integrated intelligent sensing device, method, and medium, wherein the photosensitive neuron includes: an avalanche detector, which is used for photon-induced avalanche detection when photons are incident. effect, output voltage pulse; the adaptive resistive memory connected in series with the avalanche detector is used to drive the conductive ions to the conductive channel to form deposition under the driving of the voltage pulse, so as to sense the light field of any signal light signal, and/or after training, to produce current pulses of maximum magnitude. Therefore, the problem of low pixel density of the sensor-memory-computing integrated architecture in the related art is solved, the pixel density of the photosensitive neuron network is greatly improved, and the size is small, the power consumption is low, and the speed is fast.

Figure 202210099896

Description

光敏神经元、感存算一体化智能感知装置、方法及介质Photosensitive neuron, sensor-memory-computing integrated intelligent perception device, method and medium

技术领域technical field

本申请涉及半导体技术领域,特别涉及一种光敏神经元、感存算一体化智能感知装置、方法及介质。The present application relates to the field of semiconductor technology, and in particular, to a photosensitive neuron, a sensor-memory-computing integrated intelligent sensing device, a method, and a medium.

背景技术Background technique

目前,已有感存算一体化架构包括CMOS(Complementary Metal OxideSemiconductor,互补金属氧化物半导体))架构和阻变调控网络架构两大类。At present, existing sensor-memory-computing integrated architectures include two categories: CMOS (Complementary Metal Oxide Semiconductor) architecture and resistive-variable control network architecture.

其中,CMOS架构的特点可以如图1所示,传感器(Sensor)和模拟信号处理器(PE)串联然后并联。Sensor将光信号转换成电信号,传给PE,PE按照一定的时序和指令对光电信号进行模拟计算,PE一般与相邻的PE交互数据,形成相邻区域信号高度关联性计算,其可以完成卷积,滤波等常规图像处理任务。由于具有时序操作能力,计算处理灵活。阻变调控网络架构的特点可以如图2所示,探测器与神经突触器件(如忆阻器、多级开关等)进行组合,探测器负责传感,神经突触器件负责存储和计算,从而实现传感与存储、计算的一体化功能融合。在该架构中,有时神经突触器件有光敏特性,可以同时充当传感器。神经突触器件事先训练好(电学训练)以确定感光单元的响应度R,每个感光单元的输出电流等于入射光强S与响应度R之间的乘积。通过像素之间的连线组合,将相距一定距离的不相邻像素的输出电流结果按照基尔霍夫定律叠加,完成神经元的加权求和功能(如S1-Sm通过加权求和映射到I1的过程)。另一方面,相邻像素对光场同一位置进行采样,可以近似认为光强一致。它们通过上述神经元加权求和的作用将光强映射到不同通路的输出电流上(如S1通过加权求和映射到I1-Im的过程)。在这种方法中,神经突触器件的尺寸往往小于探测器尺寸,不影响空间探测效率。Among them, the characteristics of the CMOS architecture can be shown in Figure 1, the sensor (Sensor) and the analog signal processor (PE) are connected in series and then in parallel. The Sensor converts the optical signal into an electrical signal and transmits it to the PE. The PE performs the analog calculation on the photoelectric signal according to a certain timing sequence and instructions. The PE generally exchanges data with the adjacent PE to form a highly correlated calculation of the signals in the adjacent area, which can be completed General image processing tasks such as convolution, filtering, etc. Due to the capability of sequential operation, the calculation processing is flexible. The characteristics of the resistive control network architecture can be shown in Figure 2. The detector is combined with neural synaptic devices (such as memristors, multi-level switches, etc.), the detector is responsible for sensing, and the neural synaptic device is responsible for storage and computing. So as to realize the integrated function fusion of sensing, storage and computing. In this architecture, sometimes synaptic devices have photosensitive properties that can act as sensors at the same time. The neural synaptic device is pre-trained (electrical training) to determine the responsivity R of the photoreceptor unit, and the output current of each photoreceptor unit is equal to the product of the incident light intensity S and the responsivity R. Through the combination of connections between pixels, the output current results of non-adjacent pixels with a certain distance are superimposed according to Kirchhoff's law, and the weighted summation function of neurons is completed (for example, S 1 -S m is mapped by weighted summation). process to I 1 ). On the other hand, adjacent pixels sample the same position in the light field, and it can be approximately considered that the light intensity is the same. They map light intensity to the output currents of different pathways through the above-mentioned neuron weighted summation (such as the process of S1 mapping to I1 - Im through weighted summation). In this method, the size of the synaptic device is often smaller than the size of the detector, which does not affect the spatial detection efficiency.

然而,对于CMOS架构来说,其主要问题在于需要状态标记区FLAG和寄存器REGISTERS寄存计算所需要的状态和数据,需要模拟运算处理器ALU来按照一定的算法加权计算相邻像素的光电流数据。ALU,FLAG和REGISTERS的硬件相对复杂,面积较大(远超Sensor尺寸),面积超过Sensor的部分无法感光,影响成像像素密度;对于阻变调控网络架构来说,其需要设置一定的周期延拓机制(如图2中虚线框所示为周期延拓最小单元)来增加像素数,从而增加神经网络的宽度。相邻的神经元在算法层面只能被当成一个像素,使得像素密度大幅度下降。另一方面,目前光敏神经元通常由具有光敏功能的忆阻器材料制成,需要较强的光或者特殊波段的光才能触发忆阻效应。However, for the CMOS architecture, the main problem is that the state flag area FLAG and the register REGISTERS need to register the state and data required for the calculation, and the analog arithmetic processor ALU is required to calculate the photocurrent data of adjacent pixels according to a certain algorithm weight. The hardware of ALU, FLAG and REGISTERS is relatively complex, with a large area (far exceeding the Sensor size), and the part exceeding the Sensor area cannot be photosensitive, which affects the imaging pixel density; for the resistive control network architecture, it needs to set a certain period extension Mechanism (as shown by the dashed box in Figure 2 is the minimum unit of periodic extension) to increase the number of pixels, thereby increasing the width of the neural network. Adjacent neurons can only be regarded as one pixel at the algorithm level, which greatly reduces the pixel density. On the other hand, current photosensitive neurons are usually made of memristor materials with photosensitive functions, which require stronger light or light in a special wavelength band to trigger the memristive effect.

发明内容SUMMARY OF THE INVENTION

本申请提供一种光敏神经元、感存算一体化智能感知装置、方法及介质,以解决相关技术中感存算一体化架构像素密度低的问题,大大提高光敏神经元网络像素密度,且尺寸小、功耗低和速度快。The present application provides a light-sensitive neuron, a sensor-memory-computing integrated intelligent sensing device, method and medium, to solve the problem of low pixel density of the sensor-memory-computing integrated structure in the related art, greatly improve the photosensitive neuron network pixel density, and the size Small, low power and fast.

本申请第一方面实施例提供一种光敏神经元,包括:The embodiment of the first aspect of the present application provides a photosensitive neuron, including:

雪崩探测器(Single Photon Avalanche Diode,SPAD),用于在光子入射时,基于光致雪崩效应,输出电压脉冲;Avalanche detector (Single Photon Avalanche Diode, SPAD), which is used to output voltage pulses based on the photo-induced avalanche effect when photons are incident;

与所述雪崩探测器串联的自适应阻变存储器(ARS),用于在所述电压脉冲的驱动下,导电离子漂移到导电沟道形成沉积,以感知任一信号光的光场信号,和/或经过训练后,产生最大幅值的电流脉冲。an adaptive resistive memory (ARS) connected in series with the avalanche detector, for driving the voltage pulse, the conductive ions drift to the conductive channel to form a deposition, so as to sense the optical field signal of any signal light, and / or after training, to generate current pulses of maximum amplitude.

可选地,在无光子入射时,所述自适应阻变存储器的导电沟道溶解消散,其中,所述导电沟道的沉积速度大于所述导电沟道的扩散消融速度时,所述适应阻变存储器进入电阻降低模式,所述雪崩探测器进入快速充电模式,恢复至雪崩之前的初始状态。Optionally, when no photon is incident, the conductive channel of the adaptive resistive memory is dissolved and dissipated, wherein when the deposition speed of the conductive channel is greater than the diffusion and ablation speed of the conductive channel, the adaptive resistance The variable memory enters the resistance reduction mode, the avalanche detector enters the fast charging mode, and returns to the initial state before the avalanche.

可选地,所述光敏神经元释放所述电流脉冲后,脉冲峰值为Ipeak=VE/Rmin,其中,VE为过剩电压,Rmin为所述自适应阻变存储器在电阻动态变化过程中的最低值。Optionally, after the photosensitive neuron releases the current pulse, the peak value of the pulse is I peak =V E /R min , where V E is the excess voltage, and R min is the dynamic change in the resistance of the adaptive resistive memory. the lowest value in the process.

可选地,所述最低值由入射光子频率确定。Optionally, the minimum value is determined by the incident photon frequency.

可选地,还包括:Optionally, also include:

引入单元,用于引入电学激励,以基于所述入射光子频率和所述电学激励将所述自适应阻变存储器的实际阻值和所述雪崩探测器的实际电流调整为目标阻值和目标电流,达到神经元的活性条件。an introduction unit for introducing electrical excitation to adjust the actual resistance value of the adaptive resistive memory and the actual current of the avalanche detector to a target resistance value and a target current based on the incident photon frequency and the electrical excitation , to achieve neuronal activity conditions.

本申请第二方面实施例提供一种感存算一体化智能感知装置,包括:The embodiment of the second aspect of the present application provides an intelligent sensing device integrating sensing, storage and computing, including:

光敏神经元阵列,所述光敏神经元阵列包括多个第一方面实施例所述的光敏神经元,以输出电流。A photosensitive neuron array, the photosensitive neuron array includes a plurality of the photosensitive neurons described in the embodiments of the first aspect to output current.

可选地,还包括:Optionally, also include:

训练单元,用于将所述光敏神经元阵列中i行j列的光敏神经元进行训练,以将所述信号光的入射光强转换成电流的敏感系数,执行神经网络的乘加运算。The training unit is used for training the photosensitive neurons in i row and j column in the photosensitive neuron array, so as to convert the incident light intensity of the signal light into a current sensitivity coefficient, and perform the multiplication and addition operation of the neural network.

可选地,所述输出电流的计算公式为:Optionally, the calculation formula of the output current is:

Figure BDA0003491903390000021
Figure BDA0003491903390000021

其中,Sij为光强,Rij为电流的敏感系数,i为行数,j为列数,m为行数最大值,n为列数最大值。Among them, S ij is the light intensity, R ij is the sensitivity coefficient of the current, i is the number of rows, j is the number of columns, m is the maximum number of rows, and n is the maximum number of columns.

本申请第三方面实施例提供一种感存算一体化智能感知方法,采用第二方面实施例所述的感存算一体化智能感知装置,所述方法包括以下步骤:The embodiment of the third aspect of the present application provides an integrated intelligent perception method for sensing, storage and computing, using the integrated intelligent sensing device for sensing storage and computing described in the embodiment of the second aspect, and the method includes the following steps:

在光子入射时,基于光致雪崩效应,输出电压脉冲;When a photon is incident, a voltage pulse is output based on the photo-induced avalanche effect;

在所述电压脉冲的驱动下,导电离子漂移到导电沟道形成沉积,以感知任一信号光的光场信号,和/或经过训练后,产生最大幅值的电流脉冲。Driven by the voltage pulse, the conductive ions drift to the conductive channel to form deposition, so as to sense the light field signal of any signal light, and/or after training, the current pulse with the maximum amplitude is generated.

本申请第四方面实施例提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行,以用于实现如第三方面实施例所述的感存算一体化智能感知方法。Embodiments of the fourth aspect of the present application provide a computer-readable storage medium on which a computer program is stored, and the program is executed by a processor, so as to realize the integrated intellisense of the sensing-memory-computing described in the embodiments of the third aspect method.

由此,本申请实施例具有以下优点:Therefore, the embodiments of the present application have the following advantages:

(1)与相关技术中的阻变调控网络架构不同,本申请实施例的神经网络不需要在相邻区域设置多个光敏神经元来增加神经网络的宽度,神经网络的宽度通过时序调控方式实现的,按照一定时序对光敏神经元进行激励训练,使其权值满足神经网络宽度方向不同节点的需求,通过时间换取空间,大大提高光敏神经元网络像素密度,且尺寸小、功耗低和速度快。(1) Different from the resistive control network architecture in the related art, the neural network of the embodiment of the present application does not need to set multiple photosensitive neurons in adjacent areas to increase the width of the neural network, and the width of the neural network is realized by means of timing control The photosensitive neurons are stimulated and trained according to a certain time sequence, so that their weights meet the needs of different nodes in the width direction of the neural network. By exchanging time for space, the pixel density of the photosensitive neuron network is greatly improved, with small size, low power consumption and speed. quick.

(2)与相关技术中的CMOS架构不同,本申请实施例的神经网络中计算核心ARS的尺寸远小于探测器SPAD尺寸,不存在ALU(arithmetic and logic unit,算术逻辑单元),FLAG(EFLAGS Register,状态标志寄存器)和REGISTERS的硬件结构,不影响成像像素密度。(2) Different from the CMOS architecture in the related art, the size of the computing core ARS in the neural network of the embodiment of the present application is much smaller than the size of the detector SPAD, and there is no ALU (arithmetic and logic unit, arithmetic logic unit), FLAG (EFLAGS Register) , Status Flag Register) and REGISTERS hardware structure, does not affect the imaging pixel density.

本申请附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本申请的实践了解到。Additional aspects and advantages of the present application will be set forth, in part, in the following description, and in part will be apparent from the following description, or learned by practice of the present application.

附图说明Description of drawings

本申请上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present application will become apparent and readily understood from the following description of embodiments taken in conjunction with the accompanying drawings, wherein:

图1为传感器与处理单元串联后并联的阵列架构示意图;FIG. 1 is a schematic diagram of an array structure in which a sensor and a processing unit are connected in series and then connected in parallel;

图2为阻变调控网络架构的示例图;FIG. 2 is an example diagram of a resistive control network architecture;

图3为根据本申请实施例提供的一种光敏神经元的方框图;3 is a block diagram of a photosensitive neuron provided according to an embodiment of the present application;

图4为根据本申请一个实施例的光敏神经元的结构示意图;4 is a schematic structural diagram of a photosensitive neuron according to an embodiment of the present application;

图5为根据本申请一个实施例的光敏神经元的三端口实现方式的示意图;5 is a schematic diagram of a three-port implementation of a photosensitive neuron according to an embodiment of the present application;

图6为根据本申请实施例的感存算一体化智能感知装置的示例图;FIG. 6 is an example diagram of a sensor-memory-computing integrated intelligent perception device according to an embodiment of the present application;

图7为根据本申请一个实施例的感存算一体化智能感知装置的结构示意图;FIG. 7 is a schematic structural diagram of a sensor-memory-computing integrated intelligent perception device according to an embodiment of the present application;

图8为根据本申请实施例的感存算一体化智能感知方法的流程图。FIG. 8 is a flowchart of a method for intelligent sensing with integrated storage and computing according to an embodiment of the present application.

具体实施方式Detailed ways

下面详细描述本申请的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本申请,而不能理解为对本申请的限制。The following describes in detail the embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to be used to explain the present application, but should not be construed as a limitation to the present application.

下面参考附图描述本申请实施例的光敏神经元、感存算一体化智能感知装置、方法及介质。针对上述背景技术中心提到的感存算一体化架构像素密度低的问题,本申请提供了一种光敏神经元,能够原位感知光场信号(比如成像)并对光场信号计算处理,不需要在相邻区域设置多个光敏神经元来增加神经网络的宽度,神经网络的宽度通过时序调控方式实现的,按照一定时序对光敏神经元进行激励训练,使其权值满足神经网络宽度方向不同节点的需求,并通过时间换取空间,大大提高光敏神经元网络像素密度,且尺寸小、功耗低和速度快,解决了相关技术中感存算一体化架构像素密度低的问题。The photosensitive neuron, the sensor-memory-computing integrated intelligent perception device, the method, and the medium of the embodiments of the present application will be described below with reference to the accompanying drawings. In view of the low pixel density of the sensor-memory-computing integrated architecture mentioned by the above-mentioned background technology center, the present application provides a photosensitive neuron, which can perceive light field signals (such as imaging) in situ and calculate and process the light field signals without It is necessary to set up multiple photosensitive neurons in adjacent areas to increase the width of the neural network. The width of the neural network is realized by timing regulation. The photosensitive neurons are stimulated and trained according to a certain timing sequence, so that their weights meet the different width directions of the neural network. It can greatly improve the pixel density of the photosensitive neuron network, and has small size, low power consumption and fast speed, which solves the problem of low pixel density of the sensor-memory-computing integrated architecture in related technologies.

具体而言,图3为本申请实施例所提供的一种光敏神经元的示意图。Specifically, FIG. 3 is a schematic diagram of a photosensitive neuron provided by an embodiment of the present application.

如图3所示,该光敏神经元10包括:雪崩探测器100和自适应阻变存储器200。As shown in FIG. 3 , the photosensitive neuron 10 includes: an avalanche detector 100 and an adaptive resistive memory 200 .

其中,雪崩探测器100用于在光子入射时,基于光致雪崩效应,输出电压脉冲;自适应阻变存储器200与雪崩探测器100串联,用于在电压脉冲的驱动下,导电离子漂移到导电沟道形成沉积,以感知任一信号光的光场信号,和/或经过训练后,产生最大幅值的电流脉冲。Among them, the avalanche detector 100 is used to output voltage pulses based on the photo-induced avalanche effect when photons are incident; the adaptive resistive memory 200 is connected in series with the avalanche detector 100, and is used for driving the conductive ions to drift to conductive ions under the driving of the voltage pulse. The channels are deposited to sense the light field signal of either signal light, and/or after training, to generate current pulses of maximum magnitude.

具体而言,如图4所示,当有光子入射时,雪崩探测器100中发生光致雪崩效应,输出电压脉冲,驱动自适应阻变存储器200中导电离子漂移到导电沟道形成沉积,从而可以感知任一信号光的光场信号,或者经过训练后,产生最大幅值的电流脉冲。需要说明的是,雪崩探测器100可以是单光子探测器,具有易集成、高灵敏的优点。Specifically, as shown in FIG. 4 , when photons are incident, a photo-induced avalanche effect occurs in the avalanche detector 100, and a voltage pulse is output to drive the conductive ions in the adaptive resistive memory 200 to drift to the conductive channel to form deposition, thereby forming deposition. The light field signal of any signal light can be sensed, or after training, the current pulse with the maximum amplitude can be generated. It should be noted that the avalanche detector 100 may be a single photon detector, which has the advantages of easy integration and high sensitivity.

可选地,在一些实施例中,在无光子入射时,自适应阻变存储器200的导电沟道溶解消散,其中,导电沟道的沉积速度大于导电沟道的扩散消融速度时,适应阻变存储器进入电阻降低模式,雪崩探测器进入快速充电模式,恢复至雪崩之前的初始状态。Optionally, in some embodiments, when no photons are incident, the conductive channel of the adaptive resistive memory 200 dissolves and dissipates, wherein when the deposition speed of the conductive channel is greater than the diffusion and ablation speed of the conductive channel, the adaptive resistance change The memory goes into resistance reduction mode and the avalanche detector goes into fast charge mode, returning to its initial state before the avalanche.

具体而言,当没有光子入射时,电压主要落在雪崩探测器100两端,自适应阻变存储器200中的导电沟道不断溶解消散,沟道沉积速度大于扩散消融速度,自适应阻变存储器200电阻迅速降低,雪崩探测器100快速充电,恢复雪崩之前的状态。Specifically, when no photons are incident, the voltage mainly falls on both ends of the avalanche detector 100, the conductive channel in the adaptive resistive memory 200 is continuously dissolved and dissipated, the channel deposition speed is greater than the diffusion and ablation speed, and the adaptive resistive memory 200 is continuously dissolved and dissipated. The resistance of 200 drops rapidly, and the avalanche detector 100 charges quickly, restoring the state before the avalanche.

可选地,在一些实施例中,光敏神经元释放电流脉冲后,脉冲峰值为Ipeak=VE/Rmin,其中,VE为过剩电压,Rmin为自适应阻变存储器在电阻动态变化过程中的最低值。Optionally, in some embodiments, after the photosensitive neuron releases the current pulse, the peak value of the pulse is I peak = VE /R min , where VE is the excess voltage, and R min is the dynamic change of the resistance of the adaptive resistive memory. the lowest value in the process.

可选地,在一些实施例中,最低值由入射光子频率确定。Optionally, in some embodiments, the minimum value is determined by the incident photon frequency.

具体而言,光敏神经元10可以释放一个电流脉冲,脉冲峰值Ipeak=VE/Rmin,VE为过剩电压(恒定值),Rmin为自适应阻变存储器200的电阻动态变化过程中的最低值。需要说明的是,Rmin值是每次雪崩过程中自适应阻变存储器200的电阻动态最低值,本质上取决于导电沟道沉积和消融的动态平衡结果。Specifically, the photosensitive neuron 10 can release a current pulse, the pulse peak value I peak =V E /R min , V E is the excess voltage (constant value), and R min is the dynamic change process of the resistance of the adaptive resistive memory 200 the lowest value. It should be noted that the value of R min is the dynamic minimum value of the resistance of the adaptive resistive memory 200 in each avalanche process, and essentially depends on the dynamic balance result of the deposition and ablation of the conductive channel.

可选地,在一些实施例中,还包括:引入单元,用于引入电学激励,以基于入射光子频率和电学激励将自适应阻变存储器的实际阻值和雪崩探测器的实际电流调整为目标阻值和目标电流,达到神经元的活性条件。Optionally, in some embodiments, it further includes: an introducing unit for introducing electrical excitation, so as to adjust the actual resistance value of the adaptive resistive memory and the actual current of the avalanche detector as a target based on the incident photon frequency and the electrical excitation resistance and target current to achieve neuronal activity conditions.

应当理解的是,本申请实施例可以可以通过入射光子频率来调节,当光子频率大的时候,雪崩发生间隔更短,导电沟道的沉积时间与消融时间之比上升,自适应阻变存储器200的导电沟道更宽,Rmin更低。反之,当入射光子频率小的时候,雪崩发生间隔更长,导电沟道的沉积时间与消融时间之比下降,自适应阻变存储器200的导电沟道更窄,Rmin更大。因此,用高亮度的光激励光敏神经元的时候,自适应阻变存储器200的导电活性高,电阻小;用低亮度的光激励光敏神经元的时候,自适应阻变存储器200的导电活性低,电阻大。本申请实施例可以通过此方法训练神经元的活性。It should be understood that the embodiment of the present application can be adjusted by the incident photon frequency. When the photon frequency is high, the avalanche occurrence interval is shorter, and the ratio of the deposition time to the ablation time of the conductive channel increases, and the adaptive resistive memory 200 The conduction channel is wider and the R min is lower. On the contrary, when the incident photon frequency is small, the avalanche interval is longer, the ratio of the deposition time to the ablation time of the conductive channel decreases, the conductive channel of the adaptive resistive memory 200 is narrower, and the R min is larger. Therefore, when the photosensitive neurons are excited by high-brightness light, the conductive activity of the adaptive resistive memory 200 is high and the resistance is small; when the photosensitive neurons are excited by low-brightness light, the conductive activity of the adaptive resistive memory 200 is low. , the resistance is large. The embodiments of the present application can use this method to train the activity of neurons.

由此,光敏神经元10可以存储照射于其上的光场信息,当信号光照射在已经被训练的光敏神经元10上时,光敏神经元10将产生一个最大幅值为VE/Rmin的电流脉冲。因此,光敏神经元是感存算一体的。Therefore, the photosensitive neuron 10 can store the light field information irradiated on it. When the signal light is irradiated on the trained photosensitive neuron 10, the photosensitive neuron 10 will generate a maximum amplitude value of V E /R min current pulse. Therefore, light-sensitive neurons are sensory-memory-integrated.

此外,上述图4所示的雪崩探测器100和自适应阻变存储器200串联的光敏神经元是二端口器件,自适应阻变存储器200的阻值以及雪崩脉冲电流的大小由入射光子频率动态调整。然而,自适应阻变存储器200的阻值还可以通过电学方法调控,如图5所示,从雪崩探测器100和自适应阻变存储器200中间引出第三个端口C,引入电学激励(比如脉冲驱动或直流驱动)改变自适应阻变存储器200的阻值。In addition, the photosensitive neuron connected in series with the avalanche detector 100 and the adaptive resistive memory 200 shown in FIG. 4 is a two-port device, and the resistance of the adaptive resistive memory 200 and the magnitude of the avalanche pulse current are dynamically adjusted by the frequency of incident photons . However, the resistance value of the adaptive resistive memory 200 can also be controlled by an electrical method. As shown in FIG. 5 , a third port C is drawn from the middle of the avalanche detector 100 and the adaptive resistive memory 200 to introduce electrical excitation (such as pulses). drive or DC drive) to change the resistance value of the adaptive resistive memory 200 .

根据本申请实施例提出的光敏神经元,能够原位感知光场信号(比如成像)并对光场信号计算处理,不需要在相邻区域设置多个光敏神经元来增加神经网络的宽度,神经网络的宽度通过时序调控方式实现的,按照一定时序对光敏神经元进行激励训练,使其权值满足神经网络宽度方向不同节点的需求,并通过时间换取空间,大大提高光敏神经元网络像素密度,且尺寸小、功耗低和速度快,解决了相关技术中感存算一体化架构像素密度低的问题。According to the photosensitive neurons proposed in the embodiments of the present application, the light field signal (such as imaging) can be sensed in situ and the light field signal can be calculated and processed, and there is no need to set multiple photosensitive neurons in adjacent areas to increase the width of the neural network. The width of the network is realized by timing regulation. The photosensitive neurons are stimulated and trained according to a certain time sequence, so that their weights meet the needs of different nodes in the width direction of the neural network, and time is exchanged for space, which greatly improves the pixel density of the photosensitive neuron network. And the small size, low power consumption and high speed solve the problem of low pixel density of the sensor-memory-computing integrated architecture in related technologies.

其次参照附图描述根据本申请实施例提出的感存算一体化智能感知装置装置。Next, referring to the accompanying drawings, the intelligent sensing device device provided according to the embodiments of the present application will be described.

图6是本申请实施例的感存算一体化智能感知装置的方框示意图。FIG. 6 is a schematic block diagram of an intelligent sensing device integrating sensing, storage and computing according to an embodiment of the present application.

如图6所示,该感存算一体化智能感知装置20包括:光敏神经元阵列21。As shown in FIG. 6 , the sensor-memory-computing integrated intelligent perception device 20 includes: a photosensitive neuron array 21 .

其中,光敏神经元阵列21包括多个如图3实施例的光敏神经元,以输出电流。Wherein, the photosensitive neuron array 21 includes a plurality of photosensitive neurons as shown in the embodiment of FIG. 3 to output current.

可选地,在一些实施例中,本申请实施例的感存算一体化智能感知装置20,还包括:训练单元。其中,训练单元用于将光敏神经元阵列中i行j列的光敏神经元进行训练,以将信号光的入射光强转换成电流的敏感系数,执行神经网络的乘加运算。Optionally, in some embodiments, the sensor-memory-computing-integrated intelligent perception device 20 of the embodiments of the present application further includes: a training unit. The training unit is used to train the photosensitive neurons in the i row and j columns in the photosensitive neuron array to convert the incident light intensity of the signal light into the sensitivity coefficient of the current, and perform the multiplication and addition operation of the neural network.

具体而言,如图7所示,本申请实施例可以将光敏神经元组成一个阵列,阵列中每一个像素点(i行j列)都由图4所示光敏神经元组成。通过训练,使得i行j列的光敏神经元将入射光强转换成电流的敏感系数设定为Rij,这样,当入射到i行j列的神经元的光强为Sij时,网络输出电流为:Specifically, as shown in FIG. 7 , in this embodiment of the present application, photosensitive neurons can be formed into an array, and each pixel point (i row and j column) in the array is composed of the photosensitive neurons shown in FIG. 4 . Through training, the photosensitive neuron in row i row j column sets the sensitivity coefficient of the incident light intensity into electric current as R ij . In this way, when the light intensity incident on the neuron in row i row j column is S ij , the network outputs The current is:

Figure BDA0003491903390000061
Figure BDA0003491903390000061

其中,Sij为光强,Rij为电流的敏感系数,i为行数,j为列数,m为行数最大值,n为列数最大值。Among them, S ij is the light intensity, R ij is the sensitivity coefficient of the current, i is the number of rows, j is the number of columns, m is the maximum number of rows, and n is the maximum number of columns.

由此,即完成了神经网络的乘加运算。Thus, the multiplication and addition operation of the neural network is completed.

需要说明的是,前述对光敏神经元实施例的解释说明也适用于该实施例的感存算一体化智能感知装置,此处不再赘述。It should be noted that, the foregoing explanations of the embodiment of the photosensitive neuron are also applicable to the intelligent sensing device integrated with sensing, storage and computing in this embodiment, which will not be repeated here.

根据本申请实施例提出的感存算一体化智能感知装置,不需要在相邻区域设置多个光敏神经元来增加神经网络的宽度,神经网络的宽度通过时序调控方式实现的,按照一定时序对光敏神经元进行激励训练,使其权值满足神经网络宽度方向不同节点的需求,并通过时间换取空间,大大提高光敏神经元网络像素密度,且尺寸小、功耗低和速度快,解决了相关技术中感存算一体化架构像素密度低的问题。According to the intelligent sensing device integrating sensing, storage and computing proposed in the embodiment of the present application, it is not necessary to set up multiple photosensitive neurons in adjacent areas to increase the width of the neural network. The photosensitive neurons are stimulated and trained to make their weights meet the needs of different nodes in the width direction of the neural network, and the time is exchanged for space, which greatly improves the pixel density of the photosensitive neuron network, and has small size, low power consumption and fast speed. The problem of low pixel density in the integrated architecture of sensing, storage and computing in technology.

图8是本申请实施例的感存算一体化智能感知方法的流程图。FIG. 8 is a flowchart of a method for intelligent perception integrating sensing, storage and computing according to an embodiment of the present application.

如图8所示,该感存算一体化智能感知方法采用图5实施例的感存算一体化智能感知装置,方法包括以下步骤:As shown in FIG. 8 , the integrated sensing-memory-computing intelligent sensing method adopts the sensing-memory-computing integrated intelligent sensing device in the embodiment of FIG. 5 , and the method includes the following steps:

S801,在光子入射时,基于光致雪崩效应,输出电压脉冲。S801, when photons are incident, a voltage pulse is output based on the photo-induced avalanche effect.

S802,在电压脉冲的驱动下,导电离子漂移到导电沟道形成沉积,以感知任一信号光的光场信号,和/或经过训练后,产生最大幅值的电流脉冲。S802 , under the driving of the voltage pulse, the conductive ions drift to the conductive channel to form deposition, so as to sense the light field signal of any signal light, and/or after training, the current pulse with the maximum amplitude is generated.

需要说明的是,前述对感存算一体化智能感知装置实施例的解释说明也适用于该实施例的感存算一体化智能感知方法,此处不再赘述。It should be noted that the foregoing explanations on the embodiment of the integrated sensing-memory-computing intelligent sensing device are also applicable to the sensing-memory-computing integrated intelligent sensing method of this embodiment, and details are not repeated here.

根据本申请实施例提出的感存算一体化智能感知方法,不需要在相邻区域设置多个光敏神经元来增加神经网络的宽度,神经网络的宽度通过时序调控方式实现的,按照一定时序对光敏神经元进行激励训练,使其权值满足神经网络宽度方向不同节点的需求,并通过时间换取空间,大大提高光敏神经元网络像素密度,且尺寸小、功耗低和速度快,解决了相关技术中感存算一体化架构像素密度低的问题。According to the integrated intelligent sensing method of sensing, storage and computing proposed in the embodiment of the present application, it is not necessary to set up multiple photosensitive neurons in adjacent areas to increase the width of the neural network. The photosensitive neurons are stimulated and trained to make their weights meet the needs of different nodes in the width direction of the neural network, and the time is exchanged for space, which greatly improves the pixel density of the photosensitive neuron network, and has small size, low power consumption and fast speed. The problem of low pixel density in the integrated architecture of sensing, storage and computing in technology.

本申请实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如上的感存算一体化智能感知方法。Embodiments of the present application further provide a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the above-mentioned integrated sensing-memory-computing intelligent sensing method.

在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或N个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of this specification, description with reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples", etc., mean specific features described in connection with the embodiment or example , structure, material or feature is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or N of the embodiments or examples. Furthermore, those skilled in the art may combine and combine the different embodiments or examples described in this specification, as well as the features of the different embodiments or examples, without conflicting each other.

此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本申请的描述中,“N个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present application, "N" means at least two, such as two, three, etc., unless otherwise expressly and specifically defined.

流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更N个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本申请的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本申请的实施例所属技术领域的技术人员所理解。Any process or method description in the flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or N more executable instructions for implementing custom logical functions or steps of the process , and the scope of the preferred embodiments of the present application includes alternative implementations in which the functions may be performed out of the order shown or discussed, including performing the functions substantially concurrently or in the reverse order depending upon the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present application belong.

在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或N个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。The logic and/or steps represented in flowcharts or otherwise described herein, for example, may be considered an ordered listing of executable instructions for implementing the logical functions, may be embodied in any computer-readable medium, For use with, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch instructions from and execute instructions from an instruction execution system, apparatus, or apparatus) or equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport the program for use by or in connection with an instruction execution system, apparatus, or apparatus. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) with one or N wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read Only Memory (ROM), Erasable Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, followed by editing, interpretation, or other suitable medium as necessary process to obtain the program electronically and then store it in computer memory.

应当理解,本申请的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,N个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。如,如果用硬件来实现和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that various parts of this application may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the N steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented by any one of the following techniques known in the art, or a combination thereof: discrete with logic gates for implementing logic functions on data signals Logic circuits, application specific integrated circuits with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.

本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing the relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the program is stored in a computer-readable storage medium. When executed, one or a combination of the steps of the method embodiment is included.

此外,在本申请各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

上述提到的存储介质可以是只读存储器,磁盘或光盘等。尽管上面已经示出和描述了本申请的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本申请的限制,本领域的普通技术人员在本申请的范围内可以对上述实施例进行变化、修改、替换和变型。The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present application have been shown and described above, it should be understood that the above embodiments are exemplary and should not be construed as limitations to the present application. Embodiments are subject to variations, modifications, substitutions and variations.

Claims (10)

1.一种光敏神经元,其特征在于,包括:1. a photosensitive neuron, is characterized in that, comprises: 雪崩探测器,用于在光子入射时,基于光致雪崩效应,输出电压脉冲;Avalanche detector, used to output voltage pulse based on photon avalanche effect when photon is incident; 与所述雪崩探测器串联的自适应阻变存储器,用于在所述电压脉冲的驱动下,导电离子漂移到导电沟道形成沉积,以感知任一信号光的光场信号,和/或经过训练后,产生最大幅值的电流脉冲。The adaptive resistive memory connected in series with the avalanche detector is used to drive the conductive ions to drift to the conductive channel to form deposition under the driving of the voltage pulse, so as to sense the optical field signal of any signal light, and/or pass After training, current pulses of maximum amplitude are generated. 2.根据权利要求1所述的光敏神经元,其特征在于,在无光子入射时,所述自适应阻变存储器的导电沟道溶解消散,其中,所述导电沟道的沉积速度大于所述导电沟道的扩散消融速度时,所述适应阻变存储器进入电阻降低模式,所述雪崩探测器进入快速充电模式,恢复至雪崩之前的初始状态。2 . The photosensitive neuron according to claim 1 , wherein when no photons are incident, the conductive channel of the adaptive resistive memory is dissolved and dissipated, wherein the deposition speed of the conductive channel is greater than the deposition speed of the conductive channel. 3 . When the diffusion ablation rate of the conductive channel is reached, the adaptive resistive memory enters a resistance reduction mode, and the avalanche detector enters a fast charging mode, returning to the initial state before the avalanche. 3.根据权利要求1或2所述的光敏神经元,其特征在于,所述光敏神经元释放所述电流脉冲后,脉冲峰值为Ipeak=VE/Rmin,其中,VE为过剩电压,Rmin为所述自适应阻变存储器在电阻动态变化过程中的最低值。3. The photosensitive neuron according to claim 1 or 2, wherein after the photosensitive neuron releases the current pulse, the peak value of the pulse is I peak =V E /R min , wherein V E is the excess voltage , R min is the lowest value of the adaptive resistive memory in the process of dynamic resistance change. 4.根据权利要求3所述的光敏神经元,其特征在于,所述最低值由入射光子频率确定。4. The photosensitive neuron of claim 3, wherein the minimum value is determined by the incident photon frequency. 5.根据权利要求3或4所述的光敏神经元,其特征在于,还包括:5. photosensitive neuron according to claim 3 or 4, is characterized in that, also comprises: 引入单元,用于引入电学激励,以基于所述入射光子频率和所述电学激励将所述自适应阻变存储器的实际阻值和所述雪崩探测器的实际电流调整为目标阻值和目标电流,达到神经元的活性条件。an introduction unit for introducing electrical excitation to adjust the actual resistance value of the adaptive resistive memory and the actual current of the avalanche detector to a target resistance value and a target current based on the incident photon frequency and the electrical excitation , to achieve neuronal activity conditions. 6.一种感存算一体化智能感知装置,其特征在于,包括:6. A sensing-memory-computing integrated intelligent sensing device, characterized in that, comprising: 光敏神经元阵列,所述光敏神经元阵列包括多个如权利要求1-5任一项所述的光敏神经元,以输出电流。A photosensitive neuron array, the photosensitive neuron array comprising a plurality of photosensitive neurons according to any one of claims 1-5, to output current. 7.根据权利要求6所述的装置,其特征在于,还包括:7. The apparatus of claim 6, further comprising: 训练单元,用于将所述光敏神经元阵列中i行j列的光敏神经元进行训练,以将所述信号光的入射光强转换成电流的敏感系数,执行神经网络的乘加运算。The training unit is used for training the photosensitive neurons in i row and j column in the photosensitive neuron array, so as to convert the incident light intensity of the signal light into a current sensitivity coefficient, and perform the multiplication and addition operation of the neural network. 8.根据权利要求7所述的装置,其特征在于,所述输出电流的计算公式为:8. The device according to claim 7, wherein the calculation formula of the output current is:
Figure FDA0003491903380000011
Figure FDA0003491903380000011
其中,Sij为光强,Rij为电流的敏感系数,i为行数,j为列数,m为行数最大值,n为列数最大值。Among them, S ij is the light intensity, R ij is the sensitivity coefficient of the current, i is the number of rows, j is the number of columns, m is the maximum number of rows, and n is the maximum number of columns.
9.一种感存算一体化智能感知方法,其特征在于,采用如权利要求6-8任一项所述的感存算一体化智能感知装置,所述方法包括以下步骤:9. A sensing-memory-computing-integrated intelligent perception method, characterized in that, adopting the sensing-memory-computing integrated intelligent sensing device according to any one of claims 6-8, the method comprises the following steps: 在光子入射时,基于光致雪崩效应,输出电压脉冲;When a photon is incident, a voltage pulse is output based on the photo-induced avalanche effect; 在所述电压脉冲的驱动下,导电离子漂移到导电沟道形成沉积,以感知任一信号光的光场信号,和/或经过训练后,产生最大幅值的电流脉冲。Driven by the voltage pulse, the conductive ions drift to the conductive channel to form deposition, so as to sense the light field signal of any signal light, and/or after training, the current pulse with the maximum amplitude is generated. 10.一种计算机存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行,以用于实现如权利要求9所述的感存算一体化智能感知方法。10. A computer storage medium on which a computer program is stored, characterized in that the program is executed by a processor to implement the sensor-memory-computing integrated intellisense method as claimed in claim 9.
CN202210099896.8A 2022-01-27 2022-01-27 Photosensitive neurons, sensing, storage and computing integrated intelligent sensing device, method and medium Active CN114638349B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210099896.8A CN114638349B (en) 2022-01-27 2022-01-27 Photosensitive neurons, sensing, storage and computing integrated intelligent sensing device, method and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210099896.8A CN114638349B (en) 2022-01-27 2022-01-27 Photosensitive neurons, sensing, storage and computing integrated intelligent sensing device, method and medium

Publications (2)

Publication Number Publication Date
CN114638349A true CN114638349A (en) 2022-06-17
CN114638349B CN114638349B (en) 2024-05-28

Family

ID=81946291

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210099896.8A Active CN114638349B (en) 2022-01-27 2022-01-27 Photosensitive neurons, sensing, storage and computing integrated intelligent sensing device, method and medium

Country Status (1)

Country Link
CN (1) CN114638349B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115860071A (en) * 2022-12-08 2023-03-28 成都市深思创芯科技有限公司 Neural network oscillator system based on integration of sensing, storage and calculation

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200326414A1 (en) * 2017-09-27 2020-10-15 The Commonwealth Of Australia Neuromorphic Single Photon Avalanche Detector (SPAD) Array Microchip
CN111950720A (en) * 2020-08-26 2020-11-17 南京大学 A novel brain-like visual system
CN112183739A (en) * 2020-11-02 2021-01-05 中国科学技术大学 Hardware architecture of memristor-based low-power-consumption pulse convolution neural network
CN113224090A (en) * 2020-01-21 2021-08-06 半导体元件工业有限责任公司 Imaging system
WO2021178434A1 (en) * 2020-03-04 2021-09-10 The University Of Chicago Avalanche photodiodes with adaptive quenching of photocurrent
CN113838971A (en) * 2020-06-23 2021-12-24 湖南师范大学 Photoelectric driving avalanche diode memristor and manufacturing method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200326414A1 (en) * 2017-09-27 2020-10-15 The Commonwealth Of Australia Neuromorphic Single Photon Avalanche Detector (SPAD) Array Microchip
CN113224090A (en) * 2020-01-21 2021-08-06 半导体元件工业有限责任公司 Imaging system
WO2021178434A1 (en) * 2020-03-04 2021-09-10 The University Of Chicago Avalanche photodiodes with adaptive quenching of photocurrent
CN113838971A (en) * 2020-06-23 2021-12-24 湖南师范大学 Photoelectric driving avalanche diode memristor and manufacturing method thereof
CN111950720A (en) * 2020-08-26 2020-11-17 南京大学 A novel brain-like visual system
CN112183739A (en) * 2020-11-02 2021-01-05 中国科学技术大学 Hardware architecture of memristor-based low-power-consumption pulse convolution neural network

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
LUKAS MENNEL、ET;: "Ultrafast machine vision with 2D material neural network image sensors", NATURE, vol. 579, 4 March 2020 (2020-03-04), pages 62 - 66, XP037050108, DOI: 10.1038/s41586-020-2038-x *
王春阳;刘鑫;史红伟;杨波;: "单光子探测器SPICE模型及主被动混合淬灭电路研究", 半导体光电, no. 04, 8 August 2018 (2018-08-08), pages 22 - 25 *
贾建权;江加丽;李佰成;王瑞恒;梁琨;杨茹;韩德俊;: "高密度外延电阻淬灭硅光电倍增器研究", 光子学报, no. 04, 15 April 2017 (2017-04-15), pages 74 - 80 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115860071A (en) * 2022-12-08 2023-03-28 成都市深思创芯科技有限公司 Neural network oscillator system based on integration of sensing, storage and calculation

Also Published As

Publication number Publication date
CN114638349B (en) 2024-05-28

Similar Documents

Publication Publication Date Title
US10708522B2 (en) Image sensor with analog sample and hold circuit control for analog neural networks
US11361216B2 (en) Neural network circuits having non-volatile synapse arrays
US20210366542A1 (en) Apparatus and method with in-memory processing
CN111656371B (en) Neural network circuit with nonvolatile synaptic arrays
US20210125048A1 (en) Neuromorphic package devices and neuromorphic computing systems
KR102568410B1 (en) Artificial intelligence system including preprocessor unit for sorting valid data
TWI754567B (en) Neuromorphic device and operating method of the same
US11056185B2 (en) Apparatus for deep learning operations on resistive crossbar array
US11756610B2 (en) Apparatus and method with in-memory delay dependent processing
US11663451B2 (en) Two-dimensional array-based neuromorphic processor and implementing method
CN114638349A (en) Photosensitive neuron, sensor-memory-computing integrated intelligent perception device, method and medium
WO2023217027A1 (en) Policy optimization method and apparatus using environment model based on memristor array
US20230113627A1 (en) Electronic device and method of operating the same
CN113489925A (en) Focal plane detector reading circuit for realizing convolution calculation
TW202248845A (en) Ai fusion pixel sensor using memristors
KR20240095298A (en) Charge domain mathematical engine and method
US20220011437A1 (en) Distance measuring device, distance measuring system, distance measuring method, and non-transitory storage medium
US11988555B1 (en) Configurable sensor units and sensor apparatus
CN112862663B (en) Near sensor end computing system
FR3119696A1 (en) NEUROMORPHIC CIRCUIT AND ASSOCIATED DRIVE METHOD
US12229680B2 (en) Neural network accelerators resilient to conductance drift
US11394865B1 (en) Low-power, fast-response machine learning autofocus enhancements
KR20240109086A (en) Neural network circuit and operating method thereof
US20240046083A1 (en) Memristive cellular neural network
US20240211743A1 (en) Neuron circuit and method with firing pattern

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant