WO2023039858A1 - Optical computing system, optical computing method and control apparatus - Google Patents

Optical computing system, optical computing method and control apparatus Download PDF

Info

Publication number
WO2023039858A1
WO2023039858A1 PCT/CN2021/119163 CN2021119163W WO2023039858A1 WO 2023039858 A1 WO2023039858 A1 WO 2023039858A1 CN 2021119163 W CN2021119163 W CN 2021119163W WO 2023039858 A1 WO2023039858 A1 WO 2023039858A1
Authority
WO
WIPO (PCT)
Prior art keywords
optical
optical signal
signal
signals
unit
Prior art date
Application number
PCT/CN2021/119163
Other languages
French (fr)
Chinese (zh)
Inventor
周雷
董晓文
王戎
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2021/119163 priority Critical patent/WO2023039858A1/en
Priority to CN202180102237.9A priority patent/CN117980920A/en
Publication of WO2023039858A1 publication Critical patent/WO2023039858A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/067Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using optical means

Definitions

  • the present application relates to the technical field of optical communication, and in particular to an optical computing system, an optical computing method and a control device.
  • An optical computing system refers to a system that uses photons as a medium for computing. Compared with electrons, photons have the advantages of high speed, high bandwidth, and low power consumption, so optical computing systems are more suitable for processing large-scale convolution operations.
  • the optical computing system includes an optical signal providing unit and an optical computing network unit.
  • the optical signal providing unit provides multiple optical signals, and the multiple optical signals respectively carry multiple input information.
  • the optical computing network unit has multiple computing nodes, and the multiple computing nodes communicate with The multi-channel optical signals correspond one-to-one, and the calculation node performs amplitude modulation on the corresponding optical signal according to the preset convolution kernel coefficient, so as to perform the multiplication operation of the convolution kernel coefficient and the input information.
  • the convolution operation of the input matrix composed of a plurality of input information and the convolution kernel matrix composed of a plurality of convolution kernel coefficients is realized in the above manner.
  • the present application provides an optical computing system, an optical computing method and a control device, and the technical solution is as follows:
  • an optical computing system including an optical signal providing unit, an optical distribution unit, and an optical computing network unit, where the optical distribution unit includes an optical steering element and an optical converging element.
  • the optical signal providing unit is used to provide multiple channels of first optical signals; the optical diverting element is used to divert multiple channels of first optical signals; the optical converging element is used to converge the diverted multiple channels of first optical signals into at least one channel
  • the second optical signal transmits at least one second optical signal to the optical computing network unit; the optical computing network unit is configured to receive at least one second optical signal and modulate at least one second optical signal.
  • the optical signal providing unit provides multiple optical signals, and the steering and convergence of the corresponding relationship of the optical signals can be controlled through the optical steering element and the optical converging element, thereby controlling the input information carried by the optical signal to be transmitted to the optical Calculate which computing node of the network unit, and then realize the flexible configuration of the corresponding relationship between the input information and the convolution kernel coefficient, so that the system can control the coefficient corresponding to each input information when performing convolution calculation, so as to ensure the realization of the convolution operation
  • the flexible configuration such as using different convolution kernel coefficient matrices to convolute images, can meet the convolution calculation requirements in various scenarios.
  • the optical signal providing unit includes a light source unit and a modulation unit
  • the optical computing network unit includes at least one computing node and at least one demultiplexer, and usually there are multiple computing nodes and demultiplexers, Taking multiple as an example, multiple computing nodes are divided into multiple groups.
  • the light source unit is used to provide multiple channels of third optical signals;
  • the modulation unit is used to receive multiple channels of third optical signals and modulate the multiple channels of third optical signals to obtain multiple channels of first optical signals, and the first optical signals carry Input information;
  • the light steering element is used to control the direction of multiple first optical signals;
  • the light converging element is used to converge the multiple first optical signals passing through the light steering element into at least one second optical signal;
  • the demultiplexer receives at least one A second optical signal, and at least one second optical signal is decoupled, and the decoupled first optical signal is output to a computing node, and the computing node modulates the amplitude of the received first optical signal.
  • the light source unit provides multiple optical signals
  • the modulation unit performs the first modulation on the multiple optical signals, and the amplitude of the optical signal after the first modulation is used to represent the input information. That is, the input information is modulated onto the optical signal to prepare for the calculation of the input information; after the first step of modulation, the first modulated optical signal is distributed to each computing node in the optical computing network through the optical distribution unit , that is, by steering and converging the optical signal, it is sent to the optical computing network unit.
  • the optical computing network unit includes a demultiplexer and a computing node. For the received optical signal, it is demultiplexed by the demultiplexer first.
  • the convolution kernel coefficients of each computing node in the optical computing network form a convolution kernel coefficient matrix
  • the input information carried by multiple first optical signals forms an input pixel amplitude matrix.
  • the pixel amplitude matrix can be input to the set calculation node.
  • the scale and position of the set calculation node are variable, that is, the convolution kernel coefficient matrix of different sizes is used to perform image processing. Convolution processing.
  • the number of channels of the first optical signal provided by the optical signal providing unit is the same as the number of computing nodes in the optical computing network unit.
  • Each path of the first optical signal can be allocated to each computing node in a one-to-one correspondence through the light steering element and the light converging element. It is also possible to divert and converge only a part of the first optical signals, so that part of the first optical signals are distributed to some computing nodes.
  • the number of paths of the first optical signal provided by the optical signal providing unit is different from the number of computing nodes in the optical computing network unit, for example, the number of paths of the first optical signal is greater than the number of computing nodes, or the number of paths of the first optical signal is greater than the number of computing nodes, or The number of paths of an optical signal is less than the number of computing nodes.
  • All or part of the first optical signals can be diverted and converged by the light diverting element and the light converging element, and then distributed to all or part of the computing nodes.
  • the multiple first optical signals are different in wavelength and mode at the same time, that is, at least one of the wavelength and mode of the two first optical signals is different.
  • the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal
  • the modes of the first optical signal and the second optical signal are different
  • the second optical signal and The wavelengths of the third optical signals are different.
  • different optical signals are provided from two dimensions of wavelength and mode, so that the optical computing network can support larger-scale convolution operations, making the optical computing system more widely used.
  • the multiple first optical signals differ only in one dimension of wavelength or mode, which will not be repeated here.
  • different light modes refer to different transverse mode modes, such as LP00, LP01, LP10, and the like.
  • the wavelength of light corresponds to the longitudinal mode of light.
  • the implementation of the light source unit is given below when multiple channels of first optical signals are simultaneously different in two dimensions: wavelength and mode.
  • the light source unit includes a multi-wavelength light source and multiple mode converters.
  • the multi-wavelength light source is used to provide multiple channels of fourth optical signals with different wavelengths; each mode converter is used to receive one of the multiple channels of fourth optical signals with different wavelengths, and is used to convert the received channel of the fourth optical signal to
  • the four optical signals are converted into multiple third optical signals with different modes, thereby obtaining multiple third optical signals, and any two of the third optical signals have different wavelengths, or different modes, or both different wavelengths and modes.
  • the light source unit includes a multi-mode light source and multiple mode converters.
  • the multi-mode light source is used to provide multiple fourth optical signals with different modes; each mode converter is used to receive one fourth optical signal among the multiple fourth optical signals with different modes, and is used to convert the received one fourth optical signal to The four optical signals are converted into multiple channels of third optical signals with different wavelengths.
  • the function of the mode converter is to convert the transverse mode of light, so as to convert one beam of light into multiple beams of light with the same wavelength and different modes.
  • the function of the mode converter is to convert the longitudinal mode of light, so as to convert one beam of light into multiple beams of light with the same mode and different wavelengths.
  • Both of the above two implementation methods can provide multiple optical signals with different wavelengths and modes at the same time, so that the optical computing network can support larger-scale convolution operations, making the optical computing system more widely used.
  • the modulating unit includes a plurality of modulators, and each modulator is used to modulate a third optical signal, for example, modulate a corresponding third optical signal with an electrical signal, so that the electrical signal carries The input information is modulated onto the third optical signal to obtain the first optical signal.
  • each channel of the first optical signal only includes a component modulated by the channel of the third optical signal.
  • the modulator is an electro-optical conversion device. The bias voltage of the modulator is controlled by an electrical signal, and the amplitude of the input optical signal is modulated so that it can represent the input information carried by the electrical signal.
  • the modulator and the third optical signal may be set one-to-one.
  • the modulators and the third optical signals may not be arranged one-to-one, for example, the number of modulators is less than that of the third optical signals, or the number of modulators is greater than that of the third optical signals.
  • the modulation unit includes multiple couplers and multiple modulators, and each coupler may correspond to one modulator.
  • Multiple couplers are used to couple multiple channels of third optical signals into multiple channels of fifth optical signals; multiple modulators are used to use multiple channels of first electrical signals to respectively modulate multiple channels of fifth optical signals to obtain multiple channels of first optical signals.
  • each first electrical signal is obtained by coupling multiple second electrical signals with different frequencies.
  • each first optical signal includes components modulated by multiple third optical signals.
  • the calculation node in the subsequent optical processing network unit modulates the first optical signal for one of the first optical signals. portion.
  • the multiple third optical signals corresponding to each coupler may be optical signals carrying input information corresponding to one or several rows of computing nodes in the optical computing network unit, and the multiple third optical signals coupled by one coupler There may be no special requirements on wavelength or mode.
  • multiple third optical signals of the same wavelength or mode can also be used to carry the input information corresponding to one or several rows of computing nodes in the optical computing network unit, and then be coupled through a coupler.
  • the third optical signal is coupled first, and then the coupled optical signal is modulated, the number of required modulators is reduced, which is beneficial to reducing the size and cost of the entire optical computing system.
  • the digital circuit provides multiple digital frequency signals with the same frequency, and each digital frequency signal has already carried input information; multiple multipliers are used to convert the frequency of the multiple digital frequency signals to obtain multiple channels with different frequencies.
  • Digital frequency signal (second electrical signal); then use the radio frequency source to couple multiple digital frequency signals to obtain multiple coupled electrical signals; use a digital-to-analog converter to convert the digital signal into an analog signal to obtain multiple first electric signal.
  • the digital-to-analog conversion is performed after the electrical signal is coupled, which reduces the number of digital-to-analog converters and is beneficial to reduce the size and cost of the entire optical computing system.
  • the digital circuit that provides the digital frequency signal may be hardware that needs to perform convolution calculation, such as a graphics card, a processor, and the like.
  • all digital frequency signals can be converted into different frequencies, or the digital frequency signals that need to be coupled into one electrical signal can be converted into frequency according to the subsequent coupling relationship.
  • Different frequencies, and the frequencies of the digital frequency signals coupled into different circuit electrical signals after frequency conversion may be the same or different.
  • each modulated first optical signal is actually modulated by multiple second electrical signals at the same time, but when actually representing input information, each The first optical signal only needs to correspond to one second electrical signal, so after passing through the optical computing network unit, the optical signal needs to be filtered to filter out components corresponding to redundant electrical signals during modulation.
  • the optical computing system further includes at least one filter.
  • Each filter is used to filter the optical signal output by at least one computing node, and retain a component corresponding to one of the multiple second electrical signals with different frequencies.
  • filtering is actually filtering out components of the optical signal.
  • the optical signal is modulated by multiple second electrical signals at the same time, so that the amplitude of the optical signal is the sum of the modulation results of the multiple second electrical signals.
  • the component modulated by the electrical signal other than the signal is filtered out.
  • the optical signal providing unit includes a multi-wavelength light source and multiple mode converters, or the optical signal providing unit includes a multi-mode light source and multiple mode converters.
  • the optical signal providing unit includes a multi-mode light source and multiple mode converters.
  • multiple mode converters convert the optical signals output by the multi-wavelength light source or multi-mode light source to obtain multiple optical signals with different modes, or multiple optical signals with different wavelengths.
  • the signal or multiple optical signals with different wavelengths are used to generate multiple first optical signals.
  • the optical signal providing unit may further include a modulating unit, configured to modulate the optical signals output by the multiple mode converters, so as to generate multiple channels of first optical signals.
  • a modulating unit configured to modulate the optical signals output by the multiple mode converters, so as to generate multiple channels of first optical signals.
  • the optical signal supply unit may not include a modulation unit, and the optical signals output by multiple mode converters do not need to be modulated by the modulation unit, and the input information has been carried on the optical signal, that is, the output is a multi-channel first light signal.
  • the light redirecting element comprises a liquid crystal on silicon cell.
  • the light diverting element may include a plurality of liquid crystal on silicon units, and each liquid crystal on silicon unit receives an optical signal output by a modulation unit, and controls the propagation direction of the optical signal, for example, controls the steering of the optical signal, or does not change the direction of the optical signal.
  • the liquid crystal on silicon cell is a voltage-driven element. By controlling the voltage of the liquid crystal cell and changing its electric field, the deflection direction of the liquid crystal is changed, thereby changing the propagation path of light passing through the liquid crystal cell.
  • the number of liquid crystal on silicon cells in the light steering element can be equal to the number of light signals output by the modulation unit, and the number of liquid crystal on silicon cells in the light steering element can also be greater than the number of light signals output by the modulation unit.
  • the light converging element includes a diffraction grating, and the diffraction grating converges the light incident in a specific direction into a beam, and then transmits it to the optical computing network unit.
  • the diffraction grating as the light converging element makes the structure of the light converging element relatively simple, thereby The volume of the entire optical computing system can be reduced.
  • the optical computing system further includes a control device.
  • the control device is used to control the liquid crystal on silicon cell to realize at least one of the following controls:
  • Controlling the composition of the first optical signal converged into a beam of light (one second optical signal) in the light converging element that is, controlling which first optical signals will be converged together after arriving at the light converging element;
  • the first computing node is any computing node, that is, control the first optical signal to be finally emitted to the optical computing network unit which location. Since the position of each optical signal converged by the light converging element is fixed to the optical computing network unit, it is controlled where the second optical signal is diverted through the liquid crystal on silicon unit to achieve converging at the optical converging element.
  • the optical computing network unit includes multiple computing nodes arranged in an array, that is, divided into multiple rows and columns, wherein one row or one column of computing nodes constitutes a group in the above.
  • the following takes a column of compute nodes as a group as an example.
  • the first optical signal corresponding to a row of computing nodes is transmitted to a specific position of the light converging element through the light steering element, converged into a beam of light through the light converging element, and then transmitted to the optical computing device through the light converging element.
  • a row of computing nodes is connected through an optical transmission medium, so that a row of computing nodes can obtain corresponding optical signals.
  • the optical converging element converges the diverted multiple first optical signals into N beams (N second optical signals), and the N beams of light correspond to the optical transmissions that are sent to the N rows of computing nodes connected to the optical computing network unit.
  • N is a positive integer.
  • the first optical signals corresponding to multiple rows of computing nodes are transmitted to a specific position of the light converging element through the light diverting element, converged into a beam of light through the light converging element, and then transmitted to the Multiple rows in optical computing network units.
  • Multiple rows of computing nodes are connected through an optical transmission medium, so that multiple rows or columns of computing nodes can obtain corresponding optical signals.
  • the demultiplexer After the aggregated optical signal is sent to the optical computing network unit, the demultiplexer performs decoupling, and outputs the decoupled first optical signal to the corresponding computing node.
  • each computing node is connected to the optical transmission medium of the row through a demultiplexer, which can receive the optical signal and decouple it to obtain the corresponding first light signal.
  • the optical computing network unit may be one processing unit, or may be composed of multiple processing units.
  • the optical computing network may be composed of multiple optical processing units, and each optical processing unit is a processing unit.
  • Each optical processing unit can contain multiple rows or columns of computing nodes and multiple demultiplexers.
  • each optical processing unit can correspond to a beam of converged light, or one optical processing unit can Converging beams of light.
  • the optical computing network unit includes at least one optical processing unit, and transmits at least one second optical signal to the optical computing network unit, including:
  • At least one second optical signal is sent to the at least one optical processing unit.
  • the processing capability of the optical processing unit is usually determined by the number of computing nodes it contains, and according to the processing capability of each optical processing unit, it is determined whether at least one second optical signal is sent to one or more optical processing units, so that the optical The computing system allocates the optical processing unit to process the optical signal according to needs, so as to avoid excess or insufficient processing capacity of the provided optical processing unit.
  • a computing node includes a modulator.
  • the compute node includes a phase change material for modulating the amplitude of the received optical signal.
  • the computing node performs amplitude modulation on the corresponding first optical signal according to the convolution kernel coefficient to perform multiplication of the convolution kernel coefficient and the input information on the corresponding first optical signal Operation, multiple computing nodes correspond to multiple convolution kernel coefficients one by one.
  • the optical computing system further includes: a converting unit, configured to add and convert the optical signals output by the optical computing network unit into electrical signals.
  • a converting unit configured to add and convert the optical signals output by the optical computing network unit into electrical signals. The same group of multiplication calculation results are added through the conversion unit, and converted into an electrical signal output, so that the calculation result can be applied to the calculation of the subsequent electrical processing unit.
  • the conversion unit includes a plurality of photoelectric converters, each photoelectric converter corresponds to a group of computing nodes, the output of this group of computing nodes is connected to the input of the same photoelectric converter, and the output of the photoelectric converter to this group of computing nodes
  • the optical signal is converted to photoelectricity to realize the addition and conversion of the optical signal mentioned above.
  • the optical computing system is used for computing in image processing, or the optical computing system is used for computing in digital signal processing, or the optical computing system is used for computing in a processor.
  • the optical computing system provided by this application can provide faster computing speed and larger computing scale, and can be applied in the above-mentioned fields to further improve the speed and scale of image processing and digital signal processing.
  • an optical computing system including a light source unit, a modulation unit, and an optical computing network unit.
  • the modulation unit includes a coupler and a modulator.
  • the light source unit is used to provide multiple channels of first optical signals; the coupler is used to couple multiple channels of first optical signals into at least one channel of second optical signals; The signal is modulated to obtain a modulated second optical signal, and each first electrical signal in at least one first electrical signal is obtained by coupling multiple second electrical signals with different frequencies; the optical computing network unit is used for At least one second optical signal is received, and at least one second optical signal is modulated.
  • first optical signal and second optical signal are only used to represent the change process of the optical signal in this implementation mode, and the first optical signal here and the first optical signal defined in the previous aspect may be different optical signals. Signal.
  • the light source unit provides multiple optical signals
  • the modulation unit performs the first modulation on the multiple optical signals, and the amplitude of the optical signal after the first modulation is used to represent the input information. That is to say, the input information is modulated onto the optical signal; after the first step of modulation, the first modulated optical signal is distributed to the optical computing network unit through the optical distribution unit, and the optical computing network unit completes the first step of these optical signals.
  • the second modulation is also amplitude modulation, and the amplitude of the optical signal after the second modulation represents the magnitude of the input information multiplied by a coefficient.
  • the above two-step calculation completes the multiplication part in the convolution operation.
  • the optical signals are coupled together by a coupler and then modulated, so that the number of required modulators is greatly reduced, which is beneficial to reduce the size and cost of the entire optical computing system.
  • multiple first optical signals are coupled together, then modulated, and then decomposed into required second optical signals in the optical computing network unit.
  • the coupled optical signals In order to ensure that the coupled optical signals can be decomposed again, it is necessary to ensure that the wavelengths or modes of the first optical signals of each channel are different.
  • the wavelengths and modes of the multiple first optical signals are different at the same time, that is, at least one of the wavelengths and modes of the two first optical signals is different.
  • the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
  • the light source unit includes a multi-wavelength light source and multiple mode converters.
  • the multi-wavelength light source is used to provide multiple channels of third optical signals with different wavelengths; each mode converter is used to receive one of the multiple channels of third optical signals with different wavelengths, and is used to convert the received channel of the third optical signal to
  • the three optical signals are converted into multiple first optical signals with different modes, thereby obtaining multiple first optical signals, and any two of them have different wavelengths, or different modes, or both different wavelengths and modes.
  • the light source unit includes a multi-mode light source and multiple mode converters.
  • the multi-mode light source is used to provide multiple third optical signals with different modes; each mode converter is used to receive one of the third optical signals among the multiple third optical signals with different modes, and is used to convert the received third optical signal
  • the three optical signals are converted into multiple channels of first optical signals with different wavelengths.
  • the function of the mode converter is to convert the transverse mode of light, so as to convert one beam of light into multiple beams of light with the same wavelength and different modes.
  • the function of the mode converter is to convert the longitudinal mode of light, so as to convert one beam of light into multiple beams of light with the same mode and different wavelengths.
  • Both of the above two implementation methods can provide multiple optical signals with different wavelengths and modes at the same time, so that the optical computing network can support larger-scale convolution operations, making the optical computing system more widely used.
  • the first electrical signal is obtained by coupling multiple second electrical signals with different frequencies.
  • the generation process of the first electrical signal is described below:
  • the digital circuit provides multiple digital frequency signals with the same frequency, and each digital frequency signal has already carried input information; multiple multipliers are used to convert the frequency of the multiple digital frequency signals to obtain multiple channels with different frequencies.
  • a digital frequency signal (second electrical signal); then use a radio frequency source to couple multiple digital frequency signals to obtain a coupled electrical signal; use a digital-to-analog converter to convert the digital signal into an analog signal to obtain the first electrical signal.
  • the digital-to-analog conversion is performed after the electrical signal is coupled, which reduces the number of digital-to-analog converters and is beneficial to reduce the size and cost of the entire optical computing system.
  • the digital circuit that provides the digital frequency signal may be hardware that needs to perform convolution calculation, such as a graphics card, a processor, and the like.
  • the optical computing network unit includes at least one demultiplexer, and the at least one demultiplexer is configured to receive at least one second optical signal and decouple at least one second optical signal.
  • each demultiplexer is used to receive the optical signal output by the modulator, decouple the optical signal output by the modulator, output the decoupled optical signal to the corresponding computing node, and separate the coupled optical signals , so that each computing node is assigned an optical signal carrying corresponding input information.
  • each modulated optical signal is actually modulated by multiple second electrical signals at the same time, but when actually representing input information, each optical signal It only needs to correspond to one second electrical signal, so after passing through the optical computing network unit, the optical signal needs to be filtered to filter out the component corresponding to the redundant electrical signal during modulation.
  • the optical computing network unit includes at least one computing node, an optical computing system, and a plurality of filters.
  • Each filter is used to filter the optical signal output by at least one computing node, and retain a component corresponding to one of the multiple second electrical signals with different frequencies.
  • filtering is actually filtering out components of the optical signal.
  • the optical signal is modulated by multiple second electrical signals at the same time, so that the amplitude of the optical signal is the sum of the modulation results of the multiple second electrical signals.
  • the component modulated by the electrical signal other than the signal is filtered out.
  • the optical computing system further includes an optical distribution unit.
  • the optical distribution unit is responsible for sending the optical signal output by the modulation unit to the optical computing network unit.
  • the light distribution unit comprises a light redirecting element.
  • the light diverting element is used to divert at least one second optical signal, so that the at least one second optical signal is sent to at least one optical processing unit.
  • At least one second optical signal can be transmitted to at least one optical processing unit according to the processing capability of at least one optical processing unit.
  • the processing capability of the optical processing unit is usually determined by the number of computing nodes it contains, and according to the processing capability of each optical processing unit, it is determined whether at least one second optical signal is sent to one or more optical processing units, so that the optical The computing system allocates the optical processing unit to process the optical signal according to needs, so as to avoid excess or insufficient processing capacity of the provided optical processing unit.
  • the light redirecting element comprises a liquid crystal on silicon cell.
  • the voltage applied to the silicon-based liquid crystal unit it is possible to flexibly adjust the propagation direction of the optical signal.
  • optical computing network unit When the optical computing network unit has only one input optical signal, in order to ensure that each computing node can obtain one second optical signal in the input optical signal.
  • Each computing node in the optical computing network unit is connected through an optical transmission medium.
  • the optical distribution unit sends one optical signal to computing nodes in multiple rows or columns at the same time.
  • a computing node includes a modulator.
  • the computing node includes a phase change material for modulating the amplitude of the received second optical signal.
  • the optical computing system further includes: a converting unit, configured to add and convert the optical signals output by the optical computing network unit into electrical signals.
  • a converting unit configured to add and convert the optical signals output by the optical computing network unit into electrical signals. The same group of multiplication calculation results are added through the conversion unit, and converted into an electrical signal output, so that the calculation result can be applied to the calculation of the subsequent electrical processing unit.
  • the conversion unit includes a plurality of photoelectric converters, each photoelectric converter corresponds to a group of computing nodes, the output of this group of computing nodes is connected to the input of the same photoelectric converter, and the output of the photoelectric converter to this group of computing nodes
  • the optical signal is converted to photoelectricity to realize the addition and conversion of the optical signal mentioned above.
  • the optical computing system is used for computing in image processing, or the optical computing system is used for computing in digital signal processing, or the optical computing system is used for computing in a processor.
  • the optical computing system provided by this application can provide faster computing speed and larger computing scale, and can be applied in the above-mentioned fields to further improve the speed and scale of image processing and digital signal processing.
  • a light calculation method comprising:
  • the at least one second optical signal is modulated by the optical computing network unit.
  • the method also includes:
  • At least one second optical signal is decoupled.
  • the optical computing network unit includes at least one optical processing unit, and transmits at least one second optical signal to the optical computing network unit, including:
  • At least one second optical signal is sent to the at least one optical processing unit.
  • the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
  • a light calculation method comprising:
  • At least one first electrical signal is used to modulate at least one second optical signal to obtain a modulated second optical signal, and each first electrical signal in the at least one first electrical signal is obtained by pairing multiple first electrical signals with different frequencies. It is obtained by coupling two electrical signals;
  • the at least one second optical signal is modulated by the optical computing network unit.
  • the method also includes:
  • At least one second optical signal is decoupled.
  • the optical computing network unit includes at least one computing node, and the method further includes:
  • the optical signal output by at least one computing node is filtered, and a component corresponding to one of the multiple second electrical signals with different frequencies is retained.
  • the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
  • a control device including a processor and a memory; program codes are stored in the memory, and when the program codes are executed by the processor, the method described in any one of the preceding items is implemented.
  • FIG. 1 is a schematic structural diagram of an optical computing system provided by some embodiments of the present application.
  • FIG. 2 is a schematic structural diagram of an optical computing system provided by some embodiments of the present application.
  • Fig. 3 is a schematic structural diagram of a light source unit provided by some embodiments of the present application.
  • Fig. 4 is a schematic structural diagram of a light source unit provided by some embodiments of the present application.
  • Fig. 5 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application.
  • Fig. 6 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application.
  • Fig. 7 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application.
  • Fig. 8 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application.
  • Fig. 9 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application.
  • FIG. 10 is a schematic structural diagram of an electrical signal generating circuit provided by some embodiments of the present application.
  • Fig. 11 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application.
  • Fig. 12 is a schematic structural diagram of an electrical signal generating circuit provided by some embodiments of the present application.
  • Fig. 13 is a flowchart of an optical calculation method provided by some embodiments of the present application.
  • Fig. 14 is a flowchart of an optical calculation method provided by some embodiments of the present application.
  • Fig. 15 is a schematic structural diagram of a control device provided by some embodiments of the present application.
  • Fig. 1 is a schematic structural diagram of an optical computing system provided by some embodiments of the present application.
  • the optical computing system includes: an optical signal providing unit 10 , an optical distribution unit 20 and an optical computing network unit 30 .
  • the output end of the optical signal supply unit 10 is connected to the input end of the optical distribution unit 20 , and the output end of the optical distribution unit 20 is connected to the input end of the optical computing network unit 30 .
  • the optical signal providing unit 10 is used to provide multiple first optical signals; the optical distribution unit 20 is used to distribute the multiple first optical signals to the optical computing network unit 30; the optical computing network unit 30 is used to receive the multiple first optical signals , and modulate the multiple first optical signals.
  • the optical distribution unit may be implemented in the following manner: First, multiple channels of first optical signals are aggregated into multiple channels of second optical signals, and then sent to the optical computing network unit 30 .
  • Fig. 2 is a schematic structural diagram of an optical computing system provided by some embodiments of the present application.
  • the optical signal providing unit 10 may include a light source unit 11 and a modulation unit 12 .
  • the light source unit 11 is used to provide multiple third optical signals;
  • the modulation unit 12 is used to receive multiple third optical signals, modulate the multiple third optical signals, and obtain multiple first optical signals, and the first optical signals carry Enter information.
  • the optical computing network unit 30 may have at least one computing node 31, and the number of computing nodes 31 is usually multiple. Taking multiple computing nodes as an example, multiple computing nodes 31 are divided into multiple groups, and the computing nodes 31 are used for receiving The amplitude of the received first optical signal is modulated.
  • the optical computing system may further include a conversion unit 50, the input end of the conversion unit 50 is connected to the output end of the optical computing network unit 30, and the conversion unit 50 is used to add and convert optical signals output by computing nodes belonging to the same group for electrical signals.
  • the number of third optical signals provided by the light source unit 11 is equal to the number of computing nodes in the optical computing network. In other possible implementation manners, the number of third optical signals provided by the light source unit 11 and the number of computing nodes in the optical computing network may also be unequal.
  • the light source unit 11 provides multiple channels of third optical signals, such as ⁇ 11, ⁇ 12... ⁇ 1n, ⁇ 21, ⁇ 22... ⁇ 2n... ⁇ m1, ⁇ m2... ⁇ mn in the figure, a total of m ⁇ n channels, m and n are both positive integer.
  • each computing node there are also m ⁇ n computing nodes in the optical computing network unit 30, and the multi-channel first optical signals modulated by the multiple third optical signals are respectively transmitted to multiple computing nodes, and each computing node completes the input information and the multiplication operation of the convolution kernel coefficients (a 11 ⁇ a mn ), after the multiplication operation is completed, the outputs of the calculation nodes belonging to a column are added to obtain the result of the convolution calculation (y1y2...yn).
  • the convolution kernel coefficients of each computing node in the optical computing network in Figure 2 constitute a convolution kernel coefficient matrix
  • the input information carried by multiple first optical signals constitutes an input pixel amplitude matrix.
  • the optical computing system provided in this application, multiple optical signals are provided, and the first step of modulation is performed on the multiple optical signals by the modulation unit, and the amplitude of the optical signal after the first modulation is used to represent the input information; After the first step of modulation, the optical signal after the first modulation is distributed to each computing node in the optical computing network through the optical distribution unit, and the second modulation of these optical signals is completed by these computing nodes. Secondary modulation is also amplitude modulation, and the amplitude of the optical signal after the second modulation represents the magnitude of the input information multiplied by a coefficient. The above two-step calculation completes the multiplication part in the convolution operation.
  • each computing node uses a separate first optical signal for calculation, that is, different optical signals participate in the calculation of each computing node, so that the power loss of the optical signal is small.
  • At least one of the modes and wavelengths of any two third optical signals in the multiple third optical signals provided by the light source unit is different, that is, the present application provides different optical signals from two dimensions of wavelength and mode. signal, so that the optical computing network can support larger-scale convolution operations.
  • Fig. 3 is a schematic structural diagram of a light source unit provided by some embodiments of the present application.
  • the light source unit 11 includes a multi-wavelength light source 111 and a plurality of mode converters 112 .
  • the output terminal of the multi-wavelength light source 111 is connected to the input terminals of a plurality of mode converters 112 .
  • the multi-wavelength light source 111 is used to provide multiple channels of fourth optical signals with different wavelengths, such as ⁇ 1, ⁇ 2... ⁇ m in FIG. 3 .
  • the wavelengths of the two optical signals can be separated by a certain value to ensure a certain degree of discrimination between the optical signals.
  • Multiple mode converters 112 correspond to multiple fourth optical signals with different wavelengths; the mode converters 112 are used to convert the corresponding fourth optical signals into multiple third optical signals with different modes, as shown in Figure 3.
  • the optical signal ⁇ 1 is converted into multiple third optical signals ⁇ 11, ⁇ 12... ⁇ 1n
  • the fourth optical signal ⁇ 2 is converted into multiple third optical signals ⁇ 21, ⁇ 22... ⁇ 2n... ⁇ m1
  • the fourth optical signal ⁇ m is converted into multiple The third optical signals ⁇ m1, ⁇ m2... ⁇ mn.
  • the mode converter 112 converts the optical signal to obtain multiple third optical signals with different modes, that is, the converted third optical signal has multiple modes, where the multiple modes can be multiple transverse modes, such as transverse modes Die LP00, LP01, LP10, etc.
  • the multi-wavelength light source 111 may be an optical frequency comb, a multi-wavelength laser array, and the like.
  • Fig. 4 is a schematic structural diagram of a light source unit provided by some embodiments of the present application.
  • the light source unit 11 includes a multi-mode light source 113 and a plurality of mode converters 112 .
  • the output of the multi-mode light source 113 is connected to the input of the plurality of mode converters 112 .
  • the multi-mode light source 113 is used to provide multiple fourth optical signals with different modes, such as ⁇ 1 , ⁇ 2 . . . ⁇ m in FIG. 4 .
  • Multiple mode converters 112 correspond to multiple fourth optical signals with different wavelengths; the mode converters 112 are used to convert a corresponding fourth optical signal into multiple third optical signals with different wavelengths, as shown in Figure 4.
  • the four optical signals ⁇ 1 are converted into multiple third optical signals ⁇ 11, ⁇ 12... ⁇ 1n
  • the fourth optical signal ⁇ 2 is converted into multiple third optical signals ⁇ 21, ⁇ 22... ⁇ 2n... ⁇ m1
  • the fourth optical signal ⁇ m is converted into multiple A third optical signal ⁇ m1, ⁇ m2... ⁇ mn.
  • the computing node 31 includes a modulator, such as a Mach Zehnder modulator (MZM).
  • MZM Mach Zehnder modulator
  • the modulator modulates the amplitude of the input optical signal, so that the amplitude is attenuated or enhanced according to the ratio corresponding to the coefficient of the convolution kernel.
  • the computing node 31 includes a phase-change material (or called a phase-sensitive material), and the phase-change material in this application is a photoinduced phase-change material.
  • the phase change material is used to change the transmittance under the control of light, so that the amplitude of the light signal passing through the light signal changes according to the coefficient of the convolution kernel.
  • the phase-change material is GST (Ge 2 Sb 2 Te 5 ) material.
  • GST material exhibits different states when the intensity of light is controlled differently. ), so that the transmittance of the material itself changes, and the modulation function of the input light is realized.
  • the converting single light 50 includes: a plurality of photoelectric converters.
  • a group of computing nodes 31 in the optical computing network unit 30 corresponds to a photoelectric converter, the input terminals of the photoelectric converter are respectively connected to the output terminals of a plurality of computing nodes 31 of the corresponding group, and the output terminals of the photoelectric converter output electrical signals.
  • the photoelectric converter is a photodiode, such as an avalanche photodiode (avalanche photodiodes, APD), a photodiode (photodiodes, PD) and the like.
  • a photodiode such as an avalanche photodiode (avalanche photodiodes, APD), a photodiode (photodiodes, PD) and the like.
  • Fig. 5 is a partial structural diagram of an optical computing system provided by some embodiments of the present application. It mainly shows the detailed structure of the modulation unit 12, the optical computing network unit 30, and the optical distribution unit 20, see FIG. 5:
  • the modulation unit 12 includes a plurality of modulators 122, each modulator 122 is responsible for processing a third optical signal, and the modulator 122 is used to modulate the corresponding third optical signal with an electrical signal, so as to modulate the input information carried by the electrical signal to On the third optical signal, the first optical signal is obtained.
  • each modulator modulates one third optical signal.
  • the modulator uses an electrical signal to modulate the optical signal, and the amplitude of the electrical signal corresponds to the bias voltage of the modulator. Therefore, the input information is represented by the magnitude of the electrical signal.
  • the electrical signal is obtained by converting the digital signal through a digital-to-analog converter, each electrical signal corresponds to a digital-to-analog converter, and the output end of the digital-to-analog converter is connected to the modulator 122 .
  • the multiple computing nodes 31 of the optical computing network unit 30 are arranged in an array, that is, divided into multiple rows and multiple columns, wherein one column of computing nodes 31 constitutes a group as mentioned above.
  • Computing nodes 31 located in the same row can be connected through an optical transmission medium 33 .
  • the optical transmission medium 33 may be an optical waveguide (such as an optical fiber), used to realize the transmission of optical signals.
  • a row of computing nodes 31 may also be regarded as a group, and at this time, a row of computing nodes 31 may be connected through an optical transmission medium 33 .
  • the multiple computing nodes 31 may also be arranged in other manners, which will not be repeated here.
  • the optical distribution unit 20 includes a light turning element 21 and an optical converging element 22; the optical computing network unit 30 also includes at least one demultiplexer 32, and the number of demultiplexers 32 is usually multiple, below are several examples.
  • the input end of the light diverting element 21 is connected to the output ends of the plurality of modulators 122, the output end of the light diverting element 21 is opposite to the input end of the light converging element 22, the output end of the light converging element 22 is connected to the optical transmission of the computing node 31
  • the medium 33 is opposite.
  • a plurality of demultiplexers 32 correspond to a plurality of computing nodes 31, and the demultiplexers 32 are connected to the optical waveguide, and a plurality of demultiplexers 32 corresponding to a row of computing nodes 31 are connected in series to the corresponding optical transmission on medium 33.
  • the light diverting element 21 is used to control the diversion of the multiple first optical signals output by the multiple modulators 122, that is, to divert the multiple first optical signals; the light converging element 22 is used to divert the diverted multiple first optical signals Converge into at least one second optical signal, transmit at least one second optical signal to the optical computing network unit; demultiplexer 32 is used to receive at least one second optical signal, and decouple at least one second optical signal.
  • the at least one second optical signal is N second optical signals
  • the N second optical signals are corresponding to the optical waveguides connected to N rows of computing nodes 31 transmitted to the optical computing network unit 30, and the optical computing network unit 30 calculates The number of rows of the node 31 is greater than or equal to N, where N is a positive integer.
  • the demultiplexer 32 corresponds to the computing node 31, and the demultiplexer 32 decouples the second optical signal transmitted by the optical transmission medium 33 corresponding to the row where the computing node 31 is located, and outputs the decoupled second optical signal to the corresponding computing node 31. first light signal.
  • the demultiplexer can decompose the optical signal corresponding to the calculation needs of the calculation node from the coupled composite optical signal.
  • the light redirecting element 21 includes liquid crystal on silicon
  • the liquid crystal on silicon includes a plurality of liquid crystal on silicon units 210
  • the plurality of liquid crystal on silicon units 210 correspond to multiple channels of first optical signals.
  • the propagating direction of each first optical signal is controllable by providing a liquid crystal unit for each first optical signal.
  • the light converging element 22 includes a diffraction grating, and the diffraction grating converges light incident from a specific direction into a beam, and then transmits it to a corresponding row of the optical computing network unit 30 .
  • Fig. 6 is a partial structural diagram of an optical computing system provided by some embodiments of the present application.
  • the optical computing system further includes a control device 150 .
  • the control device 150 is connected with the light turning element 21 and is used for controlling the voltage output to the liquid crystal on silicon unit 210 in the light turning element 21 .
  • the control device 150 is used to control the liquid crystal on silicon unit to realize at least one of the following controls:
  • Controlling the composition of the first optical signal converged into a second optical signal in the optical converging element that is, controlling which first optical signals will be converged together after arriving at the optical converging element;
  • the first computing node is any computing node, that is, control the first optical signal to be finally emitted to the optical computing network unit which location. Since the position of each optical signal converged by the light converging element is fixed to the optical computing network unit, it means that the first optical signal is controlled to be converged at the light converging element after being steered by the liquid crystal on silicon unit.
  • the corresponding relationship between input information and computing nodes can be controlled through the control device, light steering element and light converging element, so as to control which computing node the input information is transmitted to, and then the flexible configuration of the corresponding relationship between input information and computing nodes can be realized, making the system
  • the coefficients corresponding to each input information can be controlled to ensure the flexible configuration of convolution operations, such as using different convolution kernel coefficient matrices to perform convolution processing on images.
  • control device 150 in addition to controlling the light diverting element 21 , can also control the generation and modulation process of the light signal.
  • the demultiplexer 32 is connected to the optical transmission medium 33 arranged in the row direction. As shown in FIG. A multiplexer 32 , an input terminal and an output terminal of the demultiplexer 32 are connected to the optical transmission medium 33 , and the other output terminal of the demultiplexer 32 is connected to the computing node 31 .
  • the working process of the demultiplexer 32 is described below with the demultiplexer of the first row in Fig. 3 as an example:
  • the optical signals ⁇ 11, ⁇ 12... ⁇ 1n are output from the optical converging element 22 to the optical transmission medium 33 where the first demultiplexer 32 is located from left to right (following will be described in this order), and the first demultiplexer 32
  • the components ⁇ 11 are decoupled and output to the corresponding computing node a 11
  • the remaining parts ⁇ 12... ⁇ 1n are output to the second demultiplexer 32 in the same row.
  • the second demultiplexer 32 decouples the component ⁇ 12 and outputs it to the corresponding computing node a 12 , and outputs the remaining parts ⁇ 13... ⁇ 1n to the third demultiplexer 32 in the same row.
  • the demultiplexer 32 is connected to the optical transmission medium 33 arranged in the row direction. As shown in FIG. Multiplexer 32 , an input terminal of demultiplexer 32 , and an output terminal of demultiplexer 32 is connected to computing node 31 .
  • the difference between Fig. 6 and Fig. 5 mainly lies in that the inputs received by a plurality of demultiplexers 32 in a row in Fig. 5 are usually different, while in Fig. 6 the inputs received by a plurality of demultiplexers 32 in a row are The input is the same.
  • the optical computing network unit 30 may be one processing unit, or may be composed of multiple processing units.
  • an optical computing network may be composed of multiple optical processing units (optical processing units, OPUs), and each optical processing unit is a processing unit.
  • Each optical processing unit may contain multiple rows or columns of computing nodes.
  • each optical processing unit may correspond to one beam of converged light, or one optical processing unit may correspond to multiple beams of converged light.
  • the optical computing network unit 30 includes at least one optical processing unit, and transmits at least one second optical signal to the optical computing network unit 30, including:
  • At least one second optical signal is sent to the at least one optical processing unit.
  • the processing capability of the optical processing unit is generally determined by the number of computing nodes it contains, and according to the processing capability of each optical processing unit, it is determined whether at least one second optical signal is sent to one or more optical processing units.
  • Fig. 7 is a partial structural diagram of an optical computing system provided by some embodiments of the present application.
  • the optical computing network unit 30 in the optical computing system includes a plurality of OPUs 300, and the multiple second optical signals converged by the optical converging elements are sent to the multiple OPUs 300, and each OPU 300 receives one second optical signal. light signal.
  • Fig. 8 is a partial structural diagram of an optical computing system provided by some embodiments of the present application.
  • the optical computing network unit 30 in the optical computing system includes multiple OPUs, and the multiple second optical signals converged by the optical converging element are sent to one OPU, and the OPU receives the multiple second optical signals.
  • Figure 7 and Figure 8 show two possible implementations, the specific scheduling of the second optical signal can be controlled according to needs, for example, the control is converged into several second optical signals, and each second optical signal is transmitted to the optical computing network Where does the unit wait.
  • each OPU only shows one row of computing nodes 31 , but actually each OPU may include multiple rows of computing nodes 31 .
  • the optical computing system includes an optical signal providing unit, an optical distribution unit, and an optical computing network unit.
  • the optical distribution unit is an optional component, for example, the optical signal output by the optical signal providing unit through an optical fiber, etc. It is transmitted to the optical computing network unit.
  • the optical signal providing unit includes a light source unit and a modulation unit.
  • the structure of the optical computing system provided by these embodiments will be described below in conjunction with the accompanying drawings. It should be noted that the first optical signal and the second optical signal used in the following embodiments are only used to represent the optical signals in these embodiments. In a change process, the first optical signal in the following embodiments and the first optical signal defined in the embodiments provided above may be different optical signals.
  • Fig. 9 is a partial structural diagram of an optical computing system provided by some embodiments of the present application. It mainly shows the detailed structure of the modulation unit 12, the optical distribution unit 20, and the optical computing network unit 30, see FIG. 9:
  • the modulation unit 12 includes a plurality of couplers 121 and a plurality of modulators 122, the input end of the coupler 121 is connected to the output end of the light source unit 11, the output end of the coupler 121 is connected to the input end of the modulator 122, and the input end of the modulator 122 The output end is connected to the optical transmission medium 33 connected to the computing node 31 through the optical distribution unit 20 .
  • the structure of the optical calculation unit 40 can be referred to FIG. 7 and FIG. 8 , which will not be repeated here.
  • Multiple couplers 121 are used to couple multiple channels of first optical signals into multiple channels of second optical signals; multiplexers 122 are used to adopt multiple channels of first electrical signals to respectively modulate multiple channels of second optical signals to obtain For the modulated second optical signal, each first electrical signal is obtained by coupling multiple second electrical signals with different frequencies.
  • the number of required modulators is reduced, which is beneficial to reducing the size and cost of the entire optical computing system.
  • the first electrical signal may be generated by an electrical signal generating circuit.
  • the generation process of the first electrical signal will be described below in conjunction with FIG. 10 :
  • Fig. 10 is a schematic structural diagram of an electrical signal generating circuit provided by some embodiments of the present application.
  • the electric signal generating circuit includes a digital circuit 91 , multiple multipliers 92 , multiple radio frequency sources 93 and multiple digital to analog converters (digital to analog converter, DAC) 94.
  • the digital circuit 91 provides multiple channels of digital frequency signals with the same frequency, and each channel of digital frequency signals has carried input information; multiple multipliers 92 are used to convert the frequencies of these multiple channels of digital frequency signals, thereby obtaining multiple channels of different frequencies.
  • Digital frequency signal (second electrical signal); then utilize multiple radio frequency sources 93 to couple multiple digital frequency signals to obtain multiple coupled electrical signals; utilize multiple digital-to-analog converters 94 to convert the digital signal into an analog signal , to obtain multiple first electrical signals. In this way, the digital-to-analog conversion is performed after the electrical signal is coupled, which reduces the number of digital-to-analog converters and is beneficial to reduce the size and cost of the entire optical computing system.
  • the digital circuit that provides the digital frequency signal may be hardware that needs to perform convolution calculation, such as a graphics card, a processor, and the like.
  • all digital frequency signals can be converted into different frequencies, or the digital frequency signals that need to be coupled into one electrical signal can be converted into frequency according to the subsequent coupling relationship.
  • Different frequencies, and the frequencies of the digital frequency signals coupled into different circuit electrical signals after frequency conversion may be the same or different.
  • each modulated second optical signal is actually modulated by multiple second electrical signals at the same time, but when actually representing input information, each channel
  • the second optical signal only needs to correspond to one second electrical signal, so before passing through the conversion unit, the optical signal needs to be filtered to filter out components corresponding to redundant electrical signals during modulation.
  • the optical computing system may further include at least one filter 40 , usually there are multiple filters 40 , and the following descriptions will be made with multiple filters as an example.
  • Multiple filters 40 correspond to multiple computing nodes 31
  • the input terminals of the filters 40 are connected to the corresponding output terminals of the computing nodes 31
  • the output terminals of the filters 40 are connected to the conversion unit 50 .
  • the output terminals of the filters 40 corresponding to the computing nodes 31 in the same column are connected to the same conversion unit 50 .
  • Each filter 40 is configured to filter an optical signal output by a computing node, and retain a corresponding component of one of the multiple second electrical signals with different frequencies.
  • filtering is actually filtering out components of the optical signal.
  • the optical signal is modulated by multiple second electrical signals at the same time, so that the amplitude of the optical signal is the sum of the modulation results of the multiple second electrical signals.
  • the component modulated by the electrical signal other than the signal is filtered out.
  • frequencies of electrical signals corresponding to any two computing nodes 31 are different.
  • the frequencies of the electrical signals corresponding to some computing nodes 31 may be the same, for example, the wavelengths of the second optical signals corresponding to these computing nodes 31 are different.
  • the electrical signal modulates the optical signal, and what is modulated is the amplitude of the optical signal.
  • Multiple electrical signals modulate one optical signal at the same time, and the change in the amplitude of the optical signal is the sum of the amplitude changes of the multiple electrical signals.
  • the component modulated by the corresponding electrical signal is filtered out from the optical signal. That is to say, in the embodiment corresponding to FIG. 9 , although multiple electrical signals are used for simultaneous modulation during modulation, the correspondence between the input information carried by the electrical signals used for modulation and the computing nodes still exists.
  • the filter It is also performed according to the corresponding relationship, that is, except for components obtained by modulation of electrical signals used to carry input information corresponding to computing nodes, the rest are filtered out.
  • each first optical signal is modulated by the m ⁇ n electrical signals.
  • filter through the filter as follows:
  • the filtered optical signal is converted into electric signal.
  • the light distribution unit 20 may include a light diverting element and a light converging element.
  • the light distribution unit 20 may only include light diverting elements.
  • the light turning element is used to control the direction of the light signal output by the modulator.
  • the optical computing network unit 30 includes at least one optical processing unit, and the optical steering element 21 is configured to divert at least one second optical signal, so that the at least one second optical signal is sent to the at least one optical processing unit.
  • Fig. 11 is a partial structural diagram of an optical computing system provided by some embodiments of the present application. It mainly shows the detailed structure of the modulation unit 12, the optical distribution unit 20, and the optical computing network unit 30, see FIG. 9:
  • the modulation unit 12 includes a coupler 121 and a modulator 122, the input end of the coupler 121 is connected to the output end of the light source unit 11, the output end of the coupler 121 is connected to the input end of the modulator 122, and the output end of the modulator 122
  • the optical distribution unit 20 is connected to the optical transmission medium 33 connected to the computing node 31 .
  • the coupler 121 is used for coupling multiple first optical signals; the modulator 122 is used for using the first electrical signal to modulate the coupled multiple first optical signals, so that the multiple first optical signals are Modulate multiple channels of second optical signals, output the modulated optical signals, and obtain the first electrical signal by coupling multiple channels of second electrical signals with different frequencies.
  • the number of required modulators is reduced, which is beneficial to reducing the size and cost of the entire optical computing system.
  • the first electrical signal may be generated by an electrical signal generating circuit.
  • the generation process of the first electrical signal will be described below in conjunction with FIG. 12 :
  • Fig. 12 is a schematic structural diagram of an electrical signal generating circuit provided by some embodiments of the present application.
  • the electric signal generating circuit includes a digital circuit 91 , a plurality of multipliers 92 , a radio frequency source 93 and a digital-to-analog converter 94 .
  • the digital circuit 91 provides multiple channels of digital frequency signals with the same frequency, and each channel of digital frequency signals has carried input information; multiple multipliers 92 are used to convert the frequencies of these multiple channels of digital frequency signals, thereby obtaining multiple channels of different frequencies.
  • digital frequency signal (second electrical signal); then utilize radio frequency source 93 to couple multiple digital frequency signals to obtain a coupled electrical signal; utilize a digital-to-analog converter 94 to convert the digital signal into an analog signal to obtain a first electrical signal an electrical signal. In this way, the digital-to-analog conversion is performed after the electrical signal is coupled, which reduces the number of digital-to-analog converters and is beneficial to reduce the size and cost of the entire optical computing system.
  • the optical computing system also includes a filter 40 , and the description of FIG. 9 may be referred to.
  • the light distributing unit 20 may only include a light redirecting element.
  • Fig. 5 to Fig. 8 have introduced that the light distribution unit 20 can be composed of a light diverting element and a light converging element
  • Fig. 9 to Fig. 12 have introduced that the modulation unit 12 can be composed of a coupler 121 and a modulator 122
  • the above implementation manner of the optical distribution unit 20 and the implementation manner of the modulation unit 12 may be combined and applied in the same optical computing system.
  • Fig. 13 is a flow chart of an optical calculation method provided by some embodiments of the present application. Referring to Figure 13, the method includes:
  • the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
  • the multiple channels of first optical signals are provided by the aforementioned optical signal providing unit 10 , and the detailed process of this step can refer to the aforementioned description about the optical signal providing unit 10 .
  • Step 132 can be performed by the aforementioned light redirection element 21 , and for the detailed process of this step, reference can be made to the foregoing description about the light redirection element 21 .
  • the optical computing network unit includes at least one optical processing unit, and transmits at least one second optical signal to the optical computing network unit, including:
  • At least one second optical signal is sent to the at least one optical processing unit.
  • Step 133 can be performed by the aforementioned light converging element 22 , and for the detailed process of this step, reference can be made to the foregoing description of the light converging element 22 .
  • Step 134 may be performed by the aforementioned optical computing network unit 30 , and for the detailed process of this step, reference may be made to the foregoing description about the optical computing network unit 30 .
  • the method also includes:
  • At least one second optical signal is decoupled.
  • Fig. 14 is a flow chart of an optical calculation method provided by some embodiments of the present application. Referring to Figure 14, the method includes:
  • the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
  • the multiple channels of first light signals are provided by the light source unit 11 mentioned above, and the detailed process of this step can refer to the description about the light source unit 11 above.
  • Step 142 can be provided by the aforementioned coupler 121 , and for the detailed process of this step, reference can be made to the aforementioned description about the coupler 121 .
  • At least one first electrical signal is used to modulate at least one second optical signal to obtain a modulated second optical signal, and each first electrical signal in at least one first electrical signal is obtained by adjusting multiple channels with different frequencies. obtained by coupling the second electrical signal.
  • Step 143 may be provided by the aforementioned modulator 122 , and for the detailed process of this step, reference may be made to the aforementioned description about the modulator 122 .
  • Step 144 may be performed by the aforementioned optical computing network unit 30 , and for the detailed process of this step, reference may be made to the foregoing description about the optical computing network unit 30 .
  • the method also includes:
  • At least one second optical signal is decoupled.
  • the optical computing network unit includes at least one computing node, and the method further includes:
  • the optical signal output by at least one computing node is filtered, and a component corresponding to one of the multiple second electrical signals with different frequencies is retained.
  • optical calculation method provided in Figure 14 uses the same inventive concept as the optical calculation system provided in any one of Figures 9 to 12 above. Therefore, the details of the optical calculation method can refer to the previous Figures 9 to 12 correspond to the text descriptions and the drawings themselves.
  • Fig. 15 shows a schematic structural diagram of a control device 150 provided by an exemplary embodiment of the present application.
  • the control device 150 shown in FIG. 15 is used to execute the operations involved in the light calculation method shown in FIG. 13 or 14 above.
  • the control device 150 can be realized by a general bus architecture.
  • control device 150 includes at least one processor 151 , a memory 153 and at least one communication interface 154 .
  • the processor 151 is, for example, a general-purpose central processing unit (central processing unit, CPU), a digital signal processor (digital signal processor, DSP), a network processor (network processor, NP), a graphics processing unit (Graphics Processing Unit, GPU), A neural network processor (neural-network processing units, NPU), a data processing unit (Data Processing Unit, DPU), a microprocessor, or one or more integrated circuits for implementing the solution of this application.
  • the processor 151 includes an application-specific integrated circuit (application-specific integrated circuit, ASIC), a programmable logic device (programmable logic device, PLD) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof.
  • the PLD is, for example, a complex programmable logic device (complex programmable logic device, CPLD), a field-programmable gate array (field-programmable gate array, FPGA), a general array logic (generic array logic, GAL) or any combination thereof. It can realize or execute various logical blocks, modules and circuits described in conjunction with the disclosure of the embodiments of the present invention.
  • the processor may also be a combination that implements computing functions, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.
  • control device 150 further includes a bus.
  • the bus is used to transfer information between the various components of the control device 150 .
  • the bus may be a peripheral component interconnect standard (PCI for short) bus or an extended industry standard architecture (EISA for short) bus or the like.
  • PCI peripheral component interconnect standard
  • EISA extended industry standard architecture
  • the bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 15 , but it does not mean that there is only one bus or one type of bus.
  • the memory 153 is, for example, a read-only memory (read-only memory, ROM) or other types of static storage devices that can store static information and instructions, or a random access memory (random access memory, RAM) or a memory that can store information and instructions.
  • Other types of dynamic storage devices such as electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc Storage (including Compact Disc, Laser Disc, Optical Disc, Digital Versatile Disc, Blu-ray Disc, etc.), magnetic disk storage medium, or other magnetic storage device, or is capable of carrying or storing desired program code in the form of instructions or data structures and capable of Any other medium accessed by a computer, but not limited to.
  • the memory 153 exists independently, for example, and is connected to the processor 151 via a bus.
  • the memory 153 can also be integrated with the processor 151 .
  • the communication interface 154 uses any device such as a transceiver for communicating with other devices or a communication network.
  • the communication network can be Ethernet, radio access network (RAN) or wireless local area network (wireless local area networks, WLAN).
  • the communication interface 154 may include a wired communication interface, and may also include a wireless communication interface.
  • the communication interface 154 can be an Ethernet (Ethernet) interface, a Fast Ethernet (Fast Ethernet, FE) interface, a Gigabit Ethernet (Gigabit Ethernet, GE) interface, an Asynchronous Transfer Mode (Asynchronous Transfer Mode, ATM) interface, a wireless local area network ( wireless local area networks, WLAN) interface, cellular network communication interface or a combination thereof.
  • the Ethernet interface can be an optical interface, an electrical interface or a combination thereof.
  • the communication interface 154 may be used for the control device 150 to communicate with other devices.
  • the processor 151 may include one or more CPUs, such as CPU0 and CPU1 shown in FIG. 15 . Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor.
  • a processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (eg, computer program instructions).
  • control device 150 may include multiple processors, such as a processor 151 and a processor 155 as shown in FIG. 15 .
  • processors can be a single-core processor (single-CPU) or a multi-core processor (multi-CPU).
  • a processor herein may refer to one or more devices, circuits, and/or processing cores for processing data such as computer program instructions.
  • control device 150 may further include an output device and an input device.
  • Output devices are in communication with processor 151 and can display information in a variety of ways.
  • the output device may be a liquid crystal display (liquid crystal display, LCD), a light emitting diode (light emitting diode, LED) display device, a cathode ray tube (cathode ray tube, CRT) display device, or a projector (projector).
  • the input device is in communication with the processor 151 and can receive user input in a variety of ways.
  • the input device may be a mouse, a keyboard, a touch screen device, or a sensing device, among others.
  • the memory 153 is used to store the program code 1510 for implementing the solution of the present application, and the processor 151 can execute the program code 1510 stored in the memory 153 . That is, the control device 150 can implement the optical computing method provided by the method embodiment through the processor 151 and the program code 1510 in the memory 153 .
  • One or more software modules may be included in the program code 1510 .
  • the processor 151 itself may also store program codes or instructions for executing the solutions of the present application.
  • control device 150 in the embodiment of the present application may correspond to the control device in each method embodiment above, and the processor 151 in the control device 150 reads the instructions in the memory 153, so that the control shown in Fig. 15
  • the device 150 is capable of performing all or part of the operations performed by the control device.
  • the processor 151 is configured to provide multiple channels of first optical signals; divert the multiple channels of first optical signals; converge the diverted multiple channels of first optical signals into at least one channel of second optical signals, and transmit
  • the at least one second optical signal is sent to the optical computing network unit; the at least one second optical signal is modulated by the optical computing network unit.
  • each first electrical signal in the at least one first electrical signal is obtained by coupling multiple second electrical signals with different frequencies; At least one second optical signal is modulated.
  • each step of the optical calculation method shown in FIG. 13 or 14 is completed by an integrated logic circuit of hardware in the processor of the control device 150 or instructions in the form of software.
  • the steps of the method disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.
  • the software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register.
  • the storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware. To avoid repetition, no detailed description is given here.
  • the embodiment of the present application also provides a chip, including: an input interface, an output interface, a processor, and a memory, the input interface, the output interface, the processor, and the memory are connected through an internal connection path, and the processor is used to execute the code in the memory , when the code is executed, the processor is configured to execute any one of the above optical calculation methods.
  • processor may be a CPU, or other general-purpose processors, DSP, ASIC, FPGA or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like.
  • a general purpose processor may be a microprocessor or any conventional processor or the like. It should be noted that the processor may be a processor supporting the ARM architecture.
  • processors there are one or more processors and one or more memories.
  • the memory may be integrated with the processor, or the memory may be separated from the processor.
  • the above-mentioned memory may include read-only memory and random-access memory, and provides instructions and data to the processor.
  • Memory may also include non-volatile random access memory.
  • the memory may also store reference blocks and target blocks.
  • the memory can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory.
  • the non-volatile memory may be ROM, PROM, EPROM, EEPROM or flash memory.
  • Volatile memory can be RAM, which acts as external cache memory.
  • many forms of RAM are available. For example, SRAM, DRAM, SDRAM, DDR SDRAM, ESDRAM, SLDRAM, and DR RAM.
  • a computer-readable storage medium stores computer instructions.
  • the computer device executes the above-mentioned The light calculation method provided.
  • a computer program product including instructions is also provided, which, when running on a computer device, causes the computer device to execute the optical calculation method provided above.
  • all or part of them may be implemented by software, hardware, firmware or any combination thereof.
  • software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the present application will be generated in whole or in part.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server, or data center by wired (eg, coaxial cable, optical fiber, DSL) or wireless (eg, infrared, wireless, microwave, etc.) means.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media.
  • the available medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, DVD), or a semiconductor medium (for example, a Solid State Disk).
  • the program can be stored in a computer-readable storage medium.
  • the above-mentioned The storage medium mentioned may be a read-only memory, a magnetic disk or an optical disk, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Theoretical Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Neurology (AREA)
  • Optical Communication System (AREA)

Abstract

The present application provides an optical computing system, an optical computing method and a control apparatus, and belongs to the technical field of optical communications. The system comprises an optical signal providing unit, an optical distribution unit and an optical computing network unit, wherein the optical distribution unit comprises an optical steering element and an optical convergence element; the optical signal providing unit is used for providing a plurality of first optical signals; the optical steering element is used for steering the plurality of first optical signals; the optical convergence element is used for converging the plurality of steered first optical signals into at least one second optical signal, and for transmitting the at least one second optical signal to the optical computing network unit; and the optical computing network unit is used for receiving the at least one second optical signal, and for modulating the at least one second optical signal.

Description

光计算系统、光计算方法及控制装置Optical computing system, optical computing method and control device 技术领域technical field
本申请涉及光通信技术领域,特别涉及一种光计算系统、光计算方法及控制装置。The present application relates to the technical field of optical communication, and in particular to an optical computing system, an optical computing method and a control device.
背景技术Background technique
光计算系统是指利用光子作为介质进行计算的系统。与电子相比,光子具有高速度、高带宽、低功耗的优势,所以光计算系统更适合处理大规模卷积运算。An optical computing system refers to a system that uses photons as a medium for computing. Compared with electrons, photons have the advantages of high speed, high bandwidth, and low power consumption, so optical computing systems are more suitable for processing large-scale convolution operations.
光计算系统包括光信号提供单元和光计算网络单元,光信号提供单元提供多路光信号,多路光信号分别携带有多个输入信息,光计算网络单元具有多个计算节点,多个计算节点与多路光信号一一对应,计算节点按照预设的卷积核系数对对应的光信号进行幅值调制,以执行卷积核系数和输入信息的乘法运算。按照上述方式实现了多个输入信息构成的输入矩阵和多个卷积核系数构成的卷积核矩阵的卷积运算。The optical computing system includes an optical signal providing unit and an optical computing network unit. The optical signal providing unit provides multiple optical signals, and the multiple optical signals respectively carry multiple input information. The optical computing network unit has multiple computing nodes, and the multiple computing nodes communicate with The multi-channel optical signals correspond one-to-one, and the calculation node performs amplitude modulation on the corresponding optical signal according to the preset convolution kernel coefficient, so as to perform the multiplication operation of the convolution kernel coefficient and the input information. The convolution operation of the input matrix composed of a plurality of input information and the convolution kernel matrix composed of a plurality of convolution kernel coefficients is realized in the above manner.
相关技术中,调制单元的多路光信号和计算节点存在一一对应的关系,进行相乘的卷积核系数和输入信息的对应关系较为固定,导致该光计算系统难以满足一些场景下的卷积计算需求。In related technologies, there is a one-to-one correspondence between the multi-channel optical signals of the modulation unit and the computing nodes, and the corresponding relationship between the multiplied convolution kernel coefficients and the input information is relatively fixed, which makes it difficult for the optical computing system to meet the volume requirements in some scenarios. Cumulative computing needs.
发明内容Contents of the invention
本申请提供了一种光计算系统、光计算方法及控制装置,所述技术方案如下:The present application provides an optical computing system, an optical computing method and a control device, and the technical solution is as follows:
一方面,提供了一种光计算系统,包括光信号提供单元、光分配单元和光计算网络单元,光分配单元包括光转向元件和光汇聚元件。In one aspect, an optical computing system is provided, including an optical signal providing unit, an optical distribution unit, and an optical computing network unit, where the optical distribution unit includes an optical steering element and an optical converging element.
其中,光信号提供单元用于提供多路第一光信号;光转向元件用于对多路第一光信号进行转向;光汇聚元件用于将转向后的多路第一光信号汇聚成至少一路第二光信号,发射至少一路第二光信号至光计算网络单元;光计算网络单元用于接收至少一路第二光信号,并对至少一路第二光信号进行调制。Wherein, the optical signal providing unit is used to provide multiple channels of first optical signals; the optical diverting element is used to divert multiple channels of first optical signals; the optical converging element is used to converge the diverted multiple channels of first optical signals into at least one channel The second optical signal transmits at least one second optical signal to the optical computing network unit; the optical computing network unit is configured to receive at least one second optical signal and modulate at least one second optical signal.
在本申请提供的光计算系统中,光信号提供单元提供多路光信号,通过光转向元件和光汇聚元件可以控制光信号对应关系的转向和汇聚,从而控制光信号携带的输入信息被传输到光计算网络单元的哪个计算节点,进而能够实现输入信息和卷积核系数的对应关系的灵活配置,使得该系统在进行卷积计算时,能够控制每个输入信息对应的系数,保证实现卷积运算的灵活配置,例如采用不同的卷积核系数矩阵对图像进行卷积处理等,能够满足各种场景下的卷积计算需求。In the optical computing system provided in this application, the optical signal providing unit provides multiple optical signals, and the steering and convergence of the corresponding relationship of the optical signals can be controlled through the optical steering element and the optical converging element, thereby controlling the input information carried by the optical signal to be transmitted to the optical Calculate which computing node of the network unit, and then realize the flexible configuration of the corresponding relationship between the input information and the convolution kernel coefficient, so that the system can control the coefficient corresponding to each input information when performing convolution calculation, so as to ensure the realization of the convolution operation The flexible configuration, such as using different convolution kernel coefficient matrices to convolute images, can meet the convolution calculation requirements in various scenarios.
在一些可能的实现方式中,光信号提供单元包括光源单元和调制单元,光计算网络单元包括至少一个计算节点和至少一个解复用器,通常计算节点和解复用器的数量均为多个,以多个为例,多个计算节点分为多组。In some possible implementation manners, the optical signal providing unit includes a light source unit and a modulation unit, and the optical computing network unit includes at least one computing node and at least one demultiplexer, and usually there are multiple computing nodes and demultiplexers, Taking multiple as an example, multiple computing nodes are divided into multiple groups.
其中,光源单元用于提供多路第三光信号;调制单元用于接收多路第三光信号,对多路第三光信号进行调制,得到多路第一光信号,第一光信号携带有输入信息;光转向元件用于 控制多路第一光信号的方向;光汇聚元件用于将通过光转向元件的多路第一光信号汇聚成至少一路第二光信号;解复用器接收至少一路第二光信号,且对至少一路第二光信号进行解耦,将解耦得到的第一光信号输出给计算节点,计算节点对接收到的第一光信号的幅值进行调制。Wherein, the light source unit is used to provide multiple channels of third optical signals; the modulation unit is used to receive multiple channels of third optical signals and modulate the multiple channels of third optical signals to obtain multiple channels of first optical signals, and the first optical signals carry Input information; the light steering element is used to control the direction of multiple first optical signals; the light converging element is used to converge the multiple first optical signals passing through the light steering element into at least one second optical signal; the demultiplexer receives at least one A second optical signal, and at least one second optical signal is decoupled, and the decoupled first optical signal is output to a computing node, and the computing node modulates the amplitude of the received first optical signal.
在本申请提供的光计算系统中,光源单元提供多路光信号,通过调制单元对这多路光信号进行第一步调制,第一次调制后的光信号的幅值用来表示输入信息,也即将输入信息调制到光信号上,为该输入信息的计算做准备;在经过第一步调制之后,通过光分配单元将第一次调制后的光信号分配给光计算网络中的各个计算节点,也即通过对光信号进行转向和汇聚,使之被发送给光计算网络单元,光计算网络单元包括解复用器和计算节点,对于接收到的光信号,先通过解复用器进行解耦,使被光汇聚元件汇聚到一起的光信号分开,使得每个计算节点分配到携带有对应的输入信息的光信号,由这多个计算节点完成对这些光信号的第二次调制,第二次调制也是幅值调制,第二次调制之后的光信号的幅值表示输入信息乘以一个系数之后的大小。上述两步计算完成了卷积运算中的乘法部分。在上述过程中,通过光转向元件和光汇聚元件可以控制输入信息和计算节点的对应关系,从而控制输入信息被传输到哪个计算节点,进而能够实现输入信息和卷积核系数的对应关系的灵活配置。In the optical computing system provided in this application, the light source unit provides multiple optical signals, and the modulation unit performs the first modulation on the multiple optical signals, and the amplitude of the optical signal after the first modulation is used to represent the input information. That is, the input information is modulated onto the optical signal to prepare for the calculation of the input information; after the first step of modulation, the first modulated optical signal is distributed to each computing node in the optical computing network through the optical distribution unit , that is, by steering and converging the optical signal, it is sent to the optical computing network unit. The optical computing network unit includes a demultiplexer and a computing node. For the received optical signal, it is demultiplexed by the demultiplexer first. coupling, so that the optical signals converged by the optical converging element are separated, so that each computing node is distributed to the optical signal carrying the corresponding input information, and these multiple computing nodes complete the second modulation of these optical signals. Secondary modulation is also amplitude modulation, and the amplitude of the optical signal after the second modulation represents the magnitude of the input information multiplied by a coefficient. The above two-step calculation completes the multiplication part in the convolution operation. In the above process, the corresponding relationship between the input information and the computing node can be controlled through the light steering element and the light converging element, so as to control which computing node the input information is transmitted to, and then the flexible configuration of the corresponding relationship between the input information and the convolution kernel coefficient can be realized .
以图像的卷积运算为例,光计算网络中各个计算节点的卷积核系数构成卷积核系数矩阵,多路第一光信号携带的输入信息构成输入像素幅值矩阵。通过光转向元件和光汇聚元件,可以将像素幅值矩阵输入到设定的计算节点上,设定的计算节点的规模及位置是可变的,也即采用不同尺寸的卷积核系数矩阵进行图像卷积处理。Taking the image convolution operation as an example, the convolution kernel coefficients of each computing node in the optical computing network form a convolution kernel coefficient matrix, and the input information carried by multiple first optical signals forms an input pixel amplitude matrix. Through the light steering element and the light converging element, the pixel amplitude matrix can be input to the set calculation node. The scale and position of the set calculation node are variable, that is, the convolution kernel coefficient matrix of different sizes is used to perform image processing. Convolution processing.
在一些可能的实施方式中,光信号提供单元提供的第一光信号的路数与光计算网络单元中计算节点的数量相同。In some possible implementation manners, the number of channels of the first optical signal provided by the optical signal providing unit is the same as the number of computing nodes in the optical computing network unit.
通过光转向元件、光汇聚元可以将每路第一光信号一一对应的分配给各个计算节点。也可以仅对其中一部分第一光信号进行转向和汇聚,使部分第一光信号被分配给部分计算节点。Each path of the first optical signal can be allocated to each computing node in a one-to-one correspondence through the light steering element and the light converging element. It is also possible to divert and converge only a part of the first optical signals, so that part of the first optical signals are distributed to some computing nodes.
在另一些可能的实施方式中,光信号提供单元提供的第一光信号的路数与光计算网络单元中计算节点的数量不同,例如第一光信号的路数大于计算节点的数量,或者第一光信号的路数小于计算节点的数量。In some other possible implementation manners, the number of paths of the first optical signal provided by the optical signal providing unit is different from the number of computing nodes in the optical computing network unit, for example, the number of paths of the first optical signal is greater than the number of computing nodes, or the number of paths of the first optical signal is greater than the number of computing nodes, or The number of paths of an optical signal is less than the number of computing nodes.
通过光转向元件、光汇聚元件可以对全部或者部分第一光信号进行转向和汇聚,然后分配给全部计算节点或部分计算节点。All or part of the first optical signals can be diverted and converged by the light diverting element and the light converging element, and then distributed to all or part of the computing nodes.
在上述光计算过程中,存在将多路第一光信号汇聚到一起的情况,后续在光计算网络单元中再分解出需要的第一光信号。为了保证被汇聚到一起的第一光信号能够再分解,需要保证各路第一光信号波长或者模式不同。In the above-mentioned optical computing process, there are cases where multiple first optical signals are gathered together, and then the required first optical signals are decomposed in the optical computing network unit. In order to ensure that the aggregated first optical signals can be re-decomposed, it is necessary to ensure that the wavelengths or modes of the first optical signals are different from each other.
在本申请的一些实施方式中,多路第一光信号同时存在波长和模式两个维度不同的情况,也即两路第一光信号的波长和模式中的至少一个不同。In some embodiments of the present application, the multiple first optical signals are different in wavelength and mode at the same time, that is, at least one of the wavelength and mode of the two first optical signals is different.
示例性地,多路第一光信号包括第一路光信号、第二路光信号和第三路光信号,第一路光信号和第二路光信号的模式不同,第二路光信号和第三路光信号的波长不同。这样,从波长和模式两个维度来提供不同光信号,从而使得该光计算网络能够支持更大规模的卷积运算,使得该光计算系统的应用更加广泛。Exemplarily, the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different. In this way, different optical signals are provided from two dimensions of wavelength and mode, so that the optical computing network can support larger-scale convolution operations, making the optical computing system more widely used.
在本申请的另一种实施方式中,多路第一光信号仅存在波长或模式一个维度不同的情况,这里不再赘述。In another implementation manner of the present application, the multiple first optical signals differ only in one dimension of wavelength or mode, which will not be repeated here.
值得说明的是,在本申请中,光的模式不同是指横模模式不同,例如LP00、LP01、LP10 等。在光学领域,光的波长对应的是光的纵模。It should be noted that, in the present application, different light modes refer to different transverse mode modes, such as LP00, LP01, LP10, and the like. In the field of optics, the wavelength of light corresponds to the longitudinal mode of light.
下面给出多路第一光信号同时存在波长和模式两个维度不同的情况时,光源单元的实现方式。The implementation of the light source unit is given below when multiple channels of first optical signals are simultaneously different in two dimensions: wavelength and mode.
在一些可能的实施方式中,光源单元包括多波长光源和多个模式转换器。In some possible implementations, the light source unit includes a multi-wavelength light source and multiple mode converters.
其中,多波长光源用于提供多路波长不同的第四光信号;每个模式转换器用于接收多路波长不同的第四光信号中的一路第四光信号,并用于将接收到的一路第四光信号转换成多路模式不同的第三光信号,从而得到多路第三光信号,且其中任意两路波长不同,或者模式不同,或者波长和模式均不同。Wherein, the multi-wavelength light source is used to provide multiple channels of fourth optical signals with different wavelengths; each mode converter is used to receive one of the multiple channels of fourth optical signals with different wavelengths, and is used to convert the received channel of the fourth optical signal to The four optical signals are converted into multiple third optical signals with different modes, thereby obtaining multiple third optical signals, and any two of the third optical signals have different wavelengths, or different modes, or both different wavelengths and modes.
在另一些可能的实施方式中,光源单元包括多模式光源和多个模式转换器。In some other possible implementation manners, the light source unit includes a multi-mode light source and multiple mode converters.
其中,多模式光源用于提供多路模式不同的第四光信号;每个模式转换器用于接收多路模式不同的第四光信号中的一路第四光信号,并用于将接收到的一路第四光信号转换成多路波长不同的第三光信号。值得说明的是,在前一种光源单元的实现方式中,模式转换器的作用是对光的横模模式进行转换,从而将一束光转换成多束波长相同模式不同的光。而在这种光源单元的实现方式中,模式转换器的作用是对光的纵模模式进行转换,从而将一束光转换成多束模式相同波长不同的光。Wherein, the multi-mode light source is used to provide multiple fourth optical signals with different modes; each mode converter is used to receive one fourth optical signal among the multiple fourth optical signals with different modes, and is used to convert the received one fourth optical signal to The four optical signals are converted into multiple channels of third optical signals with different wavelengths. It is worth noting that, in the former implementation of the light source unit, the function of the mode converter is to convert the transverse mode of light, so as to convert one beam of light into multiple beams of light with the same wavelength and different modes. However, in this implementation of the light source unit, the function of the mode converter is to convert the longitudinal mode of light, so as to convert one beam of light into multiple beams of light with the same mode and different wavelengths.
通过上述两种实现方式均能够提供多路同时存在波长和模式两个维度不同的光信号,从而使得该光计算网络能够支持更大规模的卷积运算,使得该光计算系统的应用更加广泛。Both of the above two implementation methods can provide multiple optical signals with different wavelengths and modes at the same time, so that the optical computing network can support larger-scale convolution operations, making the optical computing system more widely used.
在一些可能的实施方式中,调制单元包括多个调制器,每个调制器用于对一路第三光信号进行调制,例如,采用一路电信号调制对应的第三光信号,以将电信号承载的输入信息调制到第三光信号上,得到第一光信号。这里的每路第一光信号仅包括一路第三光信号调制而来的分量。调制器是电光转换器件,通过电信号控制调制器的偏置电压,对输入的光信号的幅值进行调制,使其能够表示出电信号所携带的输入信息。In some possible implementation manners, the modulating unit includes a plurality of modulators, and each modulator is used to modulate a third optical signal, for example, modulate a corresponding third optical signal with an electrical signal, so that the electrical signal carries The input information is modulated onto the third optical signal to obtain the first optical signal. Here, each channel of the first optical signal only includes a component modulated by the channel of the third optical signal. The modulator is an electro-optical conversion device. The bias voltage of the modulator is controlled by an electrical signal, and the amplitude of the input optical signal is modulated so that it can represent the input information carried by the electrical signal.
示例性地,调制器和第三光信号可以是一对一设置的。Exemplarily, the modulator and the third optical signal may be set one-to-one.
示例性地,调制器和第三光信号可以不是一对一设置的,例如调制器的数量少于第三光信号的数量,或者调制器的数量多于第三光信号的数量。Exemplarily, the modulators and the third optical signals may not be arranged one-to-one, for example, the number of modulators is less than that of the third optical signals, or the number of modulators is greater than that of the third optical signals.
在另一些可能的实施方式中,调制单元包括多个耦合器和多个调制器,每个耦合器可以对应一个调制器。In some other possible implementation manners, the modulation unit includes multiple couplers and multiple modulators, and each coupler may correspond to one modulator.
多个耦合器用于将多路第三光信号耦合成多路第五光信号;多个调制器用于采用多路第一电信号,分别对多路第五光信号进行调制,得到多路第一光信号,每路第一电信号是通过对多路频率不同的第二电信号进行耦合得到的。这里的每路第一光信号包括多路第三光信号调制而来的分量,这种情况下,后续光处理网络单元中的计算节点对第一光信号调制都是针对第一光信号的一个分量。Multiple couplers are used to couple multiple channels of third optical signals into multiple channels of fifth optical signals; multiple modulators are used to use multiple channels of first electrical signals to respectively modulate multiple channels of fifth optical signals to obtain multiple channels of first optical signals. For the optical signal, each first electrical signal is obtained by coupling multiple second electrical signals with different frequencies. Here, each first optical signal includes components modulated by multiple third optical signals. In this case, the calculation node in the subsequent optical processing network unit modulates the first optical signal for one of the first optical signals. portion.
示例性地,每个耦合器对应的多路第三光信号可以是携带光计算网络单元中一行或几行计算节点对应的输入信息的光信号,被一个耦合器耦合的多路第三光信号在波长或模式上可以没有特殊要求。当然,也可以让同一波长或者同一模式的多路第三光信号携带光计算网络单元中一行或几行计算节点对应的输入信息,然后通过一个耦合器进行耦合。Exemplarily, the multiple third optical signals corresponding to each coupler may be optical signals carrying input information corresponding to one or several rows of computing nodes in the optical computing network unit, and the multiple third optical signals coupled by one coupler There may be no special requirements on wavelength or mode. Of course, multiple third optical signals of the same wavelength or mode can also be used to carry the input information corresponding to one or several rows of computing nodes in the optical computing network unit, and then be coupled through a coupler.
在这种实现方式下,由于先对第三光信号进而了耦合,然后再对耦合的光信号进行调制,因此减少了需求的调制器的数量,有利于降低整个光计算系统的尺寸和成本。In this implementation manner, since the third optical signal is coupled first, and then the coupled optical signal is modulated, the number of required modulators is reduced, which is beneficial to reducing the size and cost of the entire optical computing system.
下面对第一电信号的产生过程进行说明:The generation process of the first electrical signal is described below:
首先由数字电路提供多路频率相同的数字频率信号,每路数字频率信号上已经携带了输入信息;利用多个乘法器对这多路数字频率信号的频率进行变频,从而得到多路频率不同的数字频率信号(第二电信号);再利用射频源对多路数字频率信号进行耦合,得到多路耦合后的电信号;利用数模转换器将数字信号转换为模拟信号,得到多路第一电信号。这种方式下电信号是耦合后再进行的数模转换,减少了数模转换器的数量,有利于降低整个光计算系统的尺寸和成本。First, the digital circuit provides multiple digital frequency signals with the same frequency, and each digital frequency signal has already carried input information; multiple multipliers are used to convert the frequency of the multiple digital frequency signals to obtain multiple channels with different frequencies. Digital frequency signal (second electrical signal); then use the radio frequency source to couple multiple digital frequency signals to obtain multiple coupled electrical signals; use a digital-to-analog converter to convert the digital signal into an analog signal to obtain multiple first electric signal. In this way, the digital-to-analog conversion is performed after the electrical signal is coupled, which reduces the number of digital-to-analog converters and is beneficial to reduce the size and cost of the entire optical computing system.
其中,提供数字频率信号的数字电路可以是需要进行卷积计算的硬件,例如显卡、处理器等。Wherein, the digital circuit that provides the digital frequency signal may be hardware that needs to perform convolution calculation, such as a graphics card, a processor, and the like.
值得说明的是,上述采用乘法器进行变频的过程中,既可以将所有的数字频率信号变频成不同的频率,也可以按照后续耦合的关系,将需要耦合成一路电信号的数字频率信号变频成不同的频率,而耦合成不同路电信号的数字频率信号变频后的频率可以相同,也可以不相同。It is worth noting that in the above-mentioned process of frequency conversion using a multiplier, all digital frequency signals can be converted into different frequencies, or the digital frequency signals that need to be coupled into one electrical signal can be converted into frequency according to the subsequent coupling relationship. Different frequencies, and the frequencies of the digital frequency signals coupled into different circuit electrical signals after frequency conversion may be the same or different.
由于采用上述耦合而成的电信号对光信号进行调制时,被调制得到的每路第一光信号实际都同时经过了多路第二电信号的调制,但实际在表示输入信息时,每路第一光信号只需要对应一路第二电信号,所以在在经过光计算网络单元之后,需要对光信号进行滤波处理,将调制时多余的电信号对应的成分滤除。When the above coupled electrical signal is used to modulate the optical signal, each modulated first optical signal is actually modulated by multiple second electrical signals at the same time, but when actually representing input information, each The first optical signal only needs to correspond to one second electrical signal, so after passing through the optical computing network unit, the optical signal needs to be filtered to filter out components corresponding to redundant electrical signals during modulation.
示例性地,光计算系统,还包括至少一个滤波器。Exemplarily, the optical computing system further includes at least one filter.
每个滤波器用于对至少一个计算节点输出的光信号进行滤波,保留多路频率不同的第二电信号中的一路对应的分量。这里,滤波实际是滤除光信号的成分。在调制单元调制时,光信号同时被多路第二电信号调制,使得光信号的幅值是这多路第二电信号调制的结果之和,因此,需要将除了计算节点对应的第二电信号之外的电信号调制而成的成分滤除。Each filter is used to filter the optical signal output by at least one computing node, and retain a component corresponding to one of the multiple second electrical signals with different frequencies. Here, filtering is actually filtering out components of the optical signal. When modulated by the modulation unit, the optical signal is modulated by multiple second electrical signals at the same time, so that the amplitude of the optical signal is the sum of the modulation results of the multiple second electrical signals. The component modulated by the electrical signal other than the signal is filtered out.
在另一些可能的实现方式中,光信号提供单元包括多波长光源和多个模式转换器,或者,光信号提供单元包括多模式光源和多个模式转换器,详细内容参见前文关于光源单元的描述。值得说明的是,多个模式转换器对多波长光源或多模式光源输出的光信号进行转换,得到多路模式不同的光信号,或者多路波长不同的光信号,这多路模式不同的光信号或者多路波长不同的光信号用于产生多路第一光信号。In some other possible implementations, the optical signal providing unit includes a multi-wavelength light source and multiple mode converters, or the optical signal providing unit includes a multi-mode light source and multiple mode converters. For details, refer to the previous description about the light source unit. . It is worth noting that multiple mode converters convert the optical signals output by the multi-wavelength light source or multi-mode light source to obtain multiple optical signals with different modes, or multiple optical signals with different wavelengths. The signal or multiple optical signals with different wavelengths are used to generate multiple first optical signals.
示例性地,光信号提供单元可以还包括调制单元,用于对多个模式转换器输出的光信号进行调制,从而产生多路第一光信号。Exemplarily, the optical signal providing unit may further include a modulating unit, configured to modulate the optical signals output by the multiple mode converters, so as to generate multiple channels of first optical signals.
示例性地,光信号提供单元可以不包括调制单元,多个模式转换器输出的光信号无需再经过调制单元的调制,已经实现在光信号上携带输入信息,也即输出即为多路第一光信号。Exemplarily, the optical signal supply unit may not include a modulation unit, and the optical signals output by multiple mode converters do not need to be modulated by the modulation unit, and the input information has been carried on the optical signal, that is, the output is a multi-channel first light signal.
示例性地,光转向元件包括硅基液晶单元。光转向元件可以包括多个硅基液晶单元,每个硅基液晶单元接收一路调制单元输出的光信号,控制光信号的传播方向,例如控制光信号转向,或者不改变光信号的方向等。硅基液晶单元是电压驱动元件,通过控制液晶单元的电压,改变其所处电场,使液晶的偏转方向发生变化,从而改变经过该液晶单元的光线的传播路径。Exemplarily, the light redirecting element comprises a liquid crystal on silicon cell. The light diverting element may include a plurality of liquid crystal on silicon units, and each liquid crystal on silicon unit receives an optical signal output by a modulation unit, and controls the propagation direction of the optical signal, for example, controls the steering of the optical signal, or does not change the direction of the optical signal. The liquid crystal on silicon cell is a voltage-driven element. By controlling the voltage of the liquid crystal cell and changing its electric field, the deflection direction of the liquid crystal is changed, thereby changing the propagation path of light passing through the liquid crystal cell.
光转向元件中硅基液晶单元的数量可以和调制单元输出的光信号的数量相等,光转向元件中硅基液晶单元的数量也可以大于调制单元输出的光信号的数量。The number of liquid crystal on silicon cells in the light steering element can be equal to the number of light signals output by the modulation unit, and the number of liquid crystal on silicon cells in the light steering element can also be greater than the number of light signals output by the modulation unit.
示例性地,光汇聚元件包括衍射光栅,衍射光栅将特定方向射入的光汇聚成一束,然后发射到光计算网络单元,采用衍射光栅作为光汇聚元件,使得光汇聚元件的结构较为简单, 从而能够降低整个光计算系统的体积。Exemplarily, the light converging element includes a diffraction grating, and the diffraction grating converges the light incident in a specific direction into a beam, and then transmits it to the optical computing network unit. Using the diffraction grating as the light converging element makes the structure of the light converging element relatively simple, thereby The volume of the entire optical computing system can be reduced.
在一些可能的实施方式中,通过改变施加给硅基液晶单元的电压,从而能够实现对光信号传播方向的灵活调整。In some possible implementation manners, by changing the voltage applied to the liquid crystal on silicon cell, it is possible to flexibly adjust the propagation direction of the optical signal.
示例性地,光计算系统还包括控制装置。Exemplarily, the optical computing system further includes a control device.
控制装置用于控制硅基液晶单元以实现如下至少一项控制:The control device is used to control the liquid crystal on silicon cell to realize at least one of the following controls:
控制在光汇聚元件中汇聚成一束光(一路第二光信号)的第一光信号的组成,也即是控制哪些第一光信号到达光汇聚元件后会被汇聚到一起;Controlling the composition of the first optical signal converged into a beam of light (one second optical signal) in the light converging element, that is, controlling which first optical signals will be converged together after arriving at the light converging element;
控制通过光汇聚元件被发送给光计算网络单元中第一计算节点的第一光信号,第一计算节点为任一计算节点,也即是控制第一光信号最终被射出到光计算网络单元的哪个位置。由于光汇聚元件汇聚而成的每一路光信号出射到光计算网络单元中的位置是固定的,因此,也即是控制第二光信号通过硅基液晶单元转向后在光汇聚元件哪里实现汇聚。Control the first optical signal sent to the first computing node in the optical computing network unit through the optical converging element, the first computing node is any computing node, that is, control the first optical signal to be finally emitted to the optical computing network unit which location. Since the position of each optical signal converged by the light converging element is fixed to the optical computing network unit, it is controlled where the second optical signal is diverted through the liquid crystal on silicon unit to achieve converging at the optical converging element.
下面结合光计算网络单元的结构,对光信号的转向控制进行说明:The steering control of the optical signal is described below in combination with the structure of the optical computing network unit:
如前所述,光计算网络单元包括多个计算节点,多个计算节点阵列式排布,也即分为多行和多列,其中,一行或者一列计算节点构成前文中的一组。下面以一列计算节点为一组为例。As mentioned above, the optical computing network unit includes multiple computing nodes arranged in an array, that is, divided into multiple rows and columns, wherein one row or one column of computing nodes constitutes a group in the above. The following takes a column of compute nodes as a group as an example.
在一些可能的实施方式中,一行计算节点对应的第一光信号通过光转向元件被发射到光汇聚元件的特定位置,通过光汇聚元件被汇聚成一束光,然后通过光汇聚元件发射到光计算网络单元中的一行。一行计算节点通过光传输介质连接,从而使得一行计算节点都能获得对应的光信号。In some possible implementations, the first optical signal corresponding to a row of computing nodes is transmitted to a specific position of the light converging element through the light steering element, converged into a beam of light through the light converging element, and then transmitted to the optical computing device through the light converging element. A row in a network element. A row of computing nodes is connected through an optical transmission medium, so that a row of computing nodes can obtain corresponding optical signals.
例如,光汇聚元件将转向后的多路第一光信号汇聚成N束光(N路第二光信号),N束光一一对应发射到光计算网络单元的N行计算节点连接的光传输介质,N为正整数。For example, the optical converging element converges the diverted multiple first optical signals into N beams (N second optical signals), and the N beams of light correspond to the optical transmissions that are sent to the N rows of computing nodes connected to the optical computing network unit. Medium, N is a positive integer.
在另一些可能的实施方式中,多行计算节点对应的第一光信号通过光转向元件被发射到光汇聚元件的特定位置,通过光汇聚元件被汇聚成一束光,然后通过光汇聚元件发射到光计算网络单元中的多行。多行计算节点通过光传输介质连接,从而使得多行或多列计算节点都能获得对应的光信号。In some other possible implementation manners, the first optical signals corresponding to multiple rows of computing nodes are transmitted to a specific position of the light converging element through the light diverting element, converged into a beam of light through the light converging element, and then transmitted to the Multiple rows in optical computing network units. Multiple rows of computing nodes are connected through an optical transmission medium, so that multiple rows or columns of computing nodes can obtain corresponding optical signals.
这里,汇聚而成的光信号被发送给光计算网络单元后,由解复用器进行解耦,并向对应的计算节点输出解耦得到的第一光信号。Here, after the aggregated optical signal is sent to the optical computing network unit, the demultiplexer performs decoupling, and outputs the decoupled first optical signal to the corresponding computing node.
以一行计算节点对应一束汇聚而成的光为例,每个计算节点通过一个解复用器连接到该行的光传输介质上,该解复用器能够接收光信号并解耦得到对应的第一光信号。Taking a row of computing nodes corresponding to a bundle of converged light as an example, each computing node is connected to the optical transmission medium of the row through a demultiplexer, which can receive the optical signal and decouple it to obtain the corresponding first light signal.
示例性地,光计算网络单元可以为一个处理单元,也可以由多个处理单元组成。例如,光计算网络可以由多个光学处理单元组成,每个光学处理单元即为一个处理单元。每个光学处理单元可以包含多行或多列计算节点以及多个解复用器,在进行光分配时,可以每个光学处理单元对应一束汇聚而成的光,或者一个光学处理单元对应多束汇聚而成的光。Exemplarily, the optical computing network unit may be one processing unit, or may be composed of multiple processing units. For example, the optical computing network may be composed of multiple optical processing units, and each optical processing unit is a processing unit. Each optical processing unit can contain multiple rows or columns of computing nodes and multiple demultiplexers. When performing light distribution, each optical processing unit can correspond to a beam of converged light, or one optical processing unit can Converging beams of light.
也即,光计算网络单元包括至少一个光学处理单元,发射至少一路第二光信号至光计算网络单元,包括:That is, the optical computing network unit includes at least one optical processing unit, and transmits at least one second optical signal to the optical computing network unit, including:
根据至少一个光学处理单元的处理能力,发射至少一路第二光信号至至少一个光学处理单元。According to the processing capability of the at least one optical processing unit, at least one second optical signal is sent to the at least one optical processing unit.
其中,光学处理单元的处理能力通常由它所包含的计算节点数量决定,根据每个光学处理单元的处理能力,确定至少一路第二光信号是发送给一个还是多个光学处理单元,从而使 得光学计算系统根据需要来分配光学处理单元进行光信号的处理,从而避免提供的光学处理单元的处理能力过剩或者不足。Wherein, the processing capability of the optical processing unit is usually determined by the number of computing nodes it contains, and according to the processing capability of each optical processing unit, it is determined whether at least one second optical signal is sent to one or more optical processing units, so that the optical The computing system allocates the optical processing unit to process the optical signal according to needs, so as to avoid excess or insufficient processing capacity of the provided optical processing unit.
示例性地,计算节点包括调制器。或者,计算节点包括相变材料,相变材料用于对接收到的光信号的幅值进行调制。Exemplarily, a computing node includes a modulator. Alternatively, the compute node includes a phase change material for modulating the amplitude of the received optical signal.
无论是那种方式实现的计算节点,计算节点都是按照卷积核系数对对应的第一光信号进行幅值调制,以执行卷积核系数和对应的第一光信号上的输入信息的乘法运算,多个计算节点与多个卷积核系数一一对应。Regardless of the computing node implemented in that way, the computing node performs amplitude modulation on the corresponding first optical signal according to the convolution kernel coefficient to perform multiplication of the convolution kernel coefficient and the input information on the corresponding first optical signal Operation, multiple computing nodes correspond to multiple convolution kernel coefficients one by one.
可选地,该光计算系统还包括:转换单元,用于将光计算网络单元输出的光信号相加并转换为电信号。通过转换单元进行同一组乘法计算结果的相加,并将其转换成电信号输出,使得计算结果能够应用在后续电处理单元的计算中。Optionally, the optical computing system further includes: a converting unit, configured to add and convert the optical signals output by the optical computing network unit into electrical signals. The same group of multiplication calculation results are added through the conversion unit, and converted into an electrical signal output, so that the calculation result can be applied to the calculation of the subsequent electrical processing unit.
示例性地,转换单元包括多个光电转换器,每个光电转换器对应一组计算节点,这一组计算节点的输出连接同一个光电转换器的输入,光电转换器对这一组计算节点输出的光信号进行光电转换,实现前文中的光信号相加及转换。Exemplarily, the conversion unit includes a plurality of photoelectric converters, each photoelectric converter corresponds to a group of computing nodes, the output of this group of computing nodes is connected to the input of the same photoelectric converter, and the output of the photoelectric converter to this group of computing nodes The optical signal is converted to photoelectricity to realize the addition and conversion of the optical signal mentioned above.
示例性地,光计算系统用于进行图像处理中的计算,或者光计算系统用于进行数字信号处理中的计算,或者光计算系统用于进行处理器中的计算。本申请提供的光计算系统能够提供更快的计算速度和更大的计算规模,应用在上述领域中,进一步提高图像处理、数字信号处理等的速度和规模。Exemplarily, the optical computing system is used for computing in image processing, or the optical computing system is used for computing in digital signal processing, or the optical computing system is used for computing in a processor. The optical computing system provided by this application can provide faster computing speed and larger computing scale, and can be applied in the above-mentioned fields to further improve the speed and scale of image processing and digital signal processing.
另一方面,提供了一种光计算系统,包括光源单元、调制单元和光计算网络单元。调制单元包括耦合器和调制器。In another aspect, an optical computing system is provided, including a light source unit, a modulation unit, and an optical computing network unit. The modulation unit includes a coupler and a modulator.
其中,光源单元用于提供多路第一光信号;耦合器用于将多路第一光信号耦合为至少一路第二光信号;调制器用于采用至少一路第一电信号,对至少一路第二光信号进行调制,得到调制后的第二光信号,至少一路第一电信号中的每路第一电信号是通过对多路频率不同的第二电信号进行耦合得到的;光计算网络单元用于接收至少一路第二光信号,并对至少一路第二光信号进行调制。Wherein, the light source unit is used to provide multiple channels of first optical signals; the coupler is used to couple multiple channels of first optical signals into at least one channel of second optical signals; The signal is modulated to obtain a modulated second optical signal, and each first electrical signal in at least one first electrical signal is obtained by coupling multiple second electrical signals with different frequencies; the optical computing network unit is used for At least one second optical signal is received, and at least one second optical signal is modulated.
值得说明的是,上述第一光信号、第二光信号仅用来表示该实现方式中光信号的变化过程,这里的第一光信号和前一方面所限定的第一光信号可以是不同光信号。It is worth noting that the above-mentioned first optical signal and second optical signal are only used to represent the change process of the optical signal in this implementation mode, and the first optical signal here and the first optical signal defined in the previous aspect may be different optical signals. Signal.
在本申请提供的光计算系统中,光源单元提供多路光信号,通过调制单元对这多路光信号进行第一步调制,第一次调制后的光信号的幅值用来表示输入信息,也即将输入信息调制到光信号上;在经过第一步调制之后,通过光分配单元将第一次调制后的光信号分配给光计算网络单元,由光计算网络单元完成对这些光信号的第二次调制,第二次调制也是幅值调制,第二次调制之后的光信号的幅值表示输入信息乘以一个系数之后的大小。上述两步计算完成了卷积运算中的乘法部分。在上述过程中,通过耦合器将光信号耦合到一起,然后再进行调制,从而使得需要的调制器的数量大幅减少,有利于降低整个光计算系统的尺寸和成本。In the optical computing system provided in this application, the light source unit provides multiple optical signals, and the modulation unit performs the first modulation on the multiple optical signals, and the amplitude of the optical signal after the first modulation is used to represent the input information. That is to say, the input information is modulated onto the optical signal; after the first step of modulation, the first modulated optical signal is distributed to the optical computing network unit through the optical distribution unit, and the optical computing network unit completes the first step of these optical signals Secondary modulation, the second modulation is also amplitude modulation, and the amplitude of the optical signal after the second modulation represents the magnitude of the input information multiplied by a coefficient. The above two-step calculation completes the multiplication part in the convolution operation. In the above process, the optical signals are coupled together by a coupler and then modulated, so that the number of required modulators is greatly reduced, which is beneficial to reduce the size and cost of the entire optical computing system.
在上述光计算过程中,多路第一光信号被耦合到一起,然后经过调制,后续在光计算网络单元中再分解出需要的第二光信号。为了保证被耦合到一起的光信号能够再分解,需要保证各路第一光信号的波长或者模式不同。In the above optical computing process, multiple first optical signals are coupled together, then modulated, and then decomposed into required second optical signals in the optical computing network unit. In order to ensure that the coupled optical signals can be decomposed again, it is necessary to ensure that the wavelengths or modes of the first optical signals of each channel are different.
在本申请的一些实施方式中,多路第一光信号同时存在波长和模式不同的情况,也即两路第一光信号的波长和模式中的至少一个不同。In some embodiments of the present application, the wavelengths and modes of the multiple first optical signals are different at the same time, that is, at least one of the wavelengths and modes of the two first optical signals is different.
示例性地,多路第一光信号包括第一路光信号、第二路光信号和第三路光信号,第一路光信号和第二路光信号的模式不同,第二路光信号和第三路光信号的波长不同。Exemplarily, the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
在一些可能的实施方式中,光源单元包括多波长光源和多个模式转换器。In some possible implementations, the light source unit includes a multi-wavelength light source and multiple mode converters.
其中,多波长光源用于提供多路波长不同的第三光信号;每个模式转换器用于接收多路波长不同的第三光信号中的一路第三光信号,并用于将接收到的一路第三光信号转换成多路模式不同的第一光信号,从而得到多路第一光信号,且其中任意两路波长不同,或者模式不同,或者波长和模式均不同。Wherein, the multi-wavelength light source is used to provide multiple channels of third optical signals with different wavelengths; each mode converter is used to receive one of the multiple channels of third optical signals with different wavelengths, and is used to convert the received channel of the third optical signal to The three optical signals are converted into multiple first optical signals with different modes, thereby obtaining multiple first optical signals, and any two of them have different wavelengths, or different modes, or both different wavelengths and modes.
在另一些可能的实施方式中,光源单元包括多模式光源和多个模式转换器。In some other possible implementation manners, the light source unit includes a multi-mode light source and multiple mode converters.
其中,多模式光源用于提供多路模式不同的第三光信号;每个模式转换器用于接收多路模式不同的第三光信号中的一路第三光信号,并用于将接收到的一路第三光信号转换成多路波长不同的第一光信号。值得说明的是,在前一种光源单元的实现方式中,模式转换器的作用是对光的横模模式进行转换,从而将一束光转换成多束波长相同模式不同的光。而在这种光源单元的实现方式中,模式转换器的作用是对光的纵模模式进行转换,从而将一束光转换成多束模式相同波长不同的光。Among them, the multi-mode light source is used to provide multiple third optical signals with different modes; each mode converter is used to receive one of the third optical signals among the multiple third optical signals with different modes, and is used to convert the received third optical signal The three optical signals are converted into multiple channels of first optical signals with different wavelengths. It is worth noting that, in the former implementation of the light source unit, the function of the mode converter is to convert the transverse mode of light, so as to convert one beam of light into multiple beams of light with the same wavelength and different modes. However, in this implementation of the light source unit, the function of the mode converter is to convert the longitudinal mode of light, so as to convert one beam of light into multiple beams of light with the same mode and different wavelengths.
通过上述两种实现方式均能够提供多路同时存在波长和模式两个维度不同的光信号,从而使得该光计算网络能够支持更大规模的卷积运算,使得该光计算系统的应用更加广泛。Both of the above two implementation methods can provide multiple optical signals with different wavelengths and modes at the same time, so that the optical computing network can support larger-scale convolution operations, making the optical computing system more widely used.
如前所述,第一电信号是通过对多路频率不同的第二电信号进行耦合得到的。下面对第一电信号的产生过程进行说明:As mentioned above, the first electrical signal is obtained by coupling multiple second electrical signals with different frequencies. The generation process of the first electrical signal is described below:
首先由数字电路提供多路频率相同的数字频率信号,每路数字频率信号上已经携带了输入信息;利用多个乘法器对这多路数字频率信号的频率进行变频,从而得到多路频率不同的数字频率信号(第二电信号);再利用射频源对多路数字频率信号进行耦合,得到一路耦合后的电信号;利用数模转换器将数字信号转换为模拟信号,得到第一电信号。这种方式下电信号是耦合后再进行的数模转换,减少了数模转换器的数量,有利于降低整个光计算系统的尺寸和成本。First, the digital circuit provides multiple digital frequency signals with the same frequency, and each digital frequency signal has already carried input information; multiple multipliers are used to convert the frequency of the multiple digital frequency signals to obtain multiple channels with different frequencies. A digital frequency signal (second electrical signal); then use a radio frequency source to couple multiple digital frequency signals to obtain a coupled electrical signal; use a digital-to-analog converter to convert the digital signal into an analog signal to obtain the first electrical signal. In this way, the digital-to-analog conversion is performed after the electrical signal is coupled, which reduces the number of digital-to-analog converters and is beneficial to reduce the size and cost of the entire optical computing system.
其中,提供数字频率信号的数字电路可以是需要进行卷积计算的硬件,例如显卡、处理器等。Wherein, the digital circuit that provides the digital frequency signal may be hardware that needs to perform convolution calculation, such as a graphics card, a processor, and the like.
值得说明的是,上述采用乘法器进行变频的过程中,是将所有的数字频率信号变频成不同的频率。It is worth noting that, in the above-mentioned process of frequency conversion by using a multiplier, all digital frequency signals are converted into different frequencies.
示例性地,光计算网络单元包括至少一个解复用器,至少一个解复用器用于接收至少一路第二光信号,且对至少一路第二光信号进行解耦。Exemplarily, the optical computing network unit includes at least one demultiplexer, and the at least one demultiplexer is configured to receive at least one second optical signal and decouple at least one second optical signal.
例如,每个解复用器用于接收调制器输出的光信号,对调制器输出的光信号进行解耦,向对应的计算节点输出解耦得到的光信号,使被耦合到一起的光信号分开,使得每个计算节点分配到携带有对应的输入信息的光信号。For example, each demultiplexer is used to receive the optical signal output by the modulator, decouple the optical signal output by the modulator, output the decoupled optical signal to the corresponding computing node, and separate the coupled optical signals , so that each computing node is assigned an optical signal carrying corresponding input information.
由于采用上述耦合而成的电信号对光信号进行调制时,被调制得到的每路光信号实际都同时经过了多路第二电信号的调制,但实际在表示输入信息时,每路光信号只需要对应一路第二电信号,所以在在经过光计算网络单元之后,需要对光信号进行滤波处理,将调制时多余的电信号对应的成分滤除。When the above coupled electrical signal is used to modulate the optical signal, each modulated optical signal is actually modulated by multiple second electrical signals at the same time, but when actually representing input information, each optical signal It only needs to correspond to one second electrical signal, so after passing through the optical computing network unit, the optical signal needs to be filtered to filter out the component corresponding to the redundant electrical signal during modulation.
示例性地,光计算网络单元包括至少一个计算节点,光计算系统,还包括多个滤波器。Exemplarily, the optical computing network unit includes at least one computing node, an optical computing system, and a plurality of filters.
每个滤波器用于对至少一个计算节点输出的光信号进行滤波,保留多路频率不同的第二 电信号中的一路对应的分量。这里,滤波实际是滤除光信号的成分。在调制单元调制时,光信号同时被多路第二电信号调制,使得光信号的幅值是这多路第二电信号调制的结果之和,因此,需要将除了计算节点对应的第二电信号之外的电信号调制而成的成分滤除。Each filter is used to filter the optical signal output by at least one computing node, and retain a component corresponding to one of the multiple second electrical signals with different frequencies. Here, filtering is actually filtering out components of the optical signal. When modulated by the modulation unit, the optical signal is modulated by multiple second electrical signals at the same time, so that the amplitude of the optical signal is the sum of the modulation results of the multiple second electrical signals. The component modulated by the electrical signal other than the signal is filtered out.
可选地,该光计算系统还包括光分配单元。光分配单元负责将调制单元输出的光信号发送给光计算网络单元。Optionally, the optical computing system further includes an optical distribution unit. The optical distribution unit is responsible for sending the optical signal output by the modulation unit to the optical computing network unit.
在一些可能的实施方式中,光分配单元包括光转向元件。In some possible embodiments, the light distribution unit comprises a light redirecting element.
光转向元件,用于对至少一路第二光信号进行转向,以使至少一路第二光信号被发送给至少一个光学处理单元。The light diverting element is used to divert at least one second optical signal, so that the at least one second optical signal is sent to at least one optical processing unit.
这样,在控制该光转向元件时,可以根据至少一个光学处理单元的处理能力,发射至少一路第二光信号至至少一个光学处理单元。其中,光学处理单元的处理能力通常由它所包含的计算节点数量决定,根据每个光学处理单元的处理能力,确定至少一路第二光信号是发送给一个还是多个光学处理单元,从而使得光学计算系统根据需要来分配光学处理单元进行光信号的处理,从而避免提供的光学处理单元的处理能力过剩或者不足。In this way, when the light turning element is controlled, at least one second optical signal can be transmitted to at least one optical processing unit according to the processing capability of at least one optical processing unit. Wherein, the processing capability of the optical processing unit is usually determined by the number of computing nodes it contains, and according to the processing capability of each optical processing unit, it is determined whether at least one second optical signal is sent to one or more optical processing units, so that the optical The computing system allocates the optical processing unit to process the optical signal according to needs, so as to avoid excess or insufficient processing capacity of the provided optical processing unit.
示例性地,光转向元件包括硅基液晶单元。通过改变施加给硅基液晶单元的电压,从而能够实现对光信号传播方向的灵活调整。Exemplarily, the light redirecting element comprises a liquid crystal on silicon cell. By changing the voltage applied to the silicon-based liquid crystal unit, it is possible to flexibly adjust the propagation direction of the optical signal.
在光计算网络单元仅有一路输入光信号时,为了保证各个计算节点都能获得该输入光信号中的一路第二光信号。光计算网络单元中的各个计算节点通过光传输介质连接。或者,由光分配单元将一路光信号同时发送给多行或多列计算节点。When the optical computing network unit has only one input optical signal, in order to ensure that each computing node can obtain one second optical signal in the input optical signal. Each computing node in the optical computing network unit is connected through an optical transmission medium. Alternatively, the optical distribution unit sends one optical signal to computing nodes in multiple rows or columns at the same time.
示例性地,计算节点包括调制器。或者,计算节点包括相变材料,相变材料用于对接收到的第二光信号的幅值进行调制。Exemplarily, a computing node includes a modulator. Alternatively, the computing node includes a phase change material for modulating the amplitude of the received second optical signal.
可选地,该光计算系统还包括:转换单元,用于将光计算网络单元输出的光信号相加并转换为电信号。通过转换单元进行同一组乘法计算结果的相加,并将其转换成电信号输出,使得计算结果能够应用在后续电处理单元的计算中。Optionally, the optical computing system further includes: a converting unit, configured to add and convert the optical signals output by the optical computing network unit into electrical signals. The same group of multiplication calculation results are added through the conversion unit, and converted into an electrical signal output, so that the calculation result can be applied to the calculation of the subsequent electrical processing unit.
示例性地,转换单元包括多个光电转换器,每个光电转换器对应一组计算节点,这一组计算节点的输出连接同一个光电转换器的输入,光电转换器对这一组计算节点输出的光信号进行光电转换,实现前文中的光信号相加及转换。Exemplarily, the conversion unit includes a plurality of photoelectric converters, each photoelectric converter corresponds to a group of computing nodes, the output of this group of computing nodes is connected to the input of the same photoelectric converter, and the output of the photoelectric converter to this group of computing nodes The optical signal is converted to photoelectricity to realize the addition and conversion of the optical signal mentioned above.
示例性地,光计算系统用于进行图像处理中的计算,或者光计算系统用于进行数字信号处理中的计算,或者光计算系统用于进行处理器中的计算。本申请提供的光计算系统能够提供更快的计算速度和更大的计算规模,应用在上述领域中,进一步提高图像处理、数字信号处理等的速度和规模。Exemplarily, the optical computing system is used for computing in image processing, or the optical computing system is used for computing in digital signal processing, or the optical computing system is used for computing in a processor. The optical computing system provided by this application can provide faster computing speed and larger computing scale, and can be applied in the above-mentioned fields to further improve the speed and scale of image processing and digital signal processing.
另一方面,提供了一种光计算方法,该方法包括:In another aspect, a light calculation method is provided, the method comprising:
提供多路第一光信号;providing multiple first optical signals;
对多路第一光信号进行转向;Steering the multiple first optical signals;
将转向后的多路第一光信号汇聚成至少一路第二光信号,发射至少一路第二光信号至光计算网络单元;Converge the diverted multiple first optical signals into at least one second optical signal, and transmit at least one second optical signal to the optical computing network unit;
通过光计算网络单元对至少一路第二光信号进行调制。The at least one second optical signal is modulated by the optical computing network unit.
可选地,该方法还包括:Optionally, the method also includes:
在对至少一路第二光信号进行调制之前,对至少一路第二光信号进行解耦。Before modulating the at least one second optical signal, at least one second optical signal is decoupled.
示例性地,光计算网络单元包括至少一个光学处理单元,发射至少一路第二光信号至光计算网络单元,包括:Exemplarily, the optical computing network unit includes at least one optical processing unit, and transmits at least one second optical signal to the optical computing network unit, including:
根据至少一个光学处理单元的处理能力,发射至少一路第二光信号至至少一个光学处理单元。According to the processing capability of the at least one optical processing unit, at least one second optical signal is sent to the at least one optical processing unit.
示例性地,多路第一光信号包括第一路光信号、第二路光信号和第三路光信号,第一路光信号和第二路光信号的模式不同,第二路光信号和第三路光信号的波长不同。Exemplarily, the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
另一方面,提供了一种光计算方法,该方法包括:In another aspect, a light calculation method is provided, the method comprising:
提供多路第一光信号;providing multiple first optical signals;
将多路第一光信号耦合为至少一路第二光信号;coupling multiple first optical signals into at least one second optical signal;
采用至少一路第一电信号,对至少一路第二光信号进行调制,得到调制后的第二光信号,至少一路第一电信号中的每路第一电信号是通过对多路频率不同的第二电信号进行耦合得到的;At least one first electrical signal is used to modulate at least one second optical signal to obtain a modulated second optical signal, and each first electrical signal in the at least one first electrical signal is obtained by pairing multiple first electrical signals with different frequencies. It is obtained by coupling two electrical signals;
通过光计算网络单元对至少一路第二光信号进行调制。The at least one second optical signal is modulated by the optical computing network unit.
可选地,该方法还包括:Optionally, the method also includes:
在对至少一路第二光信号进行调制之前,对至少一路第二光信号进行解耦。Before modulating the at least one second optical signal, at least one second optical signal is decoupled.
可选地,光计算网络单元包括至少一个计算节点,方法还包括:Optionally, the optical computing network unit includes at least one computing node, and the method further includes:
对至少一个计算节点输出的光信号进行滤波,保留多路频率不同的第二电信号中的一路对应的分量。The optical signal output by at least one computing node is filtered, and a component corresponding to one of the multiple second electrical signals with different frequencies is retained.
示例性地,多路第一光信号包括第一路光信号、第二路光信号和第三路光信号,第一路光信号和第二路光信号的模式不同,第二路光信号和第三路光信号的波长不同。Exemplarily, the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
另一方面,提供了一种控制装置,包括处理器和存储器;所述存储器中存储有程序代码,所述程序代码被所述处理器执行时,以实现如前任一项所述的方法。In another aspect, a control device is provided, including a processor and a memory; program codes are stored in the memory, and when the program codes are executed by the processor, the method described in any one of the preceding items is implemented.
附图说明Description of drawings
图1是本申请一些实施例提供的光计算系统的结构示意图;FIG. 1 is a schematic structural diagram of an optical computing system provided by some embodiments of the present application;
图2是本申请一些实施例提供的光计算系统的结构示意图;FIG. 2 is a schematic structural diagram of an optical computing system provided by some embodiments of the present application;
图3是本申请一些实施例提供的光源单元的结构示意图;Fig. 3 is a schematic structural diagram of a light source unit provided by some embodiments of the present application;
图4是本申请一些实施例提供的光源单元的结构示意图;Fig. 4 is a schematic structural diagram of a light source unit provided by some embodiments of the present application;
图5是本申请一些实施例提供的光计算系统的部分结构示意图;Fig. 5 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application;
图6是本申请一些实施例提供的光计算系统的部分结构示意图;Fig. 6 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application;
图7是本申请一些实施例提供的光计算系统的部分结构示意图;Fig. 7 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application;
图8是本申请一些实施例提供的光计算系统的部分结构示意图;Fig. 8 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application;
图9是本申请一些实施例提供的光计算系统的部分结构示意图;Fig. 9 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application;
图10是本申请一些实施例提供的电信号产生电路的结构示意图;FIG. 10 is a schematic structural diagram of an electrical signal generating circuit provided by some embodiments of the present application;
图11是本申请一些实施例提供的光计算系统的部分结构示意图;Fig. 11 is a partial structural schematic diagram of an optical computing system provided by some embodiments of the present application;
图12是本申请一些实施例提供的电信号产生电路的结构示意图;Fig. 12 is a schematic structural diagram of an electrical signal generating circuit provided by some embodiments of the present application;
图13是本申请一些实施例提供的光计算方法的流程图;Fig. 13 is a flowchart of an optical calculation method provided by some embodiments of the present application;
图14是本申请一些实施例提供的光计算方法的流程图;Fig. 14 is a flowchart of an optical calculation method provided by some embodiments of the present application;
图15是本申请一些实施例提供的控制装置的结构示意图。Fig. 15 is a schematic structural diagram of a control device provided by some embodiments of the present application.
具体实施方式Detailed ways
图1是本申请一些实施例提供的光计算系统的结构示意图。参见图1,该光计算系统包括:光信号提供单元10、光分配单元20和光计算网络单元30。Fig. 1 is a schematic structural diagram of an optical computing system provided by some embodiments of the present application. Referring to FIG. 1 , the optical computing system includes: an optical signal providing unit 10 , an optical distribution unit 20 and an optical computing network unit 30 .
光信号提供单元10的输出端和光分配单元20的输入端连接,光分配单元20的输出端和光计算网络单元30的输入端连接。The output end of the optical signal supply unit 10 is connected to the input end of the optical distribution unit 20 , and the output end of the optical distribution unit 20 is connected to the input end of the optical computing network unit 30 .
光信号提供单元10用于提供多路第一光信号;光分配单元20用于将多路第一光信号分配给光计算网络单元30;光计算网络单元30用于接收多路第一光信号,并对多路第一光信号进行调制。The optical signal providing unit 10 is used to provide multiple first optical signals; the optical distribution unit 20 is used to distribute the multiple first optical signals to the optical computing network unit 30; the optical computing network unit 30 is used to receive the multiple first optical signals , and modulate the multiple first optical signals.
示例性地,该光分配单元可以采用如下方式实现:先将多路第一光信号汇聚成多路第二光信号,然后再发送给光计算网络单元30。Exemplarily, the optical distribution unit may be implemented in the following manner: First, multiple channels of first optical signals are aggregated into multiple channels of second optical signals, and then sent to the optical computing network unit 30 .
图2是本申请一些实施例提供的光计算系统的结构示意图。参见图2,光信号提供单元10可以包括光源单元11和调制单元12。光源单元11用于提供多路第三光信号;调制单元12用于接收多路第三光信号,对多路第三光信号进行调制,得到多路第一光信号,第一光信号携带有输入信息。Fig. 2 is a schematic structural diagram of an optical computing system provided by some embodiments of the present application. Referring to FIG. 2 , the optical signal providing unit 10 may include a light source unit 11 and a modulation unit 12 . The light source unit 11 is used to provide multiple third optical signals; the modulation unit 12 is used to receive multiple third optical signals, modulate the multiple third optical signals, and obtain multiple first optical signals, and the first optical signals carry Enter information.
示例性地,光计算网络单元30可以具有至少一个计算节点31,计算节点31的数量通常为多个,以多个为例,多个计算节点31分为多组,计算节点31用于对接收到的第一光信号的幅值进行调制。Exemplarily, the optical computing network unit 30 may have at least one computing node 31, and the number of computing nodes 31 is usually multiple. Taking multiple computing nodes as an example, multiple computing nodes 31 are divided into multiple groups, and the computing nodes 31 are used for receiving The amplitude of the received first optical signal is modulated.
可选地,光计算系统还可以包括转换单元50,转换单元50的输入端和光计算网络单元30的输出端连接,转换单元50用于将属于同一组的计算节点输出的光信号相加并转换为电信号。Optionally, the optical computing system may further include a conversion unit 50, the input end of the conversion unit 50 is connected to the output end of the optical computing network unit 30, and the conversion unit 50 is used to add and convert optical signals output by computing nodes belonging to the same group for electrical signals.
如图2所示,光源单元11提供的第三光信号的数量和光计算网络中计算节点的数量是相等的。在其他可能的实施方式中,光源单元11提供的第三光信号的数量和光计算网络中计算节点的数量也可以是不相等的。As shown in FIG. 2 , the number of third optical signals provided by the light source unit 11 is equal to the number of computing nodes in the optical computing network. In other possible implementation manners, the number of third optical signals provided by the light source unit 11 and the number of computing nodes in the optical computing network may also be unequal.
参见图2,光源单元11提供了多路第三光信号,例如图中的λ11、λ12…λ1n、λ21、λ22…λ2n…λm1、λm2…λmn,一共m×n路,m和n均为正整数。相应地,光计算网络单元30中也存在m×n个计算节点,将多路第三光信号经过调制后的多路第一光信号分别传递给多个计算节点,每个计算节点完成输入信息和卷积核系数(a 11~a mn)的乘法运算,完成乘法运算后,属于一列的计算节点的输出相加,得到卷积计算的结果(y1y2…yn)。 Referring to Fig. 2, the light source unit 11 provides multiple channels of third optical signals, such as λ11, λ12...λ1n, λ21, λ22...λ2n...λm1, λm2...λmn in the figure, a total of m×n channels, m and n are both positive integer. Correspondingly, there are also m×n computing nodes in the optical computing network unit 30, and the multi-channel first optical signals modulated by the multiple third optical signals are respectively transmitted to multiple computing nodes, and each computing node completes the input information and the multiplication operation of the convolution kernel coefficients (a 11 ~a mn ), after the multiplication operation is completed, the outputs of the calculation nodes belonging to a column are added to obtain the result of the convolution calculation (y1y2...yn).
以图像的卷积运算为例,图2中光计算网络中各个计算节点的卷积核系数构成卷积核系数矩阵,多路第一光信号携带的输入信息构成输入像素幅值矩阵,通过输入信息和卷积核系数的乘法,以及同一列计算节点输出结果的相加,从而得到结果矩阵y1y2…yn。Taking the image convolution operation as an example, the convolution kernel coefficients of each computing node in the optical computing network in Figure 2 constitute a convolution kernel coefficient matrix, and the input information carried by multiple first optical signals constitutes an input pixel amplitude matrix. The multiplication of information and convolution kernel coefficients, and the addition of the output results of the calculation nodes in the same column, thereby obtaining the result matrix y1y2...yn.
在本申请提供的光计算系统中,提供多路光信号,并通过调制单元对这多路光信号进行第一步调制,第一次调制后的光信号的幅值用来表示输入信息;在经过第一步调制之后,通过光分配单元将第一次调制后的光信号分配给光计算网络中的各个计算节点,由这多个计算节点完成对这些光信号的第二次调制,第二次调制也是幅值调制,第二次调制之后的光信号的幅值表示输入信息乘以一个系数之后的大小。上述两步计算完成了卷积运算中的乘法部分。 然后通过转换单元进行同一列乘法计算结果的相加,并将其转换成电信号输出,使得计算结果能够应用在后续电处理单元的计算中。该方案中每个计算节点采用单独的第一光信号进行计算,也即参与每个计算节点运算的是不同的光信号,使得光信号功率损耗小。In the optical computing system provided in this application, multiple optical signals are provided, and the first step of modulation is performed on the multiple optical signals by the modulation unit, and the amplitude of the optical signal after the first modulation is used to represent the input information; After the first step of modulation, the optical signal after the first modulation is distributed to each computing node in the optical computing network through the optical distribution unit, and the second modulation of these optical signals is completed by these computing nodes. Secondary modulation is also amplitude modulation, and the amplitude of the optical signal after the second modulation represents the magnitude of the input information multiplied by a coefficient. The above two-step calculation completes the multiplication part in the convolution operation. Then, the conversion unit performs the addition of the multiplication calculation results of the same column, and converts it into an electrical signal output, so that the calculation results can be applied to the calculation of the subsequent electrical processing unit. In this solution, each computing node uses a separate first optical signal for calculation, that is, different optical signals participate in the calculation of each computing node, so that the power loss of the optical signal is small.
在上述光计算系统中,光源单元提供的多路第三光信号中任意两路第三光信号的模式和波长中的至少一个不同,也即本申请从波长和模式两个维度来提供不同光信号,从而使得该光计算网络能够支持更大规模的卷积运算。In the above optical computing system, at least one of the modes and wavelengths of any two third optical signals in the multiple third optical signals provided by the light source unit is different, that is, the present application provides different optical signals from two dimensions of wavelength and mode. signal, so that the optical computing network can support larger-scale convolution operations.
图3是本申请一些实施例提供的光源单元的结构示意图。参见图3,光源单元11包括多波长光源111和多个模式转换器112。多波长光源111的输出端和多个模式转换器112的输入端连接。Fig. 3 is a schematic structural diagram of a light source unit provided by some embodiments of the present application. Referring to FIG. 3 , the light source unit 11 includes a multi-wavelength light source 111 and a plurality of mode converters 112 . The output terminal of the multi-wavelength light source 111 is connected to the input terminals of a plurality of mode converters 112 .
多波长光源111用于提供多路波长不同的第四光信号,如图3中的λ1、λ2…λm。通常,两路光信号的波长可以间隔一定数值,以保证光信号之间有一定的区分度。The multi-wavelength light source 111 is used to provide multiple channels of fourth optical signals with different wavelengths, such as λ1, λ2...λm in FIG. 3 . Usually, the wavelengths of the two optical signals can be separated by a certain value to ensure a certain degree of discrimination between the optical signals.
多个模式转换器112与多路波长不同的第四光信号对应;模式转换器112,用于将对应的第四光信号转换成多路模式不同的第三光信号,如图3中第四光信号λ1被转成多路第三光信号λ11、λ12…λ1n,第四光信号λ2被转成多路第三光信号λ21、λ22…λ2n…λm1,第四光信号λm被转成多路第三光信号λm1、λm2…λmn。 Multiple mode converters 112 correspond to multiple fourth optical signals with different wavelengths; the mode converters 112 are used to convert the corresponding fourth optical signals into multiple third optical signals with different modes, as shown in Figure 3. The optical signal λ1 is converted into multiple third optical signals λ11, λ12...λ1n, the fourth optical signal λ2 is converted into multiple third optical signals λ21, λ22...λ2n...λm1, and the fourth optical signal λm is converted into multiple The third optical signals λm1, λm2...λmn.
这里,模式转换器112对光信号进行转换得到多路模式不同的第三光信号,也即转换得到的第三光信号有多种模式,这里的多种模式可以是多种横模,例如横模LP00、LP01、LP10等。Here, the mode converter 112 converts the optical signal to obtain multiple third optical signals with different modes, that is, the converted third optical signal has multiple modes, where the multiple modes can be multiple transverse modes, such as transverse modes Die LP00, LP01, LP10, etc.
示例性地,多波长光源111可以为光频梳、多波长激光器阵列等。Exemplarily, the multi-wavelength light source 111 may be an optical frequency comb, a multi-wavelength laser array, and the like.
图4是本申请一些实施例提供的光源单元的结构示意图。参见图4,光源单元11包括多模式光源113和多个模式转换器112。多模式光源113的输出端和多个模式转换器112的输入端连接。Fig. 4 is a schematic structural diagram of a light source unit provided by some embodiments of the present application. Referring to FIG. 4 , the light source unit 11 includes a multi-mode light source 113 and a plurality of mode converters 112 . The output of the multi-mode light source 113 is connected to the input of the plurality of mode converters 112 .
多模式光源113用于提供多路模式不同的第四光信号,如图4中的λ1、λ2…λm。The multi-mode light source 113 is used to provide multiple fourth optical signals with different modes, such as λ1 , λ2 . . . λm in FIG. 4 .
多个模式转换器112与多路波长不同的第四光信号对应;模式转换器112,用于将对应的一路第四光信号转换成多路波长不同的第三光信号,如图4中第四光信号λ1被转成多路第三光信号λ11、λ12…λ1n,第四光信号λ2被转成多路第三光信号λ21、λ22…λ2n…λm1,第四光信号λm被转成多路第三光信号λm1、λm2…λmn。 Multiple mode converters 112 correspond to multiple fourth optical signals with different wavelengths; the mode converters 112 are used to convert a corresponding fourth optical signal into multiple third optical signals with different wavelengths, as shown in Figure 4. The four optical signals λ1 are converted into multiple third optical signals λ11, λ12...λ1n, the fourth optical signal λ2 is converted into multiple third optical signals λ21, λ22...λ2n...λm1, and the fourth optical signal λm is converted into multiple A third optical signal λm1, λm2...λmn.
在一些可能的实施方式中,计算节点31包括调制器,如马赫曾德尔调制器(mach zehnder modulator,MZM)来实现,调制器是电光转换器件,通过控制光调制的偏置电压,即可调整调制器对应的卷积核系数,例如需要卷积核系数a 11=0.5,则控制该计算节点的偏置电压=1V即可。调制器是对输入的光信号的幅值进行调制,使其幅值按照该卷积核系数对应的比例进行衰减或者增强。 In some possible implementations, the computing node 31 includes a modulator, such as a Mach Zehnder modulator (MZM). The modulator is an electro-optical conversion device, and by controlling the bias voltage of the optical modulation, it can adjust For the convolution kernel coefficient corresponding to the modulator, for example, the convolution kernel coefficient a 11 =0.5 is required, and then the bias voltage of the calculation node is controlled to be 1V. The modulator modulates the amplitude of the input optical signal, so that the amplitude is attenuated or enhanced according to the ratio corresponding to the coefficient of the convolution kernel.
在另一些可能的实施方式中,计算节点31包括相变材料(或称为相敏材料),本申请中的相变材料为光致相变材料。相变材料用于在控制光作用下改变透过率,以使光信号穿过时光信号的幅值按照卷积核系数发生变化。In some other possible implementation manners, the computing node 31 includes a phase-change material (or called a phase-sensitive material), and the phase-change material in this application is a photoinduced phase-change material. The phase change material is used to change the transmittance under the control of light, so that the amplitude of the light signal passing through the light signal changes according to the coefficient of the convolution kernel.
示例性地,该相变材料为GST(Ge 2Sb 2Te 5)材料,GST材料在控制光强度不同时,呈现的状态不同,能够在晶体(光可以通过)和非晶体(光不可以通过)之间转换,从而使材料本身透过率发生变化,实现对输入光的调制功能。 Exemplarily, the phase-change material is GST (Ge 2 Sb 2 Te 5 ) material. GST material exhibits different states when the intensity of light is controlled differently. ), so that the transmittance of the material itself changes, and the modulation function of the input light is realized.
示例性地,转换单光50包括:多个光电转换器。光计算网络单元30中的一组计算节点 31对应一个光电转换器,光电转换器的输入端分别与对应组的多个计算节点31的输出端连接,光电转换器的输出端输出电信号。Exemplarily, the converting single light 50 includes: a plurality of photoelectric converters. A group of computing nodes 31 in the optical computing network unit 30 corresponds to a photoelectric converter, the input terminals of the photoelectric converter are respectively connected to the output terminals of a plurality of computing nodes 31 of the corresponding group, and the output terminals of the photoelectric converter output electrical signals.
示例性地,光电转换器为光电二极管,例如雪崩光电二极管(avalanche photo diodes,APD)、光敏二极管(photo diodes,PD)等。Exemplarily, the photoelectric converter is a photodiode, such as an avalanche photodiode (avalanche photodiodes, APD), a photodiode (photodiodes, PD) and the like.
图5是本申请一些实施例提供的光计算系统的部分结构示意图。主要示出了调制单元12、光计算网络单元30、光分配单元20的详细结构,参见图5:Fig. 5 is a partial structural diagram of an optical computing system provided by some embodiments of the present application. It mainly shows the detailed structure of the modulation unit 12, the optical computing network unit 30, and the optical distribution unit 20, see FIG. 5:
调制单元12包括多个调制器122,每个调制器122负责处理一路第三光信号,调制器122用于采用一路电信号调制对应的第三光信号,以将电信号承载的输入信息调制到第三光信号上,得到第一光信号。The modulation unit 12 includes a plurality of modulators 122, each modulator 122 is responsible for processing a third optical signal, and the modulator 122 is used to modulate the corresponding third optical signal with an electrical signal, so as to modulate the input information carried by the electrical signal to On the third optical signal, the first optical signal is obtained.
在图5示出的结构中,每个调制器调制一路第三光信号。调制器采用电信号对光信号进行调制,电信号的幅值大小对应调制器的偏置电压的大小。因此,输入信息由电信号的幅值表示。In the structure shown in Fig. 5, each modulator modulates one third optical signal. The modulator uses an electrical signal to modulate the optical signal, and the amplitude of the electrical signal corresponds to the bias voltage of the modulator. Therefore, the input information is represented by the magnitude of the electrical signal.
在本申请实施例中,电信号由数字信号经过数模转换器转换得到,每一路电信号对应一个数模转换器,数模转换器的输出端连接调制器122。In the embodiment of the present application, the electrical signal is obtained by converting the digital signal through a digital-to-analog converter, each electrical signal corresponds to a digital-to-analog converter, and the output end of the digital-to-analog converter is connected to the modulator 122 .
再次参见图5,光计算网络单元30的多个计算节点31阵列式排布,也即分为多行和多列,其中,一列计算节点31构成前文中的一组。位于同一行的计算节点31可以通过光传输介质33连接。光传输介质33可以是光波导(例如光纤),用于实现光信号的传输。在图5所示的计算节点31排布方式中,也可以将一行计算节点31作为一组,此时一列计算节点31可以通过光传输介质33连接。Referring again to FIG. 5 , the multiple computing nodes 31 of the optical computing network unit 30 are arranged in an array, that is, divided into multiple rows and multiple columns, wherein one column of computing nodes 31 constitutes a group as mentioned above. Computing nodes 31 located in the same row can be connected through an optical transmission medium 33 . The optical transmission medium 33 may be an optical waveguide (such as an optical fiber), used to realize the transmission of optical signals. In the arrangement of computing nodes 31 shown in FIG. 5 , a row of computing nodes 31 may also be regarded as a group, and at this time, a row of computing nodes 31 may be connected through an optical transmission medium 33 .
在其他可能的实施方式中,多个计算节点31还可以采用其他方式排布,对此不做赘述。In other possible implementation manners, the multiple computing nodes 31 may also be arranged in other manners, which will not be repeated here.
在一些可能的实现方式中,光分配单元20包括光转向元件21、光汇聚元件22;光计算网络单元30还包括至少一个解复用器32,解复用器32的数量通常为多个,下面以多个为例。光转向元件21的输入端和多个调制器122的输出端连接,光转向元件21的输出端和光汇聚元件22的输入端相对,光汇聚元件22的输出端和计算节点31所连的光传输介质33相对。多个解复用器32与多个计算节点31对应,解复用器32连接在光波导上,一行计算节点31对应的多个解复用器32串联在该行计算节点31对应的光传输介质33上。In some possible implementations, the optical distribution unit 20 includes a light turning element 21 and an optical converging element 22; the optical computing network unit 30 also includes at least one demultiplexer 32, and the number of demultiplexers 32 is usually multiple, Below are several examples. The input end of the light diverting element 21 is connected to the output ends of the plurality of modulators 122, the output end of the light diverting element 21 is opposite to the input end of the light converging element 22, the output end of the light converging element 22 is connected to the optical transmission of the computing node 31 The medium 33 is opposite. A plurality of demultiplexers 32 correspond to a plurality of computing nodes 31, and the demultiplexers 32 are connected to the optical waveguide, and a plurality of demultiplexers 32 corresponding to a row of computing nodes 31 are connected in series to the corresponding optical transmission on medium 33.
光转向元件21用于控制多个调制器122输出的多路第一光信号转向,也即对多路第一光信号进行转向;光汇聚元件22用于将转向后的多路第一光信号汇聚成至少一路第二光信号,发射至少一路第二光信号至光计算网络单元;解复用器32,用于接收至少一路第二光信号,且对至少一路第二光信号进行解耦。The light diverting element 21 is used to control the diversion of the multiple first optical signals output by the multiple modulators 122, that is, to divert the multiple first optical signals; the light converging element 22 is used to divert the diverted multiple first optical signals Converge into at least one second optical signal, transmit at least one second optical signal to the optical computing network unit; demultiplexer 32 is used to receive at least one second optical signal, and decouple at least one second optical signal.
示例性地,至少一路第二光信号为N路第二光信号,N路第二光信号对应发射到光计算网络单元30的N行计算节点31连接的光波导,光计算网络单元30中计算节点31的行数大于或等于N,N为正整数。解复用器32和计算节点31对应,解复用器32对对应计算节点31所在行的光传输介质33传输的第二光信号进行解耦,并向对应的计算节点31输出解耦得到的第一光信号。Exemplarily, the at least one second optical signal is N second optical signals, and the N second optical signals are corresponding to the optical waveguides connected to N rows of computing nodes 31 transmitted to the optical computing network unit 30, and the optical computing network unit 30 calculates The number of rows of the node 31 is greater than or equal to N, where N is a positive integer. The demultiplexer 32 corresponds to the computing node 31, and the demultiplexer 32 decouples the second optical signal transmitted by the optical transmission medium 33 corresponding to the row where the computing node 31 is located, and outputs the decoupled second optical signal to the corresponding computing node 31. first light signal.
在该实现方式中,通过光转向元件和光汇聚元件,能够控制光信号最终发射到光网络中的位置(比如行或者列的位置),实现光信号的灵活调度和配置。而通过解复用器能够将对应计算节点计算需要的光信号,从耦合成的复合光信号中分解出来。In this implementation, through the light diverting element and the light converging element, it is possible to control the position where the optical signal is finally transmitted to the optical network (such as the row or column position), so as to realize flexible scheduling and configuration of the optical signal. The demultiplexer can decompose the optical signal corresponding to the calculation needs of the calculation node from the coupled composite optical signal.
示例性地,光转向元件21包括硅基液晶,硅基液晶包括多个硅基液晶单元210,多个硅 基液晶单元210与多路第一光信号对应。通过控制液晶单元所处电场,使液晶的偏转方向发生变化,从而改变经过该液晶单元的光线的传播路径。通过为每路第一光信号设置一个液晶单元使得每路第一光信号的传播方向可控。Exemplarily, the light redirecting element 21 includes liquid crystal on silicon, and the liquid crystal on silicon includes a plurality of liquid crystal on silicon units 210, and the plurality of liquid crystal on silicon units 210 correspond to multiple channels of first optical signals. By controlling the electric field where the liquid crystal unit is located, the deflection direction of the liquid crystal is changed, thereby changing the propagation path of the light passing through the liquid crystal unit. The propagating direction of each first optical signal is controllable by providing a liquid crystal unit for each first optical signal.
示例性地,光汇聚元件22包括衍射光栅,衍射光栅将特定方向射入的光汇聚成一束,然后发射到光计算网络单元30的对应行。Exemplarily, the light converging element 22 includes a diffraction grating, and the diffraction grating converges light incident from a specific direction into a beam, and then transmits it to a corresponding row of the optical computing network unit 30 .
图6是本申请一些实施例提供的光计算系统的部分结构示意图。与图5相比,该光计算系统还包括控制装置150。控制装置150和光转向元件21连接,用于控制输出给光转向元件21中硅基液晶单元210的电压。Fig. 6 is a partial structural diagram of an optical computing system provided by some embodiments of the present application. Compared with FIG. 5 , the optical computing system further includes a control device 150 . The control device 150 is connected with the light turning element 21 and is used for controlling the voltage output to the liquid crystal on silicon unit 210 in the light turning element 21 .
控制装置150用于控制硅基液晶单元,以实现如下至少一项控制:The control device 150 is used to control the liquid crystal on silicon unit to realize at least one of the following controls:
控制在光汇聚元件中汇聚成一路第二光信号的第一光信号的组成,也即是控制哪些第一光信号到达光汇聚元件后会被汇聚到一起;Controlling the composition of the first optical signal converged into a second optical signal in the optical converging element, that is, controlling which first optical signals will be converged together after arriving at the optical converging element;
控制通过光汇聚元件被发送给光计算网络单元中第一计算节点的第一光信号,第一计算节点为任一计算节点,也即是控制第一光信号最终被射出到光计算网络单元的哪个位置。由于光汇聚元件汇聚而成的每一路光信号出射到光计算网络单元中的位置是固定的,因此,也即是控制第一光信号通过硅基液晶单元转向后在光汇聚元件哪里实现汇聚。Control the first optical signal sent to the first computing node in the optical computing network unit through the optical converging element, the first computing node is any computing node, that is, control the first optical signal to be finally emitted to the optical computing network unit which location. Since the position of each optical signal converged by the light converging element is fixed to the optical computing network unit, it means that the first optical signal is controlled to be converged at the light converging element after being steered by the liquid crystal on silicon unit.
通过控制装置、光转向元件和光汇聚元件可以控制输入信息和计算节点的对应关系,从而控制输入信息被传输到哪个计算节点,进而能够实现输入信息和计算节点的对应关系的灵活配置,使得该系统在进行卷积计算时,能够控制每个输入信息对应的系数,保证实现卷积运算的灵活配置,例如采用不同卷积核系数矩阵对图像进行卷积处理等。The corresponding relationship between input information and computing nodes can be controlled through the control device, light steering element and light converging element, so as to control which computing node the input information is transmitted to, and then the flexible configuration of the corresponding relationship between input information and computing nodes can be realized, making the system When performing convolution calculations, the coefficients corresponding to each input information can be controlled to ensure the flexible configuration of convolution operations, such as using different convolution kernel coefficient matrices to perform convolution processing on images.
在一些实施例中,控制装置150除了用于控制光转向元件21外,还可以控制光信号的生成以及调制过程。In some embodiments, in addition to controlling the light diverting element 21 , the control device 150 can also control the generation and modulation process of the light signal.
在图5所示的结构中,解复用器32连接在行方向布置的光传输介质33上,如图5所示,每根横向布置的光传输介质33上设置有和计算节点对应的解复用器32,解复用器32的输入端和一个输出端连接该光传输介质33,解复用器32的另一个输出端连接计算节点31。下面以图3中第一行的解复用器为例对解复用器32的工作过程进行说明:In the structure shown in FIG. 5, the demultiplexer 32 is connected to the optical transmission medium 33 arranged in the row direction. As shown in FIG. A multiplexer 32 , an input terminal and an output terminal of the demultiplexer 32 are connected to the optical transmission medium 33 , and the other output terminal of the demultiplexer 32 is connected to the computing node 31 . The working process of the demultiplexer 32 is described below with the demultiplexer of the first row in Fig. 3 as an example:
光信号λ11、λ12…λ1n由光汇聚元件22输出至从左到右(后续都按照此顺序说明)的第一个解复用器32所在的光传输介质33,第一个解复用器32将其中的成分λ11解耦,并输出给对应的计算节点a 11,将剩余的部分λ12…λ1n输出给同一行的第二个解复用器32。第二个解复用器32将其中的成分λ12解耦,并输出给对应的计算节点a 12,将剩余的部分λ13…λ1n输出给同一行的第三个解复用器32。以此类推,到最后一个解复用器32时,只剩下成分λ1n,最后一个解复用器32将λ1n输出给对应的计算节点a 1nThe optical signals λ11, λ12...λ1n are output from the optical converging element 22 to the optical transmission medium 33 where the first demultiplexer 32 is located from left to right (following will be described in this order), and the first demultiplexer 32 The components λ11 are decoupled and output to the corresponding computing node a 11 , and the remaining parts λ12...λ1n are output to the second demultiplexer 32 in the same row. The second demultiplexer 32 decouples the component λ12 and outputs it to the corresponding computing node a 12 , and outputs the remaining parts λ13...λ1n to the third demultiplexer 32 in the same row. By analogy, when reaching the last demultiplexer 32, only the component λ1n remains, and the last demultiplexer 32 outputs λ1n to the corresponding computing node a 1n .
在图6所示的结构中,解复用器32连接在行方向布置的光传输介质33上,如图6所示,每根横向布置的光传输介质33上设置有和计算节点对应的解复用器32,解复用器32的输入端,解复用器32的一个输出端连接计算节点31。图6和图5的区别主要在于,图5中一行内的多个解复用器32接收到的输入通常是不同的,而在图6中一行内的多个解复用器32接收到的输入是相同的。In the structure shown in FIG. 6, the demultiplexer 32 is connected to the optical transmission medium 33 arranged in the row direction. As shown in FIG. Multiplexer 32 , an input terminal of demultiplexer 32 , and an output terminal of demultiplexer 32 is connected to computing node 31 . The difference between Fig. 6 and Fig. 5 mainly lies in that the inputs received by a plurality of demultiplexers 32 in a row in Fig. 5 are usually different, while in Fig. 6 the inputs received by a plurality of demultiplexers 32 in a row are The input is the same.
示例性地,光计算网络单元30可以为一个处理单元,也可以由多个处理单元组成。例如,光计算网络可以由多个光学处理单元(optical processing unit,OPU)组成,每个光学处理单元即为一个处理单元。每个光学处理单元可以包含多行或多列计算节点,在进行光分配时, 可以每个光学处理单元对应一束汇聚而成的光,或者一个光学处理单元对应多束汇聚而成的光。Exemplarily, the optical computing network unit 30 may be one processing unit, or may be composed of multiple processing units. For example, an optical computing network may be composed of multiple optical processing units (optical processing units, OPUs), and each optical processing unit is a processing unit. Each optical processing unit may contain multiple rows or columns of computing nodes. When performing light distribution, each optical processing unit may correspond to one beam of converged light, or one optical processing unit may correspond to multiple beams of converged light.
也即,光计算网络单元30包括至少一个光学处理单元,发射至少一路第二光信号至光计算网络单元30,包括:That is, the optical computing network unit 30 includes at least one optical processing unit, and transmits at least one second optical signal to the optical computing network unit 30, including:
根据至少一个光学处理单元的处理能力,发射至少一路第二光信号至至少一个光学处理单元。According to the processing capability of the at least one optical processing unit, at least one second optical signal is sent to the at least one optical processing unit.
其中,光学处理单元的处理能力通常由它所包含的计算节点数量决定,根据每个光学处理单元的处理能力,确定至少一路第二光信号是发送给一个还是多个光学处理单元。Wherein, the processing capability of the optical processing unit is generally determined by the number of computing nodes it contains, and according to the processing capability of each optical processing unit, it is determined whether at least one second optical signal is sent to one or more optical processing units.
图7是本申请一些实施例提供的光计算系统的部分结构示意图。参见图7,该光计算系统中的光计算网络单元30包括多个OPU 300,光汇聚元件汇聚而成的多路第二光信号被发送给多个OPU 300,每个OPU 300接收一路第二光信号。Fig. 7 is a partial structural diagram of an optical computing system provided by some embodiments of the present application. Referring to FIG. 7, the optical computing network unit 30 in the optical computing system includes a plurality of OPUs 300, and the multiple second optical signals converged by the optical converging elements are sent to the multiple OPUs 300, and each OPU 300 receives one second optical signal. light signal.
图8是本申请一些实施例提供的光计算系统的部分结构示意图。参见图8,该光计算系统中的光计算网络单元30包括多个OPU,光汇聚元件汇聚而成的多路第二光信号被发送给一个OPU,该OPU接收多路第二光信号。Fig. 8 is a partial structural diagram of an optical computing system provided by some embodiments of the present application. Referring to FIG. 8 , the optical computing network unit 30 in the optical computing system includes multiple OPUs, and the multiple second optical signals converged by the optical converging element are sent to one OPU, and the OPU receives the multiple second optical signals.
图7和图8示出了两种可能的实施方式,具体第二光信号的调度可以根据需要进行控制,例如控制汇聚成几路第二光信号,每一路第二光信号发射到光计算网络单元的哪里等。Figure 7 and Figure 8 show two possible implementations, the specific scheduling of the second optical signal can be controlled according to needs, for example, the control is converged into several second optical signals, and each second optical signal is transmitted to the optical computing network Where does the unit wait.
值得说明的是,在图7和图8所示的结构中,为了简化,每个OPU仅示出了一行计算节点31,实际每个OPU可以包括多行计算节点31。It should be noted that, in the structures shown in FIG. 7 and FIG. 8 , for simplicity, each OPU only shows one row of computing nodes 31 , but actually each OPU may include multiple rows of computing nodes 31 .
本公开另一些实施例提供的光计算系统包括光信号提供单元、光分配单元和光计算网络单元,这些实施例中光分配单元为可选部件,例如通过光纤等将光信号提供单元输出的光信号传输给光计算网络单元。The optical computing system provided by other embodiments of the present disclosure includes an optical signal providing unit, an optical distribution unit, and an optical computing network unit. In these embodiments, the optical distribution unit is an optional component, for example, the optical signal output by the optical signal providing unit through an optical fiber, etc. It is transmitted to the optical computing network unit.
其中,光信号提供单元包括光源单元和调制单元。下面结合附图对这些实施例提供的光计算系统的结构进行说明,值得注意的是,后文实施例中使用的第一光信号、第二光信号仅用来表示这些实施例中光信号的变化过程,后文实施例中的第一光信号和前文提供的实施例中所限定的第一光信号可以是不同光信号。Wherein, the optical signal providing unit includes a light source unit and a modulation unit. The structure of the optical computing system provided by these embodiments will be described below in conjunction with the accompanying drawings. It should be noted that the first optical signal and the second optical signal used in the following embodiments are only used to represent the optical signals in these embodiments. In a change process, the first optical signal in the following embodiments and the first optical signal defined in the embodiments provided above may be different optical signals.
图9是本申请一些实施例提供的光计算系统的部分结构示意图。主要示出了调制单元12、光分配单元20、光计算网络单元30的详细结构,参见图9:Fig. 9 is a partial structural diagram of an optical computing system provided by some embodiments of the present application. It mainly shows the detailed structure of the modulation unit 12, the optical distribution unit 20, and the optical computing network unit 30, see FIG. 9:
调制单元12包括多个耦合器121和多个调制器122,耦合器121的输入端和光源单元11的输出端连接,耦合器121的输出端和调制器122的输入端连接,调制器122的输出端通过光分配单元20和计算节点31所连的光传输介质33连接。其中,光计算单元40的结构可以参见图7和图8,这里不再赘述。The modulation unit 12 includes a plurality of couplers 121 and a plurality of modulators 122, the input end of the coupler 121 is connected to the output end of the light source unit 11, the output end of the coupler 121 is connected to the input end of the modulator 122, and the input end of the modulator 122 The output end is connected to the optical transmission medium 33 connected to the computing node 31 through the optical distribution unit 20 . Wherein, the structure of the optical calculation unit 40 can be referred to FIG. 7 and FIG. 8 , which will not be repeated here.
多个耦合器121用于将多路第一光信号耦合成多路第二光信号;多路调制器122用于采用多路第一电信号,分别对多路第二光信号进行调制,得到调制后的第二光信号,每路第一电信号是通过对多路频率不同的第二电信号进行耦合得到的。 Multiple couplers 121 are used to couple multiple channels of first optical signals into multiple channels of second optical signals; multiplexers 122 are used to adopt multiple channels of first electrical signals to respectively modulate multiple channels of second optical signals to obtain For the modulated second optical signal, each first electrical signal is obtained by coupling multiple second electrical signals with different frequencies.
在这种实现方式下,由于先对第一光信号进而了耦合,然后再对耦合的光信号进行调制,因此减少了需求的调制器的数量,有利于降低整个光计算系统的尺寸和成本。In this implementation manner, since the first optical signal is coupled first, and then the coupled optical signal is modulated, the number of required modulators is reduced, which is beneficial to reducing the size and cost of the entire optical computing system.
在本申请的一些可能的实施方式中,第一电信号可以通过一个电信号产生电路生成,下面结合图10对第一电信号的产生过程进行说明:In some possible implementations of the present application, the first electrical signal may be generated by an electrical signal generating circuit. The generation process of the first electrical signal will be described below in conjunction with FIG. 10 :
图10是本申请一些实施例提供的电信号产生电路的结构示意图。参见图10,该电信号产生电路包括数字电路91、多个乘法器92、多个射频源93和多个数模转换器(digital to analog convertor,DAC)94。Fig. 10 is a schematic structural diagram of an electrical signal generating circuit provided by some embodiments of the present application. Referring to FIG. 10 , the electric signal generating circuit includes a digital circuit 91 , multiple multipliers 92 , multiple radio frequency sources 93 and multiple digital to analog converters (digital to analog converter, DAC) 94.
数字电路91提供多路频率相同的数字频率信号,每路数字频率信号上已经携带了输入信息;利用多个乘法器92对这多路数字频率信号的频率进行变频,从而得到多路频率不同的数字频率信号(第二电信号);再利用多个射频源93对多路数字频率信号进行耦合,得到多路耦合后的电信号;利用多个数模转换器94将数字信号转换为模拟信号,得到多路第一电信号。这种方式下电信号是耦合后再进行的数模转换,减少了数模转换器的数量,有利于降低整个光计算系统的尺寸和成本。The digital circuit 91 provides multiple channels of digital frequency signals with the same frequency, and each channel of digital frequency signals has carried input information; multiple multipliers 92 are used to convert the frequencies of these multiple channels of digital frequency signals, thereby obtaining multiple channels of different frequencies. Digital frequency signal (second electrical signal); then utilize multiple radio frequency sources 93 to couple multiple digital frequency signals to obtain multiple coupled electrical signals; utilize multiple digital-to-analog converters 94 to convert the digital signal into an analog signal , to obtain multiple first electrical signals. In this way, the digital-to-analog conversion is performed after the electrical signal is coupled, which reduces the number of digital-to-analog converters and is beneficial to reduce the size and cost of the entire optical computing system.
其中,提供数字频率信号的数字电路可以是需要进行卷积计算的硬件,例如显卡、处理器等。Wherein, the digital circuit that provides the digital frequency signal may be hardware that needs to perform convolution calculation, such as a graphics card, a processor, and the like.
值得说明的是,上述采用乘法器进行变频的过程中,既可以将所有的数字频率信号变频成不同的频率,也可以按照后续耦合的关系,将需要耦合成一路电信号的数字频率信号变频成不同的频率,而耦合成不同路电信号的数字频率信号变频后的频率可以相同,也可以不相同。It is worth noting that in the above-mentioned process of frequency conversion using a multiplier, all digital frequency signals can be converted into different frequencies, or the digital frequency signals that need to be coupled into one electrical signal can be converted into frequency according to the subsequent coupling relationship. Different frequencies, and the frequencies of the digital frequency signals coupled into different circuit electrical signals after frequency conversion may be the same or different.
由于采用上述耦合而成的电信号对光信号进行调制时,被调制得到的每路第二光信号实际都同时经过了多路第二电信号的调制,但实际在表示输入信息时,每路第二光信号只需要对应一路第二电信号,所以在经过转换单元之前,需要对光信号进行滤波处理,将调制时多余的电信号对应的成分滤除。When the above coupled electrical signal is used to modulate the optical signal, each modulated second optical signal is actually modulated by multiple second electrical signals at the same time, but when actually representing input information, each channel The second optical signal only needs to correspond to one second electrical signal, so before passing through the conversion unit, the optical signal needs to be filtered to filter out components corresponding to redundant electrical signals during modulation.
再次参见图9,光计算系统,还可以包括至少一个滤波器40,通常滤波器40的数量为多个,下面以多个滤波器为例进行说明。多个滤波器40与多个计算节点31对应,滤波器40的输入端和对应的计算节点31的输出端连接,滤波器40的输出端和转换单元50连接。如图9所示,同一列的计算节点31对应的滤波器40的输出端连接同一个转换单元50。Referring again to FIG. 9 , the optical computing system may further include at least one filter 40 , usually there are multiple filters 40 , and the following descriptions will be made with multiple filters as an example. Multiple filters 40 correspond to multiple computing nodes 31 , the input terminals of the filters 40 are connected to the corresponding output terminals of the computing nodes 31 , and the output terminals of the filters 40 are connected to the conversion unit 50 . As shown in FIG. 9 , the output terminals of the filters 40 corresponding to the computing nodes 31 in the same column are connected to the same conversion unit 50 .
每个滤波器40用于对一个计算节点输出的光信号进行滤波,保留多路频率不同的第二电信号中的一路对应的分量。这里,滤波实际是滤除光信号的成分。在调制单元调制时,光信号同时被多路第二电信号调制,使得光信号的幅值是这多路第二电信号调制的结果之和,因此,需要将除了计算节点对应的第二电信号之外的电信号调制而成的成分滤除。Each filter 40 is configured to filter an optical signal output by a computing node, and retain a corresponding component of one of the multiple second electrical signals with different frequencies. Here, filtering is actually filtering out components of the optical signal. When modulated by the modulation unit, the optical signal is modulated by multiple second electrical signals at the same time, so that the amplitude of the optical signal is the sum of the modulation results of the multiple second electrical signals. The component modulated by the electrical signal other than the signal is filtered out.
在一些可能的实现方式中,任意两个计算节点31对应的电信号的频率不同。在另一些可能的实现方式中,部分计算节点31对应的电信号的频率可以相同,例如这些计算节点31对应的第二光信号的波长不同。In some possible implementation manners, frequencies of electrical signals corresponding to any two computing nodes 31 are different. In some other possible implementation manners, the frequencies of the electrical signals corresponding to some computing nodes 31 may be the same, for example, the wavelengths of the second optical signals corresponding to these computing nodes 31 are different.
在该实现方式中,电信号对于光信号调制,调制的是光信号的幅值。多路电信号同时对一路光信号进行调制,该光信号幅值的改变是这多个电信号调制的幅值变化总和,但由于这多路电信号的频率不同,因此仍然能够从调制后的光信号中滤出对应的电信号调制的分量。也就是说,在图9对应的实施例中,虽然调制时是采用多路电信号同时调制,但调制使用的电信号携带的输入信息和计算节点之间的对应关系仍然存在,这里滤波器滤波也是按照该对应关系执行的,也即除了用于承载计算节点对应的输入信息的电信号调制得到的成分,其余的被过滤掉。下面通过示例来进行说明:In this implementation manner, the electrical signal modulates the optical signal, and what is modulated is the amplitude of the optical signal. Multiple electrical signals modulate one optical signal at the same time, and the change in the amplitude of the optical signal is the sum of the amplitude changes of the multiple electrical signals. However, since the frequencies of the multiple electrical signals are different, it is still possible to obtain The component modulated by the corresponding electrical signal is filtered out from the optical signal. That is to say, in the embodiment corresponding to FIG. 9 , although multiple electrical signals are used for simultaneous modulation during modulation, the correspondence between the input information carried by the electrical signals used for modulation and the computing nodes still exists. Here, the filter It is also performed according to the corresponding relationship, that is, except for components obtained by modulation of electrical signals used to carry input information corresponding to computing nodes, the rest are filtered out. Let's illustrate with an example:
例如,使用m×n路电信号,频率分别为f11、f12、fmn,调制时每路第一光信号均受到这m×n路电信号的调制。在相加之前,通过滤波器进行如下方式滤波:For example, m×n electrical signals are used, and the frequencies are f11, f12, and fmn respectively. During modulation, each first optical signal is modulated by the m×n electrical signals. Before adding, filter through the filter as follows:
对于计算节点a 11,滤除f11调制而成的分量以外的其他分量,对于计算节点a 21,滤除f21调制而成的分量以外的其他分量,以此类推,将滤波之后的光信号转换成电信号。 For the calculation node a 11 , other components other than the component modulated by f11 are filtered out; for the calculation node a 21 , other components other than the component modulated by f21 are filtered out, and so on, the filtered optical signal is converted into electric signal.
对于图9所示的光计算系统,在一些可能的实施方式中,光分配单元20可以包括光转向元件和光汇聚元件。For the optical computing system shown in FIG. 9 , in some possible implementations, the light distribution unit 20 may include a light diverting element and a light converging element.
在另一些可能的实施方式中,光分配单元20可以仅包括光转向元件。光转向元件用于控制调制器输出的光信号的方向。In some other possible implementations, the light distribution unit 20 may only include light diverting elements. The light turning element is used to control the direction of the light signal output by the modulator.
示例性地,光计算网络单元30包括至少一个光学处理单元,光转向元件21,用于对至少一路第二光信号进行转向,以使至少一路第二光信号被发送给至少一个光学处理单元。Exemplarily, the optical computing network unit 30 includes at least one optical processing unit, and the optical steering element 21 is configured to divert at least one second optical signal, so that the at least one second optical signal is sent to the at least one optical processing unit.
图11是本申请一些实施例提供的光计算系统的部分结构示意图。主要示出了调制单元12、光分配单元20、光计算网络单元30的详细结构,参见图9:Fig. 11 is a partial structural diagram of an optical computing system provided by some embodiments of the present application. It mainly shows the detailed structure of the modulation unit 12, the optical distribution unit 20, and the optical computing network unit 30, see FIG. 9:
调制单元12包括一个耦合器121和一个调制器122,耦合器121的输入端和光源单元11的输出端连接,耦合器121的输出端和调制器122的输入端连接,调制器122的输出端通过光分配单元20和计算节点31所连的光传输介质33连接。The modulation unit 12 includes a coupler 121 and a modulator 122, the input end of the coupler 121 is connected to the output end of the light source unit 11, the output end of the coupler 121 is connected to the input end of the modulator 122, and the output end of the modulator 122 The optical distribution unit 20 is connected to the optical transmission medium 33 connected to the computing node 31 .
其中,耦合器121用于对多路第一光信号进行耦合;调制器122用于采用第一电信号,对耦合后的多路第一光信号进行调制,以使多路第一光信号被调制成多路第二光信号,输出调制后的光信号,第一电信号是通过对多路频率不同的第二电信号进行耦合得到的。Wherein, the coupler 121 is used for coupling multiple first optical signals; the modulator 122 is used for using the first electrical signal to modulate the coupled multiple first optical signals, so that the multiple first optical signals are Modulate multiple channels of second optical signals, output the modulated optical signals, and obtain the first electrical signal by coupling multiple channels of second electrical signals with different frequencies.
在这种实现方式下,由于先对第一光信号进而了耦合,然后再对耦合的光信号进行调制,因此减少了需求的调制器的数量,有利于降低整个光计算系统的尺寸和成本。In this implementation manner, since the first optical signal is coupled first, and then the coupled optical signal is modulated, the number of required modulators is reduced, which is beneficial to reducing the size and cost of the entire optical computing system.
在本申请的一些可能的实施方式中,第一电信号可以通过一个电信号产生电路生成,下面结合图12对第一电信号的产生过程进行说明:In some possible implementations of the present application, the first electrical signal may be generated by an electrical signal generating circuit. The generation process of the first electrical signal will be described below in conjunction with FIG. 12 :
图12是本申请一些实施例提供的电信号产生电路的结构示意图。参见图10,该电信号产生电路包括数字电路91、多个乘法器92、射频源93和一个数模转换器94。Fig. 12 is a schematic structural diagram of an electrical signal generating circuit provided by some embodiments of the present application. Referring to FIG. 10 , the electric signal generating circuit includes a digital circuit 91 , a plurality of multipliers 92 , a radio frequency source 93 and a digital-to-analog converter 94 .
数字电路91提供多路频率相同的数字频率信号,每路数字频率信号上已经携带了输入信息;利用多个乘法器92对这多路数字频率信号的频率进行变频,从而得到多路频率不同的数字频率信号(第二电信号);再利用射频源93对多路数字频率信号进行耦合,得到一路耦合后的电信号;利用一个数模转换器94将数字信号转换为模拟信号,得到一路第一电信号。这种方式下电信号是耦合后再进行的数模转换,减少了数模转换器的数量,有利于降低整个光计算系统的尺寸和成本。The digital circuit 91 provides multiple channels of digital frequency signals with the same frequency, and each channel of digital frequency signals has carried input information; multiple multipliers 92 are used to convert the frequencies of these multiple channels of digital frequency signals, thereby obtaining multiple channels of different frequencies. digital frequency signal (second electrical signal); then utilize radio frequency source 93 to couple multiple digital frequency signals to obtain a coupled electrical signal; utilize a digital-to-analog converter 94 to convert the digital signal into an analog signal to obtain a first electrical signal an electrical signal. In this way, the digital-to-analog conversion is performed after the electrical signal is coupled, which reduces the number of digital-to-analog converters and is beneficial to reduce the size and cost of the entire optical computing system.
在图11所示的结构中,光计算系统也包括滤波器40,可以参见图9的描述。In the structure shown in FIG. 11 , the optical computing system also includes a filter 40 , and the description of FIG. 9 may be referred to.
在图11所示的结构中,光分配单元20可以仅包括光转向元件。In the structure shown in FIG. 11, the light distributing unit 20 may only include a light redirecting element.
在上述实施例中,图5至图8介绍了光分配单元20可以通过光转向元件和光汇聚元件组成,在图9至图12中介绍了调制单元12可以通过耦合器121和调制器122组成,需要说明的是,上述光分配单元20的实现方式和调制单元12的实现方式可以结合并应用在同一光计算系统内。In the above embodiments, Fig. 5 to Fig. 8 have introduced that the light distribution unit 20 can be composed of a light diverting element and a light converging element, and Fig. 9 to Fig. 12 have introduced that the modulation unit 12 can be composed of a coupler 121 and a modulator 122, It should be noted that, the above implementation manner of the optical distribution unit 20 and the implementation manner of the modulation unit 12 may be combined and applied in the same optical computing system.
图13是本申请一些实施例提供的光计算方法的流程图。参见图13,该方法包括:Fig. 13 is a flow chart of an optical calculation method provided by some embodiments of the present application. Referring to Figure 13, the method includes:
131:提供多路第一光信号。131: Provide multiple channels of first optical signals.
示例性地,多路第一光信号包括第一路光信号、第二路光信号和第三路光信号,第一路光信号和第二路光信号的模式不同,第二路光信号和第三路光信号的波长不同。Exemplarily, the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
多路第一光信号由前文中的光信号提供单元10提供,该步骤的详细过程可以参考前文关于光信号提供单元10的描述。The multiple channels of first optical signals are provided by the aforementioned optical signal providing unit 10 , and the detailed process of this step can refer to the aforementioned description about the optical signal providing unit 10 .
132:对多路第一光信号进行转向。132: Steer the multiple channels of first optical signals.
步骤132可以由前文中的光转向元件21执行,该步骤的详细过程可以参考前文关于光转向元件21的描述。Step 132 can be performed by the aforementioned light redirection element 21 , and for the detailed process of this step, reference can be made to the foregoing description about the light redirection element 21 .
133:将转向后的多路第一光信号汇聚成至少一路第二光信号,发射至少一路第二光信号至光计算网络单元。133: Converge the diverted multiple first optical signals into at least one second optical signal, and transmit at least one second optical signal to the optical computing network unit.
示例性地,光计算网络单元包括至少一个光学处理单元,发射至少一路第二光信号至光计算网络单元,包括:Exemplarily, the optical computing network unit includes at least one optical processing unit, and transmits at least one second optical signal to the optical computing network unit, including:
根据至少一个光学处理单元的处理能力,发射至少一路第二光信号至至少一个光学处理单元。According to the processing capability of the at least one optical processing unit, at least one second optical signal is sent to the at least one optical processing unit.
步骤133可以由前文中的光汇聚元件22执行,该步骤的详细过程可以参考前文关于光汇聚元件22的描述。Step 133 can be performed by the aforementioned light converging element 22 , and for the detailed process of this step, reference can be made to the foregoing description of the light converging element 22 .
134:通过光计算网络单元对至少一路第二光信号进行调制。134: Use the optical computing network unit to modulate at least one second optical signal.
步骤134可以由前文中的光计算网络单元30执行,该步骤的详细过程可以参考前文关于光计算网络单元30的描述。Step 134 may be performed by the aforementioned optical computing network unit 30 , and for the detailed process of this step, reference may be made to the foregoing description about the optical computing network unit 30 .
可选地,该方法还包括:Optionally, the method also includes:
在对至少一路第二光信号进行调制之前,对至少一路第二光信号进行解耦。Before modulating the at least one second optical signal, at least one second optical signal is decoupled.
值得说明的是,图13提供的光计算方法和前文中的图5~图8任一项提供的光计算系统采用了同样的发明构思,因此,该光计算方法的细节内容可以参考前文中的图5~图8对应的文字描述及附图本身。It is worth noting that the optical calculation method provided in Figure 13 and the optical calculation system provided by any one of Figures 5 to 8 above adopt the same inventive concept, therefore, the details of the optical calculation method can refer to the previous Figures 5 to 8 correspond to the text descriptions and the drawings themselves.
图14是本申请一些实施例提供的光计算方法的流程图。参见图14,该方法包括:Fig. 14 is a flow chart of an optical calculation method provided by some embodiments of the present application. Referring to Figure 14, the method includes:
141:提供多路第一光信号。141: Provide multiple channels of first optical signals.
示例性地,多路第一光信号包括第一路光信号、第二路光信号和第三路光信号,第一路光信号和第二路光信号的模式不同,第二路光信号和第三路光信号的波长不同。Exemplarily, the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, the modes of the first optical signal and the second optical signal are different, and the second optical signal and The wavelengths of the third optical signals are different.
多路第一光信号由前文中的光源单元11提供,该步骤的详细过程可以参考前文关于光源单元11的描述。The multiple channels of first light signals are provided by the light source unit 11 mentioned above, and the detailed process of this step can refer to the description about the light source unit 11 above.
142:将多路第一光信号耦合为至少一路第二光信号。142: Coupling multiple first optical signals into at least one second optical signal.
步骤142可以由前文中的耦合器121提供,该步骤的详细过程可以参考前文关于耦合器121的描述。Step 142 can be provided by the aforementioned coupler 121 , and for the detailed process of this step, reference can be made to the aforementioned description about the coupler 121 .
143:采用至少一路第一电信号,对至少一路第二光信号进行调制,得到调制后的第二光信号,至少一路第一电信号中的每路第一电信号是通过对多路频率不同的第二电信号进行耦合得到的。143: At least one first electrical signal is used to modulate at least one second optical signal to obtain a modulated second optical signal, and each first electrical signal in at least one first electrical signal is obtained by adjusting multiple channels with different frequencies. obtained by coupling the second electrical signal.
步骤143可以由前文中的调制器122提供,该步骤的详细过程可以参考前文关于调制器122的描述。Step 143 may be provided by the aforementioned modulator 122 , and for the detailed process of this step, reference may be made to the aforementioned description about the modulator 122 .
144:通过光计算网络单元对至少一路第二光信号进行调制。144: Use the optical computing network unit to modulate at least one second optical signal.
步骤144可以由前文中的光计算网络单元30执行,该步骤的详细过程可以参考前文关于光计算网络单元30的描述。Step 144 may be performed by the aforementioned optical computing network unit 30 , and for the detailed process of this step, reference may be made to the foregoing description about the optical computing network unit 30 .
可选地,该方法还包括:Optionally, the method also includes:
在对至少一路第二光信号进行调制之前,对至少一路第二光信号进行解耦。Before modulating the at least one second optical signal, at least one second optical signal is decoupled.
可选地,光计算网络单元包括至少一个计算节点,方法还包括:Optionally, the optical computing network unit includes at least one computing node, and the method further includes:
对至少一个计算节点输出的光信号进行滤波,保留多路频率不同的第二电信号中的一路对应的分量。The optical signal output by at least one computing node is filtered, and a component corresponding to one of the multiple second electrical signals with different frequencies is retained.
值得说明的是,图14提供的光计算方法和前文中的图9~图12任一项提供的光计算系统采用了同样的发明构思,因此,该光计算方法的细节内容可以参考前文中的图9~图12对应的文字描述及附图本身。It is worth noting that the optical calculation method provided in Figure 14 uses the same inventive concept as the optical calculation system provided in any one of Figures 9 to 12 above. Therefore, the details of the optical calculation method can refer to the previous Figures 9 to 12 correspond to the text descriptions and the drawings themselves.
图15示出了本申请一个示例性实施例提供的控制装置150的结构示意图。图15所示的控制装置150用于执行上述图13或14所示的光计算方法所涉及的操作。该控制装置150可以由一般性的总线体系结构来实现。Fig. 15 shows a schematic structural diagram of a control device 150 provided by an exemplary embodiment of the present application. The control device 150 shown in FIG. 15 is used to execute the operations involved in the light calculation method shown in FIG. 13 or 14 above. The control device 150 can be realized by a general bus architecture.
如图15所示,控制装置150包括至少一个处理器151、存储器153以及至少一个通信接口154。As shown in FIG. 15 , the control device 150 includes at least one processor 151 , a memory 153 and at least one communication interface 154 .
处理器151例如是通用中央处理器(central processing unit,CPU)、数字信号处理器(digital signal processor,DSP)、网络处理器(network processer,NP)、图形处理器(Graphics Processing Unit,GPU)、神经网络处理器(neural-network processing units,NPU)、数据处理单元(Data Processing Unit,DPU)、微处理器或者一个或多个用于实现本申请方案的集成电路。例如,处理器151包括专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。PLD例如是复杂可编程逻辑器件(complex programmable logic device,CPLD)、现场可编程逻辑门阵列(field-programmable gate array,FPGA)、通用阵列逻辑(generic array logic,GAL)或其任意组合。其可以实现或执行结合本发明实施例公开内容所描述的各种逻辑方框、模块和电路。所述处理器也可以是实现计算功能的组合,例如包括一个或多个微处理器组合,DSP和微处理器的组合等等。The processor 151 is, for example, a general-purpose central processing unit (central processing unit, CPU), a digital signal processor (digital signal processor, DSP), a network processor (network processor, NP), a graphics processing unit (Graphics Processing Unit, GPU), A neural network processor (neural-network processing units, NPU), a data processing unit (Data Processing Unit, DPU), a microprocessor, or one or more integrated circuits for implementing the solution of this application. For example, the processor 151 includes an application-specific integrated circuit (application-specific integrated circuit, ASIC), a programmable logic device (programmable logic device, PLD) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The PLD is, for example, a complex programmable logic device (complex programmable logic device, CPLD), a field-programmable gate array (field-programmable gate array, FPGA), a general array logic (generic array logic, GAL) or any combination thereof. It can realize or execute various logical blocks, modules and circuits described in conjunction with the disclosure of the embodiments of the present invention. The processor may also be a combination that implements computing functions, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.
可选的,控制装置150还包括总线。总线用于在控制装置150的各组件之间传送信息。总线可以是外设部件互连标准(peripheral component interconnect,简称PCI)总线或扩展工业标准结构(extended industry standard architecture,简称EISA)总线等。总线可以分为地址总线、数据总线、控制总线等。为便于表示,图15中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。Optionally, the control device 150 further includes a bus. The bus is used to transfer information between the various components of the control device 150 . The bus may be a peripheral component interconnect standard (PCI for short) bus or an extended industry standard architecture (EISA for short) bus or the like. The bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 15 , but it does not mean that there is only one bus or one type of bus.
存储器153例如是只读存储器(read-only memory,ROM)或可存储静态信息和指令的其它类型的静态存储设备,又如是随机存取存储器(random access memory,RAM)或者可存储信息和指令的其它类型的动态存储设备,又如是电可擦可编程只读存储器(electrically erasable programmable read-only Memory,EEPROM)、只读光盘(compact disc read-only memory,CD-ROM)或其它光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其它磁存储设备,或者是能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其它介质,但不限于此。存储器153例如是独立存在,并通过总线与处理器151相连接。存储器153也可以和处理器151集成在一起。The memory 153 is, for example, a read-only memory (read-only memory, ROM) or other types of static storage devices that can store static information and instructions, or a random access memory (random access memory, RAM) or a memory that can store information and instructions. Other types of dynamic storage devices, such as electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc Storage (including Compact Disc, Laser Disc, Optical Disc, Digital Versatile Disc, Blu-ray Disc, etc.), magnetic disk storage medium, or other magnetic storage device, or is capable of carrying or storing desired program code in the form of instructions or data structures and capable of Any other medium accessed by a computer, but not limited to. The memory 153 exists independently, for example, and is connected to the processor 151 via a bus. The memory 153 can also be integrated with the processor 151 .
通信接口154使用任何收发器一类的装置,用于与其它设备或通信网络通信,通信网络可以为以太网、无线接入网(RAN)或无线局域网(wireless local area networks,WLAN)等。通信接口154可以包括有线通信接口,还可以包括无线通信接口。具体的,通信接口154可以为以太(Ethernet)接口、快速以太(Fast Ethernet,FE)接口、千兆以太(Gigabit Ethernet,GE)接口,异步传输模式(Asynchronous Transfer Mode,ATM)接口,无线局域网(wireless local area networks,WLAN)接口,蜂窝网络通信接口或其组合。以太网接口可以是光接口,电接口或其组合。在本申请实施例中,通信接口154可以用于控制装置150与其他设备进行通信。The communication interface 154 uses any device such as a transceiver for communicating with other devices or a communication network. The communication network can be Ethernet, radio access network (RAN) or wireless local area network (wireless local area networks, WLAN). The communication interface 154 may include a wired communication interface, and may also include a wireless communication interface. Specifically, the communication interface 154 can be an Ethernet (Ethernet) interface, a Fast Ethernet (Fast Ethernet, FE) interface, a Gigabit Ethernet (Gigabit Ethernet, GE) interface, an Asynchronous Transfer Mode (Asynchronous Transfer Mode, ATM) interface, a wireless local area network ( wireless local area networks, WLAN) interface, cellular network communication interface or a combination thereof. The Ethernet interface can be an optical interface, an electrical interface or a combination thereof. In the embodiment of the present application, the communication interface 154 may be used for the control device 150 to communicate with other devices.
在具体实现中,作为一种实施例,处理器151可以包括一个或多个CPU,如图15中所示的CPU0和CPU1。这些处理器中的每一个可以是一个单核(single-CPU)处理器,也可以是一个多核(multi-CPU)处理器。这里的处理器可以指一个或多个设备、电路、和/或用于处理数据(例如计算机程序指令)的处理核。In a specific implementation, as an embodiment, the processor 151 may include one or more CPUs, such as CPU0 and CPU1 shown in FIG. 15 . Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (eg, computer program instructions).
在具体实现中,作为一种实施例,控制装置150可以包括多个处理器,如图15中所示的处理器151和处理器155。这些处理器中的每一个可以是一个单核处理器(single-CPU),也可以是一个多核处理器(multi-CPU)。这里的处理器可以指一个或多个设备、电路、和/或用于处理数据(如计算机程序指令)的处理核。In a specific implementation, as an embodiment, the control device 150 may include multiple processors, such as a processor 151 and a processor 155 as shown in FIG. 15 . Each of these processors can be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). A processor herein may refer to one or more devices, circuits, and/or processing cores for processing data such as computer program instructions.
在具体实现中,作为一种实施例,控制装置150还可以包括输出设备和输入设备。输出设备和处理器151通信,可以以多种方式来显示信息。例如,输出设备可以是液晶显示器(liquid crystal display,LCD)、发光二级管(light emitting diode,LED)显示设备、阴极射线管(cathode ray tube,CRT)显示设备或投影仪(projector)等。输入设备和处理器151通信,可以以多种方式接收用户的输入。例如,输入设备可以是鼠标、键盘、触摸屏设备或传感设备等。In a specific implementation, as an example, the control device 150 may further include an output device and an input device. Output devices are in communication with processor 151 and can display information in a variety of ways. For example, the output device may be a liquid crystal display (liquid crystal display, LCD), a light emitting diode (light emitting diode, LED) display device, a cathode ray tube (cathode ray tube, CRT) display device, or a projector (projector). The input device is in communication with the processor 151 and can receive user input in a variety of ways. For example, the input device may be a mouse, a keyboard, a touch screen device, or a sensing device, among others.
在一些实施例中,存储器153用于存储执行本申请方案的程序代码1510,处理器151可以执行存储器153中存储的程序代码1510。也即是,控制装置150可以通过处理器151以及存储器153中的程序代码1510,来实现方法实施例提供的光计算方法。程序代码1510中可以包括一个或多个软件模块。可选地,处理器151自身也可以存储执行本申请方案的程序代码或指令。In some embodiments, the memory 153 is used to store the program code 1510 for implementing the solution of the present application, and the processor 151 can execute the program code 1510 stored in the memory 153 . That is, the control device 150 can implement the optical computing method provided by the method embodiment through the processor 151 and the program code 1510 in the memory 153 . One or more software modules may be included in the program code 1510 . Optionally, the processor 151 itself may also store program codes or instructions for executing the solutions of the present application.
在具体实施例中,本申请实施例的控制装置150可对应于上述各个方法实施例中的控制装置,控制装置150中的处理器151读取存储器153中的指令,使图15所示的控制装置150能够执行控制装置所执行的全部或部分操作。In a specific embodiment, the control device 150 in the embodiment of the present application may correspond to the control device in each method embodiment above, and the processor 151 in the control device 150 reads the instructions in the memory 153, so that the control shown in Fig. 15 The device 150 is capable of performing all or part of the operations performed by the control device.
具体的,处理器151用于提供多路第一光信号;对所述多路第一光信号进行转向;将转向后的所述多路第一光信号汇聚成至少一路第二光信号,发射所述至少一路第二光信号至光计算网络单元;通过所述光计算网络单元对所述至少一路第二光信号进行调制。Specifically, the processor 151 is configured to provide multiple channels of first optical signals; divert the multiple channels of first optical signals; converge the diverted multiple channels of first optical signals into at least one channel of second optical signals, and transmit The at least one second optical signal is sent to the optical computing network unit; the at least one second optical signal is modulated by the optical computing network unit.
或者,提供多路第一光信号;将所述多路第一光信号耦合为至少一路第二光信号;采用至少一路第一电信号,对所述至少一路第二光信号进行调制,得到调制后的所述第二光信号,所述至少一路第一电信号中的每路第一电信号是通过对多路频率不同的第二电信号进行耦合得到的;通过光计算网络单元对所述至少一路第二光信号进行调制。Alternatively, providing multiple first optical signals; coupling the multiple first optical signals into at least one second optical signal; using at least one first electrical signal to modulate the at least one second optical signal to obtain modulation After the second optical signal, each first electrical signal in the at least one first electrical signal is obtained by coupling multiple second electrical signals with different frequencies; At least one second optical signal is modulated.
其他可选的实施方式,为了简洁,在此不再赘述。For other optional implementation manners, for the sake of brevity, details are not repeated here.
其中,图13或14所示的光计算方法的各步骤通过控制装置150的处理器中的硬件的集成逻辑电路或者软件形式的指令完成。结合本申请实施例所公开的方法的步骤可以直接体现 为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成上述方法的步骤,为避免重复,这里不再详细描述。Wherein, each step of the optical calculation method shown in FIG. 13 or 14 is completed by an integrated logic circuit of hardware in the processor of the control device 150 or instructions in the form of software. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register. The storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware. To avoid repetition, no detailed description is given here.
本申请实施例还提供了一种芯片,包括:输入接口、输出接口、处理器和存储器,输入接口、输出接口、处理器以及存储器之间通过内部连接通路相连,处理器用于执行存储器中的代码,当代码被执行时,处理器用于执行上述任一种的光计算方法。The embodiment of the present application also provides a chip, including: an input interface, an output interface, a processor, and a memory, the input interface, the output interface, the processor, and the memory are connected through an internal connection path, and the processor is used to execute the code in the memory , when the code is executed, the processor is configured to execute any one of the above optical calculation methods.
应理解的是,上述处理器可以是CPU,还可以是其他通用处理器、DSP、ASIC、FPGA或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者是任何常规的处理器等。值得说明的是,处理器可以是支持ARM架构的处理器。It should be understood that the above-mentioned processor may be a CPU, or other general-purpose processors, DSP, ASIC, FPGA or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or any conventional processor or the like. It should be noted that the processor may be a processor supporting the ARM architecture.
进一步地,在一种可选的实施例中,上述处理器为一个或多个,存储器为一个或多个。可选地,存储器可以与处理器集成在一起,或者存储器与处理器分离设置。上述存储器可以包括只读存储器和随机存取存储器,并向处理器提供指令和数据。存储器还可以包括非易失性随机存取存储器。例如,存储器还可以存储参考块和目标块。Further, in an optional embodiment, there are one or more processors and one or more memories. Optionally, the memory may be integrated with the processor, or the memory may be separated from the processor. The above-mentioned memory may include read-only memory and random-access memory, and provides instructions and data to the processor. Memory may also include non-volatile random access memory. For example, the memory may also store reference blocks and target blocks.
该存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是ROM、PROM、EPROM、EEPROM或闪存。易失性存储器可以是RAM,其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用。例如,SRAM、DRAM、SDRAM、DDR SDRAM、ESDRAM、SLDRAM和DR RAM。The memory can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. Wherein, the non-volatile memory may be ROM, PROM, EPROM, EEPROM or flash memory. Volatile memory can be RAM, which acts as external cache memory. By way of illustration and not limitation, many forms of RAM are available. For example, SRAM, DRAM, SDRAM, DDR SDRAM, ESDRAM, SLDRAM, and DR RAM.
本申请实施例中,还提供了一种计算机可读存储介质,计算机可读存储介质存储有计算机指令,当计算机可读存储介质中存储的计算机指令被计算机设备执行时,使得计算机设备执行上述所提供的光计算方法。In the embodiment of the present application, a computer-readable storage medium is also provided. The computer-readable storage medium stores computer instructions. When the computer instructions stored in the computer-readable storage medium are executed by a computer device, the computer device executes the above-mentioned The light calculation method provided.
本申请实施例中,还提供了一种包含指令的计算机程序产品,当其在计算机设备上运行时,使得计算机设备执行上述所提供的光计算方法。In the embodiment of the present application, a computer program product including instructions is also provided, which, when running on a computer device, causes the computer device to execute the optical calculation method provided above.
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘Solid State Disk)等。In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the present application will be generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server, or data center by wired (eg, coaxial cable, optical fiber, DSL) or wireless (eg, infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media. The available medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, DVD), or a semiconductor medium (for example, a Solid State Disk).
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成, 也可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps for implementing the above embodiments can be completed by hardware, and can also be completed by instructing related hardware through a program. The program can be stored in a computer-readable storage medium. The above-mentioned The storage medium mentioned may be a read-only memory, a magnetic disk or an optical disk, and the like.
以上所述仅为本申请的可选实施例,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应该以权利要求的保护范围为准。The above descriptions are only optional embodiments of the present application, but the scope of protection of the present application is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application. All should be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
除非另作定义,此处使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开专利申请说明书以及权利要求书中使用的“第一”、“第二”、“第三”以及类似的词语并不表示任何顺序、数量或者重要性,而只是用来区分不同的组成部分。同样,“一个”或者“一”等类似词语也不表示数量限制,而是表示存在至少一个。“包括”或者“包含”等类似的词语意指出现在“包括”或者“包含”前面的元件或者物件涵盖出现在“包括”或者“包含”后面列举的元件或者物件及其等同,并不排除其他元件或者物件。Unless otherwise defined, the technical terms or scientific terms used herein shall have the usual meanings understood by those having ordinary skill in the art to which the present disclosure belongs. "First", "second", "third" and similar words used in the specification and claims of this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components . Likewise, words like "a" or "one" do not denote a limitation in quantity, but indicate that there is at least one. Words such as "comprises" or "comprising" and similar terms mean that the elements or items listed before "comprising" or "comprising" include the elements or items listed after "comprising" or "comprising" and their equivalents, and do not exclude other component or object.
以上仅为本申请一个实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。The above is only an embodiment of the present application, and is not intended to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application shall be included within the protection scope of the present application.

Claims (31)

  1. 一种光计算系统,其特征在于,包括:An optical computing system, characterized in that it comprises:
    光信号提供单元(10),用于提供多路第一光信号;An optical signal providing unit (10), configured to provide multiple channels of first optical signals;
    光转向元件(21),用于对所述多路第一光信号进行转向;a light diverting element (21), configured to divert the multiple channels of first optical signals;
    光汇聚元件(22),用于将转向后的所述多路第一光信号汇聚成至少一路第二光信号,发射所述至少一路第二光信号至光计算网络单元(30);An optical converging element (22), configured to aggregate the diverted multiple first optical signals into at least one second optical signal, and transmit the at least one second optical signal to an optical computing network unit (30);
    所述光计算网络单元(30),用于接收所述至少一路第二光信号,并对所述至少一路第二光信号进行调制。The optical computing network unit (30) is configured to receive the at least one second optical signal and modulate the at least one second optical signal.
  2. 根据权利要求1所述的光计算系统,其特征在于,所述光计算网络单元(30),包括:The optical computing system according to claim 1, wherein the optical computing network unit (30) comprises:
    至少一个解复用器(32),所述至少一个解复用器(32)用于接收所述至少一路第二光信号,且对所述至少一路第二光信号进行解耦。At least one demultiplexer (32), the at least one demultiplexer (32) is used to receive the at least one second optical signal and decouple the at least one second optical signal.
  3. 根据权利要求1所述的光计算系统,其特征在于,所述光计算网络单元(30)包括至少一个光学处理单元(300),所述发射所述至少一路第二光信号至光计算网络单元(30),包括:The optical computing system according to claim 1, wherein the optical computing network unit (30) comprises at least one optical processing unit (300), and the transmitting of the at least one second optical signal to the optical computing network unit (30), including:
    根据所述至少一个光学处理单元(300)的处理能力,发射所述至少一路第二光信号至所述至少一个光学处理单元(300)。Transmitting the at least one second optical signal to the at least one optical processing unit (300) according to the processing capability of the at least one optical processing unit (300).
  4. 根据权利要求1至3任一项所述的光计算系统,其特征在于,所述多路第一光信号包括第一路光信号、第二路光信号和第三路光信号,所述第一路光信号和所述第二路光信号的模式不同,所述第二路光信号和所述第三路光信号的波长不同。The optical computing system according to any one of claims 1 to 3, wherein the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, and the first The modes of one optical signal and the second optical signal are different, and the wavelengths of the second optical signal and the third optical signal are different.
  5. 根据权利要求4所述的光计算系统,其特征在于,所述光信号提供单元(10),包括:The optical computing system according to claim 4, wherein the optical signal providing unit (10) comprises:
    多波长光源(111),用于提供多路波长不同的第四光信号;A multi-wavelength light source (111), configured to provide multiple channels of fourth optical signals with different wavelengths;
    多个模式转换器(112),用于将接收到的一路所述第四光信号转换成多路模式不同的光信号,所述多路模式不同的光信号用于产生所述多路第一光信号;A plurality of mode converters (112), configured to convert the received fourth optical signal into multiple optical signals with different modes, and the multiple optical signals with different modes are used to generate the multiple first light signal;
    或者,所述光信号提供单元(10),包括:Alternatively, the optical signal providing unit (10) includes:
    多模式光源(113),用于提供多路模式不同的第四光信号;A multi-mode light source (113), configured to provide multiple fourth optical signals with different modes;
    多个波长转换器(112),用于将接收到的一路所述第四光信号转换成多路波长不同的光信号,所述多路波长不同的光信号用于产生所述多路第一光信号。A plurality of wavelength converters (112), configured to convert the received fourth optical signal into multiple optical signals with different wavelengths, and the multiple optical signals with different wavelengths are used to generate the multiple first light signal.
  6. 根据权利要求1至4任一项所述的光计算系统,其特征在于,所述光信号提供单元(10),包括:The optical computing system according to any one of claims 1 to 4, wherein the optical signal providing unit (10) includes:
    光源单元(11),用于提供多路第三光信号;A light source unit (11), configured to provide multiple third optical signals;
    调制单元(12),用于接收所述多路第三光信号,对所述多路第三光信号进行调制,得到多路第一光信号,所述第一光信号携带有输入信息。A modulation unit (12), configured to receive the multiple third optical signals, and modulate the multiple third optical signals to obtain multiple first optical signals, the first optical signals carrying input information.
  7. 根据权利要求6所述的光计算系统,其特征在于,所述调制单元(12),包括:The optical computing system according to claim 6, wherein the modulation unit (12) comprises:
    多个耦合器(121),用于将所述多路第三光信号耦合成多路第五光信号;A plurality of couplers (121), configured to couple the multiple third optical signals into multiple fifth optical signals;
    多路调制器(122),用于采用多路第一电信号,分别对所述多路第五光信号进行调制,得到多路第一光信号,每路所述第一电信号是通过对多路频率不同的第二电信号进行耦合得到的。A multiplexer (122), configured to use multiple first electrical signals to modulate the multiple fifth optical signals respectively to obtain multiple first optical signals, each of the first electrical signals is obtained by pairing It is obtained by coupling multiple second electrical signals with different frequencies.
  8. 根据权利要求7所述的光计算系统,其特征在于,所述光计算网络单元(30)包括至少一个计算节点(31),所述光计算系统还包括:The optical computing system according to claim 7, wherein the optical computing network unit (30) comprises at least one computing node (31), and the optical computing system further comprises:
    至少一个滤波器(40),每个所述滤波器(40)用于对所述至少一个计算节点(31)输出的光信号进行滤波,保留所述多路频率不同的第二电信号中的一路对应的分量。At least one filter (40), each of the filters (40) is used to filter the optical signal output by the at least one computing node (31), and retain the multiple second electrical signals with different frequencies The corresponding weight along the way.
  9. 根据权利要求6至8任一项所述的光计算系统,其特征在于,所述光源单元(11),包括:The optical computing system according to any one of claims 6 to 8, wherein the light source unit (11) includes:
    多波长光源(111),用于提供多路波长不同的第四光信号;A multi-wavelength light source (111), configured to provide multiple channels of fourth optical signals with different wavelengths;
    多个模式转换器(112),用于将接收到的一路所述第四光信号转换成多路模式不同的第三光信号;A plurality of mode converters (112), configured to convert one of the received fourth optical signals into multiple third optical signals with different modes;
    或者,所述光源单元(11),包括:Alternatively, the light source unit (11) includes:
    多模式光源(113),用于提供多路模式不同的第四光信号;A multi-mode light source (113), configured to provide multiple fourth optical signals with different modes;
    多个波长转换器(112),用于将接收到的一路所述第四光信号转换成多路波长不同的第三光信号。A plurality of wavelength converters (112), configured to convert one path of the received fourth optical signal into multiple paths of third optical signals with different wavelengths.
  10. 根据权利要求1至9任一项所述的光计算系统,其特征在于,所述光转向元件(21)包括硅基液晶单元(210)。The optical computing system according to any one of claims 1 to 9, characterized in that the light redirecting element (21) comprises a liquid crystal on silicon cell (210).
  11. 根据权利要求1至10任一项所述的光计算系统,其特征在于,所述光汇聚元件(22)包括衍射光栅。An optical computing system according to any one of claims 1 to 10, characterized in that the light concentrating element (22) comprises a diffraction grating.
  12. 根据权利要求1至11任一项所述的光计算系统,其特征在于,所述光计算系统,还包括:The optical computing system according to any one of claims 1 to 11, wherein the optical computing system further comprises:
    转换单元(50),用于将所述光计算网络单元(30)输出的光信号相加并转换为电信号。A conversion unit (50), configured to add and convert the optical signals output by the optical computing network unit (30) into electrical signals.
  13. 根据权利要求1至12任一项所述的光计算系统,其特征在于,所述光计算系统用于进行图像处理中的计算,或者所述光计算系统用于进行数字信号处理中的计算,或者所述光计算系统用于进行处理器中的计算。The optical calculation system according to any one of claims 1 to 12, wherein the optical calculation system is used for calculation in image processing, or the optical calculation system is used for calculation in digital signal processing, Or the optical computing system is used to perform calculations in a processor.
  14. 一种光计算系统,其特征在于,包括:An optical computing system, characterized in that it comprises:
    光源单元(11),用于提供多路第一光信号;A light source unit (11), configured to provide multiple channels of first optical signals;
    耦合器(121),用于将所述多路第一光信号耦合为至少一路第二光信号;A coupler (121), configured to couple the multiple first optical signals into at least one second optical signal;
    调制器(122),用于采用至少一路第一电信号,对所述至少一路第二光信号进行调制,得到调制后的所述第二光信号,所述至少一路第一电信号中的每路第一电信号是通过对多路频率不同的第二电信号进行耦合得到的;A modulator (122), configured to use at least one first electrical signal to modulate the at least one second optical signal to obtain the modulated second optical signal, and each of the at least one first electrical signal The first electrical signal is obtained by coupling multiple second electrical signals with different frequencies;
    光计算网络单元(30),用于接收所述至少一路第二光信号,并对所述至少一路第二光信号进行调制。An optical computing network unit (30), configured to receive the at least one second optical signal and modulate the at least one second optical signal.
  15. 根据权利要求14所述的光计算系统,其特征在于,所述光计算网络单元(30),包括:The optical computing system according to claim 14, wherein the optical computing network unit (30) comprises:
    至少一个解复用器(32),所述至少一个解复用器(32)用于接收所述至少一路第二光信号,且对所述至少一路第二光信号进行解耦。At least one demultiplexer (32), the at least one demultiplexer (32) is used to receive the at least one second optical signal and decouple the at least one second optical signal.
  16. 根据权利要求14或15所述的光计算系统,其特征在于,所述光计算网络单元(30)包括至少一个计算节点(41),所述光计算系统还包括:The optical computing system according to claim 14 or 15, wherein the optical computing network unit (30) includes at least one computing node (41), and the optical computing system further includes:
    至少一个滤波器(40),每个所述滤波器(40)用于对所述至少一个计算节点(41)输出的光信号进行滤波,保留所述多路频率不同的第二电信号中的一路对应的分量。At least one filter (40), each of the filters (40) is used to filter the optical signal output by the at least one computing node (41), and retain the multiple second electrical signals with different frequencies The corresponding weight along the way.
  17. 根据权利要求14至16任一项所述的光计算系统,其特征在于,所述多路第一光信号包括第一路光信号、第二路光信号和第三路光信号,所述第一路光信号和所述第二路光信号的模式不同,所述第二路光信号和所述第三路光信号的波长不同。The optical computing system according to any one of claims 14 to 16, wherein the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, and the first The modes of one optical signal and the second optical signal are different, and the wavelengths of the second optical signal and the third optical signal are different.
  18. 根据权利要求17所述的光计算系统,其特征在于,所述光源单元(11),包括:The optical computing system according to claim 17, wherein the light source unit (11) comprises:
    多波长光源(111),用于提供多路波长不同的第三光信号;A multi-wavelength light source (111), configured to provide multiple channels of third optical signals with different wavelengths;
    多个模式转换器(112),每个所述模式转换器(112)用于接收所述多路波长不同的第三光信号中的一路第三光信号,并用于将接收到的所述一路第三光信号转换成多路模式不同的第一光信号;A plurality of mode converters (112), each of the mode converters (112) is used to receive one of the third optical signals among the multiple third optical signals with different wavelengths, and is used to convert the received one converting the third optical signal into a first optical signal with different multipath modes;
    或者,所述光源单元(11),包括:Alternatively, the light source unit (11) includes:
    多模式光源(113),用于提供多路模式不同的第三光信号;A multi-mode light source (113), configured to provide multiple third optical signals with different modes;
    多个模式转换器(112),每个所述模式转换器(112)用于接收所述多路模式不同的第三光信号中的一路第三光信号,并用于将接收到的所述一路第三光信号转换成多路波长不同的第一光信号。A plurality of mode converters (112), each of the mode converters (112) is used to receive one of the third optical signals of the multiple third optical signals with different modes, and is used to convert the received one of the third optical signals The third optical signal is converted into multiple channels of first optical signals with different wavelengths.
  19. 根据权利要求14至18任一项所述的光计算系统,其特征在于,所述光计算网络单元(30)包括至少一个光学处理单元(300),所述光计算系统,还包括:The optical computing system according to any one of claims 14 to 18, wherein the optical computing network unit (30) includes at least one optical processing unit (300), and the optical computing system further includes:
    光转向元件(21),用于对所述至少一路第二光信号进行转向,以使所述至少一路第二光信号被发送给所述至少一个光学处理单元(300)。A light diverting element (21), configured to divert the at least one second optical signal, so that the at least one second optical signal is sent to the at least one optical processing unit (300).
  20. 根据权利要求19所述的光计算系统,其特征在于,所述光转向元件(21)包括硅基液晶单元(210)。The optical computing system according to claim 19, characterized in that the light redirecting element (21) comprises a liquid crystal on silicon cell (210).
  21. 根据权利要求14至20任一项所述的光计算系统,其特征在于,所述光计算系统,还包括:The optical computing system according to any one of claims 14 to 20, wherein the optical computing system further comprises:
    转换单元(50),用于将所述光计算网络单元(30)输出的光信号相加并转换为电信号。A conversion unit (50), configured to add and convert the optical signals output by the optical computing network unit (30) into electrical signals.
  22. 根据权利要求14至21任一项所述的光计算系统,其特征在于,所述光计算系统用于进行图像处理中的计算,或者所述光计算系统用于进行数字信号处理中的计算,或者所述光计算系统用于进行处理器中的计算。The optical calculation system according to any one of claims 14 to 21, wherein the optical calculation system is used for calculation in image processing, or the optical calculation system is used for calculation in digital signal processing, Or the optical computing system is used to perform calculations in a processor.
  23. 一种光计算方法,其特征在于,所述方法包括:An optical calculation method, characterized in that the method comprises:
    提供多路第一光信号;providing multiple first optical signals;
    对所述多路第一光信号进行转向;Steering the multiple channels of first optical signals;
    将转向后的所述多路第一光信号汇聚成至少一路第二光信号,发射所述至少一路第二光信号至光计算网络单元;Converging the diverted multiple first optical signals into at least one second optical signal, and transmitting the at least one second optical signal to the optical computing network unit;
    通过所述光计算网络单元对所述至少一路第二光信号进行调制。The at least one second optical signal is modulated by the optical computing network unit.
  24. 根据权利要求23所述的光计算方法,其特征在于,所述方法还包括:The optical calculation method according to claim 23, further comprising:
    在对所述至少一路第二光信号进行调制之前,对所述至少一路第二光信号进行解耦。Before modulating the at least one second optical signal, decoupling the at least one second optical signal.
  25. 根据权利要求23所述的光计算方法,其特征在于,所述光计算网络单元包括至少一个光学处理单元,所述发射所述至少一路第二光信号至光计算网络单元,包括:The optical computing method according to claim 23, wherein the optical computing network unit includes at least one optical processing unit, and transmitting the at least one second optical signal to the optical computing network unit includes:
    根据所述至少一个光学处理单元的处理能力,发射所述至少一路第二光信号至所述至少一个光学处理单元。Transmitting the at least one second optical signal to the at least one optical processing unit according to the processing capability of the at least one optical processing unit.
  26. 根据权利要求23至25任一项所述的光计算方法,其特征在于,所述多路第一光信号 包括第一路光信号、第二路光信号和第三路光信号,所述第一路光信号和所述第二路光信号的模式不同,所述第二路光信号和所述第三路光信号的波长不同。The optical calculation method according to any one of claims 23 to 25, wherein the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, and the first The modes of one optical signal and the second optical signal are different, and the wavelengths of the second optical signal and the third optical signal are different.
  27. 一种光计算方法,其特征在于,所述方法包括:An optical calculation method, characterized in that the method comprises:
    提供多路第一光信号;providing multiple first optical signals;
    将所述多路第一光信号耦合为至少一路第二光信号;coupling the multiple first optical signals into at least one second optical signal;
    采用至少一路第一电信号,对所述至少一路第二光信号进行调制,得到调制后的所述第二光信号,所述至少一路第一电信号中的每路第一电信号是通过对多路频率不同的第二电信号进行耦合得到的;Using at least one first electrical signal to modulate the at least one second optical signal to obtain the modulated second optical signal, and each first electrical signal in the at least one first electrical signal is obtained by pairing obtained by coupling multiple second electrical signals with different frequencies;
    通过光计算网络单元对所述至少一路第二光信号进行调制。The at least one second optical signal is modulated by the optical computing network unit.
  28. 根据权利要求27所述的光计算方法,其特征在于,所述方法还包括:The optical calculation method according to claim 27, further comprising:
    在对所述至少一路第二光信号进行调制之前,对所述至少一路第二光信号进行解耦。Before modulating the at least one second optical signal, decoupling the at least one second optical signal.
  29. 根据权利要求27或28所述的光计算方法,其特征在于,所述光计算网络单元包括至少一个计算节点,所述方法还包括:The optical computing method according to claim 27 or 28, wherein the optical computing network unit includes at least one computing node, and the method further includes:
    对所述至少一个计算节点输出的光信号进行滤波,保留所述多路频率不同的第二电信号中的一路对应的分量。Filtering the optical signal output by the at least one computing node, and retaining a component corresponding to one of the multiple second electrical signals with different frequencies.
  30. 根据权利要求27至29任一项所述的光计算方法,其特征在于,所述多路第一光信号包括第一路光信号、第二路光信号和第三路光信号,所述第一路光信号和所述第二路光信号的模式不同,所述第二路光信号和所述第三路光信号的波长不同。The optical calculation method according to any one of claims 27 to 29, wherein the multiple first optical signals include a first optical signal, a second optical signal, and a third optical signal, and the first The modes of one optical signal and the second optical signal are different, and the wavelengths of the second optical signal and the third optical signal are different.
  31. 一种控制装置,其特征在于,包括处理器和存储器;所述存储器中存储有程序代码,所述程序代码被所述处理器执行时,以实现如权利要求23至26任一项或者权利要求27至30任一项所述的方法。A control device, characterized by comprising a processor and a memory; program codes are stored in the memory, and when the program codes are executed by the processor, any one of claims 23 to 26 or claims The method described in any one of 27 to 30.
PCT/CN2021/119163 2021-09-17 2021-09-17 Optical computing system, optical computing method and control apparatus WO2023039858A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2021/119163 WO2023039858A1 (en) 2021-09-17 2021-09-17 Optical computing system, optical computing method and control apparatus
CN202180102237.9A CN117980920A (en) 2021-09-17 2021-09-17 Optical calculation system, optical calculation method, and control device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/119163 WO2023039858A1 (en) 2021-09-17 2021-09-17 Optical computing system, optical computing method and control apparatus

Publications (1)

Publication Number Publication Date
WO2023039858A1 true WO2023039858A1 (en) 2023-03-23

Family

ID=85602333

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/119163 WO2023039858A1 (en) 2021-09-17 2021-09-17 Optical computing system, optical computing method and control apparatus

Country Status (2)

Country Link
CN (1) CN117980920A (en)
WO (1) WO2023039858A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105007118A (en) * 2015-06-10 2015-10-28 重庆邮电大学 Neural network equalization method used for indoor visible light communication system
CN109784486A (en) * 2018-12-26 2019-05-21 中国科学院计算技术研究所 A kind of optical neural network processor and its training method
US20190370652A1 (en) * 2018-06-05 2019-12-05 Lightelligence, Inc. Optoelectronic computing systems
CN111338423A (en) * 2018-12-19 2020-06-26 华为技术有限公司 Optical device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105007118A (en) * 2015-06-10 2015-10-28 重庆邮电大学 Neural network equalization method used for indoor visible light communication system
US20190370652A1 (en) * 2018-06-05 2019-12-05 Lightelligence, Inc. Optoelectronic computing systems
CN111338423A (en) * 2018-12-19 2020-06-26 华为技术有限公司 Optical device
CN109784486A (en) * 2018-12-26 2019-05-21 中国科学院计算技术研究所 A kind of optical neural network processor and its training method

Also Published As

Publication number Publication date
CN117980920A (en) 2024-05-03

Similar Documents

Publication Publication Date Title
Al-Qadasi et al. Scaling up silicon photonic-based accelerators: Challenges and opportunities
WO2022016894A1 (en) Photonic neural network
TW202221578A (en) High efficiency optical neural network
CN113805641B (en) Photonic neural network
WO2023201970A1 (en) Computing chip, system, and data processing method
CN108828712B (en) Large-scale integrated optical switch chip based on optical phased array
US11509397B2 (en) Balanced photonic architectures for matrix computations
CN113472529B (en) Quantum interconnection channel switching method and device based on chip integrated optical circuit
WO2022160784A1 (en) Optical computing device and system and convolution computing method
WO2022001802A1 (en) Optical transmitter and optical modulation method
CN111561953B (en) On-chip integrated optical matrix vector multiplier based on wavelength division multiplexing and balanced detection
CN117077750B (en) Parallel photon convolution operation chip and system
WO2023039858A1 (en) Optical computing system, optical computing method and control apparatus
CN116739063A (en) Neural network accelerator based on multimode interferometer and coherent detection
CN211880393U (en) Planar sparse light-controlled phased array transmitting antenna system with low array element number
CN113325917A (en) Light computing device, system and computing method
CN116520618A (en) Photoelectric integrated photon digital-to-analog converter and method
CN114706161B (en) On-chip integrated optical matrix vector processor based on frequency coding
US20230163859A1 (en) Optical routing network-based quantum array control
CN113267911B (en) Large-capacity photoelectric hybrid programmable logic operation chip
CN115640839A (en) Storage and calculation integrated circuit, calculation system and calculation method
Prucnal et al. Neuromorphic photonics: current status and challenges
CN114217293A (en) Light-operated multi-beam forming network chip and network
CN117709423B (en) Deep neural network photon acceleration chip and operation system thereof
CN115508958B (en) Photonic chip based on optical neural network

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21957139

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202180102237.9

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE