CN117784313B - Two-dimensional photon convolution operation chip and system based on cyclic array waveguide grating - Google Patents
Two-dimensional photon convolution operation chip and system based on cyclic array waveguide grating Download PDFInfo
- Publication number
- CN117784313B CN117784313B CN202410220245.9A CN202410220245A CN117784313B CN 117784313 B CN117784313 B CN 117784313B CN 202410220245 A CN202410220245 A CN 202410220245A CN 117784313 B CN117784313 B CN 117784313B
- Authority
- CN
- China
- Prior art keywords
- signal
- dimensional
- micro
- array
- wavelength
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 125000004122 cyclic group Chemical group 0.000 title claims abstract description 37
- 230000003287 optical effect Effects 0.000 claims abstract description 157
- 239000011159 matrix material Substances 0.000 claims description 47
- 230000008878 coupling Effects 0.000 claims description 24
- 238000010168 coupling process Methods 0.000 claims description 24
- 238000005859 coupling reaction Methods 0.000 claims description 24
- 230000005540 biological transmission Effects 0.000 claims description 14
- 238000000034 method Methods 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 10
- 238000013507 mapping Methods 0.000 claims description 7
- 230000003111 delayed effect Effects 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 claims description 4
- 238000010521 absorption reaction Methods 0.000 claims description 2
- 239000011149 active material Substances 0.000 claims description 2
- 230000005693 optoelectronics Effects 0.000 claims description 2
- 239000002210 silicon-based material Substances 0.000 claims description 2
- 230000003595 spectral effect Effects 0.000 claims description 2
- 230000006798 recombination Effects 0.000 abstract description 5
- 238000005215 recombination Methods 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 21
- 238000005516 engineering process Methods 0.000 description 7
- 230000001133 acceleration Effects 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 108010076504 Protein Sorting Signals Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Abstract
The invention discloses a two-dimensional photon convolution operation chip and a system based on a cyclic array waveguide grating. The invention loads the signal to be processed on the multi-wavelength optical carrier wave containing M wavelengths, the power is divided into M paths, then the first-stage time interleaving is realized through the first-stage delay waveguide, on the basis, the cyclic array waveguide grating realizes the cyclic route distribution of the signals with different wavelengths, then the second-stage time interleaving is realized through the second-stage delay waveguide, the convolution kernel coefficient weighting of the signals with different carrier waves is realized through adjusting the micro-rings in the micro-ring weighting array, finally, the optical signal is converted into the electric signal through the balance detector array, and the electric signal obtained by serially summing the electric signals output by the balance detector array can complete convolution operation through collection and data recombination, thus obtaining the characteristic signal.
Description
Technical Field
The invention belongs to the field of photon calculation, and particularly relates to an artificial intelligence-oriented two-dimensional photon convolution operation chip based on a circular array waveguide grating and a corresponding application system.
Background
The existing neural network model is mainly based on electronic chips such as a CPU, a GPU and an application specific integrated circuit, and is limited by a classical computer structure with separated electronic chip program space and data space, so that the data transmission speed between a storage unit and a computing unit is limited, and the operation efficiency of the network model is limited. Photon technology taking photons as an information carrier has the characteristics of large bandwidth, low loss, parallelism and the like, and currently attracts researchers to apply the photon technology in the field of high-speed computation (see [Solli, Daniel R., and Bahram Jalali. "Analog optical computing." Nature Photonics 9.11 (2015): 704-706.]）. for solving the technical development bottleneck of high power consumption, long delay and limited speed of electronic technology through photon technology advantages, firstly, photon computation adopts an analog computing architecture, storage is carried out simultaneously, computation delay can be reduced while computation speed is improved, secondly, an optical link has the characteristic of low loss based on the intrinsic characteristics of an optical transmission medium, system power consumption can be indirectly reduced, finally, a photon device is increased by several orders of magnitude relative to an electronic device, the effective working bandwidth is more suitable for high-speed real-time operation of a neural network, and the scheme (see [Meng, Xiangyan, et al. "Compact optical convolution processing unit based on multimode interference." Nature Communications 14.1 (2023): 3000.]） for providing a parallel convolution operation scheme based on a neural network, which can simultaneously realize convolution operation of a plurality of convolution kernels, but is limited in the computing architecture, the scheme can only realize convolution operation of convolution kernels with non-multiple modes in the optical domain, if realizing real convolution kernel operation, signal processing needs to be carried out in the digital domain, and the scheme system has wide promotion space in the aspects of generalization, scale, practicability and the like.
Disclosure of Invention
The technical problems to be solved by the invention are as follows: the method overcomes the defects of the prior art, realizes the two-dimensional convolution kernel matrix coefficient weighting of the signal to be convolved by utilizing the monolithic integrated two-stage delay waveguide array, the micro-ring weighting array and the cyclic array waveguide grating, has a simple and compact scheme, can flexibly expand the convolution kernel matrix coefficient, and is suitable for two-dimensional convolution operation of two-dimensional data.
The technical scheme adopted by the invention specifically solves the technical problems as follows:
The two-dimensional photon convolution operation chip based on the cyclic array waveguide grating is integrated with a1 XM power divider, a first-stage delay waveguide array, an MXM cyclic array waveguide grating, a second-stage delay waveguide array, a micro-ring weighting array and a balance detector array; wherein:
the 1 XM power divider comprises 1 optical input end and M optical output ends, wherein the optical input end of the 1 XM power divider is the optical input end of the whole photon chip and is used for receiving external multi-wavelength modulation optical signals; the first-stage delay waveguide array and the second-stage delay waveguide array both comprise delay waveguides with M sections of sequentially increased lengths, wherein the optical input ends of the delay waveguides with the M sections of sequentially increased lengths of the first-stage delay waveguide array are respectively connected with M optical output ends of the 1 XM power divider; the optical output ends of the delay waveguides with sequentially increased lengths of M sections of the first-stage delay waveguide array are respectively connected with M optical input ends of the MxM circulating array waveguide grating; the multi-wavelength modulation optical signal is divided into M paths of sub multi-wavelength modulation optical signals with sequentially increased delay at equal intervals through the 1 XM power divider and the first-stage delay waveguide array; the multi-wavelength modulation optical signal is obtained by loading a signal to be convolved on a multi-wavelength optical carrier signal through a modulator, and the signal to be convolved is a one-dimensional signal obtained by flattening a matrix of a two-dimensional signal to be convolved;
the M multiplied by M circular array waveguide grating comprises M optical input ends and M optical output ends, wherein the optical output ends are respectively connected with delay waveguides with sequentially increased lengths of M sections of a second-stage delay waveguide array, and the optical output ends of the second-stage delay waveguide array are respectively connected with the optical input ends of the micro-ring weighting array; the M sub-weighted intensity modulation optical signals realize different wavelength signal circulation routes according to different wavelength signal route topological relations of input and output ports in the M X M circulation array waveguide grating, and M delay sub-multi-wavelength modulation optical signals are obtained at the output end of the second stage delay waveguide array after the M output ports of the M X M circulation array waveguide grating output optical signals are respectively delayed by the second stage delay waveguide array;
The micro-ring weighting array comprises M micro-ring weighting units, each micro-ring weighting unit is formed by connecting 1 through waveguide, 1 coupling waveguide and M micro-ring resonators in series, the input end of each through waveguide is the optical input end of the micro-ring weighting unit, the output end of each through waveguide and the output end of each coupling waveguide are a pair of optical output ends of the micro-ring weighting unit, and the two optical input ends of one balance detector are respectively connected; the optical input ends of the M through waveguides respectively receive M paths of delay sub-multi-wavelength modulation optical signals, the convolution kernel control signals respectively realize the convolution kernel coefficient weighting of M wavelengths in the delay sub-multi-wavelength modulation optical signals by controlling the coupling coefficients and the transmission coefficients of M micro-ring resonators in each micro-ring weighting unit, and the optical output ends obtain M pairs of sub-weighted intensity modulation optical signals;
the detector array comprises M balance detectors which are used for converting the M pairs of weighted intensity modulation optical signals into electric signals, the electric signals output by the M balance detectors are summed in series and then used as electric output signals of a chip, and the characteristic signals after the convolution operation of the signals to be convolved are obtained through data acquisition and recombination.
Preferably, the M-section delay waveguides in the first-stage delay waveguide array take the first-section delay waveguide as a reference, and the rest delay waveguides are sequentially increased in length to beWhere c is the speed of light in vacuum and n w is the effective refractive index of the delay waveguide,/>For a single symbol duration of the signal to be convolved, S M is the signal symbol rate to be convolved.
Preferably, the M-section delay waveguides in the second-stage delay waveguide array take the first-section delay waveguide as a reference, and the rest delay waveguides are sequentially increased in length to beWherein O is the number of columns of the two-dimensional signal matrix to be convolved, c is the speed of light in vacuum, n w is the effective refractive index of the delay waveguide,/>For a single symbol duration of the signal to be convolved, S M is the signal symbol rate to be convolved.
Further, the free spectral range f FSR of the circular array waveguide grating is spaced from the wavelength channelThe following relationships are satisfied: /(I); And different wavelengths corresponding to the multi-wavelength optical carrier signals are respectively positioned in different wavelength channels of the cyclic array waveguide grating.
Further, the M micro-ring weighting units in the micro-ring weighting array have the same structure, and the M micro-ring resonators in each micro-ring weighting unit have different radii, and their resonant wavelengths respectively correspond to one wavelength in the multi-wavelength optical carrier signal.
Further, the convolution kernel control signal realizes the convolution kernel matrix coefficient weighting of the M wavelength modulation signals by controlling the transmission coefficients and the coupling coefficients of the M micro-loops in each micro-loop weighting unit in the micro-loop weighting array, specifically:
The M conT is divided into two parts M + conT and M - conT, and the transmission coefficient and the coupling coefficient of the micro-ring resonator in the micro-ring weighting unit are controlled by a thermo-optical effect or an electro-optical effect respectively, and the M conT、M+ conT and the M - conT meet the relation of M conT =M+ conT-M- conT. M×M micro-ring resonators in the M micro-ring weighting units correspond to a two-dimensional convolution kernel matrix with the size of M×M; and the mapping relation between the M multiplied by M two-dimensional convolution kernel matrix coefficient and M multiplied by M micro-ring resonators in the M micro-ring weighting units is determined according to the wavelength routing mapping relation of the cyclic array waveguide grating.
Preferably, the chip can be integrated by a silicon-based material process or a III-V active material process.
On the basis of the technical scheme, the following technical scheme can be further obtained:
An operation system comprising a two-dimensional photon convolution operation chip based on a circular array waveguide grating comprises a multi-wavelength light source, a modulator, an optical amplifier, a signal source to be convolved, an optical amplifier, a two-dimensional convolution kernel control unit, a transimpedance amplifier, a signal acquisition and processing unit and the two-dimensional photon convolution operation chip based on the circular array waveguide grating; the multi-wavelength light source is connected with the optical input end of the modulator, the signal source to be convolved is connected with the electrical input end of the modulator, the optical output end of the modulator is connected with the input end of the optical amplifier, the output end of the optical amplifier is connected with the optical input end of the two-dimensional photon convolution operation chip, the two-dimensional convolution kernel control unit is connected with the electrical input end of the micro-ring weighting array of the two-dimensional photon convolution operation chip, the electrical output end of the two-dimensional photon convolution operation chip is connected with the electrical input end of the transimpedance amplifier, and the electrical output end of the transimpedance amplifier is connected with the acquisition processing unit.
Wherein:
a multi-wavelength light source for generating a multi-wavelength optical carrier signal containing M wavelengths and sending the signal to a modulator;
the signal source to be convolved is used for flattening the two-dimensional data to be convolved into one-dimensional data to be convolved, and generating a one-dimensional signal to be convolved according to the one-dimensional data to be convolved;
the modulator is used for loading the one-dimensional signal to be convolved on the multi-wavelength optical carrier signal to obtain a multi-wavelength modulated optical signal;
an optical amplifier for amplifying the multi-wavelength modulated optical signal output from the modulator;
the two-dimensional convolution kernel control unit is used for generating a convolution kernel control signal according to the two-dimensional convolution kernel matrix;
The transimpedance amplifier is used for amplifying the electric output signal of the two-dimensional photon convolution operation chip to obtain an amplified characteristic electric signal;
And the signal acquisition and processing unit is used for carrying out data acquisition and recombination on the amplified characteristic electric signals to obtain two-dimensional characteristic data of the signal to be convolved after convolution operation is completed.
Further, the two-dimensional data to be convolved is flattened into one-dimensional data to be convolved, and the specific process is as follows:
The two-dimensional data to be convolved is usually a two-dimensional matrix of Q rows and O columns, firstly, the two-dimensional matrix containing Q×O elements is divided into Q1×O one-dimensional matrices, secondly, the Q1×O one-dimensional matrices are sequentially connected end to obtain a 1×QO one-dimensional matrix, and the one-dimensional matrix digital-to-analog conversion can obtain the one-dimensional data to be convolved.
Compared with the prior art, the technical scheme of the invention has the following beneficial effects:
1) The invention realizes two-dimensional convolution acceleration based on wavelength-time interleaving technology, and can realize optical domain loading of signals by a single modulator, and the convolution operation speed is limited to the modulator speed.
2) The two-dimensional convolution kernel convolution acceleration operation of the two-dimensional data can be realized in a single signal period based on the combination of the two-stage delay and the two-dimensional micro-ring weighting array and the cyclic array waveguide grating, and the scheme is simple and efficient.
3) The invention can realize convolution kernel operation of any real number by combining the micro-ring weighting array with the balance detector, and the main functional devices are integrated in a single chip, thereby effectively reducing the complexity of the system, reducing the power consumption and being capable of widely increasing the application scene of the invention.
Drawings
FIG. 1 is a schematic diagram of a two-dimensional photon convolution operation chip based on a circular array waveguide grating;
FIG. 2 is a schematic diagram of an embodiment of an operation system including a two-dimensional photonic convolution operation chip based on a circular array waveguide grating according to the present invention;
FIG. 3 is a schematic diagram of a two-dimensional signal matrix to be convolved flattening process in an embodiment of an operation system including a two-dimensional photonic convolution operation chip based on a circular array waveguide grating according to the present invention: a in FIG. 3 is a two-dimensional signal matrix to be convolved and a convolution kernel matrix, B in FIG. 3 is a schematic diagram of a one-dimensional flattening processing method of the two-dimensional signal matrix to be convolved, and C in FIG. 3 is a two-dimensional characteristic signal obtained by reconstruction;
FIG. 4 is a graph of time series versus wavelength for each of the delay waveguides in the first stage delay waveguide array to output sub-multi-wavelength modulated optical signals in one embodiment of an operation system comprising a cyclic array waveguide grating based two-dimensional photon convolution operation chip in accordance with the present invention; fig. 4 a is a time-series and wavelength diagram of a first delay waveguide output sub-multi-wavelength modulated optical signal, fig. 4B is a time-series and wavelength diagram of a second delay waveguide output sub-multi-wavelength modulated optical signal, fig. 4C is a time-series and wavelength diagram of a third delay waveguide output sub-multi-wavelength modulated optical signal, and fig. 4D is a time-series and wavelength diagram of a fourth delay waveguide output sub-multi-wavelength modulated optical signal;
FIG. 5 is a graph of a cyclic array waveguide grating wavelength routing mapping relationship in one implementation of an operation system comprising a cyclic array waveguide grating-based two-dimensional photon convolution operation chip of the present invention;
FIG. 6 is a schematic diagram of a two-dimensional convolution kernel matrix modified from an array waveguide grating wavelength routing map according to an original two-dimensional convolution kernel matrix in an embodiment of an operation system including a two-dimensional photon convolution operation chip based on a cyclic array waveguide grating according to the present invention;
FIG. 7 is a graph of time series versus wavelength for a micro-ring weighting array output sub-weighted intensity modulated optical signal in one embodiment of an operation system comprising a cyclic array waveguide grating based two-dimensional photon convolution operation chip in accordance with the present invention; fig. 7 a is a time-series and wavelength diagram of the sub-weighted intensity modulated optical signal output by the first micro-ring weighting unit, and fig. 7B is a time-series and wavelength diagram of the sub-weighted intensity modulated optical signal output by the second micro-ring weighting unit;
FIG. 8 is a graph of time series versus wavelength for a micro-ring weighting array output sub-weighted intensity modulated optical signal in one embodiment of an operation system comprising a cyclic array waveguide grating based two-dimensional photon convolution operation chip in accordance with the present invention; fig. 8 a is a time-series and wavelength diagram of the sub-weighted intensity modulated optical signal output by the third micro-ring weighting unit, and fig. 8B is a time-series and wavelength diagram of the sub-weighted intensity modulated optical signal output by the fourth micro-ring weighting unit;
FIG. 9 is a graph of time series and wavelength relationships of a micro-ring weighting unit in a micro-ring weighting array through waveguide output sub-weighted intensity modulated optical signal and a coupling waveguide output sub-weighted intensity modulated optical signal in a time coordinate axis, respectively, in an embodiment of an operation system comprising a two-dimensional photon convolution operation chip based on a cyclic array waveguide grating according to the present invention; a in fig. 9 is a straight-through waveguide output sub-weighted intensity modulated optical signal, and B in fig. 9 is a coupled waveguide output sub-weighted intensity modulated optical signal.
Detailed Description
Aiming at the defects of the prior art, the method is characterized in that the route reconstruction of signals with different wavelengths is realized on a single chip based on a circular array waveguide grating, and the time-wavelength interleaving of the multi-wavelength signals and the convolution kernel matrix coefficient weighting of the signals to be convolved are realized based on a two-dimensional micro-ring weighting array combined with two-stage delay. In the scheme, the convolution kernel matrix can be flexibly expanded, and the signal processing is real-time and efficient.
The two-dimensional photon convolution operation chip structure of the invention is shown in figure 1, and is integrated by a1 XM power divider, a first-stage delay waveguide array, an MXM circulating array waveguide grating, a second-stage delay waveguide array, a micro-ring weighting array and a balance detector array; wherein:
The 1 XM power divider comprises 1 optical input end and M optical output ends, wherein the optical input end is an optical input end of the whole chip and is used for receiving external multi-wavelength modulation optical signals, the optical output ends are respectively connected with delay waveguides with sequentially increased lengths of M sections in a first-stage delay waveguide array, and the optical output ends of the first-stage delay waveguide array are respectively connected with the optical input ends of an MXM circulating array waveguide grating;
The M multiplied by M circular array waveguide grating comprises M optical input ends and M optical output ends, wherein the optical output ends are respectively connected with delay waveguides with sequentially increased lengths of M sections in a second-stage delay waveguide array, and the optical output ends of the second-stage delay waveguide array are respectively connected with the M optical input ends of the micro-ring weighting array;
the micro-ring weighting array comprises M micro-ring weighting units, each micro-ring weighting unit is formed by connecting 1 through waveguide, 1 coupling waveguide and M micro-ring resonators in series, the input end of each through waveguide is the optical input end of the micro-ring weighting unit, the output end of each through waveguide and the output end of each coupling waveguide are a pair of optical output ends of the micro-ring weighting unit, and the two optical input ends of one balance detector are respectively connected;
The detector array comprises M balance detectors, wherein the M balance detector output ends are connected in series and summarized into an electric output end, and the electric output end is the electric output end of the whole chip.
The structural diagram of a specific embodiment of an operation system of the two-dimensional photon convolution operation chip based on the cyclic array waveguide grating of the present invention is shown in fig. 2, and the operation system comprises: the device comprises a multi-wavelength light source, a modulator, an optical amplifier, a signal source to be convolved, a two-dimensional convolution kernel control unit, a transimpedance amplifier, a signal acquisition and processing unit, a two-dimensional photon convolution operation chip and the like.
Firstly, a multi-wavelength light source generates a multi-wavelength light carrier signal containing M wavelengths and sends the multi-wavelength light carrier signal to a modulator, a signal to be convolved output by a signal source to be convolved is loaded on the multi-wavelength light carrier signal through the modulator to obtain a multi-wavelength modulated light signal, wherein the signal to be convolved is a one-dimensional signal obtained by flattening a matrix of a two-dimensional signal to be convolved; the multi-wavelength modulation optical signal is amplified by an optical amplifier and then is sent to an optical input end of a1 XM power divider in a two-dimensional photon convolution operation chip, and is divided into M sub multi-wavelength modulation optical signals by the 1 XM power divider; the M sub-multi-wavelength modulation optical signals are respectively sent into delay waveguides with sequentially increased M sections of length in the first-stage delay waveguide array, and the M sub-multi-wavelength modulation optical signals with sequentially increased M sections of delay at equal intervals are obtained; the M paths of sub-multi-wavelength modulation optical signals with sequentially increased delay at equal intervals are respectively sent into an M multiplied by M circulating array waveguide grating, different wavelength signal circulating routes of the M multiplied by M circulating array waveguide grating are realized according to different wavelength signal routing topological relations of input and output ports, and after the M output ports of the M multiplied by M circulating array waveguide grating output optical signals are respectively delayed by a second-stage delay waveguide array, M delay sub-multi-wavelength modulation optical signals are obtained at the output end of the second-stage delay waveguide array; the M delay sub-multi-wavelength modulation optical signals are respectively input into M micro-ring weighting units in the micro-ring weighting array, the convolution kernel control signals generated by the two-dimensional convolution kernel control unit respectively realize the convolution kernel coefficient weighting of M wavelengths in the corresponding delay sub-multi-wavelength modulation optical signals by controlling the coupling coefficients and the transmission coefficients of M micro-ring resonators in each micro-ring weighting unit, and the optical output end obtains M pairs of sub-weighted intensity modulation optical signals; the M pairs of sub-weighted intensity modulation optical signals complete photoelectric conversion through M balance detectors in the balance detector array to obtain M electric signals; and the electric signals output by the M balance detectors are summed in series and then used as electric output signals of the two-dimensional photon convolution operation chip, and characteristic signals after convolution operation of signals to be convolved are obtained through data acquisition and recombination.
The invention respectively loads signals to be convolved to a plurality of optical carriers based on a wavelength division multiplexing technology, realizes first-stage time interleaving of M sub-multi-wavelength modulated optical signals through a first-stage delay waveguide array, then realizes different-wavelength signal circulation routing through an M×M circulating array waveguide grating, realizes second-stage time interleaving based on a second-stage delay waveguide, realizes convolution kernel coefficient weighting of different carrier signals by utilizing microrings in M microring weighting units in a microring weighting array, realizes summation operation through a balance detector, and finally obtains a characteristic signal through acquisition and data recombination of electric signals obtained by summation of output signals of the M balance detectors. The invention can directly realize the construction of a two-dimensional convolution kernel matrix based on the two-stage delay waveguide, the cyclic array waveguide grating and the micro-ring weighting array of the integrated micro-ring resonator, and can realize the two-dimensional convolution kernel convolution acceleration operation of two-dimensional data in a single signal period, thereby greatly improving the convolution operation rate.
The modulator may be an electro-absorption modulator, a mach-zehnder modulator, or the like, and the mach-zehnder modulator is preferable in this embodiment.
For the convenience of public understanding, the following further details of the technical solution of the present invention are described by a specific embodiment (in which m=4 is selected):
firstly, a multi-wavelength laser as a multi-wavelength light source outputs 4 multi-wavelength optical carrier signals with equal wavelength intensity, the 4 multi-wavelength optical carrier signals are sent to a Mach-Zehnder modulator, a signal to be convolved output by a signal to be convolved source modulates the multi-wavelength optical carrier signals through the Mach-Zehnder modulator, and the signal to be convolved is respectively loaded on different wavelengths of the multi-wavelength optical carrier signals. The signal sequence to be convolved can be expressed as Wherein i represents a discretization time sequence number, r=qo is the length of a signal to be convolved, and the signal to be convolved is a one-dimensional signal obtained by flattening two-dimensional data to be convolved through a matrix. The two-dimensional matrix of data to be convolved is shown as a in fig. 3 as a matrix of Q rows and O columns. The matrix flattening specific operation is to convert a two-dimensional or multi-dimensional matrix into a one-dimensional matrix, the process of which is shown as B in fig. 3. Each intensity-modulated wavelength corresponds to a signal to be convolved to obtain a multi-wavelength modulated optical signal. The multi-wavelength modulation optical signal is amplified by an optical amplifier and then is sent to an optical input end of a 1X 4 power divider in a two-dimensional photon convolution operation chip by an optical fiber-chip coupling technology, and is divided into 4-sub multi-wavelength modulation optical signals by the 1X 4 power divider. The 4 light output ends of the 1X 4 power divider are respectively connected with 4 delay waveguides with sequentially increased lengths in the first-stage delay waveguide array. The 4 sections of delay waveguides in the first-stage delay waveguide array take the first section of delay waveguide as a reference, and the length of the rest delay waveguides is increased to/>Where c is the speed of light in vacuum and n w is the effective refractive index of the delay waveguide,/>For a single symbol duration of the signal to be convolved, i.e., the time difference between x (i) and x (i-1), S M is the symbol rate of the signal to be convolved. The time sequence and wavelength relation diagrams of the sub-multi-wavelength modulated optical signals with the output delays of the 4 delay waveguides in the first-stage delay waveguide array sequentially increased at equal intervals are respectively shown as A in fig. 4, B in fig. 4, C in fig. 4 and D in fig. 4. The optical output ends of the first-stage delay waveguide array are respectively connected with 4 optical input ends of the 4×4 cyclic array waveguide grating, and the 4 sub-multi-wavelength modulated optical signals with sequentially equal interval increase are circularly routed in the M×M cyclic array waveguide grating according to the different wavelength signal routing topological relation of the input and output ports to obtain 4 second sub-multi-wavelength modulated optical signals. The free spectrum range f FSR and the wavelength channel interval/>, of the circulating array waveguide gratingThe following relationships are satisfied: /(I); And different wavelengths corresponding to the multi-wavelength optical carrier signals are respectively positioned in different wavelength channels of the cyclic array waveguide grating. E is adopted to represent the e optical input port of the cyclic array waveguide grating, f represents different wavelength serial numbers of the multi-wavelength optical carrier signals, and the wavelength signals input by the e optical input port of the cyclic array waveguide grating and with the wavelength serial number f are represented asThe cyclic routing relationship of the cyclic arrayed waveguide grating for signals of different wavelengths is shown in fig. 5. And after the 4 second sub-multi-wavelength modulation optical signals are respectively delayed in the second-stage delay waveguide array, 4 delay sub-multi-wavelength modulation optical signals are obtained at the output end of the second-stage delay waveguide array. The 4-section delay waveguide in the second-stage delay waveguide array takes the first-section delay waveguide as a reference, and the length of the rest delay waveguides is increased to/>Wherein O is the number of columns of the two-dimensional signal matrix to be convolved. The 4 delayed multi-wavelength modulation optical signals are respectively sent into a weighted micro-ring array comprising 4 micro-ring weighting units, the structural schematic diagram of each micro-ring weighting unit is shown in fig. 2, each micro-ring weighting unit is formed by connecting 1 through waveguide, 1 coupling waveguide and M micro-ring resonators in series, the input end of each through waveguide is the optical input end of the micro-ring weighting unit, the output end of each through waveguide and the output end of each coupling waveguide are a pair of optical output ends of the micro-ring weighting unit, the resonance characteristics of the 4 micro-rings in each micro-ring weighting unit sequentially correspond to one wavelength of the multi-wavelength optical carrier signal, the transmission coefficient and the coupling coefficient of the micro-ring resonator are determined according to the size of a convolution kernel matrix element and the initial signal intensity of each wavelength in the multi-wavelength optical carrier signal, the transmission coefficient and the coupling coefficient of the micro-ring resonator are changed through a thermo-optic effect or an electro-optic effect, and the original two-dimensional convolution kernel matrix coefficient M con is set to be expressed as:
w represents a convolution kernel matrix element, and the two-dimensional convolution kernel matrix coefficient M conT corrected according to the arrayed waveguide grating wavelength routing mapping relation diagram is expressed as follows:
The schematic diagram of the original two-dimensional convolution kernel matrix corrected according to the array waveguide grating wavelength routing mapping relation diagram is shown in fig. 6. It should be noted that, because the transmission coefficient and the coupling coefficient of the micro-ring resonator in the micro-ring weighting unit can only correspond to positive numbers, in order to realize that the convolution kernel coefficient takes a value in the real number domain, the modified two-dimensional convolution kernel matrix needs to be divided into two parts M + conT and M - conT, and the transmission coefficient and the coupling coefficient of the micro-ring resonator in the micro-ring weighting unit are controlled respectively, and the satisfying relation between M conT、M+ conT and M - conT is M conT =M+ conT-M- conT. And the convolution kernel control signals output by the two-dimensional convolution kernel matrix control unit respectively control the coupling coefficients and the transmission coefficients of the micro-ring resonators at corresponding positions in the micro-ring weighting array according to the corrected two-dimensional convolution kernel matrix coefficients to respectively realize the convolution kernel coefficient weighting of M wavelengths in the delay sub-multi-wavelength modulated optical signals. The optical output obtains 4 pairs of sub-weighted intensity modulated optical signals. The time series and wavelength diagrams of the sub-weighted intensity modulated optical signals are shown as a in fig. 7, B in fig. 7, a in fig. 8 and B in fig. 8, respectively. The 4 pairs of sub-weighted intensity modulation optical signals are respectively input into 4 balance detectors to realize photoelectric conversion, 4 electric signals are obtained, and the electric signals output by the 4 balance detectors are summed in series and then used as electric output signals of a two-dimensional photon convolution operation chip. In order to more clearly explain the two-dimensional convolution operation method, a time sequence and a wavelength relation diagram of a micro-ring weighting unit through waveguide output sub-weighted intensity modulation optical signal and a coupling waveguide output sub-weighted intensity modulation optical signal in a time coordinate axis are combined for description; wherein: a in fig. 9 corresponds to the through waveguide outputting the sub-weighted intensity modulated optical signal, and B in fig. 9 corresponds to the coupling waveguide outputting the sub-weighted intensity modulated optical signal. The external transimpedance amplifier amplifies the electric output signal, the acquisition processing unit acquires the signal, and then the effective time sequence signal can realize two-dimensional reconstruction of the signal in a digital domain in a mode of matrix flattening treatment reverse to the effective time sequence signal, and the two-dimensional reconstruction data is shown as C in fig. 3, wherein 3 columns filled are redundant data. And removing redundant data to obtain a two-dimensional characteristic signal after the two-dimensional signal to be convolved completes convolution operation. The above process is a specific example illustration of the process performed without zero padding of the original data. When the original data is zero-padded, the zero-padded data can be used as the operation of the original two-dimensional data.
Finally, it should be noted that the above list is only specific embodiments of the present invention. The invention is not limited to the above embodiments, but many variations are possible. All modifications directly derived or suggested to one skilled in the art from the present disclosure should be considered as being within the scope of the present invention.
Claims (10)
1. The two-dimensional photon convolution operation chip based on the cyclic array waveguide grating is characterized in that the chip is integrated by a1 XM power divider, a first-stage delay waveguide array, an MXM cyclic array waveguide grating, a second-stage delay waveguide array, a micro-ring weighting array and a balance detector array which are connected in sequence; wherein:
The 1 XM power divider is used for receiving an external multi-wavelength modulation optical signal; the first-stage delay waveguide array and the second-stage delay waveguide array both comprise delay waveguides with M sections of sequentially increased lengths; the multi-wavelength modulation optical signal is divided into M paths of sub multi-wavelength modulation optical signals with sequentially increased delay at equal intervals through a1 XM power divider and a first-stage delay waveguide array; the multi-wavelength modulation optical signal is obtained by loading a signal to be convolved on a multi-wavelength optical carrier signal through a modulator, wherein the signal to be convolved is a one-dimensional signal obtained by flattening a matrix of a two-dimensional signal to be convolved;
The M sub multi-wavelength modulation optical signals realize different wavelength signal circulation routes according to different wavelength signal routing topological relations of input and output ports in the MxM circulation array waveguide grating, and the output optical signals are respectively delayed by a second-stage delay waveguide array to obtain M delay sub multi-wavelength modulation optical signals;
The micro-ring weighting array comprises M micro-ring weighting units, each micro-ring weighting unit is formed by connecting 1 through waveguide, 1 coupling waveguide and M micro-ring resonators in series, and the output end of the through waveguide and the output end of the coupling waveguide are a pair of light output ends of the micro-ring weighting units; the micro-ring weighting array respectively receives M paths of delay sub-multi-wavelength modulation optical signals, the convolution kernel coefficients of M wavelengths in the delay sub-multi-wavelength modulation optical signals are respectively weighted by controlling the coupling coefficients and the transmission coefficients of M micro-ring resonators in each micro-ring weighting unit, and an optical output end obtains M pairs of sub-weighted intensity modulation optical signals;
The detector array comprises M balance detectors which are used for converting the M pairs of weighted intensity modulation optical signals into electric signals, summing the electric signals in series and then taking the electric signals as electric output signals of the chip, and acquiring and recombining data to obtain characteristic signals of the signals to be convolved after convolution operation is completed.
2. The two-dimensional photon convolution operation chip based on cyclic array waveguide grating as claimed in claim 1, wherein the M-section delay waveguide in the first-stage delay waveguide array uses the first-section delay waveguide as reference, and the rest delay waveguides are sequentially increased in length to beWhere c is the speed of light in vacuum and n w is the effective refractive index of the delay waveguide,/>For a single symbol duration of the signal to be convolved, S M is the signal symbol rate to be convolved.
3. The two-dimensional photon convolution operation chip based on cyclic array waveguide grating as claimed in claim 1, wherein the M-section delay waveguide in the second-stage delay waveguide array uses the first-section delay waveguide as reference, and the rest delay waveguides are sequentially increased in length to beWherein O is the number of columns of the two-dimensional signal matrix to be convolved, c is the speed of light in vacuum, n w is the effective refractive index of the delay waveguide,/>For a single symbol duration of the signal to be convolved, S M is the signal symbol rate to be convolved.
4. The two-dimensional photon convolution operation chip based on cyclic array waveguide grating as claimed in claim 1, wherein free spectral range f FSR and wavelength channel interval of said cyclic array waveguide gratingThe following relationships are satisfied: /(I); And different wavelengths corresponding to the multi-wavelength optical carrier signals are respectively positioned in different wavelength channels of the cyclic array waveguide grating.
5. The two-dimensional photonic convolution operation chip based on a circular array waveguide grating according to claim 1, wherein M micro-ring weighting units in the micro-ring weighting array have the same structure, and M micro-ring resonators in each micro-ring weighting unit have different radii, and their resonant wavelengths respectively correspond to one wavelength in a multi-wavelength optical carrier signal.
6. The two-dimensional photon convolution operation chip based on the cyclic array waveguide grating according to claim 1, wherein the convolution kernel coefficients of M wavelengths in the delayed sub-multi-wavelength modulated optical signal are weighted by controlling the coupling coefficients and the transmission coefficients of M micro-ring resonators in each micro-ring weighting unit, specifically:
Dividing an M multiplied by M two-dimensional convolution kernel matrix M conT into two parts M + conT and M - conT, and controlling the transmission coefficient and the coupling coefficient of a micro-ring resonator in a micro-ring weighting unit through a thermo-optical effect or an electro-optical effect respectively, wherein the satisfying relation of M conT、M+ conT and M - conT is that elements in M conT =M+ conT-M- conT;M+ conT and M - conT are non-negative numbers; the elements in M conT are arbitrary real numbers; M×M micro-ring resonators in the M micro-ring weighting units correspond to a two-dimensional convolution kernel matrix with the size of M×M; and the mapping relation between the M multiplied by M two-dimensional convolution kernel matrix coefficient and M multiplied by M micro-ring resonators in the M micro-ring weighting units is determined according to the wavelength routing mapping relation of the cyclic array waveguide grating.
7. The two-dimensional photon convolution operation chip based on the circular array waveguide grating according to claim 1, wherein the chip is integrated by adopting a silicon-based material process or a III-V active material process.
8. An arithmetic system comprising a cyclic array waveguide grating-based two-dimensional photon convolution operation chip, characterized by comprising a multi-wavelength light source for generating a multi-wavelength light signal comprising M wavelengths, a modulator, an optical amplifier, a signal source to be convolved for generating a signal to be convolved, a two-dimensional convolution kernel control unit for generating a convolution kernel control signal from a two-dimensional convolution kernel matrix, a transimpedance amplifier, a signal acquisition and processing unit, and the cyclic array waveguide grating-based two-dimensional photon convolution operation chip of any one of claims 1 to 7; the multi-wavelength light source is connected with the optical input end of the modulator, the signal source to be convolved is connected with the electrical input end of the modulator, the optical output end of the modulator is connected with the input end of the optical amplifier, the output end of the optical amplifier is connected with the optical input end of the two-dimensional photon convolution operation chip based on the circular array waveguide grating, the two-dimensional convolution kernel control unit is connected with the electrical input end of the micro-ring weighting array of the two-dimensional photon convolution operation chip based on the circular array waveguide grating, the electrical output end of the two-dimensional photon convolution operation chip based on the circular array waveguide grating is connected with the electrical input end of the transimpedance amplifier, and the electrical output end of the transimpedance amplifier is connected with the acquisition processing unit.
9. The computing system comprising a two-dimensional photon convolution operation chip based on a circular array waveguide grating according to claim 8, wherein the specific process of generating the signal to be convolved by the signal source to be convolved is:
Dividing a two-dimensional matrix to be convolved comprising Q×O elements into Q1×O one-dimensional matrices, sequentially connecting the Q1×O one-dimensional matrices end to obtain a 1×QO one-dimensional matrix, and performing digital-to-analog conversion on the one-dimensional matrix to obtain a one-dimensional signal to be convolved.
10. The computing system comprising a cyclic array waveguide grating based two-dimensional photonic convolution operation chip of claim 8 wherein the modulator is an electro-absorption modulator or a mach-zehnder modulator.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410220245.9A CN117784313B (en) | 2024-02-28 | Two-dimensional photon convolution operation chip and system based on cyclic array waveguide grating |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410220245.9A CN117784313B (en) | 2024-02-28 | Two-dimensional photon convolution operation chip and system based on cyclic array waveguide grating |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117784313A CN117784313A (en) | 2024-03-29 |
| CN117784313B true CN117784313B (en) | 2024-06-07 |
Family
ID=
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002250828A (en) * | 1996-09-02 | 2002-09-06 | Nippon Telegr & Teleph Corp <Ntt> | Optical signal processor and optical signal processing method |
| CN109639359A (en) * | 2019-01-07 | 2019-04-16 | 上海交通大学 | Photon neural network convolutional layer chip based on micro-ring resonator |
| CN110501779A (en) * | 2019-08-26 | 2019-11-26 | 南京航空航天大学 | Micro-loop delay matrix and microwave photon integrate multi-beam phased array chip, system |
| WO2020089661A1 (en) * | 2018-10-30 | 2020-05-07 | Optagon Photonics Private Company | Optical finite impulse response filter with rate flexibility and multi-wavelength operation capability based on integrated delay lines with micro-ring resonators |
| CN111882052A (en) * | 2020-08-19 | 2020-11-03 | 北京大学 | Photon convolution neural network system |
| CN112308224A (en) * | 2020-10-09 | 2021-02-02 | 武汉光谷信息光电子创新中心有限公司 | Optical neural network device, chip and optical implementation method for neural network calculation |
| CN114358271A (en) * | 2022-03-18 | 2022-04-15 | 之江实验室 | Time-wavelength interweaving photon neural network convolution acceleration chip |
| CN114815959A (en) * | 2022-06-27 | 2022-07-29 | 之江实验室 | Photon tensor calculation acceleration method and device based on wavelength division multiplexing |
| CN115130666A (en) * | 2022-08-31 | 2022-09-30 | 之江实验室 | Two-dimensional photon convolution acceleration method and system |
| CN115167610A (en) * | 2022-09-08 | 2022-10-11 | 之江实验室 | Two-dimensional photon convolution acceleration chip and application system and method |
| CN115169542A (en) * | 2022-09-02 | 2022-10-11 | 之江实验室 | Two-dimensional photon convolution acceleration system and device for convolution neural network |
| CN115222035A (en) * | 2022-09-20 | 2022-10-21 | 之江实验室 | Photon neural network convolution acceleration chip |
| CN115374828A (en) * | 2022-09-07 | 2022-11-22 | 之江实验室 | Tensor convolution kernel acceleration chip and method |
| WO2023044990A1 (en) * | 2021-09-24 | 2023-03-30 | 上海交通大学 | Silicon-based reconfigurable microwave photon multi-beam forming network chip |
| CN116029350A (en) * | 2023-03-29 | 2023-04-28 | 之江实验室 | Two-dimensional photon coherent convolution acceleration chip based on time interleaving and application system thereof |
| CN116400453A (en) * | 2023-03-07 | 2023-07-07 | 上海理工大学 | High-resolution low-crosstalk phased array scanning chip based on sparse matrix structure |
| CN117077750A (en) * | 2023-08-21 | 2023-11-17 | 之江实验室 | Parallel photon convolution operation chip and system |
| CN117554972A (en) * | 2023-06-20 | 2024-02-13 | 之江实验室 | Multi-beam microwave photon phased array radar detection method and system |
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002250828A (en) * | 1996-09-02 | 2002-09-06 | Nippon Telegr & Teleph Corp <Ntt> | Optical signal processor and optical signal processing method |
| WO2020089661A1 (en) * | 2018-10-30 | 2020-05-07 | Optagon Photonics Private Company | Optical finite impulse response filter with rate flexibility and multi-wavelength operation capability based on integrated delay lines with micro-ring resonators |
| CN109639359A (en) * | 2019-01-07 | 2019-04-16 | 上海交通大学 | Photon neural network convolutional layer chip based on micro-ring resonator |
| CN110501779A (en) * | 2019-08-26 | 2019-11-26 | 南京航空航天大学 | Micro-loop delay matrix and microwave photon integrate multi-beam phased array chip, system |
| CN111882052A (en) * | 2020-08-19 | 2020-11-03 | 北京大学 | Photon convolution neural network system |
| CN112308224A (en) * | 2020-10-09 | 2021-02-02 | 武汉光谷信息光电子创新中心有限公司 | Optical neural network device, chip and optical implementation method for neural network calculation |
| WO2023044990A1 (en) * | 2021-09-24 | 2023-03-30 | 上海交通大学 | Silicon-based reconfigurable microwave photon multi-beam forming network chip |
| CN114358271A (en) * | 2022-03-18 | 2022-04-15 | 之江实验室 | Time-wavelength interweaving photon neural network convolution acceleration chip |
| CN114815959A (en) * | 2022-06-27 | 2022-07-29 | 之江实验室 | Photon tensor calculation acceleration method and device based on wavelength division multiplexing |
| CN115130666A (en) * | 2022-08-31 | 2022-09-30 | 之江实验室 | Two-dimensional photon convolution acceleration method and system |
| CN115169542A (en) * | 2022-09-02 | 2022-10-11 | 之江实验室 | Two-dimensional photon convolution acceleration system and device for convolution neural network |
| CN115374828A (en) * | 2022-09-07 | 2022-11-22 | 之江实验室 | Tensor convolution kernel acceleration chip and method |
| CN115167610A (en) * | 2022-09-08 | 2022-10-11 | 之江实验室 | Two-dimensional photon convolution acceleration chip and application system and method |
| CN115222035A (en) * | 2022-09-20 | 2022-10-21 | 之江实验室 | Photon neural network convolution acceleration chip |
| CN116400453A (en) * | 2023-03-07 | 2023-07-07 | 上海理工大学 | High-resolution low-crosstalk phased array scanning chip based on sparse matrix structure |
| CN116029350A (en) * | 2023-03-29 | 2023-04-28 | 之江实验室 | Two-dimensional photon coherent convolution acceleration chip based on time interleaving and application system thereof |
| CN117554972A (en) * | 2023-06-20 | 2024-02-13 | 之江实验室 | Multi-beam microwave photon phased array radar detection method and system |
| CN117077750A (en) * | 2023-08-21 | 2023-11-17 | 之江实验室 | Parallel photon convolution operation chip and system |
Non-Patent Citations (6)
| Title |
|---|
| Correlated optical convolutional neural network with "quantum speedup";Sun Yifan;LIGHT-SCIENCE & APPLICATIONS;20240131;全文 * |
| Photonics-Based Broadband Radar With Coherent Receiving for High-Resolution Detection;Guo Qingshu;IEEE PHOTONICS TECHNOLOGY LETTERS;20230715;全文 * |
| 可重构自耦合微环辅助的MZI集成光子滤波器;郑鹏飞;恽斌峰;;光学精密工程;20200115(第01期);全文 * |
| 硅基可重构模拟光计算芯片研究;赵雨赫;中国博士学位论文全文数据库 (信息科技辑);20230115;全文 * |
| 聚合物微环谐振器电光开关阵列的优化与模拟;闫欣;马春生;陈宏起;郑传涛;王现银;张大明;;光学学报;20090915(第09期);全文 * |
| 阵列波导光栅梳状带通滤波器的传输效率;郭福源;王明华;;光学技术;20071115(第06期);全文 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114358271B (en) | Time-wavelength interweaving photon neural network convolution acceleration chip | |
| CN111882052B (en) | Photon convolution neural network system | |
| CN115167610B (en) | Two-dimensional photon convolution acceleration chip and application system and method | |
| CN109639359A (en) | Photon neural network convolutional layer chip based on micro-ring resonator | |
| CN114819132B (en) | Photon two-dimensional convolution acceleration method and system based on time-wavelength interleaving | |
| CN115169542B (en) | Two-dimensional photon convolution acceleration system and device for convolution neural network | |
| CN111561953B (en) | On-chip integrated optical matrix vector multiplier based on wavelength division multiplexing and balanced detection | |
| CN114815959B (en) | Photon tensor calculation acceleration method and device based on wavelength division multiplexing | |
| CN117077750B (en) | Parallel photon convolution operation chip and system | |
| CN113805641B (en) | Photonic neural network | |
| US20210264241A1 (en) | Optical multiply and accumulate unit | |
| WO2022164746A1 (en) | Photonic accelerator for deep neural networks | |
| CN116432726A (en) | Photoelectric hybrid deep neural network operation device and operation method | |
| US11934943B1 (en) | Two-dimensional photonic neural network convolutional acceleration chip based on series connection structure | |
| CN110852431A (en) | Digital signal modulation method of photon artificial intelligence computing chip | |
| CN117784313B (en) | Two-dimensional photon convolution operation chip and system based on cyclic array waveguide grating | |
| CN115222035B (en) | Photon neural network convolution acceleration chip | |
| CN116484931B (en) | Photon matrix multiplication operation device and operation method for neural network | |
| CN117784313A (en) | Two-dimensional photon convolution operation chip and system based on cyclic array waveguide grating | |
| CN114723016A (en) | On-chip photon convolution neural network and construction method thereof | |
| CN117709423B (en) | Deep neural network photon acceleration chip and operation system thereof | |
| CN114488650A (en) | Silicon-based photonic integrated chip | |
| CN113630207A (en) | Photon neural network chip | |
| CN116029350B (en) | Two-dimensional photon coherent convolution acceleration chip based on time interleaving and application system thereof | |
| CN115688898A (en) | Photon convolution three-dimensional image processing system and method for automatic driving |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |