CN116266771A - Convolution operation device and convolution operation method based on multi-mode interference - Google Patents

Abstract

The present disclosure provides a convolution operation device based on multimode interference, comprising: the laser generation module is used for generating first laser; the data input module is used for modulating the data to be processed onto the first laser; the delay module is used for delaying and splitting the modulated first laser to obtain N beams of second laser; the multimode interference coupler is used for simultaneously carrying out multimode interference on N beams of second lasers according to a preset convolution matrix and outputting M groups of optical signals; the detector array comprises M photoelectric detectors, and the M photoelectric detectors are used for respectively receiving M groups of optical signals and detecting the intensity of the M groups of optical signals to obtain convolution operation results; wherein M and N are positive integers. The present disclosure also provides a convolution operation method based on multimode interference.

Description

Convolution operation device and convolution operation method based on multi-mode interference

technical field

The present disclosure relates to the fields of big data technology and microwave photonics, in particular to a multimode interference-based convolution operation device and a convolution operation method thereof.

Background technique

As a big data computing method that can be widely used in signal processing, physics, image processing, artificial intelligence and other fields, convolution operation needs to rely on high-performance computers to improve the efficiency of data processing.

With the development of 5G technology, autonomous driving technology, and high-speed network systems, the amount of data that needs to be processed through convolution operations is increasing exponentially. Therefore, traditional von Neumann-based computers are increasingly facing challenges in latency, energy consumption, and processing speed.

Contents of the invention

In view of this, in order to overcome at least one aspect of the above-mentioned problems, the present disclosure provides a multi-mode interference-based convolution operation device, including: a laser generation module, used to generate the first laser light; a data input module, used to process The data is modulated onto the first laser light; the delay module is used to delay and split the modulated first laser light to obtain N beams of second laser light; at least one multimode interference coupler is used to The convolution matrix simultaneously performs multi-mode interference on the N beams of second laser light, and outputs M groups of optical signals; and the detector array includes M photodetectors, and the M photodetectors are used to respectively receive the M groups of optical signals , and detecting the intensities of the M groups of optical signals to obtain a convolution operation result; wherein, M and N are positive integers.

According to an embodiment of the present disclosure, the multimode interference coupler includes N input ports and M output ports; the multimode interference coupler is configured to respectively receive the N beams of second laser light through the N input ports , and split the N second laser beams to the M output ports respectively according to N sets of preset splitting ratios to obtain M sets of optical signals; wherein, the N sets of preset splitting ratios are the same as the N beams of the first The two lasers correspond one to one.

According to an embodiment of the present disclosure, the preset convolution matrix includes M convolution kernels; the multimode interference coupler is configured to adjust the intensity of the N beams of second laser light according to the M convolution kernels respectively, M groups of optical signals are obtained; wherein, the M convolution kernels are in one-to-one correspondence with the M groups of optical signals.

According to an embodiment of the present disclosure, the multimode interference coupler includes N input waveguides, M output waveguides, and a multimode interference region; the N input waveguides and M output waveguides are respectively installed on the multimode Both sides of the mode interference area.

According to an embodiment of the present disclosure, the multimode interference area includes a plurality of multimode interference units and a plurality of adjustment parts, and the plurality of adjustment parts are respectively used to adjust a multimode interference unit in the plurality of multimode interference units. refractive index.

According to an embodiment of the present disclosure, the multimode interference coupler further includes N polarization controllers; the N polarization controllers are configured to respectively control the polarization states of the N beams of second laser light.

According to an embodiment of the present disclosure, when the at least one multimode interference coupler includes a plurality of multimode interference couplers, the plurality of multimode interference couplers are connected in parallel.

According to an embodiment of the present disclosure, the data input module includes: an arbitrary waveform generator, used to convert the data to be processed into a signal to be processed; an electro-optical modulator, used to receive the signal to be processed and the first laser, and convert The signal to be processed is modulated onto the first laser.

According to an embodiment of the present disclosure, the delay module includes a beam splitter and at least N-1 optical delay lines, the data to be processed includes continuously input N-bit data, and the duration of each bit of data is one input cycle; The beam splitter is used to divide the modulated first laser into N beams to obtain N laser components; the at least N-1 optical delay lines are used to delay the N laser components respectively, Obtaining N beams of second laser light; wherein, N-1 beams of second laser beams of the N beams of second laser light are sequentially delayed by one input period, so that the N-bit data is simultaneously input into the multimode interference coupler.

The present disclosure also provides a multi-mode interference convolution operation method, based on the multi-mode interference convolution operation device described in any one of the above, the method includes: generating the first laser through the laser generation module; through the data input module Modulate the data to be processed onto the first laser; delay and split the modulated first laser through a delay module to obtain N beams of second laser; pass at least one multimode interference coupler according to the preset volume The product matrix performs multi-mode interference on the N beams of second laser light at the same time, and outputs M groups of optical signals; the detector array includes M photodetectors, and the M photodetectors respectively receive the M groups of optical signals, and Detecting the intensities of the N groups of optical signals to obtain a convolution operation result; wherein, M and N are positive integers.

Compared with the prior art, the present disclosure has the following beneficial effects:

1. Utilize the advantages of large bandwidth, high speed and low delay of light, design the transmission time and wavelength of light, and carry out efficient big data processing through optical transmission.

2. Using multiple laser components with different wavelengths to realize the parallel convolution operation of multiple convolution kernels not only improves the data input rate, but also makes the data processing process faster.

3. Through the special design of the structural parameters in the multimode interference coupler, the regional fine adjustment of the refractive index, and the polarization control of the input light, the real-time adjustment of the convolution kernel is realized, so that the convolution operation system is fully reconfigurable and scalability.

Description of drawings

For a more complete understanding of the present disclosure and its advantages, reference should now be made to the following description taken in conjunction with the accompanying drawings, in which:

FIG. 1 schematically shows a schematic diagram of a multimode interference-based convolution operation device according to an embodiment of the present disclosure;

Fig. 2 schematically shows a schematic diagram of laser time delay according to an embodiment of the present disclosure;

FIG. 3 schematically shows a schematic structural diagram of a multimode interference coupler according to an embodiment of the present disclosure;

FIG. 4 schematically shows a schematic structural diagram of a multimode interference coupler according to another embodiment of the present disclosure;

FIG. 5 schematically shows a schematic structural diagram of a multimode interference coupler according to another embodiment of the present disclosure;

FIG. 6 schematically shows a schematic diagram of a convolution operation device based on multi-mode interference according to another embodiment of the present disclosure; and

Fig. 7 schematically shows a flow chart of a multimode interference convolution operation method according to an embodiment of the present disclosure.

Explanation of reference signs

1 laser generator module

2 Data input module

3 delay module

4 Multimode interference coupler

41 Input waveguide

42 output waveguide

43 Multimode interference zone

44 Polarization controller

5 detector array

51 photodetector

6 Optocoupler

Detailed ways

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, these descriptions are only exemplary. It is not intended to limit the scope of the present disclosure. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the present disclosure. Unless otherwise defined, the technical terms or scientific terms used in the present disclosure shall have the usual meanings understood by those skilled in the art to which the present disclosure belongs.

The terminology used herein is for the purpose of describing particular embodiments only, and is not intended to be limiting of the present disclosure. The terms "comprising", "comprising", etc. used herein indicate the presence of stated features, steps, operations and/or components, but do not exclude the presence or addition of one or more other features, steps, operations or components.

Fig. 1 schematically shows a schematic diagram of a convolution operation device based on multi-mode interference according to an embodiment of the present disclosure. As shown in FIG. 1 , the present disclosure provides a multimode interference-based convolution operation device 100 including: a laser generation module 1, a data input module 2, a delay module 3, at least one multimode interference coupler 4 and a detector array5.

The laser generating module 1 , the data input module 2 , the delay module 3 , at least one multimode interference coupler 4 and the detector array 5 are sequentially connected through optical fiber jumpers.

The multi-mode interference-based convolution operation device 100 also includes an optical amplifier, which can be located anywhere in the optical link, and is used to amplify the power of the laser in the optical link.

The laser generating module 1 is used to generate the first laser.

In order to implement convolution operations on multiple convolution kernels, the first laser may include N laser components, where N is a positive integer.

Exemplarily, the laser generating module 1 includes N lasers and a beam combiner. The N lasers respectively generate N lasers with different wavelengths, and the beam combiner combines the N lasers with different wavelengths into a first laser. Beam combiners include, but are not limited to, optical couplers, wavelength division multiplexers, dense wavelength division multiplexers, and arrayed waveguide gratings.

Exemplarily, the laser generating module 1 may be a multi-wavelength laser. A multi-wavelength laser generates a laser beam including N laser components with different wavelengths.

The data input module 2 is used for modulating the data to be processed onto the first laser.

The data input module 2 includes an arbitrary waveform generator and an electro-optic modulator. The arbitrary waveform generator and the electro-optic modulator are connected by a cable.

The data input module 2 can also include an electrical amplifier, which can be located between the arbitrary waveform generator and the electro-optical modulator, and the electrical amplifier is connected to the arbitrary waveform generator and the electro-optical modulator through the two ends of the cable, for receiving and amplifying the signal to be processed The power of the amplified signal to be processed is sent to the electro-optical modulator.

Arbitrary waveform generator for converting data to be processed into signal to be processed. Data to be processed includes, but is not limited to, images, audio, video, and text. Arbitrary waveform generators convert images, audio and text to be processed into electrical signals to be processed.

Exemplarily, the data to be processed can be converted into a signal to be processed by a programmable pulse generator (PPG), or a field programmable gate array (FPGA), a central processing unit (CPU), a graphics processing unit (GPU), The combination of a logical operation unit such as an application-specific integrated circuit (ASIC) and a digital-to-analog converter converts the data to be processed into a signal to be processed.

The electro-optic modulator is used to receive the signal to be processed and the first laser, and modulate the signal to be processed onto the first laser.

The electrical signal to be processed is used as a modulation signal, and the signal to be processed is modulated onto the first laser by the electro-optic modulator. Understandably, the data to be processed is loaded on the intensity of the first laser light through the electro-optic modulator.

It should be noted that the intensity of the modulated first laser light changes. The intensity of the N laser components included in the modulated first laser light all changes, but the intensity of each laser component changes in the same proportion. The relative intensity relationship between the modulated laser components is consistent with the relative intensity relationship between the laser components before modulation.

The delay module 3 is configured to delay and split the modulated first laser light to obtain N beams of second laser light.

Since when performing the convolution operation, it is necessary to simultaneously input N bits of data to be convolved into the multimode interference coupler 4, and the data to be processed is serially modulated onto the first laser, so it is necessary to The N laser components are delayed to different degrees, so that the N bits of data to be convolved can be input to the multimode interference coupler 4 at the same time.

The delay module 3 includes a beam splitter and at least N-1 optical delay lines. The data to be processed includes continuously input N-bit data, and the duration of each bit of data is one input cycle.

The beam splitter is used to divide the modulated first laser beam into N beams to obtain N laser components. The beam splitter splits the modulated first laser beam into N beams according to the wavelength, each wavelength is divided into one beam, and each beam forms a laser component. Beam splitters include, but are not limited to, wave division multiplexers, dense wave division multiplexers, arrayed waveguide gratings, and wave shapers.

At least N-1 optical delay lines respectively delay N-1 laser components in the N laser components to obtain N beams of second laser light. Among the N second laser beams, N−1 second laser beams are sequentially delayed for one input period, so that N bits of data are input to the multimode interference coupler 4 at the same time.

Fig. 2 schematically shows a schematic diagram of laser time delay according to an embodiment of the present disclosure.

As shown in FIG. 2(A), the laser generating module 1 generates a first laser, and the first laser includes four laser beams Laser ₁ -Laser ₄ . The data to be processed includes data X ₁ to X ₄ , and the input frequency of the data to be processed is f. After passing through the data input module 2, the lasers Laser ₁ -Laser ₄ all carry data X ₁ -X ₄ to be processed. Since the input frequency of the data to be processed is f, the input time difference between each data to be processed is an input period T=1/f.

If 4 beams of laser light are input to the multimode interference coupler 4 at the same time, the multimode interference coupler 4 can only receive the data X ₁ to be processed at the same time in the first data input cycle, and can only receive the data to be processed at the same time in the second data input cycle Data X ₂ is processed.

As shown in FIG. 2(B), the delay module 3 delays the four laser beams separately, so that the multimode interference coupler 4 can simultaneously receive the data X ₁ -X ₄ to be processed at a certain moment. The delay operation includes delaying the laser Laser ₁ for 3 input cycles, delaying the laser Laser ₂ for 2 input cycles, delaying the laser Laser ₃ for 1 input cycle, and not delaying the laser ₄ .

At least one multimode interference coupler 4 is used to simultaneously perform multimode interference on N beams of second laser light according to a preset convolution matrix, and output M groups of optical signals.

The multimode interference coupler 4 includes N input ports and M output ports. The multi-mode interference coupler 4 respectively receives N beams of second laser light through N input ports, and splits N beams of second laser light into M output ports according to N groups of preset splitting ratios, and outputs M groups through M output ports. light signal.

The N sets of preset splitting ratios correspond to the N beams of second laser light one by one. Each second laser beam is split to M output terminals according to the corresponding beam splitting ratio, and each output port outputs laser beams split by N second laser beams.

For example, the multimode interference coupler 4 includes 4 input ports and 5 output ports, and the multimode interference coupler 4 respectively receives 4 laser beams Laser' ₁ -Laser' ₄ through the 4 input ports. The four laser beams Laser' ₁ -Laser' ₄ are beam-split according to 4 sets of preset splitting ratios S ₁₁ -S ₁₅ , S ₂₁ -S ₂₅ , S ₃₁ -S ₃₅ , and S ₄₁ -S ₄₅ .

Split the laser Laser' ₁ to 5 output ports according to the preset split ratio S ₁₁ ~ S ₁₅ , split the laser Laser' ₂ to 5 output ports according to the preset split ratio S ₂₁ ~ 5 ₂₅ , and split the laser beam to 5 output ports according to the preset split ratio The ratios S ₃₁ to S ₃₅ split the laser Laser' ₃ to 5 output ports, and split the laser Laser' ₄ to 5 output ports according to the preset splitting ratios S ₄₁ to S ₄₅ . The 5 output ports output 5 groups of optical signals. The optical signals output by the first output port include lasers Laser' ₁ ~ Laser' ₄ respectively according to the preset splitting ratios S ₁₁ , S ₂₁ , S ₃₁ and S ₄₁ to the first The laser output from the first output port, the optical signal output from the second output port includes the lasers Laser' ₁ ~ Laser' ₄ split to the second output port according to the preset splitting ratios S ₁₂ , S ₂₂ , S ₃₂ and S ₄₂ respectively Laser, the optical signal output by the third output port includes lasers Laser' ₁ ~ Laser' ₄ split into the third output port according to the preset splitting ratios S ₁₃ , S ₂₃ , S ₃₃ and S ₄₃ respectively, and the fourth The optical signals output by the first output ports include the laser beams split by Laser' ₁ ~ Laser' ₄ to the fourth output port according to the preset splitting ratios S ₁₄ , S ₂₄ , S ₃₄ and S ₄₄ respectively, and the fifth output port The output optical signals include the laser beams split by the lasers Laser' ₁ to Laser' ₄ to the fifth output port according to the preset splitting ratios S ₁₅ , S ₂₅ , S ₃₅ and S ₄₅ respectively.

The splitting of N beams of lasers according to the preset splitting ratio is essentially that the data to be processed loaded on the laser is convoluted according to the preset convolution matrix. The preset convolution matrix includes M convolution kernels. The multimode interference coupler adjusts the intensity of the N beams of second laser light according to one of the M convolution kernels respectively to obtain M groups of optical signals. Wherein, the M convolution kernels are in one-to-one correspondence with the M groups of optical signals.

卷积核分别为{(K₁₁ ...K_1N)，...，(K_M1 ... K_MN)}，待处理数据包括X₁～X_N，输出的卷积运算结果为Y₁～Y_M。Exemplarily, the preset convolution matrix is

The convolution kernels are {(K ₁₁ ... K _1N ), ..., (K _M1 ... K _MN )}, the data to be processed includes X ₁ ~ X _N , and the output convolution operation result is Y ₁ ~ Y _M .

The convolution operation process can be expressed as formula (1):

Convolution operation result Y1=X ₁ K ₁₁ +X ₂ K ₁₂ +...+X _N K _1N .

For example, the preset convolution matrix includes 5 convolution kernels C ₁ -C ₅ . The multimode interference coupler 4 adjusts the intensities of the four laser beams Laser' ₁ -Laser' ₄ respectively according to the five convolution kernels C ₁ -C ₅ to obtain five groups of optical signals.

Adjust the intensities of the four lasers Laser' ₁ - Laser' ₄ according to the convolution kernel C ₁ , perform convolution operations on the data to be processed loaded on the lasers Laser' ₁ - Laser' ₄ , and output the first group of optical signals Laser" ₁ . Similarly, output optical signals Laser" ₂ -Laser" ₅ . Among them, 5 convolution kernels correspond to 5 groups of optical signals one by one, and each convolution kernel includes 4 elements.

It should be noted that the number of elements included in each convolution kernel is the same as the number of input ports of the multimode interference coupler. Convolution kernels come in many forms. In the above embodiments, the convolution kernel is expressed in the form of a one-dimensional horizontal vector, and the convolution kernel can also be expressed in the form of a multi-dimensional matrix. However, no matter what form the convolution kernel is expressed in, the convolution operation process can be expressed by the above formula (1). When the convolution kernel is a multi-dimensional matrix, the multi-dimensional matrix can be converted into a one-dimensional horizontal vector.

Fig. 3 schematically shows a schematic structural diagram of a multimode interference coupler according to an embodiment of the present disclosure.

As shown in FIG. 3 , the multimode interference coupler 4 includes N input waveguides 41 , M output waveguides 42 and a multimode interference region 43 . N input waveguides 41 and M output waveguides 42 are respectively installed on both sides of the multimode interference region 43 at a preset distance. Changing the installation positions of the input waveguide 41 and the output waveguide 42 can realize the adjustment of the preset convolution matrix. The length L, width W and height H of the multi-mode interference region 43 can be designed to realize the adjustment of the preset convolution matrix.

Fig. 4 schematically shows a structural diagram of a multimode interference coupler according to another embodiment of the present disclosure.

As shown in FIG. 4 , the multimode interference area 43 includes multiple multimode interference units and multiple adjustment parts, and the multiple adjustment parts are respectively used to adjust the refractive index of the multiple multimode interference units. A plurality of multi-mode interference units and a plurality of adjustment controls are in one-to-one correspondence.

In the embodiments of the present disclosure, there are multiple methods for regulating the multi-mode interference unit. Electrodes can be made in each multi-mode interference unit, and different voltages can be applied to the electrodes to adjust the refractive index through carrier injection; phase-change materials or ferroelectric materials can also be used to make these multi-mode interference areas The independent adjustment of the refractive index can be realized; the independent adjustment of the refractive index of each multi-mode interference unit can also be realized by independently designing the thickness and doping concentration of each multi-mode interference unit.

Fine tuning of the convolution matrix can be achieved by independently fine-tuning the refractive index of the multimode interference unit.

Fig. 5 schematically shows a structural diagram of a multimode interference coupler according to another embodiment of the present disclosure.

As shown in FIG. 5 , the multimode interference coupler 4 further includes N polarization controllers 44 on the basis of N input waveguides 41 , M output waveguides 42 and multimode interference regions 43 .

Before the optical signal is input to the input waveguide 41 , the optical signal is first input to the polarization controller 44 . The polarization controller 44 separately controls the polarization state of the laser light, so as to realize the adjustment of the convolution matrix.

The detector array 5 converts the received optical signal into an electrical signal, thereby converting the convolution result into the electrical domain.

The detector array 5 includes M photodetectors 51, and the M photodetectors 51 respectively receive M groups of optical signals, detect the intensity of the M groups of optical signals, and obtain convolution operation results.

The present disclosure also provides another embodiment, the delay module 3 may also be a dispersion medium and a beam splitter. In the case that the delay module 3 is a dispersive medium, the laser generating module 1 generates laser light with a comb spectrum, and the laser light includes N laser components. The wavelength of each laser component is different, and the wavelength interval between any two laser components with adjacent wavelengths is equal.

For example, the laser generating module 1 generates four laser components Laser ₁ - Laser ₄ , and the wavelengths of the four laser components Laser ₁ - Laser ₄ are λ ₁ , λ ₂ , λ ₃ and λ ₄ respectively. Wherein, the wavelength interval between two adjacent laser components of any wavelength among λ ₁ , λ ₂ , λ ₃ and λ ₄ is the same. Understandably, the wavelength relationship among λ ₁ , λ ₂ , λ ₃ and λ ₄ satisfies Δλ=λ ₁ -λ ₂ =λ ₂ -λ ₃ =λ ₃ -λ ₄ .

The laser generating module 1 can be a multi-wavelength laser, or N lasers, or an active mode-locked laser, an optical frequency comb, a high-speed directly modulated laser, or a combination of a laser and an electro-optic modulator.

The dispersion medium includes but not limited to at least one of dispersion compensating fiber, chirped fiber grating, common single-mode fiber and multimode fiber. The dispersive medium delays the N laser components to different degrees.

The present disclosure provides an exemplary method to achieve a delay of one data input period between any two laser components of adjacent wavelengths. However, the present disclosure does not limit the specific laser delay method.

For example, it can be set to satisfy the relationship between the laser component and the dispersive medium:

为色散介质的色散系数和L为色散介质的长度。可理解地，波长相邻的任意两个激光分量之间的延迟量为1/f。Among them, Δλ is the wavelength interval between any two laser components with adjacent wavelengths, f _k is the input frequency of the data to be processed,

is the dispersion coefficient of the dispersive medium and L is the length of the dispersive medium. Understandably, the retardation between any two laser components with adjacent wavelengths is 1/f.

It should be noted that, in the case that the delay module 3 is a beam splitter and N-1 optical delay lines, it is necessary to split the laser beam into N beams according to the wavelength, and then delay the time through the optical delay line. The delayed N beams of laser light are input to the multimode interference coupler 4 . When the delay module 3 is a dispersive medium and a beam splitter, the modulated laser beam is directly subjected to group velocity dispersion, the dispersed laser beam is split into N beams, and the N beams of laser light are input to the multimode interference coupler 4 .

The present disclosure also provides another embodiment, the laser generating module 1 may be a single-wavelength laser, and the single-wavelength laser generates laser light with a single wavelength. The delay module 3 is a plurality of optical delay lines.

Before the optical delay line delays the laser light, the modulated single-wavelength laser power needs to be divided into N beams through an optical coupler, and the optical delay line delays the N beams of laser light respectively.

Fig. 6 schematically shows a schematic diagram of a convolution operation device based on multi-mode interference according to another embodiment of the present disclosure.

As shown in Figure 6, the multimode interference-based convolution computing device 100 includes a laser generation module 1, a data input module 2, a delay module 3, N optical couplers 6, R multimode interference couplers 4 and R A detector array 5 and R multimode interference couplers 4 are connected in parallel.

For the laser generating module 1 , the data input module 2 , the delay module 3 and the detector array 5 , please refer to the previous embodiment of the multi-mode interference-based convolution operation device, which will not be repeated here.

The delay module 3 delays the N laser components to obtain N second laser beams, and the N optical couplers 6 divide the N second laser beams into R beams respectively. R beams of laser light divided by 6 power points of each optical coupler are respectively input into R multimode interference couplers 4 to realize parallel convolution calculation of multiple convolution kernels.

The present disclosure provides a detailed convolution operation method, which is suitable for the above-mentioned convolution operation device. FIG. 7 schematically shows a flowchart of the convolution operation method according to an embodiment of the present disclosure.

As shown in Figure 7, the convolution operation method at least includes the following steps:

S1, generating the first laser light through the laser generating module.

S2. Modulate the data to be processed onto the first laser through the data input module.

S3. Delaying and beam-splitting the modulated first laser light through a delay module to obtain N beams of second laser light.

S4. Simultaneously perform multi-mode interference on N beams of second laser light through at least one multi-mode interference coupler according to a preset convolution matrix, and output M groups of optical signals, where M is a positive integer.

S5. The detector array includes M photodetectors, and the M photodetectors respectively receive M groups of optical signals, and detect the intensity of the M groups of optical signals, to obtain a convolution operation result.

It should be noted that the convolution operation method of multi-mode interference in the embodiment of the present disclosure corresponds to the convolution operation device part of the multi-mode interference in the embodiment of the present disclosure, and the description of the convolution operation method of multi-mode interference For details, refer to the convolution operation device part of the multi-mode interference, which will not be repeated here.

Regarding the embodiments of the present disclosure, it should also be noted that, under the condition of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other to obtain new embodiments.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure and not to limit them. Although the present disclosure has been described in detail with reference to preferred embodiments, those skilled in the art should understand that the technical solutions of the present disclosure can be Modifications or equivalent replacements may be made without departing from the spirit and scope of the technical solutions of the present disclosure.

Claims (10)

1. A convolution operation device based on multimode interference, characterized in that, comprising: a laser generating module, configured to generate the first laser; a data input module, configured to modulate data to be processed onto the first laser; a delay module, configured to delay and split the modulated first laser light to obtain N beams of second laser light; At least one multimode interference coupler, configured to simultaneously perform multimode interference on the N beams of second laser light according to a preset convolution matrix, and output M groups of optical signals; and The detector array includes M photodetectors, and the M photodetectors are used to respectively receive the M groups of optical signals and detect the intensity of the M groups of optical signals to obtain a convolution operation result; Wherein, M and N are positive integers. 2. The convolution operation device according to claim 1, wherein the multimode interference coupler comprises N input ports and M output ports; The multimode interference coupler is configured to respectively receive the N beams of second laser light through the N input ports, and split the N beams of second laser light to the M according to N sets of preset beam splitting ratios respectively. output ports to obtain M groups of optical signals; Wherein, the N sets of preset splitting ratios correspond to the N beams of second laser light one by one. 3. The convolution operation device according to claim 1, wherein the preset convolution matrix includes M convolution kernels; The multimode interference coupler is configured to adjust the intensity of the N beams of second laser light according to the M convolution kernels respectively, to obtain M groups of optical signals; Wherein, the M convolution kernels are in one-to-one correspondence with the M groups of optical signals. 4. The convolution operation device according to claim 1, wherein the multimode interference coupler comprises N input waveguides, M output waveguides and a multimode interference region; The N input waveguides and the M output waveguides are respectively installed on both sides of the multi-mode interference area at preset intervals. 5. The convolution operation device according to claim 4, wherein the multimode interference area comprises a plurality of multimode interference units and a plurality of adjustment parts, and the plurality of adjustment parts are respectively used to adjust the multimode interference The refractive index of a multimode interference element. 6. The convolution operation device according to any one of claims 2-5, wherein the multimode interference coupler further comprises N polarization controllers; The N polarization controllers are used to respectively control the polarization states of the N beams of second laser light. 7. The convolution operation device according to claim 1, wherein, when the at least one multimode interference coupler comprises a plurality of multimode interference couplers, the plurality of multimode interference couplers are connected in parallel . 8. The convolution operation device according to claim 1, wherein the data input module comprises: Arbitrary waveform generator for converting data to be processed into signals to be processed; An electro-optic modulator, configured to receive the signal to be processed and the first laser light, and modulate the signal to be processed onto the first laser light. 9. The convolution computing device according to claim 8, wherein the delay module includes a beam splitter and at least N-1 optical delay lines, and the data to be processed includes continuously input N-bit data , the duration of each bit of data is one input cycle; The beam splitter is used to divide the modulated first laser light into N beams to obtain N laser components; The at least N-1 optical delay lines are used to respectively delay the N laser components to obtain N beams of second laser light; Wherein, N−1 second laser beams of the N second laser beams are sequentially delayed by one input period, so that the N-bit data is simultaneously input into the multimode interference coupler. 10. A convolution operation method based on multi-mode interference, characterized in that, based on the multi-mode interference-based convolution operation device according to any one of claims 1-9, the method comprises: generating the first laser light through the laser generating module; Modulating data to be processed onto the first laser through a data input module; Delaying and splitting the modulated first laser light through a delay module to obtain N beams of second laser light; Simultaneously perform multimode interference on the N beams of second laser light through at least one multimode interference coupler according to a preset convolution matrix, and output M groups of optical signals; The detector array includes M photodetectors, the M photodetectors respectively receive the M groups of optical signals, and detect the intensity of the M groups of optical signals to obtain a convolution operation result; Wherein, M and N are positive integers.

Images