CN114993472A - Bionic multispectral polarization single-pixel imaging device and method based on nerve overlapping compound eye - Google Patents
Bionic multispectral polarization single-pixel imaging device and method based on nerve overlapping compound eye Download PDFInfo
- Publication number
- CN114993472A CN114993472A CN202210615529.9A CN202210615529A CN114993472A CN 114993472 A CN114993472 A CN 114993472A CN 202210615529 A CN202210615529 A CN 202210615529A CN 114993472 A CN114993472 A CN 114993472A
- Authority
- CN
- China
- Prior art keywords
- sub
- polarization
- imaging
- eye
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 89
- 230000010287 polarization Effects 0.000 title claims abstract description 60
- 150000001875 compounds Chemical class 0.000 title claims abstract description 27
- 239000011664 nicotinic acid Substances 0.000 title claims abstract description 22
- 210000005036 nerve Anatomy 0.000 title claims abstract description 17
- 238000000034 method Methods 0.000 title abstract description 9
- 239000013307 optical fiber Substances 0.000 claims abstract description 27
- 239000000758 substrate Substances 0.000 claims abstract description 12
- 238000004364 calculation method Methods 0.000 claims description 8
- 230000001537 neural effect Effects 0.000 claims description 3
- 230000003592 biomimetic effect Effects 0.000 claims 3
- 239000000835 fiber Substances 0.000 claims 1
- 238000004519 manufacturing process Methods 0.000 abstract description 3
- 230000003595 spectral effect Effects 0.000 description 19
- 238000005516 engineering process Methods 0.000 description 10
- 238000001228 spectrum Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 4
- 239000000126 substance Substances 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000000701 chemical imaging Methods 0.000 description 2
- 239000003245 coal Substances 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 239000004575 stone Substances 0.000 description 2
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000002591 computed tomography Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000030808 detection of mechanical stimulus involved in sensory perception of sound Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013076 target substance Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/447—Polarisation spectrometry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
The invention relates to a bionic multispectral polarization single-pixel imaging device and method based on nerve overlapped compound eyes, wherein the device comprises: a substrate; a plurality of sub-eyes; the sub-eyes are uniformly distributed on the substrate, and each sub-eye consists of at least one optical fiber; the front end of each imaging channel consists of optical fibers in the same position in each sub-eye, and the rear end of each imaging channel consists of optical fibers in the same position in each sub-eye which are fixed together; at least one filter or polarizer located at the rear end of the imaging channel; and at least one single pixel detector located behind each filter or polarizer. The imaging device provided by the invention has the advantages of compact structure, small occupied space, low manufacturing cost, large imaging field angle, high imaging dynamic range and high target identification efficiency.
Description
Technical Field
The invention relates to the technical field of bionic compound eyes, single-pixel imaging and target identification, in particular to a bionic multispectral polarization single-pixel imaging device and method based on nerve overlapping compound eyes.
Background
The target substance identification has important significance and application value in the fields of military reconnaissance, deep space exploration, environmental monitoring, resource assessment, judicial appraisal, biomedicine and the like, and common methods comprise radar, sonar, infrared imaging, multispectral imaging, polarization imaging and the like. These methods have their own advantages and limitations.
For example, before a radar is used for target identification, electromagnetic waves must be emitted to a target, so that the radar is very susceptible to interference from various external factors, and passive target identification cannot be performed. Sonar is the detection of sound waves in water, which are affected by a variety of conditions in the sea. Although the infrared image technology is not easily interfered and can realize real-time monitoring all day long, the infrared stealth technology aiming at the infrared image technology is also rapidly developed, and further wider application of the infrared image technology is prevented. The core of the spectrum identification technology is that different substances have different spectra, but the method often has the situation that foreign matters are in the same spectrum. Polarization detection, while immune to external environmental changes and interference, lacks the ability to accurately detect objects of lower contrast.
In order to improve and enhance the target identification effect, many researchers have proposed a target identification technology combining a multispectral imaging technology and a polarization imaging technology, which is called a spectral polarization imaging technology. The technology can obtain two-dimensional space information, one-dimensional spectral information and polarization state information of a target, various existing spectral polarization imagers are mainly obtained by improving the conventional imaging spectrometer, and the essence of the existing spectral polarization imagers can be divided into two types, namely time-sharing imaging and partition imaging. Typical representatives of time-sharing imaging are spectral polarization imagers that rotate filters and polarizers for imaging, spectral imagers based on acousto-optic/liquid crystal tunable filters, and fourier spectral polarization imagers that obtain multiple types of information of a target at the expense of time resolution. The subarea imaging is to obtain all spectral information and polarization information in one exposure, including a computed tomography spectral polarization imager and a compression spectral polarization imager which are proposed in recent years, but the algorithm is more complex, the settlement time is long, and the spectral accuracy is also sacrificed.
All the spectral polarization imagers are improved on the basis of a traditional single-aperture camera, and have many limitations of the traditional camera, for example, the imaging field angle is small, and increasing the field angle introduces large image distortion and small dynamic range, and there are inoperable time periods in deep space detection, large picture data volume and high requirements on data transmission. And to date, there is a problem that either spectral polarization imager has low efficiency.
Disclosure of Invention
In order to solve the technical problem, the invention provides a bionic multispectral polarization single-pixel imaging device and method based on nerve overlapping compound eyes.
The technical solution of the invention is as follows: a bionic multispectral polarization single-pixel imaging device based on a nerve overlapped compound eye comprises:
a substrate;
a plurality of sub-eyes; the sub-eyes are uniformly distributed on the substrate, and each sub-eye is formed by fixing a plurality of optical fibers;
the front end of each imaging channel consists of optical fibers in the same positions in the sub-eyes, and the rear end of each imaging channel consists of optical fibers in the same positions in the sub-eyes which are fixed together;
at least one filter or polarizer located at the rear end of each set of imaging channels;
and at least one single pixel detector located behind each of the filters or polarizers.
Compared with the prior art, the invention has the following advantages:
the invention discloses a bionic multispectral polarization single-pixel imaging device based on nerve overlapped compound eyes, which is characterized in that a single-pixel light path is constructed to carry out single-pixel imaging on a target object, a compound eye system is used for matching with a filter plate and a polaroid to obtain multilayer space information of the object, the target can be identified by means of simple calculation, and the device has the advantages of compact structure, small occupied space, low manufacturing cost, large imaging visual angle, high imaging dynamic range and high target identification efficiency.
Drawings
Fig. 1 is a schematic structural diagram of a bionic multispectral polarization single-pixel imaging device based on a neuro-overlap compound eye in an embodiment of the present invention;
FIG. 2 is a schematic diagram of the position of optical fibers in a sub-eye in an embodiment of the present invention;
fig. 3 is a schematic light path diagram in a bionic multispectral polarization single-pixel imaging method based on a nerve overlapping compound eye in the embodiment of the present invention.
Detailed Description
The invention provides a bionic multispectral polarization single-pixel imaging device based on nerve overlapping compound eyes, which is compact in structure, small in occupied space, low in manufacturing cost, large in imaging field angle, high in imaging dynamic range and high in target identification efficiency.
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings.
Example one
As shown in fig. 1, a bionic multispectral polarization single-pixel imaging device based on a neural overlapping compound eye provided in an embodiment of the present invention includes:
a substrate 101; the shape of the substrate may be planar, curved, or otherwise. In the embodiment of the invention, the substrate adopts a hemispherical curved surface shape;
a plurality of sub-eyes 102; the sub-eyes are uniformly distributed on the substrate, and each sub-eye is formed by fixing at least one optical fiber; when the sub-eye is composed of a plurality of optical fibers, numbering is carried out on each optical fiber in each sub-eye, and as shown in fig. 2, the optical fibers in the same position of each sub-eye are required to be guaranteed to be consistent in number; the front end face and the rear end face of all the optical fibers need to be polished;
at least one group of imaging channels 103, the front end of each group of imaging channels is composed of optical fibers in the same position in each sub-eye, that is, the optical fiber No. 1 of each sub-eye is used as the front end of the first group of imaging channels, the optical fiber No. 2 of each sub-eye is used as the front end and the rear end of the second group of imaging channels, and so on; the rear end of each imaging channel is formed by fixing optical fibers at the same position in each sub-eye, namely the rear end of the No. 1 optical fiber in each sub-eye is fixed into a group, the rear end of the No. 2 optical fiber is fixed into a group, and the rest is done in the same way. When the sub-eyes comprise n optical fibers (n is more than or equal to 1), n groups of imaging channels can be obtained, the number of the optical fibers contained in each group of imaging channels is the total number of the sub-eyes, the front end of each group of imaging channels is uniformly distributed on the substrate along with each sub-eye, the rear end of each group of imaging channels is formed by fixing the optical fibers which are numbered in the same position in each sub-eye, and the front end face and the rear end face of each optical fiber in each group of imaging channels are required to be kept flat and consistent;
at least one filter or polarizer 104 located at the rear end of each set of imaging channels; a filter or a polaroid is arranged behind each group of imaging channels; when a plurality of groups of imaging channels exist, filters or polarizing plates can be placed at the rear ends of all the imaging channels according to requirements, or filters or polarizing plates with different proportions are placed; as shown in fig. 2, each sub-eye in the embodiment of the present invention includes 7 optical fibers, which form 7 imaging channels, and 3 polarizers and 4 filters are respectively disposed behind the imaging channels, which correspond to 3 polarization channels and 4 spectrum channels, respectively;
and at least one single pixel detector 105 behind each filter or polarizer for collecting the light intensity delivered by each constituent image channel.
The bionic multispectral polarization single-pixel imaging device based on the nerve overlapping compound eye provided by the invention has the advantages that the single-pixel imaging is carried out on a target object by building a single-pixel light path, and the multilayer space information of the target object is obtained by using the compound eye system in cooperation with the filter and the polaroid.
Example two
Based on the device provided in the first embodiment, the bionic multispectral polarization single-pixel imaging method based on the nerve overlapping compound eye is realized, and the light path diagram is shown in fig. 3: the device comprises a light source emitter 201, a spatial light modulator 202, an object to be detected 203, a bionic multispectral polarization single-pixel imaging device 204 based on nerve overlapped compound eyes, an imaging channel 103, a filter and polaroid array 104 and a single-pixel detector array 105;
the method comprises the following specific steps:
s1: acquiring a mask pattern required by single-pixel imaging, and uploading the mask pattern to a spatial light modulator;
s2: placing an object to be measured in a light-shading environment, and reflecting light emitted by a light source emitter to the object to be measured through modulation of a spatial light modulator; the sub-eye of the bionic multispectral polarization single-pixel imaging device based on the nerve overlapped compound eye collects total light intensity generated after the interaction between the mask pattern and an object to be detected and transmits the total light intensity through an imaging channel;
for a single pixel imaging optical path, a light source with a wide bandwidth is required, and the bandwidth of the selected light source needs to include the spectrum of the selected plurality of filters. According to the embodiment of the invention, coal and stones are selected to be put together to serve as an object to be measured, the object to be measured is placed in a light-shading environment, and light emitted by the light source emitter is modulated by the spatial light modulator and reflected to the object to be measured.
Let P i (x, y) is a mask pattern used for the ith measurement, wherein I is 1, 2, 3, …, M is the total number of measurements, and I (x, y) represents the spatial coordinates of the object to be measured. P i After the total light intensity generated after the action of (x, y) and I (x, y) is collected by sub-eyes of the bionic multispectral polarization single-pixel imaging device based on the nerve overlapped compound eye, as each sub-eye in the embodiment of the invention consists of 7 optical fibers as shown in figure 2, the total light intensity is divided into 7 parts which are respectively transmitted by each component image channel;
s3: modulating the total light intensity by using a filter or a polaroid or a combination of the filter and the polaroid, and then entering a single-pixel detector to obtain light intensity information;
the embodiment of the invention adopts an array combination of 4 filters and 3 polaroids to be placed at the rear end of an imaging channel, wherein the imaging spectral bands of the 4 filters are respectively 480(20nm), 650(12nm), 800(25nm) and 950(50nm), the angles of the 3 polaroids are respectively 0 degree, 60 degrees and 120 degrees, the light with the total light intensity modulated by the 4 filters and the 3 polaroids enters a single-pixel detector, and the single-pixel detector records the light intensity information, namely S i As shown in equation (1):
S i ＝∫∫P i (x,y)I(x,y)dxdy (1)
s4: calculating according to the light intensity information to obtain a multispectral image and a polarization image; respectively carrying out band operation and calculation of polarization degree and polarization angle on the multispectral image and the polarization image;
due to S i And P i (x, y) are known quantities at this time, 4 spectrums of different wave bands and 3 polarization images of different polarization states of the object to be measured can be obtained through calculation;
according to 4 pictures with the same content in different wave bands and 3 pictures with different polarization states; selecting the interested part of the picture and respectively carrying out wave band operation and calculation of polarization degree and polarization angle;
the calculation formula of the degree of polarization (DOLP) and the angle of polarization (AOLP) is as follows:
wherein, I (0 °), I (60 °), I (120 °) respectively represent the light intensities of the linearly polarized components of the light wave in the directions of 0 °, 60 ° and 120 °, and I, Q, U are the first 3 parameters of the stokes vector respectively;
s5: and comparing the calculation result with the data in the database to obtain the type of the object to be detected.
And comparing the obtained spectral data of the object to be detected, the polarization degree and the polarization angle of the spectral data with the data in the database to obtain the types of the object to be detected, namely coal and stone, so as to finish the target identification work.
The bionic multispectral polarization single-pixel imaging method based on the nerve overlapping compound eye can obtain a plurality of images of a plurality of different spectral bands and a plurality of different polarization angles of an object to be detected at one time, and the images contain two-dimensional space information of the object to be detected: the spectral information and the polarization information are simply processed to obtain the spatial multilayer information of the object to be measured, and the spatial multilayer information is compared with the spectrum and the polarization database of various substances measured in advance, so that the purpose of identifying the substance of the object to be measured is achieved.
The embodiment of the invention adopts single-pixel imaging as an imaging method, outputs one-dimensional light intensity information, has data volume far smaller than that of other spectral polarization imaging instruments, and is convenient for long-time work and data transmission of the instrument. In addition, due to the characteristic of single-pixel imaging, except different carried spectrums and polarization information, the obtained two-dimensional space information of the objects on the multiple pictures is completely the same, the subsequent work of picture registration is not needed, and the efficiency is higher.
The embodiment of the invention adopts an active single-pixel imaging method, and is theoretically also suitable for passive single-pixel imaging. When the passive single-pixel imaging method is used, because the experiment is not carried out in a dark place, another great advantage of single-pixel imaging can be brought into play, the dynamic range of the single-pixel imaging method is far larger than that of a common camera, and imaging can be carried out in a large dynamic range only by simply adjusting the gain of a single-pixel detector under different illumination conditions. In addition, the passive single-pixel imaging has outstanding excellent imaging performance under the condition of weak light.
The above examples are provided only for the purpose of describing the present invention, and are not intended to limit the scope of the present invention. The scope of the invention is defined by the appended claims. Various equivalent substitutions and modifications can be made without departing from the spirit and principles of the invention, and are intended to be included within the scope of the invention.
Claims (5)
1. A bionic multispectral polarization single-pixel imaging device based on nerve overlapped compound eyes is characterized by comprising:
a substrate;
a plurality of sub-eyes; the sub-eyes are uniformly distributed on the substrate, and each sub-eye is composed of at least one optical fiber;
the front end of each imaging channel consists of optical fibers in the same positions in the sub-eyes, and the rear end of each imaging channel consists of optical fibers in the same positions in the sub-eyes which are fixed together;
at least one filter or polarizer located at the rear end of each set of imaging channels;
and at least one single pixel detector located behind each of the filters or polarizers.
2. The neuro-superimposable compound eye-based biomimetic multi-spectral polarization single pixel imaging device according to claim 1, wherein said substrate is in a curved shape.
3. The neuro-overlay compound eye-based biomimetic multi-spectral polarization single-pixel imaging device according to claim 1, wherein each sub-eye comprises at least 1 fiber.
4. The biomimetic multispectral polarized single-pixel imaging device based on neuro-overlap compound eye according to claim 1, comprising at least 1 filter or 1 polarizer.
5. The bionic multispectral polarization single-pixel imaging method based on the neural overlapping compound eye is characterized in that the bionic multispectral polarization single-pixel imaging device based on the neural overlapping compound eye according to any one of claims 1 to 4 comprises the following steps:
s1: acquiring a mask pattern required by single-pixel imaging, and uploading the mask pattern to a spatial light modulator;
s2: placing an object to be measured in a light-shading environment, and reflecting light emitted by a light source emitter to the object to be measured through modulation of the spatial light modulator; the sub-eye of the bionic multispectral polarization single-pixel imaging device based on the nerve overlapped compound eye collects total light intensity generated after the mask pattern interacts with the object to be detected and transmits the total light intensity through an imaging channel;
s3: modulating the total light intensity by using a filter or a polaroid or a combination of the filter and the polaroid, and then entering a single-pixel detector to obtain light intensity information;
s4: calculating to obtain a multispectral image and a polarization image according to the light intensity information; respectively carrying out band operation and calculation of polarization degree and polarization angle on the multispectral image and the polarization image;
s5: and comparing the calculation result with data in a database to obtain the type of the object to be detected.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210615529.9A CN114993472A (en) | 2022-06-01 | 2022-06-01 | Bionic multispectral polarization single-pixel imaging device and method based on nerve overlapping compound eye |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210615529.9A CN114993472A (en) | 2022-06-01 | 2022-06-01 | Bionic multispectral polarization single-pixel imaging device and method based on nerve overlapping compound eye |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114993472A true CN114993472A (en) | 2022-09-02 |
Family
ID=83031008
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210615529.9A Pending CN114993472A (en) | 2022-06-01 | 2022-06-01 | Bionic multispectral polarization single-pixel imaging device and method based on nerve overlapping compound eye |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114993472A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116698189A (en) * | 2023-06-06 | 2023-09-05 | 北京理工大学长三角研究院(嘉兴) | Sensory calculation integrated bionic compound eye sensor and construction method |
-
2022
- 2022-06-01 CN CN202210615529.9A patent/CN114993472A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116698189A (en) * | 2023-06-06 | 2023-09-05 | 北京理工大学长三角研究院(嘉兴) | Sensory calculation integrated bionic compound eye sensor and construction method |
| CN116698189B (en) * | 2023-06-06 | 2024-03-29 | 北京理工大学长三角研究院(嘉兴) | Sensory calculation integrated bionic compound eye sensor and construction method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Cao et al. | A prism-mask system for multispectral video acquisition | |
| RU2535640C2 (en) | Forming multispectral images | |
| CN104792417B (en) | A kind of EO-1 hyperion compact and portable type imaging device of polarization completely | |
| Genser et al. | Camera array for multi-spectral imaging | |
| CN108780142A (en) | 3D imaging systems and method | |
| CN109764964A (en) | A kind of push-scanning type polarization light spectrum image-forming micro-system, imaging method and preparation method | |
| CN102297722B (en) | Double-channel differential polarizing interference imaging spectrometer | |
| US20230204418A1 (en) | High-speed and high-precision spectral video system and method for flame shooting | |
| CN104793343A (en) | Three-channel and single-Wollaston prism polarization imaging device and polarization information detecting method | |
| CN110595616A (en) | Hyperspectral imaging device and imaging method adopting linear gradient filter and slit | |
| US11125621B2 (en) | Method and system for polarimetry using static geometric polarization manipulation | |
| CN111537065A (en) | Bandwidth design method for spatial modulation full-polarization imaging system | |
| CN105227815A (en) | A kind of passive type list pixel is looked in the distance imaging system and formation method | |
| CN102879097A (en) | Circular polarization hyperspectral image detection system | |
| CN108088561A (en) | A kind of fast illuminated light field-optical spectrum imagers and imaging method | |
| DE102020210943A1 (en) | FINGERPRINT DETECTION UNDER THE DISPLAY BASED ON EXTERNAL ANGLE LIGHT | |
| CN114659634A (en) | Miniature snapshot type compressed spectrum imaging detection device and detection method | |
| CN114993472A (en) | Bionic multispectral polarization single-pixel imaging device and method based on nerve overlapping compound eye | |
| CN107356333B (en) | A kind of infrared spectrum polarized imaging system and its parameter optimization configuration method | |
| CN107144351B (en) | A kind of broadband full polarization imaging method based on Mach Zehnder interferometer | |
| US5949480A (en) | Broad band imaging spectroradiometer | |
| CN115014522A (en) | Integrated calculation spectral imaging method and device | |
| CN209639829U (en) | Push-sweep type polarization spectrum imaging micro-system | |
| JP3329898B2 (en) | Multi-channel Fourier transform spectrometer | |
| Garcia et al. | A 1300× 800, 700 mW, 30 fps spectral polarization imager |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |