CN112114310A - Microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition - Google Patents

Microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition Download PDF

Info

Publication number
CN112114310A
CN112114310A CN202010879257.4A CN202010879257A CN112114310A CN 112114310 A CN112114310 A CN 112114310A CN 202010879257 A CN202010879257 A CN 202010879257A CN 112114310 A CN112114310 A CN 112114310A
Authority
CN
China
Prior art keywords
dimension
millimeter wave
dimensional
microwave
antenna array
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010879257.4A
Other languages
Chinese (zh)
Other versions
CN112114310B (en
Inventor
孟祥新
柳桃荣
笪敏
刘泽鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Brainware Terahertz Information Technology Co ltd
Original Assignee
Brainware Terahertz Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Brainware Terahertz Information Technology Co ltd filed Critical Brainware Terahertz Information Technology Co ltd
Priority to CN202010879257.4A priority Critical patent/CN112114310B/en
Publication of CN112114310A publication Critical patent/CN112114310A/en
Application granted granted Critical
Publication of CN112114310B publication Critical patent/CN112114310B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/89Radar or analogous systems specially adapted for specific applications for mapping or imaging

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

The invention provides a microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition, which sequentially comprises the following steps: carrying out image focusing processing on the backscattering echo signal in a two-dimensional dimension, wherein the two-dimensional dimension is a two-dimensional dimension perpendicular to the arrangement direction of the microwave millimeter wave antenna elements; and carrying out secondary image focusing on the backscattered echo signals subjected to the image focusing, wherein the secondary image focusing is carried out on the dimension of the array direction of the microwave and millimeter wave antenna elements. The image reconstruction method of the invention carries out three-dimensional decomposition on the three-dimensional echo signal, and the three-dimensional echo signal is decomposed into a two-dimensional dimension and a one-dimensional dimension for image reconstruction respectively, thereby simplifying the computational complexity.

Description

Microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition
Technical Field
The invention relates to the field of microwave and millimeter wave holographic imaging, in particular to a microwave and millimeter wave holographic image reconstruction method based on three-dimensional decomposition.
Background
A microwave millimeter wave three-dimensional holographic imaging security inspection system is an important technical means for realizing active microwave millimeter wave human body security inspection. The imaging security inspection system can comprise a planar mechanical scanning type imaging system, a cylindrical surface mechanical scanning type imaging system or a two-dimensional sparse array electronic scanning type imaging system. The microwave millimeter wave frequency electromagnetic wave can penetrate through clothes, so that three-dimensional holographic images obtained through microwave millimeter wave three-dimensional holographic imaging can represent body surface information of a human body more abundantly, and the microwave millimeter wave three-dimensional holographic imaging security inspection system can effectively detect dangerous goods hidden under the clothes of the human body through the three-dimensional holographic images, so that the microwave millimeter wave three-dimensional holographic imaging security inspection system is an effective new means for human body security inspection and is widely applied to the field of human body security inspection.
At present, a microwave millimeter wave three-dimensional holographic image reconstruction method mainly comprises a time domain type image reconstruction algorithm and a frequency domain type image reconstruction algorithm.
Time-domain class image reconstruction algorithms are known to include time-domain correlation algorithms and backprojection reconstruction algorithms. The time domain algorithm does not need any approximation in the derivation process, the implementation process of the algorithm is simple and easy to understand, and the implementation technology threshold is low, but the time domain algorithm directly processes the three-dimensional echo data to enable the three dimensions to be cross-coupled together, so that the calculation of one pixel point in an image needs to be traversed for all echo data at one time, the calculation amount is large, and the traversal processing needs to access the storage space of the three-dimensional echo data when a hardware platform is implemented, so that the real-time performance of image reconstruction calculation is delayed, meanwhile, high requirements are provided for resources of the hardware platform, and the method is difficult to be applied to an imaging system with high real-time requirements.
In mainstream frequency domain algorithms, a wavenumber domain algorithm is mainly known, but due to different data acquisition modes of a planar mechanical scanning type imaging system and a cylindrical surface mechanical scanning type imaging system, the derivation processes of the corresponding wavenumber domain algorithms have great difference, source codes need to be developed and a hardware platform needs to be implemented respectively, and thus, higher requirements on labor, time and cost are provided. Therefore, it is necessary to develop an image reconstruction method suitable for the two imaging systems to greatly reduce the labor, time and cost in the system engineering implementation process.
Disclosure of Invention
Aiming at the problems, the invention provides a microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition.
The invention relates to a microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition, which is used for processing a backscattering echo signal obtained by scanning a target by transmitting a microwave millimeter wave beam by a microwave millimeter wave antenna array element, wherein the target is positioned in an imaging target area, and the microwave millimeter wave antenna array element is an antenna array element of a one-dimensional antenna array in a mechanical scanning type imaging system, and is characterized by comprising the following steps of:
A. discretizing the imaging target area and the mechanical scanning position of the one-dimensional antenna array in a two-dimensional dimension, wherein the two-dimensional dimension is a two-dimensional dimension perpendicular to the arrangement direction of the microwave millimeter wave antenna array elements;
B. performing image focusing processing on the two-dimensional dimension on the backscatter echo signal;
C. performing interpolation processing on the backscatter echo signals processed in the step B, wherein the interpolation processing is performed on a distance dimension in the two-dimensional dimension;
D. performing second discretization processing on the imaging target area, wherein the second discretization processing is performed on the dimension of the arrangement direction of the microwave millimeter wave antenna elements;
E. and carrying out secondary image focusing on the backscattered echo signals subjected to the image focusing, wherein the secondary image focusing is carried out on the dimension of the array direction of the microwave and millimeter wave antenna elements.
Further, in the present invention,
the microwave millimeter wave holographic image reconstruction method further comprises the following steps: a three-dimensional rectangular coordinate system is established,
wherein,
taking the arrangement direction of the microwave millimeter wave antenna array elements as the Y-axis direction of the three-dimensional space rectangular coordinate system;
when the mechanical scanning type imaging system is a one-dimensional antenna array plane mechanical scanning type imaging system, the scanning moving direction of the microwave millimeter wave antenna array elements is taken as the X-axis direction of the three-dimensional space rectangular coordinate system, and the Z-axis direction of the three-dimensional space rectangular coordinate system is established according to the relation of the directions of three coordinate axes of the three-dimensional space rectangular coordinate system;
when the mechanical scanning type imaging system is a one-dimensional antenna array cylindrical surface mechanical scanning type imaging system, the Y-axis direction and the Z-axis direction of a three-dimensional space rectangular coordinate system are determined according to the relation of the directions of three coordinate axes of the three-dimensional space rectangular coordinate system;
and the dimension corresponding to the Z axis is the distance dimension.
Further, in the present invention,
and recording Y-axis coordinates of the microwave millimeter wave antenna array elements'k,k∈[1,Nant],NantThe number of the microwave millimeter wave antenna elements in the one-dimensional antenna array is an integer which is more than 1,
Figure BDA0002653607290000031
Lais the length of the one-dimensional antenna array;
traverse the coordinate y'kAt each coordinate y'kAnd C, executing the step B and the step C.
Further, in the present invention,
in the step a, the two-dimensional dimensions are (x, z) dimensions, that is, x dimension and z dimension, and the coordinates of the divided imaging target region at the discrete grid points in the two-dimensional dimensions are (x, z)i,zj) Wherein i ∈ [0, N ∈ ]x],j∈[0,Nz],NxA number of meshes, N, of discrete meshes divided along the x-dimension for the imaging target regionzOf discrete grids divided along the z-dimension for the imaging target regionNumber of meshes, NxAnd NzAre all integers greater than 1;
the grid obtained by discretization satisfies the following conditions: grid size divided along the x dimension
Figure BDA0002653607290000032
Number of said grids
Figure BDA0002653607290000041
Grid size divided along the z dimension
Figure BDA0002653607290000042
Number of said grids
Figure BDA0002653607290000043
Figure BDA0002653607290000044
Meaning that the rounding is done down,
wherein λ is0Is the central wavelength, theta, of the radio frequency signal of the mechanically scanned imaging systemxAntenna beam width, L, of x dimensionxThe spatial range covered by the scanning in the dimension x, B is the bandwidth of the microwave millimeter wave signal of the mechanical scanning type imaging system, c is the speed of light in vacuum, and L iszA range covered in the z dimension for the imaging target area;
obtaining discretized mechanical scanning positions of the divided one-dimensional antenna array
Figure BDA0002653607290000045
Wherein,
Figure BDA0002653607290000046
Figure BDA0002653607290000047
a grid number of discrete grids divided along an x-dimension for the discretized mechanical scan location,
Figure BDA0002653607290000048
a grid number divided into discrete grids divided along the z-dimension by the discretized mechanical scan location,
Figure BDA0002653607290000049
and
Figure BDA00026536072900000410
are all integers greater than 1;
the discretized mechanical scan location satisfies: when the one-dimensional antenna array plane mechanical scanning type imaging system is adopted,
Figure BDA00026536072900000411
Lsthe grid size divided by the x dimension of the mechanical scanning position is the scanning distance of the microwave millimeter wave antenna array element
Figure BDA00026536072900000412
Figure BDA00026536072900000413
Taking a certain value; when the one-dimensional antenna array cylindrical surface mechanical scanning type imaging system is adopted,
Figure BDA00026536072900000414
and satisfy
Figure BDA00026536072900000415
R is the radius of the cylindrical surface scanning track of the microwave millimeter wave antenna array element,
Figure BDA00026536072900000416
the scanned angle of the microwave millimeter wave antenna array element,
Figure BDA00026536072900000417
discrete interval of
Figure BDA00026536072900000418
rsFor scanning the radius of the object, k is the microwave and millimeter wave frequency wave number, kzThe number of spatial waves in the arrangement direction of the microwave millimeter wave antenna elements is shown.
Further, LaIs 0.5 to 3 m, LxIs 0.3-2 m, LzIs 0.1 to 1.5 m, LsIs 0.1 to 2 m in length,
Figure BDA00026536072900000419
further, LaIs 2 m, LxIs 1 m, LzIs 0.2-0.8 m, Ls2 m, R0.6 m,
Figure BDA0002653607290000051
is composed of
Figure BDA0002653607290000052
Further, in the present invention,
the backscatter echo signal is S (x, y, z, f), where f is the microwave millimeter wave frequency dimension, then in step B, at each discrete grid point coordinate (x, z) in the (x, z) dimensioni,zj) The following steps are carried out:
calculating the discrete grid point coordinates (x)i,zj) Discretized mechanical scanning position to the microwave and millimeter wave antenna elements
Figure BDA0002653607290000053
Angular distance of
Figure BDA0002653607290000054
Then obtaining the matched filtering signal in the z dimension
Figure BDA0002653607290000055
Matching the filtered signal
Figure BDA0002653607290000056
And the mechanical scanning position
Figure BDA0002653607290000057
To echo signals
Figure BDA0002653607290000058
Is/are as follows
Figure BDA0002653607290000059
Carrying out matched filtering processing after dimensionality multiplication to obtain a signal
Figure BDA00026536072900000510
Will be at all of said mechanical scanning positions
Figure BDA00026536072900000511
The signal of
Figure BDA00026536072900000512
All are calculated and accumulated to obtain a signal SD(xi,y'k,zj)。
Further, in the present invention,
in the step C, the interpolation processing employs any one of linear interpolation, SINC interpolation, spline interpolation, or cubic interpolation methods;
obtaining an up-sampled signal S by the interpolation processingF(xi,y'k,zp1),
Wherein p1 is an integer, p1 epsilon [0, N'z]And N'z>NzAnd N'z=N0·NzAnd the pixel interval of the up-sampling signal in the z dimension is set to be Δ z
Figure BDA00026536072900000513
And z in the z dimensionp1Coverage and zjThe coverage is consistent.
Further, in the present invention,
in the step D, the coordinates of the discrete grid points in the y-dimension are y after the second discretization processq,q∈[0,Ny],NyFor dividing along the y-dimensionThe number of meshes of the discrete mesh is an integer greater than 1.
Further, in the present invention,
in said step E, said second image focusing comprises at each discrete grid point coordinate (x)i,yq,zj) The following steps are carried out:
calculating the discrete grid point coordinates (x)i,yq,zj) To all sampling positions of the microwave millimeter wave antenna array element
Figure BDA0002653607290000061
I.e. the slope in the y and z dimensions
Figure BDA0002653607290000062
And acquiring a distance matching point signal S at the sampling position in the z dimensionG(xi,y'k,zL)=SF(xi,y'k,zL) Wherein
Figure BDA0002653607290000063
taor=c/(2·B)/N0
calculating all sampling positions y 'of y dimension of microwave millimeter wave antenna array element'kMatched filtered signal
Figure BDA0002653607290000064
Wherein f is0The central frequency of the microwave millimeter wave radio frequency signal in the imaging target area is obtained;
all sampling positions y 'of y dimension of microwave millimeter wave antenna array element'kMatched filtered signal
Figure BDA0002653607290000065
Are all equal to the sampling position y'kThe distance matching point signal S ofG(xi,y'k,zL) Y'kAll sampling positions y 'of the y dimension of the microwave millimeter wave antenna array element are obtained through corresponding multiplication of the dimensions'kSignal of
Figure BDA0002653607290000066
All sampling positions y 'of y dimension of microwave millimeter wave antenna array element'kSignal of
Figure BDA0002653607290000067
Performing complex number accumulation calculation to obtain signal S (x)i,yq,zj)。
The microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition integrates the characteristics of a time domain reconstruction algorithm, respectively processes three dimensions of echo data, is more suitable for high-speed parallel realization of hardware signal processing platforms such as an FPGA (field programmable gate array), a DSP (digital signal processor), a GPU (graphic processing unit) and the like, is not limited by any scanning mode of scanning dimensions, is suitable for both a planar mechanical scanning type imaging system and a cylindrical mechanical scanning type imaging system, and is a universal three-dimensional image reconstruction method.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 shows a diagram of an operation (scanning) mode of a microwave millimeter wave holographic reconstruction system 1 (one-dimensional antenna array planar mechanical scanning type imaging system) according to an embodiment of the present invention;
fig. 2 is a diagram showing an operation (scanning) mode of a microwave millimeter wave holographic reconstruction system 2 (one-dimensional antenna array cylindrical surface mechanical scanning type imaging system) according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a scanning mode diagram of a one-dimensional antenna array planar mechanical scanning imaging system, and fig. 2 is a scanning mode diagram of a one-dimensional antenna array cylindrical surface mechanical scanning imaging system. In fig. 1 and 2, 1 is a microwave millimeter wave antenna array element in the one-dimensional antenna array, 2 is a horizontal scanning direction of the one-dimensional antenna array, 3 is an imaging target area, and a plurality of microwave millimeter wave antenna array elements 1 are arranged along the same direction to form the one-dimensional antenna array. As can be seen from fig. 1, if the center of the imaging target region 3 is taken as the origin of coordinates, the arrangement direction of the microwave millimeter wave antenna array elements 1 of the one-dimensional antenna array plane mechanical scanning type imaging system is the Y-axis direction, the plane scanning moving direction of the microwave millimeter wave antenna array elements 1 is the X-axis direction, and a three-dimensional rectangular spatial coordinate system can be established, where the imaging target region 3 is located on one side of the plane track through which the microwave millimeter wave antenna array elements 1 scan. As can be seen from fig. 2, if the center of the imaging target region 3 is taken as the origin of coordinates, a three-dimensional space rectangular coordinate system can be established with the arrangement direction of the microwave millimeter wave antenna array elements 1 of the one-dimensional antenna array cylindrical surface mechanical scanning type imaging system as the Y-axis direction, wherein the imaging target region 3 is located in the cylindrical surface track through which the microwave millimeter wave antenna array elements 1 scan.
In the two scanning type imaging systems, the beam of the transmitting antenna and the beam of the receiving antenna of the imaging system realize vertical (i.e. Y-axis direction) moving scanning by switching the radio frequency switch of the microwave millimeter wave antenna array element 1; the one-dimensional antenna array is driven by a high-precision mechanical scanning control device to realize horizontal scanning (scanning along the X-axis direction in figure 1 and scanning along the cylindrical surface in figure 2), and finally, the discrete distribution of antenna beams (including the beams of a transmitting antenna and a receiving antenna) on an (X, z) two-dimensional space plane is obtained.
The microwave millimeter wave holographic image reconstruction method comprises the following steps of:
first, a backscatter echo signal S (x, y, z, f) (referred to as echo signal) of the target is acquired.
By performing the scanning, the microwave millimeter wave transceiving front ends in the two scanning type imaging systems can detect and obtain three-dimensional echo signals S (x, y, z, f) of the imaging target region 3, wherein the y dimension is a microwave millimeter wave antenna array element switch scanning dimension, the f is a microwave millimeter wave frequency dimension, the echo signals S (x, y, z, f) are complex signals and contain amplitude and phase information, and the signal system of the transceiving front ends is a frequency modulation continuous wave signal or a frequency stepping continuous wave signal. For a one-dimensional antenna array plane mechanical scanning type imaging system, if the microwave millimeter wave antenna array element 1 scans along the X axis, the scanning coordinate on the (X, z) two-dimensional space or the (X, z) dimension (namely the X dimension and the z dimension) is (X, z)10) Wherein z is10The coordinate of the Z axis of the microwave millimeter wave antenna array element 1 is a fixed value; for a one-dimensional antenna array cylindrical surface mechanical scanning type imaging system, setting the Y axis as the central axis of the cylindrical surface, and then scanning coordinates of the two-dimensional space
Figure BDA0002653607290000081
Wherein R is the radius of the cylindrical surface scanning track,
Figure BDA0002653607290000082
is the angle mechanically scanned by the one-dimensional antenna array.
It is to be noted that Y 'is the Y-axis coordinate of the microwave millimeter wave antenna array element 1'k,k∈[1,Nant],NantIs the number of the antenna elements 1 in the one-dimensional antenna array and is an integer greater than 1
Figure BDA0002653607290000091
LaIs the length, L, of the one-dimensional antenna arrayaIt may be desirable to be from 0.5 to 3 meters, preferably 2 meters.
Secondly, traversing the coordinate y 'of the microwave millimeter wave antenna array element 1'kAt each coordinate y'kThen, the following steps 2a and 2b are performed:
2a discretizing the imaged target area 3 and the mechanical scanning position of the one-dimensional antenna array in (x, z) dimensions, i.e. x and z dimensions.
Through the discretization, the coordinates of the discrete grid points of the divided imaging target area 3 are obtained as (x)i,zj) I is an integer and i belongs to [0, N ]x]J is an integer and j is an element [0, N ]z],NxNumber of discrete grids divided along x-dimension for imaging target area 3, NzThe number of meshes, N, of the discrete grid divided along the z-dimension (also referred to as the distance dimension) for the imaging target region 3xAnd NzAre all integers greater than 1. The mesh subjected to the discretization satisfies: mesh size for x dimension partitioning
Figure BDA0002653607290000092
Number of grids
Figure BDA0002653607290000093
Figure BDA0002653607290000094
Represents rounding down; grid size for z-dimension partitioning
Figure BDA0002653607290000095
Number of grids
Figure BDA0002653607290000096
Wherein λ is0For the center wavelength of the radio frequency signals of the two scanning type imaging systems,θxantenna beam width, L, of x dimensionxThe spatial range covered by the scanning of the imaging target region 3 in the x dimension, B ═ fmax-fminFor the bandwidth (f) of the microwave millimeter wave signal in the imaging target region 3maxAnd fminRespectively the highest frequency and the lowest frequency of the microwave millimeter wave signal), c is the speed of light in vacuum, LzIs the extent covered in the z-dimension by the imaging target area 3. L isxGenerally set to be 0.3-2 m, preferably 1 m, which is the transverse coverage of human body, LzGenerally 0.1-1.5 m, preferably 0.2-0.8 m, which is the span of the human body in the z dimension. The smaller the values of the grid sizes delta x and delta z are, the finer the divided grid is, and the higher the fineness of the image reconstruction result is.
Obtaining the discretized mechanical scanning position (hereinafter referred to as mechanical scanning position) of the divided one-dimensional antenna array by the discretization
Figure BDA0002653607290000101
When a one-dimensional antenna array planar mechanical scanning type imaging system is adopted,
Figure BDA0002653607290000102
l is an integer and
Figure BDA0002653607290000103
Lsl is the scanning distance of the microwave millimeter wave antenna array element 1 according to specific application scenessCan be 0.1-2 m, preferably 2 m,
Figure BDA0002653607290000104
the number of grids of the discrete grid divided along the x-dimension for the mechanical scan position,
Figure BDA0002653607290000105
Figure BDA0002653607290000106
can be-2 to-0.1 meter, preferably-0.4 meter; when a one-dimensional antenna array cylindrical surface mechanical scanning type imaging system is adopted,
Figure BDA0002653607290000107
and
Figure BDA0002653607290000108
m is an integer of
Figure BDA0002653607290000109
Figure BDA00026536072900001010
And
Figure BDA00026536072900001011
a grid number divided into discrete grids of mechanical scan positions divided along the x-dimension and z-dimension,
Figure BDA00026536072900001012
r is preferably 0.6 m and has
Figure BDA00026536072900001013
Figure BDA00026536072900001014
Preferably, it is
Figure BDA00026536072900001015
The discretization condition of the mechanical scanning position is different from the discretization condition A in that when the one-dimensional antenna array plane mechanical scanning type imaging system is adopted, the number of grids is increased
Figure BDA00026536072900001016
In this embodiment, the size Δ x of the grid divided in the x dimension of the imaging target region 3 and the size Δ x of the grid divided in the x dimension of the mechanical scanning position
Figure BDA00026536072900001017
The values can be the same or different according to different working conditions in specific application; when one-dimensional antenna array cylindrical surface mechanical scanning type imaging system is adopted, the number of grids
Figure BDA00026536072900001018
Figure BDA00026536072900001019
Discrete interval of
Figure BDA00026536072900001020
rsIs the radius of the scanned object (i.e., the radius of the smallest cylinder that can contain the scanned object), k is the microwave millimeter wave frequency wavenumber (i.e., the wavenumber of the microwave millimeter wave in the microwave millimeter wave frequency dimension), k iszThe number of spatial waves in the arrangement direction of the microwave millimeter wave antenna elements.
2b, carrying out (x, z) dimensional image focusing processing on the backscatter echo signal S (x, y, z, f) at each discrete grid point coordinate (x, y, z, f)i,zj) The following steps 2ba to 2bc are performed:
2ba, in the (x, z) dimension, the coordinates (x) of the discrete grid points are first calculatedi,zj) Mechanical scanning position to microwave millimeter wave antenna element 1 in one-dimensional antenna array
Figure BDA0002653607290000111
Angular distance of
Figure BDA0002653607290000112
Then obtaining matched filtering signal in z dimension
Figure BDA0002653607290000113
Wherein the mechanical scanning position of the one-dimensional antenna array of the planar mechanical scanning type imaging system
Figure BDA0002653607290000114
The mechanical scanning position of the one-dimensional antenna array of the cylindrical surface mechanical scanning type imaging system
Figure BDA0002653607290000115
Figure BDA0002653607290000116
Angle mechanically scanned for one-dimensional antenna array
Figure BDA0002653607290000117
Discretized coordinates of (a);
2bb, filtering the matched filter signal
Figure BDA0002653607290000118
And the mechanical scanning position
Figure BDA0002653607290000119
To echo signals
Figure BDA00026536072900001110
Is/are as follows
Figure BDA00026536072900001111
Carrying out matched filtering processing after dimensionality multiplication to obtain a signal
Figure BDA00026536072900001112
2bc, will be at all said mechanical scanning positions
Figure BDA00026536072900001113
The signal of
Figure BDA00026536072900001114
All are calculated and accumulated to obtain a signal SD(xi,y'k,zj)。
Obtaining all the microwave millimeter wave antenna array elements 1 at the position y 'through the step two'kSignal S ofD(xi,y'k,zj) So far the image in (x, z) dimension is fully focused.
Three, two signals SD(xi,y'k,zj) Z of (a)jAnd carrying out interpolation processing on the dimension.
Obtaining an up-sampled signal S by the interpolation processingF(xi,y'k,zp1) Wherein p1 is an integer, p1 ∈ [0, N'z]And N'z>NzAnd N'z=N0·Nz. Since the grid size divided in the z dimension is Δ z, and the pixel interval of the up-sampled signal in the z dimension is Δ z', then
Figure BDA00026536072900001115
And z in the z dimensionp1Coverage and zjThe coverage range is consistent; the interpolation processing may adopt interpolation methods such as linear interpolation, SINC interpolation, spline interpolation, cubic interpolation and the like.
And fourthly, discretizing the y dimension in the imaging scene.
Through the discretization processing, the coordinates of the discrete grid points in the y dimension are yq,q∈[0,Ny],NyThe number of meshes of the discrete mesh divided along the y-dimension and is an integer greater than 1. Setting yqThe position coordinate range of the antenna array element 1 in the one-dimensional antenna array is consistent, and the coordinate of the discrete grid point of the z dimension is still zj
Fifthly, final image focusing processing
At each discrete grid point coordinate (x)i,yq,zj) The following steps 5a to 5d are performed:
5a, calculating discrete grid point coordinates (y) in the (y, z) dimensions, i.e. the y and z dimensionsq,zj) To all sampling positions of said antenna element 1 in the one-dimensional antenna array (i.e. the coordinate position of the antenna element 1 during scanning)
Figure BDA0002653607290000121
Is inclined distance
Figure BDA0002653607290000122
And acquiring a distance matching point signal S at the sampling position in the z dimensionG(xi,y'k,zL)=SF(xi,y'k,zL) The selection criterion of the location of the distance dimension is
Figure BDA0002653607290000123
taor=c/(2·B)/N0B is the bandwidth of the microwave millimeter wave signal;
5b, calculating all y-dimension sampling positions y 'of the microwave millimeter wave antenna array element 1'kMatched filtered signal
Figure BDA0002653607290000124
Wherein f is0The central frequency of the microwave millimeter wave radio frequency signal in the imaging target area 3;
5c, sampling all y-dimensional sampling positions y 'of the microwave millimeter wave antenna array element 1'kMatched filtered signal
Figure BDA0002653607290000125
Are all equal to the sampling position y'kDistance matching point signal SG(xi,y'k,zL1) The y dimension of the microwave millimeter wave antenna array element 1 is obtained by corresponding multiplicationqAll sample positions in dimension y'kSignal of
Figure BDA0002653607290000126
5d, sampling all y-dimensional sampling positions y 'of the microwave millimeter wave antenna array element 1'kSignal of
Figure BDA0002653607290000127
Are calculated and subjected to complex accumulation to obtain a signal S (x)i,yq,zj)。
Obtaining all discrete grid point coordinates (x) through step fivei,yq,zj) Signal S (x) ofi,yq,zj) Completing the focusing of the image in the y dimension to obtain the final three-dimensional complex image O (x)i,yq,zj)。
Finally, the three-dimensional complex image O (x) obtained is obtainedi,yq,zj) Transmitted to a display terminal for display, target detection,Object classification and recognition, etc.
The method is particularly suitable for high-speed parallel processing of a hardware platform, and is a universal image reconstruction method because the time domain type algorithm is adopted, the mechanical scanning mode of a microwave millimeter wave imaging system is not limited, and the method achieves the purpose that the image reconstruction method is suitable for two one-dimensional antenna array mechanical scanning imaging modes.
Although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition is used for processing a backscattering echo signal obtained by scanning a target by transmitting a microwave millimeter wave beam by a microwave millimeter wave antenna array element, wherein the target is positioned in an imaging target area, and the microwave millimeter wave antenna array element is an antenna array element of a one-dimensional antenna array in a mechanical scanning type imaging system, and is characterized by comprising the following steps of:
A. discretizing the imaging target area and the mechanical scanning position of the one-dimensional antenna array in a two-dimensional dimension, wherein the two-dimensional dimension is a two-dimensional dimension perpendicular to the arrangement direction of the microwave millimeter wave antenna array elements;
B. performing image focusing processing on the two-dimensional dimension on the backscatter echo signal;
C. performing interpolation processing on the backscatter echo signals processed in the step B, wherein the interpolation processing is performed on a distance dimension in the two-dimensional dimension;
D. performing second discretization processing on the imaging target area, wherein the second discretization processing is performed on the dimension of the arrangement direction of the microwave millimeter wave antenna elements;
E. and carrying out secondary image focusing on the backscattered echo signals subjected to the image focusing, wherein the secondary image focusing is carried out on the dimension of the array direction of the microwave and millimeter wave antenna elements.
2. The three-dimensional decomposition-based microwave and millimeter wave holographic image reconstruction method according to claim 1,
the microwave millimeter wave holographic image reconstruction method further comprises the following steps: a three-dimensional rectangular coordinate system is established,
wherein,
taking the arrangement direction of the microwave millimeter wave antenna array elements as the Y-axis direction of the three-dimensional space rectangular coordinate system;
when the mechanical scanning type imaging system is a one-dimensional antenna array plane mechanical scanning type imaging system, the scanning moving direction of the microwave millimeter wave antenna array elements is taken as the X-axis direction of the three-dimensional space rectangular coordinate system, and the Z-axis direction of the three-dimensional space rectangular coordinate system is established according to the relation of the directions of three coordinate axes of the three-dimensional space rectangular coordinate system;
when the mechanical scanning type imaging system is a one-dimensional antenna array cylindrical surface mechanical scanning type imaging system, the Y-axis direction and the Z-axis direction of a three-dimensional space rectangular coordinate system are determined according to the relation of the directions of three coordinate axes of the three-dimensional space rectangular coordinate system;
and the dimension corresponding to the Z axis is the distance dimension.
3. The three-dimensional decomposition-based microwave and millimeter wave holographic image reconstruction method according to claim 2,
recording the microwave and millimeter waveY 'is the Y-axis coordinate of the antenna array element'k,k∈[1,Nant],NantThe number of the microwave millimeter wave antenna elements in the one-dimensional antenna array is an integer which is more than 1,
Figure FDA0002653607280000026
Lais the length of the one-dimensional antenna array;
traverse the coordinate y'kAt each coordinate y'kAnd C, executing the step B and the step C.
4. The three-dimensional decomposition-based microwave and millimeter wave holographic image reconstruction method according to claim 3,
in the step a, the two-dimensional dimensions are (x, z) dimensions, that is, x dimension and z dimension, and the coordinates of the divided imaging target region at the discrete grid points in the two-dimensional dimensions are (x, z)i,zj) Wherein i ∈ [0, N ∈ ]x],j∈[0,Nz],NxA number of meshes, N, of discrete meshes divided along the x-dimension for the imaging target regionzA number of meshes, N, of discrete meshes divided along the z-dimension for the imaging target regionxAnd NzAre all integers greater than 1;
the grid obtained by discretization satisfies the following conditions: grid size divided along the x dimension
Figure FDA0002653607280000021
Number of said grids
Figure FDA0002653607280000022
Grid size divided along the z dimension
Figure FDA0002653607280000023
Number of said grids
Figure FDA0002653607280000024
Figure FDA0002653607280000025
Meaning that the rounding is done down,
wherein λ is0Is the central wavelength, theta, of the radio frequency signal of the mechanically scanned imaging systemxAntenna beam width, L, of x dimensionxThe spatial range covered by the scanning in the dimension x, B is the bandwidth of the microwave millimeter wave signal of the mechanical scanning type imaging system, c is the speed of light in vacuum, and L iszA range covered in the z dimension for the imaging target area;
obtaining discretized mechanical scanning positions of the divided one-dimensional antenna array
Figure FDA0002653607280000031
Wherein,
Figure FDA0002653607280000032
Figure FDA0002653607280000033
a grid number of discrete grids divided along an x-dimension for the discretized mechanical scan location,
Figure FDA0002653607280000034
a grid number divided into discrete grids divided along the z-dimension by the discretized mechanical scan location,
Figure FDA0002653607280000035
and
Figure FDA0002653607280000036
are all integers greater than 1;
the discretized mechanical scan location satisfies: when the one-dimensional antenna array plane mechanical scanning type imaging system is adopted,
Figure FDA0002653607280000037
Lsis the microwave and millimeter wave antennaThe scanning distance of the linear array element and the grid size divided by the x dimension of the mechanical scanning position
Figure FDA0002653607280000038
Figure FDA0002653607280000039
Taking a certain value; when the one-dimensional antenna array cylindrical surface mechanical scanning type imaging system is adopted,
Figure FDA00026536072800000310
and satisfy
Figure FDA00026536072800000311
R is the radius of the cylindrical surface scanning track of the microwave millimeter wave antenna array element,
Figure FDA00026536072800000312
the scanned angle of the microwave millimeter wave antenna array element,
Figure FDA00026536072800000313
discrete interval of
Figure FDA00026536072800000314
rsFor scanning the radius of the object, k is the microwave and millimeter wave frequency wave number, kzThe number of spatial waves in the arrangement direction of the microwave millimeter wave antenna elements is shown.
5. The three-dimensional decomposition-based microwave and millimeter wave holographic image reconstruction method according to claim 4, wherein L isaIs 0.5 to 3 m, LxIs 0.3-2 m, LzIs 0.1 to 1.5 m, LsIs 0.1 to 2 m in length,
Figure FDA00026536072800000315
6. the microwave and millimeter wave holographic image reconstruction method based on three-dimensional decomposition as claimed in claim 5, wherein L isaIs 2 m, LxIs 1 m, LzIs 0.2-0.8 m, Ls2 m, R0.6 m,
Figure FDA00026536072800000316
is composed of
Figure FDA00026536072800000317
7. The three-dimensional decomposition-based microwave and millimeter wave holographic image reconstruction method according to any one of claims 4 to 6,
the backscatter echo signal is S (x, y, z, f), where f is the microwave millimeter wave frequency dimension, then in step B, at each discrete grid point coordinate (x, z) in the (x, z) dimensioni,zj) The following steps are carried out:
calculating the discrete grid point coordinates (x)i,zj) Discretized mechanical scanning position to the microwave and millimeter wave antenna elements
Figure FDA0002653607280000041
Angular distance of
Figure FDA0002653607280000042
Then obtaining the matched filtering signal in the z dimension
Figure FDA0002653607280000043
Matching the filtered signal
Figure FDA0002653607280000044
And the mechanical scanning position
Figure FDA0002653607280000045
Echo signal processingNumber (C)
Figure FDA0002653607280000046
Is/are as follows
Figure FDA0002653607280000047
Carrying out matched filtering processing after dimensionality multiplication to obtain a signal
Figure FDA0002653607280000048
Will be at all of said mechanical scanning positions
Figure FDA0002653607280000049
The signal of
Figure FDA00026536072800000410
All are calculated and accumulated to obtain a signal SD(xi,y'k,zj)。
8. The three-dimensional decomposition-based microwave and millimeter wave holographic image reconstruction method according to claim 7,
in the step C, the interpolation processing employs any one of linear interpolation, SINC interpolation, spline interpolation, or cubic interpolation methods;
obtaining an up-sampled signal S by the interpolation processingF(xi,y'k,zp1),
Wherein p1 is an integer, p1 epsilon [0, N'z]And N'z>NzAnd N'z=N0·NzAnd the pixel interval of the up-sampling signal in the z dimension is set to be Δ z
Figure FDA00026536072800000411
And z in the z dimensionp1Coverage and zjThe coverage is consistent.
9. The three-dimensional decomposition-based microwave and millimeter wave holographic image reconstruction method according to claim 8,
in the step D, the coordinates of the discrete grid points in the y-dimension are y after the second discretization processq,q∈[0,Ny],NyA number of meshes of a discrete mesh divided along the y-dimension and is an integer greater than 1.
10. The three-dimensional decomposition-based microwave and millimeter wave holographic image reconstruction method according to claim 9,
in said step E, said second image focusing comprises at each discrete grid point coordinate (x)i,yq,zj) The following steps are carried out:
calculating the discrete grid point coordinates (x)i,yq,zj) To all sampling positions of the microwave millimeter wave antenna array element
Figure FDA0002653607280000051
I.e. the slope in the y and z dimensions
Figure FDA0002653607280000052
And acquiring a distance matching point signal S at the sampling position in the z dimensionG(xi,y'k,zL)=SF(xi,y'k,zL) Wherein
Figure FDA0002653607280000053
taor=c/(2·B)/N0
calculating all sampling positions y 'of y dimension of microwave millimeter wave antenna array element'kMatched filtered signal
Figure FDA0002653607280000054
Wherein f is0The central frequency of the microwave millimeter wave radio frequency signal in the imaging target area is obtained;
all sampling positions y 'of y dimension of microwave millimeter wave antenna array element'kMatched filtered signal
Figure FDA0002653607280000055
Are all equal to the sampling position y'kThe distance matching point signal S ofG(xi,y'k,zL) Y'kAll sampling positions y 'of the y dimension of the microwave millimeter wave antenna array element are obtained through corresponding multiplication of the dimensions'kSignal of
Figure FDA0002653607280000056
All sampling positions y 'of y dimension of microwave millimeter wave antenna array element'kSignal of
Figure FDA0002653607280000057
Performing complex number accumulation calculation to obtain signal S (x)i,yq,zj)。
CN202010879257.4A 2020-08-27 2020-08-27 Microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition Active CN112114310B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010879257.4A CN112114310B (en) 2020-08-27 2020-08-27 Microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010879257.4A CN112114310B (en) 2020-08-27 2020-08-27 Microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition

Publications (2)

Publication Number Publication Date
CN112114310A true CN112114310A (en) 2020-12-22
CN112114310B CN112114310B (en) 2022-08-02

Family

ID=73804229

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010879257.4A Active CN112114310B (en) 2020-08-27 2020-08-27 Microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition

Country Status (1)

Country Link
CN (1) CN112114310B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112634244A (en) * 2020-12-28 2021-04-09 博微太赫兹信息科技有限公司 Three-dimensional complex image processing method and system for target detection
CN113156432A (en) * 2021-05-07 2021-07-23 南京邮电大学 Portable microwave imaging system
CN113156429A (en) * 2021-04-23 2021-07-23 森思泰克河北科技有限公司 Imaging method, device and equipment based on millimeter wave and storage medium
CN116893415A (en) * 2023-06-08 2023-10-17 珠海微度芯创科技有限责任公司 Rapid imaging method and system based on millimeter wave sparse array system design

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050253579A1 (en) * 2004-05-12 2005-11-17 Block Walter F Magnetic resonance imaging with fat suppression
US20070205936A1 (en) * 2005-03-24 2007-09-06 Battelle Memorial Institute Holographic arrays for multi-path imaging artifact reduction
CN104569971A (en) * 2014-12-25 2015-04-29 深圳市一体太赫兹科技有限公司 Close-range three-dimensional holographic imaging method and system
CN105068126A (en) * 2015-07-02 2015-11-18 中国科学院上海微系统与信息技术研究所 Millimeter-wave holographic imaging method with function of amplitude correction
CN106338732A (en) * 2016-08-23 2017-01-18 华讯方舟科技有限公司 Millimeter wave 3D holographic imaging method and millimeter wave 3D holographic imaging system
CN107942326A (en) * 2017-11-14 2018-04-20 西南交通大学 A kind of two-dimentional active MMW imaging method with high universalizable
CN109471193A (en) * 2018-11-19 2019-03-15 博微太赫兹信息科技有限公司 Signal processing imaging method of microwave millimeter wave three-dimensional holographic imaging system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050253579A1 (en) * 2004-05-12 2005-11-17 Block Walter F Magnetic resonance imaging with fat suppression
US20070205936A1 (en) * 2005-03-24 2007-09-06 Battelle Memorial Institute Holographic arrays for multi-path imaging artifact reduction
CN104569971A (en) * 2014-12-25 2015-04-29 深圳市一体太赫兹科技有限公司 Close-range three-dimensional holographic imaging method and system
CN105068126A (en) * 2015-07-02 2015-11-18 中国科学院上海微系统与信息技术研究所 Millimeter-wave holographic imaging method with function of amplitude correction
CN106338732A (en) * 2016-08-23 2017-01-18 华讯方舟科技有限公司 Millimeter wave 3D holographic imaging method and millimeter wave 3D holographic imaging system
CN107942326A (en) * 2017-11-14 2018-04-20 西南交通大学 A kind of two-dimentional active MMW imaging method with high universalizable
CN109471193A (en) * 2018-11-19 2019-03-15 博微太赫兹信息科技有限公司 Signal processing imaging method of microwave millimeter wave three-dimensional holographic imaging system

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
DAVID M. SHEEN ET AL.: "Three-Dimensional Millimeter-Wave Imaging for Concealed Weapon Detection", 《IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES》 *
HANG CHENG ET AL.: "W-band three-dimensional surveillance imaging system", 《2015 ASIA-PACIFIC MICROWAVE CONFERENCE (APMC)》 *
LINGBO QIAO ET AL.: "Algebraic Reconstruction Technique for Millimeter-wave Holographic Imaging", 《2015 40TH INTERNATIONAL CONFERENCE ON INFRARED, MILLIMETER, AND TERAHERTZ WAVES (IRMMW-THZ)》 *
YU SUN ET AL.: "Spatial Resolution Enhancement Techniques of Space-borne Microwave Radiometer", 《PROCEEDINGS OF 2014 3RD ASIA-PACIFIC CONFERENCE ON ANTENNAS AND PROPAGATION》 *
周光珍等: "激光全息投影三维图像重构技术", 《自动化与仪器仪表》 *
孟祥新等: "W波段调频连续波系统三维成像技术研究", 《电子测量技术》 *
王彦平等: "长序列星载合成孔径雷达数据层析处理技术", 《测试技术学报》 *
谢朋飞等: "融合w-K和BP算法的圆柱扫描毫米波三维成像算法", 《雷达学报》 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112634244A (en) * 2020-12-28 2021-04-09 博微太赫兹信息科技有限公司 Three-dimensional complex image processing method and system for target detection
CN112634244B (en) * 2020-12-28 2022-09-30 博微太赫兹信息科技有限公司 Three-dimensional complex image processing method and system for target detection
CN113156429A (en) * 2021-04-23 2021-07-23 森思泰克河北科技有限公司 Imaging method, device and equipment based on millimeter wave and storage medium
CN113156432A (en) * 2021-05-07 2021-07-23 南京邮电大学 Portable microwave imaging system
CN113156432B (en) * 2021-05-07 2023-08-15 南京邮电大学 Portable microwave imaging system
CN116893415A (en) * 2023-06-08 2023-10-17 珠海微度芯创科技有限责任公司 Rapid imaging method and system based on millimeter wave sparse array system design
CN116893415B (en) * 2023-06-08 2024-05-10 珠海微度芯创科技有限责任公司 Rapid imaging method and system based on millimeter wave sparse array system design

Also Published As

Publication number Publication date
CN112114310B (en) 2022-08-02

Similar Documents

Publication Publication Date Title
CN112114310B (en) Microwave millimeter wave holographic image reconstruction method based on three-dimensional decomposition
CN109471193B (en) Signal processing imaging method of microwave millimeter wave three-dimensional holographic imaging system
Moll et al. Towards three-dimensional millimeter-wave radar with the bistatic fast-factorized back-projection algorithm—Potential and limitations
US7245250B1 (en) Synthetic aperture radar image compression
US9250323B2 (en) Target detection utilizing image array comparison
US11561300B2 (en) Close-range microwave imaging method and system
Chan et al. Experimental studies on circular SAR imaging in clutter using angular correlation function technique
US11385380B2 (en) System and method for debugging millimeter wave security inspection instrument
JP5705244B2 (en) Super-resolution imaging radar
CN111505721A (en) Millimeter wave sparse imaging method and system based on sparse array
CN112415515B (en) Method for separating targets with different heights by airborne circular track SAR
Bocker et al. New inverse synthetic aperture radar algorithm for translational motion compensation
CN111025256A (en) Method and system for detecting weak vital sign signals of airborne radar
Bocker et al. ISAR motion compensation using the burst derivative measure as a focal quality indicator
Tuo et al. Super-resolution imaging for real aperture radar by two-dimensional deconvolution
CN112099102B (en) Antenna array mechanical scanning type holographic image reconstruction method
CN111090102B (en) Super-resolution reflection type terahertz three-dimensional target reconstruction imaging method
Kahl et al. Stand-off real-time synthetic imaging at mm-wave frequencies
CN112666625A (en) Rapid imaging device and method for millimeter wave security inspection
CN109884628B (en) Radar based on solution line frequency modulation pulse pressure is associated with three-D imaging method
EP4273579B1 (en) Systems and methods for non-intrusive material quality inspection using threedimensional monostatic radar based imaging
Yang et al. Shape Reconstruction of Concave Objects Based on High-Order Boundary Scattering Transform for Millimeter-Wave Near-Field Imaging
CN118365819A (en) Three-dimensional reconstruction method and device for urban building
CN118731974A (en) OPA-LiDAR detection imaging method and system based on active synthetic aperture
Tan et al. A super-resolution imaging method for real-aperture scanning radar based on mrf prior model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant