CN115880188A - Polarization direction statistical image generation method, device and medium - Google Patents
Polarization direction statistical image generation method, device and medium Download PDFInfo
- Publication number
- CN115880188A CN115880188A CN202310077424.7A CN202310077424A CN115880188A CN 115880188 A CN115880188 A CN 115880188A CN 202310077424 A CN202310077424 A CN 202310077424A CN 115880188 A CN115880188 A CN 115880188A
- Authority
- CN
- China
- Prior art keywords
- image
- polarization
- pixel
- polarization direction
- diagonal neighborhood
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
A method, equipment and medium for generating a polarization direction statistical image belong to the technical field of polarization spectrum imaging and image processing. Obtaining a polarization focusing plane image, carrying out diagonal neighborhood orthogonal difference on the polarization focusing plane image to obtain a diagonal neighborhood orthogonal difference image with a negative value in a pixel, and correcting the diagonal neighborhood orthogonal difference image with the negative value in the pixel to obtain a diagonal neighborhood orthogonal difference image; calculating by utilizing the polarization split focal plane image and the negative diagonal neighborhood orthogonal difference image to obtain a natural light component image, and obtaining an analyzing direction image through the natural light component image; calculating and interpolating the polarization focusing plane image to obtain a polarization angle image with the same resolution as the polarization focusing plane image, and performing angle division and classification on the polarization angle image to obtain a polarization direction image; and correcting the polarization detection direction image according to the polarization direction image to obtain a polarization direction statistical image, and obtaining a polarization direction characteristic image by using the polarization direction statistical image and the diagonal neighborhood orthogonal difference image.
Description
Technical Field
The invention relates to the technical field of polarization spectrum imaging and image processing, in particular to a method, equipment and medium for generating a polarization direction statistical image.
Background
When the form and color of the artificial target are different from the natural background, the target in the background is difficult to identify by common light intensity imaging, and the polarized light formed by polarizing the natural light by the target and the background surface can contain the own polarization characteristics of the target and the background, so that certain convenience can be provided for target detection by polarized imaging.
When the target detection is carried out through polarization imaging, the performance of a polarization imaging device can be improved, such as the extinction ratio and the like, and the contrast can be improved through the fusion of a polarization image and a light intensity image so as to carry out the target detection. By obtaining S in the prior art 0 、S 1 、S 2 And S 3 The polarization degree and the polarization angle are calculated by four Stokes vectors, the polarization degree has the problem that the difference of a target background is not obvious in some scenes, and the polarization angle has the problem that the noise is large and the target background cannot be identified, so that the difference between the target and the background is difficult to express through the image information of the polarization degree and the polarization angle.
In summary, in the prior art, it is difficult to express the difference between the target and the background for the polarization degree and the polarization angle image information.
Disclosure of Invention
The invention solves the problem that the difference between the target and the background is difficult to express to the image information of the polarization degree and the polarization angle in the prior art.
The invention relates to a method for generating a polarization direction statistical image, which comprises the following steps:
the method comprises the following steps that S1, after a polarization focus splitting plane image is obtained, diagonal neighborhood orthogonal difference is carried out on the polarization focus splitting plane image to obtain a diagonal neighborhood orthogonal difference image with a pixel having a negative value, and the diagonal neighborhood orthogonal difference image with the pixel having the negative value is corrected to obtain a diagonal neighborhood orthogonal difference image;
s2, calculating by utilizing the polarization split focal plane image and the diagonal neighborhood orthogonal difference image to obtain a natural light component image, and obtaining an analyzing direction image through the natural light component image;
s3, calculating and interpolating the polarization focusing plane image to obtain a polarization angle image with the same resolution as the polarization focusing plane image, and performing angle division and classification on the polarization angle image to obtain a polarization direction image;
and S4, correcting the polarization detection direction image according to the polarization direction image to obtain a polarization direction statistical image, and obtaining a polarization direction characteristic image by using the polarization direction statistical image and the diagonal neighborhood orthogonal differential image.
Further, in an embodiment of the present invention, the calculation formula for performing diagonal neighborhood orthogonal difference on the image to obtain a diagonal neighborhood orthogonal difference image with a negative value in the pixel is as follows:
I IOD (i,j)=I DOFP (i,j)-(I DOFP (i-1,j-1)+I DOFP (i-1,j+1)+I DOFP (i+1,j-1)+I DOFP (i+1,j+1))/4；
in the formula I IOD (I, j) diagonal neighborhood orthogonal difference image I with negative pixel values IOD Pixel value of (2), I DOFP (I, j) is a polarization-resolved focal plane image I DOFP Is the image I, (I, j) is the pixel value of IOD And I DOFP A pixel row-column position index;
the calculation formula for correcting the diagonal neighborhood orthogonal difference image with the negative value of the pixel is as follows:
I OD (i，j)= I IOD (i，j)+Min(I IOD (i，j));
in the formula I OD (i, j) is the diagonal neighborhood orthogonal differencePartial image I OD Pixel value of (1), I IOD (I, j) diagonal neighborhood orthogonal difference image I with negative pixel values IOD Pixel value of (d), min (I) IOD (I, j)) a diagonal neighborhood orthogonal difference image I with negative values of pixels IOD Is the minimum pixel value of (I, j) is the image I OD And I IOD A pixel row-column position index;
further, in an embodiment of the present invention, the calculation formula of the natural light component image is:
I N (i,j)= I DOFP (i,j)- I OD (i，j);
in the formula I N (I, j) is a natural light component image I N Pixel value of (1), I DOFP (I, j) is a polarization-resolved focal plane image I DOFP Pixel value of (1), I OD (I, j) is a diagonal neighborhood orthogonal differential image I OD Is the image I, (I, j) is the pixel value of N 、I DOFP And I OD Pixel row-column position index.
Further, in an embodiment of the present invention, the obtaining an analysis direction image through a natural light component image specifically includes:
dividing the natural light component image into a plurality of 2 x 2 pixel blocks at equal intervals, wherein the direction value of the direction of the minimum pixel in each 2 x 2 pixel block is the pixel value of the image in the polarization detection direction, and the length and the width of the image in the polarization detection direction are half of the natural light component image;
I DD (x,y)=Minθ(I N (i,j),I N (i,j+1), I N (i+1,j), I N (i+1,j+1));
in the formula I DD (x, y) is the analyzing direction image I DD (x, y) is the image I DD A pixel row and column position index, min theta (t) is an operation sign of the direction of the minimum pixel in the 2 x 2 pixel blocks, I N (I, j) is the pixel value of the natural light polarization component image, and (I, j) is the image I N Pixel row column position index where x and y have half the maximum index position number of i and j.
Further, in an embodiment of the present invention, the angle-dividing and classifying the polarization angle image to obtain a polarization direction image includes the following steps:
step S301, a plurality of 2 × 2 pixel blocks which are divided into rows and columns of the initial polarization direction image at equal intervals are subjected to statistical calculation to obtain an initial polarization direction image, and the calculation formula of the initial polarization direction image is as follows:
in the formula I IAD (x, y) is an initial polarization direction image I IAD (x, y) is the image I IAD Pixel row-column position index, I AOP (I, j) is a polarization angle image I AOP Is the image I, (I, j) is the image I AOP A pixel row-column position index;
step S302, the angles represented by the pixel values of the initial polarization direction image are respectively classified into four directions of 0 degrees, 45 degrees, 90 degrees and 135 degrees to obtain a polarization direction image, and the calculation formula of the polarization direction image is as follows:
in the formula I AD (x, y) is a polarization direction image I AD Pixel value of (2), I IAD (x, y) is an initial polarizing angle image I IAD Is (x, y) an image I IAD And I AD Pixel row-column position index, N 0 ～N 4 The pixel value of the image in the polarization direction is in the range of 0-180, and the interval between two adjacent pixels is equal.
Further, in an embodiment of the present invention, the calculation formula for obtaining the polarization direction statistical image by correcting the polarization analysis direction image according to the polarization direction image is as follows:
in the formula I TD (x, y) is a polarization direction statistical image I TD Pixel value of (1), I AD (x, y) is a polarization direction image I AD Pixel value of (1), I DD (x, y) is an analyzing direction image I DD Is (x, y) an image I TD 、I AD And I DD Pixel row-column position index.
Further, in an embodiment of the present invention, the obtaining of the polarization direction characteristic image by using the polarization direction statistical image and the diagonal neighborhood orthogonal difference image specifically includes:
dividing rows and columns of a diagonal neighborhood difference image into a plurality of 2 x 2 pixel blocks at equal intervals, taking a pixel value of a difference direction when the direction represented by a pixel of a polarization direction statistical image is equal to a certain difference direction in the corresponding 2 x 2 pixel blocks of the diagonal neighborhood difference image, and taking the average value of the 2 x 2 pixel blocks of the corresponding diagonal neighborhood difference image to obtain a polarization direction characteristic image when the pixel of the polarization direction statistical image is-1, wherein the calculation formula of the polarization direction characteristic image is as follows:
in the formula I T (x, y) is a characteristic image I of polarization direction T Pixel value of (1), I TD (x, y) is a polarization direction statistical image I TD Pixel value of (1), I OD (I, j) is a diagonal neighborhood orthogonal difference image I OD The operator D () is the direction of obtaining the diagonal neighborhood orthogonal difference image pixel representation, the operator Mean () is the calculation of the diagonal neighborhood orthogonal difference image 2 x 2 pixel block Mean, (x, y) is the image I T And I TD Pixel row column position index, (I, j) is image I OD Pixel row-column position index.
The invention relates to electronic equipment which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for completing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of the above methods when executing the program stored in the memory.
A computer-readable storage medium according to the present invention, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of the above-mentioned methods.
The invention solves the problem that the difference between the target and the background is difficult to express to the image information of the polarization degree and the polarization angle in the prior art. The method has the following specific beneficial effects:
1. the invention relates to a polarization direction statistical image generation method, which comprises the steps of carrying out diagonal neighborhood pixel orthogonal difference operation on a polarization focusing plane image to obtain a diagonal neighborhood orthogonal difference image, subtracting the diagonal neighborhood orthogonal difference image to obtain a natural light component image, obtaining an analysis direction image through the natural light component image, obtaining a polarization angle image through polarization focusing plane image interpolation calculation, carrying out angle division and classification on the polarization angle image to obtain a polarizing angle image, correcting the analysis angle image through the polarizing angle image to obtain a polarization direction statistical image, and obtaining a polarization direction characteristic image by utilizing the polarization direction statistical image and the diagonal neighborhood orthogonal difference image, wherein the image can enhance the polarization direction difference between a target and a background;
2. according to the polarization direction statistical image generation method, different polarization angles can represent polarization characteristics of different objects, polarization direction images are obtained through statistics, the polarization direction images obtained through statistics calculation are corrected, and finally polarization direction statistical images with polarization directions consistent with the polarization directions are obtained.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a block flow diagram of a method for generating a polarization direction statistical characteristic image according to an embodiment;
fig. 2 is a schematic diagram of a calculation process of an analyzing direction image of a polarization direction statistical characteristic image generation method according to an embodiment;
fig. 3 is a schematic diagram of a calculation process of polarization direction images of a polarization direction statistical characteristic image generation method according to an embodiment;
fig. 4 is a schematic diagram of a polarization direction statistical image calculation process of a polarization direction statistical feature image generation method according to an embodiment;
fig. 5 is a schematic diagram of a polarization direction characteristic image calculation process of a polarization direction statistical characteristic image generation method according to an embodiment.
Detailed Description
Various embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings. The embodiments described by referring to the drawings are exemplary and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The method for generating a statistical image of polarization directions according to this embodiment includes the following steps:
the method comprises the following steps that S1, after a polarization focusing plane image is obtained, diagonal neighborhood orthogonal difference is conducted on the polarization focusing plane image to obtain a diagonal neighborhood orthogonal difference image with a pixel having a negative value, and the diagonal neighborhood orthogonal difference image with the pixel having the negative value is corrected to obtain a diagonal neighborhood orthogonal difference image;
s2, calculating by utilizing the polarization split focal plane image and the diagonal neighborhood orthogonal difference image to obtain a natural light component image, and obtaining an analyzing direction image through the natural light component image;
s3, calculating and interpolating the polarization focusing plane image to obtain a polarization angle image with the same resolution as the polarization focusing plane image, and performing angle division and classification on the polarization angle image to obtain a polarization direction image;
and S4, correcting the polarization detection direction image according to the polarization direction image to obtain a polarization direction statistical image, and obtaining a polarization direction characteristic image by using the polarization direction statistical image and the diagonal neighborhood orthogonal difference image.
In this embodiment, the calculation formula for obtaining the diagonal neighborhood orthogonal difference image by performing the diagonal neighborhood orthogonal difference on the image is as follows:
I IOD (i,j)=I DOFP (i,j)-(I DOFP (i-1,j-1)+I DOFP (i-1,j+1)+I DOFP (i+1,j-1)+I DOFP (i+1,j+1))/4；
in the formula I IOD (I, j) orthogonal differential image I of diagonal neighborhood with negative pixel values IOD Pixel value of (1), I DOFP (I, j) is a polarization-resolved focal plane image I DOFP Is the image I, (I, j) is the pixel value of IOD And I DOFP A pixel row-column position index;
the calculation formula for correcting the diagonal neighborhood orthogonal difference image with the negative value of the pixel is as follows:
I OD (i，j)= I IOD (i，j)+Min(I IOD (i，j));
in the formula I OD (I, j) is a diagonal neighborhood orthogonal differential image I OD Pixel value of (1), I IOD (I, j) diagonal neighborhood orthogonal difference image I with negative pixel values IOD Pixel value of (d), min (I) IOD (I, j)) a diagonal neighborhood orthogonal difference image I with negative values of pixels IOD Is the minimum pixel value of (I, j) is the image I OD And I IOD A pixel row-column position index;
in this embodiment, the formula for calculating the natural light component image is:
I N (i,j)=I DOFP (i,j)- I OD (i，j);
in the formula I N (I, j) is a natural light component image I N Pixel value of (1), I DOFP (I, j) is a polarization-separated focal plane image I DOFP Pixel value of (1), I OD (I, j) is a diagonal neighborhood orthogonal difference image I OD Is the image I, (I, j) is the image I N 、I DOFP And I OD Pixel row-column position index.
In this embodiment, the obtaining of the polarization analysis direction image through the natural light component image specifically includes:
dividing the natural light component image into a plurality of 2 x 2 pixel blocks at equal intervals, wherein the direction value of the direction of the minimum pixel in each 2 x 2 pixel block is the pixel value of the image in the polarization detection direction, and the length and the width of the image in the polarization detection direction are half of the natural light component image;
I DD (x,y)=Minθ(I N (i,j),I N (i,j+1), I N (i+1,j), I N (i+1,j+1));
in the formula I DD (x, y) is an analyzing direction image I DD Is (x, y) an image I DD A pixel row and column position index, min theta (t) is an operation sign of the direction of the minimum pixel in the 2 x 2 pixel blocks, I N (I, j) is a natural light polarization component image I N Is the image I, (I, j) is the pixel value of N Pixel row column position index, where x and y have half the maximum index position number of i and j.
In this embodiment, the angle division and classification of the polarization angle image to obtain the polarization direction image includes the following steps:
step S301, dividing the initial polarizing direction image into a plurality of 2 x 2 pixel blocks with equal intervals, and performing statistical calculation to obtain an initial polarizing direction image, wherein the initial polarizing direction image has a calculation formula as follows:
in the formula I IAD (x, y) is an initial polarization direction image I IAD Is (x, y) an image I IAD Pixel row column position index, I AOP (I, j) is the pixel value of the polarization angle image, and (I, j) is the image I AOP A pixel row-column position index;
step S302, the angles represented by the pixel values of the initial polarization direction image are respectively classified into four directions of 0 degree, 45 degrees, 90 degrees and 135 degrees to obtain a polarization direction image, and the calculation formula of the polarization direction image is as follows:
in the formula I AD (x, y) is a polarization direction image I AD Pixel value of (2), I IAD (x, y) is an initial polarizing angle I IAD The pixel value of the image (x, y) is the image I IAD And I AD Pixel row-column position index, N 0 ～N 4 Is the image of the polarization direction imageThe element value is in the range of 0-180, and the interval between two adjacent elements is equal.
In this embodiment, the calculation formula for obtaining the statistical image of the polarization direction by correcting the image of the polarization detection direction according to the image of the polarization direction is as follows:
in the formula I TD (x, y) is a polarization direction statistical image I TD Pixel value of (2), I AD (x, y) is a polarization direction image I AD Pixel value of (2), I DD (x, y) is the analyzing direction image I DD Is (x, y) an image I TD 、I AD And I DD Pixel row-column position index.
In this embodiment, the obtaining of the polarization direction characteristic image by using the polarization direction statistical image and the diagonal neighborhood orthogonal difference image specifically includes:
dividing rows and columns of the diagonal neighborhood difference image into a plurality of 2 x 2 pixel blocks at equal intervals, when the direction represented by the pixel of the polarization direction statistical image is equal to a certain difference direction in the corresponding diagonal neighborhood difference image 2 x 2 pixel blocks, taking the pixel value of the difference direction, when the pixel of the polarization direction statistical image is-1, taking the average value of the corresponding diagonal neighborhood difference image 2 x 2 pixel blocks to obtain a polarization direction characteristic image, wherein the calculation formula of the polarization direction characteristic image is as follows:
in the formula I T (x, y) is a polarization direction characteristic image I T Pixel value of (1), I TD (x, y) is a polarization direction statistical image I TD Pixel value of (1), I OD (I, j) is the pixel value of the diagonal neighborhood orthogonal difference image, the operator D (Mean)) is the direction of obtaining the pixel representation of the diagonal neighborhood orthogonal difference image, the operator Mean (Mean)) is the average value of 2 x 2 pixel blocks of the diagonal neighborhood orthogonal difference image, and (x, y) is the image I T And I TD Pixel row column position index, (I, j) is image I OD Pixel row-column position index.
The present embodiment is based on the polarization direction statistical image generation method described in the present invention, and can be better understood with reference to fig. 1, and provides an actual embodiment:
the embodiment provides a polarization direction characteristic image generation method, which is characterized in that polarization directions of natural light which is incident to the surface of an object and subjected to polarization reflection are different based on different materials and structures of the object, so that a polarization detection directional diagram calculation method for filtering a large amount of natural light is provided, a polarization detection directional diagram calculation method for classifying angles is provided, and direction characteristics corresponding to an orthogonal differential diagram of an opposite angle neighborhood are extracted after the polarization detection method is corrected by utilizing the polarization detection method.
The method comprises the steps of firstly obtaining an orthogonal differential image of a diagonal neighborhood through calculation of a polarization splitting focal plane image, then obtaining a natural light component image through subtraction of the orthogonal differential image of the diagonal neighborhood and the polarization splitting focal plane image, and then obtaining an analysis directional diagram through selecting the direction of a minimum pixel value in a pixel block 2 x 2 of the natural light component image, wherein as shown in figure 2, the direction of a natural light image I is the direction of the minimum pixel value in the pixel block 2 x 2 N Of a certain 2 x 2 pixel block has a pixel value of I N (i,j)=n 2 ，I N (i,j+1)=n 3 ，I N (i+1,j)=n 1 And I N (i+1,j+1)=n 0 When I is N (i,j)=n 2 When the value of (A) is the smallest of 4 pixels, I is selected N (i,j)=n 2 The angle 90 of the analyzing direction is an analyzing image I DD Pixel value of (2), i.e. I DD (x,y)=90。
The second part is to solve the problem of disorderly polarization angle direction, and calculate the average value of all the pixel values of 2-2 pixel blocks of the polarization angle image to obtain the initial polarization direction image I with half of the polarization angle image in length and width IAD And by mixing
The pixel values are divided into four types of 0 degrees, 45 degrees, 90 degrees and 135 degrees to obtain polarization direction images which represent 0 degrees, 45 degrees, 90 degrees and 135 degreesFour directions of 135 deg., as shown in fig. 3, by means of the formula->
The numerical value corresponding relation of (A) to (B) is image I IAD The pixel values are divided and classified to obtain an image I AD 。
The third part is to ensure that the polarization direction and the polarization detection direction are consistent, so that the final polarization direction characteristic image has the characteristic of large difference of the target background, and as shown in fig. 4, an image I passing through the polarization direction is adopted AD Correction of polarization-detection orientation image I DD Wherein, the polarization direction statistic image I is obtained when the two corresponding pixels are the same TD Pixel value I TD (x, y) and I AD (x, y) and I DD (x, y) are kept the same at different times I TD The (x, y) pixel value is-1, so that a polarization direction statistical image is obtained. Obtaining a polarization direction characteristic image I by obtaining the pixel values of the directions in the diagonal neighborhood orthogonal differential image 2 x 2 pixel blocks corresponding to the pixel values of the polarization direction statistical image T When the polarization direction is counted as image I, as shown in FIG. 5 TD Pixel value of (1) TD (x, y) is 135, polarization direction characteristic image I T Pixel value of (1) T (x, y) is a diagonal neighborhood orthogonal difference image I OD Pixel value n of pixel with 135 deg. difference direction in corresponding 2 x 2 pixel block 3 (ii) a When the image I TD Pixel value of (1) TD When (x, y) is-1, image I T Pixel value of (1) T (x, y) = n is the image I OD The average of 4 pixels in the corresponding 2 x 2 pixel block, i.e. n = (n) 4 +n 5 +n 6 +n 7 )/4。
For better illustration of the polarization direction statistical image generation method described in the present application, the following embodiments are used for detailed description:
the method comprises the following steps:
the method comprises the following steps of S1, obtaining a polarization focus splitting plane image and carrying out diagonal neighborhood orthogonal difference on the polarization focus splitting plane image to obtain a diagonal neighborhood orthogonal difference image;
the step S1 includes the steps of:
s11, obtaining a polarization split focal plane image and carrying out diagonal neighborhood orthogonal difference on the polarization split focal plane image to obtain a diagonal neighborhood orthogonal difference image with a negative value of a pixel;
collecting a polarization split-focus plane image containing an artificial target and a natural background by utilizing a polarization split-focus plane camera;
in order to ensure that the resolution of the diagonal neighborhood orthogonal differential image with the negative value of the pixel is the same as that of the polarization split-focus plane image, the polarization split-focus plane image needs to expand the edges of 4 edges in the calculation process, the edge pixel value is given as 0 after the expansion, and the calculation formula of the diagonal neighborhood orthogonal differential image with the negative value of the pixel is as follows:
I IOD (i,j)=I DOFP (i,j)-(I DOFP (i-1,j-1)+I DOFP (i-1,j+1)+I DOFP (i+1,j-1)+I DOFP (i+1,j+1))/4；
in the formula I IOD (I, j) diagonal neighborhood orthogonal difference image I with negative pixel values IOD Pixel value of (1), I DOFP (I, j) is a polarization-resolved focal plane image I DOFP Is the image I, (I, j) is the pixel value of IOD And I DOFP A pixel row-column position index;
s12, correcting the diagonal neighborhood orthogonal differential image with a negative value in the pixel;
in order to make the pixel value of the diagonal neighborhood orthogonal difference image with the negative value of the pixel calculated in the above step be greater than or equal to 0, the correction is carried out by the following formula:
I OD (i，j)= I IOD (i，j)+Min(I IOD (i，j));
in the formula I OD (I, j) is a diagonal neighborhood orthogonal difference image I OD Pixel value of (1), I IOD (I, j) diagonal neighborhood orthogonal difference image I with negative pixel values IOD Pixel value of (d), min (I) IOD (I, j)) is the minimum pixel value of the diagonal neighborhood orthogonal difference image with a negative value of the pixel, and (I, j) is the image I OD And I IOD Pixel row-column position index.
S2, subtracting the orthogonal differential image of the diagonal neighborhood from the polarization splitting focal plane image to obtain a natural light component image, and obtaining an analyzing direction image through the natural light component image;
the step S2 includes the steps of:
step S21, subtracting the orthogonal differential image of the diagonal neighborhood from the polarization split focal plane image to obtain a natural light component image;
I N (i,j)=I DOFP (i,j)- I OD (i，j);
in the formula I N (I, j) is a natural light component image I N Pixel value of (1), I DOFP (I, j) is a polarization-resolved focal plane image I DOFP Pixel value of (2), I OD (I, j) is a diagonal neighborhood orthogonal difference image I OD Is the image I, (I, j) is the pixel value of N 、I DOFP And I OD A pixel row-column position index;
step S22, obtaining an analyzing direction image by carrying out statistical calculation on the natural light component image;
dividing the natural light component image into a plurality of 2 x 2 pixel blocks at equal intervals, wherein the direction represented by the pixel with the minimum pixel value in each 2 x 2 pixel block is the pixel value of the image in the polarization analysis direction, and the length and the width of the image in the polarization analysis direction are half of the natural light component image;
I DD (x,y)=Minθ(I N (i,j),I N (i,j+1), I N (i+1,j), I N (i+1,j+1));
in the formula I DD (x, y) is an analyzing direction image I DD Is (x, y) an image I DD A pixel row-column position index, min θ (, n) is an operand in the direction of the smallest pixel value in the 2 x 2 pixel block (four directions of 0 °,45 °,90 ° and 135 °, respectively), I N (I, j) is the pixel value of the natural light polarization component image, and (I, j) is the image I N Pixel row-column position index, where the maximum index position numbers of x and y are half of the maximum index positions of i and j;
s3, calculating and interpolating according to the polarization focusing plane image to obtain a polarization angle image with the same resolution as the polarization focusing plane image, and calculating to obtain a polarization direction image;
step S3 includes the following steps:
s31, obtaining a polarization angle image with the same resolution as the polarization split focal plane image through interpolation decomposition calculation of the polarization split focal plane image;
the polarization focusing plane image with 0 value boundary expansion is decomposed into I through a bilinear interpolation method 0 、I 45 、I 90 And I 135 . Obtaining a Stokes vector image I through Stokes vector calculation S0 、I S1 、I S2 And a polarization angle image, the calculation formula of which is:
I S0 =( I 0 +I 45 +I 90 +I 135 )/2；
I S1 = I 0 -I 90 ；
I S2 = I 45 -I 135 ；
dividing the rows and the columns of the polarization angle image into a plurality of 2 x 2 pixel blocks at equal intervals, calculating the average value of each pixel block to obtain the pixel value of an initial polarization direction image, wherein the length and the width of the initial polarization direction image are divided into half of the polarization angle image, and the calculation formula of the initial polarization direction image is as follows:
in the formula I IAD (x, y) is an initial polarization direction image I IAD Is (x, y) an image I IAD Pixel row column position index, I AOP (I, j) is a polarization angle image I AOP Is the image I, (I, j) is the image I AOP A pixel row-column position index;
step S32, classifying the angles represented by the pixel values of the initial polarization direction image into four directions of 0 degrees, 45 degrees, 90 degrees and 135 degrees to obtain a polarization direction image, wherein the calculation formula of the polarization direction image is as follows:
in the formula I AD (x, y) is a polarization direction image I AD Pixel value of (2), I IAD (x, y) is an initial polarizing angle image I IAD Is (x, y) an image I IAD And I AD Pixel row column position index, N 0 ～N 4 The pixel value of the image in the polarizing direction is in the range of 0-180, and the interval between two adjacent pixels is equal;
s4, correcting the polarization detection direction image according to the polarization direction image to obtain a polarization direction statistical chart, and obtaining a polarization direction characteristic chart by utilizing the polarization direction statistical chart and the diagonal neighborhood orthogonal difference image;
step S4 includes the following steps:
s41, correcting the polarization detection direction image according to the polarization direction image to obtain a polarization direction statistical chart;
the pixel values of the polarization direction image and the polarization analysis direction image represent the polarization direction. Comparing the pixel values of the polarization direction image and the polarization analysis direction image, assigning the pixel values to the pixels corresponding to the polarization direction statistical image when the pixel values of the polarization direction image and the polarization analysis direction image are the same, assigning the pixels of the polarization direction statistical image to be-1 when the pixel values of the polarization direction statistical image and the polarization analysis direction image are different, and the calculation formula is as follows:
in the formula I TD (x, y) is a polarization direction statistical image I TD Pixel value of (2), I AD (x, y) is a polarization direction image I AD Pixel value of (1), I DD (x, y) is an analyzing direction image I DD Is (x, y) an image I TD 、I AD And I DD A pixel row-column position index;
s42, obtaining a polarization direction characteristic diagram by utilizing the polarization direction statistical image and the diagonal neighborhood orthogonal differential image;
dividing rows and columns of a diagonal neighborhood difference image into a plurality of 2 x 2 pixel blocks at equal intervals, taking a pixel value (an angle value in a non-difference direction) of a difference direction when the direction represented by a pixel of a polarization direction statistical image is equal to a certain difference direction in the corresponding diagonal neighborhood difference image 2 x 2 pixel block, taking the average value of the corresponding diagonal neighborhood difference image 2 x 2 pixel when the pixel of the polarization direction statistical image is-1, and obtaining a polarization direction characteristic image, wherein the calculation formula of the polarization direction characteristic image is as follows:
in the formula I T (x, y) is a polarization direction characteristic image I T Pixel value of (1), I TD (x, y) is a polarization direction statistical image I TD Pixel value of (1), I OD (I, j) is the pixel value of the diagonal neighborhood orthogonal difference image, the operator D (Mean)) is the direction of obtaining the pixel representation of the diagonal neighborhood orthogonal difference image, the operator Mean (Mean)) is the average value of 2 x 2 pixel blocks of the diagonal neighborhood orthogonal difference image, and (x, y) is the image I T And I TD Pixel row column position index number, (I, j) is image I OD Pixel row-column position index.
The electronic device according to this embodiment includes a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface are configured to complete communication between the processor and the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of the above embodiments when executing the program stored in the memory.
A computer-readable storage medium according to this embodiment, in which a computer program is stored, which, when being executed by a processor, implements the method steps of any of the above embodiments.
The memory in the embodiments of the present application may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile memory may be a Read Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate SDRAM, enhanced SDRAM, SLDRAM, synchronous Link DRAM (SLDRAM), and direct rambus RAM (DR RAM). It should be noted that the memories of the methods described herein are intended to comprise, without being limited to, these and any other suitable types of memories.
In the above embodiments, all or part of the implementation may be realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a Digital Video Disk (DVD)), or a semiconductor medium (e.g., a Solid State Disk (SSD)), among others.
In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The steps of a method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in a processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor. To avoid repetition, it is not described in detail here.
It should be noted that the processor in the embodiments of the present application may be an integrated circuit chip having signal processing capability. In implementation, the steps of the above method embodiments may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The processor described above may be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and combines hardware thereof to complete the steps of the method.
The method, the device and the medium for generating a polarization direction statistical image provided by the invention are described in detail above, and a specific example is applied in the text to explain the principle and the implementation of the invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (9)
1. A method for generating a polarization-direction statistical image, the method comprising the steps of:
the method comprises the following steps that S1, after a polarization focus splitting plane image is obtained, diagonal neighborhood orthogonal difference is carried out on the polarization focus splitting plane image to obtain a diagonal neighborhood orthogonal difference image with a pixel having a negative value, and the diagonal neighborhood orthogonal difference image with the pixel having the negative value is corrected to obtain a diagonal neighborhood orthogonal difference image;
s2, calculating by utilizing the polarization focus splitting plane image and the diagonal neighborhood orthogonal difference image to obtain a natural light component image, and obtaining an analyzing direction image through the natural light component image;
s3, calculating and interpolating the polarization focusing plane image to obtain a polarization angle image with the same resolution as the polarization focusing plane image, and performing angle division and classification on the polarization angle image to obtain a polarization direction image;
and S4, correcting the polarization detection direction image according to the polarization direction image to obtain a polarization direction statistical image, and obtaining a polarization direction characteristic image by using the polarization direction statistical image and the diagonal neighborhood orthogonal difference image.
2. The method for generating a statistical image of polarization directions according to claim 1, wherein the calculation formula for performing diagonal neighborhood orthogonal difference to obtain a diagonal neighborhood orthogonal difference image with a negative pixel value is as follows:
I IOD (i,j)=I DOFP (i,j)-(I DOFP (i-1,j-1)+I DOFP (i-1,j+1)+I DOFP (i+1,j-1)+I DOFP (i+1,j+1))/4；
in the formula I IOD (I, j) diagonal neighborhood orthogonal difference image I with negative pixel values IOD Pixel value of (2), I DOFP (I, j) is a polarization-resolved focal plane image I DOFP Is the image I, (I, j) is the pixel value of IOD And I DOFP A pixel row-column position index;
the calculation formula for correcting the diagonal neighborhood orthogonal difference image with the negative value of the pixel is as follows:
I OD (i，j)= I IOD (i，j)+Min(I IOD (i，j));
in the formula I OD (I, j) is a diagonal neighborhood orthogonal differential image I OD Pixel value of (2), I IOD (I, j) diagonal neighborhood orthogonal difference image I with negative pixel values IOD Pixel value of (d), min (I) IOD (I, j)) a diagonal neighborhood orthogonal difference image I with negative values of pixels IOD Is the minimum pixel value of (I, j) is the image I OD And I IOD Pixel row-column position index.
3. The method according to claim 1, wherein the calculation formula of the natural light component image is:
I N (i,j)=I DOFP (i,j)- I OD (i，j);
in the formula I N (I, j) is a natural light component image I N Pixel value of (1), I DOFP (I, j) is a polarization-resolved focal plane image I DOFP Pixel value of (2), I OD (I, j) is a diagonal neighborhood orthogonal difference image I OD Is the image I, (I, j) is the pixel value of N 、I DOFP And I OD Pixel row-column position index.
4. The method for generating a statistical image of polarization directions according to claim 1, wherein the obtaining of the image of polarization directions from the natural light component image comprises:
dividing the natural light component image into a plurality of 2 x 2 pixel blocks at equal intervals, wherein the direction value of the direction of the minimum pixel in each 2 x 2 pixel block is the pixel value of the image in the polarization detection direction, and the length and the width of the image in the polarization detection direction are half of the natural light component image;
I DD (x,y)=Minθ(I N (i,j),I N (i,j+1), I N (i+1,j), I N (i+1,j+1));
in the formula I DD (x, y) is an analyzing direction image I DD Is (x, y) an image I DD A pixel row and column position index, min theta (t) is an operation sign of the direction of the minimum pixel in the 2 x 2 pixel blocks, I N (I, j) is a natural light polarization component image I N Is the image I, (I, j) is the pixel value of N Pixel row column position index where x and y have half the maximum index position number of i and j.
5. The method for generating the statistical image of the polarization direction according to claim 1, wherein the step of classifying the polarization angle image into the polarization direction image comprises the following steps:
step S301, dividing the initial polarizing direction image into a plurality of 2 x 2 pixel blocks with equal intervals, and performing statistical calculation to obtain an initial polarizing direction image, wherein the initial polarizing direction image has a calculation formula as follows:
in the formula I IAD (x, y) is an initial polarization direction image I IAD (x, y) is the image I IAD Pixel row-column position index, I AOP (I, j) is a polarization angle image I AOP Is the image I, (I, j) is the image I AOP A pixel row-column position index;
step S302, the angles represented by the pixel values of the initial polarization direction image are respectively classified into four directions of 0 degrees, 45 degrees, 90 degrees and 135 degrees to obtain a polarization direction image, and the calculation formula of the polarization direction image is as follows:
in the formula I AD (x, y) is a polarization direction image I AD Pixel value of (1), I IAD (x, y) is an initial polarizing angle image I IAD (x, y) is the image I IAD And I AD Pixel row column position index, N 0 ～N 4 The pixel value of the image in the polarization direction is in the range of 0-180, and the interval between two adjacent pixels is equal.
6. The method according to claim 1, wherein the calculation formula for obtaining the polarization direction statistical image by correcting the polarization analysis direction image according to the polarization direction image is as follows:
in the formula I TD (x, y) is a polarization direction statistical image I TD Pixel value of (1), I AD (x, y) is a polarization direction image I AD Pixel value of (1), I DD (x, y) is an analyzing direction image I DD Is (x, y) an image I TD 、I AD And I DD Pixel row-column position index.
7. The method for generating a polarization direction statistical image according to claim 1, wherein the polarization direction characteristic image is obtained by using the polarization direction statistical image and a diagonal neighborhood orthogonal difference image, and specifically comprises:
dividing rows and columns of a diagonal neighborhood difference image into a plurality of 2 x 2 pixel blocks at equal intervals, taking a pixel value of a difference direction when the direction represented by a pixel of a polarization direction statistical image is equal to a certain difference direction in the corresponding 2 x 2 pixel blocks of the diagonal neighborhood difference image, and taking the average value of the 2 x 2 pixel blocks of the corresponding diagonal neighborhood difference image to obtain a polarization direction characteristic image when the pixel of the polarization direction statistical image is-1, wherein the calculation formula of the polarization direction characteristic image is as follows:
in the formula I T (x, y) is a polarization direction characteristic image I T Pixel value of (2), I TD (x, y) is a polarization direction statistical image I TD Pixel value of (1), I OD (I, j) is a diagonal neighborhood orthogonal difference image I OD The operator D () is the direction of obtaining the pixel representation of the diagonal neighborhood orthogonal difference image, the operator Mean () is the average value of 2 x 2 pixel blocks of the diagonal neighborhood orthogonal difference image, and (x, y) is the image I T And I TD Pixel row column position index, (I, j) is image I OD Pixel row-column position index.
8. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing the communication between the processor and the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of claims 1 to 7 when executing a program stored in the memory.
9. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310077424.7A CN115880188B (en) | 2023-02-08 | 2023-02-08 | Polarization direction statistical image generation method, device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310077424.7A CN115880188B (en) | 2023-02-08 | 2023-02-08 | Polarization direction statistical image generation method, device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115880188A true CN115880188A (en) | 2023-03-31 |
| CN115880188B CN115880188B (en) | 2023-05-19 |
Family
ID=85760873
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310077424.7A Active CN115880188B (en) | 2023-02-08 | 2023-02-08 | Polarization direction statistical image generation method, device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115880188B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102980530A (en) * | 2012-12-05 | 2013-03-20 | 清华大学 | Elliptic partial measurement device and measurement method based on spatial light modulator |
| CN105959514A (en) * | 2016-04-20 | 2016-09-21 | 河海大学 | Weak target imaging detection device and method |
| US20220210322A1 (en) * | 2019-04-19 | 2022-06-30 | Sony Group Corporation | Imaging apparatus, image processing apparatus, and image processing method |
| CN114913075A (en) * | 2022-06-15 | 2022-08-16 | 长春理工大学 | Polarization direction full-resolution image reconstruction method |
| CN115468654A (en) * | 2022-09-05 | 2022-12-13 | 长春理工大学 | Method for acquiring polarization difference characteristic image under optimal angle |
-
2023
- 2023-02-08 CN CN202310077424.7A patent/CN115880188B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102980530A (en) * | 2012-12-05 | 2013-03-20 | 清华大学 | Elliptic partial measurement device and measurement method based on spatial light modulator |
| CN105959514A (en) * | 2016-04-20 | 2016-09-21 | 河海大学 | Weak target imaging detection device and method |
| US20220210322A1 (en) * | 2019-04-19 | 2022-06-30 | Sony Group Corporation | Imaging apparatus, image processing apparatus, and image processing method |
| CN114913075A (en) * | 2022-06-15 | 2022-08-16 | 长春理工大学 | Polarization direction full-resolution image reconstruction method |
| CN115468654A (en) * | 2022-09-05 | 2022-12-13 | 长春理工大学 | Method for acquiring polarization difference characteristic image under optimal angle |
Non-Patent Citations (3)
| Title |
|---|
| XIAOMING LI ET AL.: "Target Detection for Infrared Polarization Image in the Background of Desert", IEEE XPLORE * |
| 李莉等: "一种动态目标检测与跟踪的方法研究", 长春理工大学学报 * |
| 马岩;张超子;刘也;张哲;: "采用双三次插值的空间目标偏振成像", 光学精密工程 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115880188B (en) | 2023-05-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11064183B2 (en) | Multi-lens based capturing apparatus and method | |
| CN110428366B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN109064428B (en) | Image denoising processing method, terminal device and computer readable storage medium | |
| CN110544214A (en) | Image restoration method and device and electronic equipment | |
| CN111199516B (en) | Image processing method, system and storage medium based on image generation network model | |
| WO2021164269A1 (en) | Attention mechanism-based disparity map acquisition method and apparatus | |
| CN109063776B (en) | Image re-recognition network training method and device and image re-recognition method and device | |
| CN110213479B (en) | Anti-shake method and device for video shooting | |
| CN110909663A (en) | Human body key point identification method and device and electronic equipment | |
| WO2021082819A1 (en) | Image generation method and apparatus, and electronic device | |
| CN113963072B (en) | Binocular camera calibration method and device, computer equipment and storage medium | |
| CN112990233B (en) | Picture classification method and device based on channel mixed sample data enhancement | |
| CN113298187B (en) | Image processing method and device and computer readable storage medium | |
| CN110689061A (en) | Image processing method, device and system based on alignment feature pyramid network | |
| CN115880188A (en) | Polarization direction statistical image generation method, device and medium | |
| CN108021815B (en) | Image encryption method and device and electronic equipment | |
| US9979908B2 (en) | Image processing devices and image processing methods with interpolation for improving image resolution | |
| CN112954454B (en) | Video frame generation method and device | |
| CN113538316B (en) | Image processing method, device, terminal equipment and readable storage medium | |
| Qu et al. | A framework for identifying shifted double JPEG compression artifacts with application to non-intrusive digital image forensics | |
| CN114818958B (en) | Method and device for generating countermeasure sample, training model and identifying image | |
| WO2023174355A1 (en) | Video super-resolution method and device | |
| Li et al. | Novel image restoration method based on multi‐frame super‐resolution for atmospherically distorted images | |
| CN112329925B (en) | Model generation method, feature extraction method, device and electronic equipment | |
| Kumar et al. | Blur parameter locus curve and its applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |