CN111667519B - Registration method and device for polarized images with different fields of view - Google Patents
Registration method and device for polarized images with different fields of view Download PDFInfo
- Publication number
- CN111667519B CN111667519B CN202010506431.0A CN202010506431A CN111667519B CN 111667519 B CN111667519 B CN 111667519B CN 202010506431 A CN202010506431 A CN 202010506431A CN 111667519 B CN111667519 B CN 111667519B
- Authority
- CN
- China
- Prior art keywords
- infrared
- images
- image
- different
- polarization information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000010287 polarization Effects 0.000 claims abstract description 206
- 230000005855 radiation Effects 0.000 claims abstract description 124
- 230000000007 visual effect Effects 0.000 claims abstract description 5
- 238000003384 imaging method Methods 0.000 claims description 24
- 238000005259 measurement Methods 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 8
- 238000013519 translation Methods 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 5
- 230000004927 fusion Effects 0.000 abstract description 10
- 238000001514 detection method Methods 0.000 description 7
- 239000013598 vector Substances 0.000 description 7
- 239000013077 target material Substances 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000005457 Black-body radiation Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000007500 overflow downdraw method Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000005315 distribution function Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- GHMWZRWCBLXYBX-UHFFFAOYSA-M sodium;4-chlorobenzoate Chemical compound [Na+].[O-]C(=O)C1=CC=C(Cl)C=C1 GHMWZRWCBLXYBX-UHFFFAOYSA-M 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4023—Scaling of whole images or parts thereof, e.g. expanding or contracting based on decimating pixels or lines of pixels; based on inserting pixels or lines of pixels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Radiation Pyrometers (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to a method, a device, equipment, a system and a computer-readable medium for registering polarized images of different fields of view, wherein the method comprises the following steps: registering the infrared radiation images with different visual fields and different wave bands, which are acquired in the corresponding rotating polarization directions; calculating infrared polarization information images of different wavebands based on the registered infrared radiation images and registering; and fusing the registered infrared polarization information images in different wave bands to obtain a fused image, and performing target identification based on the fused image. The invention provides a registration method of polarized images of different fields based on radiation image registration, which can overcome the difference of infrared polarization characteristics of targets in different wave band ranges and the polarization information errors possibly introduced by the fusion of the polarization information of different field detectors, and improves the identification accuracy based on the edge contour polarization characteristics of the targets.
Description
Technical Field
The present invention relates to the field of polarization information image fusion, and in particular, to a method, apparatus, device, system, and computer readable storage medium for registering polarized images of different fields of view based on radiation image registration.
Background
The infrared polarized image improves the object detection capability mainly through the detailed characteristics of the outline, the edge and the like of the object. Theoretical analysis and experiments show that the infrared polarization characteristic of the target surface is related to the detection wavelength and is not a fixed value. Typical target surface polarization characteristics are generally not the same across different bands. In view of the difference of the infrared polarization characteristics of the target surface in different wave bands, in order to improve the identification accuracy of the polarization characteristics based on the edge profile of the target, an infrared polarization information fusion method needs to be studied. For the fusion of the infrared polarization information of different wave bands of the same view field, the main problem to be solved is the registration problem of targets in the polarization information, and for the fusion of the infrared polarization information of different wave bands of different view fields, the influence of the change of edge details caused by the interpolation of the polarization information images of different view fields on the polarization characteristics of the surfaces of the targets needs to be considered.
Since interpolation registration of polarized images of different fields of view can lead to sharpening of edge contour details of a target, polarization information errors are artificially introduced by image processing.
Disclosure of Invention
The invention aims at solving the technical problems of the prior art and provides a registration method, a registration device, a registration equipment, a registration system and a registration system for polarized images with different fields of view and a computer readable storage medium, which improve the accuracy of target identification detection based on infrared polarized profile characteristics of a target surface.
To solve the above technical problem, a first aspect of the present invention provides a registration method for polarized images of different fields of view, the method comprising the steps of:
registering the infrared radiation images with different visual fields and different wave bands, which are acquired in the corresponding rotating polarization directions;
calculating infrared polarization information images of different wavebands based on the registered infrared radiation images and registering;
and fusing the registered infrared polarization information images in different wave bands to obtain a fused image, and performing target identification based on the fused image.
In the method for registering polarized images of different fields of view according to the present invention, preferably, registering the infrared radiation images of different fields of view and different bands of wavelengths, which correspond to the rotation polarization directions, includes:
based on an infrared polarization imaging measurement device, acquiring an infrared radiation image I of a target scene with rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG through a rotation polaroid 0° 、I 45° 、I 90° 、I 135° ；
Interpolation is carried out on the infrared radiation image with low resolution by using an image interpolation method, so that the resolution of the infrared radiation image with low resolution is improved to be the same as the resolution of the infrared radiation image with different view fields corresponding to the rotation polarization directions;
extracting invariant features in the corresponding two long-wave infrared radiation images and the middle-wave infrared radiation image with the same rotation polarization direction by using a feature-based registration method, and completing registration of the two infrared radiation images based on the invariant features.
In the registration method of polarized images of different fields of view according to the present invention, preferably, the calculating and registering the infrared polarized information images of different wavebands based on the registered infrared radiation images includes:
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
edge extraction is carried out on the infrared polarization information image, and edge linear characteristics of targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image are extracted; and carrying out autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current wave band according to the peak value occurrence position, and carrying out translation adjustment on the infrared polarization information image of the other wave band according to the two-dimensional offset so as to realize the registration of the infrared polarization information images of different wave bands.
In the registration method of polarized images of different fields of view according to the present invention, preferably, the calculating the infrared polarized information images of different wavebands based on the registered infrared radiation images includes:
calculating Stokes parametric images based on the registered infrared radiation images:
wherein I' 0° 、I' 90° 、I' 45° And I' 135° Infrared radiation images with the rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG after registration are respectively; s is S 0 、S 1 、S 2 And S is 3 Representing Stokes parameters S 0 Image, S 1 Image, S 2 Image and S 3 An image; i RCP And I LCP Respectively representing right-hand and left-hand circular polarization;
and calculating based on Stokes parameter images to obtain an infrared polarization information image of the surface of the measured object:
where p is the degree of polarization and α is the angle of polarization.
In a second aspect of the present invention, there is provided a different field of view polarized image registration apparatus comprising:
the infrared radiation image registration unit is used for registering the infrared radiation images of different visual fields and different wave bands, which are acquired in the corresponding rotation polarization directions;
the polarization information image registration unit is used for calculating infrared polarization information images of different wave bands based on the registered infrared radiation images and registering the infrared polarization information images;
the target recognition unit is used for fusing the registered infrared polarization information images in different wave bands to obtain a fused image, and performing target recognition based on the fused image.
In the different field of view polarized image registration apparatus according to the present invention, preferably, the infrared radiation image registration unit performs registration by:
based on an infrared polarization imaging measurement device, acquiring an infrared radiation image I of a target scene with rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG through a rotation polaroid 0° 、I 45° 、I 90° 、I 135° ；
Interpolation is carried out on the infrared radiation image with low resolution by using an image interpolation method, so that the resolution of the infrared radiation image with low resolution is improved to be the same as the resolution of the infrared radiation image with different view fields corresponding to the rotation polarization directions;
extracting invariant features in the corresponding two long-wave infrared radiation images and the middle-wave infrared radiation image with the same rotation polarization direction by using a feature-based registration method, and completing registration of the two infrared radiation images based on the invariant features.
In the different field-of-view polarized image registration apparatus according to the present invention, preferably, the polarized information image registration unit performs registration by:
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
edge extraction is carried out on the infrared polarization information image, and edge linear characteristics of targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image are extracted; and carrying out autocorrelation calculation on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current wave band according to the peak value occurrence position, and carrying out translation adjustment on the infrared polarization information image of the other wave band according to the two-dimensional offset so as to realize registration of the infrared polarization information images of different wave bands.
In a third aspect of the present invention, there is provided a different field of view polarized image registration apparatus comprising: at least one processor, at least one memory and a computer program stored in the memory, characterized in that the computer program implements the method as described before when being executed by the processor.
In a fourth aspect of the invention, there is provided a different field of view polarized image registration system comprising a different field of view polarized image registration apparatus as described above and at least two infrared polarized imaging measurement devices connected thereto.
In a fifth aspect of the invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method as described above.
The method, the device, the equipment, the system and the computer readable storage medium for registering polarized images with different fields of view have the following beneficial effects: the method mainly considers the difference of infrared polarization characteristics of targets in different wave band ranges and the possible polarization information errors possibly introduced by the fusion of polarization information of different view field detectors, and proposes that the infrared radiation images acquired by the different view field detectors are registered firstly, then the infrared polarization information images of corresponding wave bands are solved, and finally the registration of the infrared polarization information images of different wave bands is completed, so that an effective infrared polarization information fusion image is acquired.
Drawings
FIGS. 1a and 1b are unbiased infrared radiation images of an infrared standard plate in the mid-wave band and the long-wave band, respectively;
FIGS. 2a and 2b are images of infrared polarization information of an infrared standard plate in the mid-wave band and the long-wave band, respectively;
FIG. 3 is a flow chart of a method of registration of polarized images of different fields of view in accordance with a preferred embodiment of the present invention;
FIG. 4 is a fused image processed by the different field of view polarized image registration method according to the present invention;
fig. 5 is a block diagram of a different field of view polarized image registration apparatus in accordance with a preferred embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The invention firstly analyzes the infrared polarization information difference of the target material as follows:
for opaque radiation targets, the radiation at their surface consists mainly of background reflection and self-radiation. From the infrared polarized imaging radiation transmission model, it is known that for an opaque radiation object, the Stokes vector S before it is incident on the polarizing device in Expressed as:
S in ＝S r +S e ＝∫f(θ i ,φ i ,θ r ,φ r ,λ)cos(θ r )dΩ r ·S i +ε surf ·I obj (1)
s in r For reflecting Stokes vectors for objects, S e For self-radiating Stokes vector, θ i For incident zenith angle, θ r For reflecting zenith angle phi i For incident azimuth angle phi r Is the reflection azimuth angle, lambda is the detection wavelength, f (θ i ,φ i ,θ r ,φ r Lambda) is the bi-directional reflectance distribution function (BRDF), epsilon surf For the surface emissivity of the material, I obj DΩ for the target radiation intensity i Is the solid angle of incidence. The transmission relation of incident radiation to reflected radiation is represented by a Fresnel reflection Muller matrix and a BRDF model based on the micro-bin theory, and the Stokes vector S of an incident interface is used i Can obtain reflected Stokes vector S r Can be expressed as:
wherein the method comprises the steps of
Respectively representing the reflected Stokes parameters, ">
Respectively represent the incident Stokes parameters, the parameters S 0 Is related to the intensity of the incident light; s is S 1 Correlating with linear polarization information in the 0 ° and 90 ° directions; s is S 2 Correlating with linear polarization information in 45 ° and 135 ° directions; s is S 3 Is related to the left-handed and right-handed circular polarization informationClose, f 00 、f 01 、f 02 、f 03 、f 10 、f 11 、f 12 、f 13 、f 20 、f 21 、f 22 、f 23 、f 30 、f 31 、f 32 、f 33 To obtain the corresponding value of the polarized BRDF model by the action of scalar BRDF function and 4×4 Muller matrix M.
For opaque radiation target surfaces, where the radiation received by infrared polarized imaging typically includes radiation of the scene and reflection from other radiation sources, the total radiance of the target surface can be expressed as:
L tol ＝L e +L r ＝L B ·ε surf +∫f(θ i ,φ i ,θ r ,φ r ,λ)·L(θ i ,φ i λ)cos(θ i )dΩ i (3)
wherein L is e For the self-radiation brightness of the target L r For reflecting the radiation brightness of the target surface, L B For blackbody radiation luminance corresponding to the spectral radiation luminance of the target, L (θ i ,φ i λ) is the incident radiance.
Since the incident radiation is thermal radiation at the same temperature as the surface, the total radiation is blackbody radiation at the same temperature, i.e
L B ·ε 0 ＝L B ·ε surf +∫f(θ i ,φ i ,θ r ,φ r ,λ)×L B ·ε 0 cos(θ i )dΩ i (4)
Wherein ε is 0 E is the blackbody emissivity vector 0 ＝(1,0,0,0) T 。
The expression of the polarized radiation emissivity of the surface of the target material can be obtained by the expression (4):
from this, it can be seen that the Stokes vector S of the self-radiation of the target material surface e Can be expressed as: s is S e ＝ε surf ·I obj Wherein I obj Is the radiation intensity of the target. Then formula (1) can be expressed as:
wherein S is 0 、S 1 、S 2 And S is 3 Representing Stokes parameters S 0 Image, S 1 Image, S 2 Image and S 3 An image. I bg Is the background radiation intensity.
The polarization degree calculation expression based on the infrared radiation polarization transmission model can be deduced from the expression (6) and the definition of the polarization degree, and is as follows:
from equation (7), it is known that the infrared polarization characteristic of the target material surface is closely related to the detection wavelength.
Please refer to fig. 1a and 1b, which are respectively an unbiased infrared radiation image of an infrared standard board in a middle wave band and a long wave band. Fig. 2a and 2b are images of infrared polarization information of an infrared standard plate in the medium-wave band and the long-wave band, respectively. As can be seen from the figure: the difference of the detailed information such as the edge of the infrared standard plate, the edge contour of the test supporting table and the like in the middle-wave and long-wave infrared polarization information images is obvious. Wherein the long-wave infrared polarization characteristics of the edge profile of the infrared standard plate in fig. 2b are clearer than those of the infrared standard plate in fig. 2a, and the medium-wave infrared polarization characteristics of the edge profile of the test support in fig. 2a are clearer than those of the long-wave infrared polarization characteristics in fig. 2 b.
In addition, in the infrared polarization imaging test process, as the resolution of infrared polarization information images in different wave bands can be different due to the fact that the fields of view of equipment are different, the infrared polarization information images acquired by infrared polarization imaging measuring devices which are different field of view detectors need to be registered. In view of the characteristic that the infrared polarization information image can highlight the edge contour feature of the target, if the calculated polarization information infrared polarization information image is directly subjected to difference matching, a polarization information error is introduced in the calculation process, so that the fused polarization image can not effectively reflect the infrared polarization feature of the target surface. To solve this problem, the infrared radiation images acquired by the different field-of-view detectors corresponding to the rotation direction of the polarizing wire grid need to be registered first. Therefore, the invention provides a registration method of polarized images of different fields of view based on radiation image registration, so as to improve the accuracy of target identification detection based on infrared polarized profile characteristics of a target surface.
Referring to fig. 3, a flowchart of a method for registering polarized images of different fields of view according to a preferred embodiment of the present invention is shown. As shown in fig. 3, this embodiment provides a different field of view polarized image registration method comprising the steps of:
first, in step S1, an infrared radiation image registration step is performed to register infrared radiation images of different fields of view and different bands of wavelengths acquired in corresponding rotational polarization directions.
Preferably, the step S1 further comprises the following specific steps:
(1) Based on an infrared polarization imaging measurement device, acquiring an infrared radiation image I of a target scene with rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG through a rotation polaroid 0° 、I 45° 、I 90° 、I 135° . The invention can be provided with at least two infrared polarization imaging measuring devices, including an infrared polarization imaging measuring device for collecting long-wave infrared radiation images and an infrared polarization imaging measuring device for collecting medium-wave infrared radiation images. The fields of view of these infrared polarized imaging measurement devices may be different, forming different field of view detectors. The long wave refers to the wavelength of 8-12 mu m, and the medium wave refers to the wavelength of 3-5 mu m. Each infrared polarization imaging measuring device can acquire infrared radiation images I of target scenes with the rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG through the rotation polaroid 0° 、I 45° 、I 90° 、I 135° 。
(2) The image interpolation method is used for interpolating the infrared radiation image with low resolution, and the resolution of the infrared radiation image with low resolution is improved, so that the infrared radiation image with low resolution is identical with the resolution of the infrared radiation image with different fields of view corresponding to the rotation polarization directions. The image interpolation method includes, but is not limited to: nearest neighbor interpolation, bilinear interpolation, bicubic interpolation. Since the fields of view of the infrared polarized imaging measurement devices of different wavebands may be different, the resolution of the infrared radiation image obtained after selecting the target area may be different. In order to correct this field of view error in this step, the resolution of all acquired infrared radiation images is made the same by interpolation. (3) Extracting invariant features in the corresponding two long-wave infrared radiation images and the middle-wave infrared radiation image with the same rotation polarization direction by using a feature-based registration method, and completing registration of the long-wave infrared radiation image and the middle-wave infrared radiation image based on the invariant features. For example, a long-wave infrared radiation image and a medium-wave infrared radiation image with rotation polarization directions of 0 degrees are selected, and invariant features are extracted and registered by the feature-based registration method. These invariant features refer to features that remain unchanged with respect to rotation, scale, translation, illumination, etc. This step may be implemented by using specific algorithms well known and applicable to those skilled in the art, and will not be described in detail herein.
Subsequently, in step S2, a polarization information image registration step is performed, and infrared polarization information images of different wavelength bands are calculated based on the registered infrared radiation images and registered. In step S1, an infrared radiation image I of a target scene with 0 °, 45 °, 90 ° and 135 ° rotational polarization directions for different bands and different fields of view is completed 0° 、I 45° 、I 90° 、I 135° After the corresponding registration, step S2 may be performed to perform the registration of the infrared polarization information image.
Preferably, the step S2 specifically includes the following steps:
(1) Calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images, and the method specifically comprises the following steps of:
a. calculating Stokes parametric images based on the registered infrared radiation images:
wherein I' 0° 、I' 90° 、I' 45° And I' 135° Infrared radiation images with the rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG after registration are respectively; s is S 0 、S 1 、S 2 And S is 3 Representing Stokes parameters S 0 Image, S 1 Image, S 2 Image and S 3 An image; i RCP And I LCP Respectively right-hand and left-hand circular polarization.
b. And calculating based on Stokes parameter images to obtain an infrared polarization information image of the surface of the measured object:
where p is the degree of polarization and α is the angle of polarization. The infrared polarization information image of the surface of the measured object can be obtained by calculation of Stokes parameter images through the formula, the range of the known polarization angle is [ -pi/2, pi/2 ], and the degree of polarization represents a dimensionless number from 0 to 1; the polarization angle α represents the angle of the polarization direction of the incident light with respect to the x-axis, and for some polarized light, the polarization direction with the greatest energy is the angle with respect to the x-axis.
(2) And extracting the edge linear characteristics of the targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image.
(3) And carrying out autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current wave band according to the peak value occurrence position, and carrying out translation adjustment on the infrared polarization information image of the other wave band according to the two-dimensional offset so as to realize the registration of the infrared polarization information images of different wave bands. For example, the long-wave infrared polarization information image is subjected to translational modulation with the medium-wave infrared polarization information image as a reference, or the medium-wave infrared polarization information image is subjected to translational modulation with the long-wave infrared polarization information image as a reference.
Finally, in step S3, a target recognition step is performed, the registered infrared polarization information images in different wavebands are fused to obtain a fused image, and target recognition is performed based on the fused image. In this step, the long-wave infrared polarization information image and the medium-wave infrared polarization information image can be fused by using an image fusion method which is well known and can be applied by those skilled in the art. Please refer to fig. 4, which is a fused image processed by the registration method of polarized images of different fields of view according to the present invention. According to the image, the method can effectively keep the polarization detail characteristics such as the edge contour information of the target in the fusion image based on the radiation image registration mode, and is beneficial to the perception of scenes and the identification of the target.
Based on the same inventive concept, the embodiment of the invention also provides a registration device for polarized images with different fields of view. Referring to fig. 5, a block diagram of a registration apparatus for polarized images of different fields of view according to a preferred embodiment of the present invention is shown. As shown in fig. 5, the apparatus 500 provided in this embodiment includes: an infrared radiation image registration unit 501, a polarization information image registration unit 502, and an object recognition unit 503.
An infrared radiation image registration unit 501 is configured to register infrared radiation images of different fields of view and different bands of wavelengths, which are acquired in corresponding rotational polarization directions.
Preferably, the infrared radiation image registration unit 501 performs registration by:
(1) Based on an infrared polarization imaging measurement device, acquiring an infrared radiation image I of a target scene with rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG through a rotation polaroid 0° 、I 45° 、I 90° 、I 135° ；
(2) Interpolation is carried out on the infrared radiation image with low resolution by using an image interpolation method, so that the resolution of the infrared radiation image with low resolution is improved to be the same as the resolution of the infrared radiation image with different view fields corresponding to the rotation polarization directions;
(3) Extracting invariant features in the corresponding two long-wave infrared radiation images and the middle-wave infrared radiation image with the same rotation polarization direction by using a feature-based registration method, and completing registration of the two infrared radiation images based on the invariant features.
And a polarization information image registration unit 502, configured to calculate and register infrared polarization information images of different wavebands based on the registered infrared radiation images.
Preferably, the polarization information image registration unit 502 performs registration by:
(1) Calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
(2) Edge extraction is carried out on the infrared polarization information image, and edge linear characteristics of targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image are extracted; (3) And carrying out autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current wave band according to the peak value occurrence position, and carrying out translation adjustment on the infrared polarization information image of the other wave band according to the two-dimensional offset so as to realize the registration of the infrared polarization information images of different wave bands.
The target recognition unit 503 is configured to fuse the registered infrared polarized information images in different wavebands to obtain a fused image, and perform target recognition based on the fused image.
The embodiment of the invention also provides equipment for executing the registration method of polarized images of different fields of view, which comprises the following steps: at least one processor, at least one memory, and a computer program stored in the memory, which when executed by the processor, implements the different field of view polarized image registration method as in the above embodiments.
The embodiment of the invention provides a registration system for polarized images with different fields of viewComprising a different field of view polarized image registration apparatus as described previously and at least two infrared polarized imaging measurement devices connected thereto. These infrared polarization imaging measurement devices include infrared polarization imaging measurement devices for acquiring long wave infrared radiation images and infrared polarization imaging measurement devices for acquiring mid wave infrared radiation images. The fields of view of these infrared polarized imaging measurement devices may be different. Each infrared polarization imaging measuring device can acquire an infrared radiation image I of a target scene with the rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG through the rotation polaroid 0° 、I 45° 、I 90° 、I 135° 。
Embodiments of the present invention provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method of registration of polarized images of different fields of view as in the above embodiments.
According to the invention, theoretical analysis verifies that the target surface has differences in polarization characteristics in different detection wave band ranges, and the image fusion of polarization information in different wave bands can enhance the detailed information such as the target surface profile. Therefore, the method aims at the registration problem in the polarization information image fusion obtained through different field-of-view detectors, and provides the method for carrying out image fusion through registering the infrared radiation images and further obtaining the polarized images with the same resolution through resolving, so that the problem of edge feature confusion generated in the polarization solving process can be solved.
It should be understood that the principles of the method and apparatus for registering polarized images of different fields of view are the same, so that the detailed description of the embodiment of the method for registering polarized images of different fields of view is also applicable to the apparatus for registering polarized images of different fields of view.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (6)
1. A method for registration of polarized images of different fields of view, the method comprising the steps of:
registering the infrared radiation images with different visual fields and different wave bands, which are acquired in the corresponding rotating polarization directions;
calculating infrared polarization information images of different wavebands based on the registered infrared radiation images and registering;
fusing the registered infrared polarization information images in different wave bands to obtain a fused image, and carrying out target recognition based on the fused image;
registering the infrared radiation images of the corresponding rotation polarization directions acquired by different view fields and different wave bands, comprising:
based on an infrared polarization imaging measurement device, acquiring an infrared radiation image I of a target scene with rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG through a rotation polaroid 0° 、I 45° 、I 90° 、I 135° ；
Interpolation is carried out on the infrared radiation image with low resolution by using an image interpolation method, so that the resolution of the infrared radiation image with low resolution is improved to be the same as the resolution of the infrared radiation image with different view fields corresponding to the rotation polarization directions;
extracting invariant features in two corresponding long-wave infrared radiation images and a middle-wave infrared radiation image with the same rotation polarization direction by using a feature-based registration method, and completing registration of the two infrared radiation images based on the invariant features;
the method for calculating and registering the infrared polarization information images of different wave bands based on the registered infrared radiation images comprises the following steps:
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
performing edge extraction on the infrared polarization information image, and respectively extracting edge linear characteristics of a target in the long-wave infrared polarization information image and the medium-wave infrared polarization information image;
and carrying out autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current wave band according to the peak value occurrence position, and carrying out translation adjustment on the infrared polarization information image of the other wave band according to the two-dimensional offset so as to realize the registration of the infrared polarization information images of different wave bands.
2. The method of registration of polarized images of different fields of view according to claim 1, wherein the calculating the infrared polarized information images of different wavebands based on the registered infrared radiation images comprises:
calculating Stokes parametric images based on the registered infrared radiation images:
wherein I' 0° 、I' 90° 、I' 45° And I' 135° Infrared radiation images with the rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG after registration are respectively; s is S 0 、S 1 、S 2 And S is 3 Representing Stokes parameters S 0 Image, S 1 Image, S 2 Image and S 3 An image; i RCP And I LCP Respectively representing right-hand and left-hand circular polarization;
and calculating based on Stokes parameter images to obtain an infrared polarization information image of the surface of the measured object:
where p is the degree of polarization and α is the angle of polarization.
3. A different field of view polarized image registration apparatus comprising:
the infrared radiation image registration unit is used for registering the infrared radiation images of different visual fields and different wave bands, which are acquired in the corresponding rotation polarization directions;
the polarization information image registration unit is used for calculating infrared polarization information images of different wave bands based on the registered infrared radiation images and registering the infrared polarization information images;
the target recognition unit is used for fusing the registered infrared polarization information images in different wave bands to obtain a fused image and carrying out target recognition based on the fused image;
the infrared radiation image registration unit registers by:
based on an infrared polarization imaging measurement device, acquiring an infrared radiation image I of a target scene with rotation polarization directions of 0 DEG, 45 DEG, 90 DEG and 135 DEG through a rotation polaroid 0° 、I 45° 、I 90° 、I 135° ；
Interpolation is carried out on the infrared radiation image with low resolution by using an image interpolation method, so that the resolution of the infrared radiation image with low resolution is improved to be the same as the resolution of the infrared radiation image with different view fields corresponding to the rotation polarization directions;
extracting invariant features in two corresponding long-wave infrared radiation images and a middle-wave infrared radiation image with the same rotation polarization direction by using a feature-based registration method, and completing registration of the two infrared radiation images based on the invariant features;
the polarization information image registration unit performs registration by:
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
edge extraction is carried out on the infrared polarization information image, and edge linear characteristics of targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image are extracted; and carrying out autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current wave band according to the peak value occurrence position, and carrying out translation adjustment on the infrared polarization information image of the other wave band according to the two-dimensional offset so as to realize the registration of the infrared polarization information images of different wave bands.
4. A different field of view polarized image registration apparatus comprising: at least one processor, at least one memory and a computer program stored in the memory, characterized in that the method according to claim 1 or 2 is implemented when the computer program is executed by the processor.
5. A different field of view polarized image registration system comprising the different field of view polarized image registration apparatus of claim 4 and at least two infrared polarized imaging measurement devices connected thereto.
6. A computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of claim 1 or 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010506431.0A CN111667519B (en) | 2020-06-05 | 2020-06-05 | Registration method and device for polarized images with different fields of view |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010506431.0A CN111667519B (en) | 2020-06-05 | 2020-06-05 | Registration method and device for polarized images with different fields of view |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111667519A CN111667519A (en) | 2020-09-15 |
| CN111667519B true CN111667519B (en) | 2023-06-20 |
Family
ID=72386861
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010506431.0A Active CN111667519B (en) | 2020-06-05 | 2020-06-05 | Registration method and device for polarized images with different fields of view |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111667519B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112163587A (en) * | 2020-09-30 | 2021-01-01 | 北京环境特性研究所 | Feature extraction method and device of target object and computer readable medium |
| CN113506330A (en) * | 2021-07-29 | 2021-10-15 | 北京环境特性研究所 | Different-waveband polarization angle image fusion method based on multi-scale transformation |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB9321711D0 (en) * | 1992-11-03 | 1993-12-15 | Israel State | Method and apparatus for simulating infra-red images and simulated infra-red images obrained therefrom |
| CN104103073A (en) * | 2014-07-14 | 2014-10-15 | 中国人民解放军国防科学技术大学 | Infrared polarization image edge detection method |
| CN106289542A (en) * | 2016-07-26 | 2017-01-04 | 北京理工大学 | A kind of radiation correction method of preposition polaroid type infrared polarization imaging system |
| CN108460750A (en) * | 2018-04-03 | 2018-08-28 | 中国人民解放军国防科技大学 | Long-wave infrared image enhancement method for ship target under water surface background |
| CN109253802A (en) * | 2017-07-13 | 2019-01-22 | 南京理工大学 | A kind of multispectral polarization synchronous of bionic navigation and method |
| CN109632102A (en) * | 2019-02-26 | 2019-04-16 | 北京环境特性研究所 | Infrared polarization image measuring device based on rotatory polarization piece |
| CN110869976A (en) * | 2018-12-04 | 2020-03-06 | 深圳市大疆创新科技有限公司 | Image processing method, device, unmanned aerial vehicle, system and storage medium |
-
2020
- 2020-06-05 CN CN202010506431.0A patent/CN111667519B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB9321711D0 (en) * | 1992-11-03 | 1993-12-15 | Israel State | Method and apparatus for simulating infra-red images and simulated infra-red images obrained therefrom |
| CN104103073A (en) * | 2014-07-14 | 2014-10-15 | 中国人民解放军国防科学技术大学 | Infrared polarization image edge detection method |
| CN106289542A (en) * | 2016-07-26 | 2017-01-04 | 北京理工大学 | A kind of radiation correction method of preposition polaroid type infrared polarization imaging system |
| CN109253802A (en) * | 2017-07-13 | 2019-01-22 | 南京理工大学 | A kind of multispectral polarization synchronous of bionic navigation and method |
| CN108460750A (en) * | 2018-04-03 | 2018-08-28 | 中国人民解放军国防科技大学 | Long-wave infrared image enhancement method for ship target under water surface background |
| CN110869976A (en) * | 2018-12-04 | 2020-03-06 | 深圳市大疆创新科技有限公司 | Image processing method, device, unmanned aerial vehicle, system and storage medium |
| CN109632102A (en) * | 2019-02-26 | 2019-04-16 | 北京环境特性研究所 | Infrared polarization image measuring device based on rotatory polarization piece |
Non-Patent Citations (1)
| Title |
|---|
| 自适应多波段偏振图像融合研究;赵永强;潘泉;张洪才;;光子学报(第07期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111667519A (en) | 2020-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108492274B (en) | Long-wave infrared polarization feature extraction and fusion image enhancement method | |
| US10129490B2 (en) | Systems and approaches for thermal image corrections | |
| CN111667519B (en) | Registration method and device for polarized images with different fields of view | |
| US11068700B2 (en) | Polarization imaging for facial recognition enhancement system and method | |
| US9741163B2 (en) | 3-D polarimetric imaging using a microfacet scattering model to compensate for structured scene reflections | |
| CN105701827B (en) | The parametric joint scaling method and device of Visible Light Camera and infrared camera | |
| JP4015944B2 (en) | Method and apparatus for image mosaicking | |
| AU2011242408B2 (en) | Shape and photometric invariants recovery from polarisation images | |
| CN111667516A (en) | Infrared polarization information fusion method based on Laplacian pyramid decomposition structure | |
| AU2011242408A1 (en) | Shape and photometric invariants recovery from polarisation images | |
| CN110462679B (en) | Rapid multispectral light field imaging method and system | |
| CN104318550A (en) | Eight-channel multi-spectral imaging data processing method | |
| Lavigne et al. | A new fusion algorithm for shadow penetration using visible and midwave infrared polarimetric images | |
| CN115468654A (en) | Method for acquiring polarization difference characteristic image under optimal angle | |
| CN108291742A (en) | Calibrate the heliostat of thermoelectricity solar power plant | |
| CN111667517A (en) | Infrared polarization information fusion method and device based on wavelet packet transformation | |
| KR20200016507A (en) | Method and Apparatus for Synthesizing Image | |
| CN109377476A (en) | The dynamic threshold acquisition methods and device of remote sensing image cloud detection characteristic parameter | |
| CN109035362B (en) | Cold reflection eliminating method based on cold reflection intensity model | |
| Lavigne et al. | A new passive polarimetric imaging system collecting polarization signatures in the visible and infrared bands | |
| Wang et al. | A new image registration method for infrared images and visible images | |
| Adler-Golden et al. | Atmospheric correction of commercial thermal infrared hyperspectral imagery using FLAASH-IR | |
| CN111339848B (en) | Method and device for identifying artificial target in natural environment | |
| Xiang et al. | MTF measurement and imaging quality evaluation of digital camera with slanted-edge method | |
| Špiclin et al. | Geometrical calibration of an AOTF hyper-spectral imaging system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |