CN111667519A - Registration method and device for polarized images with different fields of view - Google Patents
Registration method and device for polarized images with different fields of view Download PDFInfo
- Publication number
- CN111667519A CN111667519A CN202010506431.0A CN202010506431A CN111667519A CN 111667519 A CN111667519 A CN 111667519A CN 202010506431 A CN202010506431 A CN 202010506431A CN 111667519 A CN111667519 A CN 111667519A
- Authority
- CN
- China
- Prior art keywords
- infrared
- image
- images
- polarization
- different
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000010287 polarization Effects 0.000 claims abstract description 242
- 230000005855 radiation Effects 0.000 claims abstract description 128
- 238000003384 imaging method Methods 0.000 claims description 24
- 238000005259 measurement Methods 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 10
- 238000013519 translation Methods 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 6
- 230000004927 fusion Effects 0.000 abstract description 11
- 238000001514 detection method Methods 0.000 description 7
- 239000013077 target material Substances 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000005457 Black-body radiation Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000007500 overflow downdraw method Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000005315 distribution function Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4023—Scaling of whole images or parts thereof, e.g. expanding or contracting based on decimating pixels or lines of pixels; based on inserting pixels or lines of pixels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Radiation Pyrometers (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to a method, a device, equipment, a system and a computer-storable medium for registering polarized images of different fields of view, wherein the method comprises the following steps: registering infrared radiation images of corresponding rotation polarization directions acquired from different fields of view and different wave bands; calculating infrared polarization information images of different wave bands based on the registered infrared radiation images and registering; and fusing the registered infrared polarization information images of different wave bands to obtain a fused image, and identifying the target based on the fused image. The invention provides a method for registering polarization images of different fields of view based on radiation image registration, which can overcome the difference of infrared polarization characteristics of a target in different wave band ranges and polarization information errors possibly introduced by the polarization information fusion of detectors of different fields of view, and improve the identification accuracy based on the edge contour polarization characteristics of the target.
Description
Technical Field
The invention relates to the field of polarization information image fusion, in particular to a method, a device, equipment, a system and a computer readable storage medium for registering polarization images with different fields of view based on radiation image registration.
Background
The infrared polarization image mainly improves the target detection capability through the detail characteristics of the contour, the edge and the like of the target. Theoretical analysis and experiments show that the infrared polarization characteristic of the target surface is related to the detection wavelength and is not a fixed value. Typical target surface polarization characteristics are generally not the same at different wavebands. In view of the difference of the infrared polarization characteristics of the target surface in different wave bands, in order to improve the identification accuracy based on the target edge profile polarization characteristics, an infrared polarization information fusion method needs to be researched. For the fusion of infrared polarization information of different wave bands of the same field of view, the main problem to be solved is the registration problem of a target in the polarization information, and for the fusion of infrared polarization information of different wave bands of different field of view, the influence of the change of edge details caused by the interpolation of polarization information images of different field of view on the polarization characteristic of the target surface needs to be considered.
Due to interpolation registration of polarized images of different fields of view, the edge contour details of the target are sharpened, and further polarization information errors are artificially introduced by image processing.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a method, an apparatus, a device, a system and a computer readable storage medium for registering polarized images of different fields of view, which improve the accuracy of target identification and detection based on infrared polarization profile characteristics of a target surface.
In order to solve the above technical problem, a first aspect of the present invention provides a method for registering polarization images of different fields of view, the method comprising the following steps:
registering infrared radiation images of corresponding rotation polarization directions acquired from different fields of view and different wave bands;
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images and registering;
and fusing the registered infrared polarization information images of different wave bands to obtain a fused image, and identifying the target based on the fused image.
In the method for registering polarization images of different fields of view according to the present invention, preferably, the registering infrared radiation images of different fields of view and different wavelength bands, which correspond to the rotation polarization directions, includes:
based on an infrared polarization imaging measurement device, an infrared radiation image I of a target scene with the rotation polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees is obtained through a rotation polaroid0°、I45°、I90°、I135°；
Interpolating the infrared radiation image with low resolution by using an image interpolation method, and improving the resolution of the infrared radiation image with low resolution to be the same as the resolution of the infrared radiation image with different rotating polarization directions corresponding to different fields of view;
and extracting invariant features in the two corresponding long-wave infrared radiation images and medium-wave infrared radiation images with the same rotation polarization direction by using a feature-based registration method, and finishing registration of the two infrared radiation images based on the invariant features.
In the method for registering polarization images of different fields of view according to the present invention, preferably, the calculating and registering infrared polarization information images of different wavebands based on the registered infrared radiation image includes:
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
performing edge extraction on the infrared polarization information image, and extracting edge linear characteristics of targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image; and performing autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current waveband according to the peak occurrence position, and performing translation adjustment on the infrared polarization information image of the other waveband according to the two-dimensional offset to realize registration of the infrared polarization information images of different wavebands.
In the method for registering polarization images of different fields of view according to the present invention, preferably, the calculating infrared polarization information images of different bands based on the registered infrared radiation images includes:
calculating a Stokes parameter image based on the registered infrared radiation image:
wherein, I'0°、I'90°、I'45°And l'135°Respectively registered infrared radiation images with the rotation polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees; s0、S1、S2And S3Representing Stokes parameters S0Image, S1Image, S2Image sum S3An image; i isRCPAnd ILCPRespectively representing right-hand and left-hand circular polarization;
calculating and obtaining an infrared polarization information image of the surface of the measured target based on the Stokes parameter image:
where p is the degree of polarization and α is the angle of polarization.
In a second aspect of the present invention, there is provided a device for registering polarized images of different fields of view, comprising:
the infrared radiation image registration unit is used for registering infrared radiation images in corresponding rotation polarization directions acquired by different fields of view and different wave bands;
the polarization information image registration unit is used for calculating infrared polarization information images of different wave bands based on the registered infrared radiation images and registering the infrared polarization information images;
and the target identification unit is used for fusing the registered infrared polarization information images of different wave bands to obtain a fused image and identifying a target based on the fused image.
In the different-field-of-view polarization image registration apparatus according to the present invention, preferably, the infrared radiation image registration unit performs registration by:
based on an infrared polarization imaging measurement device, an infrared radiation image I of a target scene with the rotation polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees is obtained through a rotation polaroid0°、I45°、I90°、I135°；
Interpolating the infrared radiation image with low resolution by using an image interpolation method, and improving the resolution of the infrared radiation image with low resolution to be the same as the resolution of the infrared radiation image with different rotating polarization directions corresponding to different fields of view;
and extracting invariant features in the two corresponding long-wave infrared radiation images and medium-wave infrared radiation images with the same rotation polarization direction by using a feature-based registration method, and finishing registration of the two infrared radiation images based on the invariant features.
In the different-field-of-view polarization image registration apparatus according to the present invention, preferably, the polarization information image registration unit performs registration by:
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
performing edge extraction on the infrared polarization information image, and extracting edge linear characteristics of targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image; and performing autocorrelation calculation on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current waveband according to the position of the peak value, and performing translation adjustment on the infrared polarization information image of the other waveband according to the two-dimensional offset to realize registration of the infrared polarization information images of different wavebands.
In a third aspect of the present invention, there is provided a polarized image registration apparatus for different fields of view, comprising: at least one processor, at least one memory and a computer program stored in the memory, characterized in that the computer program realizes the method as described before when the computer program is executed by the processor.
In a fourth aspect of the present invention, there is provided a different field of view polarized image registration system, which includes the different field of view polarized image registration apparatus as described above and at least two infrared polarization imaging measurement devices connected thereto.
In a fifth aspect of the invention, a computer-readable storage medium is provided, on which a computer program is stored, which, when being executed by a processor, carries out the method as set forth above.
The implementation of the method, the device, the equipment, the system and the computer readable storage medium for registering the polarization images with different fields of view has the following advantages: the invention mainly considers the difference of infrared polarization characteristics of a target in different wave band ranges and polarization information errors possibly introduced by the polarization information fusion of detectors in different field of view, and provides the method for registering infrared radiation images acquired by detectors in different field of view, further solving the infrared polarization information images of corresponding wave bands and finally completing the registration of the infrared polarization information images of different wave bands so as to acquire effective infrared polarization information fusion images.
Drawings
FIG. 1a and FIG. 1b are unbiased infrared radiation images of an infrared standard plate in a medium wave band and a long wave band, respectively;
FIGS. 2a and 2b are infrared polarization information images of an infrared standard plate in a medium wave band and a long wave band, respectively;
FIG. 3 is a flow chart of a method for registration of polarized images of different fields of view according to a preferred embodiment of the present invention;
FIG. 4 is a fused image processed according to the different field of view polarized image registration method of the present invention;
fig. 5 is a block diagram of a different field of view polarized image registration apparatus according to a preferred embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
The invention firstly analyzes the difference of the infrared polarization information of the target material as follows:
for an opaque radiation target, the radiation at its surface consists mainly of background reflections and self-radiation. According to the infrared polarization imaging radiation transmission model, the Stokes vector S of an opaque radiation object before the object is incident on a polarization deviceinExpressed as:
Sin＝Sr+Se＝∫f(θi,φi,θr,φr,λ)cos(θr)dΩr·Si+surf·Iobj(1)
in the formula SrAs target reflection Stokes vector, SeRadiating the Stokes vector, θ, for the target itselfiAt the angle of incidence zenith, θrTo reflect the zenith angle phiiIs the incident azimuth angle phirFor the reflection azimuth, λ is the detection wavelength, f (θ)i,φi,θr,φrλ) is the Bidirectional Reflectance Distribution Function (BRDF),surfis the surface emissivity of the material, Iobjd.OMEGA.for target radiation intensityiIs the angle of incidence. Expressing the transmission relation from incident radiation to reflected radiation by using a Fresnel reflection Muller matrix and a BRDF model based on micro-surface element theory, and according to the Stokes vector S of an incident interfaceiThe Stokes vector S of the reflection can be obtainedrCan be expressed as:
wherein
Respectively, represent the reflected Stokes parameters,
respectively representing the incident Stokes parameter, parameter S0Is related to the incident light intensity; s1Linear polarization information associated with the 0 ° and 90 ° directions; s2Linear polarization information associated with 45 ° and 135 ° directions; s3Associated with left-handed and right-handed circular polarization information, f00、f01、f02、f03、f10、f11、f12、f13、f20、f21、f22、f23、f30、f31、f32、f33Is the corresponding value of the polarized BRDF model obtained by the action of the scalar BRDF function and the Muller matrix M of 4 × 4.
For an opaque radiation target surface, typically the radiation received by infrared polarized imaging includes radiation from the scene and reflections from other radiation sources, then the total radiance at the target surface can be expressed as:
Ltol＝Le+Lr＝LB·surf+∫f(θi,φi,θr,φr,λ)·L(θi,φiλ)cos(θi)dΩi(3)
wherein L iseIs the target's own radiance, LrIs the brightness of the reflected radiation of the target surface, LBIs the black body radiation brightness corresponding to the spectral radiation brightness of the target, L (theta)i,φiAnd λ) is the incident radiation brightness.
Since the incident radiation is thermal radiation at the same temperature as the surface, the total radiation is black body radiation at the same temperature, i.e.
LB·0＝LB·surf+∫f(θi,φi,θr,φr,λ)×LB·0cos(θi)dΩi(4)
Wherein0Is a vector of the radiation rate of the black body,0＝(1,0,0,0)T。
the expression of the surface polarized radiation emissivity of the target material obtained by the formula (4) is as follows:
therefore, the Stokes vector S of the self radiation of the target material surface can be knowneCan be expressed as: se＝surf·IobjIn which IobjIs the radiation intensity of the target. Then equation (1) can be expressed as:
wherein S0、S1、S2And S3Representing Stokes parameters S0Image, S1Image, S2Image sum S3And (4) an image. I isbgIs the background radiation intensity.
The calculation expression of the polarization degree based on the infrared radiation polarization transmission model can be derived from the definition of the formula (6) and the polarization degree:
from the equation (7), the infrared polarization characteristic of the target material surface is closely related to the detection wavelength.
Please refer to fig. 1a and fig. 1b, which are unbiased ir radiation images of the ir standard plate in the mid-wave band and the long-wave band, respectively. Fig. 2a and 2b are infrared polarization information images of the infrared standard plate in a medium wave band and a long wave band, respectively. As can be seen from the figure: the difference of detail information such as the edge of the infrared standard plate, the edge profile of the test support table and the like in the medium wave and long wave infrared polarization information images is obvious. Wherein the long wave infrared polarization characteristic of the edge profile of the infrared standard plate of FIG. 2b is more distinct than the medium wave infrared polarization characteristic of FIG. 2a, and the medium wave infrared polarization characteristic of the edge profile of the test support table of FIG. 2a is more distinct than the long wave infrared polarization characteristic of FIG. 2 b.
In addition, in the infrared polarization imaging test process, due to the fact that different fields of view of the devices used can cause differences in the resolution of infrared polarization information images of different wave bands, the infrared polarization information images acquired by detectors of different fields of view, namely the infrared polarization imaging measurement device, need to be registered. In view of the characteristic that the infrared polarization information image can highlight the edge contour features of the target, if the difference matching is directly performed on the polarization information infrared polarization information image obtained through calculation, polarization information errors are introduced in the calculation process, and the polarization image obtained through fusion cannot effectively reflect the infrared polarization features of the target surface. To solve this problem, it is necessary to register the infrared radiation images of the polarization wire grid corresponding to the rotation directions acquired by the detectors with different fields of view. Therefore, the invention provides a different-field polarization image registration method based on radiation image registration, so as to improve the accuracy of target identification and detection based on the infrared polarization contour characteristics of the target surface.
Referring to fig. 3, a flowchart of a method for registering polarization images of different fields of view according to a preferred embodiment of the invention is shown. As shown in fig. 3, the embodiment provides a method for registering polarization images of different fields of view, which comprises the following steps:
first, in step S1, an infrared radiation image registration step is performed to register infrared radiation images of corresponding rotational polarization directions acquired from different fields of view and different wavelength bands.
Preferably, the step S1 further includes the following specific steps:
(1) based on an infrared polarization imaging measurement device, an infrared radiation image I of a target scene with the rotation polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees is obtained through a rotation polaroid0°、I45°、I90°、I135°. The invention can be provided with at least two infrared polarization imaging measuring devices, including an infrared device for acquiring long-wave infrared radiation imagesThe device comprises a polarization imaging measuring device and an infrared polarization imaging measuring device used for collecting a medium wave infrared radiation image. The fields of view of these infrared polarization imaging measurement devices may be different, forming different field of view detectors. The long wave refers to the wavelength of 8-12 μm, and the medium wave refers to the wavelength of 3-5 μm. Each infrared polarization imaging measurement device can also acquire an infrared radiation image I of a target scene with the rotating polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees through the rotating polaroid0°、I45°、I90°、I135°。
(2) And interpolating the infrared radiation image with low resolution by using an image interpolation method, and improving the resolution of the infrared radiation image with low resolution so as to enable the infrared radiation image with low resolution to be the same as the infrared radiation images with different rotating polarization directions corresponding to different fields of view. The image interpolation method includes but is not limited to: nearest neighbor interpolation, bilinear interpolation, bicubic interpolation. Since the fields of view of the infrared polarization imaging measurement devices of different bands may be different, the resolution of the infrared radiation image obtained after selecting the target area may be different. In order to correct such a field error, the resolution of all the acquired infrared radiation images is made the same by interpolation. (3) And extracting invariant features in the two corresponding long-wave infrared radiation images and medium-wave infrared radiation images in the same rotation polarization direction by using a feature-based registration method, and finishing registration of the long-wave infrared radiation images and the medium-wave infrared radiation images based on the invariant features. For example, a long wave infrared radiation image and a medium wave infrared radiation image with rotation polarization directions of 0 degree are selected, and the invariant features are extracted and registered by using the feature-based registration method. These invariant features refer to features that remain invariant to rotation, scale, translation, and illumination, among others. This step can be implemented by using specific algorithms that are well known and applicable to those skilled in the art, and will not be described herein.
Subsequently, in step S2, a polarization information image registration step is performed, and infrared polarization information images of different wavelength bands are calculated based on the registered infrared radiation images and are registered. In step S1, the rotation polarization direction of different wave bands and different fields of view is 0 degree and 45 degree90 DEG and 135 DEG infrared radiation image I of the target scene0°、I45°、I90°、I135°After the corresponding registration, step S2 may be executed to perform image registration of the infrared polarization information.
Preferably, the step S2 specifically includes the following steps:
(1) calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images, and the steps specifically comprise:
a. calculating a Stokes parameter image based on the registered infrared radiation image:
wherein, I'0°、I'90°、I'45°And l'135°Respectively registered infrared radiation images with the rotation polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees; s0、S1、S2And S3Representing Stokes parameters S0Image, S1Image, S2Image sum S3An image; i isRCPAnd ILCPIndicating right-hand and left-hand circular polarization, respectively.
b. Calculating and obtaining an infrared polarization information image of the surface of the measured target based on the Stokes parameter image:
where p is the degree of polarization and α is the angle of polarization. The infrared polarization information image of the surface of the measured target can be obtained by calculating the Stokes parameter image through the formula, the value range of the known polarization angle is [ -pi/2, pi/2 ], and the polarization degree represents a dimensionless number from 0 to 1; the polarization angle α represents the angle between the polarization direction of the incident light and the x-axis, and for partially polarized light, the angle between the polarization direction with the maximum energy and the x-axis.
(2) And performing edge extraction on the infrared polarization information image, and extracting edge linear characteristics of the target in the long-wave infrared polarization information image and the medium-wave infrared polarization information image.
(3) And performing autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current waveband according to the peak occurrence position, and performing translation adjustment on the infrared polarization information image of the other waveband according to the two-dimensional offset to realize registration of the infrared polarization information images of different wavebands. For example, the long-wave infrared polarization information image is subjected to translational modulation with reference to the medium-wave infrared polarization information image, or the medium-wave infrared polarization information image is subjected to translational modulation with reference to the long-wave infrared polarization information image.
Finally, in step S3, a target recognition step is performed to fuse the registered infrared polarization information images of different wavebands to obtain a fused image, and target recognition is performed based on the fused image. In this step, the long-wave infrared polarization information image and the medium-wave infrared polarization information image can be fused by using an image fusion method which is well known and can be applied by the basic technical personnel in the field. Fig. 4 is a fused image processed by the method for registering polarized images of different fields of view according to the present invention. According to the method, the edge contour information and other polarization detail characteristics of the target in the fusion image can be effectively maintained based on the radiation image registration mode, and scene perception and target identification are facilitated.
Based on the same inventive concept, the embodiment of the invention also provides a device for registering the polarized images with different fields of view. Referring to fig. 5, a block diagram of an apparatus for registering polarized images of different fields of view according to a preferred embodiment of the present invention is shown. As shown in fig. 5, this embodiment provides an apparatus 500 comprising: an infrared radiation image registration unit 501, a polarization information image registration unit 502, and an object recognition unit 503.
An infrared radiation image registration unit 501, configured to register infrared radiation images with different rotation polarization directions acquired in different fields and different bands.
Preferably, the infrared radiation image registration unit 501 performs registration by:
(1) based on an infrared polarization imaging measurement device, an infrared radiation image I of a target scene with the rotation polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees is obtained through a rotation polaroid0°、I45°、I90°、I135°；
(2) Interpolating the infrared radiation image with low resolution by using an image interpolation method, and improving the resolution of the infrared radiation image with low resolution to be the same as the resolution of the infrared radiation image with different rotating polarization directions corresponding to different fields of view;
(3) and extracting invariant features in the two corresponding long-wave infrared radiation images and medium-wave infrared radiation images with the same rotation polarization direction by using a feature-based registration method, and finishing registration of the two infrared radiation images based on the invariant features.
And a polarization information image registration unit 502, configured to calculate infrared polarization information images of different wave bands based on the registered infrared radiation image and perform registration.
Preferably, the polarization information image registration unit 502 performs registration by:
(1) calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
(2) performing edge extraction on the infrared polarization information image, and extracting edge linear characteristics of targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image; (3) and performing autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current waveband according to the peak occurrence position, and performing translation adjustment on the infrared polarization information image of the other waveband according to the two-dimensional offset to realize registration of the infrared polarization information images of different wavebands.
And the target identification unit 503 is configured to fuse the registered infrared polarization information images of different wave bands to obtain a fused image, and perform target identification based on the fused image.
The embodiment of the invention also provides equipment for executing the registration method of the polarized images of different fields of view, which comprises the following steps: at least one processor, at least one memory, and a computer program stored in the memory, which when executed by the processor, implement the different field of view polarization image registration method as in the above embodiments.
The embodiment of the invention provides a different-field-of-view polarized image registration system, which comprises the different-field-of-view polarized image registration equipment and at least two infrared polarization imaging measurement devices connected with the different-field-of-view polarized image registration equipment. These infrared polarization imaging measuring devices include an infrared polarization imaging measuring device for acquiring long-wave infrared radiation images and an infrared polarization imaging measuring device for acquiring medium-wave infrared radiation images. The fields of view of these infrared polarization imaging measurement devices may be different. Each infrared polarization imaging measurement device can acquire an infrared radiation image I of a target scene with the rotating polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees through a rotating polaroid0°、I45°、I90°、I135°。
Embodiments of the present invention provide a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the method for registering polarization images of different fields of view as in the above embodiments.
According to the invention, the difference of polarization characteristics of the target surface in different detection wave band ranges is verified through theoretical analysis, and the fusion of polarization information images of different wave bands can enhance the detail information such as the target surface profile and the like. Therefore, the method provides a registration method of infrared polarization images of different fields of view based on radiation image registration, and aims at the registration problem in the polarization information image fusion acquired by detectors of different fields of view, the method provides the registration of the infrared radiation images, and then carries out image fusion by a method of obtaining polarization images with the same resolution by calculation, so that the problem of edge feature confusion generated in the polarization solving process can be solved.
It should be understood that the principle of the method and apparatus for registering polarized images of different fields of view in the present invention is the same, and therefore, the detailed description of the embodiment of the method for registering polarized images of different fields of view is also applicable to the apparatus for registering polarized images of different fields of view.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for registering polarized images of different fields of view, the method comprising the steps of:
registering infrared radiation images of corresponding rotation polarization directions acquired from different fields of view and different wave bands;
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images and registering;
and fusing the registered infrared polarization information images of different wave bands to obtain a fused image, and identifying the target based on the fused image.
2. The method according to claim 1, wherein the registering the infrared radiation images with corresponding rotation polarization directions acquired from different fields of view and different bands comprises:
based on an infrared polarization imaging measurement device, an infrared radiation image I of a target scene with the rotation polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees is obtained through a rotation polaroid0°、I45°、I90°、I135°；
Interpolating the infrared radiation image with low resolution by using an image interpolation method, and improving the resolution of the infrared radiation image with low resolution to be the same as the resolution of the infrared radiation image with different rotating polarization directions corresponding to different fields of view;
and extracting invariant features in the two corresponding long-wave infrared radiation images and medium-wave infrared radiation images with the same rotation polarization direction by using a feature-based registration method, and finishing registration of the two infrared radiation images based on the invariant features.
3. The method for registering polarization images of different fields of view according to claim 1 or 2, wherein the calculating and registering infrared polarization information images of different wave bands based on the registered infrared radiation images comprises:
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
performing edge extraction on the infrared polarization information image, and respectively extracting edge linear characteristics of targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image;
and performing autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current waveband according to the peak occurrence position, and performing translation adjustment on the infrared polarization information image of the other waveband according to the two-dimensional offset to realize registration of the infrared polarization information images of different wavebands.
4. The method according to claim 3, wherein the calculating infrared polarization information images of different wave bands based on the registered infrared radiation images comprises:
calculating a Stokes parameter image based on the registered infrared radiation image:
wherein, I'0°、I'90°、I'45°And l'135°Respectively registered infrared radiation images with the rotation polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees; s0、S1、S2And S3Representing Stokes parameters S0Image, S1Image, S2Image sum S3An image; i isRCPAnd ILCPRespectively representing right-hand and left-hand circular polarization;
calculating and obtaining an infrared polarization information image of the surface of the measured target based on the Stokes parameter image:
where p is the degree of polarization and α is the angle of polarization.
5. A device for registering polarized images of different fields of view, comprising:
the infrared radiation image registration unit is used for registering infrared radiation images in corresponding rotation polarization directions acquired by different fields of view and different wave bands;
the polarization information image registration unit is used for calculating infrared polarization information images of different wave bands based on the registered infrared radiation images and registering the infrared polarization information images;
and the target identification unit is used for fusing the registered infrared polarization information images of different wave bands to obtain a fused image and identifying a target based on the fused image.
6. The different-field-of-view polarized image registration apparatus according to claim 5, wherein the infrared radiation image registration unit performs registration by:
based on an infrared polarization imaging measurement device, an infrared radiation image I of a target scene with the rotation polarization directions of 0 degree, 45 degrees, 90 degrees and 135 degrees is obtained through a rotation polaroid0°、I45°、I90°、I135°；
Interpolating the infrared radiation image with low resolution by using an image interpolation method, and improving the resolution of the infrared radiation image with low resolution to be the same as the resolution of the infrared radiation image with different rotating polarization directions corresponding to different fields of view;
and extracting invariant features in the two corresponding long-wave infrared radiation images and medium-wave infrared radiation images with the same rotation polarization direction by using a feature-based registration method, and finishing registration of the two infrared radiation images based on the invariant features.
7. The different-field-of-view polarized image registration apparatus according to claim 5 or 6, wherein the polarization information image registration unit performs registration by:
calculating infrared polarization information images of different wave bands based on the registered infrared radiation images, wherein the infrared polarization information images of different wave bands comprise long-wave infrared polarization information images and medium-wave infrared polarization information images;
performing edge extraction on the infrared polarization information image, and extracting edge linear characteristics of targets in the long-wave infrared polarization information image and the medium-wave infrared polarization information image; and performing autocorrelation calculation based on the extracted edge linear features, confirming the two-dimensional offset of the infrared polarization information image of the current waveband according to the peak occurrence position, and performing translation adjustment on the infrared polarization information image of the other waveband according to the two-dimensional offset to realize registration of the infrared polarization information images of different wavebands.
8. A different field of view polarized image registration apparatus, comprising: at least one processor, at least one memory and a computer program stored in the memory, characterized in that the computer program realizes the method according to any one of claims 1 to 4 when the computer program is executed by the processor.
9. A different field of view polarized image registration system comprising the different field of view polarized image registration apparatus of claim 8 and at least two infrared polarization imaging measurement devices connected thereto.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010506431.0A CN111667519B (en) | 2020-06-05 | 2020-06-05 | Registration method and device for polarized images with different fields of view |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010506431.0A CN111667519B (en) | 2020-06-05 | 2020-06-05 | Registration method and device for polarized images with different fields of view |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111667519A true CN111667519A (en) | 2020-09-15 |
| CN111667519B CN111667519B (en) | 2023-06-20 |
Family
ID=72386861
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010506431.0A Active CN111667519B (en) | 2020-06-05 | 2020-06-05 | Registration method and device for polarized images with different fields of view |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111667519B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112163587A (en) * | 2020-09-30 | 2021-01-01 | 北京环境特性研究所 | Feature extraction method and device of target object and computer readable medium |
| CN113506330A (en) * | 2021-07-29 | 2021-10-15 | 北京环境特性研究所 | Different-waveband polarization angle image fusion method based on multi-scale transformation |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB9321711D0 (en) * | 1992-11-03 | 1993-12-15 | Israel State | Method and apparatus for simulating infra-red images and simulated infra-red images obrained therefrom |
| CN104103073A (en) * | 2014-07-14 | 2014-10-15 | 中国人民解放军国防科学技术大学 | Infrared polarization image edge detection method |
| CN106289542A (en) * | 2016-07-26 | 2017-01-04 | 北京理工大学 | A kind of radiation correction method of preposition polaroid type infrared polarization imaging system |
| CN108460750A (en) * | 2018-04-03 | 2018-08-28 | 中国人民解放军国防科技大学 | Long-wave infrared image enhancement method for ship target under water surface background |
| CN109253802A (en) * | 2017-07-13 | 2019-01-22 | 南京理工大学 | A kind of multispectral polarization synchronous of bionic navigation and method |
| CN109632102A (en) * | 2019-02-26 | 2019-04-16 | 北京环境特性研究所 | Infrared polarization image measuring device based on rotatory polarization piece |
| CN110869976A (en) * | 2018-12-04 | 2020-03-06 | 深圳市大疆创新科技有限公司 | Image processing method, device, unmanned aerial vehicle, system and storage medium |
-
2020
- 2020-06-05 CN CN202010506431.0A patent/CN111667519B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB9321711D0 (en) * | 1992-11-03 | 1993-12-15 | Israel State | Method and apparatus for simulating infra-red images and simulated infra-red images obrained therefrom |
| CN104103073A (en) * | 2014-07-14 | 2014-10-15 | 中国人民解放军国防科学技术大学 | Infrared polarization image edge detection method |
| CN106289542A (en) * | 2016-07-26 | 2017-01-04 | 北京理工大学 | A kind of radiation correction method of preposition polaroid type infrared polarization imaging system |
| CN109253802A (en) * | 2017-07-13 | 2019-01-22 | 南京理工大学 | A kind of multispectral polarization synchronous of bionic navigation and method |
| CN108460750A (en) * | 2018-04-03 | 2018-08-28 | 中国人民解放军国防科技大学 | Long-wave infrared image enhancement method for ship target under water surface background |
| CN110869976A (en) * | 2018-12-04 | 2020-03-06 | 深圳市大疆创新科技有限公司 | Image processing method, device, unmanned aerial vehicle, system and storage medium |
| CN109632102A (en) * | 2019-02-26 | 2019-04-16 | 北京环境特性研究所 | Infrared polarization image measuring device based on rotatory polarization piece |
Non-Patent Citations (1)
| Title |
|---|
| 赵永强;潘泉;张洪才;: "自适应多波段偏振图像融合研究", 光子学报 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112163587A (en) * | 2020-09-30 | 2021-01-01 | 北京环境特性研究所 | Feature extraction method and device of target object and computer readable medium |
| CN113506330A (en) * | 2021-07-29 | 2021-10-15 | 北京环境特性研究所 | Different-waveband polarization angle image fusion method based on multi-scale transformation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111667519B (en) | 2023-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11068700B2 (en) | Polarization imaging for facial recognition enhancement system and method | |
| CN108492274B (en) | Long-wave infrared polarization feature extraction and fusion image enhancement method | |
| US10129490B2 (en) | Systems and approaches for thermal image corrections | |
| EP2561482B1 (en) | Shape and photometric invariants recovery from polarisation images | |
| CN111667519B (en) | Registration method and device for polarized images with different fields of view | |
| CN111667516A (en) | Infrared polarization information fusion method based on Laplacian pyramid decomposition structure | |
| WO2017112040A1 (en) | 3-d polarimetric imaging using a microfacet scattering model to compensate for structured scene reflections | |
| AU2011242408A1 (en) | Shape and photometric invariants recovery from polarisation images | |
| CN104318550A (en) | Eight-channel multi-spectral imaging data processing method | |
| CN110462679B (en) | Rapid multispectral light field imaging method and system | |
| CN112907527B (en) | Infrared thermal imaging splicing detection method for large-size curved surface test piece | |
| Hu et al. | Automatic algorithm for relative radiometric normalization of data obtained from Landsat TM and HJ-1A/B charge-coupled device sensors | |
| CN115468654A (en) | Method for acquiring polarization difference characteristic image under optimal angle | |
| Lavigne et al. | A new fusion algorithm for shadow penetration using visible and midwave infrared polarimetric images | |
| CN109377476A (en) | The dynamic threshold acquisition methods and device of remote sensing image cloud detection characteristic parameter | |
| KR20200016507A (en) | Method and Apparatus for Synthesizing Image | |
| CN110865391B (en) | Millimeter wave terahertz multi-polarization imaging method and imaging system for target enhancement | |
| JP2015129710A (en) | Non-contact temperature measurement method and non-contact temperature measurement device | |
| Wang et al. | A new image registration method for infrared images and visible images | |
| CN112102419B (en) | Dual-light imaging equipment calibration method and system and image registration method | |
| CN111339848B (en) | Method and device for identifying artificial target in natural environment | |
| Xiang et al. | MTF measurement and imaging quality evaluation of digital camera with slanted-edge method | |
| Špiclin et al. | Geometrical calibration of an AOTF hyper-spectral imaging system | |
| Keshavarz et al. | Developing a new approach for registering LWIR and MWIR images using local transformation function | |
| Petrocelli et al. | 3D Thermal Imaging: An approach towards true field temperature measurement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |