CN114898117A - Sequence infrared image target detection method based on equalized structure texture representation - Google Patents

Sequence infrared image target detection method based on equalized structure texture representation Download PDF

Info

Publication number
CN114898117A
CN114898117A CN202210574392.7A CN202210574392A CN114898117A CN 114898117 A CN114898117 A CN 114898117A CN 202210574392 A CN202210574392 A CN 202210574392A CN 114898117 A CN114898117 A CN 114898117A
Authority
CN
China
Prior art keywords
image
infrared image
gradient
tensor
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210574392.7A
Other languages
Chinese (zh)
Inventor
席春美
邓丽珍
朱虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Posts and Telecommunications
Original Assignee
Nanjing University of Posts and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Posts and Telecommunications filed Critical Nanjing University of Posts and Telecommunications
Priority to CN202210574392.7A priority Critical patent/CN114898117A/en
Publication of CN114898117A publication Critical patent/CN114898117A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/54Extraction of image or video features relating to texture
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

A sequence infrared image target detection method based on equalized structure texture representation includes the steps that firstly, a local intensity information graph is constructed by means of the fact that small targets in an infrared image are brighter than a background, background clutter of which the central pixel value is smaller than a local average pixel is fully suppressed, and possible image blocks of the targets are locked. Secondly, after image blocks possibly having small targets are obtained, a polar coordinate system is established at the center points of the image blocks, the small targets are detected by utilizing local gradient attributes, and the small targets are detected by testing given threshold values. And finally, combining the local strength and the local gradient to form an equalized structure texture representation, and adding a balance factor to adjust the proportion of the strength and the gradient in the equalized structure texture representation. Compared with other algorithms, the method can detect the position of the small target more efficiently and accurately.

Description

Sequence infrared image target detection method based on equalized structure texture representation
Technical Field
The invention belongs to the field of infrared small target detection, and particularly relates to a sequence infrared image target detection method based on equalization structure texture representation.
Background
With the rapid development of modern military technology, various precisely guided missiles play an important role in modern wars, and have the capability of precisely striking various aircraft carrier operation platforms such as military targets, airplanes, ships and aircrafts at any time. Therefore, in order to ensure the safety of the operating platform, the hit target needs to be effectively detected and tracked.
So far, methods for detecting infrared small targets at home and abroad can be divided into two types: a sequential detection method and a single frame detection method. Although the existing method works well, it is very necessary to consider time information because a single frame image lacks enough information to detect a small object. The self-regularized weighted (SRWS) model (Zhang T, Peng Z, Wu H, et al. Infrared small target detection part self-regulated weighted sparse model [ J ]. neuro-compression, 2021,420:124-148.) proposed by Zhang T, Peng Z, Wu H, et al, utilizes the overlapping edge information of the detectable background result information to constrain the sparse term, improves the detection precision, but needs a certain screening for the detected target. A norm constraint-based non-convex optimization (NOLC) model (Zhang T, Wu H, Liu Y, et al. Infrared small target detection based on non-concurrent optimization with Lp-norm constraint [ J ] removal Sensing,2019,11(5):559.) proposed by Zhang et al strengthens sparse term constraint and simultaneously properly scales low-rank term constraint, and the method has poor detection effect under a strong noise environment. Zhang et al propose an edge and Corner perception Based spatio-Temporal Tensor (BTR) Model (Zhang P, Zhang L, Wang X, et al edge and Corner aware-Based Spatial-Temporal Tensor Model for extracted Small-Target Detection [ J ]. IEEE Transactions on Geoscience and Remote Sensing,2020,59(12):10708-10724.) for Infrared Small Target Detection, which has problems in Target enhancement, the edge information of the Target cannot be effectively retained, causing the Target to be over-shrunk. At present, there are many methods based on a space-time tensor model, but in the space-time tensor model, how to rapidly detect the position of a small target is still a difficult problem.
Disclosure of Invention
The invention aims to provide a sequence infrared image target detection method based on equalized structure texture representation, so that the position of a target can be accurately detected in an infrared image lacking texture information and structure information. The method starts from the potential space in the infrared image, and utilizes the local intensity information and the local gradient information of the original infrared image to construct the balanced structure texture representation so as to more accurately detect the target. In addition, in order to improve the compatibility of the method under more scenes, a variable balance factor is additionally added in the model.
The technical scheme of the invention mainly comprises the following three contents: one is the value of using local intensity information for the detection of small targets. Since background intensities are typically small or nearly the same, local intensity information can be used to suppress a relatively dark or relatively uniform background. By calculating the average of the image blocks, background clutter, where the central pixel value is less than the local average pixel, can be suppressed. Secondly, most of the gradient vectors of the target point to the center of the target, and the local gradient attribute means that the gradient directions of the background with strong edges are consistent, so that the small target can be detected by using the local gradient attribute. Thirdly, a new equalized structure texture characterization is proposed by combining the local intensity graph and the local gradient graph to reduce the false alarm rate of the model. A new importance factor is added to the texture characterization of the equalization structure to measure the relative importance of the intensity map and the gradient map.
Compared with the prior art, the invention has the following beneficial effects:
(1) the method is based on an infrared image space-time model, and a tensor model of an original image is obtained through space-time.
(2) The method used by the invention effectively inhibits the background clutter, overcomes the influence of the background clutter on the detected target, constructs a balanced structure texture representation by combining the strength and the gradient, and can quickly position the target in the original image.
(3) The invention effectively balances the relative weights of the intensity graph and the gradient graph in different scenes by adding the adjustable balance factor in the texture characterization of the equalization structure, so that the method has stronger adaptability and robustness.
Drawings
FIG. 1 is a general flow diagram of the method of the present invention.
Fig. 2 is an infrared image data set original according to an embodiment of the present invention.
Fig. 3 is a diagram of a target result after detection in the embodiment of the present invention.
Fig. 4 is a 3D potential energy diagram of a detection result diagram in an embodiment of the present invention.
Fig. 5 is a comparative demonstration of the experimental results in the example of the present invention.
Detailed Description
The technical scheme of the invention is further explained in detail by combining the drawings in the specification.
As shown in fig. 1, the present invention provides an infrared small target detection method based on texture characterization of an equalization structure, which specifically includes the following steps:
step 1: the original infrared image is preprocessed, namely the RGB image is converted into a gray image, and the sequence picture is constructed into a space-time tensor. For the input image, if the input image is an RGB image, the image can be converted into a gray image through a matlab function RGB2gray, and the information of the image is effectively retained. For m pieces of infrared images of L multiplied by H size sequence, wherein L and H are respectively the length and the width of the infrared images, the method for constructing the space-time tensor is to construct a three-dimensional L multiplied by H multiplied by m tensor.
In the embodiment of the present invention, there are 5 data sets used, and as shown in fig. 2, partial infrared images are respectively shown in fig. (a): the size of the pictures of the airplane in cloudy weather is 128 multiplied by 128, and the number of the pictures is 84; FIG. (b): the target under the background of cloudy days, because the target is too small, there is no shape information available, the picture size is 256 x 200, totally 30; FIG. (c): the size of the picture of the ship under the sea-sky background is 320 multiplied by 240, and the number of the pictures is 120; FIG. (d): 160 vehicles in the field with the picture size of 384 by 288; FIG. (e): the size of the pictures of the airplane under the cloudy background is 256 multiplied by 200, and 70 pictures are obtained in total;
step 2: and (4) dividing the infrared picture into pieces according to the size of the sliding window n multiplied by n, and calculating the local intensity value I of the infrared image.
For an n × n image block of a given size, the average of its surrounding areas is:
Figure BDA0003661490050000041
wherein N is m The number of pixels in an image block is indicated. v. of ij A pixel specific value representing the position of ith row and jth column in the image block, where v 0 Representing the value of the central pixel. By the formula (1), the local intensity value of the image block can be obtained:
Figure BDA0003661490050000042
and step 3: and establishing a polar coordinate by taking the target image block as a center, and calculating the gradient value G of the target image. And combining the intensity value I with the gradient value G to form the balanced structure texture representation.
First, polar coordinates are established in the center of an image block, and the image block is divided into 4 parts, each of which can be expressed as:
Figure BDA0003661490050000051
wherein p is i Each part of the image is represented (i ═ 1,2,3, 4). Since the gradient of a small target is not strictly directed to the center, a more relaxed constraint is used to formulate the gradient towards the center:
Figure BDA0003661490050000052
wherein
Figure BDA0003661490050000053
Indicates satisfaction of region p i The set of gradients of the constraint is,
Figure BDA0003661490050000054
is one gradient element in the set and m and a are its magnitude and direction, respectively. Then, in each zone, the meterCalculating out
Figure BDA0003661490050000055
Mean square of (d):
Figure BDA0003661490050000056
wherein N is j (j ═ 1,2, …, N) is a set
Figure BDA0003661490050000057
In
Figure BDA0003661490050000058
The number of the cells. After the gradient values of the four parts are calculated, the local gradient value of the image block can be obtained:
Figure BDA0003661490050000059
wherein k is a constant, G max And G min Respectively representing the mean square of the maximum gradient and the mean square of the minimum gradient.
Analysis of the ir images combined found two notable results: (1) in a place with high intensity, a target exists and a strong edge in a background clutter exists at the same time; (2) the gradient values for small and irregular objects are generally low. Therefore, a new equalized structure texture characterization is proposed to reduce the false alarm rate of the model by combining the local intensity map and the local gradient map.
Figure BDA00036614900500000510
Wherein, IG ij ,I ij ,G ij Respectively representing pixel values in the texture characterization, intensity map and gradient map of the equalized structure. The weights of the intensity map and the gradient map may be adapted to various scenarios by adjusting the balance factor α. Mathematically, when α is 1, the gradient map and intensity map have equal influence; when alpha is>At 1, the gradient map takes up higher weight;when α is<The intensity map is more important at 1. In the method, the value of alpha is adjusted according to the actual situation of the infrared image so as to flexibly deal with various complex infrared scenes.
And 4, step 4: and (3) inputting the image obtained in the step (1) and the balanced structure texture representation obtained in the step (3) into a truncated nuclear norm tensor model, and iterating by an alternative direction multiplier method to obtain small target information detected in the infrared image. For a given sequence infrared image, a balanced structure texture representation of the image is obtained through calculation, pixels in a target area can be almost completely highlighted, meanwhile, the low rank and sparsity of an infrared image tensor are utilized, the tensor is regarded as the combination of a sparse tensor and a low rank tensor, a truncated nuclear norm tensor model is adopted to quickly approach the rank of the low rank tensor in the model, the value of the sparse tensor is enhanced through the balanced texture structure representation, the low rank tensor is finally restored to the background, and the sparse tensor is restored to the target.
The purpose of detecting the infrared small target is finally achieved through the method, the experimental result is shown in fig. 3, and the method can effectively detect the small target in the image. The 3D potential energy diagram of the target image is shown in fig. 4, and from the potential energy diagram, the patent can intuitively feel that the infrared image has remarkable effects on background suppression and target highlighting.
As shown in FIG. 5, in order to verify the advancement of the present patent, some advanced algorithms were selected for comparison, mainly IPI model, BTR model, TIP model, NOLC model, SRWS model. Fig. 5 shows a graph of the results of the detection of each algorithm model on the same data. At the same time, parameter indexes are respectively selected
Figure BDA0003661490050000061
(background suppression factor) and
Figure BDA0003661490050000062
(signal to noise ratio gain) to more intuitively judge the effect of the algorithm, as shown in tables 1 and 2, respectively. By contrast, the method is in a leading position, whether on background suppression or target highlighting.
Table 1: each method of
Figure BDA0003661490050000071
Value of
IPI BTR TIP NOLC SRWS OURS
a 0.31 2.30 12.75 21.08 7.60 29.04
b 7.12 27.04 15.41 31.34 20.20 25.38
c INF 10.82 9.34 44.98 13.81 48.09
d 4.14 22.89 16.62 27.09 21.23 24.16
e 1.33 4.10 9.16 4.14 2.07 6.94
Table 2: each method of
Figure BDA0003661490050000072
Value of
IPI BTR TIP NOLC SRWS OURS
a 0.31 9.02 4.24 21.45 7.73 41.76
b 7.12 27.04 6.65 31.34 20.20 25.38
c NAN 12.53 5.28 52.11 16.00 125.14
d 0.34 11.08 7.42 10.56 9.30 14.29
e 1.33 4.10 2.43 4.14 2.13 5.08
The above description is only a preferred embodiment of the present invention, and the scope of the present invention is not limited to the above embodiment, but equivalent modifications or changes made by those skilled in the art according to the present disclosure should be included in the scope of the present invention as set forth in the appended claims.

Claims (7)

1. A sequence infrared image target detection method based on equalized structure texture representation is characterized by comprising the following steps: the method comprises the following steps:
step 1: preprocessing an original infrared image, including converting an RGB image into a gray image, and constructing a sequence picture into a space-time tensor;
step 2: dividing the infrared image into pieces according to the size of the sliding window n multiplied by n, and calculating a local intensity value I of the infrared image;
and step 3: establishing a polar coordinate by taking the target image block as a center, and calculating a gradient value G of the target image; combining the intensity value I with the gradient value G to form balanced structure texture representation;
and 4, step 4: and (3) inputting the image obtained in the step (1) and the balanced structure texture representation obtained in the step (3) into a truncated nuclear norm tensor model, and iterating by an alternative direction multiplier method to obtain small target information detected in the infrared image.
2. The method for detecting the sequence infrared image target based on the equalization structure texture characterization according to claim 1, characterized in that: the image preprocessing in the step 1 is realized by the following steps: for an input RGB image, converting the image into a gray image through a function RGB2gray of matlab, and keeping the information of the image; for m pieces of L × H size sequence infrared images, wherein L, H are the length and width of the infrared image respectively, and m represents the frame number of the infrared image, a three-dimensional L × H × m space-time tensor is constructed.
3. The method for detecting the sequence infrared image target based on the equalization structure texture characterization according to claim 1, characterized in that: the specific implementation steps of calculating the local intensity value I of the infrared image in the step 2 are as follows:
for an n × n image block of a given size, the average of its surrounding areas is:
Figure FDA0003661490040000011
wherein N is m Indicating the number of pixels in an image block, v ij A pixel specific value representing the position of ith row and jth column in the image block, where v 0 A value representing the center pixel; the local intensity value I of the image block is obtained by equation (1):
Figure FDA00036614900400000210
4. the method for detecting the sequence infrared image target based on the equalization structure texture characterization according to claim 1, characterized in that: the specific implementation steps of calculating the gradient value G of the infrared image in the step 3 are as follows:
firstly, a polar coordinate system (r, theta) is established at the center of an image block i ) The image block is divided into 4 parts,each part is represented as:
Figure FDA0003661490040000021
wherein p is i Representing each part of the image, i ═ 1,2,3, 4; the gradient towards the center is formulated using a constraint:
Figure FDA0003661490040000022
wherein
Figure FDA0003661490040000023
Indicates satisfaction of region p i The set of gradients of the constraint is,
Figure FDA0003661490040000024
is one gradient element in the set, and m and a are its magnitude and direction, respectively; then, in each region, calculation is performed
Figure FDA0003661490040000025
Mean square of G i
Figure FDA0003661490040000026
Wherein N is j (j ═ 1,2, …, N) is a set
Figure FDA0003661490040000027
In
Figure FDA0003661490040000028
The number of (2); after the gradient values of the four parts are calculated, obtaining the local gradient value of the image block:
Figure FDA0003661490040000029
wherein k is a constant, G max And G min Respectively representing the mean square of the maximum gradient and the mean square of the minimum gradient.
5. The method for detecting the sequence infrared image target based on the equalization structure texture characterization according to claim 1, characterized in that: the specific implementation steps for calculating the texture characterization of the equalization structure of the infrared image in the step 3 are as follows:
comprehensively analyzing the infrared image, and providing balanced structure texture representation by combining the local intensity graph and the local gradient graph to reduce the false alarm rate of the model:
Figure FDA0003661490040000031
wherein, IG ij ,I ij ,G ij Respectively representing pixel values in the texture characterization, the intensity map and the gradient map of the equalized structure; the weights of the intensity map and the gradient map are adapted to various scenes by adjusting a balance factor alpha; when α is 1, the gradient map and the intensity map have equal influence; when alpha is>At 1, the gradient map takes up higher weight; when α is<The intensity map is more important at 1.
6. The method for detecting the sequence infrared image target based on the equalization structure texture characterization according to claim 1, characterized in that: in the step 4, a sequence infrared image is given, the texture representation of the equalization structure of the image is obtained through calculation so as to highlight the pixels of the target area, meanwhile, the tensor is regarded as the combination of the sparse tensor and the low-rank tensor by utilizing the low-rank property and the sparsity of the infrared image tensor, the low-rank tensor is restored to the background by cutting off the nuclear norm tensor model, and the sparse tensor is restored to the target.
7. The method for detecting the sequence infrared image target based on the equalization structure texture characterization according to claim 6, characterized in that: in the truncation nuclear norm tensor model, the truncation nuclear norm is adopted in the model to quickly approach the rank of the low-rank tensor, meanwhile, the value of the sparse tensor is enhanced by using the representation of the equalized texture structure, finally, the low-rank tensor is restored to the background, and the sparse tensor is restored to the target.
CN202210574392.7A 2022-05-25 2022-05-25 Sequence infrared image target detection method based on equalized structure texture representation Pending CN114898117A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210574392.7A CN114898117A (en) 2022-05-25 2022-05-25 Sequence infrared image target detection method based on equalized structure texture representation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210574392.7A CN114898117A (en) 2022-05-25 2022-05-25 Sequence infrared image target detection method based on equalized structure texture representation

Publications (1)

Publication Number Publication Date
CN114898117A true CN114898117A (en) 2022-08-12

Family

ID=82725295

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210574392.7A Pending CN114898117A (en) 2022-05-25 2022-05-25 Sequence infrared image target detection method based on equalized structure texture representation

Country Status (1)

Country Link
CN (1) CN114898117A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070230788A1 (en) * 2006-03-31 2007-10-04 Sony Deutschland Gmbh Adaptive histogram equalization for images with strong local contrast
CN109934815A (en) * 2019-03-18 2019-06-25 电子科技大学 A kind of tensor recovery method for detecting infrared puniness target of combination ATV constraint
CN110807742A (en) * 2019-11-21 2020-02-18 西安工业大学 Low-light-level image enhancement method based on integrated network

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070230788A1 (en) * 2006-03-31 2007-10-04 Sony Deutschland Gmbh Adaptive histogram equalization for images with strong local contrast
CN109934815A (en) * 2019-03-18 2019-06-25 电子科技大学 A kind of tensor recovery method for detecting infrared puniness target of combination ATV constraint
CN110807742A (en) * 2019-11-21 2020-02-18 西安工业大学 Low-light-level image enhancement method based on integrated network

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘忠林等: "多尺度红外超像素图像模型的小目标检测", 中国图象图形学报, no. 12, 16 December 2019 (2019-12-16) *

Similar Documents

Publication Publication Date Title
Xu et al. Review of video and image defogging algorithms and related studies on image restoration and enhancement
CN106023257B (en) A kind of method for tracking target based on rotor wing unmanned aerial vehicle platform
CN112434745B (en) Occlusion target detection and identification method based on multi-source cognitive fusion
CN108182690B (en) A kind of infrared Weak target detecting method based on prospect weighting local contrast
CN103440502A (en) Infrared small-target detection method based on mixing Gauss and sparse representation
CN105160648A (en) Radar target and shadow segmentation method based on wavelet and constant false alarm rate
Yeriomina et al. Formation of reference images and decision function in radiometric correlation-extremal navigation systems
Guo et al. Aircraft detection in high-resolution SAR images using scattering feature information
Chen et al. Space-based infrared aerial target detection method via interframe registration and spatial local contrast
CN105046706B (en) SAR image ship detection method based on rational polynominal Function Fitting sea clutter
CN105139432B (en) Infrared DIM-small Target Image emulation mode based on Gauss model
Li et al. Multi-scale rock detection on Mars
CN113989631A (en) Infrared image target detection network compression method based on convolutional neural network
CN110276371B (en) Container corner fitting identification method based on deep learning
CN114898117A (en) Sequence infrared image target detection method based on equalized structure texture representation
Su et al. A Space Target Detection Method Based on Spatial–Temporal Local Registration in Complicated Backgrounds
CN111931558A (en) Ship category identification method and system
Xi et al. Multitarget detection algorithms for multitemporal remote sensing data
Xie et al. UAV cluster detection algorithm based on weighted tri-layer window local contrast
CN109410142A (en) A kind of defogging method optimal based on image quality evaluation
CN115187856A (en) SAR image ship detection method based on human eye vision attention mechanism
CN115205683A (en) Infrared small target detection method
Que et al. Low altitude, slow speed and small size object detection improvement in noise conditions based on mixed training
Lin et al. Coarse to fine aircraft detection from front-looking infrared images
Malarvel et al. An Improved Kernel Density Estimation with adaptive bandwidth selection for Edge detection

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information
CB03 Change of inventor or designer information

Inventor after: Deng Lizhen

Inventor after: Xi Chunmei

Inventor after: Zhu Hu

Inventor before: Xi Chunmei

Inventor before: Deng Lizhen

Inventor before: Zhu Hu