CN107977619B - Hyperspectral target detection method based on ensemble learning constraint energy minimization - Google Patents
Hyperspectral target detection method based on ensemble learning constraint energy minimization Download PDFInfo
- Publication number
- CN107977619B CN107977619B CN201711215419.9A CN201711215419A CN107977619B CN 107977619 B CN107977619 B CN 107977619B CN 201711215419 A CN201711215419 A CN 201711215419A CN 107977619 B CN107977619 B CN 107977619B
- Authority
- CN
- China
- Prior art keywords
- algorithm
- data set
- hyperspectral
- cem
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/194—Terrestrial scenes using hyperspectral data, i.e. more or other wavelengths than RGB
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Astronomy & Astrophysics (AREA)
- Remote Sensing (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
The invention relates to a hyperspectral target detection method based on ensemble learning constrained energy minimization, which comprises the following five steps: the method comprises the following steps: reading data by a computer; step two: expanding a data set; step three: randomly sampling to obtain a plurality of detectors; step four: calculating an included angle between the pixel vector and the interested target; step five: and performing soft voting on the obtained distribution condition. The method overcomes the defects of the prior art, well solves the problem of hyperspectral image target detection, and obtains a better detection result, so that the method can be applied to hyperspectral image target detection and has wide application prospect and value.
Description
The technical field is as follows:
the invention relates to a hyperspectral target detection method based on ensemble learning constrained energy minimization, and belongs to the technical field of hyperspectral remote sensing image target detection.
(II) background technology:
the hyperspectral remote sensing image not only contains the spatial information of an object, but also contains the spectral information of the object, wherein each pixel contains an approximately continuous spectral curve. All pixels in the hyperspectral image in the same wave band can form a two-dimensional image, and each pixel also comprises a spectrum curve, so that the hyperspectral image data can be regarded as three-dimensional data and contain abundant spectrum information. The hyperspectral image has high spectral resolution, can distinguish materials of different ground objects through spectral characteristics, and can solve the problems which cannot be solved by using the original full-color image and multispectral image, such as military camouflage identification, underground work, resource detection, environment monitoring and the like, so that the hyperspectral image target detection has important application value in military and civil aspects.
The existing algorithms for detecting the hyperspectral image target include a Spectral Angle Matching (SAM) algorithm, a Spectral Information Divergence (SID) algorithm, a Constrained Energy Minimization (CEM) algorithm, a Matched Filter (MF), and an adaptive coherence/cosine estimator (ACE).
Most detectors constructed by the existing algorithm are obtained by a constraint least square method or a hypothesis testing algorithm based on Gaussian distribution prior, and most of the obtained detectors are linear operators (such as CEM/MF) or quadratic operators (ACE). However, the hyperspectral data captured in the real environment is usually affected by imaging noise, atmospheric turbulence, spectrum mixing and other effects, usually shows strong nonlinear distribution characteristics, and does not satisfy gaussian distribution prior in the spectrum space. In this case, it is often difficult to obtain satisfactory detection results by linear operators or quadratic operators. Although some scholars in the field of hyperspectral target detection map hyperspectral data points to a high-dimensional or infinite-dimensional space through a kernel method (kernel trim), nonlinear expression forms of the above algorithms such as kernel cem (kernel cem), kernel ace (kernel ace) and the like are obtained, the kernel method itself is easily subjected to kernel function parameter selection and shows a phenomenon of unstable performance. From the theory of statistical machine learning, the expression ability and generalization ability of the algorithm are two important factors restricting the accuracy and stability of the algorithm, for traditional algorithms such as CEM, MF and ACE, the generalization ability is strong, the expression ability is relatively weak, the spectrum data under nonlinear distribution is difficult to describe, and the nucleation forms of the traditional algorithms have strong expression ability and weak generalization performance. In general, the key to designing a hyperspectral target algorithm is the trade-off between algorithm expressive power and generalization power.
An integrated learning algorithm is an important method in machine learning, and the idea is to improve the expression capacity and generalization capacity of the integrated learning algorithm by adopting the integration of a plurality of weak decision makers. Two important ideas exist in ensemble learning, one is called Boosting, the effect of Boosting is to keep the generalization performance of a weak decision maker unchanged and simultaneously improve the expression capacity of the weak decision maker, and a typical algorithm is an Adaboost algorithm; and the other type of idea called Model Combination is to ensure the strong expression capability of the weak decision maker and simultaneously improve the generalization performance of the weak decision maker, and the typical algorithm is Bagging. Therefore, one problem that we can easily think is that the existing hyperspectral target detection algorithm can be improved by using the idea of Model Combination in ensemble learning, so that the hyperspectral target detection algorithm has strong nonlinear spectral expression capability and improves the stability and robustness of the hyperspectral target detection algorithm. Aiming at the situation, the invention provides an Ensemble-based-CEM (E-CEM for short) hyperspectral target detection method with minimized constraint energy by Ensemble learning.
(III) the invention content:
1. the purpose is as follows: the invention aims to provide a hyperspectral target detection method for minimizing the constraint energy of ensemble learning.
2. The technical scheme is as follows: the invention is realized by the following technical scheme:
the invention discloses a hyperspectral target detection method based on ensemble learning constraint energy minimization. The method comprises the following specific steps:
the method comprises the following steps: the computer reads the data.
Step two: expanding the data set, and specifically adopting a QCEM algorithm;
step three: extracting N samples from the data set, repeating the step two P times to obtain M sampling sets containing N training samples, training each sampling set to obtain a CEM detector, and obtaining the distribution condition of the interested target d by using the detectors;
step four: and calculating the included angle between each pixel vector in the data set and the interested target.
Step five: and performing soft voting on the distribution condition of the interested target d in the data set, which is obtained by all the CEM operators, and finally obtaining the distribution condition of the interested target d in the whole data set by taking the included angle obtained in the step four as the weight.
3. The advantages and the effects are as follows:
the invention discloses a hyperspectral target detection method based on ensemble learning constraint energy minimization. The invention has the advantages that: the hyperspectral target detection is completed by a method of integrating learning and constraining energy minimization. The stability and robustness of the hyperspectral target are integrally improved on the basis that the constraint energy minimization has stronger spectral expression capability, and the overall effect of hyperspectral target detection is better through the combination of the constraint energy minimization and the hyperspectral target.
(IV) description of the drawings:
FIG. 1 is a block diagram of hyperspectral target detection by the method of the invention.
FIG. 2 is the AUC value of the method of the present invention and other related algorithms on hyperspectral data.
(V) specific embodiment:
for a better understanding of the technical solution of the present invention, the following embodiments of the present invention are further described with reference to the accompanying drawings:
the invention is implemented in the MATLAB 2016a programming environment. After reading the hyperspectral remote sensing image data, the computer firstly expands the data set, then replaces and extracts N sample pixels to train a CEM detector, repeats T times to obtain T detectors, judges the distribution condition of an interested target on the data set by using the trained detectors, performs soft voting by taking the included angle of a pixel vector and a target vector as a weight to obtain the final distribution condition of the interested target in the data set, and finally completes hyperspectral target detection.
The flow chart of the invention is shown in 1, a computer is configured by adopting an Intel (R) core (TM) i7-3770 processor, the main frequency is 3.40GHz and the memory is 32GB, and the hyperspectral target detection method comprises the following steps:
the method comprises the following steps: the computer reads the data. The method comprises the steps of reading an AVIRIS hyperspectral image by using a computer in an MATLAB 2016a programming environment, wherein data used by the method is an Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) hyperspectral image for target detection, and the scene of the image is an airport in San Diego in the United states. The data collected by the AVIRIS have 224 wave bands, and the wave band range is 0.4-2.5 μm. The water vapor absorption band and the low signal-to-noise ratio band are removed first, the actually used data have 189 bands, and the image size is 200 x 200 pixels. Recording a matrix S ═ r formed by all pixels in the hyperspectral image1,r2,...,rNIn which r isj=(rj1,rj2,...,rjL)TThe image is any sample pixel vector (j ═ 1, 2.., N), N is the number of pixels, and L is the number of bands of the image. The object of interest is d ═ d (d)1,d2,...,dL)。
Step two: and expanding the data set. Adopting QCEM algorithm;
to achieve a stronger nonlinear representation capability than the Constrained Energy Minimization (CEM) algorithm, we here use the modified algorithm QCEM. The QCEM algorithm is to design the filter G ═ diag (G)1,g2,...,gL) And ω ═ ω (ω)1,ω2,...,ωL)T. Where the filter can be seen as a matrix, g1,g2,...,gLAnd ω1,ω2,...,ωLRespectively, represents an element in a matrix, and T represents a matrix transpose.
When the input is rjWhen it is, remember yjFor the output through the filter:
G, ω can be solved by:
wherein, E { y2The desired value of output energy is shown as beta (/)2F+∥G∥2F) Is a regularization term to reduce the complexity and improve the stability of the filter.
The pixel vectors in the dataset are expanded as:
the object of interest is expanded into
The number of bands is expanded to 2L.
(2) The formula can be converted into:
obtaining:
step three: extracting N samples from the data set, repeating the step two times and P times to obtain M sampling sets { D) containing N training samples1,D2,...,DPTherein ofFor any one of the sample sets, the sampling rate is,for any pixel vector (i ═ 1, 2.., N) in the sample set, each sample set DiA CEM operator can be obtained, the CEM operator is acted on each pixel in the data set, and the distribution condition of the interested target d in the data set is obtainedWhereinIs hiIn thatThe final distribution of the objects of interest obtained by all CEM operators can be expressed as { c }1,c2,...,cNTherein of
Describing an algorithm:
inputting: data set S ═ r1,r2,...,rNWhere ri=(ri1,ri2,...,riL)T;
A target spectrum of interest d;
extracting N pixel vectors M in a replacement mode;
The number of training rounds P;
the process is as follows:
step four: calculating the included angle (theta) between each pixel vector in the data set and the interested target d1,θ2,...,θNLet αi=1-θiTo obtain { alpha1,α2,...,αN}。αiThe calculated value of the included angle theta changes along with the change of the similarity degree of the pixel and the interested target, if the pixel is more similar to the interested target, the included angle of the two vectors is smaller, and alpha isiThe larger, conversely, the larger alphaiThe smaller, { α1,α2,...,αNCan be used as the weight in soft voting.
Step five: distribution of objects of interest in the dataset by all CEM operators { c }1,c2,...,cNPerforming soft voting, and obtaining an included angle { alpha ] in the step four1,α2,...,αNAnd f, taking the weight as the weight, and finally obtaining the distribution condition of the interested target d in the whole data set.
The experimental results are as follows: in order to verify the effectiveness of the method, the method is used for carrying out experiments, and a good hyperspectral target detection effect is obtained. The data used in the experiment of the invention is an Airborn Visible/Infrared Imaging Spectrometer (AVIRIS) hyperspectral image. The Area Under the ROC Curve (AUC) of the hyperspectral target detection method (E-CEM) with ensemble learning constrained energy minimization finally obtained on test data is 0.9982, and the hyperspectral target detection effect is good (see fig. 2 and table 1 below).
TABLE 1
From the experimental result, the method well solves the problem of visible hyperspectral target detection, so that the method can be applied to hyperspectral target detection and has wide application prospect and value.
Claims (1)
1. A hyperspectral target detection method based on ensemble learning constraint energy minimization is characterized by comprising the following steps: the method comprises the following steps:
the method comprises the following steps: reading data by a computer; reading the AVIRIS hyperspectral image by using a computer in an MATLAB 2016a programming environment, and performing target detection on the AVIRIS hyperspectral image by using data, wherein the scene of the image is an airport in san Diego in the United states; the data collected by the AVIRIS have 224 wave bands, and the wave band range is 0.4-2.5 mu m; firstly, removing water vapor absorption wave bands and low signal-to-noise ratio wave bands, wherein actually used data have 189 wave bands, and the size of an image is 200 x 200 pixels; recording a matrix S ═ r formed by all pixels in the hyperspectral image1,r2,...,rNIn which r isj=(rj1,rj2,...,rjL)TThe method comprises the steps that any sample pixel vector is obtained, j is 1, 2, the. The object of interest is d ═ d (d)1,d2,...,dL);
Step two: expanding the data set; adopting QCEM algorithm;
in order to obtain the nonlinear expression capability stronger than that of the constrained energy minimization CEM algorithm, an improved algorithm QCEM is adopted; the QCEM algorithm is to design the filter G ═ diag (G)1,g2,...,gL) And ω ═ ω (ω)1,ω2,...,ωL)T(ii) a Where the filter is considered as a matrix, g1,g2,...,gLAnd ω1,ω2,...,ωLRespectively representing elements in the matrix, and T represents matrix transposition;
when the input is rjWhen it is, remember yjFor the output through the filter:
g, ω is solved by:
wherein, E { y2The expected value of output energy is shown, and beta (//w//2F +/G// 2F) is a regularization term used for reducing the complexity of the filter and improving the stability of the filter;
the pixel vectors in the dataset are expanded as:
the object of interest is expanded into
The number of wave bands is expanded to 2L;
(2) the formula is converted into:
obtaining:
step three: extracting N samples from the data set, repeating the step two times and P times to obtain M sampling sets { D) containing N training samples1,D2,...,DPTherein ofFor any one of the sample sets, the sampling rate is,for any pixel vector in the sampling set, i is 1, 2iObtaining a CEM operator, and applying the CEM operator to each pixel in the data set to obtain the distribution condition of the target d of interest in the data setWhereinIs hiIn thatThe final distribution of the objects of interest obtained by all CEM operators is expressed as { c }1,c2,...,cNTherein of
Describing an algorithm:
inputting: data set S ═ r1,r2,...,rNWhere ri=(ri1,ri2,...,riL)T;
A target spectrum of interest d;
extracting N pixel vectors M in a replacement mode;
The number of training rounds P;
the process is as follows:
5:end for
step four: calculating the included angle (theta) between each pixel vector in the data set and the interested target d1,θ2,...,θNLet αi=1-θiTo obtain { alpha1,α2,...,αN};αiThe calculated value of the included angle theta changes along with the change of the similarity degree of the pixel and the interested target, if the pixel is more similar to the interested target, the included angle of the two vectors is smaller, and alpha isiThe larger, conversely, the larger alphaiThe smaller, { α1,α2,...,αNTaking the weight as the weight of soft voting;
step five: distribution of objects of interest in the dataset by all CEM operators { c }1,c2,...,cNPerforming soft voting, and obtaining an included angle { alpha ] in the step four1,α2,...,αNAnd f, taking the weight as the weight, and finally obtaining the distribution condition of the interested target d in the whole data set.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711215419.9A CN107977619B (en) | 2017-11-28 | 2017-11-28 | Hyperspectral target detection method based on ensemble learning constraint energy minimization |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711215419.9A CN107977619B (en) | 2017-11-28 | 2017-11-28 | Hyperspectral target detection method based on ensemble learning constraint energy minimization |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107977619A CN107977619A (en) | 2018-05-01 |
CN107977619B true CN107977619B (en) | 2021-02-23 |
Family
ID=62012175
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711215419.9A Active CN107977619B (en) | 2017-11-28 | 2017-11-28 | Hyperspectral target detection method based on ensemble learning constraint energy minimization |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107977619B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111401359A (en) * | 2020-02-25 | 2020-07-10 | 北京三快在线科技有限公司 | Target identification method and device, electronic equipment and storage medium |
CN112733661B (en) * | 2020-12-31 | 2023-08-18 | 西安电子科技大学 | Multi-example energy constraint minimized hyperspectral target description and detection method |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8280111B2 (en) * | 2010-02-17 | 2012-10-02 | The Boeing Company | Advanced background estimation technique and circuit for a hyper-spectral target detection method |
CN102222221B (en) * | 2011-07-01 | 2014-03-26 | 哈尔滨工程大学 | Target detection method based on multispectral image filtering output statistical distribution regularity |
CN105760857B (en) * | 2016-03-18 | 2019-04-26 | 武汉大学 | A kind of target in hyperspectral remotely sensed image object detection method |
-
2017
- 2017-11-28 CN CN201711215419.9A patent/CN107977619B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN107977619A (en) | 2018-05-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Wang et al. | Locality and structure regularized low rank representation for hyperspectral image classification | |
Zhao et al. | Hyperspectral anomaly detection via a sparsity score estimation framework | |
Wang et al. | Robust hyperspectral unmixing with correntropy-based metric | |
CN107992891B (en) | Multispectral remote sensing image change detection method based on spectral vector analysis | |
CN109766858A (en) | Three-dimensional convolution neural network hyperspectral image classification method combined with bilateral filtering | |
CN107609573B (en) | Hyperspectral image time-varying feature extraction method based on low-rank decomposition and spatial-spectral constraint | |
Sun et al. | Nonlinear dimensionality reduction via the ENH-LTSA method for hyperspectral image classification | |
CN102663752A (en) | SAM weighted KEST hyperspectral anomaly detection algorithm | |
He et al. | Spectral-spatial hyperspectral image classification via SVM and superpixel segmentation | |
CN107977619B (en) | Hyperspectral target detection method based on ensemble learning constraint energy minimization | |
Liu et al. | Feature extraction for hyperspectral remote sensing image using weighted PCA-ICA | |
CN114863173B (en) | Self-mutual-attention hyperspectral image classification method for land resource audit | |
Yuan et al. | ROBUST PCANet for hyperspectral image change detection | |
Li et al. | Variational Bayesian independent component analysis-support vector machine for remote sensing classification | |
Zhang et al. | Feature-band-based unsupervised hyperspectral underwater target detection near the coastline | |
Luo et al. | Wavelet-based extended morphological profile and deep autoencoder for hyperspectral image classification | |
Li et al. | Using improved ICA method for hyperspectral data classification | |
Kong et al. | Regularized multiple sparse Bayesian learning for hyperspectral target detection | |
Wang et al. | Multiple Spectral-Spatial Representation Based on Tensor Decomposition for HSI Anomaly Detection | |
CN105825512A (en) | Hyperspectral remote sensing image abnormal target detection method based on robust background regression | |
Srivatsa et al. | Application of least square denoising to improve admm based hyperspectral image classification | |
Lian et al. | Low-rank constrained memory autoencoder for hyperspectral anomaly detection | |
CN105761273B (en) | A kind of abnormal target in hyperspectral remotely sensed image object detection method based on figure construction | |
CN111899226B (en) | Hyperspectral image target prior optimization method based on multitask sparse learning | |
Ghosh et al. | A combined framework for dimensionality reduction of hyperspectral images using feature selection and feature extraction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |