CN100385214C - Nonlinear spectrum similarity measurement method - Google Patents

Nonlinear spectrum similarity measurement method Download PDF

Info

Publication number
CN100385214C
CN100385214C CNB2003101093471A CN200310109347A CN100385214C CN 100385214 C CN100385214 C CN 100385214C CN B2003101093471 A CNB2003101093471 A CN B2003101093471A CN 200310109347 A CN200310109347 A CN 200310109347A CN 100385214 C CN100385214 C CN 100385214C
Authority
CN
China
Prior art keywords
spectrum
spectral
vector
characteristic
kernel function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2003101093471A
Other languages
Chinese (zh)
Other versions
CN1546959A (en
Inventor
方涛
唐宏
杜培军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiaotong University
Original Assignee
Shanghai Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiaotong University filed Critical Shanghai Jiaotong University
Priority to CNB2003101093471A priority Critical patent/CN100385214C/en
Publication of CN1546959A publication Critical patent/CN1546959A/en
Application granted granted Critical
Publication of CN100385214C publication Critical patent/CN100385214C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

The present invention relates to a nonlinear spectrum similarity measurement method which belongs to the technical field of information. Firstly, in the present invention, a kernel principal component analysis method is adopted to remove the strong correlation between spectral wavebands. More specifically, the present invention aims at the strong correlation between the spectrum wavebands and uses nonlinear transformation to transform original spectrum vectors into a new characteristic space. In the characteristic space, a kernel function and the principal component analysis method are used for obtaining characteristic values and characteristic vectors of all nonzero characteristics in a covariance matrix. The characteristic values are ranged in descending order, and the characteristic vectors corresponding to the first N characteristic values are selected. Thus, a standard orthogonal basis is structured, and the spectral vectors in the characteristic space are finally projected onto the standard orthogonal basis. Secondly, spectral reflection and absorptive characteristics are merged. More specifically, a reflectivity vector and a normalized absorbance vector are correspondingly multiplied with a waveband value, and thus, a compound spectral vector is formed. The present invention can be used for removing the strong correlation between the wavebands, and is compatible with the functions of the spectral reflection and the absorptive characteristics in the spectral similarity measurement at the same time.

Description

The non-linear spectral method for measuring similarity
Technical field
The present invention relates to a kind of spectral measurements method, specifically is a kind of based on the reflection of the complete waveform of spectrum and the non-linear spectral method for measuring similarity of absorption feature.Belong to areas of information technology.
Background technology
Find that by literature search the spectral similarity measure can be divided into two classes, a class is based on complete waveform character, typical method such as the drawing of spectrum angle.Kruse, " the visual and analysis of spectrum picture disposal system-optical spectrum imagers data interaction " (1993b that people such as FA deliver in U.S.'s " environmental remote sensing ", The SpectralImage Processing System (SIPS)-Interactive Visualization and Analysisof Imaging Spectrometer Data.Remote Sensing nvironment, 44:145-163), this article has proposed spectrum angle drafting method, promptly utilizes angle between the spectral reflectivity vector to go to measure similarity between spectrum.The advantage of this method is that it can overcome the influence of intensity of illumination to spectral similarity tolerance.Yet this method has only been considered the effect of spectral reflectivity in similarity measurement on the one hand, does not consider the strong correlation between spectral band on the other hand.Another kind of spectroscopic diagnostics absorption feature, the method for curve such as the spectral absorption index of being based on.People such as Wang Jinnian are at " environmental remote sensing " Vol.11, " imaging spectral image spectral absorption discriminating model and mineral map plotting research " literary composition of delivering on the No.1.Feb 1996, and this article has proposed spectral absorption evaluation model, i.e. the spectral absorption index certificate of a correction.This method is suitable for that spectrum specific absorption peak is carried out similarity and passes judgment on, this method itself also is not suitable for similarity measurement between any spectrum, yet this method has reflected that the contribution that the spectrum different-waveband is measured spectral similarity is different, and its shortcoming is the complete waveform of having ignored the reflectance signature of spectrum and can not being applicable to spectrum.The reflection of spectrum and to absorb feature be indivisible two category features of spectrum, however present spectral similarity measure is only at a kind of feature wherein.In addition, present spectral similarity degree method is all supposed between spectral band independently of one another, however this hypothesis do not tally with the actual situation, the strong correlation between spectral band at present is widely applied in the dimensionality reduction and feature extraction of spectroscopic data.
Summary of the invention
The objective of the invention is to above-mentioned deficiency at prior art, a kind of non-linear spectral method for measuring similarity is proposed, promptly based on the reflection of complete waveform and the non-linear spectral method for measuring similarity of absorption feature, make it can remove strong correlation between wave band on the one hand, taken into account spectral reflectance on the other hand and absorbed the effect of feature in spectral similarity tolerance.
The present invention is achieved by the following technical solutions, and the inventive method comprises two key links, and one is that employing core principle component analysis method has been removed the strong correlation between the spectral band, and another is spectral reflectance and the merging that absorbs feature.
1 adopts the strong correlation between the core principle component analysis method removal spectral band
At the strong correlation between spectral band, at first utilize nonlinear transformation with original spectrum vector transformation to a new feature space.Then, in feature space, utilize kernel function and principal component analytical method to obtain covariance matrix all non-zero characteristics eigenwert and proper vectors, eigenwert is pressed descending sort, select top n (N is the spectral band number) eigenwert characteristic of correspondence vector, and construct one group of orthonormal basis with this.At last, with spectrum vector projection in the feature space to orthonormal basis.
The merging of 2 spectral reflectances and absorption feature
The continuum curve is meant the outer wrapping curve of the curve of spectrum, and when actual treatment, the continuum curve is that the straight line with segmentation comes approximate representation.Continuum is removed the ratio that curve is meant the curve of spectrum and continuum curve, and it has kept the spectral absorption peak, and reflection peak is normalized to 1, is shown below:
r → cr = r → / r → c - - - ( 1 )
Wherein,
Figure C20031010934700042
Be that continuum is removed curve, Be spectrum,
Figure C20031010934700044
Be and spectrum The corresponding continuum curve of wave band.The absorption feature of spectrum (as the symmetry of the degree of depth, width, wave band position and the absorption peak that absorb etc.) can be removed curve according to continuum and obtain, but with the absorption feature of spectrum as factor of similarity measurement, see expression formula (2).
R → = r → × r → cr - - - ( 2 )
Wherein,
Figure C20031010934700047
In addition continuum is removed the non-linear spectral vector of curve constraint,
Figure C20031010934700048
Be to project to the later spectrum vector of orthonormal basis in the feature space,
Figure C20031010934700049
The continuum that is spectrum is removed curve.
Below the present invention is further illustrated, the method concrete steps are as follows:
(1) select kernel function and parameter is set, the kernel function of choosing is the polar coordinates kernel functions
( k ( x , y ) = exp ( - | | x - y | | 2 δ ) ) , ( δ = 2 ) ;
(2) utilize kernel function to obtain nuclear matrix K,, in original spectrum vector projection to a Hilbert inner product space, be actually the nonlinear transformation of having finished an implicit expression by kernel function;
(3) by calculating eigenwert and the proper vector that obtains nuclear matrix K;
(4) eigenwert and the proper vector of N non-zero of selection, and proper vector is carried out zero-mean handle, wherein N is the spectral band number, why selects eigenwert and the proper vector the same with the spectral band number, is to merge (suc as formula 2) for the absorption feature with the back;
(5) with spectrum vector projections all in the feature space to the normal coordinates base of selecting that proper vector constituted;
(6) reflectance signature behind the combined transformation and absorption feature are seen formula 2.
(7) utilize the drawing of spectrum angle that the later vector of conversion is carried out similarity measurement.
The present invention mainly contains the innovative point of two aspects, utilize on the one hand core principle component analysis to remove strong correlation between spectral band, thereby it is consistent that the spectrum vector and the prerequisite of spectrum angle drawing tolerance are supposed, is separate between each wave band promptly.Take all factors into consideration the reflection of spectrum on the other hand and absorbed the effect of feature in similarity measurement, strengthened the effect of spectral absorption peak in similarity measurement.This method had both overcome spectrum angle drafting method and had not considered strong correlation between spectral band, overcome drawing of spectrum angle and spectral absorption index again and only considered the shortcoming of a certain feature (absorbing feature or reflectance signature) of spectrum, in addition, this method has made full use of the advantage of drawing of spectrum angle and spectral absorption index, i.e. it is that to contribute be different to different-waveband in the advantage of spectral similarity tolerance influence and the spectral absorption index to the weight of spectral similarity tolerance that spectrum angle drawing can overcome intensity of illumination.
Embodiment
For understanding technical scheme of the present invention better, the realization to this method is further described in conjunction with the embodiments.
At first, select kernel function and necessary parameter is set.In the case study on implementation below, the kernel function of choosing is ( k ( x , y ) = exp ( | | x - y | | 2 δ ) ) , (δ=2)。Then, utilize kernel function calculate by covariance matrix and and nuclear matrix that proper vector derived, and calculate the eigenwert and the proper vector of this matrix.Secondly, construct one group of orthonormal basis according to these proper vectors, and the projection of spectrum vector on orthogonal basis in the calculated characteristics space.Once more, merge in the spectrum vector according to the absorption feature of formula (2) spectrum.At last, with metric function the later spectrum vector of conversion is carried out similarity measurement.
Content in conjunction with the inventive method provides following examples:
Library of spectra (spc_lib04a) with US Geological Survey (USGS) is a data source, and the spectrum in this library of spectra is carried out the similarity retrieval experiment.Total totally 498 spectrum in the library of spectra, the wave band number of spectrum is 444, and wavelength is between 0.2 to 3.0 micron, and spectral resolution is less than waiting 10 nanometers (Clark, 1993).The particulars of relevant this library of spectra can be with reference to network address Http:// speclab.cr.usgs.gov/spectral.lib04/clark1993/spectral lib.html
With haematite (Hematite_FE2606) is reference spectra, and the similarity measurement function is spectrum angle drawing (being the angle between the vector), carries out the similarity retrieval experiment, and experimental result is as follows: the waveform of 16 spectrum that (1) is the most similar; (2) the most similar 16 spectrum titles, mineral type and mineral compositions (seeing Table 1); (3) belong to the ordering (see Table 2) of 12 spectrum in similarity retrieval of haematite in the library of spectra.
From three aspects result for retrieval is estimated: (1) retrieval precision, it is meant that spectrum similar with parameter spectrum in the result for retrieval that returns accounts for the ratio of overall result; (2) recall rate, it is in the spectrum similar with reference spectra, the shared proportion of similar spectrum that returns; (3) similar spectrum sorts at spectral similarity.
16 spectrum titles that table 1 is the most similar and mineral type
Figure C20031010934700061
Figure C20031010934700071
Ordering and the spectrum angle of the spectrum of all haematite classes of table 2 in similarity retrieval
Figure C20031010934700082
As can be seen from Table 1: from the mineral classification, in non-linear spectral drawing retrieval, the spectrum that belongs to haematite has 10, and in the drafting method of spectrum angle, has only 7 to belong to the haematite class (1); (2) from mineral type, in nonlinear optical spectral corner drawing retrieval, the spectrum that belongs to oxide has 12, and in the drafting method of spectrum angle, the spectrum that belongs to oxide has only 9; (3) formation of spectral absorption characteristics mainly be since in the mineral electronic transition and molecular vibration (Clark, R.N.199), therefore, the composition of mineral is to a certain degree determining the diagnostic waveform of spectrum.From mineral composition, contain the spectrum of Alpha-Fe203, have 14 in the non-linear spectral drafting method under the continuum constraint, and have only 10 in the drafting method of spectrum angle; Therefore, analyze from 16 spectrum of the similarity of two kinds of methods, nonlinear optical spectral corner drafting method will obviously be better than spectrum angle drafting method.From above three angles that different spectrum is similar, the result of calculation of retrieval precision sees Table 3.
The table 3 liang class methods retrieval precision table of comparisons
Method for measuring similarity Spectrum types Mineral type Mineral composition
The drawing of spectrum angle 0.437 0.563 0.625
The drawing of nonlinear optical spectral corner 0.625 0.75 0.875
In addition, from the mineral classification, the recall rate of the retrieval at spectrum angle is 0.583, and the recall rate of non-linear spectral angle drafting method is 0.833.
As can be seen from Table 2: belong in 12 spectrum ordering that all spectral similarities are measured in library of spectra of haematite, for nonlinear optical spectral corner drafting method, 10 spectrum are in being in 16 the most similar result for retrieval, and maximum sequence number is 25.Yet in the drafting method of spectrum angle, have only 7 to be in 16 the most similar result for retrieval, in addition, its maximum sequence number has reached 96, and greater than have 5 of sequence number 25.
Therefore, from the angle of spectrum class similarity retrieval, nonlinear optical spectral corner drafting method obviously is better than spectrum angle drafting method.

Claims (1)

1. non-linear spectral method for measuring similarity is characterized in that concrete steps are as follows:
(1) selects kernel function and correlation parameter is set;
(2) utilize kernel function to obtain nuclear matrix K,, in original spectrum vector projection to a Hilbert inner product space, finish the nonlinear transformation of an implicit expression by kernel function;
(3) by calculating eigenwert and the proper vector that obtains nuclear matrix K;
(4) select the eigenwert and the proper vector of N non-zero, and proper vector is carried out zero-mean handle, wherein N is the spectral band number;
(5) with spectrum vector projections all in the feature space to the normal coordinates base of selecting that proper vector constituted;
(6) reflectance signature after merging absorption feature and the conversion, the corresponding wave band value of absorptivity vector that reflectivity vector sum normalization after the nuclear conversion is later multiplies each other, thereby constitutes a compound spectrum vector;
(7) utilize spectrum angle drawing that the compound spectrum vector of new formation is carried out similarity measurement.
CNB2003101093471A 2003-12-12 2003-12-12 Nonlinear spectrum similarity measurement method Expired - Fee Related CN100385214C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2003101093471A CN100385214C (en) 2003-12-12 2003-12-12 Nonlinear spectrum similarity measurement method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2003101093471A CN100385214C (en) 2003-12-12 2003-12-12 Nonlinear spectrum similarity measurement method

Publications (2)

Publication Number Publication Date
CN1546959A CN1546959A (en) 2004-11-17
CN100385214C true CN100385214C (en) 2008-04-30

Family

ID=34335145

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2003101093471A Expired - Fee Related CN100385214C (en) 2003-12-12 2003-12-12 Nonlinear spectrum similarity measurement method

Country Status (1)

Country Link
CN (1) CN100385214C (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104573732B (en) * 2013-10-18 2017-12-22 核工业北京地质研究院 A kind of target optical spectrum matching process
CN103837484B (en) * 2014-02-24 2016-08-17 广西科技大学 A kind of angular multivariable technique for eliminating the spectrum property taken advantage of random error
CN103926203B (en) * 2014-04-29 2016-04-20 中国科学院遥感与数字地球研究所 A kind of for the probabilistic Spectral Angle Mapping method of object spectrum
CN110909635A (en) * 2019-11-08 2020-03-24 华北电力大学 Waveform similarity analysis method of nonlinear element model
CN112329792B (en) * 2020-10-30 2022-12-09 中国电子科技集团公司第五十四研究所 Hyperspectral image target feature extraction method based on spectrum angle

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002286704A (en) * 2001-03-28 2002-10-03 Shimadzu Corp Data processing device for chromatograph

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002286704A (en) * 2001-03-28 2002-10-03 Shimadzu Corp Data processing device for chromatograph

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
The spectral image processingsystem(SIPS)-interactivevisualization and analysis of imagingspectrometer data. F.A. Kruse .etc.remote sensing environment,Vol.44 . 1993
The spectral image processingsystem(SIPS)-interactivevisualization and analysis of imagingspectrometer data. F.A. Kruse .etc.remote sensing environment,Vol.44 . 1993 *
光谱角度填图方法及其在岩性识别中的应用. 王志刚等.遥感学报,第3卷第1期. 1999
光谱角度填图方法及其在岩性识别中的应用. 王志刚等.遥感学报,第3卷第1期. 1999 *
基于核的特征提取技术及应用研究. 肖健华等.计算机工程,第28卷第10期. 2002
基于核的特征提取技术及应用研究. 肖健华等.计算机工程,第28卷第10期. 2002 *
成象光谱图象光谱吸收鉴别模型与矿物填图研究. 王晋年等.环境遥感,第11卷第1期. 1996
成象光谱图象光谱吸收鉴别模型与矿物填图研究. 王晋年等.环境遥感,第11卷第1期. 1996 *

Also Published As

Publication number Publication date
CN1546959A (en) 2004-11-17

Similar Documents

Publication Publication Date Title
Minnotte et al. The mode tree: A tool for visualization of nonparametric density features
Whiting duchamp: a 3D source finder for spectral‐line data
Karner et al. An image based measurement system for anisotropic reflection
Buat et al. The local universe as seen in the far-infrared and far-ultraviolet: A global point of view of the local recent star formation
CN104463808B (en) High-spectral data noise-reduction method and system based on spatial coherence
CN101540049B (en) End member extract method of hyperspectral image
Lavine et al. Criteria for comparing infrared spectra–A review of the forensic and analytical chemistry literature
JP2010522883A (en) System for color matching and digital color display
CN105352895A (en) Hyperspectral remote sensing data vegetation information extraction method
Ren et al. White dwarf-main sequence binaries from LAMOST: the DR1 catalogue
Grant et al. Identification of recently handled materials by analysis of latent human fingerprints using infrared spectromicroscopy
CN105424641A (en) Crude oil type near infrared spectrum identification method
CN100385214C (en) Nonlinear spectrum similarity measurement method
CN106951458A (en) A kind of product ontology is traced to the source Jianzhen's method for anti-counterfeit and system
Riviere et al. Multispectral polarized BRDF: design of a highly resolved reflectometer and development of a data inversion method.
Demir et al. Hyperspectral image classification using denoising of intrinsic mode functions
Breshike et al. Rapid detection of infrared backscatter for standoff detection of trace explosives
CN105181809A (en) Method and system for identifying jewelry quality based on multi-spectrum analysis
CN100334467C (en) Aeronautical high-spectrum remote-sensing image spectrum zonc noise self-detecting and removing method
CN106841070A (en) A kind of falsification of distilled spirit authentication method and device
CN106525729A (en) Substance element content information detection method based on spectral analysis technology
Rasigni et al. Study of surface roughness using microdensitometer analysis of electron micrographs of surface replicas. II: Autocovariance functions
CN105067558B (en) Near-infrared Qualitive test feature extracting method
CN102998279A (en) Method for fast identifying authenticity of Ganoderma lucidum spore powder
CN112396066B (en) Feature extraction method suitable for hyperspectral image

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20080430

Termination date: 20101212