CN100449282C - Method and device for separating noise signal from infrared spectrum signal by independent vector analysis - Google Patents

Method and device for separating noise signal from infrared spectrum signal by independent vector analysis Download PDF

Info

Publication number
CN100449282C
CN100449282C CNB2005100385293A CN200510038529A CN100449282C CN 100449282 C CN100449282 C CN 100449282C CN B2005100385293 A CNB2005100385293 A CN B2005100385293A CN 200510038529 A CN200510038529 A CN 200510038529A CN 100449282 C CN100449282 C CN 100449282C
Authority
CN
China
Prior art keywords
current
vectors
independent component
coefficient vectors
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2005100385293A
Other languages
Chinese (zh)
Other versions
CN1657888A (en
Inventor
赵杰文
邹小波
黄星奕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu University
Original Assignee
Jiangsu University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu University filed Critical Jiangsu University
Priority to CNB2005100385293A priority Critical patent/CN100449282C/en
Publication of CN1657888A publication Critical patent/CN1657888A/en
Application granted granted Critical
Publication of CN100449282C publication Critical patent/CN100449282C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The present invention relates to an infrared spectral analysis method. The method comprises the following steps: firstly a preprocessor is adopted, centralizing processing and whitening processing are carried out to original signals which a spectrograph primary and secondary collected, and a pretreatment array with two vectors W1, W2 is output; then, an independent component analyzer is arranged for receiving the two vectors W1, W2 which are output by the preprocessor, and two coefficient vectors W1(n), W2 (n) at present are output; a spectral signal selector determines noise signals and useful signals by analyzing the energy of the two vectors W1, W2. The present invention has the advantages that the useful signals and the noise signals can be separated from infrared spectral signals obtained from the infrared spectrograph in a short time through independent component analysis to improve the accuracy of the infrared spectrograph.

Description

Infrared spectrum denoising method and device based on isolated component
Affiliated technical field
The present invention relates to a kind of infrared spectrum analysis.Refer in particular to a kind of infrared spectrum denoising method and device based on isolated component.
Background technology
Both contained useful information in the spectral signal that is obtained by spectrometer, stochastic error (noise) is also superposeing simultaneously.In order to reduce the influence of noise, normally pass through the final spectrum of the mean value of repeatedly sampling as sample to the spectrometer precision.Like this, there is important systematic parameter one sampling number to need to select in each spectrometer.Yet sampling number is selected needs certain experience, if sampling number is very few, influencing at random when spectrum is sampled is big, and spectral accuracy reduces; Sampling number is too much, and the spectrum that obtains after averaging is with the prolongation in sampling time, and the systematic error (as the drift of instrument) that instrument produces also increases thereupon, so not only sacrificed the time, and the precision of spectrum also is difficult to guarantee.
Summary of the invention
Invention provides a kind of infrared spectrum denoising method and device based on two-dimentional neuron isolated component algorithm, isolates useful signal and noise signal in the short period of time from the infrared spectroscopy signals that spectrometer obtains.These apparatus and method are the hybrid processing of the infrared spectrum difference of twice collection of same target being come estimated signal according to spectrometer.
The device of realizing technique scheme comprises: through data-signal continuous successively spectrometer, pretreater, independent component analysis device, spectral signal selector switch.
Infrared and near infrared spectrum during described infrared spectrum comprises, promptly wavelength coverage is: 780nm~50000nm;
Described pretreater take centralization and albefaction to spectrometer for the first time, the original signal of gathering for the second time handles.
Described independent component analysis device uses independent component analysis method to determine current two coefficient vectors of output
Described spectral signal selector switch adopts energy spectrometer to determine noise signal and useful signal.
The method of isolating useful signal and noise signal from infrared spectroscopy signals of the present invention may further comprise the steps:
(1) at first at the pretreater place, to spectrometer for the first time, the original signal of gathering for the second time carries out centralization and albefaction is handled, and exports a pre-service array that two vectors are arranged
Figure C20051003852900042
(2) the independent component analysis device is set then and is used for accepting pretreater output And export current two coefficient vectors { w → 1 ( n ) , w → 2 ( n ) } ;
(3) the spectral signal selector switch is by right Carry out energy spectrometer and determine noise signal and useful signal.
Described independent component analysis device is to determine described current two coefficient vectors according to following formula { w → 1 ( n ) , w → 2 ( n ) }
w(n)=w(n-1)+(I-2Bexp(-B 2/2)B T)w(n-1)
Wherein, w (n) is included as two current coefficient vectors { w → 1 ( n ) , w → 2 ( n ) } , Two coefficient vectors that once calculate before w (n-1) comprises { w → 1 ( n - 1 ) , w → 2 ( n - 1 ) } ; I is 2 * 1 unit matrixs, and B is for comprising described pre-service array
Figure C20051003852900055
2 * 1 column matrix, B TBe the transposition of B, be row matrix.
Effect of the present invention is can isolate useful signal and noise signal in the short period of time by independent component analysis from the infrared spectroscopy signals that spectrometer obtains, the precision of raising infrared spectrometer.
Description of drawings
Fig. 1 infrared spectrum burbling noise schematic representation of apparatus;
The process flow diagram of Fig. 2 independent component analysis.
The effect of Fig. 3 centering ir data denoising
Fig. 4 is to the effect of near infrared spectrum data denoising
Embodiment
Below in conjunction with accompanying drawing the present invention is described in further detail.
Fig. 1 has shown according to the preferred embodiment of the present invention, has been used for the schematic representation of apparatus of noise in the separate red external spectrum.This device comprises pretreater, independent component analysis device, spectral signal selector switch,
Pretreater to spectrometer for the first time, the original signal of gathering for the second time carries out centralization and albefaction is handled, and exports a pre-service array that two vectors are arranged
Figure C20051003852900056
The independent component analysis device is used for accepting pretreater output
Figure C20051003852900057
And export current two coefficient vectors { w → 1 ( n ) , w → 2 ( n ) } , These two coefficient vectors use independent component analysis method to calculate, and n represents the current iteration number of times of independent component analysis method.
Be described in detail this isolated component method below and how infrared spectrometer gathered that noise separation in the infrared spectroscopy signals that reaches comes out.Allow useful infrared signal and the independence between the noise signal maximize, promptly useful infrared signal and noise signal return to its mixed virgin state, and this mixed signal is exactly the original spectrum signal that spectrometer collects.
The spectral signal selector switch is by right
Figure C20051003852900059
Carry out energy spectrometer and determine noise signal and useful signal, obtain the useful infrared spectroscopy signals that noise separation is gone out.
Fig. 2 is the process flow diagram of independent component analysis among the present invention, and this process flow diagram is two-dimentional neuron isolated component algorithm, and this algorithm can be finished by the independent component analysis device among Fig. 1.
Independent component analysis method among Fig. 2 is controlled current two coefficient vectors { w → 1 ( n ) , w → 2 ( n ) } , This independent component analysis method is by the signal that comprises pretreater output among Fig. 1
Figure C20051003852900062
The nonlinear function (Bexp (B of matrix B 2/ 2)) realize, shown in following formula (1).
w(n)=w(n-1)+(I-2Bexp(-B 2/2)B T)w(n-1)
Wherein, w (n) is included as two current coefficient vectors { w → 1 ( n ) , w → 2 ( n ) } , Two coefficient vectors that once calculate before w (n-1) comprises { w → 1 ( n - 1 ) , w → 2 ( n - 1 ) } ; I is 2 * 1 unit matrixs, and B is for comprising described pre-service array
Figure C20051003852900065
2 * 1 column matrix, B TBe the transposition of B, be row matrix.
When opening infrared spectrum burbling noise device, at first at the pretreater place, to spectrometer for the first time, the original signal of gathering for the second time carries out centralization and albefaction is handled, and exports a pre-service array that two vectors are arranged
Figure C20051003852900066
Then, the independent component analysis device analytic process among Fig. 1 is carried out initialization earlier as shown in Figure 2, produces at random w ( 0 ) = { w → 1 ( 0 ) , w → 2 ( 0 ) } , N=1 produces I and B in the formula (1) simultaneously, and the independent component analysis device among Fig. 1 calculates above formula (1) then, exports two current coefficient vectors { w → 1 ( n ) , w → 2 ( n ) } ; Determine whether two coefficient vectors of isolated component output restrain, on same direction, promptly their dot product equals 1 or be approximately equal to 1 to the new value that " convergence " here refers to w with old value.If restrain current coefficient is final isolated component coefficient, if do not restrain then n is added 1, and then carries out formula (1) computing, till convergence.
The independent component analysis method of Fig. 2 can carry out in short convergence time.Therefore, when the infrared spectrum burbling noise device of Fig. 1 is installed on the infrared spectrometer data acquisition system (DAS) and by the estimated useful infrared spectroscopy signals output of this independent component analysis method, the user can obtain low noise, high-precision infrared spectrum at short notice.
Fig. 3 is the effect with apparatus and method centering ir data of the present invention denoising, and Fig. 4 is with the effect of apparatus and method of the present invention to the near infrared spectrum data denoising.The random noise of instrument and ground unrest all have been separated as can be seen among the figure.

Claims (2)

1. based on the infrared spectrum denoising device of isolated component, it is characterized in that comprising spectrometer, pretreater, independent component analysis device, the spectral signal selector switch that links to each other successively through data-signal; Described pretreater take centralization and albefaction to spectrometer for the first time, the original signal of gathering for the second time handles; Described independent component analysis device uses independent component analysis method to determine current two coefficient vectors of output
Figure C2005100385290002C1
Described spectral signal selector switch adopts energy spectrometer to determine noise signal and useful signal,
Described independent component analysis device is to determine described current two coefficient vectors according to following formula W (n)=w (n-1)+(I-2B exp (B 2/ 2) B T) w (n-1), wherein, w (n) is included as two current coefficient vectors Two coefficient vectors that once calculate before w (n-1) comprises
Figure C2005100385290002C4
Figure C2005100385290002C5
N represents the current iteration number of times of independent component analysis method, and I is 2 * 1 unit matrixs, B be comprise to spectrometer for the first time, the original signal of gathering for the second time carries out centralization and albefaction is handled, and exports a pre-service array that two vectors are arranged
Figure C2005100385290002C6
2 * 1 column matrix, B TBe the transposition of B, be row matrix; Produce at random w ( 0 ) = { w → 1 ( 0 ) , w → 2 ( 0 ) } N=1 produces I and B in the above-mentioned formula simultaneously, calculates above-mentioned formula then, exports two current coefficient vectors
Figure C2005100385290002C9
Figure C2005100385290002C10
Determine whether two coefficient vectors of isolated component output restrain, on same direction, promptly their dot product equals 1 or be approximately equal to 1 to the new value that " convergence " here refers to w (n) with old value; If restrain current coefficient is final isolated component coefficient, if do not restrain then n is added 1, and then carries out above-mentioned formula operation, till convergence.
2. based on the infrared spectrum denoising method of isolated component, it is characterized in that may further comprise the steps:
(1) at first at the pretreater place, to spectrometer for the first time, the original signal of gathering for the second time carries out centralization and albefaction is handled, and exports a pre-service array that two vectors are arranged
Figure C2005100385290002C11
(2) the independent component analysis device is set then and is used for accepting pretreater output
Figure C2005100385290002C12
And export current two coefficient vectors
Figure C2005100385290002C13
(3) the spectral signal selector switch is by right (n) carry out energy spectrometer and determine noise signal and useful signal;
Described independent component analysis device is to determine described current two coefficient vectors according to following formula W (n)=w (n-1)+(I-2B exp (B 2/ 2) B T) w (n-1), wherein, w (n) is included as two current coefficient vectors
Figure C2005100385290002C16
Two coefficient vectors that once calculate before w (n-1) comprises
Figure C2005100385290003C1
Figure C2005100385290003C2
N represents the current iteration number of times of independent component analysis method, and I is 2 * 1 unit matrixs, and B is for comprising described pre-service array
Figure C2005100385290003C3
2 * 1 column matrix, B TBe the transposition of B, be row matrix; Produce at random w ( 0 ) = { w → 1 ( 0 ) , w → 2 ( 0 ) } N=1 produces I and B in the above-mentioned formula simultaneously, calculates above-mentioned formula then, exports two current coefficient vectors
Figure C2005100385290003C6
Determine whether two coefficient vectors of isolated component output restrain, on same direction, promptly their dot product equals 1 or be approximately equal to 1 to the new value that " convergence " here refers to w (n) with old value; If restrain current coefficient is final isolated component coefficient, if do not restrain then n is added 1, and then carries out above-mentioned formula operation, till convergence.
CNB2005100385293A 2005-03-23 2005-03-23 Method and device for separating noise signal from infrared spectrum signal by independent vector analysis Expired - Fee Related CN100449282C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2005100385293A CN100449282C (en) 2005-03-23 2005-03-23 Method and device for separating noise signal from infrared spectrum signal by independent vector analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005100385293A CN100449282C (en) 2005-03-23 2005-03-23 Method and device for separating noise signal from infrared spectrum signal by independent vector analysis

Publications (2)

Publication Number Publication Date
CN1657888A CN1657888A (en) 2005-08-24
CN100449282C true CN100449282C (en) 2009-01-07

Family

ID=35007520

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005100385293A Expired - Fee Related CN100449282C (en) 2005-03-23 2005-03-23 Method and device for separating noise signal from infrared spectrum signal by independent vector analysis

Country Status (1)

Country Link
CN (1) CN100449282C (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102539370B (en) * 2011-11-11 2014-06-04 西安交通大学 Filtering method for fourier transform infrared spectrum online analysis of multi-component gas
CN103308165B (en) * 2013-05-29 2015-10-28 南京宝光检测技术有限公司 The method of the balanced spectrum of all band is obtained based on subsection integral matching method
CN104236707B (en) * 2014-09-23 2016-05-18 中国科学院光电研究院 A kind of prism color dispersion-type imaging spectrometer band noise cancellation method
CN104954704B (en) * 2015-06-01 2018-08-31 北京华泰诺安探测技术有限公司 One kind being used for Raman spectrometer ccd signal noise-reduction method
CN106803239B (en) * 2016-12-26 2019-07-26 浙江工业大学 Image de-noising method based on ICA and NLTV
CN106897971B (en) * 2016-12-26 2019-07-26 浙江工业大学 Non local TV image de-noising method based on independent component analysis and singular value decomposition

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004029754A (en) * 2002-05-10 2004-01-29 Univ Kinki Method for restoring target sound based on division spectrum by using position information of sound source
JP2004069772A (en) * 2002-08-01 2004-03-04 Denso Corp Noise eliminator, speech recognition device, and speech communication device
WO2004095425A1 (en) * 2003-04-21 2004-11-04 Wavecom Corporation Method for isolating sound source by independent component analysis, sound source isolation processing system, and computer software program for the same
US20050060142A1 (en) * 2003-09-12 2005-03-17 Erik Visser Separation of target acoustic signals in a multi-transducer arrangement

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004029754A (en) * 2002-05-10 2004-01-29 Univ Kinki Method for restoring target sound based on division spectrum by using position information of sound source
JP2004069772A (en) * 2002-08-01 2004-03-04 Denso Corp Noise eliminator, speech recognition device, and speech communication device
WO2004095425A1 (en) * 2003-04-21 2004-11-04 Wavecom Corporation Method for isolating sound source by independent component analysis, sound source isolation processing system, and computer software program for the same
US20050060142A1 (en) * 2003-09-12 2005-03-17 Erik Visser Separation of target acoustic signals in a multi-transducer arrangement

Also Published As

Publication number Publication date
CN1657888A (en) 2005-08-24

Similar Documents

Publication Publication Date Title
CN100449282C (en) Method and device for separating noise signal from infrared spectrum signal by independent vector analysis
Abitbol et al. Prospects for measuring cosmic microwave background spectral distortions in the presence of foregrounds
KR102037195B1 (en) Voice detection methods, devices and storage media
EP4141458A1 (en) Fault arc signal detection method using convolutional neural network
CN106443379A (en) Transformer partial discharge fault type identifying method and transformer partial discharge fault type identifying device
Heber et al. A spectroscopic study of HB stars in the galactic globular cluster NGC 6752
CN105158200B (en) A kind of modeling method for improving the Qualitative Analysis of Near Infrared Spectroscopy degree of accuracy
CN111050315B (en) Wireless transmitter identification method based on multi-core two-way network
US20050258357A1 (en) System and method for extracting spectra from data produced by a spectrometer
CN109991479A (en) The sudden and violent real-time detection apparatus, system and method for the Rapid Radio of multibeam receiver
CN101399930B (en) Method for intelligently channel scanning and related apparatus
CN113229829A (en) Quaternion electroencephalogram signal extraction method and system
CN108494508A (en) The high-efficiency frequency spectrum detection method restored based on MWC associated support collection
CN102135496A (en) Infrared spectrum quantitative analysis method and infrared spectrum quantitative analysis device based on multi-scale regression
CN114757224A (en) Specific radiation source identification method based on continuous learning and combined feature extraction
US20030149711A1 (en) Filter bank approach to adaptive filtering method using independent component analysis
Ziehe et al. A comparison of ICA-based artifact reduction methods for MEG
CN102685049B (en) Fractional order channelized separation method for reaching two linear frequency modulation (LFM) signals at the same time
US7299161B2 (en) Decorrelation of signals
CN100445959C (en) System and method for extracting spectra from data produced by a spectrometer
CN102879098B (en) Rapid interference imaging method and rapid interference imaging device for narrow-band hyperspectrum
CN112422212B (en) Data self-adaptive wireless communication channel prediction method, storage medium and equipment
CN101813770B (en) Simulation method for remote sensing data under arbitrary spectral response characteristic
CN103903631A (en) Speech signal blind separating method based on variable step size natural gradient algorithm
Bittanti et al. High-accuracy fit of the poles of spectroscopy amplifiers designed for mixed analog-digital filtering

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract

Assignee: Jiangsu Yingyang Industrial Co., Ltd.

Assignor: Jiangsu University

Contract record no.: 2010320000479

Denomination of invention: Method and device for separating noise signal from infrared spectrum signal by independent vector analysis

Granted publication date: 20090107

License type: Exclusive License

Open date: 20050824

Record date: 20100428

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090107

Termination date: 20160323