GB2265710A - Data compression of FTIR Spectra - Google Patents

Data compression of FTIR Spectra Download PDF

Info

Publication number
GB2265710A
GB2265710A GB9206965A GB9206965A GB2265710A GB 2265710 A GB2265710 A GB 2265710A GB 9206965 A GB9206965 A GB 9206965A GB 9206965 A GB9206965 A GB 9206965A GB 2265710 A GB2265710 A GB 2265710A
Authority
GB
United Kingdom
Prior art keywords
spectrum
auto
model
order
ftir
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB9206965A
Other versions
GB9206965D0 (en
GB2265710B (en
Inventor
Anthony Kevin Booer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Services Petroliers Schlumberger SA
Original Assignee
Services Petroliers Schlumberger SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Services Petroliers Schlumberger SA filed Critical Services Petroliers Schlumberger SA
Priority to GB9206965A priority Critical patent/GB2265710B/en
Publication of GB9206965D0 publication Critical patent/GB9206965D0/en
Publication of GB2265710A publication Critical patent/GB2265710A/en
Application granted granted Critical
Publication of GB2265710B publication Critical patent/GB2265710B/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/35Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J2003/283Investigating the spectrum computer-interfaced
    • G01J2003/284Spectral construction
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/35Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
    • G01N2021/3595Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light using FTIR
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/35Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
    • G01N21/3563Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light for analysing solids; Preparation of samples therefor

Abstract

A method for processing IR spectra, e.g. of drilling fluids or cement slurries, to achieve data compression while retaining important features, comprises the following steps: generate spectrum, obtain autocorrelation sequence for spectrum, select a desired order for an auto regressive model, calculate auto regressive coefficient from the autocorrelation sequence and the selected order so as to construct an autoregressive model, calculate the poles of the autoregressive model, and solve the characteristic equation. <IMAGE>

Description

METHOD FOR PROCESSING INFRARED SPECTRAL DATA The present invention relates to a method for processing spectroscopic data. In particular, the invention relates to a method of processing Fourier Transform Infra Red spectral data so as to compress the data contained therein while retaining the important characteristic. However, it will be appreciated that the invention is not restricted to this alone.
The technique of FTIR analysis is well known. An absorption or transmission spectrum, typically in the wavenumber (frequency) domain, is generated from an interferogram produced by the analyser. Each spectrum might typically contain 2000 datapoints and so it is desirable to reduce the number of datapoints for a spectrum when a large number of spectra need to be analysed, especially if individual features must be identified. Peak picking procedures for data extraction have problems in estimating absorption in closely spaced peaks or dealing with noise.
It is an object of the present invention to provide a method for processing infrared spectral data so as to achieve data compression while retaining important spectral information.
The method according to the present invention comprises the following steps: 1 Generate spectrum 2 Obtain autocorrelation sequence for spectrum 3 Select a desired order (p) for an autoregressive model 4 Calculate auto regressive coefficient from the autocorrelation sequence and the selected order so as to construct an autoregressive model [n] 5 Calculate the poles (Zk)of the autoregressive model
wherein hk = Ak exp(j6 Zk = exp [(ak +j 2n: fk)?l and Ak = amplitude Ok = phase ak = decay rate fk = frequency = < T = sampling interval The present method is applicable to HIR spectra.The values of such spectra are not the original interference pattern but are the result of subsequent FT analysis.
However, the autocorrelation sequence for a spectrum can be obtained by using an inverse Fourier transform on this data. The autocorrelation sequence obtained can then be used to formulate an autoregressive (AR) model of order p. The order p of the model is selected such that it is greater than the number of peaks expected in the spectrum (since the exact number are not known and the model would not work if the order is less than the number of peaks). The spectrum will also contain noise which should also be modelled which also required a larger order than this expected number. In order to avoid problems with the model assigning more than one peak where only one is appropriate, it is desirable to ensure that the model order is typically less than twice the number of expected peaks.
The AR model can be used to express the spectrum H(eis0) as
and the coefficients a[M] (M = l...p) determined by calculating the solution of the AR Yule Walker normal equations
It is assumed, from the present invention, that the underlying mechanism which results in a measured FTIR spectrum is that of a discrete number of exponentially damped resonances.The model x for the Time domain data x[l]...x[Nl (sampling interval T) is
where the complex constants hk and Zk are defined as hk =Aexp(jO (jOk) Zk = exp [(&alpha;k + j2# fx)T] [V1 where amplitude Ak, phase ok. decay rate ak, frequency fk and real, j = < and ak < 0 so IZkl < l.
Equation [El can also be written as
The matrix of elements Zk is Vandermonde (t = Zi-1j) and if Zk are known, the equation is simply a set of simultaneous equations (in a least squares sense) for the complex amplitudes hk. It can be shown that Zk are the roots of the characteristic equation associated with a linear difference equation
for p+l < n < N where a[Ml are chosen to minimise
Once the coefficients a[m] have been determined from [11], the linear difference equation [VII1 can be used to construct a time domain representation x' of the AR spectrum thus
where #[n]= #e #[n]= 6e if n = 0 0 if n # 0 The values Zk are the poles of the AR model and can be calculated by finding the roots of the coefficient polynomial a[m]. The values calculated from Zk and x'[m] (substituted for x[n]) can be used in equation [V'] to calculate the values of hk.
The present invention will now be described in further detail with reference to the accompanying drawings, in which: - Figures 1 (a) and (b) comprise examples of ETIR spectra of a cement slurry and a dried mud powder respectively; - Figures 2(a) and (b) comprise the autoregressive model spectrum for the cement slurry and the residual error between the model and the raw spectrum; - Figures 3(a) and (b) comprise corresponding spectra and error for.a dried mud sample; - Figures 4(a) and (b) comprise wavenumber/amplitude and decay timel wavenumber parameters for the AR model of cement data; - Figures 5(a) and (b) comprise reduced parameters for Figures 4(a) and (b); - Figures 6(a) and (b) and 7(a) and (b) show corresponding parameters for dried mud data;; - Figure 8 shows a reconstructed cement spectrum; and - Figure 9 shows a reconstructed mud spectrum.
The invention finds particular use in the decomposition of FTIR spectra for quantitative analysis of oilfield cements and drilling muds. Such spectra are particularly complex but contain useful chemical and physical information. The automatic analysis of a number of spectra is desirable but problems may occur if the number of datapoints in each spectrum is large since the time taken for analysis will increase greatly. Matlab codes for FTIR spectrum analysis and spectrum synthesis are shown in Appendices A and B below. Typical examples of cement and dried mud FTlR spectra are shown in Figures l(a) and (b) and as can be seen, both show a large amount of structure, at least some of which is due to noise or interference. In each case, it is expected that the spectrum will include about 25 peaks as an AR model order of 50 has been chosen.
Other similar spectra might contain 10-20 significant peaks so that the mode order can be chosen accordingly. Once the model order has been selected hk and Zk can be calculated for each of the 50 parameters in accordance with the method described generally above. The amplitude Ak can be obtained from hk Ak = Ihkl [X] and the frequency fk and decay time Xk from Zk. The decay time xk is obtained from the decay exponent ak thus
A complex set of parameters (Ak, Fk, Tk) can be obtained for a given period model order p.
Figures 4 and 6 show plots in the frequency (wavenumber) domain of Ak and xk.
As the model order is 50, there are 50 lines on each plot. In order to reduce the number of lines on each plot, only 25 significant points are taken. These are graded according to the energy of each "peak" which is related to the product Ak Tk. The values of the reduced parameters are shown in the table below and plotted in Figures 5 and 7. Table 1: Estimated wavenumbers, amplitudes, and decay times for cement and dried mud spectra. Values in parentheses are wavenumbers of some known components.
cement Dried Mud wavenumber amplitude decay time wavenumber amplitude decay time fk Xkx104 Xk fk Xk x 104 Xk 90 132 26 439 93 11 131 100 24 506 106 11 262 96 58 572 99 10 338 86 25 634 106 11 411 73 22 705 96 12 519 83 20 783 103 13 613 368 24 1 850 68 10 675 593 31 918 111 12 742 627 24 994 126 10 809 448 17 1041 100 9 886 367 14 1110 (1107) 123 10 949 371 14 1171 102 10 1108 (1113) 272 18 1234 78 10 1632 (1635) 502 22 1445 (1445) 128 10 1678 274 16 1642 (1637) 146 12 3024 159 13 2854 77 11 3096 307 15 2928 (2927) 111 12 3165 630 19 3132 87 7 3219 426 16 3202 103 7 3304 556 26 3260 110 7 3387 585 22 3327 122 7 3451 389 14 3393 132 8 3510 396 15 3460 118 8 3573 269 16 3523 101 7 3639 160 20 3635 (3621) 179 13 The values obtained from the 25 peaks can be used to reconstruct spectra which are shown in Figures 2(a) and 3(a). The residual error between the reconstructed spectra and the measured spectra are shown in Figures 2(b) and 3(b) respectively and are obtained by subtraction of spectra.

Claims (1)

  1. A method of processing Fourier Transform infra-red (FTIR) data comprising: a) generating a FnR spectrum of a sample being analysed; b) obtaining an auto-correlation sequence for the spectrum; c) selecting a desired order (p) for an auto-regressive model; d) calculating an auto-regressive coefficient from the autocorrelation sequence and the selected order (p) so as to construct an auto-regressive model x[n]; e) calculating the poles (Zk) of the auto-regressive model; and
    wherein hk = Ak exp(jEk) Zk = exp [(&alpha;k + j 2# fk)T] and Ak = amplitude ok = phase ak = decay rate fk = frequency = < T = sampling interval A method as claimed in claim 1, wherein the autocorrelation sequence is obtained by using an inverse Fourier Transform on the original spectral data.
    A method as claimed in claim 1 or 2, wherein the order (p) is selected so as to be greater than the expected number of peaks in the spectrum but less than twice this number.
    A method as claimed in any preceding claim for compositional analysis of a drilling fluid on cement slurry.
    A Matlab code for FTIR spectrum analysis function (fr, tau, am, X, R] = ftir2(s,f, p) %FTIR2 % ftir2(spectrum, frequency, order) - analyze FTIR spectrum for peak frequencies, heights, and decay rates n = length(s); fmin = min(f); fmax = max(f); % acs = (ifft(s.*s)); % auto-correl'n EA,v) = levinson(acs(l:p+1)); % AR parameters A = 1 ; A]; x = filter(l,A,tsqrt(v);zeros(n - 1,1)]); % impulse response X = abs(fft(x)); % spectrum R = roots(A); % pole locations an = angle(R)/(2*pi); fr = (an + (an < O)) * (fmax-fmin) + fmin; % unvrap frequency tau = - 1 ./ log(abs(R)); % decrement % V = vandermonde(R,0:(2*p-1)); am = V \ x(1:2*p); % solve L2 problem B Mat lab code for spectrum synthesis A synthetic spectrum may be reconstructed from model parameters using the following code: function X = recon(rt,am, l,p); %RECON % % X = recon(rt,am,l,p) % % reconstruct spectrum from roots and amplitudes % 1 is length of xtn] sequence, p is spectrum length.
    %.
    X = vandermonde(rt,O:(p-1)); x = V * am; X = abs(fft((x ; zeros(l-p,1)]));
GB9206965A 1992-03-31 1992-03-31 Method for processing infrared spectral data Expired - Fee Related GB2265710B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB9206965A GB2265710B (en) 1992-03-31 1992-03-31 Method for processing infrared spectral data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB9206965A GB2265710B (en) 1992-03-31 1992-03-31 Method for processing infrared spectral data

Publications (3)

Publication Number Publication Date
GB9206965D0 GB9206965D0 (en) 1992-05-13
GB2265710A true GB2265710A (en) 1993-10-06
GB2265710B GB2265710B (en) 1996-05-08

Family

ID=10713134

Family Applications (1)

Application Number Title Priority Date Filing Date
GB9206965A Expired - Fee Related GB2265710B (en) 1992-03-31 1992-03-31 Method for processing infrared spectral data

Country Status (1)

Country Link
GB (1) GB2265710B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996012173A1 (en) * 1994-10-14 1996-04-25 University Of Washington System for sensing droplet formation time delay in a flow cytometer
WO1996018089A1 (en) * 1994-12-09 1996-06-13 Foss Electric A/S A method of obtaining information
DE19726023A1 (en) * 1997-06-19 1998-12-24 Univ Dresden Tech Infrared spectroscopic process for building materials, e.g. clay
US20110141845A1 (en) * 2009-12-11 2011-06-16 Peacock G Scott High Fidelity Data Compression for Acoustic Arrays

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0341783A1 (en) * 1988-05-11 1989-11-15 Koninklijke Philips Electronics N.V. Method of and device for determining spectrum parameters of a spectrum related to spectroscopic signals
GB2225110A (en) * 1988-10-31 1990-05-23 Amoco Corp Obtaining composition logs of well bores

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0341783A1 (en) * 1988-05-11 1989-11-15 Koninklijke Philips Electronics N.V. Method of and device for determining spectrum parameters of a spectrum related to spectroscopic signals
GB2225110A (en) * 1988-10-31 1990-05-23 Amoco Corp Obtaining composition logs of well bores

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996012173A1 (en) * 1994-10-14 1996-04-25 University Of Washington System for sensing droplet formation time delay in a flow cytometer
WO1996018089A1 (en) * 1994-12-09 1996-06-13 Foss Electric A/S A method of obtaining information
AU691067B2 (en) * 1994-12-09 1998-05-07 Foss Electric A/S A method of obtaining information
DE19726023A1 (en) * 1997-06-19 1998-12-24 Univ Dresden Tech Infrared spectroscopic process for building materials, e.g. clay
US20110141845A1 (en) * 2009-12-11 2011-06-16 Peacock G Scott High Fidelity Data Compression for Acoustic Arrays
US8254210B2 (en) * 2009-12-11 2012-08-28 The Johns Hopkins University High fidelity data compression for acoustic arrays

Also Published As

Publication number Publication date
GB9206965D0 (en) 1992-05-13
GB2265710B (en) 1996-05-08

Similar Documents

Publication Publication Date Title
Jiang et al. Quasi-quadrennial and quasi-biennial variability in the equatorial Pacific
Gokhale et al. Time domain signal analysis using wavelet packet decomposition approach
Wesfreid et al. Adapted local trigonometric transforms and speech processing
US5479440A (en) Apparatus and method for impulsive noise cancellation
CN109031422A (en) A kind of seismic signal noise suppressing method based on CEEMDAN and Savitzky-Golay filtering
US5663929A (en) Drilling signal transmission method and system
Yang et al. Denoising UHF signal for PD detection in transformers based on wavelet technique
US5550788A (en) Method and system of analysis of the behavior of a drill string
GB2265710A (en) Data compression of FTIR Spectra
US5729124A (en) Estimation of signal frequency using fast walsh transform
van den Branden Lambrecht et al. Wavelet packets-based high-resolution spectral estimation
US7027942B1 (en) Multirate spectral analyzer with adjustable time-frequency resolution
KR920702101A (en) How to send a signal
Frost Power-spectrum estimation
Chen Seismic pattern recognition
CN109670531A (en) A kind of denoising method of the near infrared light spectrum signal based on Hodrick-Prescott filter
Kozek Matched generalized Gabor expansion of nonstationary processes
US5862516A (en) Method of non-harmonic analysis and synthesis of wave data
Nguyen et al. Matching pursuit of two dimensional seismic data and its filtering application
Coruh Stretched automatic amplitude adjustment of seismic data
Smallwood et al. Salvaging pyrotechnic data with minor overloads and offsets
Mitrofanov et al. Using of the Proni transform in processing of Chinese seismic data
Brown Real‐time filtering of data from mobile, passive remote infrared sensors with principal component models of background
Park Speech compression using ARMA model and wavelet transform
Teuner et al. An extension to the analytical Gabor expansion with applications in image coding

Legal Events

Date Code Title Description
PCNP Patent ceased through non-payment of renewal fee

Effective date: 20050331