CN105306066A - Method of lossless compression of oil well data based on Taylor series estimation - Google Patents

Method of lossless compression of oil well data based on Taylor series estimation Download PDF

Info

Publication number
CN105306066A
CN105306066A CN201510796740.5A CN201510796740A CN105306066A CN 105306066 A CN105306066 A CN 105306066A CN 201510796740 A CN201510796740 A CN 201510796740A CN 105306066 A CN105306066 A CN 105306066A
Authority
CN
China
Prior art keywords
data
point
error
taylor series
estimated value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510796740.5A
Other languages
Chinese (zh)
Other versions
CN105306066B (en
Inventor
王卫江
高巍
史玥婷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Technology BIT
Original Assignee
Beijing Institute of Technology BIT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Technology BIT filed Critical Beijing Institute of Technology BIT
Priority to CN201510796740.5A priority Critical patent/CN105306066B/en
Publication of CN105306066A publication Critical patent/CN105306066A/en
Application granted granted Critical
Publication of CN105306066B publication Critical patent/CN105306066B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses a method of lossless compression of oil well data based on Taylor series estimation, and belongs to the field of data compression processing. According to the method, an oil well data curve is fitted through decomposition of Taylor series, then, backward estimation is carried out, and lossless compression of data is realized through transmitting estimation error of a fitted value and an actual value. Moreover, according to actual application situation, a method of adaptively selecting Taylor series decomposition order of minimum compression rate is designed. The method of lossless compression of oil well data based on Taylor series estimation is suitable for an oil field data remote transmission system, and can effectively reduce data load of a transmission network.

Description

Based on the well data lossless compression method that Taylor series are estimated
Technical field
This method relates to the well data Lossless Compression estimated based on Taylor series, effectively can reduce the load of well data transmission network.
Background technology
Due to the intensification of Oilfield Information degree, transmitted data amount sharply increases, but is subject to the restriction of oil field geographical environment, and these information are mainly through wireless network transmissions.A wireless network for internal proprietary, as ZigBee-network; Another kind is third party's Operation Network, as GPRS or 3G network.The former bandwidth is less, is difficult to the transmission quantity that load is increasing; The latter is with roomy, but belongs to charge network, takies civilian resource.Therefore, the mode of directly transmission, has not been suitable for the demand of digitlization oil field big data quantity.The method of more existing research oil well data compressions at present.RDP (Ramer-Douglas-Peucker) algorithm, expresses the key point of this curve shape feature by only retaining being enough on curve, realize data compression, but data precision exists obviously error at deletion point place, and belongs to lossy compression method.Somebody proposes one and does singular value decomposition to mass data, carrys out approximate fits data, reach the object of data compression with the base vector obtained, but algorithm amount of calculation is large, cannot meet the real-time Transmission of well data.In addition, some classical general data compression algorithms: huffman compression coding, arithmetic coding, Run-Length Coding, lzw algorithm etc., these algorithms all do not consider the feature of well data, effectively can not realize the compression of well data.
Summary of the invention
In order to realize the high efficiency of transmission of well data, taking into full account its data and curves correlation, proposing a kind of new lossless compression algorithm.First utilizing Tavlor series expansion to simulate well data curve, then carry out backward estimation, by transmitting the evaluated error of match value and actual value, realizing the Lossless Compression of data.And according to practical situations, design the method for the Tavlor series expansion exponent number of adaptively selected minimal compression rate.
The object of the invention is to be achieved through the following technical solutions.
The well data lossless compression method estimated based on Taylor series of the present invention, step is:
1) according to oil well actual acquired data situation, by calculating minimal compression rate, the optimal factor M of Tavlor series expansion is determined.
Described compression ratio calculates, and is the data after being compressed by following steps and the data before compression, the bit wide ratio after quantification.
2) to the data collected, by M rank Taylor series expansion, coefficient (a is solved 0, a 1..., a m).The coefficient of described Tavlor series expansion is determined to utilize front M+1 known point, lists M+1 decomposition formula, obtains by separating math equation calculating.
3) according to step 1) and step 2) M that obtains and (a 0, a 1..., a m), converse M+2 point with above M+1 put relation.
Described conversion method utilizes the correlation of well data and the character of Taylor series, simulates the value of M+2 point according to the coefficient of trying to achieve, exponent number
4) according to step 3) estimated value that calculates, obtain the error of M+2 point.
The calculating of described estimated value error, is the estimated value utilizing matching to obtain, subtracts each other with actual value, obtain error.
5) according to step 3) any relational expression after the known point that obtains and known point, step by step calculation goes out the estimated value of follow-up data, and the error of estimated value and actual value.
6) transmitting data is steps 2) in the known point of M+1 and step 5) error amount from M+2 point that calculates.
7) carrying out decompression processing to the data received, is utilize step 1) to step 3) method calculate the estimated value of subsequent point according to a front M+1 known point, then be superimposed with error, namely Distortionless goes out initial data.
Beneficial effect
The inventive method is estimated to realize lossless date-compress by Taylor series expansion, have the advantages that time space complexity is low, be applicable to oil field data distance transmission system, verified by the real system in certain oil field, transmitting network data load can be reduced to 45%.
Accompanying drawing explanation
Fig. 1 is that the system of the inventive method realizes block diagram;
Fig. 2 utilizes the power function of different rank to carry out compression effectiveness figure to electrical quantity data.
Embodiment
Below in conjunction with drawings and Examples, the present invention will be further described.
Embodiment
1) discrete type well data actual acquisition arrived is by M rank Tavlor series expansion.
Described decomposed form is, well data function representation is: y n=f (x n) | x n=nT s, n ∈ [1, N], wherein, T sit is the sampling period.Function decomposition is M rank: y n=a mx n m+ ... + a 1x n+ a 0+ e n.
2) determine by step 1) in the variable of Tavlor series expansion: M (optimal factor of function); a m~ a 0(coefficient of function).
First according to the Cramer rule solving linear equation, determine that M+1 coefficient needs M+1 independently linear equation, introduce assumed condition: e n=0, n ∈ [1, M+1].
Can by step 1) M rank breakdown be modified to: y 1 = a M x 1 M + ... + a 1 x 1 + a 0 y 2 = a M x 2 M + ... + a 1 x 2 + a 0 . . . y M + 1 = a M x M + 1 M + ... + a 1 x M + 1 + a 0 ,
Be rewritten into matrix form: y=Xa.Again because x n=nT s, n ∈ [1, N], so X is generalized circular matrix, only has relation with matching exponent number M, after be denoted as X m+1, meet full rank condition: r (X m+1)=M+1, the inverse matrix of existence anduniquess and coefficient vector: a=X m+1 -1y.Optimal factor M, determine according to minimal compression rate, concrete grammar is see step 6).
3) according to step 2) the coefficient a that obtains and front M+1 known point X, converse the relation with M+2 point, thus estimate the value of M+2 point, obtain the error of estimated value and actual value.
The estimated value of M+2 point: y ^ M + 2 = a M x M + 2 M + a M - 1 x M + 2 M - 1 + ... + a 0 = x M + 2 M x M + 2 M - 1 ... x M + 2 0 a = mX M + 1 - 1 y
And m and all only relevant with the value of matching exponent number M.Order be rewritten as the linear combination about y: y ^ M + 2 = b y = b M + 1 y M + 1 + b M y M + ... + b 1 y 1 Evaluated error is: e M + 2 = y M + 2 - y ^ M + 2
4) according to above-mentioned steps 1), step 2), step 3) method, regard the 1st as to M+1 bit data the 2nd to M+2 bit data, use same algorithm for estimating, progressively obtain the error amount that follow-up data is corresponding.
When after this estimating M+i point: obtain evaluated error sequence: E=(e m+2, e m+3..., e n)
5) the transmission data after having processed are compressed.
The data sequence Y of initial M+1 point only need be transmitted in transmitting procedure init=(y 1, y 2..., y m+1) and evaluated error sequence { E}, namely data sequence waiting for transmission is: Y trans=(y 1, y 2..., y m, e m+1..., e n)
6) decompression processing is carried out to reception data, recover initial data.
Receiving terminal decompression procedure is the inverse process of compression, namely first can obtain out generalized circular matrix X by matching exponent number M m+1, then utilize M+1 initiation sequence { Y initaccording to step 1) and step 2) just can obtain Taylor Series coefficient vector a, then estimate next point data by these Taylor series finally by the error e received m+2to estimated value revise, the actual value y of M+2 point can be obtained m+2.Repeat above-mentioned decompression procedure, finally can realize data convert.
7) from transducer collects data, intercept one-period, utilize step 1) to step 4) method carry out compression and calculate, from M=1, obtain a temporary transient maximum estimated error magnitude: Δ E=max (E)-min (E).The Δ E on calculated for subsequent M+1 rank, circulates successively, when maximum estimated error magnitude becomes increase from the trend reduced, can jump out circulation, determine the matching exponent number of best Taylor series.Utilize the power function of different rank to compress electrical quantity data, the compression result obtained as shown in Figure 2.

Claims (1)

1., based on the well data lossless compression method that Taylor series are estimated, it is characterized in that, comprise following steps:
Step one: according to oil well actual acquired data situation, by calculating minimal compression rate, determines the optimal factor M of Tavlor series expansion.
Described compression ratio calculates, and is the data after being compressed by following steps and the data before compression, the bit wide ratio after quantification.
Step 2: to the data collected, by M rank Taylor series expansion, solves coefficient (a 0, a 1..., a m).
The coefficient of described Tavlor series expansion is determined to utilize front M+1 known point, lists M+1 decomposition formula, obtains by separating math equation calculating.
Step 3: the M obtained according to step one and step 2 and (a 0, a 1..., a m), converse M+2 point with above M+1 put relation.
Described conversion method utilizes the correlation of well data and the character of Taylor series, simulates the value of M+2 point according to the coefficient of trying to achieve, exponent number
Step 4: the estimated value calculated according to step 3, obtains the error of M+2 point.
The calculating of described estimated value error, is the estimated value utilizing matching to obtain, subtracts each other with actual value, obtain error.
Step 5: any relational expression after the known point obtained according to step 3 and known point, step by step calculation goes out the estimated value of follow-up data, and the error of estimated value and actual value.
Step 6: transmission data are error amounts from M+2 point that the known point of M+1 in step 2 and step 5 calculate.Carry out decompression processing to the data received, be the estimated value utilizing step one to the method for step 3 to calculate subsequent point according to a front M+1 known point, then be superimposed with error, namely Distortionless goes out initial data.
CN201510796740.5A 2015-11-18 2015-11-18 Well data lossless compression method based on Taylor series estimation Active CN105306066B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510796740.5A CN105306066B (en) 2015-11-18 2015-11-18 Well data lossless compression method based on Taylor series estimation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510796740.5A CN105306066B (en) 2015-11-18 2015-11-18 Well data lossless compression method based on Taylor series estimation

Publications (2)

Publication Number Publication Date
CN105306066A true CN105306066A (en) 2016-02-03
CN105306066B CN105306066B (en) 2018-12-04

Family

ID=55202905

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510796740.5A Active CN105306066B (en) 2015-11-18 2015-11-18 Well data lossless compression method based on Taylor series estimation

Country Status (1)

Country Link
CN (1) CN105306066B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108981990A (en) * 2018-07-25 2018-12-11 中国石油天然气股份有限公司 Indicator

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1172539A (en) * 1995-01-31 1998-02-04 摩托罗拉公司 Logarithm/inverse-logarithm converter utilizing truncated taylor series and method of use thereof
US5836003A (en) * 1993-08-26 1998-11-10 Visnet Ltd. Methods and means for image and voice compression
CN101515922A (en) * 2008-02-20 2009-08-26 苏盛 Method for transmitting dynamic process data of power networks in data acquiring-monitoring systems

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5836003A (en) * 1993-08-26 1998-11-10 Visnet Ltd. Methods and means for image and voice compression
CN1172539A (en) * 1995-01-31 1998-02-04 摩托罗拉公司 Logarithm/inverse-logarithm converter utilizing truncated taylor series and method of use thereof
CN101515922A (en) * 2008-02-20 2009-08-26 苏盛 Method for transmitting dynamic process data of power networks in data acquiring-monitoring systems

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108981990A (en) * 2018-07-25 2018-12-11 中国石油天然气股份有限公司 Indicator

Also Published As

Publication number Publication date
CN105306066B (en) 2018-12-04

Similar Documents

Publication Publication Date Title
CN103458460B (en) Method and device for compressing and decompressing signal data
CN107395211B (en) Data processing method and device based on convolutional neural network model
CN109495744B (en) Large-magnification remote sensing image compression method based on joint generation countermeasure network
CN101640803B (en) Progressive distribution type encoding and decoding method and device for multispectral image
CN103136239B (en) Transportation data loss recovery method based on tensor reconstruction
CN108495132B (en) The big multiplying power compression method of remote sensing image based on lightweight depth convolutional network
CN103997395B (en) Change system decoding method based on MIMO radar communicating integral signal
CN101431691B (en) Fast parallel compression method for high dynamic range image
CN108989817A (en) A kind of radar data compression method based on reference frame dislocation prediction
CN110751265A (en) Lightweight neural network construction method and system and electronic equipment
CN102905137B (en) The quick difference vector of ultraphotic spectrum signal quantizes compaction coding method
CN116827350B (en) Flexible work platform intelligent supervision method and system based on cloud edge cooperation
CN102685501B (en) Fixed-point wavelet transform method for joint photographic experts group 2000 (JPEG2000) image compression
CN113595993A (en) Vehicle-mounted sensing equipment joint learning method for model structure optimization under edge calculation
CN102523453A (en) Super large compression method and transmission system for images
CN105306066A (en) Method of lossless compression of oil well data based on Taylor series estimation
CN102256137B (en) Context-prediction-based polar light image lossless coding method
CN102695055B (en) JPEG_LS (Joint Pho-tographic Experts Group-Lossless Standard) bit rate control method under high bit rate
CN111479286A (en) Data processing method for reducing communication flow of edge computing system
CN101718867A (en) Forecasting coefficient estimation method and device applicable to hyperspectral image compression
RU2419246C1 (en) Method to compress and recover fixed halftone video images
Sacaleanu et al. Compression scheme for increasing the lifetime of wireless intelligent sensor networks
CN103985096A (en) Hyperspectral image regression prediction compression method based on off-line training
CN114663307B (en) Integrated image denoising system based on uncertainty network
CN116341616A (en) Electric load information acquisition method based on matrix reconstruction two-dimensional convolution network

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Wang Weijiang

Inventor after: Shi Yueting

Inventor after: Gao Wei

Inventor before: Wang Weijiang

Inventor before: Gao Wei

Inventor before: Shi Yueting

CB03 Change of inventor or designer information
GR01 Patent grant
GR01 Patent grant