CN112925678B - Distributed downhole data safe storage method for testing - Google Patents
Distributed downhole data safe storage method for testing Download PDFInfo
- Publication number
- CN112925678B CN112925678B CN202110264978.9A CN202110264978A CN112925678B CN 112925678 B CN112925678 B CN 112925678B CN 202110264978 A CN202110264978 A CN 202110264978A CN 112925678 B CN112925678 B CN 112925678B
- Authority
- CN
- China
- Prior art keywords
- data
- value
- missing
- testing
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
Abstract
The invention discloses a distributed underground data safe storage method for testing, which comprises the following steps: reading original data of a plurality of pressure gauges; step two, processing the original data by using an interleaving algorithm to obtain interleaved data; step three, the interleaved data is backed up to obtain a plurality of groups of backup data; storing a plurality of groups of backup data on a plurality of storage devices in a one-to-one correspondence manner; reading the data stored in the plurality of memory devices, and then respectively performing deinterleaving to obtain a plurality of groups of deinterleaved data; and step five, correcting the multiple groups of deinterleaving data to obtain restored original data of the multiple pressure gauges. According to the distributed underground data safety storage method for testing, provided by the invention, the data of a plurality of pressure gauges are mixed through interleaving, data increment backup is carried out, the data are respectively stored on a plurality of storage chips, and then the data are restored to the maximum extent through de-interleaving processing, so that the failure rate of stratum testing operation can be effectively reduced.
Description
Technical Field
The invention belongs to the technical field of petroleum and natural gas exploration and testing, and particularly relates to a distributed underground data safe storage method for testing.
Background
At present, when stratum testing is carried out, original data of a plurality of underground pressure gauges are stored in a storage device, and once a sector of a storage chip fails, data loss is irreversible, so that stratum testing operation fails. Along with the continuous expansion of the offshore oil and gas testing range, the aging requirement is improved, the working condition tends to be complex, the operation difficulty is more and more high, the unconventional operation amount is increased year by year, and the sector of a part of an underground data storage device is easy to lose efficacy in the underground high-temperature environment, so that the field operation is failed, and great economic and manual waste is caused. Therefore, how to effectively guarantee the reliability of downhole data storage is imperative.
Disclosure of Invention
The invention aims to provide a distributed underground data safe storage method for testing, which can effectively reduce the failure rate of stratum testing operation by mixing data of a plurality of pressure gauges through interweaving, respectively storing the data on a plurality of storage chips after performing data incremental backup, and then restoring the data to the maximum extent through deinterlacing processing.
The technical scheme provided by the invention is as follows:
a distributed downhole data safe storage method for testing comprises the following steps:
reading original data of a plurality of pressure gauges;
step two, processing the original data by using an interleaving algorithm to obtain interleaved data;
step three, the interleaved data is backed up to obtain a plurality of groups of backup data; storing the plurality of groups of backup data on a plurality of storage devices in a one-to-one correspondence manner;
reading the data stored in the plurality of storage devices, and then respectively performing deinterleaving to obtain a plurality of groups of deinterleaved data;
and fifthly, correcting the multiple groups of deinterleaving data to obtain restored original data of the multiple pressure gauges.
Preferably, in the third step, the backup data is at least two groups.
Preferably, in the fifth step, the correction processing includes comparing the plurality of sets of deinterleaved data and then performing mutual interpolation correction.
Preferably, the original data is a matrix of M × N in a memory of the processor, and the interleaved data is a matrix of N × M.
Preferably, the distributed downhole data safe storage method for testing further includes:
in the fifth step, when all the corresponding positions of the multiple sets of data have data missing, before performing the intercross correction, the method further includes supplementing the numerical value of each missing position of data into:
wherein x is ij ' represents a supplementary missing value, i represents the serial number of the row in which the missing value is located, and j represents the serial number of the column in which the missing value is located; x is a radical of a fluorine atom ij-gro1 ,x ij-gro2 ,……x ij-groP Respectively representing numerical values of missing positions of the No. 1 group, the No. 2 group, \8230theNo. 8230the No. P group data.
Preferably, the preset values of the numerical values of the data missing positions are as follows:
wherein N represents the group number of the data, N =1,2 \ 8230, P; x is the number of groN A value of default value, x, representing the missing position of the Nth group of data Nij-f Indicating the ith row in the Nth group of data is located at x ij The front position is closest to x ij Value of (a), x ij-b Indicates the ith row in the Nth group of data is located in x ij The rear position being closest to x ij Value of (a), x Ni-max Denotes the maximum value, x, of the ith row in the Nth group of data Ni-min Represents the minimum value of the ith row in the Nth group of data, mu N Means, σ, of i-th row in Nth group of data N Showing the standard deviation of the ith row in the Nth group of data, H showing the depth of the stratum where the pressure gauge corresponding to the ith row of data is located, H 0 A baseline value representing the depth of the formation.
The invention has the beneficial effects that:
according to the distributed underground data safety storage method for testing, provided by the invention, the data of a plurality of pressure gauges are mixed through interleaving, data increment backup is carried out, the data are respectively stored on a plurality of storage chips, and then the data are restored to the maximum extent through de-interleaving processing, so that the failure rate of stratum testing operation can be effectively reduced.
Drawings
FIG. 1 is a flow chart of a distributed downhole data security storage method for testing according to the present invention.
Fig. 2 is a schematic diagram of a storage form of raw data according to the present invention.
Fig. 3 is a schematic diagram of a data interleaving process according to the present invention.
Fig. 4 is a schematic diagram of a storage form of data after interleaving processing according to the present invention.
Fig. 5 is a schematic diagram illustrating recovery of deinterleaved data according to the present invention.
Detailed Description
The present invention is further described in detail below with reference to the attached drawings so that those skilled in the art can implement the invention by referring to the description text.
As shown in fig. 1, the invention provides a distributed downhole data safety storage method for testing, which is applied to an oil and gas well testing stage to realize a simulation test of a data wireless transmission technology based on electromagnetic waves, and after original data of four pressure gauges on a pressure gauge support cylinder in oil and gas formation testing operation are read, the data are an M × N matrix in a memory of a processor; then, the original data are mixed by interleaving using an interleaving algorithm, and the data become a matrix of N × M. Wherein, in the process of interleaving the data, the data is discretized; in the discretization data, the data of each pressure gauge is placed on different matrix positions, and the data are finally stored and distributed to different storage sectors on the memory according to the position difference; therefore, the loss of one pressure gauge data on continuous addresses caused by the failure of the sector of the high-temperature first storage device is effectively avoided. The interleaved data is backed up and then distributed and stored in different storage devices. When data needs to be read, data read from different memory devices are deinterleaved, M x N data matrixes obtained by deinterleaving on different memories are compared, and after effective data interpolation is carried out, the original data of each branch pressure gauge can be restored to the maximum extent. Thereby effectively avoiding the problem of pressure gauge data loss caused by the failure of the underground high-temperature memory.
As shown in fig. 1, the specific data processing process mainly includes the following parts:
(1) Data reading and sorting
As shown in fig. 2, the raw data from the 4 pressure gauges were placed in a data storage matrix of M x N.
(2) Data interleaving
As shown in fig. 3, the M × N data matrix is interleaved and transformed into an N × M data memory matrix by data interleaving processing, and interleaved data is obtained.
(3) And backing up the interleaved data, wherein the number of the backed-up data is at least two.
(4) As shown in fig. 4, the multiple copies of data obtained after backup are stored in a plurality of different memories in a one-to-one correspondence manner.
(5) And after reading the data stored in the plurality of different memories, respectively deinterleaving the plurality of data.
(6) Correcting and interpolating the deinterleaved data to recover data
As shown in fig. 5, after the data in the two (or more) memories are deinterleaved, the data are compared to identify the data lost due to the failure of the memory sector, and the two (or more) groups of data are interpolated and corrected with each other, so as to recover the original data.
If all the data in the corresponding positions of the multiple groups of data have data loss, the data in the data loss positions (common to all the groups of backup) need to be supplemented before mutual interpolation correction.
Firstly, calculating a preset value of data at each group of data missing positions:
wherein x is ij Representing a complement missing value, i indicates the number of the row in which the missing value is located, j indicates the number of the column in which the missing value is located, x ij-f Represents the ith lineIs located at x ij The front position is closest to x ij Value of (a), x ij-b Indicates the position in x in the ith row ij The rear position being closest to x ij Value of (a), x i-max Denotes the maximum value of the ith row, x i-min Represents the minimum value of the ith row, mu represents the average value of the ith row, sigma represents the standard deviation of the ith row, H represents the depth of the stratum where the pressure gauge corresponding to the ith row is located, H 0 A baseline value representing the depth of the formation. According to experience, H 0 The pressure gauge can be selected and set to be 1/3-1/2 of the maximum bottom layer depth applicable to the pressure gauge.
Through the calculation formula, the default values of the missing values of the corresponding positions of the multiple groups of backup data can be calculated, namely, a plurality of x values can be obtained ij When the backup data are P groups in total, the obtained numerical values are respectively marked as x ij-gro1 ,x ij-gro2 ,……x ij-groP ；x ij-gro1 ,x ij-gro2 ,……x ij-groP The deletion values calculated in group 1, group 2, \8230, group 8230and group P are shown.
The numerical value of the data missing position is finally determined as:
that is, the value of the position where the data is missing common to each set of backup data is supplemented as x ij '; and then normal mutual difference correction is performed.
After the numerical value of the missing position is supplemented through the method, the original data can be restored to a greater extent, and the stability and the safety of the stored data are further improved.
The invention adopts a distributed data storage method to respectively store data of a plurality of pressure gauges on two or more storage chips after interweaving and mixing the data and performing data incremental backup. The method can restore the data to the maximum extent from the subsequent de-interleaving and backup data re-interpolation mode even if partial sectors fail, and can effectively reduce the failure rate of stratum test operation. The invention can effectively solve the problem that the storage sector of the storage device is randomly invalid due to the high-temperature environment of the storage device in the data storage of the formation testing downhole pressure gauge.
While embodiments of the invention have been described above, it is not intended to be limited to the details shown, described and illustrated herein, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed, and to such extent that such modifications are readily available to those skilled in the art, and it is not intended to be limited to the details shown and described herein without departing from the general concept as defined by the appended claims and their equivalents.
Claims (3)
1. A distributed downhole data safe storage method for testing is characterized by comprising the following steps:
reading original data of a plurality of pressure gauges;
step two, processing the original data by using an interleaving algorithm to obtain interleaved data;
step three, the interleaved data is backed up to obtain a plurality of groups of backup data; storing the plurality of groups of backup data on a plurality of storage devices in a one-to-one correspondence manner;
reading the data stored in the plurality of storage devices, and then respectively performing deinterleaving to obtain a plurality of groups of deinterleaved data;
fifthly, correcting the multiple groups of deinterleaved data to obtain restored original data of the multiple pressure gauges;
in the fifth step, when all the corresponding positions of the multiple sets of deinterleaving data have data missing, before performing the mutual interpolation correction, the method further includes supplementing the numerical value of the missing position of each set of data as:
wherein x is ij ' represents a supplementary missing value, i represents the serial number of the row in which the missing value is located, and j represents the serial number of the column in which the missing value is located; x is the number of ij-gro1 ,x ij-gro2 ,……x ij-groP Respectively represent group 1, group 2,8230the numerical value of the missing position of the No. P group data is preset;
the preset values of the numerical values of the data missing positions are as follows:
wherein N represents the group number of the data, N =1,2 \8230P; x is the number of groN A value of default value, x, representing the missing position of the Nth group of data Nij-f Indicating the ith row in the Nth group of data is located at x ij The front position is closest to x ij Value of (a), x Nij-b Indicating the ith row in the Nth group of data is located at x ij The rear position being closest to x ij Value of (a), x Ni-max Denotes the maximum value, x, of the ith row in the Nth group of data Ni-min Denotes the minimum value, μ, of the ith row in the Nth group of data N Means, σ, of i-th row in Nth group of data N The standard deviation of the ith row in the Nth group of data is shown, H shows the depth of the stratum where the pressure gauge corresponding to the ith row of data is positioned, H 0 A baseline value representing the depth of the formation.
2. The distributed downhole data security storage method for testing as defined in claim 1, wherein in step five, the correction process includes performing mutual interpolation correction after comparing the plurality of sets of deinterleaved data.
3. The distributed downhole data security storage method for testing of claim 2, wherein the raw data is a matrix of M x N in a memory of a processor and the interleaved data is a matrix of N x M.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110264978.9A CN112925678B (en) | 2021-03-11 | 2021-03-11 | Distributed downhole data safe storage method for testing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110264978.9A CN112925678B (en) | 2021-03-11 | 2021-03-11 | Distributed downhole data safe storage method for testing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112925678A CN112925678A (en) | 2021-06-08 |
| CN112925678B true CN112925678B (en) | 2022-12-06 |
Family
ID=76172567
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110264978.9A Active CN112925678B (en) | 2021-03-11 | 2021-03-11 | Distributed downhole data safe storage method for testing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112925678B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102201892A (en) * | 2011-05-13 | 2011-09-28 | 中兴通讯股份有限公司 | Method and device for implementing interlacing or deinterlacing |
| CN108062262A (en) * | 2017-12-25 | 2018-05-22 | 厦门市美亚柏科信息股份有限公司 | Operating system backup-and-restore method and its system based on storage sector data |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10678225B2 (en) * | 2013-03-04 | 2020-06-09 | Fisher-Rosemount Systems, Inc. | Data analytic services for distributed industrial performance monitoring |
| TWI569587B (en) * | 2015-02-06 | 2017-02-01 | 晨星半導體股份有限公司 | Convolutional de-interleaver |
| CN109284069A (en) * | 2018-08-23 | 2019-01-29 | 郑州云海信息技术有限公司 | A kind of distributed memory system and method for storing Backup Data |
| CN111338840B (en) * | 2020-03-07 | 2021-09-28 | 西安电子科技大学 | Space data protection method, storage medium, computer program, system and terminal |
-
2021
- 2021-03-11 CN CN202110264978.9A patent/CN112925678B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102201892A (en) * | 2011-05-13 | 2011-09-28 | 中兴通讯股份有限公司 | Method and device for implementing interlacing or deinterlacing |
| CN108062262A (en) * | 2017-12-25 | 2018-05-22 | 厦门市美亚柏科信息股份有限公司 | Operating system backup-and-restore method and its system based on storage sector data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112925678A (en) | 2021-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE60015753T2 (en) | SYSTEM AND METHOD FOR PROTECTION OF DATA AND CORRECTION OF BIT ERRORS FOLLOWING COMPONENT ERRORS | |
| CN106095700B (en) | Method and system for replicating and using grid-level metadata in a storage system | |
| US8489916B2 (en) | Multi-disk fault-tolerant system, method for generating a check block, and method for recovering a data block | |
| DE112010003345B4 (en) | A data storage system and method for operating a data storage system | |
| US6327672B1 (en) | Multiple drive failure tolerant raid system | |
| KR101837318B1 (en) | Access method and device for message-type memory module | |
| CN104052576B (en) | Data recovery method based on error correcting codes in cloud storage | |
| DE112011100579T5 (en) | METHOD AND DEVICE FOR USING CACHE STORAGE IN A SYSTEM THAT SUPPORTS A LOW POWER CONDITION | |
| CN101840360A (en) | Rapid reconstruction method and device of RAID (Redundant Array of Independent Disk) system | |
| WO2016010763A1 (en) | Methods and systems for storing data in a redundant manner on a plurality of storage units | |
| CN101546249A (en) | On-line capacity expansion method for disk arrays | |
| CN104871138A (en) | Method and system for multi-dimensional raid reconstruction and defect avoidance | |
| CN101868785A (en) | Generate the parallel recovery plan of data-storage system | |
| TWI684857B (en) | Flash memory apparatus and storage management method for flash memory | |
| CN114281270B (en) | Data storage method, system, equipment and medium | |
| CN107391300A (en) | A kind of method and system for improving flash data memory reliability | |
| CN112925678B (en) | Distributed downhole data safe storage method for testing | |
| WO2023184911A1 (en) | Data storage method and apparatus, and device and non-volatile readable storage medium | |
| CN114442950B (en) | Data recovery method, system, device and computer readable storage medium | |
| CN112612637B (en) | Memory data storage method, memory controller, processor chip and electronic device | |
| CN110600070B (en) | Coding and repairing method for improving repairing performance of solid state disk array system | |
| DE112019001968B4 (en) | COMMON CORRECTION LOGIC FOR HIGH AND LOW RANDOM BIT ERROR RATES | |
| US8443264B2 (en) | Disk array apparatus, a disk array apparatus control method and a program for a disk array apparatus | |
| CN114416437B (en) | Data storage method of self-adaptive redundancy level | |
| WO2015016879A1 (en) | Operating a memory unit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |