CN101609446B - Method for storing and managing dynamic data - Google Patents
Method for storing and managing dynamic data Download PDFInfo
- Publication number
- CN101609446B CN101609446B CN2008101059261A CN200810105926A CN101609446B CN 101609446 B CN101609446 B CN 101609446B CN 2008101059261 A CN2008101059261 A CN 2008101059261A CN 200810105926 A CN200810105926 A CN 200810105926A CN 101609446 B CN101609446 B CN 101609446B
- Authority
- CN
- China
- Prior art keywords
- data
- vector
- input
- container
- output
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The invention discloses a method for storing and managing dynamic data, which relates to real-time storage and management of a large number of dynamic data and belongs to the field of data storage and information processing. Aiming at the problems existing in the aspects of integrity and real-time property for the single use of a database or a file container, the invention provides a vector container. The data are stored in the vector container and the file container respectively. The vector container mainly stores current data, and the volume of the vector container changes dynamically so as to ensure the real-time property of data processing and result display. A plurality of files are used for storing original data so as to ensure the integrity of data storage and the timeliness and the accuracy of history playback. The method for storing and managing a large number of the dynamic data not only can ensure the integrity of the data, but also can ensure the real-time property of the data, thus a comparatively ideal practical effect is obtained.
Description
Technical field
The present invention relates to real-time storage and management method, belong to data storage and field of information processing a large amount of dynamic datas.
Background technology
In the actual industrial production process, often need the storage and a large amount of real time data that process produced of managing production.For example for oilfield drilling, steam piano was wanted work really long days before closing down.During this period of time, measurement-while-drilling system can produce the huge initial data of quantity, and this brings very big challenge for real-time storage with processing with boring signal.On the other hand, production reality require again must service data integrality and real-time, could provide in time the field personnel like this, various physical parametric data in down-hole accurately, improve the correctness of job acceptance decision.The external software that Present Domestic enterprise is using adopts database container to come store and management live signal data.Its main process is at first to accept instant data from serial ports, then instant data is stored in the database in real time, and the required data of various successor operations then all read from this database.This method can guarantee the complete attribute of data preferably; but because data volume is very huge; corresponding database is also just very huge with it; so just caused the normal toggle speed of software, follow-up various operations all very slow to the processing speed of instant mud signal data; heavy damage whole real-time, do not satisfy the needs of actual production.Preserve data if only adopt file, owing in operating process, need raw data is carried out the curve playback, only opening this file just might account for memory source, cause machine to be in seemingly-dead machine state, and file data inquires about also and makes mistakes easily, and this does not satisfy demand of practical production equally.At the problems referred to above, the present invention proposes a kind of dynamic data storage and management method, and be successfully used to the measurement-while-drilling system of petroleum drilling.
Summary of the invention
The integrality and the data that the objective of the invention is to solve emphatically the data storage are processed and the real time problems that shows, a kind of method that effectively, can carry out to a large amount of dynamic datas real-time storage and management is provided.
At first data integrality and real-time property are simply explained.This term of data integrity is used for making a general reference and damages and lose the state of relative data, and it shows that usually reliable the and accuracy of data can trust, and simultaneously, in bad situation, means that data might be invalid, or incomplete.The real-time of so-called data refers to instantaneity, i.e. the required time will be within the range of permission between the processing of data message showed to the result.For the integrality and the data that solve the data storage are processed and the real time problems that shows, operation principle with reference to cistern in the daily life, main storage current data in the vector containers that the present invention proposes, its capacity can dynamic changes, can guarantee like this real-time of data manipulation; The persistence of file (can be kept in the hard disk) can guarantee the integrality of data.Be used in combination vector containers and document container and carry out data management, thus the purpose that reaches mutual supplement with each other's advantages, strengthens the property.
The objective of the invention is to be achieved through the following technical solutions.
A kind of dynamic data storage of the present invention and management method, the vector containers of proposition is used in combination the storage and management that document container carries out dynamic data, comprises following operation to vector containers:
1) sets up vector containers: create a vector containers; By the function that is pressed into that calls vector containers data point injection vector containers is carried out input operation, carry out output function by the deletion function that calls vector containers;
2) when the number of data points in the vector containers equals less than some values, stop output, only begin input, enter the state that only input is not exported;
3) when the number of data points in the vector containers during greater than some values, carry out output function, enter output state, at this moment will carry out the operation of storage initial data in the vector containers; Normal waveform drawing and decoding also obtain data point from output;
4) when needs carry out pausing operation, stop output function at once, vector containers receives only data point during this period, and the Release Number strong point namely is not in the state that only input is not exported;
5) when pursuing and attacking operation, input is carried out simultaneously with output, and the speed of output is greater than the speed of input;
6) when the number of data points in the vector containers drops to certain value, just immediately the speed of output is changed into the speed that equals to import.
The vector containers of the present invention in the Object-Oriented Programming Language, it has the advantage of array and chained list concurrently.
When pursuing and attacking the crucial moment that operates to the normal operating transition, vector containers may occur and be empty situation, and also not obtain next data point this moment, will cause the situation of misreading data point, the integrality of the data of destruction this moment.Solution is: except when closing pump, outside emptying the data point in the vector containers, in the situation of normal operation, the data point in the vector containers will remain at more than some values (such as 5).And this vector containers can only temporarily be stored data at the program run duration, can not satisfy the requirement of permanent maintenance data, so will be in conjunction with the document container integrated use.
Document container used in the present invention is not an independent file.Because the cycle very long (such as several days time) of actual production process produces very huge initial data in this process, it is unscientific adopting a file to store all data.And in operating process, the technician needs at any time the raw data to a certain section to reanalyse (being the curve playback operation), and at this moment only opening this file might account for memory source, causes machine to be in seemingly-dead machine state.For this situation, the present invention uses the littler file of N to replace a big file, and the capacity of each small documents can artificially be set the value (such as 5M etc.) of a permission.When needs are observed historical data, can carry out playback operation easily, but not influence collection, storage and processing current and follow-up input data.
The present invention has the following advantages:
1, the present invention proposes vector containers, and is used in combination vector containers and document container carries out data management.
2, the present invention proposes a kind of method that effectively, can carry out to a large amount of dynamic datas real-time storage and management, can guarantee data integrity simultaneously and the requirement of real-time, satisfies the needs of actual production.
Description of drawings
Fig. 1 is the process flow diagram of data storage, processing and demonstration;
Fig. 2 is the oscillogram that data are misread in the document container;
Fig. 3 is the data waveform figure that is used in combination vector containers and document container.
Embodiment
The invention will be further described below in conjunction with drawings and Examples.
Embodiment
Invention can be implemented in the system that need to carry out to a large amount of dynamic datas real-time storage and demonstration.In oilfield drilling, measurement while-drilling instrument is followed drilling process and is carried out operations such as data acquisition, processing, analytical calculation, demonstration.Data volume is along with the carrying out that produces constantly increasing.How the so huge initial data of store and management will satisfy the technical staff simultaneously to integrality and the real-time requirement of data, is a difficult problem that does not have fine solution always.
The vector containers technology that adopts the present invention to propose, and be used in combination document container and carry out data management, the difficult problem above having solved well.
Shown in Figure 1 is the flow chart of data storage, processing and demonstration in the measurement-while-drilling system.X represents the current data that the external world is imported into; Serial ports is a control, is used for accepting current data, and this current data is delivered to the vector containers porch; Vector containers has an entrance operation and export operation, and entrance is accepted data, and outlet discharges the data in the vector containers; File part is made up of a plurality of small documents, stores all initial data; Drawing is the curve that picture N data point forms, and shows the meaning of data representative etc.; Decoding is exactly that the physical parameter that certain segment data represents is explained out.
Adopt the vector containers memory technology, and it is as follows to be used in combination the data managing method of document container:
1) at first begin input, turn on pump then, the current data number of spots stops output when equaling less than 5, enter the state that only input is not exported.Realize being exactly that the data of only calling vector containers are pressed into function with program.
2) when the number of data points in the vector containers during, begin output, enter output state, just call the data deletion function of vector containers greater than 5.At this moment to carry out in document container, storing the operation of initial data.Normal waveform drawing and decoding also obtain data point from output.
3) when needs carry out pausing operation, stop output at once, vector containers receives only data point during this period, and the Release Number strong point namely is not in the state that only input is not exported.
4) when pursuing and attacking operation, input is carried out simultaneously with output, and the speed of output is greater than the speed of input.
5) when the number of data points in the vector containers drops to 5, just immediately the speed of output is changed into the speed that equals to import.
The speed that should import in vector containers with serial ports in the example is data point of 50ms.Because a halted state was necessarily arranged before program is in the state of pursuing and attacking, when pursuing and attacking operation, the quantity of data point must be greater than 5 in the vector containers.To pursue and attack used time in order reducing as far as possible, need to have maximum output speed, according to the hardware performance of working computer, is that 1ms reads a data point in should be with example.The real-time that has kept so in maximum the parameter decoded result to show.
In the measurement while drilling process, need carry out operations such as SYN, FID, PLAY.The SYN operation is when synchronizing signal does not capture, and need to soften terms re-starts the operation of seizure; FID is that synchronizing signal is correct, and working method (FID) signal needs artificial the correction this moment because noise jamming makes decoded result produce mistake; PLAY operation be when the staff behind halted state observation analysis waveform and parameter result, do not need to carry out the operation such as SYN and FID and the continuation carried out is moved.The operation such as these operations have all comprised time-out, pursue and attack.
When usage data storehouse method storage data; because its data volume is very huge; so just caused the normal toggle speed of software, follow-up various operations all very slow to the processing speed of instant data, heavy damage whole real-time, do not satisfy the needs of actual production.Performance Ratio is relatively poor aspect the real-time that shows in data in view of data base method, only the experimental result of only using document container and being used in combination vector containers and document container is compared below therefore.
1) document container method: create a temporary file and store all data points of accepting to the serial ports of pursuing and attacking tailend from after suspending as container.When suspending, program is set up temporary file, and serial ports writes data to temporary file simultaneously, stops other operation.When entering when pursuing and attacking state, program has also just begun waveform drawing, parameter decoding, parameter display etc. operation simultaneously.The condition that pursue and attack end this moment is to read the not tail of temporary file.
For sense data accurately and quickly, the form of data in the temporary file is done a regulation: data of every row storage so just require to have the operation of a line feed after every row has been deposited.If before line feed, to pursue and attack operation and just finish, this moment, parameter just can correctly solve, otherwise the operation of a null of mutiread will occur, i.e. null value of mutiread, this occurs not allowing in real work.
Referring to Fig. 2, the parameter of back all fails to solve as can be seen, and the method has caused grave error.The white vertical line that the waveform right-hand member occurs, show draw operation from the not tail mutiread of temporary file a null value.
2) vector containers and document container associated methods: utilize method of the present invention, create a vector containers and store all data points of accepting to the serial ports of pursuing and attacking tailend from after suspending.When suspending, vector containers only stops output, and input state is constant, accepts from the data point of serial ports input, other operation of program stopped.When entering when pursuing and attacking state, vector containers begins output, and program has also just begun waveform drawing, parameter decoding, the operations such as parameter display simultaneously.The condition that pursue and attack end this moment is that the data left point is the value of a fixed size in the vector containers.
Adopt this method, except that termination of pumping, vector containers is under other any state, and all some reserves has guaranteed can both correctly read each time an active data point from vector containers, and the situation of having avoided well misreading data point takes place.
Because the field technician needs constantly inquiry and observes past data, therefore also will deposit these data in file.In order to guarantee that data integrity makes again data query convenient simultaneously, the present invention adopts a plurality of files to replace a file.Should use in the example, the capacity of each file can be set at the 1M byte.When carrying out playback operation, can close immediately current file, produce immediately a new file in order to store the data of thereafter serial ports acceptance.The curve playback operation can playback other waveform except that current file like this, so not only can see the data waveform of all previous switch pump, also can see the data behind this turn on pump, has improved the real-time performance.The curve playback operation is not high to requirement of real-time, but in operations such as time-out, " pursuing and attacking " real-time is had strict requirement, and go store this part data point with an independent interim document container this moment.When handling halted state, just to these interim document container storage data, current being in when pursuing and attacking state in these document container storage data, read data, until running through, finishes the task of pursuing and attacking and carries out the transition to normal drawing waveforms and decoded state.
The result as shown in Figure 3.
Experiment showed, that through situ of drilling well repeatedly this method is an optimum data management method desirable, that satisfy the situ of drilling well actual needs.
Claims (1)
1. dynamic data storage and management method is characterized in that:
Create a vector containers, by the function that is pressed into that calls vector containers data point input vector container is carried out input operation, input rate is the 50ms/ data point, carries out output function by the deletion function that calls vector containers; Vector containers is used for storing all data points of accepting to the serial ports of pursuing and attacking tailend from after suspending;
Situation 1: when the number of data points in the vector containers is equal to or less than 5 data points, stop output, begin input, enter the state that only input is not exported;
Situation 2: when the number of data points in the vector containers during greater than 5 data points, begin to carry out output function, at this moment will carry out the operation of storage initial data in the document container; Input is carried out simultaneously with output, and the speed of output is greater than the speed of input, namely is in and pursues and attacks mode of operation; When the number of data points in the vector containers drops to 5 data points, just immediately the speed of output is changed into the speed that equals to import; Normal waveform drawing and coding also obtain data point from output;
Situation 3: when needs carry out pausing operation, stop output function, vector containers receives only data point during this period, and the Release Number strong point namely is not in the state that only input is not exported at once;
After above-mentioned situation 2, when carrying out playback operation, close the current file container immediately, produce a new document container in order to store the data of serial ports reception thereafter, be specially and use N less document container to replace a big document container, the capacity of each small documents container is set at the 1M byte.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101059261A CN101609446B (en) | 2008-05-07 | 2008-05-07 | Method for storing and managing dynamic data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101059261A CN101609446B (en) | 2008-05-07 | 2008-05-07 | Method for storing and managing dynamic data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101609446A CN101609446A (en) | 2009-12-23 |
| CN101609446B true CN101609446B (en) | 2011-04-13 |
Family
ID=41483203
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008101059261A Expired - Fee Related CN101609446B (en) | 2008-05-07 | 2008-05-07 | Method for storing and managing dynamic data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101609446B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1202061A (en) * | 1998-05-26 | 1998-12-16 | 英业达股份有限公司 | Method for dynamically managing common sources of network |
| CN1506844A (en) * | 2002-11-19 | 2004-06-23 | �Ҵ���˾ | Hierarchy storage management method and apparatus using dynamic content table and content table collection |
| US7353232B1 (en) * | 2002-10-02 | 2008-04-01 | Q. Know Technologies, Inc. | Computer assisted and/or implemented method and system for layered access and/or supervisory control of projects and items incorporating electronic information |
-
2008
- 2008-05-07 CN CN2008101059261A patent/CN101609446B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1202061A (en) * | 1998-05-26 | 1998-12-16 | 英业达股份有限公司 | Method for dynamically managing common sources of network |
| US7353232B1 (en) * | 2002-10-02 | 2008-04-01 | Q. Know Technologies, Inc. | Computer assisted and/or implemented method and system for layered access and/or supervisory control of projects and items incorporating electronic information |
| CN1506844A (en) * | 2002-11-19 | 2004-06-23 | �Ҵ���˾ | Hierarchy storage management method and apparatus using dynamic content table and content table collection |
Non-Patent Citations (1)
| Title |
|---|
| 孟昭英等.港海一号钻井平台数据信息管理系统研究.中国海洋平台.2002,17(1),38-40. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101609446A (en) | 2009-12-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102025636B (en) | Message feature processing method and device as well as network equipment | |
| CN110390596A (en) | A kind of financial futures trading system | |
| CN108628891A (en) | Realize method, apparatus, electronic equipment and the readable storage medium storing program for executing of data buffer storage layer | |
| WO2007143264B1 (en) | Hierarchical state machine generation for interaction management using goal specifications | |
| CN103559217A (en) | Heterogeneous database oriented massive multicast data storage implementation method | |
| CN102591864B (en) | Data updating method and device in comparison system | |
| CN109308296A (en) | A kind of generation method, device and the computer readable storage medium of business datum table | |
| CN109614433A (en) | The recognition methods of data blood relationship, device, equipment and storage medium between operation system | |
| CN102148805A (en) | Feature matching method and device | |
| CN115994251B (en) | Target projectile telemetering data analysis device and analysis system | |
| CN105677716A (en) | Computer data acquisition, processing and analysis system | |
| CN102521356B (en) | Regular expression matching equipment and method on basis of deterministic finite automaton | |
| US7958083B2 (en) | Interacting methods of data summarization | |
| US8600990B2 (en) | Interacting methods of data extraction | |
| CN101609446B (en) | Method for storing and managing dynamic data | |
| CN110515870A (en) | A kind of method, equipment and the readable medium of the communication of server power supply front stage | |
| CN101702661B (en) | Method and device for obtaining diagnostic information | |
| CN102231104A (en) | Device and method for generating interface based on description | |
| CN105468600A (en) | Real-time storage and management method for large amounts of dynamic data | |
| CN102855297A (en) | Method for controlling data transmission, and connector | |
| CN104794129A (en) | Data processing method and system based on query logs | |
| CN105808742A (en) | Image pool system and method for using the image pool | |
| CN101556680A (en) | Method for reusing transaction information in character front end and character front-end system | |
| CN107665195A (en) | Import the method, apparatus and system of mass data | |
| CN111242595A (en) | Information exchange method and device between ERP platform and payment platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110413 Termination date: 20120507 |