CN114185984A - Well site data conversion and synchronization method - Google Patents
Well site data conversion and synchronization method Download PDFInfo
- Publication number
- CN114185984A CN114185984A CN202210135168.8A CN202210135168A CN114185984A CN 114185984 A CN114185984 A CN 114185984A CN 202210135168 A CN202210135168 A CN 202210135168A CN 114185984 A CN114185984 A CN 114185984A
- Authority
- CN
- China
- Prior art keywords
- data
- server
- query
- synchronization method
- conversion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a well site data conversion and synchronization method, and relates to the technical field of petroleum well site data synchronization. The invention comprises the following steps: the method comprises the steps of S1, data reading, S2, data conversion, S3, data transmission, S4 and data query, entering a data reading stage according to well site data fed back by synchronous software, transmitting the data and reading the data in real time.
Description
Technical Field
The invention relates to the technical field of petroleum well site data synchronization, in particular to a well site data conversion and synchronization method.
Background
The petroleum well site refers to the exploration of oil storage blocks, and means that a cylindrical hole with a certain diameter is drilled downwards or on one side at a pre-selected surface position by using special equipment and technology, and the work of drilling underground hydrocarbon reservoirs is achieved.
In order to reduce the drilling cost and improve the benefit, the digital construction of well sites is actively developed in the current petroleum industry. Currently, several drilling companies have implemented real-time acquisition and monitoring of field data of drilling, logging, well cementation, and the like. To ensure stability, the data is mostly stored in a large database which can be backed up in real time, and the data of the construction well is rapidly increased at a frequency of one line every five seconds.
In the prior art, the well site data conversion and synchronization method has the advantages that (1) the collected well site data can only be monitored, cannot be synchronized into professional drilling and logging software in real time, cannot ensure the analysis while drilling and the rapid adjustment of a construction scheme, and needs to improve the utilization rate of expert resources. (2) The data size is enormous. A single well generates more than ten thousand rows of data every day, and a month generates more than forty thousand rows. If a certain well is drilled for half a year, more than two million lines of data are generated, which presents a considerable challenge to the stable operation of data synchronization. (3) Compatibility difficulties. The database structure difference is large, the data storage is scattered, the time consumption of interface adaptation is long, and the maintenance cost is high.
Disclosure of Invention
The present invention is directed to a method for converting and synchronizing wellsite data, which solves the above-mentioned problems of the prior art.
In order to solve the technical problems, the invention is realized by the following technical scheme:
the invention relates to a well site data conversion and synchronization method, which comprises the following steps:
s1, data reading:
entering a data reading stage according to well site data fed back by the synchronous software, transmitting the data and reading the data in real time;
s2, data conversion:
converting the data into a Witsml standard format, analyzing the request parameters by a Witsml server, and abstracting the data in the Witsml standard format into a basic class template by the Witsml server according to an object-oriented idea;
the conversion performance is greatly improved, the data integrity and the service stability are improved, only the template needs to be updated for the support of subsequent Witsml higher versions, the conversion performance is still stable when the data size is large, the requirement on computer hardware is low, and the 4G internal memory computer can stably run the service without pressure.
S3, data transmission:
transmitting the data to a server, wherein the server adopts a general communication protocol based on SOAP + XML packaged by stateless HTTP;
the SOAP + XML general communication protocol has good compatibility and stable transmission performance.
S4, data synchronization:
the data synchronization system of the server comprises more than two data clusters and a central node, wherein each data cluster comprises a primary data node and at least one secondary data node, the central node receives data to be synchronized sent by the primary data nodes and extracts data characteristic information corresponding to the data to be synchronized, and the data to be synchronized is sent to the primary data nodes by user terminals connected with the secondary data nodes in a descending mode through the secondary data nodes;
s5, data query:
in the server, data is first written and then can be queried.
Preferably, the data transmission is returned in an incremental query mode;
in the embodiment, millions of rows of data can be transmitted in batches, the transmission mode is more suitable for the characteristics of long duration time and more incremental data of drilling operation, incremental query is performed, a large amount of bandwidth can be saved by returning data in a small range, normal communication of other communication equipment is ensured, routing rules between a database table and wells are automatically established according to configured database link information after service is started, and differences between databases are shielded.
Preferably, in the data conversion, the witxml server abstracts the data in the witxml standard format into a basic class template according to the object-oriented requirement.
In the data query, query parameters are automatically input into a database table, and interval values are obtained according to incremental query
Preferably, the server does not perform caching processing on the queried data.
Preferably, the data query, when an interruption is encountered during the data query, will automatically end the request, and the queried data will be automatically recycled in the memory.
Preferably, in the data transmission, if a network is disconnected, the server only needs to carry the same request parameters as those before the network is disconnected when the client requests again according to the common communication protocol of SOAP + XML, and can acquire the data requested last time again.
Preferably, if the data query is disconnected, the server rolls back the write operation by default according to a general communication protocol of SOAP + XML, so as to ensure the integrity of the database data.
The invention has the following beneficial effects:
1. the invention converts the Witsml specification into a basic class template according to the object-oriented idea, thereby greatly improving the conversion performance, increasing the complete row of data and the stability of service, only updating the template for the support of the subsequent Witsml higher version, simultaneously, the conversion performance is still stable when the data volume is large, the requirement on computer hardware is low, the computer with 4G memory can stably run the service without pressure, and the service does not carry out cache processing on the inquired data because the data is inquired in an increment range and the performance of the conversion process is stable and almost has no attenuation, thereby avoiding the occupation of a disk and further reducing the system overhead.
2. The default of the transmission data is returned in an incremental query mode, so that millions of rows of data can be transmitted in batches, and the transmission mode is more suitable for the characteristics of long duration of drilling operation and more incremental data. The data transmission protocol adopts a SOAP + XML general communication protocol, and has good compatibility and stable transmission performance.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings may be obtained according to the drawings without creative efforts.
FIG. 1 is a technical framework diagram of a wellsite data conversion and synchronization method of the present invention;
FIG. 2 is a block diagram of a data reading technique in S1 according to the present invention;
fig. 3 is a block diagram of a data conversion technique in S2 according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it is to be understood that the terms "upper", "middle", "outer", "inner", and the like, indicate orientations or positional relationships, are used for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the referenced components or elements must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention.
Referring to fig. 1 to 3, the present embodiment provides a wellsite data conversion and synchronization method, including the following steps:
s1, data reading:
entering a data reading stage according to well site data fed back by the synchronous software, transmitting the data and reading the data in real time;
s2, data conversion:
converting the data into a Witsml standard format;
in the embodiment, the conversion performance is greatly improved, the data integrity and the service stability are improved, the template only needs to be updated for the support of the subsequent Witsml higher version, the conversion performance is still stable when the data size is large, the requirement on computer hardware is low, and the 4G internal memory computer can stably run the service without pressure.
S3, data transmission:
transmitting the data to a server, wherein the server adopts a general communication protocol based on SOAP + XML packaged by stateless HTTP;
in the embodiment, the SOAP + XML general communication protocol has good compatibility and stable transmission performance.
S4, data synchronization:
the data synchronization system of the server comprises more than two data clusters and a central node, wherein each data cluster comprises a primary data node and at least one secondary data node, the central node receives data to be synchronized sent by the primary data nodes and extracts data characteristic information corresponding to the data to be synchronized, and the data to be synchronized is sent to the primary data nodes by user terminals connected with the secondary data nodes in a descending mode through the secondary data nodes;
s4, data query:
in the server, data is first written and then can be queried.
The data transmission is returned in an incremental query mode;
in the embodiment, millions of rows of data can be transmitted in batches, the transmission mode is more suitable for the characteristics of long duration time and more incremental data of drilling operation, incremental query is performed, a large amount of bandwidth can be saved by returning data in a small range, normal communication of other communication equipment is ensured, routing rules between a database table and wells are automatically established according to configured database link information after service is started, and differences between databases are shielded.
In the data conversion, according to the requirement of object orientation, the Witsml server abstracts the data in the Witsml standard format into a basic class template.
And the server does not perform caching processing on the inquired data.
When interruption occurs in the data query process, the data query automatically ends the request, and the queried data is automatically recycled in the memory.
And data transmission, if the network is disconnected, the server can acquire the data requested last time again only by carrying the same request parameters as those before the network is disconnected when the client requests again according to the SOAP + XML general communication protocol.
And (4) data query, if the network is disconnected, the server rolls back the write-in operation by default according to a general communication protocol of SOAP + XML, and further the integrity of the database data is ensured.
In the embodiment, as the data is queried in the increment range, the performance of the conversion process is stable, and almost no attenuation exists, the service does not perform cache processing on the queried data, so that the occupation of a disk is avoided, and the system overhead is further reduced.
Aiming at the problem of network disconnection caused by network jitter and even signal interruption under severe natural conditions in the actual transmission process of millions of lines, the SOAP + XML protocol encapsulated based on stateless HTTP is adopted for service, so that the problem can be well solved. For data query, if an interruption is encountered in the data query process, the request is automatically ended, and the queried data is automatically recycled in the memory. If the network is disconnected in the data return stage, the client only needs to carry the same request parameters as those before the network is disconnected when requesting again, and the data requested last time can be obtained again. And aiming at data writing, if the network is disconnected, a service transaction mechanism rolls back the writing operation by default, and the integrity of the database data is further ensured.
The maintenance is simple: managing server software based on Web pages without independently installing clients; the drilling and logging data chart browsing of a Web page is supported; the data are various: the synchronization of data of well heads, tracks, casings, drilling tools, well drilling, well logging, well cementing and the like is supported; the data source can be wellsite equipment or a professional database;
synchronous stable, efficient: smooth synchronization of dozens of wells is supported, and the synchronization frequency is defaulted to 60 seconds each time; the stability is strong, and breakpoint continuous transmission can be supported; the data volume of a single well supports millions of rows; supporting mainstream software: support mainstream petroleum engineering software such as Wellplan and compass software of landmurark EDT, stress simulation software GMI of beckhaus, logging software Techlog of schlumberger, and the like.
In the description herein, references to the description of "one embodiment," "an example," "a specific example" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (7)
1. A wellsite data conversion and synchronization method, comprising the steps of:
s1, data reading:
entering a data reading stage according to well site data fed back by the synchronous software, transmitting the data and reading the data in real time;
s2, data conversion:
converting the data into a Witsml standard format, analyzing the request parameters by the Witsml server, and abstracting the data in the Witsml standard format into a basic class template by the Witsml server according to the object-oriented requirement;
s3, data transmission:
transmitting the data to a server, wherein the server adopts a general communication protocol based on SOAP + XML packaged by stateless HTTP;
s4, data synchronization:
the data synchronization system of the server comprises more than two data clusters and a central node, wherein each data cluster comprises a primary data node and at least one secondary data node, the central node receives data to be synchronized sent by the primary data nodes and extracts data characteristic information corresponding to the data to be synchronized, and the data to be synchronized is sent to the primary data nodes by user terminals connected with the secondary data nodes in a descending mode through the secondary data nodes;
s5, data query:
in the server, data is first written and then can be queried.
2. The wellsite data conversion and synchronization method of claim 1, wherein: the data transmission is returned in an incremental query.
3. The wellsite data conversion and synchronization method of claim 1, wherein: in the data query, query parameters are automatically input into a database table, and interval values are obtained according to increment query.
4. The wellsite data conversion and synchronization method of claim 1, wherein: and the server does not perform caching processing on the inquired data.
5. The wellsite data conversion and synchronization method of claim 1, wherein: when interruption occurs in the data query process, the data query ends the request, and the queried data is recycled in the memory.
6. The wellsite data conversion and synchronization method of claim 1, wherein: in the data transmission, if the network is disconnected, the server can acquire the data requested last time again only by carrying the same request parameters as those before the network is disconnected when the client requests again according to the SOAP + XML general communication protocol.
7. The wellsite data conversion and synchronization method of claim 1, wherein: and if the data query is disconnected, the server rolls back the write-in operation by default according to a general communication protocol of SOAP + XML, so that the integrity of the database data is ensured.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210135168.8A CN114185984A (en) | 2022-02-15 | 2022-02-15 | Well site data conversion and synchronization method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210135168.8A CN114185984A (en) | 2022-02-15 | 2022-02-15 | Well site data conversion and synchronization method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114185984A true CN114185984A (en) | 2022-03-15 |
Family
ID=80545954
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210135168.8A Pending CN114185984A (en) | 2022-02-15 | 2022-02-15 | Well site data conversion and synchronization method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114185984A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106649181A (en) * | 2016-09-29 | 2017-05-10 | 中法渤海地质服务有限公司 | Method used for simultaneously integrating WITS data and WITSML data on drilling completion site |
| CN113259470A (en) * | 2021-06-03 | 2021-08-13 | 长视科技股份有限公司 | Data synchronization method and data synchronization system |
-
2022
- 2022-02-15 CN CN202210135168.8A patent/CN114185984A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106649181A (en) * | 2016-09-29 | 2017-05-10 | 中法渤海地质服务有限公司 | Method used for simultaneously integrating WITS data and WITSML data on drilling completion site |
| CN113259470A (en) * | 2021-06-03 | 2021-08-13 | 长视科技股份有限公司 | Data synchronization method and data synchronization system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100289520B1 (en) | Client/server communication system | |
| Pitoura et al. | Building information systems for mobile environments | |
| KR100295003B1 (en) | Time coherent caching system | |
| CN110413599A (en) | Generating date and storage system and method | |
| US8171171B2 (en) | Data synchronization method and system between devices | |
| US9135321B2 (en) | Synchronization infrastructure for networked devices, applications and services in a loosely coupled multi-master synchronization environment | |
| KR100426307B1 (en) | Apparatus and method accessing data by using single object access protocol-extended markup language | |
| EP1131725B1 (en) | System and method for analyzing web-server log files | |
| US20050278458A1 (en) | Analysis services database synchronization | |
| US8601001B2 (en) | Selectively structuring a table of contents for accessing a database | |
| WO2008095125A2 (en) | Synchronization framework for occasionally connected applications | |
| US20140358492A1 (en) | Systems and methods for synchronizing geographic information system (gis) network models | |
| CN106934048A (en) | Online data moving method, agent node | |
| CN112929437A (en) | Data transmission system, method and device based on Internet of things MQTT technical framework | |
| CN1271812C (en) | Wireless facility synchronizing system and method | |
| US20050235161A1 (en) | Method to reduce input parameter interface error and inconsistency for servlets | |
| CN114185984A (en) | Well site data conversion and synchronization method | |
| CN101895550B (en) | Cache accelerating method for compatibility of dynamic and static contents of internet website | |
| CN111787061B (en) | Method for transmitting well site real-time logging multivariate data | |
| CN101610225B (en) | Method, system and device for synchronous processing | |
| CN106649181A (en) | Method used for simultaneously integrating WITS data and WITSML data on drilling completion site | |
| CN101340463B (en) | Method and apparatus for determining network resource type | |
| CN113051091A (en) | Process-level cache data synchronization method and device | |
| LU503249B1 (en) | Digital-Twinning-Based Three-Dimensional Pipe Gallery System for Chemical Industry Park | |
| Ballesteros et al. | Op: Styx batching for high latency links |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220315 |