CN116016554A - Configurable cloud edge real-time database transmission system and method - Google Patents
Configurable cloud edge real-time database transmission system and method Download PDFInfo
- Publication number
- CN116016554A CN116016554A CN202111228039.5A CN202111228039A CN116016554A CN 116016554 A CN116016554 A CN 116016554A CN 202111228039 A CN202111228039 A CN 202111228039A CN 116016554 A CN116016554 A CN 116016554A
- Authority
- CN
- China
- Prior art keywords
- cloud
- real
- edge
- time database
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a configurable cloud edge real-time database transmission system and a method, comprising the following steps: cloud edge configuration client: the method is responsible for interacting with an edge node real-time database to perform synchronous Tag point management work; cloud edge configuration module: the method comprises the steps of acquiring configured synchronous Tag points from an edge node real-time database, and adding the configured synchronous Tag points into a cloud real-time database; cloud edge data synchronization module: the method comprises the steps of acquiring update data of synchronous Tag points from an edge node real-time database, and sending the update data to a cloud real-time database for storage to finish cloud edge data synchronous work; cloud edge data cache processing module: and the management of the cache data is responsible, and the cache data is sent to a cloud real-time database. The invention can complete the data transmission in the edge node real-time database to the cloud, realize cloud edge data cooperation, has lower processing delay and supports distributed deployment and breakpoint continuous transmission functions.
Description
Technical Field
The invention relates to the technical field of cloud edges, in particular to a configurable cloud edge real-time database transmission system and method.
Background
The conventional database transmission system is complex, and patent document CN113032480A provides a data synchronization method, system and device, relates to the technical field of electronic information, and can solve the problem of low efficiency when different types of databases transmit data. The specific technical scheme is as follows: acquiring a target configuration file, wherein the target configuration file can comprise target data, configuration information of a target database and configuration information of a source database; and generating target request information according to the target configuration file, requesting the source database to send target data, and converting the target data to be sent to the target database by the server after acquiring the target data, so that the technical effects of data transmission and data synchronization between the target database and the source database are realized. However, it cannot effectively compromise the transmission efficiency and configure different synchronization modes to perform data transmission based on the Tag point.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a configurable cloud edge real-time database transmission system and method.
The invention provides a configurable cloud edge real-time database transmission system, which comprises:
cloud edge configuration client: the method is responsible for interacting with an edge node real-time database to perform synchronous Tag point management work;
cloud edge configuration module: the method comprises the steps of acquiring configured synchronous Tag points from an edge node real-time database, adding the configured synchronous Tag points into a cloud real-time database, and guaranteeing real-time synchronization of edge node real-time database and cloud real-time database Tag point configuration;
cloud edge data synchronization module: the method comprises the steps of acquiring update data of synchronous Tag points from an edge node real-time database, and sending the update data to a cloud real-time database for storage to finish cloud edge data synchronous work;
cloud edge data cache processing module: and the management of the cache data is responsible, and the cache data is sent to a cloud real-time database.
Preferably, in the cloud edge configuration client, the cloud edge configuration client is connected to the edge node real-time database through the set edge node real-time database connection information configuration, and queries Tag point configuration information in the edge node real-time database, wherein the Tag point configuration information comprises Tag name, tag type and Tag description information, a Tag point which needs to be synchronized to the cloud real-time database is selected, and a synchronization mode and a synchronization period of the synchronization Tag point are set, and the synchronization mode comprises periodic synchronization and registration synchronization.
Preferably, the cloud side configuration module is connected to the edge node real-time database and the cloud side real-time database according to the cloud side real-time database connection information configuration, periodically acquires version number information of synchronous Tag point configuration of the edge node real-time database, judges whether the synchronous Tag point configuration of the edge node real-time database is changed, acquires synchronous Tag points from the edge node real-time database when judging that the synchronous Tag point configuration of the edge node real-time database is changed, compares the synchronous Tag points with the last synchronous Tag point, and judges the new addition and deletion conditions of the synchronous Tag points; the cloud edge configuration module updates the synchronous Tag points of the cloud real-time database, and ensures that the edge node real-time database and the cloud real-time database are synchronous in configuration.
Preferably, the cloud edge data synchronization module is configured according to the connection information of the cloud edge real-time database, is connected to the edge node real-time database and the cloud real-time database, acquires the synchronous Tag point information from the edge node real-time database, and processes the information according to different synchronous modes.
Preferably, for the Tag point in the registered synchronization mode, the cloud edge data synchronization module registers a data callback function to the edge node real-time database, when the data of the synchronous Tag point in the edge node real-time database is updated, the corresponding callback function is called to update the real-time data of the synchronous Tag point, and the cloud edge data synchronization module sends the real-time data of the synchronous Tag point to the cloud real-time database; when the cloud side data synchronization module fails to send the synchronous Tag point data to the cloud side data caching and processing module for processing due to network problems and the like, the cloud side data synchronization module prevents data loss.
Preferably, for the periodically synchronized synchronous Tag points, the cloud side data synchronization module queries real-time data corresponding to the synchronous Tag points from the edge node real-time database at regular time according to the synchronization period, and sends the real-time data of the queried synchronous Tag points to the cloud side real-time database for storage, and when the sending of the synchronous Tag points to the cloud side real-time database fails due to network problems and the like, the cloud side data synchronization module sends the synchronous Tag point data to the cloud side data cache processing module for processing, so that data loss is prevented.
Preferably, when the cloud side data synchronization module cannot send data to the cloud side real-time database due to network problems and the like, the cloud side data synchronization module sends the data to the cloud side data caching and processing module, the cloud side data caching and processing module writes the received data into a cache file, and then sends the data in the cache file to the cloud side real-time database to ensure that the synchronous Tag point data are synchronized to the cloud side real-time database.
Preferably, a Tag point in a registered synchronization mode is selected, and when the edge node real-time database has data update, update data is pushed to the cloud real-time database.
Preferably, a synchronization period is set for selecting the periodically synchronized Tag point, and the data in the edge node real-time database is synchronized to the cloud real-time database according to the synchronization period.
According to the cloud edge data synchronization method provided by the invention, the configurable cloud edge real-time database transmission system is used for synchronizing cloud edge data.
Compared with the prior art, the invention has the following beneficial effects:
1. the cloud edge data collaborative method and the cloud edge data collaborative device can finish data transmission in the edge node real-time database to the cloud, and cloud edge data collaboration is achieved.
2. The invention can configure different synchronization modes based on the Tag point, and comprises two synchronization methods of a periodic type and a registration type.
3. The invention can be flexibly configured according to the needs, has lower processing delay and supports distributed deployment and breakpoint continuous transmission functions.
Drawings
Other features, objects and advantages of the present invention will become more apparent upon reading of the detailed description of non-limiting embodiments, given with reference to the accompanying drawings in which:
fig. 1 is a deployment diagram of a configurable cloud edge real-time database transmission system module provided by the invention.
Fig. 2 is a schematic workflow diagram of a cloud-edge configuration module in a cloud-edge real-time database transmission system.
Fig. 3 is a schematic workflow diagram of a cloud-edge data synchronization module in a cloud-edge real-time database transmission system.
Fig. 4 is a schematic workflow diagram of a cloud edge data caching module in the cloud edge real-time database transmission system.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the present invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications could be made by those skilled in the art without departing from the inventive concept. These are all within the scope of the present invention.
As shown in fig. 1, fig. 1 is a deployment diagram of a configurable cloud edge real-time database transmission system module provided by the invention. The invention provides a configurable cloud edge real-time database transmission system, which mainly comprises: the cloud edge configuration client, the cloud edge configuration module, the cloud edge data synchronization module and the cloud edge data cache processing module. The implementation of the module function can rely on an autonomously encapsulated c++ framework. According to the cloud edge data collaborative method, data in the edge node real-time database can be transmitted to the cloud, and cloud edge data collaboration is achieved; different synchronization modes can be configured based on Tag points, and the different synchronization modes comprise two synchronization methods of periodic type and registration type; the system can be flexibly configured according to the needs, has lower processing delay and supports distributed deployment and breakpoint continuous transmission functions.
1. Cloud edge configuration client: responsible for interacting with the edge node real-time database to synchronize Tag pointsThe main functions of the management work comprise edge node real-time database connection information configuration, cloud real-time database connection information configuration, edge node real-time database synchronous Tag point inquiry, addition, deletion, synchronous mode, synchronous period, batch import and export and the like.
The edge node real-time database connection information configuration comprises an edge node real-time database host IP, a port number, a standby IP, a standby port number, a user name, a password and the like. The cloud real-time database connection information configuration comprises an edge node real-time database host IP, a port number, a standby IP, a standby port number, a user name, a password and the like.
In the cloud side configuration client, the cloud side configuration client is connected to the edge node real-time database through the set edge node real-time database connection information configuration, the Tag point configuration information in the edge node real-time database is queried, the Tag point configuration information comprises Tag name, tag type, tag description information and other configurations, tag points needing to be synchronized to the cloud side real-time database are selected, and a synchronization mode and a synchronization period of the synchronization Tag points are set, wherein the synchronization mode comprises periodic synchronization and registration synchronization.
Particularly, selecting a Tag point in a registered synchronization mode, and pushing updated data to the cloud real-time database when the edge node real-time database has data update. And selecting a synchronous Tag point of periodic synchronization, setting a synchronization period, and synchronizing data in the edge node real-time database to the cloud real-time database according to the synchronization period. The cloud side configuration client side also supports the configuration of the synchronous Tag point by importing an excel file from the outside, and the configured synchronous Tag point can be exported to the excel file and reused in other client sides, so that the configuration efficiency of the synchronous Tag point is greatly improved.
As shown in fig. 2, fig. 2 is a schematic workflow diagram of a cloud side configuration module in a cloud side real-time database transmission system.
2. Cloud edge configuration module: the method is responsible for acquiring configured synchronous Tag points from the edge node real-time database, adding the configured synchronous Tag points into the cloud real-time database, and guaranteeing edgesThe node real-time database is synchronized with the cloud real-time database Tag point configuration in real time, so that preparation is made for data transmission of the cloud side real-time database.
The cloud side configuration module is connected to the edge node real-time database and the cloud side real-time database according to the cloud side real-time database connection information configuration, periodically acquires version number information of the edge node real-time database synchronous Tag point configuration, judges whether the edge node real-time database synchronous Tag point configuration is changed, acquires synchronous Tag points from the edge node real-time database when judging that the edge node real-time database synchronous Tag point configuration is changed, compares the synchronous Tag points with the last synchronous Tag point, and judges the new and deleted conditions of the synchronous Tag points. The cloud edge configuration module updates the synchronous Tag point of the cloud real-time database, and ensures that the edge node real-time database and the cloud real-time database are synchronous in configuration.
As shown in fig. 3, fig. 3 is a schematic workflow diagram of a cloud-edge data synchronization module in a cloud-edge real-time database transmission system.
3. Cloud edge data synchronization module: and the updating data of the synchronous Tag point is acquired from the edge node real-time database and is sent to the cloud real-time database for storage, so that cloud edge data synchronous work is completed.
The cloud side data synchronization module is configured according to the connection information of the cloud side real-time database, is connected to the edge node real-time database and the cloud side real-time database, acquires synchronous Tag point information from the edge node real-time database, and comprises Tag name, tag type, tag synchronization mode, synchronization period and other information, and processes the information according to different synchronization modes.
For the Tag points in the registered synchronization mode, the cloud edge data synchronization module registers a data callback function to the edge node real-time database, when the data of the synchronous Tag points in the edge node real-time database are updated, the corresponding callback function is called, the real-time data of the synchronous Tag points are updated, and the cloud edge data synchronization module sends the real-time data of the synchronous Tag points to the cloud end real-time database. When the cloud side data synchronization module fails to send the synchronous Tag point data to the cloud side data caching and processing module for processing due to network problems and the like, the cloud side data synchronization module prevents data loss.
For the synchronous Tag points which are periodically synchronous, the cloud side data synchronization module queries real-time data corresponding to the synchronous Tag points from the edge node real-time database according to the synchronous period at fixed time, and sends the real-time data of the queried synchronous Tag points to the cloud side real-time database for storage, and when the sending of the synchronous Tag points to the cloud side real-time database fails due to network problems and the like, the cloud side data synchronization module sends the synchronous Tag point data to the cloud side data cache processing module for processing, so that data loss is prevented.
According to the cloud edge data synchronization method and device, cloud edge data synchronization is carried out in a registration type synchronization mode and a periodic type synchronization mode, and according to different requirements of different Tag points, the cloud edge data synchronization method and device are flexibly configured, system resources are saved, and cloud edge data transmission efficiency is greatly improved.
As shown in fig. 4, fig. 4 is a schematic workflow diagram of a cloud edge data caching module in a cloud edge real-time database transmission system.
4. Cloud edge data cache processing module: and the management of the cache data is responsible, and the cache data is sent to a cloud real-time database.
When the cloud side data synchronization module cannot send data to the cloud side real-time database due to network problems and the like, the cloud side data synchronization module sends the data to the cloud side data caching and processing module, the cloud side data caching and processing module writes the received data into a cache file, and then sends the data in the cache file to the cloud side real-time database to ensure that the synchronous Tag point data is stably and reliably synchronized to the cloud side real-time database.
The invention also provides a cloud edge data synchronization method, which uses the configurable cloud edge real-time database transmission system to perform data synchronization.
Those skilled in the art will appreciate that the systems, apparatus, and their respective modules provided herein may be implemented entirely by logic programming of method steps such that the systems, apparatus, and their respective modules are implemented as logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers, etc., in addition to the systems, apparatus, and their respective modules being implemented as pure computer readable program code. Therefore, the system, the apparatus, and the respective modules thereof provided by the present invention may be regarded as one hardware component, and the modules included therein for implementing various programs may also be regarded as structures within the hardware component; modules for implementing various functions may also be regarded as being either software programs for implementing the methods or structures within hardware components.
The foregoing describes specific embodiments of the present invention. It is to be understood that the invention is not limited to the particular embodiments described above, and that various changes or modifications may be made by those skilled in the art within the scope of the appended claims without affecting the spirit of the invention. The embodiments of the present application and features in the embodiments may be combined with each other arbitrarily without conflict.
Claims (10)
1. A configurable cloud-edge real-time database transmission system, comprising:
cloud edge configuration client: the method is responsible for interacting with an edge node real-time database to perform synchronous Tag point management work;
cloud edge configuration module: the method comprises the steps of acquiring configured synchronous Tag points from an edge node real-time database, adding the configured synchronous Tag points into a cloud real-time database, and guaranteeing real-time synchronization of edge node real-time database and cloud real-time database Tag point configuration;
cloud edge data synchronization module: the method comprises the steps of acquiring update data of synchronous Tag points from an edge node real-time database, and sending the update data to a cloud real-time database for storage to finish cloud edge data synchronous work;
cloud edge data cache processing module: and the management of the cache data is responsible, and the cache data is sent to a cloud real-time database.
2. The configurable cloud-edge real-time database transmission system according to claim 1, wherein in the cloud-edge configuration client, the cloud-edge configuration client is connected to the edge node real-time database through the set edge node real-time database connection information configuration, and the edge node real-time database is queried for Tag point configuration information, wherein the Tag point configuration information comprises Tag name, tag type and Tag description information, the Tag point to be synchronized to the cloud real-time database is selected, and a synchronization mode and a synchronization period of synchronizing the Tag point are set, and the synchronization mode comprises periodic synchronization and registration synchronization.
3. The configurable cloud edge real-time database transmission system according to claim 1, wherein the cloud edge configuration module is configured according to the cloud edge real-time database connection information, is connected to the edge node real-time database and the cloud real-time database, periodically acquires version number information of synchronous Tag point configuration of the edge node real-time database, judges whether the synchronous Tag point configuration of the edge node real-time database is changed, acquires synchronous Tag points from the edge node real-time database when judging that the synchronous Tag point configuration of the edge node real-time database is changed, compares the synchronous Tag points with the last synchronous Tag point, and judges the new and deleted conditions of the synchronous Tag points; the cloud edge configuration module updates the synchronous Tag points of the cloud real-time database, and ensures that the edge node real-time database and the cloud real-time database are synchronous in configuration.
4. The configurable cloud edge real-time database transmission system according to claim 1, wherein the cloud edge data synchronization module is configured according to the connection information of the cloud edge real-time database, is connected to the edge node real-time database and the cloud end real-time database, acquires synchronous Tag point information from the edge node real-time database, and processes the synchronous Tag point information according to different synchronous modes.
5. The configurable cloud-edge real-time database transmission system of claim 4, wherein for a Tag point in a registered synchronization mode, the cloud-edge data synchronization module registers a data callback function to the edge node real-time database, when data update exists in the synchronous Tag point in the edge node real-time database, the corresponding callback function is called to update real-time data of the synchronous Tag point, and the cloud-edge data synchronization module sends the real-time data of the synchronous Tag point to the cloud real-time database; when the cloud side data synchronization module fails to send the synchronous Tag point data to the cloud side data caching and processing module for processing due to network problems and the like, the cloud side data synchronization module prevents data loss.
6. The configurable cloud-edge real-time database transmission system according to claim 1, wherein for the periodically synchronized Tag points, the cloud-edge data synchronization module queries the edge node real-time database for real-time data corresponding to the synchronized Tag points according to the synchronization period, and sends the real-time data of the queried synchronized Tag points to the cloud-edge real-time database for storage, and when the sending to the cloud-edge real-time database fails due to a network problem or the like, the cloud-edge data synchronization module sends the synchronized Tag point data to the cloud-edge data cache processing module for processing, so as to prevent data loss.
7. The configurable cloud-edge real-time database transmission system of claim 1, wherein when the cloud-edge data synchronization module cannot send data to the cloud-edge real-time database due to a network problem or the like, the cloud-edge data synchronization module sends the data to the cloud-edge data cache processing module, the cloud-edge data cache processing module writes the received data into a cache file, and then sends the data in the cache file to the cloud-edge real-time database to ensure that the synchronous Tag point data are synchronized to the cloud-edge real-time database.
8. The configurable cloud-edge real-time database transmission system of claim 2, wherein a Tag point of a registered synchronization mode is selected, and when the edge node real-time database has data update, update data is pushed to the cloud-edge real-time database.
9. The configurable cloud-edge real-time database transmission system of claim 2, wherein a synchronization period is further required to be set for selecting a periodically synchronized synchronization Tag point, and data in the edge node real-time database is synchronized to the cloud-edge real-time database according to the synchronization period.
10. A cloud-edge data synchronization method, characterized in that the cloud-edge data is synchronized using the configurable cloud-edge real-time database transmission system according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111228039.5A CN116016554A (en) | 2021-10-21 | 2021-10-21 | Configurable cloud edge real-time database transmission system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111228039.5A CN116016554A (en) | 2021-10-21 | 2021-10-21 | Configurable cloud edge real-time database transmission system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116016554A true CN116016554A (en) | 2023-04-25 |
Family
ID=86019712
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111228039.5A Pending CN116016554A (en) | 2021-10-21 | 2021-10-21 | Configurable cloud edge real-time database transmission system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116016554A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117473019A (en) * | 2023-12-25 | 2024-01-30 | 阿里云计算有限公司 | Data synchronization method, system, computer equipment and storage medium |
-
2021
- 2021-10-21 CN CN202111228039.5A patent/CN116016554A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117473019A (en) * | 2023-12-25 | 2024-01-30 | 阿里云计算有限公司 | Data synchronization method, system, computer equipment and storage medium |
| CN117473019B (en) * | 2023-12-25 | 2024-03-22 | 阿里云计算有限公司 | Data synchronization method, system, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107783975B (en) | Method and device for synchronous processing of distributed databases | |
| CN101188566B (en) | A method and system for data buffering and synchronization under cluster environment | |
| CN109144785B (en) | Method and apparatus for backing up data | |
| CN110309161B (en) | Data synchronization method and device and server | |
| CN109522363B (en) | Cloud platform synchronization method, system, equipment and storage medium based on block chain | |
| CN105763369A (en) | Terminal equipment remote software version distribution method and system | |
| CN106713391B (en) | Session information sharing method and sharing system | |
| CN111506592B (en) | Database upgrading method and device | |
| CN104506496A (en) | Quasi-real-time data increment distribution middleware based on Oracle Streams technology and method | |
| CN106484321A (en) | A kind of date storage method and data center | |
| CN108833610B (en) | Information updating method, device and system | |
| CN103701913A (en) | Data synchronization method and device | |
| JP2017500622A (en) | Method for updating a data table in a KeyValue database and apparatus for updating table data | |
| CN102946411A (en) | Network synchronization system | |
| CN110858197A (en) | Method and device for synchronizing data | |
| CN116016554A (en) | Configurable cloud edge real-time database transmission system and method | |
| CN111338834B (en) | Data storage method and device | |
| CN105700962A (en) | Data update processing method and apparatus | |
| CN110099128B (en) | Authentication data synchronization method and device | |
| CN111737711A (en) | Time-limited user temporary role management method and device | |
| CN112069152B (en) | Database cluster upgrading method, device, equipment and storage medium | |
| CN114138568A (en) | Scheduling method and system for client fault transfer in Redis sentinel mode | |
| CN112069137B (en) | Method, device, electronic equipment and computer readable storage medium for generating information | |
| CN110209534B (en) | System and method for automatically backing up mysql database | |
| CN112052295A (en) | Data synchronization method and device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |