CN117331993A - Method and equipment for exchanging data by real-time database - Google Patents
Method and equipment for exchanging data by real-time database Download PDFInfo
- Publication number
- CN117331993A CN117331993A CN202311210353.XA CN202311210353A CN117331993A CN 117331993 A CN117331993 A CN 117331993A CN 202311210353 A CN202311210353 A CN 202311210353A CN 117331993 A CN117331993 A CN 117331993A
- Authority
- CN
- China
- Prior art keywords
- time database
- real
- data
- target
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000005540 biological transmission Effects 0.000 claims description 38
- 238000011157 data evaluation Methods 0.000 claims description 29
- 238000004364 calculation method Methods 0.000 claims description 21
- 238000011084 recovery Methods 0.000 claims description 18
- 230000000694 effects Effects 0.000 claims description 15
- 238000004891 communication Methods 0.000 claims description 9
- 238000012544 monitoring process Methods 0.000 claims description 9
- 238000013500 data storage Methods 0.000 claims description 6
- 239000002131 composite material Substances 0.000 claims description 4
- 101000872083 Danio rerio Delta-like protein C Proteins 0.000 claims description 3
- 238000004458 analytical method Methods 0.000 claims description 3
- CLOMYZFHNHFSIQ-UHFFFAOYSA-N clonixin Chemical compound CC1=C(Cl)C=CC=C1NC1=NC=CC=C1C(O)=O CLOMYZFHNHFSIQ-UHFFFAOYSA-N 0.000 claims description 3
- 238000012790 confirmation Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 claims description 3
- 238000011895 specific detection Methods 0.000 claims description 3
- 238000011156 evaluation Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3058—Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and equipment for exchanging data of a real-time database, which relate to the technical field of voltage control.
Description
Technical Field
The invention relates to the technical field of data synchronization, in particular to a method and equipment for exchanging data by a real-time database.
Background
The real-time database is a specially designed database system for real-time application programs, has high real-time and responsive data processing capability, can rapidly process and transmit data, provides near-real-time data read-write operation, supports high concurrency and real-time notification mechanisms, is widely applied to the fields of financial transactions, the Internet of things, real-time monitoring and the like, can influence the stability and performance of the connection when the connection between the real-time databases is established, can cause connection loss, delay increase or data packet loss when the network fluctuation occurs, can cause connection interruption or disconnection, thereby interrupting the transmission and synchronization of data, can cause data inconsistency or loss of partial data, and can determine the performance of the real-time database in terms of data exchange by using a real-time database exchange data evaluation coefficient to evaluate the performance and efficiency of the real-time database in the data exchange process, thereby optimizing and improving the performance of the real-time database so as to meet the real-time requirements of the real-time application programs on the data processing and response.
The current method and apparatus for exchanging data with a real-time database may have the following problems in the process of exchanging data: 1. before data exchange, performance indexes of the main real-time database and the target real-time database are not analyzed and processed, exchange data evaluation is not performed on the data exchange process of the main real-time database and the target real-time database, the situation that data cannot be transmitted and data are lost easily occurs in the data exchange process, and when the data exchange is performed on the main real-time database and the target real-time database, the data exchange mode is determined according to the specific performance indexes of the main real-time database and the target real-time database.
2. Network fluctuation is not considered in the real-time data transmission process, the network fluctuation can cause data loss, delay increase and data transmission interruption, and the exchanged data is not checked with the original data after the exchanged data is received by each target real-time database.
Disclosure of Invention
The invention aims to provide a method and equipment for exchanging data by a real-time database, which solve the problems in the background technology.
In order to solve the technical problems, the invention adopts the following technical scheme: the invention provides a method and equipment for exchanging data by a real-time database, wherein the method comprises the following steps: step one, establishing database connection: acquiring connection parameters of the main real-time database and the target real-time database, and establishing connection between the main real-time database and the target real-time database according to the connection parameters of the main real-time database and the target real-time database; step two, establishing a switching mode: according to the storage information of each target real-time database and the performance index of the main real-time database, respectively calculating the exchange data evaluation coefficients of each target real-time database and the main real-time database, and obtaining the comprehensive score of the data exchange between each target real-time database and the main real-time database through calculation, thereby confirming the data exchange mode between each target real-time database and the main real-time database;
step three, data transmission monitoring: carrying out data transmission on storage information corresponding to each target real-time database, and monitoring transmission information between the main real-time database and each target real-time database in the process of data transmission to be exchanged to obtain the transmission information between the main real-time database and each target real-time database;
step four, data transmission analysis: according to the transmission information between the main real-time database and each target real-time database, analyzing the network fluctuation value corresponding to each target real-time database, and further judging the data exchange effect corresponding to each target real-time database;
step five: exchange data authentication: and after each target real-time database receives the exchanged data, checking the exchanged data with the original data.
Preferably, the calculating the exchange data evaluation coefficient of each target real-time database comprises the following specific calculating process: the performance indexes of each target real-time database comprise storage capacity, query speed and CPU occupancy rate, and the storage capacity, query speed and CPU occupancy rate of each target real-time database are substituted into a calculation formulaObtaining the exchange data evaluation coefficient xi of each target real-time database i Wherein A is i 、B i 、C i The storage capacity, the query speed and the CPU occupancy rate corresponding to the ith real-time database are respectively represented, i is a number corresponding to each target real-time database, i=1, 2ΔC is the set difference in allowable storage capacity, allowable inquiry speed, allowable CPU occupancy, and κ, respectively 1 、κ 2 、κ 3 And respectively setting weight factors corresponding to the storage capacity, the query speed and the CPU occupation rate of each target real-time database.
Preferably, the calculating the exchange data evaluation coefficient of the main real-time database specifically comprises the following steps: the performance indexes of the main real-time database comprise data index efficiency, data recovery speed and memory utilization rate, and the data index efficiency, the data recovery speed and the memory utilization rate of the main real-time database are substituted into a calculation formulaObtaining an exchange data evaluation coefficient psi of the main real-time database, wherein W, V, S respectively represents data index efficiency, data recovery speed and memory utilization rate corresponding to the main real-time database, W ', V ', S ' respectively represent standard data index efficiency, standard data recovery speed and standard memory utilization rate corresponding to the set main real-time database, and DeltaW, deltaV and DeltaS respectively represent allowable data index efficiency difference, allowable data recovery speed difference and allowable memory utilization rate difference corresponding to the set main real-time database, and DeltaA 1 、λ 2 、λ 3 And respectively setting weight factors corresponding to the data index efficiency, the data recovery speed and the memory utilization rate of the main real-time database.
Preferably, the comprehensive score of the data exchange between each target real-time database and the main real-time database is obtained through calculation, and the specific calculation process is as follows: substituting the exchange data evaluation coefficients of each target real-time database and the exchange data evaluation coefficients of the main real-time database into a calculation formula eta=ζ i *μ 1 +ψ*μ 2 Obtaining a composite score for data exchange between each target real-time database and the master real-time database, wherein mu 1 、μ 2 And exchanging data evaluation coefficients for the set target real-time databases and weight factors corresponding to the data evaluation coefficients for the master real-time database respectively.
Preferably, the data exchange mode between each target real-time database and the main real-time database is confirmed, and the specific confirmation process is as follows: the data exchange modes of the real-time databases comprise data circuit exchange, message exchange and packet exchange, the comprehensive score of the data exchange between each target real-time database and the main real-time database is obtained, the comprehensive score of the data exchange between each target real-time database and the main real-time database is compared with the set scoring interval of each data exchange mode, and if the comprehensive score of the data exchange between each target real-time database and the main real-time database is in the set scoring interval of each data exchange mode, the data exchange mode between each target real-time database and the main real-time database is judged to belong to the data exchange mode corresponding to the set scoring interval of each data exchange mode.
Preferably, the monitoring is performed on the transmission information between the main real-time database and each target real-time database, and the specific detection process is as follows: and arranging each time point according to a preset time interval in the transmission process of the data to be exchanged, and operating a detection device corresponding to each target real-time database, thereby acquiring the network speed, the exchange data storage capacity, the packet loss rate and the network throughput corresponding to each time point of each target real-time database, and taking the network speed, the exchange data storage capacity, the packet loss rate and the network throughput corresponding to each time point of each target backup database as transmission information between the main real-time database and each target real-time database.
Preferably, the network fluctuation value corresponding to each target real-time database is specifically analyzed as follows: substituting the network speed, the exchange data capacity, the packet loss rate and the network throughput corresponding to each target backup database at each time point into a calculation formula
Obtaining a network fluctuation value xi corresponding to each real-time backup database, wherein V t i 、/>Respectively representing the network speed and the exchange corresponding to the ith target real-time database at the t time pointData capacity, packet loss rate, network throughput, t is the number corresponding to each time point, t=1, 2,. The.m, m is any integer greater than 2, < >>The values of network speed, exchange data capacity, packet loss rate and network throughput of the ith target real-time database at the t-1 th time are respectively set allowable network speed difference, allowable exchange data capacity difference, allowable packet loss difference and allowable network throughput difference, and K is respectively set as DeltaV, deltaR, deltaB and DeltaC 1 、K 2 、K 3 、K 4 Respectively set weight factors corresponding to network speed, exchange data capacity, packet loss rate and network throughput.
Preferably, the determining the data exchange effect corresponding to each target real-time database specifically includes the following steps: comparing the network fluctuation value corresponding to each target exchange real-time database with a preset network fluctuation value threshold, judging that the data exchange effect of the target real-time database is poor if the network fluctuation value corresponding to a certain target real-time database is larger than the network fluctuation value threshold, and judging that the data exchange effect of the target real-time database is good if the network fluctuation value corresponding to a certain target real-time database is smaller than or equal to the network fluctuation value threshold, so that the data exchange effect corresponding to each target real-time database is judged.
Preferably, the checking the data to be exchanged in each target real-time database includes the following specific checking process: comparing the data to be exchanged in each target real-time database with the data to be exchanged in the main real-time database, if the data to be exchanged in a certain target real-time database is different from the data to be exchanged in the corresponding real-time database, deleting all the data to be exchanged in the target real-time database, and executing the step 3, if the data to be exchanged in the target real-time database is the same as the data to be exchanged in the main real-time database, judging that the data to be exchanged in the target real-time database is completed, and checking the data to be exchanged in each target real-time database.
Preferably, the real-time database is used for exchanging data equipment and comprises a processor, a memory and a communication bus; the memory has stored thereon a computer readable program executable by the processor; the communication bus realizes connection communication between the processor and the memory; the processor, when executing the computer readable program, implements the steps of a method for exchanging data according to a real-time database as claimed in any one of claims 1-9.
The invention has the beneficial effects that: 1. according to the method and the device for exchanging data of the real-time database, before data exchange, performance indexes of the main real-time database and each target real-time database are analyzed and processed, before data exchange is carried out between the real-time databases, the data exchange evaluation coefficients of the main real-time database and each target real-time database are calculated respectively, the comprehensive score of the data exchange between each target real-time database and the main real-time database is calculated, and the comprehensive score of the data exchange between each target real-time database and the main real-time database is compared with the set scoring interval of each data exchange mode, so that the data exchange mode between each target real-time database and the main real-time database is obtained, the transmission of the whole data is facilitated, and the data transmission efficiency is improved.
2. According to the invention, the network fluctuation value corresponding to each target real-time database is calculated, the network speed, the exchange data capacity, the packet loss rate and the network throughput corresponding to each target backup database at each time point are analyzed, the problems that data cannot be transmitted and data is lost due to network fluctuation in the data exchange process are effectively solved, and after the data exchange, the data exchanged by the target real-time databases are checked and compared, so that the integrity of the data can be verified, unauthorized tampering and access in the data transmission or storage process are prevented, and the confidentiality of the data is protected.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of the steps of the method of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, the present invention provides a method and apparatus for exchanging data in a real-time database, the method comprising the steps of: step one, establishing database connection: acquiring connection parameters of the main real-time database and the target real-time database, and establishing connection between the main real-time database and the target real-time database according to the connection parameters of the main real-time database and the target real-time database; it should be noted that, the connection between the main real-time database and the target real-time database is obtained through the corresponding database client or driver, then the connection parameters are used, the connection parameters include the required hostname, port number, user name and password, thereby creating a connection object, and finally the connection is opened to establish the actual connection with the target real-time database.
Step two, establishing a switching mode: according to the storage information of each target real-time database and the performance index of the main real-time database, respectively calculating the exchange data evaluation coefficients of each target real-time database and the main real-time database, and obtaining the comprehensive score of the data exchange between each target real-time database and the main real-time database through calculation, thereby confirming the data exchange mode between each target real-time database and the main real-time database;
the performance index of each target real-time database and the performance index of the main real-time database are obtained from the database management platform.
In a specific embodiment, the calculating the exchange data evaluation coefficients of each target real-time database specifically includes the following steps: the performance indexes of each target real-time database comprise storage capacity, query speed and CPU occupancy rate, and the storage capacity, query speed and CPU occupancy rate of each target real-time database are substituted into a calculation formulaObtaining the exchange data evaluation coefficient xi of each target real-time database i Wherein A is i 、B i 、C i The storage capacity, the query speed and the CPU occupancy rate corresponding to the ith real-time database are respectively represented, i is a number corresponding to each target real-time database, i=1, 2 1 、κ 2 、κ 3 And respectively setting weight factors corresponding to the storage capacity, the query speed and the CPU occupation rate of each target real-time database.
In a specific embodiment, the calculating the exchange data evaluation coefficient of the main real-time database specifically includes the following steps: the performance indexes of the main real-time database comprise data index efficiency, data recovery speed and memory utilization rate, and the data index efficiency, the data recovery speed and the memory utilization rate of the main real-time database are substituted into a calculation formulaObtaining an exchange data evaluation coefficient psi of the main real-time database, wherein W, V, S respectively represents data index efficiency, data recovery speed and memory utilization rate corresponding to the main real-time database, W ', V ', S ' respectively represent standard data index efficiency, standard data recovery speed and standard memory utilization rate corresponding to the set main real-time database, and DeltaW, deltaV and DeltaS respectively represent allowable data index efficiency difference and allowable data recovery corresponding to the set main real-time databaseSpeed difference, allowable memory utilization difference, lambda 1 、λ 2 、λ 3 And respectively setting weight factors corresponding to the data index efficiency, the data recovery speed and the memory utilization rate of the main real-time database.
In a specific embodiment, the comprehensive score of the data exchange between each target real-time database and the main real-time database is obtained through calculation, and the specific calculation process is as follows: substituting the exchange data evaluation coefficients of each target real-time database and the exchange data evaluation coefficients of the main real-time database into a calculation formula eta=ζ i *μ 1 +ψ*μ 2 Obtaining a composite score for data exchange between each target real-time database and the master real-time database, wherein mu 1 、μ 2 And exchanging data evaluation coefficients for the set target real-time databases and weight factors corresponding to the data evaluation coefficients for the master real-time database respectively.
In a specific embodiment, the data exchange manner between each target real-time database and the main real-time database is confirmed, and a specific confirmation process is as follows: the data exchange modes of the real-time databases comprise data circuit exchange, message exchange and packet exchange, the comprehensive score of the data exchange between each target real-time database and the main real-time database is obtained, the comprehensive score of the data exchange between each target real-time database and the main real-time database is compared with the set scoring interval of each data exchange mode, and if the comprehensive score of the data exchange between each target real-time database and the main real-time database is in the set scoring interval of each data exchange mode, the data exchange mode between each target real-time database and the main real-time database is judged to belong to the data exchange mode corresponding to the set scoring interval of each data exchange mode.
Step three, data transmission monitoring: carrying out data transmission on storage information corresponding to each target real-time database, and monitoring transmission information between the main real-time database and each target real-time database in the process of data transmission to be exchanged to obtain the transmission information between the main real-time database and each target real-time database;
in a specific embodiment, the monitoring of the transmission information between the main real-time database and each target real-time database includes the following specific detection process: and arranging each time point according to a preset time interval in the transmission process of the data to be exchanged, and operating a detection device corresponding to each target real-time database, thereby acquiring the network speed, the exchange data storage capacity, the packet loss rate and the network throughput corresponding to each time point of each target real-time database, and taking the network speed, the exchange data storage capacity, the packet loss rate and the network throughput corresponding to each time point of each target backup database as transmission information between the main real-time database and each target real-time database.
Step four, data transmission analysis: according to the transmission information between the main real-time database and each target real-time database, analyzing the network fluctuation value corresponding to each target real-time database, and further judging the data exchange effect corresponding to each target real-time database;
in a specific embodiment, the network fluctuation value corresponding to each target real-time database is specifically analyzed as follows: substituting the network speed, the exchange data capacity, the packet loss rate and the network throughput corresponding to each target backup database at each time point into a calculation formulaObtaining a network fluctuation value xi corresponding to each real-time backup database i Wherein V is t i 、/>The network speed, the exchange data capacity, the packet loss rate and the network throughput corresponding to the ith target real-time database at the t time point are respectively represented, t is the number corresponding to each time point, t=1, 2, m is any integer greater than 2>The values of network speed, exchange data capacity, packet loss rate and network throughput of the ith target real-time database at the t-1 th time are respectively set allowable network speed difference, allowable exchange data capacity difference and allowable loss, and DeltaV, deltaR, deltaB and DeltaC are respectively setPacket difference, licensed network throughput difference, K 1 、K 2 、K 3 、K 4 Respectively set weight factors corresponding to network speed, exchange data capacity, packet loss rate and network throughput.
In a specific embodiment, the determining the data exchange effect corresponding to each target real-time database specifically includes the following steps: comparing the network fluctuation value corresponding to each target exchange real-time database with a preset network fluctuation value threshold, judging that the data exchange effect of the target real-time database is poor if the network fluctuation value corresponding to a certain target real-time database is larger than the network fluctuation value threshold, and judging that the data exchange effect of the target real-time database is good if the network fluctuation value corresponding to a certain target real-time database is smaller than or equal to the network fluctuation value threshold, so that the data exchange effect corresponding to each target real-time database is judged.
According to the invention, the network fluctuation value corresponding to each target real-time database is calculated, the network speed, the exchange data capacity, the packet loss rate and the network throughput corresponding to each target backup database at each time point are analyzed, the problems that data cannot be transmitted and data is lost due to network fluctuation in the data exchange process are effectively solved, and after the data exchange, the data exchanged by the target real-time databases are checked and compared, so that the integrity of the data can be verified, unauthorized tampering and access in the data transmission or storage process are prevented, and the confidentiality of the data is protected.
Step five: exchange data authentication: and after each target real-time database receives the exchanged data, checking the exchanged data with the original data.
In a specific embodiment, the verification is performed on the data to be exchanged in each target real-time database, and a specific verification process is as follows: comparing the data to be exchanged in each target real-time database with the data to be exchanged in the main real-time database, if the data to be exchanged in a certain target real-time database is different from the data to be exchanged in the corresponding real-time database, deleting all the data to be exchanged in the target real-time database, and executing the step 3, if the data to be exchanged in the target real-time database is the same as the data to be exchanged in the main real-time database, judging that the data to be exchanged in the target real-time database is completed, and checking the data to be exchanged in each target real-time database.
The real-time database is used for exchanging data equipment and comprises a processor, a memory and a communication bus; the memory has stored thereon a computer readable program executable by the processor; the communication bus realizes connection communication between the processor and the memory; the processor, when executing the computer readable program, implements the steps of a method for exchanging data according to a real-time database as claimed in any one of claims 1-9.
According to the method and the device for exchanging data of the real-time database, before data exchange, performance indexes of the main real-time database and each target real-time database are analyzed and processed, before data exchange is carried out between the real-time databases, the data exchange evaluation coefficients of the main real-time database and each target real-time database are calculated respectively, the comprehensive score of the data exchange between each target real-time database and the main real-time database is calculated, and the comprehensive score of the data exchange between each target real-time database and the main real-time database is compared with the set scoring interval of each data exchange mode, so that the data exchange mode between each target real-time database and the main real-time database is obtained, the transmission of the whole data is facilitated, and the data transmission efficiency is improved.
The foregoing is merely illustrative and explanatory of the principles of the invention, as various modifications and additions may be made to the specific embodiments described, or similar thereto, by those skilled in the art, without departing from the principles of the invention or beyond the scope of the appended claims.
Claims (10)
1. A method for exchanging data in a real-time database, comprising:
step one, establishing database connection: acquiring connection parameters of the main real-time database and the target real-time database, and establishing connection between the main real-time database and the target real-time database according to the connection parameters of the main real-time database and the target real-time database;
step two, establishing a switching mode: acquiring storage information of each target real-time database and performance indexes of the main real-time database, respectively calculating exchange data evaluation coefficients of each target real-time database and the main real-time database, and obtaining comprehensive scores of data exchange between each target real-time database and the main real-time database through calculation, thereby confirming a data exchange mode between each target real-time database and the main real-time database;
step three, data transmission monitoring: transmitting data to be exchanged in the main real-time database to each target real-time database type according to a data exchange mode between each target real-time database and the main real-time database, and monitoring transmission information between the main real-time database and each target real-time database in the transmission process of the data to be exchanged to obtain transmission information between the main real-time database and each target real-time database;
step four, data transmission analysis: according to the transmission information between the main real-time database and each target real-time database, analyzing the network fluctuation value corresponding to each target real-time database, and further judging the data exchange effect corresponding to each target real-time database;
step five: exchange data authentication: and after each target real-time database receives the data to be exchanged, checking the data to be exchanged in each target real-time database.
2. The method for exchanging data with a real-time database according to claim 1, wherein the calculating the exchanging data evaluation coefficients of each target real-time database comprises the following specific calculating process:
the performance indexes of each target real-time database comprise storage capacity, query speed and CPU occupation rate;
substituting the storage capacity, query speed and CPU occupancy rate of each target real-time database into a calculation formulaObtaining the exchange data evaluation coefficient xi of each target real-time database i Wherein A is i 、B i 、C i The storage capacity, the query speed and the CPU occupancy rate corresponding to the ith real-time database are respectively represented, i is a number corresponding to each target real-time database, i=1, 2 1 、κ 2 、κ 3 And respectively setting weight factors corresponding to the storage capacity, the query speed and the CPU occupation rate of each target real-time database.
3. A method for exchanging data with a real-time database according to claim 2, wherein the calculating the exchange data evaluation coefficients of the master real-time database is performed by the following steps:
the performance indexes of the main real-time database comprise data index efficiency, data recovery speed and memory utilization rate;
substituting the data index efficiency, the data recovery speed and the memory utilization rate of the main real-time database into a calculation formulaObtaining an exchange data evaluation coefficient psi of the main real-time database, wherein W, V, S respectively represents data index efficiency, data recovery speed and memory utilization rate corresponding to the main real-time database, W ', V ', S ' respectively represent standard data index efficiency, standard data recovery speed and standard memory utilization rate corresponding to the set main real-time database, and DeltaW, deltaV and DeltaS respectively represent allowable data index efficiency difference, allowable data recovery speed difference and allowable memory utilization rate difference corresponding to the set main real-time database, and DeltaA 1 、λ 2 、λ 3 Respectively set weight factors corresponding to data index efficiency, data recovery speed and memory utilization rate of main real-time databaseAnd (5) a seed.
4. A method for exchanging data with a real-time database according to claim 2, wherein the calculation is performed to obtain a composite score of the data exchange between each target real-time database and the main real-time database, and the specific calculation process is as follows:
substituting the exchange data evaluation coefficients of each target real-time database and the exchange data evaluation coefficients of the main real-time database into a calculation formula eta=ζ i *μ 1 +ψ*μ 2 Obtaining a composite score for data exchange between each target real-time database and the master real-time database, wherein mu 1 、μ 2 And exchanging data evaluation coefficients for the set target real-time databases and weight factors corresponding to the data evaluation coefficients for the master real-time database respectively.
5. The method for exchanging data with a real-time database according to claim 4, wherein the data exchange manner between each target real-time database and the main real-time database is confirmed by the following specific confirmation process:
the data exchange mode of the real-time database comprises data circuit exchange, message exchange and packet exchange;
the comprehensive score of the data exchange between each target real-time database and the main real-time database is obtained, the comprehensive score of the data exchange between each target real-time database and the main real-time database is compared with the set scoring interval of each data exchange mode, and if the comprehensive score of the data exchange between each target real-time database and the main real-time database is within the set scoring interval of each data exchange mode, the data exchange mode between each target real-time database and the main real-time database is judged to belong to the data exchange mode corresponding to the set scoring interval of each data exchange mode.
6. A method for exchanging data with a real-time database according to claim 1, wherein the transmission information between the main real-time database and each target real-time database is monitored, and the specific detection process is as follows:
and arranging each time point according to a preset time interval in the transmission process of the data to be exchanged, and operating a detection device corresponding to each target real-time database, thereby acquiring the network speed, the exchange data storage capacity, the packet loss rate and the network throughput corresponding to each time point of each target real-time database, and taking the network speed, the exchange data storage capacity, the packet loss rate and the network throughput corresponding to each time point of each target backup database as transmission information between the main real-time database and each target real-time database.
7. A method for exchanging data with a real-time database according to claim 3, wherein the network fluctuation value corresponding to each target real-time database is specifically analyzed as follows:
substituting the network speed, the exchange data capacity, the packet loss rate and the network throughput corresponding to each target backup database at each time point into a calculation formula
Obtaining a network fluctuation value xi corresponding to each real-time backup database, wherein V t i 、/>The network speed, the exchange data capacity, the packet loss rate and the network throughput corresponding to the ith target real-time database at the t time point are respectively represented, t is the number corresponding to each time point, t=1, 2, m is any integer greater than 2>The values of network speed, exchange data capacity, packet loss rate and network throughput of the ith target real-time database at the t-1 th time are respectively set allowable network speed difference, allowable exchange data capacity difference, allowable packet loss difference and allowable network throughput difference, and K is respectively set as DeltaV, deltaR, deltaB and DeltaC 1 、K 2 、K 3 、K 4 Respectively set weight factors corresponding to network speed, exchange data capacity, packet loss rate and network throughput.
8. The method for exchanging data with a real-time database according to claim 1, wherein the determining the data exchange effect corresponding to each target real-time database comprises the following specific determining process:
comparing the network fluctuation value corresponding to each target exchange real-time database with a preset network fluctuation value threshold, judging that the data exchange effect of the target real-time database is poor if the network fluctuation value corresponding to a certain target real-time database is larger than the network fluctuation value threshold, and judging that the data exchange effect of the target real-time database is good if the network fluctuation value corresponding to a certain target real-time database is smaller than or equal to the network fluctuation value threshold, so that the data exchange effect corresponding to each target real-time database is judged.
9. The method for exchanging data with a real-time database according to claim 1, wherein the checking the data to be exchanged in each target real-time database comprises the following specific checking process:
comparing the data to be exchanged in each target real-time database with the data to be exchanged in the main real-time database, if the data to be exchanged in a certain target real-time database is different from the data to be exchanged in the corresponding real-time database, deleting all the data to be exchanged in the target real-time database, and executing the step 3, if the data to be exchanged in the target real-time database is the same as the data to be exchanged in the main real-time database, judging that the data to be exchanged in the target real-time database is completed, and checking the data to be exchanged in each target real-time database.
10. A real-time database for a data exchange device, applied to a method for exchanging data according to any one of claims 1-9, characterized by: the real-time database is used for exchanging data equipment and comprises a processor, a memory and a communication bus; the memory has stored thereon a computer readable program executable by the processor; the communication bus realizes connection communication between the processor and the memory; the processor, when executing the computer readable program, implements the steps of a method for exchanging data according to a real-time database as claimed in any one of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311210353.XA CN117331993B (en) | 2023-09-19 | 2023-09-19 | Method and equipment for exchanging data by real-time database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311210353.XA CN117331993B (en) | 2023-09-19 | 2023-09-19 | Method and equipment for exchanging data by real-time database |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117331993A true CN117331993A (en) | 2024-01-02 |
| CN117331993B CN117331993B (en) | 2024-06-21 |
Family
ID=89282121
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311210353.XA Active CN117331993B (en) | 2023-09-19 | 2023-09-19 | Method and equipment for exchanging data by real-time database |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117331993B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110196824A1 (en) * | 2010-02-05 | 2011-08-11 | Oracle International Corporation | Orchestrated data exchange and synchronization between data repositories |
| CN110096541A (en) * | 2019-04-28 | 2019-08-06 | 新华三大数据技术有限公司 | Method for interchanging data and device between a kind of database |
| CN113987002A (en) * | 2021-09-26 | 2022-01-28 | 陈文艳 | Data exchange method based on mass data analysis platform |
| CN116450726A (en) * | 2023-04-26 | 2023-07-18 | 国网河北省电力有限公司 | Multi-source heterogeneous data exchange platform and exchange method for power system |
| CN116471103A (en) * | 2023-05-04 | 2023-07-21 | 深圳市显科科技有限公司 | Internal and external network data security exchange method, device and equipment based on boundary network |
| CN116708434A (en) * | 2023-06-16 | 2023-09-05 | 广东红海湾发电有限公司 | Data exchange system capable of simultaneously meeting multiple types of relational databases |
-
2023
- 2023-09-19 CN CN202311210353.XA patent/CN117331993B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110196824A1 (en) * | 2010-02-05 | 2011-08-11 | Oracle International Corporation | Orchestrated data exchange and synchronization between data repositories |
| CN110096541A (en) * | 2019-04-28 | 2019-08-06 | 新华三大数据技术有限公司 | Method for interchanging data and device between a kind of database |
| CN113987002A (en) * | 2021-09-26 | 2022-01-28 | 陈文艳 | Data exchange method based on mass data analysis platform |
| CN116450726A (en) * | 2023-04-26 | 2023-07-18 | 国网河北省电力有限公司 | Multi-source heterogeneous data exchange platform and exchange method for power system |
| CN116471103A (en) * | 2023-05-04 | 2023-07-21 | 深圳市显科科技有限公司 | Internal and external network data security exchange method, device and equipment based on boundary network |
| CN116708434A (en) * | 2023-06-16 | 2023-09-05 | 广东红海湾发电有限公司 | Data exchange system capable of simultaneously meeting multiple types of relational databases |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117331993B (en) | 2024-06-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112087334B (en) | Alarm root cause analysis method, electronic device and storage medium | |
| CN110874744B (en) | Data anomaly detection method and device | |
| CN113949577A (en) | Data attack analysis method applied to cloud service and server | |
| CN112184510B (en) | Interactive teaching platform based on high in clouds | |
| CN115865779A (en) | Communication path selection method, system, terminal equipment and storage medium | |
| CN115022022A (en) | Method for improving Raft consensus mechanism based on node past behavior analysis | |
| CN112818056A (en) | Log security sharing method, system and device of block chain | |
| CN107528861B (en) | A kind of method and device of determining IP user's access authority | |
| CN117331993B (en) | Method and equipment for exchanging data by real-time database | |
| CN107257290B (en) | Test method and system for open SOA service-oriented architecture | |
| CN112969172A (en) | Communication flow control method based on cloud mobile phone | |
| CN116614251A (en) | Data security monitoring system | |
| CN116528226A (en) | Security monitoring method and system based on remote module wireless communication | |
| CN113949578B (en) | Automatic detection method and device for unauthorized loopholes based on flow and computer equipment | |
| CN101286903A (en) | Method for enhancing integrity of sessions in network audit field | |
| CN111835741B (en) | Internet of things equipment safety access system and method based on consensus mechanism and intelligent contract | |
| CN114760083A (en) | Method and device for issuing attack detection file and storage medium | |
| CN117857212B (en) | Cloud information access security monitoring method, system, electronic equipment and computer readable storage medium | |
| CN111404928B (en) | Block chain link point consensus method suitable for real-time transaction scene | |
| CN117931953B (en) | Heterogeneous database data synchronization method and system | |
| CN116684303B (en) | Digital twinning-based data center operation and maintenance method and system | |
| CN117834123B (en) | Industrial Internet equipment safety state early warning method based on encrypted data | |
| CN108449425A (en) | A kind of monitoring system of machine and its method based on Internet of Things | |
| CN112804255B (en) | Network abnormal node detection method based on node multidimensional characteristics | |
| TW202335469A (en) | Anomaly detection system, method and computer readable medium based on system characteristics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |