CN113626516A - Data increment synchronization method and system - Google Patents
Data increment synchronization method and system Download PDFInfo
- Publication number
- CN113626516A CN113626516A CN202110687848.6A CN202110687848A CN113626516A CN 113626516 A CN113626516 A CN 113626516A CN 202110687848 A CN202110687848 A CN 202110687848A CN 113626516 A CN113626516 A CN 113626516A
- Authority
- CN
- China
- Prior art keywords
- terminal
- database
- data
- server
- terminals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data increment synchronization method and a system, wherein the method is applied to a data increment synchronization system and comprises a first database, a server, a terminal set and a second database, and the method comprises the following steps: the server acquires the logs of the first database from the first database, analyzes the logs of the first database and stores the analysis result; the terminal set judges whether the data of the first database are changed through the server; if the terminal set judges that the data of the first database are changed, selecting a preset number of terminals as execution terminals by each terminal in the terminal set according to a preset load balancing and trust degree strategy; and the execution terminal acquires the changed data in the first database corresponding to the analysis result from the server and synchronizes the changed data increment in the first database into the second database. The invention can improve the efficiency and the safety of data increment synchronization.
Description
Technical Field
The invention belongs to the technical field of computers, and particularly relates to a method and a system for incremental synchronization of data.
Background
The rapid development of the internet promotes the transformation and the upgrade of the traditional industry, and more enterprises and public institutions, government and government affair systems and the like realize the informatization of services in the process of fusing with the internet. However, the information systems are not uniform, and data sharing among databases of the systems is difficult.
However, in many application scenarios, data sharing and data synchronization between different databases need to be performed, where data synchronization refers to that after data in one database is changed, the change needs to be synchronized to another database, so as to ensure consistency of data in the entire system.
The existing data synchronization methods are divided into full-quantity synchronization and incremental synchronization. The full synchronization is that all data are read from a source database and then are converted to a certain degree and then applied to a target database. Incremental synchronization refers to synchronizing only data changed after the last synchronization each time, so that the time consumption is less, and the real-time consistency of the data is better.
How to improve the efficiency and the safety of data increment synchronization is a problem which needs to be solved urgently in the existing increment synchronization scheme.
Disclosure of Invention
In view of this, the present invention provides a data increment synchronization method and system, which can improve the efficiency and security of data increment synchronization.
A first aspect of an embodiment of the present invention provides a data increment synchronization method, which is applied to a data increment synchronization system, where the system includes a first database, a server, a terminal set and a second database, where the terminal set includes N terminals, N is greater than or equal to 2, the server communicates with the first database and the terminal set, respectively, and the terminal set further communicates with the second database, and the method includes:
the server acquires the log of the first database from the first database, analyzes the log of the first database and stores an analysis result;
the terminal set judges whether the data of the first database are changed or not through the server, wherein the server judges whether the data of the first database are changed or not according to the analysis result;
if the terminal set judges that the data of the first database are changed, selecting a preset number of terminals as execution terminals by each terminal in the terminal set according to a preset load balancing and trust degree strategy;
and the execution terminal acquires the changed data in the first database corresponding to the analysis result from the server and synchronizes the changed data increment in the first database to the second database.
In a second aspect, an embodiment of the present invention provides a data incremental synchronization system, where the system includes a first database, a server, a terminal set, and a second database, where the terminal set includes N terminals, N is greater than or equal to 2, the server communicates with the first database and the terminal set, respectively, and the terminal set further communicates with the second database, and the data incremental synchronization system is configured to implement the steps of the method according to the first aspect.
The embodiment of the invention provides a data increment synchronization method and a data increment synchronization system.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a schematic diagram of a data incremental synchronization system provided by an embodiment of the present invention;
fig. 2 is a flowchart of an implementation of a data increment synchronization method according to an embodiment of the present invention;
FIG. 3 is a flowchart of another implementation of a data increment synchronization method according to an embodiment of the present invention;
FIG. 4 is a flowchart of another implementation of a data increment synchronization method according to an embodiment of the present invention;
FIG. 5 is a flowchart of another implementation of a data increment synchronization method according to an embodiment of the present invention;
FIG. 6 is a flowchart illustrating an implementation of another data increment synchronization method according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a terminal or a server according to an embodiment of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following description is made by way of specific embodiments with reference to the accompanying drawings.
Referring to fig. 1, which shows a schematic diagram of a data incremental synchronization system provided by an embodiment of the present invention, the data incremental synchronization method provided by the present invention is applied to a data incremental synchronization system shown in fig. 1, as shown in the drawing, the system includes a first database, a server, a terminal set and a second database, where the terminal set includes N terminals, N is greater than or equal to 2, the server communicates with the first database and the terminal set respectively, and the terminal set further communicates with the second database, and with reference to fig. 2, the method includes:
s101, the server acquires logs of the first database from the first database, analyzes the logs of the first database and stores analysis results.
Taking the MySQL database as an example, the MySQL log includes a binary log, and the binary log records all modification operations of the MySQL database, including data modification such as insertion, update, and deletion, and modification of the data table by CREATE and the like, which are preconditions for copying, backing up, and recovering the MySQL database, and if the first database is the MySQL database, the log of the first database at least includes the binary log of the MySQL database.
Of course, in the embodiment of the present invention, the types of the first database, the second database, and the log are not limited, and any type of database capable of implementing the data increment method provided by the present invention is within the protection scope of the present invention.
Specifically, the server establishes a connection with a first database, and sends a log query message to the first database, where the log message includes a log file name and an offset position in a log file, and after receiving the log query message, the first database pushes all log events recorded in a log after the log file name and the offset position in the log file are determined to the server, and after data change occurs in the first database, the first database writes the change into its own log file in the form of a log event, and pushes the log event to the server. After receiving the log event, the server analyzes the log event, and then complete data change can be obtained.
And S102, the terminal set judges whether the data of the first database are changed through the server, wherein the server judges whether the data of the first database are changed according to the analysis result.
The server analyzes the log of the first database to judge whether the first database has data change. The terminal set judges whether the data of the first sub-database is changed through the server, and the method includes but is not limited to the following two modes:
in an optional embodiment, if the server determines that the data of the first database is changed according to the analysis result, the server issues a broadcast message to the terminal set, where the broadcast message is used to indicate that the data of the first database is changed;
in another optional implementation manner, any terminal in the terminal set sends a query message to the server at preset time intervals, where the query message is used to query whether the first database has data change in a time period corresponding to the preset time intervals.
And S103, if the terminal set judges that the data of the first database are changed, selecting a preset number of terminals as execution terminals by each terminal in the terminal set according to a preset load balancing and trust degree strategy.
In this step, the trust level refers to the trust level of the server to the terminal, the load balancing refers to the performance index of the central processing unit CPU of the terminal itself, and a preset number of terminals with better comprehensive trust level and load balancing capability are selected as the execution terminals in this step.
And S104, the execution terminal acquires the changed data in the first database corresponding to the analysis result from the server, and synchronizes the changed data increment in the first database to the second database.
Because the execution terminal in this step is the terminal with better integration of the trust level and the load balancing capability selected in step S103, the efficiency and the security of the incremental synchronization of the data when the execution terminal executes step S104 are improved.
Therefore, the invention selects the preset number of terminals with better comprehensive trust and load balancing capability as the execution terminals in the terminal cluster by establishing the terminal cluster to synchronize the data increment in the first database to the second database, thereby improving the efficiency and the safety of data increment synchronization.
Fig. 3 shows a flowchart of another implementation of the data increment synchronization method according to the embodiment of the present invention, where the embodiment is mainly used to implement step S103 in the embodiment corresponding to fig. 2, and details are as follows in conjunction with fig. 3:
and S1031, aiming at any terminal in the terminal set, the terminal acquires the trust degree score of the server to the terminal.
Optionally, the server performs trust level scoring on the terminal according to a preset trust index corresponding to the terminal, where the preset trust index corresponding to the terminal includes, but is not limited to, network location information of the terminal, a device type of the terminal, a network access mode of the terminal, a historical packet loss rate of the terminal, and a historical average network delay of the terminal. And the server sends the trust level score of the terminal to the terminal.
S1032, the terminal obtains the data processing capability score of the terminal according to the performance index of the CPU of the terminal.
Optionally, the CPU performance of the terminal includes, but is not limited to, a cache capacity and a utilization rate of the CPU of the terminal.
And S1033, the terminal obtains a self comprehensive score according to the trust score, the self data processing capability score and the preset weight value.
Optionally, the terminal calculates its own comprehensive score through the following formula:
wz＝ρ1w1+ρ2w2
wherein, wzFor a composite rating of the terminal, p1And ρ2For presetting a weight coefficient, rho1And ρ2Is 1, w1Rating of the server's trust of the terminal, w2And scoring the data processing capability of the terminal.
S1034, the terminal broadcasts the comprehensive score of the terminal in the terminal set.
S1035, selecting a preset number of terminals as executing terminals by all terminals in the terminal set according to the comprehensive score of each terminal.
Optionally, all terminals in the terminal set sort the comprehensive scores of each terminal in the order from high to low, and select the terminals with the top preset number in the sorting result as the execution terminals.
Therefore, the invention selects the preset number of terminals with better comprehensive trust and load balancing capability as the execution terminals in the terminal cluster to synchronize the data increment in the first database to the second database, thereby improving the efficiency and safety of data increment synchronization.
Fig. 4 shows a flowchart of another implementation of a data increment synchronization method provided in an embodiment of the present invention, which is detailed in conjunction with fig. 4 as follows:
s401, the server divides the analysis result into a plurality of categories, and each category corresponds to a category label.
For example, the data in the first database is classified into the following three categories: a government information class, a financial data class, a news message class. For the second database, in some application scenarios, it is not necessary or not authorized to perform incremental synchronization on all types of data in the first database, but only one type or several types of data are necessary or authorized to perform incremental synchronization.
In this application scenario, the server divides the parsing result into a plurality of categories, each category corresponding to a category tag.
S402, the server judges the authorized class label corresponding to the execution terminal.
The execution terminal is used for incrementally synchronizing the data in the first database to the second database, for example, the second database only needs or only has the right to perform data incremental synchronization on one category of data or several categories of data, at this time, all terminals in the terminal set are authorized in advance to only need the second database, or only have the right to perform class labeling corresponding to one category of data or several categories of data.
And S403, the server obtains the changed data in the first database corresponding to the authorized category labels according to the authorized category labels corresponding to the execution terminal, and sends the data to the execution terminal, wherein the authorized category labels of any two terminals in the terminal set are the same, and the preset number is 1.
In the application scenario of the embodiment of the present invention, authorized category labels of any two terminals in the terminal set are the same, the preset number is 1, and only one terminal in the terminal set is selected as an execution terminal.
For example, if all terminals in the terminal set are authorized for the data category label "financial data category", the executing terminal sends the changed data in the first database corresponding to the data category label "financial data category" to the executing terminal.
The embodiment of the invention classifies the data in the first database, so that the execution terminal can only obtain the data of the first database within the authorized range and synchronizes the increment of the data into the second database, thereby not only reducing the transmission quantity of the data, but also further ensuring the safety of the data.
Fig. 5 shows a flowchart of another implementation of a data increment synchronization method provided in an embodiment of the present invention, which is detailed in conjunction with fig. 5 as follows:
s501, the server divides the analysis result into M categories, each category corresponds to a category label, the contents of any two categories are not overlapped, and M is a positive integer greater than or equal to 2.
For example, the data in the first database is classified into the following three categories: a government information class, a financial data class, a news message class.
When the task of data increment synchronization is very large, only one execution terminal has large increment synchronization calculation amount and low efficiency, and in the application scene, the server divides the analysis result into a plurality of categories, and each category corresponds to one category label.
S502, the preset number is M, authorized category labels corresponding to any two execution terminals in the M execution terminals are different, and aiming at any one execution terminal in the M execution terminals, the server obtains changed data in the first database corresponding to the authorized category label according to the authorized category label corresponding to the execution terminal, and sends the data to the execution terminal.
For example, the data in the first database is classified into the following three categories: a government information class, a financial data class, a news message class, and in this case, M is 3.
Selecting 3 execution terminals from the terminal set, wherein the authorized class label of the terminal 1 is 'government affair information class', and then the terminal 1 synchronizes the data increment of the 'government affair information class' to a second database; if the authorized category label of the terminal 2 is 'financial data class', the terminal 2 synchronizes the data increment of the 'financial data class' to the second database; the authorized category label of the terminal 3 is "news message class", the terminal 3 synchronizes the data increment of "news message class" to the second database.
In the implementation of the invention, the server divides the analysis result into M categories, and the M execution terminals respectively execute the increment synchronization work from the first database to the second database corresponding to one category label, thereby improving the efficiency of the increment synchronization.
Fig. 6 shows a flowchart of another implementation of a data increment synchronization method according to an embodiment of the present invention, which is detailed in conjunction with fig. 6 as follows:
s601, the server divides the analysis result into a plurality of levels.
And dividing the analysis result into a plurality of levels according to the importance degree of the data in the first database.
For example, the server divides the parsing result into 3 levels, i.e. level 1 data, level 2 data, and level 3 data, where the data levels are, from low to high: level 1 data, level 2 data, level 3 data.
S602, the server judges the authorized level corresponding to the execution terminal.
The second database is only authorized to synchronize certain levels of data. For example, the second database only allows synchronization of data at level 2 and below, at which time each terminal in the set of terminals is correspondingly authorized at level 2.
S603, the server obtains the changed data which is equal to or lower than the authorization level in the first database according to the authorization level corresponding to the execution terminal, and sends the data to the execution terminal, wherein the authorization levels of any two terminals in the terminal set are the same, and the preset number is 1.
In the embodiment of the invention, the authorized levels of any two terminals in the terminal set are the same, the preset number is 1, and only one terminal in the terminal set is selected as an execution terminal.
In the embodiment of the invention, the data in the first database is classified in grades, so that the terminal in the terminal set can only synchronize the data in the first database with the authorization level of the terminal set being the same as or lower than the authorization level of the terminal set to the second database, thereby ensuring the security of incremental synchronization of the data.
Optionally, the first database and the second database are databases of the same data type, or the first database and the second database are databases of different data types; if the first database and the second database are databases of different data types, then synchronizing the changed data increment in the first database to the second database further comprises: and performing data processing on the changed data in the first database, so that the data format of the changed data in the first database is the same as that of the second database.
The invention can be applied to data increment synchronization between mainstream databases, including but not limited to MySQL database, SQL Server database, etc.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Fig. 7 is a schematic diagram of a terminal or a server according to an embodiment of the present invention. As shown in fig. 7, the terminal or server 7 of this embodiment includes: a processor 70, a memory 71 and a computer program 72 stored in said memory 71 and executable on said processor 70. The processor 70, when executing the computer program 72, implements the steps of the above-described embodiments of the data incremental synchronization method, such as the steps 101 to 104 shown in fig. 2.
Illustratively, the computer program 72 may be partitioned into one or more modules/units that are stored in the memory 71 and executed by the processor 70 to implement the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 72 in the terminal 7.
The terminal 7 may be a desktop computer, a notebook, a palm computer, a cloud server, or other computing devices. The terminal 7 may include, but is not limited to, a processor 70, a memory 71. It will be appreciated by those skilled in the art that fig. 7 is only an example of a terminal 7 and does not constitute a limitation of the terminal 7, and that it may comprise more or less components than those shown, or some components may be combined, or different components, for example the terminal may further comprise input output devices, network access devices, buses, etc.
The Processor 70 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 71 may be an internal storage unit of the terminal 7, such as a hard disk or a memory of the terminal 7. The memory 71 may also be an external storage device of the terminal 7, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) and the like provided on the terminal 7. Further, the memory 71 may also include both an internal storage unit and an external storage device of the terminal 7. The memory 71 is used for storing the computer program and other programs and data required by the terminal. The memory 71 may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal and method may be implemented in other ways. For example, the above-described apparatus/terminal embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method according to the above embodiments may also be implemented by a computer program, which may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of the above embodiments of the data increment synchronization method. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain other components which may be suitably increased or decreased as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media which may not include electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (10)
1. A data increment synchronization method is applied to a data increment synchronization system, the system comprises a first database, a server, a terminal set and a second database, wherein the terminal set comprises N terminals, N is more than or equal to 2, the server is respectively communicated with the first database and the terminal set, and the terminal set is also communicated with the second database, the method comprises the following steps:
the server acquires the log of the first database from the first database, analyzes the log of the first database and stores an analysis result;
the terminal set judges whether the data of the first database are changed or not through the server, wherein the server judges whether the data of the first database are changed or not according to the analysis result;
if the terminal set judges that the data of the first database are changed, selecting a preset number of terminals as execution terminals by each terminal in the terminal set according to a preset load balancing and trust degree strategy;
and the execution terminal acquires the changed data in the first database corresponding to the analysis result from the server and synchronizes the changed data increment in the first database to the second database.
2. The method of claim 1, wherein the determining, by the server, whether the data in the first database is changed by the terminal set comprises:
if the server judges that the data of the first database is changed according to the analysis result, the server issues a broadcast message to the terminal set, wherein the broadcast message is used for indicating that the data of the first database is changed;
or, any terminal in the terminal set sends a query message to the server at intervals of a preset time interval, where the query message is used to query whether the first database has data change in a time period corresponding to the preset time interval.
3. The method according to claim 1, wherein each terminal in the terminal set selects a preset number of terminals as executing terminals according to a preset load balancing and trust policy, and the method comprises:
aiming at any terminal in the terminal set, the terminal acquires the trust level score of the server to the terminal;
the terminal obtains the data processing capability score of the terminal according to the performance index of a Central Processing Unit (CPU) of the terminal;
the terminal obtains a self comprehensive score according to the trust score, the self data processing capability score and a preset weight value;
the terminal broadcasts the self comprehensive score in the terminal set;
and selecting a preset number of terminals as execution terminals by all terminals in the terminal set according to the comprehensive score of each terminal.
4. The method according to claim 3, wherein the selecting, by all terminals in the terminal set, a preset number of terminals as executing terminals according to the composite score of each terminal comprises:
and sequencing the comprehensive scores of all the terminals in the terminal set according to the sequence from high to low, and selecting the terminals with the preset number in the sequencing result as execution terminals.
5. The method of claim 2, wherein the terminal obtaining the trust score of the server for the terminal comprises:
the server scores the trust level of the terminal according to a preset trust index corresponding to the terminal, wherein the preset trust index corresponding to the terminal comprises network position information of the terminal, the equipment type of the terminal, the network access mode of the terminal, the historical packet loss rate of the terminal and the historical average network delay of the terminal;
and the server sends the trust level score of the terminal to the terminal.
6. The method of claim 1, further comprising:
the server divides the analysis result into a plurality of categories, and each category corresponds to a category label;
the step of acquiring, by the execution terminal, the changed data in the first database corresponding to the analysis result from the server includes:
the server judges an authorized category label corresponding to the execution terminal;
the server obtains the changed data in the first database corresponding to the authorized category labels according to the authorized category labels corresponding to the execution terminal, and sends the data to the execution terminal, wherein the authorized category labels of any two terminals in the terminal set are the same, and the preset number is 1.
7. The method of claim 1, further comprising:
the server divides the analysis result into M categories, each category corresponds to a category label, the contents of any two categories are not coincident, and M is a positive integer greater than or equal to 2;
the step of acquiring, by the execution terminal, the changed data in the first database corresponding to the analysis result from the server includes:
the preset number is M, authorized category labels corresponding to any two execution terminals in the M execution terminals are different, and for any one execution terminal in the M execution terminals, the server obtains changed data in a first database corresponding to the authorized category label according to the authorized category label corresponding to the execution terminal, and sends the data to the execution terminal.
8. The method of claim 1, further comprising:
the server divides the analysis result into a plurality of levels;
the step of acquiring, by the execution terminal, the changed data in the first database corresponding to the analysis result from the server includes:
the server judges the authorized level corresponding to the execution terminal;
and the server obtains the changed data which is equal to or lower than the authorization level in the first database according to the authorization level corresponding to the execution terminal, and sends the data to the execution terminal, wherein the authorization levels of any two terminals in the terminal set are the same, and the preset number is 1.
9. The method of any one of claims 1 to 8, wherein the first database and the second database are databases of the same data type, or wherein the first database and the second database are databases of different data types;
if the first database and the second database are databases of different data types, synchronizing the changed data increment in the first database to the second database further includes:
and performing data processing on the changed data in the first database, so that the data format of the changed data in the first database is the same as that of the second database.
10. A data incremental synchronization system, comprising a first database, a server, a terminal set and a second database, wherein the terminal set comprises N terminals, N is greater than or equal to 2, the server is respectively in communication with the first database and the terminal set, and the terminal set is also in communication with the second database, the data incremental synchronization system is configured to implement the steps of the method according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110687848.6A CN113626516A (en) | 2021-06-21 | 2021-06-21 | Data increment synchronization method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110687848.6A CN113626516A (en) | 2021-06-21 | 2021-06-21 | Data increment synchronization method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113626516A true CN113626516A (en) | 2021-11-09 |
Family
ID=78378261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110687848.6A Pending CN113626516A (en) | 2021-06-21 | 2021-06-21 | Data increment synchronization method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113626516A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115794837A (en) * | 2023-02-01 | 2023-03-14 | 天翼云科技有限公司 | Data table synchronization method and system, electronic equipment and storage medium |
-
2021
- 2021-06-21 CN CN202110687848.6A patent/CN113626516A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115794837A (en) * | 2023-02-01 | 2023-03-14 | 天翼云科技有限公司 | Data table synchronization method and system, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109299164B (en) | Data query method, computer readable storage medium and terminal equipment | |
| CN111914520A (en) | Document collaborative editing method and device, computer device and storage medium | |
| CN112597153B (en) | Block chain-based data storage method, device and storage medium | |
| CN105989076A (en) | Data statistical method and device | |
| CN113704243A (en) | Data analysis method, data analysis device, computer device, and storage medium | |
| CN110674152B (en) | Data synchronization method and device, storage medium and electronic equipment | |
| CN111506559A (en) | Data storage method and device, electronic equipment and storage medium | |
| CN111104426B (en) | Data query method and system | |
| CN111611249A (en) | Data management method, device, equipment and storage medium | |
| CN112181967B (en) | Method, device, computer equipment and medium for monitoring quality of source data | |
| CN108446989B (en) | Method for determining commission charge and terminal equipment | |
| CN112416991A (en) | Data processing method and device and storage medium | |
| CN113722276A (en) | Log data processing method, system, storage medium and electronic equipment | |
| CN110569308A (en) | Data file assembling method, device, equipment and storage medium | |
| CN113626516A (en) | Data increment synchronization method and system | |
| CN111753019A (en) | Data partitioning method and device applied to data warehouse | |
| CN113254457A (en) | Account checking method, account checking system and computer readable storage medium | |
| CN102737082A (en) | Method and system for dynamically updating file data indexes | |
| JP2024509629A (en) | Quantum car type component basic database creation method, device, electronic equipment, and storage medium | |
| CN111209284B (en) | Meta-data-based sub-table method and device | |
| CN116628042A (en) | Data processing method, device, equipment and medium | |
| CN114356712A (en) | Data processing method, device, equipment, readable storage medium and program product | |
| CN111221817B (en) | Service information data storage method, device, computer equipment and storage medium | |
| CN115794806A (en) | Gridding processing system, method and device for financial data and computing equipment | |
| CN114547184A (en) | Personnel information synchronization method, terminal device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |