WO2021168654A1

WO2021168654A1 - Method and apparatus for detecting synchronized data, server, and data synchronization system

Info

Publication number: WO2021168654A1
Application number: PCT/CN2020/076609
Authority: WO
Inventors: 徐豪聪
Original assignee: 深圳市欢太科技有限公司; Oppo广东移动通信有限公司
Priority date: 2020-02-25
Filing date: 2020-02-25
Publication date: 2021-09-02
Also published as: CN114981797A

Abstract

Disclosed in the embodiments of the present application are a method and apparatus for detecting synchronized data, a server, and a data synchronization system. The method comprises: obtaining target time corresponding to data detection; obtaining first data and second data, the first data being the data in synchronized data stored in a source end to which the update time corresponding is the target time, and the second data being the data in synchronized data stored in a target end to which the update time corresponding is the target time, wherein the synchronized data stored in the source end is the data synchronized to the target end, and the synchronized data stored in the target end is the data synchronized from the source end; and performing the data detection on the first data and the second data. According to the method, first data and second data serving as portions to be detected can be determined on the basis of update time in a detection process of synchronized data that is synchronized from the source end to the target end, so as to reduce the amount of repeatedly detected data and reduce the cost of verification.

Description

Method, device, server and data synchronization system for detecting synchronization data

Technical field

This application relates to the field of data synchronization, and more specifically, to a method, device, server, and data synchronization system for detecting synchronized data.

Background technique

For the purpose of data security backup or to improve the access speed of users everywhere, some Internet sites will deploy multiple sites in different locations. Among them, each site is a server or a cluster composed of multiple servers. These sites will maintain data synchronization, so that part of the data content or all the data content stored therein are consistent. However, in this data synchronization, the consistency detection method of the synchronized data needs to be improved.

Summary of the invention

In view of the above-mentioned problems, this application proposes a method, device, server, and data synchronization system for detecting synchronization data to improve the above-mentioned problems.

In a first aspect, the present application provides a method for detecting synchronization data, the method includes: obtaining data and detecting a corresponding target time; obtaining first data and second data, the first data being synchronized data stored at the source end The corresponding update time in the target time is the data of the target time, and the second data is the data of the synchronization data stored at the target end and the corresponding update time is the target time, wherein the synchronization data stored in the source end is the synchronization data. For the data to the target end, the synchronization data stored by the target end is data synchronized from the source end; the data detection is performed on the first data and the second data.

In the second aspect, the present application provides a method for detecting synchronization data, which is applied to a data synchronization system. The data synchronization system includes a detection end, a source end, and a target end. The synchronization data stored at the source end is synchronized to The data of the target end, the synchronized data stored by the target end is data synchronized from the source end, and the method includes: the detection end obtains the data and detects the corresponding target time; obtains the first data and the second data, The first data is data in which the update time corresponding to the target time in the synchronization data stored at the source end is the target time, and the second data is the data in which the update time corresponding to the target time in the synchronization data stored at the target end is the target time Time data; the data detection is performed on the first data and the second data.

In a third aspect, the present application provides an apparatus for detecting synchronization data. The apparatus includes: a time obtaining unit for obtaining a target time corresponding to the data detection; a data obtaining unit for obtaining first data and second data, The first data is data whose update time is the target time in the synchronization data stored at the source end, and the second data is data whose update time is the target time in the synchronization data stored at the target end, Wherein, the synchronization data stored by the source end is data synchronized to the target end, and the synchronization data stored by the target end is data synchronized from the source end; the data detection unit is configured to compare the first data and Perform the data detection on the second data.

In a fourth aspect, the present application provides a data synchronization system. The data synchronization system includes a detection end, a source end, and a target end. The synchronization data stored by the source end is data synchronized to the target end. The synchronization data stored by the target end is the data synchronized from the source end; the detection end is used to obtain the target time corresponding to the data detection; obtain the first data and the second data, and the first data is the source end The corresponding update time in the stored synchronization data is the data at the target time, and the second data is the data at the target time corresponding to the update time in the synchronization data stored at the target end; for the first data And performing the data detection on the second data.

In a fifth aspect, the present application provides a server including one or more processors and a memory; one or more programs are stored in the memory and configured to be executed by the one or more processors, so The one or more programs are configured to perform the methods described above.

In a sixth aspect, the present application provides a computer-readable storage medium having program code executable by a processor, the program code causing the processor to execute the above-mentioned method.

The present application provides a method, device, server, and data synchronization system for detecting synchronized data. The corresponding target time is detected by first obtaining the data, and then the corresponding update time in the synchronized data stored at the source is obtained as the target time. Data is used as the first data, and the data whose update time is the target time corresponding to the synchronization data stored on the target side is obtained as the second data, and then the data detection is performed on the first data and the second data . Thus, in the detection process of the synchronized data synchronized from the source end to the target end, the first data and the second data as the part to be detected can be determined based on the update time, so as to reduce the amount of repeated detection data and reduce the verification. cost.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 shows a schematic diagram of an application scenario of a method for detecting synchronized data proposed in this application;

Figure 2 shows a flow chart of a method for detecting synchronization data proposed by the present application;

Fig. 3 shows a flowchart of another method for detecting synchronization data proposed by the present application;

Fig. 4 shows a flow chart of a positioning detection proposed in this application;

FIG. 5 shows a flowchart of another method for detecting synchronization data proposed by the present application;

Fig. 6 shows a flowchart of another method for detecting synchronization data proposed by the present application;

FIG. 7 shows a flowchart of another method for detecting synchronization data proposed by the present application;

FIG. 8 shows a structural block diagram of a device for detecting synchronization data proposed by this application;

FIG. 9 shows a structural block diagram of another device for detecting synchronization data proposed by this application;

Fig. 10 shows a structural block diagram of an electronic device proposed in this application.

FIG. 11 is a storage unit for storing or carrying program code for implementing the method for detecting synchronization data according to the embodiment of the present application according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

Generally, Internet companies deploy multiple sites distributed in different regions. Sometimes, in order to ensure that the data between the deployed sites is the same or part of the data in the site is the same, data synchronization is performed between different sites. For example, in order to facilitate user login when accessing each site, login information such as user names and passwords of all users will be synchronized between different sites.

Usually a site is built in a computer room, so when data is synchronized between different sites, it can also be regarded as cross-computer room data synchronization between different computer rooms. Among them, a site can be understood as one end. For example, the site that initiates synchronization during the data synchronization process can be understood as the source end, and the site receiving the synchronized data can be understood as the target end. In the case of data synchronization across computer rooms, in order to facilitate the detection of whether the synchronized data has errors, the synchronized data may be detected, for example, whether the synchronized data stored in the target end is consistent with the data in the source end. The inventor found that there are still many problems that need to be improved in the detection process of related synchronization data.

In a related synchronization data detection process, all the synchronization data are detected at one time each time, which in turn causes a large amount of data to be detected each time. In addition, all the synchronized data will be checked at one time each time, and some data that has not been updated will be checked repeatedly. For example, there are 100 pieces of data stored on the source end, and these 100 pieces of data will be synchronized to the target end as synchronization data, and the synchronized data stored on the target end will include the 100 pieces of data. Optionally, only 10 of these 100 pieces of data may be updated more frequently. However, in each detection process of synchronized data, not only the 10 data that has been updated with a higher frequency will be detected, but also another 90 pieces of data will be detected, resulting in some data that has not been updated. Repeated detection.

In another related synchronization data detection process, 100 pieces of data are stored at the source, and the 100 pieces of data will be detected one by one. In this case, the data that has been detected before will be checked later. In the process of testing other data, the previously tested data may be updated again, but for the previously tested data that has been updated again, the test cannot be performed immediately, which may cause the test results to be different from the actual situation. Inconsistent.

Therefore, in order to improve the above problems, the inventor proposes the method, device, server, and data synchronization system for detecting synchronization data in this application. The method provided by this application can at least detect the corresponding target time by acquiring the data first, and then acquire the source. The data corresponding to the update time of the target time in the synchronization data stored at the target end is used as the first data, and the data corresponding to the update time of the target time stored in the synchronization data is obtained as the second data, and then the data The data detection is performed on the first data and the second data. Thus, in the detection process of the synchronized data synchronized from the source end to the target end, the first data and the second data as the part to be detected can be determined based on the update time, so as to reduce the amount of repeated detection data and reduce the verification. cost.

The following first introduces the environment of a data synchronization system in which the method and device for detecting synchronization data provided by the present application operate.

As shown in FIG. 1, the cross-computer room data synchronization system 100 shown in FIG. 1 includes a first site 110, a second site 120 and a detection terminal 130. Among them, the first site 110, the second site 120, and the detection terminal 130 exchange data with each other through the network 140. Among them, the first site 110 is deployed in the first computer room 111, and the second site 120 is deployed in the second computer room 121. It should be noted that in the present application, both the first site 110 and the second site 120 can be respectively used as the source end or the target end in the data synchronization process. For example, if the first site 110 synchronizes data with the second site 120, the first site 110 can be understood as the source end, and the second site 120 can be understood as the target end. For another example, if the second site 120 synchronizes data with the first site 110, the second site 120 can be understood as the source end, and the first site 110 can be understood as the target end.

Hereinafter, each embodiment of the present application will be described in detail with reference to the accompanying drawings.

Please refer to FIG. 2, a method for detecting synchronization data provided by the present application, the method includes:

S110: Obtain the target time corresponding to the data detection.

It should be noted that, in this embodiment, the data stored in either the source end or the target end will correspond to the configuration update time parameter. The update time corresponding to the data represents the time when the data was last updated. Exemplarily, the update time corresponding to the data A is a year a month a hour a minute a second, which means that the data A was updated in a year a month a hour a minute and a second.

At the beginning of the data detection, the target time can be acquired first as the basis for the selection of the update time. In this embodiment, the target time can be a time, such as a year, a month, a hour, a minute, and a second, or a time period, such as a year, a month, a hour, a minute, and a second to a year, a month, and a hour. b minutes and b seconds.

In this embodiment, there can be multiple ways to determine the target time. The first thing to note is that time itself is an objective and sequential parameter. For example, when a year, a month, a hour, a minute, and a second, the time of a year, a month, a hour, a minute, and a second will not appear again. In this case, as a way to determine the target time, the time at which the previous data detection ends the detection can be used as the starting point to determine the target time, so as to ensure that all updated data can be detected.

S120: Acquire first data and second data, where the first data is data whose update time is the target time in the synchronization data stored at the source end, and the second data is the data corresponding to the synchronization data stored at the target end. The update time of is the data of the target time, wherein the synchronization data stored at the source end is data synchronized to the target end, and the synchronization data stored at the target end is data synchronized from the source end.

It should be noted that the source end will synchronize data to the target end, and the data synchronized from the source end to the target end is regarded as synchronized data in this embodiment. For example, there are 5 pieces of data stored at the source end, namely data A, data B, data C, data D, and data E. In the case where the source side synchronizes the data D and the data E to the target side, the data D and the data E can be understood as a kind of incremental data, which will then be determined as the synchronized data of the source side and the target side.

In addition, it should be noted that the update time corresponding to the same data is the same regardless of whether it is on the source side or the target side when a data synchronization is completed. The same data can be understood as data corresponding to the same data identifier. Still taking the aforementioned data D and data E as examples, after the data D and data E are synchronized to the target end, the update time of the data D stored in the target end is the same as the update time of the data D stored in the source end Yes, the update time of the data E stored at the target end is the same as the update time of the data E stored at the source end. Moreover, after data D and data E are synchronized to the target end, even if the source end data D and data E are updated again and the corresponding update time is changed, the source end again synchronizes the updated data of data D and data E to After the target end, the update time of data D and data E at the target end will still be consistent with the update time of data D and data E at the source end.

For example, the update time corresponding to the data D stored in the source is a year a month 10: 0: 0 second, and the data E corresponding update time is a year a month 11: 0: 0 second. In the case that data D and data E have not been synchronized to the target side, after the source side synchronizes data D and data E for the first time, the corresponding update time of data D stored on the target side is also a year a month 10: 0 0 seconds, and the update time of data E is also a year a month 11: 0: 0 seconds. After that, if the source data D is updated again, and the update time occurs at 12 o'clock, then the update time corresponding to the source end of the data D is changed to a year a month 12: 0: 0 seconds, and the data D is synchronized again After arriving at the target end, the corresponding update time of the data D on the target end will also be changed to 12: 0: 0 seconds of year a and month a.

After the target time is obtained, the update time corresponding to the synchronized data stored at the source end can be matched with the target time, and the data whose update time matches the target time can be filtered out as the first data. Similarly, the update time corresponding to the synchronized data stored at the target end can also be matched with the target time, and data whose update time matches the target time can be filtered out as the second data.

S130: Perform the data detection on the first data and the second data.

As a way, the data detection may be a detection of the consistency of the data. The consistency can be understood as whether the data is the same. Exemplarily, the value corresponding to data D at the source end is 0, and the value corresponding to data D at the target end is 1, and then it is determined that the data D at the source end is inconsistent with the data D at the target end. When the value of data D at the target end is inconsistent When it is also 0, it is determined that the data D at the source end is consistent with the data D at the target end.

As another way, the data detection may be to detect the format of the data to detect whether each piece of data fits the data storage format defined by the site where it is located. Exemplarily, the source side defines the synchronization data to be stored in a first format, and the target side defines the synchronization data to be stored in a second format different from the first format. In other words, when the same piece of data is stored at the source, it is stored in the first format, and after being synchronized to the target, it is stored in the second format, so that it can adapt to the services carried by different sites. Data reading method.

The method for detecting synchronization data provided in this embodiment first detects the corresponding target time by acquiring the data, and then acquires the data whose update time is the target time in the synchronization data stored at the source end as the first data, and Obtain the data whose update time is the target time in the synchronization data stored at the target end as the second data, and then perform the data detection on the first data and the second data. Thus, in the detection process of the synchronized data synchronized from the source end to the target end, the first data and the second data as the part to be detected can be determined based on the update time, so as to reduce the amount of repeated detection data and reduce the verification. cost.

Please refer to FIG. 3, a method for detecting synchronization data provided by the present application, the method includes:

S210: In the current data detection, obtain the target time corresponding to the current data detection.

It should be noted that the amount of data synchronized from the source end to the target end may be relatively large, and in order to reduce the amount of data that needs to be detected each time, data detection can be performed multiple times. In this embodiment, there may be multiple ways to determine how many data detections are specifically required after the data detection starts, and the target time corresponding to each data detection.

As a way, data detection can be performed in a periodic manner after the first data detection starts. In this way, each cycle can correspond to one data detection, and the target time corresponding to the current data detection is the cycle length of the corresponding cycle. Exemplarily, if the period is once every 1 minute, the time length of the target time corresponding to each data detection is 1 minute, and the start time of the target time of the current data detection is corresponding to the previous data detection The end time of the target time.

As another way, a total time range of data detection may be determined first, and the total time range is divided into multiple sub-time ranges, and each sub-time range corresponds to one data detection. In this way, the target time of the current data detection is the corresponding sub-time range. Exemplarily, if the determined total time range is from 10 o'clock to 11 o'clock, then it is divided into 6 sub-time ranges, that is, from 10 o'clock to 10 o'clock, 10 is divided into the first sub-time range, and 10: 10 to 10: 20 is divided into The second sub-time range, 10:20 to 10:30 is divided into the third sub-time range, 10:30 to 10:40 is divided into the fourth sub-time range, and 10:40 to 10:50 is divided into the fifth A sub-time range, 10:50 to 11 o'clock is the sixth sub-time range. In this way of division, the target time corresponding to the first sub-time range is from 10 to 10:10, and corresponding to the second sub-time range, the target time is from 10:10 to 10 Point 20, and so on.

S220: Acquire first data and second data, where the first data is data with the update time corresponding to the target time in the synchronization data stored at the source end, and the second data is the data corresponding to the synchronization data stored at the target end. The update time of is the data of the target time, wherein the synchronization data stored at the source end is data synchronized to the target end, and the synchronization data stored at the target end is data synchronized from the source end.

S230: Detect whether the first data is consistent with the second data.

S231: If it is detected that the first data is consistent with the second data, proceed to the next data detection.

In this embodiment, there are multiple ways to detect whether the first data and the second data are consistent.

As a way, whether the data included in the first data and the data included in the second data are consistent can be compared one by one. It should be noted that in the process of comparing one by one, it is to compare whether the value of the same piece of data at the source end and the value at the target end are the same, or to judge based on the first data, whether the data in the first data are all Exist in the second data.

Exemplarily, if the first data includes data F, data G, data H, and data I, then when the source end completes the synchronization of data F, data G, data H, and data I, the acquired second The data should also be data F, data G, data H, and data I. However, due to network reasons, the value of the data may be tampered with during transmission or changed due to transmission errors. There is also a situation where part of the synchronized data is not successfully synchronized to the target end. For example, the synchronization data stored at the source end is the aforementioned data F, data G, data H, and data I, and the data I among them may not be successfully synchronized to the target end, then when the second data is obtained (and, Data I has not been synchronized before), it is possible that only data F, data G, and data H can be obtained. Therefore, in this way of comparing one by one, you can first compare whether the data included in the second data are all included in the data included in the first data, and whether the data included in the second data are all included in the first data. When the included data is included, it is then specifically compared whether the value of the data included in the first data is consistent with the value of the data included in the second data.

As a way, the detecting whether the first data is consistent with the second data includes: acquiring a characteristic value of the first data; acquiring a characteristic value of the second data; if the first data The characteristic value of is the same as the characteristic value of the second data, and it is determined that the first data is consistent with the second data. In this manner, optionally, the acquiring the characteristic value of the first data includes: sending a characteristic value calculation instruction to the source end, and the characteristic value calculation instruction carries a trigger to calculate the first Structured query code for data feature value calculation (for example, SQL (Structured Query Language) code); receiving the data returned by the source in response to the feature value calculation instruction as the feature value of the first data.

Optionally, the obtaining the characteristic value of the second data includes: sending a characteristic value calculation instruction to the target end, and the characteristic value calculation instruction carries a structure that triggers the calculation of the characteristic value calculation of the second data Query code; receiving the data returned by the source in response to the feature value calculation instruction as the feature value of the second data.

S240: If it is detected that the first data is inconsistent with the second data, locate and detect data that is inconsistent among the data included in the first data and the data included in the second data.

S250: Based on the result of the positioning detection, proceed to the next data detection.

It should be noted that the end time of the target time corresponding to the current data detection is the start time of the target time corresponding to the next data detection.

As a manner, as shown in FIG. 4, the data included in the first data of the positioning detection data that is inconsistent with the data included in the second data includes:

S241: Acquire the cut-off time of the current positioning detection.

It should be noted that the cut-off time is a time within the current target time. Exemplarily, if the current target time is from 10 o'clock to 11 o'clock, the cut-off time of the first positioning detection can be 10:30, or 10:40.

S242: Acquire first to-be-positioned data, where the first to-be-positioned data is data in the first data whose corresponding update time is between the start time of the target time and the end time.

S243: Acquire second to-be-positioned data, where the second to-be-positioned data is data in the second data whose corresponding update time is between the start time of the target time and the end time.

S244: Detect whether the first data to be positioned and the second data to be positioned are consistent.

S245: If the first data to be positioned is inconsistent with the second data to be positioned, enter the next position detection until the data included in the first data and the data included in the second data are positioned. And the cut-off time of the next positioning detection is half of the cut-off time of the previous positioning detection.

It should be noted that the cut-off time of the next positioning detection is half of the cut-off time of the previous positioning detection, which can be understood as the start time of the target time of the current data detection to the next positioning detection The length of time between the cut-off time is half of the time length between the start time of the target time of the current data detection and the cut-off time of the current positioning detection. Exemplarily, the target time of the current data detection is from 10 to 11, then the cut-off time of the current (it can be the first time) positioning detection is 10:30, then the cut-off time of the next positioning detection It can be 10:15.

In this manner, the step of entering the next data detection based on the result of the positioning detection includes: S246: if the first data to be positioned is consistent with the second data to be positioned, entering The start time of the next data detection and the target time of the next data detection is the end time of the current positioning detection. In addition, after locating data that is inconsistent in the data included in the first data and the data included in the second data, the next data detection will also be triggered.

In addition, for the determination of the cut-off time of each positioning detection, in addition to the aforementioned method, that is, the cut-off time of the next positioning detection is half of the cut-off time of the previous positioning detection. The cut-off time of each positioning detection can also be dynamically adjusted according to the real-time situation. As a way, the cut-off time of each location detection can be determined according to the amount of data corresponding to the current data detection. In this way, the larger the amount of data corresponding to the corresponding data detection, the cut-off time of each location detection The time is reduced more than the cut-off time of the last positioning detection. Among them, the reduction can be understood as the degree of shortening of the length of time. For example, the aforementioned cut-off time of the next positioning detection is half of the cut-off time of the previous positioning detection, which can be understood as the cut-off time of the next positioning detection compared to the previous positioning detection The length of the cut-off time of detection is reduced by half.

It should be noted that, as shown above, the cut-off time of the next positioning detection will be earlier in time sequence than the cut-off time of the last positioning detection. During the process, if it is detected that the first data to be positioned is consistent with the second data to be positioned, the update time of the inconsistent data is from the cut-off time of the current positioning detection to the end of the target time of the current data detection Between time, in order to facilitate the improvement of the overall detection efficiency, there is no need to perform the next positioning detection, but directly enter the next data detection, and the start time of the target time of the next data detection is the detection The cut-off time of the positioning detection when the first to-be-positioned data is consistent with the second to-be-positioned data.

The foregoing content is explained below through an example.

If the target time of the current data detection is 10 o'clock to 11 o'clock. Then when the first data and the second data are detected to be inconsistent, the positioning detection is started, and the cut-off time of the first positioning detection is 10:30, then the first data to be positioned is the corresponding update in the first data Data from 10:30 to 10:30, the second to-be-positioned data is the data corresponding to the update time of 10:30 to 10:30 in the second data, then if the first to-be-positioned data and the second to-be-positioned data are detected If the bit data is consistent, then the update time of the inconsistent data must be within the time period of 10:30 to 11, but the solution provided in this embodiment will not use the time of 10:30 to 11 Positioning detection is performed in the segment, but directly enters the next data detection with 10:30 as the starting point of time, because inconsistent data in the time period from 10:30 to 11:00 will inevitably be detected in the data with 10:30 as the starting point It is detected in the middle, so there is no need to waste time to perform positioning detection at the time period of 10:30 to 11: 00, which can improve the efficiency of data detection.

The method for detecting synchronization data provided in this embodiment can perform data detection on synchronized data multiple times based on the updated data of the data. In each data detection process, the corresponding data detection corresponding to the current data can be obtained first. Target time, and then obtain the data whose update time is the target time in the synchronization data stored at the source end as the first data, and obtain the data whose update time is the target time in the synchronization data stored at the target end as the first data Second data, and then check the consistency of the first data and the second data. If it is detected that the first data and the second data obtained at the time are consistent, the next data check is started, thereby In the detection process of the synchronized data from the source end to the target end, the first data and the second data as the part to be detected can be determined based on the update time, so as to reduce the amount of repeated detection data and reduce the cost of verification .

In addition, in this embodiment, the first data and the second data to be detected at the current time can be determined based on the update time for the synchronized data, so that it can support the dynamic change of the source or target data, that is, for the data that has been detected in advance. The data can also be checked again immediately.

Please refer to FIG. 5, a method for detecting synchronization data provided by the present application, the method includes:

S310: In the current data detection, obtain the target time corresponding to the current data detection.

S320: Acquire first data and second data, where the first data is data whose update time is the target time in the synchronization data stored at the source end, and the second data is the data corresponding to the synchronization data stored at the target end. The update time of is the data of the target time, wherein the synchronization data stored at the source end is data synchronized to the target end, and the synchronization data stored at the target end is data synchronized from the source end.

S330: Detect whether the first data is consistent with the second data.

S331: If it is detected that the first data is consistent with the second data, proceed to the next data detection.

S340: If it is detected that the first data is inconsistent with the second data, locate and detect data that is inconsistent among the data included in the first data and the data included in the second data.

S350: Acquire data to be modified, where the data to be modified is data that is inconsistent among data included in the first data and data included in the second data.

S351: Modify the data to be modified to make the first data consistent with the second data.

Optionally, before changing the data to be changed, the method further includes: sending a prompt message for changing the data; if an instruction to allow the data change is received, executing the changing of the data to be changed. Optionally, the prompt information can be sent to the administrator terminal, and if the administrator terminal detects that the administrator has triggered the operation of agreeing to the data change, it can return the instruction to allow the data change.

S360: Based on the result of the positioning detection, proceed to the next data detection.

As a consistent method, after detecting that the previously located inconsistent data has been changed, the next data detection can be performed.

And in this embodiment, the located data to be changed will be further changed, so that the first data and the second data involved in the current data detection can be changed to be consistent, so as to realize the repaired data synchronization process. mistake.

Please refer to FIG. 6, a method for detecting synchronization data provided by the present application, the method includes:

S410: Obtain the service currently carried by the source end, where the data generated by the service is stored at the source end.

S420: Determine a target time corresponding to data detection based on the service type of the service.

As a way, the determining the target time corresponding to the data detection based on the service type of the service includes: obtaining the data generation frequency corresponding to the service type; if the data generation frequency is lower than the threshold frequency, obtaining the first time As the target time; if the data generation frequency is not lower than the threshold frequency, acquire the second time as the target time; wherein the time length of the second time is greater than the time length of the first time.

Optionally, as a way, before obtaining the data generation frequency corresponding to the service type, the method further includes: obtaining and storing the data generation frequency of each service type; and the obtaining the data generation frequency corresponding to the service type, Including: reading the stored data generation frequency of the service type.

S430: Acquire first data and second data, where the first data is data with the update time corresponding to the target time in the synchronization data stored at the source end, and the second data is the data corresponding to the synchronization data stored at the target end. The update time of is the data of the target time, wherein the synchronization data stored at the source end is data synchronized to the target end, and the synchronization data stored at the target end is data synchronized from the source end.

S440: Perform the data detection on the first data and the second data.

The method for detecting synchronized data provided in this embodiment can obtain the service currently carried by the source end, and determine the target time corresponding to data detection based on the service type of the service. In each data detection process, First obtain the target time corresponding to the current data detection, and then obtain the data whose update time is the target time in the synchronization data stored at the source end as the first data, and obtain the corresponding data in the synchronization data stored at the target end The data whose update time is the target time is used as the second data, and then the consistency of the first data and the second data is detected, if it is detected that the first data and the second data obtained at the time are consistent , The next data detection starts, so that in the detection process of the synchronized data from the source end to the target end, the first data and the second data as the part to be detected can be determined based on the update time, so as to reduce Repeat the data volume of the test and reduce the cost of verification.

In addition, for the target time determined based on the service type, the process of detecting the synchronized data can be dynamically adjusted based on the service currently carried by the source at the same time, so as to improve the flexibility of the synchronized data detection process.

Please refer to FIG. 7, a method for detecting synchronization data provided by the present application is applied to a data synchronization system. The data synchronization system includes a detection end, a source end, and a target end. The synchronization data stored at the source end is synchronized. For the data to the target end, the synchronized data stored by the target end is data synchronized from the source end, and the method includes:

S510: The detection terminal acquires data and detects the corresponding target time.

S520: Acquire first data and second data, where the first data is data whose corresponding update time is the target time in the synchronization data stored by the source end, and the second data is data stored by the target end. The corresponding update time in the synchronized data is the data of the target time.

S530: Perform the data detection on the first data and the second data.

The method for detecting synchronization data provided by the present application detects the corresponding target time by first acquiring the data, and then acquiring the data whose update time is the target time in the synchronization data stored at the source end as the first data, and acquiring The data with the update time corresponding to the target time in the synchronization data stored at the target end is used as the second data, and then the data detection is performed on the first data and the second data. Thus, in the detection process of the synchronized data synchronized from the source end to the target end, the first data and the second data as the part to be detected can be determined based on the update time, so as to reduce the amount of repeated detection data and reduce the verification. cost.

Please refer to FIG. 8, an apparatus 600 for detecting synchronization data provided by the present application, and the apparatus 600 includes:

The time acquiring unit 610 is configured to acquire the target time corresponding to the data detection.

The data acquisition unit 620 is configured to acquire first data and second data, where the first data is data whose update time is the target time in the synchronization data stored at the source end, and the second data is data stored at the target end. The corresponding update time in the synchronization data is the target time data, wherein the synchronization data stored by the source end is the data synchronized to the target end, and the synchronization data stored by the target end is the synchronization data from the source end. The data.

The data detection unit 630 is configured to perform the data detection on the first data and the second data.

As a way, the time acquisition unit 610 is specifically configured to acquire the target time corresponding to the current data detection in the current data detection. In this manner, the data detection unit 630 is specifically configured to detect whether the first data is consistent with the second data; if it is detected that the first data is consistent with the second data, enter the next The data detection. Optionally, the data detection unit 630 is specifically further configured to locate and detect the data included in the first data and the data included in the second data if it is detected that the first data is inconsistent with the second data. Inconsistent data; based on the result of the positioning detection, proceed to the next data detection. Wherein, the end time of the target time corresponding to the current data detection is the start time of the target time corresponding to the next data detection.

Optionally, the data detection unit 630 is specifically configured to obtain the characteristic value of the first data; obtain the characteristic value of the second data; if the characteristic value of the first data is the same as the characteristic value of the second data Same, it is determined that the first data is consistent with the second data. Wherein, the data detection unit 630 is specifically configured to send a feature value calculation instruction to the source end, and the feature value calculation instruction carries a structured query code that triggers the calculation of the first data feature value calculation; and receives the source The data returned by the terminal in response to the characteristic value calculation instruction is used as the characteristic value of the first data. Similarly, the data detection unit 630 is further specifically configured to send a feature value calculation instruction to the target terminal, and the feature value calculation instruction carries a structured query code that triggers the calculation of the second data feature value calculation; The data returned by the source in response to the feature value calculation instruction is used as the feature value of the second data.

In this manner, the data detection unit 630 is specifically configured to obtain the cut-off time of the current positioning detection; obtain the first to-be-positioned data, where the first to-be-positioned data is the first data, and the corresponding update time is Data between the start time of the target time and the end time; acquire second to-be-positioned data, where the second to-be-positioned data is the second data, and the corresponding update time is at the start of the target time Data between time and the cut-off time; if the first to-be-positioned data is inconsistent with the second to-be-positioned data, enter the next positioning detection until the data included in the first data is positioned Data that is inconsistent with the data included in the second data, and the cut-off time of the next positioning detection is half of the cut-off time of the previous positioning detection.

In this manner, the data detection unit 630 is specifically configured to enter the next data detection if the first data to be positioned is consistent with the second data to be positioned, and the next data detection The start time of the target time is the end time of the current positioning detection.

As a way, as shown in FIG. 9, the device 600 further includes: a data compensation unit 640, configured to obtain data to be modified, where the data to be modified is the data included in the first data and the first data. The second data includes data that is inconsistent, and the data to be changed is modified to make the first data consistent with the second data. In this manner, optionally, the device 600 may further include: a compensation prompt unit 650, configured to send out prompt information for data modification. Correspondingly, the data compensation unit 640 is configured to, if an instruction allowing data modification is received, execute the modification to the data to be modified.

As a way, the time obtaining unit 610 is specifically configured to obtain the service currently carried by the source end, wherein the data generated by the service is stored at the source end; the data detection is determined based on the service type of the service The corresponding target time. Optionally, the time obtaining unit 610 is specifically configured to obtain the data generation frequency corresponding to the service type; if the data generation frequency is lower than the threshold frequency, obtain the first time as the target time; if the data generation frequency is not low At the threshold frequency, a second time is acquired as the target time; wherein the time length of the second time is greater than the time length of the first time. Optionally, the device further includes a data generation frequency obtaining unit 611, configured to obtain and store the data generation frequency of each service type. In this manner, the time obtaining unit 610 is specifically configured to read the stored data generation frequency of the service type.

The device for detecting synchronization data provided by the present application detects the corresponding target time by acquiring the data first, and then acquires the data whose update time is the target time in the synchronization data stored at the source end as the first data, and acquires The data with the update time corresponding to the target time in the synchronization data stored at the target end is used as the second data, and then the data detection is performed on the first data and the second data. Thus, in the detection process of the synchronized data synchronized from the source end to the target end, the first data and the second data as the part to be detected can be determined based on the update time, so as to reduce the amount of repeated detection data and reduce the verification. cost.

Hereinafter, an electronic device provided by the present application will be described with reference to FIG. 10.

Referring to FIG. 10, based on the foregoing short message pushing method, an embodiment of the present application also provides another electronic device 200 including a processor 102 that can execute the foregoing short message pushing method. The electronic device 200 further includes a memory 104 and a network module 106. Wherein, the memory 104 stores a program that can execute the content in the foregoing embodiment, and the processor 102 can execute the program stored in the memory 104.

Among them, the processor 102 uses various interfaces and lines to connect various parts of the entire electronic device 200, by running or executing instructions, programs, code sets, or instruction sets stored in the memory 104, and calling data stored in the memory 104 , Perform various functions of the electronic device 200 and process data. Optionally, the processor 102 may use at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). A kind of hardware form to realize. The processor 102 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), a modem, and the like. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is used for rendering and drawing of display content; the modem is used for processing wireless communication. It is understandable that the above-mentioned modem may not be integrated into the processor 102, but may be implemented by a communication chip alone.

The memory 104 may include random access memory (RAM) or read-only memory (Read-Only Memory). The memory 104 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 104 may include a storage program area and a storage data area, where the storage program area may store instructions for implementing the operating system and instructions for implementing at least one function (such as touch function, sound playback function, image playback function, etc.) , Instructions used to implement the following various method embodiments, etc. The data storage area can also store data (such as phone book, audio and video data, chat record data) created by the terminal 100 during use.

The network module 106 is used to receive and send electromagnetic waves, and realize the mutual conversion between electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices, such as with an audio playback device. The network module 106 may include various existing circuit elements for performing these functions, for example, an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a subscriber identity module (SIM) card, a memory, etc. . The network module 106 can communicate with various networks, such as the Internet, an intranet, and a wireless network, or communicate with other devices through a wireless network. The aforementioned wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network. For example, the network module 106 can exchange information with the base station.

Optionally, the electronic device 200 may be a server that executes the foregoing method embodiments.

Please refer to FIG. 11, which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable medium 1100 stores program code, and the program code can be invoked by a processor to execute the method described in the foregoing method embodiment.

The computer-readable storage medium 1100 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 1100 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 1100 has a storage space for executing the program code 810 of any method step in the above-mentioned method. These program codes can be read from or written into one or more computer program products. The program code 1110 may be compressed in an appropriate form, for example.

In summary, the method, device, server, and data synchronization system for detecting synchronized data provided by the present application detect the corresponding target time by first obtaining the data, and then obtaining the corresponding update time in the synchronized data stored at the source end. The data of the target time is used as the first data, and the data corresponding to the update time of the target time in the synchronization data stored on the target side is obtained as the second data, and then the data of the first data and the second data are obtained Perform the data detection. Thus, in the detection process of the synchronized data synchronized from the source end to the target end, the first data and the second data as the part to be detected can be determined based on the update time, so as to reduce the amount of repeated detection data and reduce the verification. cost.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the foregoing embodiments are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not drive the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

A method for detecting synchronization data, characterized in that the method includes:

Obtain the target time corresponding to the data detection;

Acquire first data and second data, where the first data is data whose corresponding update time is the target time in the synchronization data stored at the source end, and the second data is the corresponding update in the synchronization data stored at the target end Time is data of the target time, wherein the synchronization data stored at the source end is data synchronized to the target end, and the synchronization data stored at the target end is data synchronized from the source end;

The data detection is performed on the first data and the second data.
The method according to claim 1, wherein the obtaining the target time corresponding to the data detection comprises: in the current data detection, obtaining the target time corresponding to the current data detection;

The performing the data detection on the first data and the second data includes: detecting whether the first data and the second data are consistent; if the first data and the first data are detected If the two data are consistent, proceed to the next data detection.
The method according to claim 2, wherein said performing said data detection on said first data and said second data further comprises:

If it is detected that the first data is inconsistent with the second data, locate and detect data that is inconsistent among the data included in the first data and the data included in the second data;

Based on the result of the positioning detection, proceed to the next data detection.
The method according to claim 3, wherein the positioning detecting data that is inconsistent in the data included in the first data and the data included in the second data includes:

Get the cut-off time of the current positioning detection;

Acquiring first to-be-positioned data, where the first to-be-positioned data is data in the first data whose corresponding update time is between the start time of the target time and the end time;

Acquiring second to-be-positioned data, where the second to-be-positioned data is data in the second data whose corresponding update time is between the start time of the target time and the end time;

If the first to-be-positioned data is inconsistent with the second to-be-positioned data, proceed to the next positioning detection until the positioning finds that the data included in the first data is inconsistent with the data included in the second data And the cut-off time of the next positioning detection is half of the cut-off time of the previous positioning detection.
The method according to claim 4, wherein the step to the next data detection based on the result of the positioning detection comprises:

If the first to-be-positioned data is consistent with the second to-be-positioned data, proceed to the next data detection, and the start time of the target time of the next data detection is that of the current positioning detection Deadline.
The method according to any one of claims 2-5, wherein the detecting whether the first data is consistent with the second data comprises:

Acquiring a characteristic value of the first data;

Acquiring the characteristic value of the second data;

If the characteristic value of the first data is the same as the characteristic value of the second data, it is determined that the first data is consistent with the second data.
The method according to claim 6, wherein the obtaining the characteristic value of the first data comprises:

Sending a feature value calculation instruction to the source end, where the feature value calculation instruction carries a structured query code that triggers the calculation of the feature value calculation of the first data;

Receiving the data returned by the source in response to the characteristic value calculation instruction as the characteristic value of the first data.
The method according to claim 6, wherein the acquiring the characteristic value of the second data comprises:

Sending a feature value calculation instruction to the target terminal, where the feature value calculation instruction carries a structured query code that triggers the calculation of the second data feature value calculation;

Receiving the data returned by the source in response to the characteristic value calculation instruction as the characteristic value of the second data.
The method according to any one of claims 2-8, wherein the method further comprises:

Acquiring data to be modified, where the data to be modified is data that is inconsistent among data included in the first data and data included in the second data;

The data to be modified is modified to make the first data consistent with the second data.
The method according to claim 9, characterized in that, before changing the data to be changed, the method further comprises:

Send out reminders for data changes;

If an instruction to allow data modification is received, execute the modification to the data to be modified.
The method according to claim 2, wherein the end time of the target time corresponding to the current data detection is the start time of the target time corresponding to the next data detection.
The method according to claim 1, wherein said acquiring data and detecting the corresponding target time comprises:

Acquiring the service currently carried by the source end, wherein the data generated by the service is stored at the source end;

The target time corresponding to the data detection is determined based on the service type of the service.
The method according to claim 12, wherein the determining the target time corresponding to data detection based on the service type of the service comprises:

Acquiring the data generation frequency corresponding to the service type;

If the data generation frequency is lower than the threshold frequency, acquiring the first time as the target time;

If the data generation frequency is not lower than the threshold frequency, the second time is acquired as the target time; wherein the time length of the second time is greater than the time length of the first time.
The method according to claim 13, wherein before obtaining the frequency of data generation corresponding to the service type, the method further comprises:

Obtain and store the frequency of data generation for each business type;

The obtaining the data generation frequency corresponding to the service type includes:

Read the stored data generation frequency of the service type.
The method according to claim 14, wherein the source terminal and the target terminal are respectively configured in different computer rooms.
A method for detecting synchronization data, characterized in that it is applied to a data synchronization system, the data synchronization system includes a detection end, a source end, and a target end, wherein the synchronization data stored by the source end is synchronized to the target end Data, the synchronized data stored by the target end is data synchronized from the source end, and the method includes:

The detection terminal acquires data and detects the corresponding target time;

Acquire first data and second data, where the first data is data whose update time is the target time in the synchronization data stored at the source end, and the second data is the synchronization data stored at the target end The corresponding update time in is the data of the target time;

The data detection is performed on the first data and the second data.
A device for detecting synchronization data, characterized in that the device includes:

The time acquisition unit is used to acquire the target time corresponding to the data detection;

The data acquisition unit is configured to acquire first data and second data, where the first data is data whose corresponding update time is the target time in the synchronization data stored at the source end, and the second data is data stored at the target end The corresponding update time in the synchronization data is data at the target time, wherein the synchronization data stored at the source end is data synchronized to the target end, and the synchronization data stored at the target end is synchronized data from the source end. data;

The data detection unit is configured to perform the data detection on the first data and the second data.
A data synchronization system, characterized in that the data synchronization system includes a detection end, a source end, and a target end, wherein the synchronization data stored by the source end is data synchronized to the target end, and the target end stores Synchronized data is data synchronized from the source end;

The detection end is used to obtain the target time corresponding to the data detection; obtain the first data and the second data, the first data being data whose update time corresponding to the target time in the synchronization data stored at the source end is the target time The second data is data whose corresponding update time is the target time in the synchronization data stored by the target end; the data detection is performed on the first data and the second data.
A server, characterized in that it includes one or more processors and a memory;

One or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the method according to any one of claims 1-15.
A computer-readable storage medium having program code executable by a processor, wherein the program code causes the processor to execute the method according to any one of claims 1-15.