CN106657376B - Data synchronization processing method and device - Google Patents
Data synchronization processing method and device Download PDFInfo
- Publication number
- CN106657376B CN106657376B CN201710005137.XA CN201710005137A CN106657376B CN 106657376 B CN106657376 B CN 106657376B CN 201710005137 A CN201710005137 A CN 201710005137A CN 106657376 B CN106657376 B CN 106657376B
- Authority
- CN
- China
- Prior art keywords
- data
- storage table
- data storage
- server
- updating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The disclosure relates to a data synchronization processing method and device. The method comprises the following steps: sending a data timing synchronization request to a second server, receiving one or more first data searched and sent by the second server according to data updating time information after the second server responds to the data timing synchronization request; wherein the timing synchronization request carries the data update time information; sending a data real-time synchronization request to the second server according to a preset data request, and receiving one or more second data which are searched and sent by the second server after the second server responds to the data real-time synchronization request. The data synchronization method and the data synchronization device can solve the problem of data synchronization of large data volume and improve the data synchronization efficiency when the data volume is too large and full synchronization cannot be adopted and the change time cannot be accurately recorded in the data source.
Description
Technical Field
The present disclosure relates to the field of data synchronization technologies, and in particular, to a data synchronization processing method and a data synchronization processing apparatus.
Background
With the rapid development of informatization technology, enterprise informatization construction is increasingly popularized. Some enterprise departments or branch companies build own informatization systems. Thus, when sharing and integrating data in these different systems, bidirectional synchronization of data (e.g., on-duty personnel data and off-duty personnel data) is a frequently encountered and very important requirement.
In the related art, there are two main ways to synchronize data with large data volume at present: the first is a full data synchronization mode, and the second is an incremental data synchronization mode. The full data synchronization mode requires that the systems of both parties have stronger data reading capability and stable networks, and the mode is long in time consumption and has high pressure on the systems of both parties. The incremental data synchronization method requires the data source system to accurately record the change information of each data, such as the update time, and realize the logical deletion. However, when the data volume is too large to adopt a full data synchronization mode, and the data source system cannot accurately record the change information of each data, the data synchronization efficiency is low, which puts new requirements on the data synchronization of large data volume. In addition, when the synchronized data is used in the destination system, how to improve the reading efficiency of the data with large data volume needs a data reading scheme adapted to the data, and a corresponding solution is currently lacking in the related art.
Therefore, there is a need to provide a new technical solution to improve one or more of the problems in the above solutions.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
An object of the present disclosure is to provide a data synchronization processing method and a data synchronization processing apparatus, which overcome one or more of the problems due to the limitations and disadvantages of the related art, at least to some extent.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or in part will be obvious from the description, or may be learned by practice of the disclosure.
According to a first aspect of the embodiments of the present disclosure, a data synchronization processing method is provided, which is applied to a first server, and the method includes:
sending a data timing synchronization request to a second server, receiving one or more first data searched and sent by the second server according to data updating time information after the second server responds to the data timing synchronization request; wherein the timing synchronization request carries the data update time information;
sending a data real-time synchronization request to the second server according to a preset data request, and receiving one or more second data which are searched and sent by the second server after the second server responds to the data real-time synchronization request.
In an exemplary embodiment of the present disclosure, a first data storage table and a second data storage table are provided on the first server; the method further comprises the following steps:
inquiring whether the second data is in the first data storage table, and updating the second data in the first data storage table when the second data is in the first data storage table;
when the second data is not in the first data storage table, inquiring whether the second data is in the second data storage table, and when the second data is in the second data storage table, updating the second data in the second data storage table;
adding the second data to the second data storage table when the second data is not in the second data storage table.
In an exemplary embodiment of the disclosure, after the updating the second data in the first data storage table, the method further includes:
judging whether an object represented by the second data exists or not, and if not, transferring the second data from the first data storage table to the second data storage table; if so, the data is not moved.
In an exemplary embodiment of the present disclosure, after the updating the second data stored in the second data storage table before, the method further includes:
judging whether an object represented by the second data exists or not, and if so, transferring the second data from the second data storage table to the first data storage table; if not, the data is not moved.
In an exemplary embodiment of the present disclosure, a first data storage table and a second data storage table are provided on the first server; the method further comprises the following steps:
and storing the first data into the first data storage table, checking whether third data with the use frequency lower than a preset value exists in the first data storage table, and if so, moving the third data into the second data storage table.
According to a second aspect of the embodiments of the present disclosure, there is provided a data synchronization processing apparatus applied to a first server, the apparatus including:
the data timing synchronization module is used for sending a data timing synchronization request to a second server, receiving one or more first data which are searched and sent on the second server according to data updating time information after the second server responds to the data timing synchronization request; wherein the timing synchronization request carries the data update time information;
and the data real-time synchronization module is used for sending a data real-time synchronization request to the second server according to a preset data request, receiving one or more second data which are searched and sent on the second server after the second server responds to the data real-time synchronization request.
In an exemplary embodiment of the present disclosure, a first data storage table and a second data storage table are provided on the first server; the device further comprises:
the first query updating module is used for querying whether the second data is in the first data storage table or not, and updating the second data in the first data storage table when the second data is in the first data storage table;
a second query updating module, configured to query whether the second data is in the second data storage table when the second data is not in the first data storage table, and update the second data in the second data storage table when the second data is in the second data storage table;
and the data adding module is used for adding the second data to the second data storage table when the second data is not in the second data storage table.
In an exemplary embodiment of the present disclosure, the apparatus further includes:
a first judging and transferring module, configured to, after the second data in the first data storage table is updated, judge whether an object represented by the second data exists, and if the object represented by the second data does not exist, transfer the second data from the first data storage table to the second data storage table; if so, the data is not moved.
In an exemplary embodiment of the present disclosure, the apparatus further includes:
a second determining and transferring module, configured to determine whether an object represented by the second data exists after the second data stored in the second data storage table before the update, and if the object represented by the second data exists, transfer the second data from the second data storage table to the first data storage table; if not, the data is not moved.
In an exemplary embodiment of the present disclosure, a first data storage table and a second data storage table are provided on the first server; the device further comprises:
and the third judging and transferring module is used for storing the first data into the first data storage table, checking whether third data with the use frequency lower than a preset value exists in the first data storage table, and if the third data exists, moving the third data into the second data storage table.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
in an embodiment of the present disclosure, by the above data synchronization processing method and apparatus, data timing synchronization and data real-time synchronization are combined, and timing batch synchronization data is adopted for data in which change time is accurately recorded in a data source, and real-time synchronization is adopted for data in which change time is not accurately recorded in the data source; therefore, on one hand, when the data volume is too large and full synchronization cannot be adopted, and meanwhile, the change time cannot be accurately recorded in the data source, the problem of data synchronization of large data volume is solved, and the data synchronization efficiency is improved to a certain extent; on the other hand, the real-time synchronization mode is not completely adopted, so that the requirement on the communication network of the two systems is reduced to a certain extent, and the pressure on the two systems is reduced.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
Fig. 1 schematically illustrates a flow chart of a first data synchronization processing method in an exemplary embodiment of the present disclosure;
fig. 2 schematically illustrates a flow chart of a second data synchronization processing method in an exemplary embodiment of the present disclosure;
FIG. 3 schematically illustrates a flow chart of a third data synchronization processing method in an exemplary embodiment of the present disclosure;
FIG. 4 is a schematic diagram illustrating an application scenario of data synchronization processing in an exemplary embodiment of the present disclosure;
fig. 5 schematically illustrates a first data synchronization processing apparatus in an exemplary embodiment of the present disclosure;
fig. 6 schematically illustrates a second data synchronization processing apparatus in an exemplary embodiment of the present disclosure;
fig. 7 schematically illustrates a third data synchronization processing apparatus in an exemplary embodiment of the present disclosure;
fig. 8 schematically illustrates another data synchronization processing apparatus in an exemplary embodiment of the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The exemplary embodiment first provides a data synchronization processing method, which may be applied to a first server, for example, a server running a destination system. Referring to fig. 1, the data synchronization processing method may include:
step S101: sending a data timing synchronization request to a second server, receiving one or more first data searched and sent by the second server according to data updating time information after the second server responds to the data timing synchronization request; wherein the timing synchronization request carries the data update time information.
Step S102: sending a data real-time synchronization request to the second server according to a preset data request, and receiving one or more second data which are searched and sent by the second server after the second server responds to the data real-time synchronization request.
By the data synchronization processing method, when the data volume is too large to adopt full synchronization and the data source cannot accurately record the change time, the problem of data synchronization of large data volume is solved, and the data synchronization efficiency is improved to a certain extent; on the other hand, the real-time synchronization mode is not completely adopted, so that the requirement on the communication network of the two systems is reduced to a certain extent, and the pressure on the two systems is reduced.
Hereinafter, the respective steps of the above-described method in the present exemplary embodiment will be described in more detail with reference to fig. 1 to 4.
In step S101, a data timing synchronization request is sent to a second server, and one or more first data that are searched and sent on the second server according to data update time information after the second server responds to the data timing synchronization request are received; wherein the timing synchronization request carries the data update time information.
In this example embodiment, the second server may be a server running a source system, for example, a branch platform system, which may store record agent information (such as name or job number). And the destination system running on the first server may be, for example, an insurance training management system.
Illustratively, the risk training management system requires the synchronous acquisition of agent information from the source system. Because the information record in the source system may be updated in a non-timely manner, some of the information of the agent accurately records the update time of the data, and some of the information of the agent does not accurately record the update time of the data. For the portion of data that accurately records the update time of the data, the personal training management system may send a timing synchronization request to the source system, where the timing synchronization request may carry a time range condition of the data to be requested, such as data within the first 3 days from the current time. And after receiving the timing synchronization request, the target system analyzes and acquires the time range condition, searches for the agent information meeting the condition according to the comparison of the time range condition and returns the agent information to the source system in batches.
In step S102, a real-time data synchronization request is sent to the second server according to a preset data request, and one or more second data that is found and sent from the second server is received after the second server responds to the real-time data synchronization request.
Illustratively, for a portion of data for which a data update time is not accurately recorded, a real-time synchronization request may be initiated by the destination system to the source system to obtain one or more pieces of data,
in the present exemplary embodiment, the synchronization of the data is implemented by combining the timing increment synchronization and the real-time synchronization. For data in which the change time is accurately recorded in the source system, batch synchronization data is timed by comparing the update time; and for the data with inaccurate update time in the source system, a synchronization request is initiated through the destination system to synchronize a specific piece or pieces of data. Therefore, when the data volume is too large and full synchronization cannot be adopted, and the change time cannot be accurately recorded in the data source, the problem of data synchronization of large data volume is solved, and the efficiency of data synchronization is improved to a certain extent.
Referring to fig. 2, in an exemplary embodiment, after data is synchronized to the destination system, in order to improve the efficiency of querying the data in the destination system. The first server may be provided with a first data storage table and a second data storage table. For example, the first data storage table may be a common data table a in the destination system, and the second data storage table may be an uncommon data table B in the destination system. The method may further include steps S103 to S105. Wherein:
step S103: and inquiring whether the second data is in the first data storage table, and updating the second data in the first data storage table when the second data is in the first data storage table.
In an exemplary embodiment, after the updating the second data in the first data storage table, the method may further include: judging whether an object represented by the second data exists or not, and if not, transferring the second data from the first data storage table to the second data storage table; if so, the data is not moved.
Illustratively, the second data may be agent data, and the object characterized by the second data is an agent. For example, the destination system initiates a real-time synchronization request to the source system, and synchronizes one or more pieces of data in the source system to the destination system. And then the target system inquires whether the synchronized data exist in the common data table A or not, and if so, the data are updated in the common data table A. After updating, the target system determines whether the data belongs to the common data or not according to the sub-table attributes, and if not, the data is moved from the common data table A to the uncommon data table B; if so, the data is not moved. For example, after the agent data is synchronized to the destination system, the destination system judges whether the agent data belongs to the frequently-used data according to the attribute information of whether the agent represented by the agent data is in the job, and if the agent data does not belong to the job, the agent data is moved from the frequently-used data table a to the infrequently-used data table B; if so, the data is not moved.
Step S104: when the second data is not in the first data storage table, inquiring whether the second data is in the second data storage table, and when the second data is in the second data storage table, updating the second data in the second data storage table.
Illustratively, the above illustration is continued. The destination system inquires whether the synchronized data exists in the common data table A, and if the synchronized data does not exist in the common data table A, the target system checks that the synchronized data exists in the uncommon data table B. If so, the data in the uncommon data table B is updated.
In an exemplary embodiment, after the updating the second data in the second data storage table, the method may further include: judging whether an object represented by the second data exists or not, and if so, transferring the second data from the second data storage table to the first data storage table; if not, the data is not moved.
Illustratively, after updating the data in the infrequent data table B, the destination system determines whether the data belongs to the frequently-used data according to the sublist attributes, and if so, moves the data from the infrequent data table B to the frequently-used data table a; if not, the data is not moved. For example, after updating the data of the agent in the uncommon data table B, the destination system determines whether the data of the agent belongs to the common data according to the attribute information of whether the agent represented by the data of the agent is working, and if the data of the agent is working, the data of the agent is moved from the uncommon data table B to the common data table a; if not, the data is not moved.
Step S105: adding the second data to the second data storage table when the second data is not in the second data storage table.
For example, when the above-mentioned synchronized data is checked whether it exists in the rare data table B, if it does not exist, the synchronized data is added to the rare data table B.
In the present exemplary embodiment, the synchronized data is updated in the destination system by using the sub-table storage, and the common data and the non-common data are converted in a timing or real-time manner. The data reading of large data volume can adopt an index and table dividing mode at the same time, and the table dividing storage is carried out according to a certain attribute of the data, so that the efficiency of carrying out data query in a target system subsequently is improved. The present exemplary embodiment improves data reading efficiency of a large data amount in the destination system.
Referring to fig. 3, in an exemplary embodiment, on the basis of the above embodiment, the first server may be provided with a first data storage table and a second data storage table. The first data storage table may be a common data table a in the destination system, and the second data storage table may be an uncommon data table B in the destination system. The method may further comprise:
step S1011: and storing the first data into the first data storage table, checking whether third data with the use frequency lower than a preset value exists in the first data storage table, and if so, moving the third data into the second data storage table.
For example, the third data with the usage frequency lower than the preset value is the uncommon data, and the preset value may be set according to specific situations, which is not limited to this. When the data is timed and synchronized, the data meeting the time requirement is incrementally synchronized to a common table A of a target system according to the updating time of the data in the source system in each time of timing synchronization. And then the target system checks whether the data which is not used frequently exists in the common table A or not according to the attribute field of the sub-table, namely the data with the frequency lower than the preset value exists, and if so, the part of the data which is not used frequently is moved to the non-common table B. Therefore, the data can be stored in the form of the sub-table according to the attribute of the synchronous data, and meanwhile, the real-time or periodic conversion between the common data and the uncommon data can be realized, so that the query efficiency is improved when the data is queried in the later period.
The exemplary embodiment will be further described with reference to an application scenario diagram of the exemplary embodiment shown in fig. 4.
In this application scenario, the procedure of the above method in this example embodiment is specifically described by taking an example that an NTMS system (a destination system) requests a BIP system (a source system) of a branch information platform to synchronize agent data. The agent information in the NTMS system needs to be acquired from the BIP system, the data volume of an agent information table in the BIP system is huge, and the adjustment of part of information does not record the updating time. The agent table in the NTMS system is divided into a leave table (corresponding to the uncommon table B) and an on-duty table (corresponding to the common table a) according to the personnel status. The flow of the agent data timing synchronization and real-time synchronization is explained below.
Firstly, data timing synchronization:
step 1): the NTMS initiates a timing synchronization request to the BIP system at a fixed time every day. For example, a synchronization request updates data for the last 3 days.
Step 2): the BIP system inquires data with the update date of the last 3 days, and if not, the data does not need to be synchronized. If yes, the BIP system synchronously updates the data meeting the conditions to the incumbent schedule of the NTMS system.
Step 3): the NTMS system determines whether the updated agent is available for employment and transfers the agent not available for employment to the leave list.
Secondly, data real-time synchronization:
step 1): the user inputs the agent manual number in the NTMS system and requests to synchronize the information of the agent.
Step 2): the BIP system finds the agent information and returns synchronization to the NTMS system.
Step 3): the NTMS inquires whether the synchronized agent exists in the job table or not, and if so, the information of the agent in the job table is updated.
Step 4): after the information of the agent in the job table is updated in the step 3), judging whether the updated agent is in the job or not, and if not, transferring the information of the agent from the in-job table to the out-of-job table; if so, the data is not moved.
Step 5): and in step 3), if the synchronous agent does not exist in the job table, checking the job leaving table. If the information exists in the job leaving form, updating the information of the agent in the job leaving form; if not, adding the information of the agent to the leave list.
Step 6): after updating the information of the agent in the leave-job table in the step 5), judging whether the updated agent is in the job or not by the NTMS system, and if so, transferring the agent from the leave-job table to the in-job table; if not, the data is not moved.
In the embodiment, the data synchronization efficiency is improved by combining the data timing synchronization mode and the real-time synchronization mode, and the data is synchronized to the target system and then stored in the sub-table mode, so that the convenience and the searching efficiency of subsequently searching the data in the target system are improved. The exemplary embodiment considers both the data reading efficiency and the accuracy of data synchronization as well as the synchronization efficiency.
It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc. Additionally, it will also be readily appreciated that the steps may be performed synchronously or asynchronously, e.g., among multiple modules/processes/threads.
Further, in the present exemplary embodiment, a data synchronization processing apparatus is also provided. The apparatus may be applied to a first server, which may be, for example, a server running the destination system. Referring to fig. 5, the apparatus 100 may include a data timing synchronization module 101 and a data real-time synchronization module 102. Wherein:
the data timing synchronization module 101 is configured to send a data timing synchronization request to a second server, and receive one or more first data that are found and sent on the second server according to data update time information after the second server responds to the data timing synchronization request; wherein the timing synchronization request carries the data update time information;
the data real-time synchronization module 102 is configured to send a data real-time synchronization request to the second server according to a preset data request, and receive one or more second data found and sent by the second server on the second server after the second server responds to the data real-time synchronization request.
Referring to fig. 6, in the present exemplary embodiment, a first data storage table and a second data storage table may be disposed on the first server; the apparatus 100 may also include a first query update module 103, a second query update module 104, and a data addition module 105. Wherein:
the first query updating module 103 is configured to query whether the second data is in the first data storage table, and update the second data in the first data storage table when the second data is in the first data storage table.
The second query updating module 104 is configured to query whether the second data is in the second data storage table when the second data is not in the first data storage table, and update the second data in the second data storage table when the second data is in the second data storage table.
The data adding module 105 is configured to add the second data to the second data storage table when the second data is not in the second data storage table.
Referring to fig. 7, in this exemplary embodiment, the apparatus 100 may further include a first determining and transferring module 106, configured to determine, after the updating of the second data in the first data storage table, whether an object represented by the second data exists, and if the object represented by the second data does not exist, transfer the second data from the first data storage table to the second data storage table; if so, the data is not moved.
Referring to fig. 7, in this exemplary embodiment, the apparatus 100 may further include a second determining and transferring module 107, configured to determine, after the second data stored in the second data storage table before the updating, whether an object represented by the second data exists, and if the object represented by the second data exists, transfer the second data from the second data storage table to the first data storage table; if not, the data is not moved.
Referring to fig. 7, in the present exemplary embodiment, a first data storage table and a second data storage table may be disposed on the first server; the apparatus 100 may further include a third determining and transferring module 108, configured to store the first data in the first data storage table, check whether third data with a usage frequency lower than a preset value exists in the first data storage table, and move the third data to the second data storage table if the third data exists.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units. The components shown as modules or units may or may not be physical units, i.e. may be located in one place or may also be distributed over a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the wood-disclosed scheme. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to make a computing device (which may be a personal computer, a server, or a network device, etc.) execute the method according to the embodiments of the present disclosure.
Fig. 8 shows a schematic diagram of a data synchronization processing apparatus 400 according to an example embodiment of the present disclosure. For example, the apparatus 400 may be provided as a server. Referring to fig. 8, apparatus 400 includes a processing component 422, which further includes one or more processors, and memory resources, represented by memory 432, for storing instructions, such as applications, that are executable by processing component 422. The application programs stored in memory 432 may include one or more modules that each correspond to a set of instructions. Further, the processing component 422 is configured to execute instructions to perform the above-described methods.
The apparatus 400 may also include a power component 426 configured to perform power management of the apparatus 400, a wired or wireless network interface 450 configured to connect the apparatus 400 to a network, and an input output (I/O) interface 458. The apparatus 400 may operate based on an operating system stored in the memory 432, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, or the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
Claims (6)
1. A data synchronization processing method is applied to a first server, and is characterized by comprising the following steps:
sending a data timing synchronization request to a second server, receiving one or more first data searched and sent by the second server according to data updating time information after the second server responds to the data timing synchronization request; wherein the timing synchronization request carries the data update time information; the first data is data for accurately recording the data updating time information;
sending a data real-time synchronization request to the second server according to a preset data request, receiving one or more second data which are searched and sent by the second server after the second server responds to the data real-time synchronization request; the second data is data in which the data updating time information is not accurately recorded;
the first server is provided with a first data storage table and a second data storage table; the method further comprises the following steps: inquiring whether the second data is in the first data storage table, and updating the second data in the first data storage table when the second data is in the first data storage table; when the second data is not in the first data storage table, inquiring whether the second data is in the second data storage table, and when the second data is in the second data storage table, updating the second data in the second data storage table; adding the second data to the second data storage table when the second data is not in the second data storage table;
the first server is provided with a first data storage table and a second data storage table; the method further comprises the following steps: storing the first data into the first data storage table, checking whether third data with the use frequency lower than a preset value exists in the first data storage table, and if so, moving the third data into the second data storage table;
and reading the synchronized data by adopting an index and table dividing mode.
2. The data synchronization processing method according to claim 1, wherein after the updating of the second data in the first data storage table, the method further comprises:
judging whether an object represented by the second data exists or not, and if not, transferring the second data from the first data storage table to the second data storage table; if so, the data is not moved.
3. The data synchronization processing method according to claim 1, wherein after the updating of the second data previously stored in the second data storage table, the method further comprises:
judging whether an object represented by the second data exists or not, and if so, transferring the second data from the second data storage table to the first data storage table; if not, the data is not moved.
4. A data synchronization processing apparatus applied to a first server, the apparatus comprising:
the data timing synchronization module is used for sending a data timing synchronization request to a second server, receiving one or more first data which are searched and sent on the second server according to data updating time information after the second server responds to the data timing synchronization request; wherein the timing synchronization request carries the data update time information; the first data is data for accurately recording the data updating time information;
the data real-time synchronization module is used for sending a data real-time synchronization request to the second server according to a preset data request, receiving one or more second data which are searched and sent on the second server after the second server responds to the data real-time synchronization request; the second data is data in which the data updating time information is not accurately recorded;
the first server is provided with a first data storage table and a second data storage table; the device further comprises: the first query updating module is used for querying whether the second data is in the first data storage table or not, and updating the second data in the first data storage table when the second data is in the first data storage table; a second query updating module, configured to query whether the second data is in the second data storage table when the second data is not in the first data storage table, and update the second data in the second data storage table when the second data is in the second data storage table; a data adding module, configured to add the second data to the second data storage table when the second data is not in the second data storage table;
the first server is provided with a first data storage table and a second data storage table; the device further comprises: a third judging and transferring module, configured to store the first data in the first data storage table, check whether third data with a use frequency lower than a preset value exists in the first data storage table, and move the third data to the second data storage table if the third data exists;
and reading the synchronized data by adopting an index and table dividing mode.
5. The data synchronization processing apparatus according to claim 4, wherein the apparatus further comprises:
a first judging and transferring module, configured to, after the second data in the first data storage table is updated, judge whether an object represented by the second data exists, and if the object represented by the second data does not exist, transfer the second data from the first data storage table to the second data storage table; if so, the data is not moved.
6. The data synchronization processing apparatus according to claim 4, wherein the apparatus further comprises:
a second determining and transferring module, configured to determine whether an object represented by the second data exists after the second data stored in the second data storage table before the update, and if the object represented by the second data exists, transfer the second data from the second data storage table to the first data storage table; if not, the data is not moved.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710005137.XA CN106657376B (en) | 2017-01-04 | 2017-01-04 | Data synchronization processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710005137.XA CN106657376B (en) | 2017-01-04 | 2017-01-04 | Data synchronization processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106657376A CN106657376A (en) | 2017-05-10 |
| CN106657376B true CN106657376B (en) | 2020-08-28 |
Family
ID=58842524
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710005137.XA Active CN106657376B (en) | 2017-01-04 | 2017-01-04 | Data synchronization processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106657376B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107679195B (en) * | 2017-10-09 | 2021-01-22 | 杭州安恒信息技术股份有限公司 | Semi-master-slave database synchronization method and system based on HTTPS protocol transmission |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101008908A (en) * | 2006-01-25 | 2007-08-01 | 联想(北京)有限公司 | Synchronous data copy system and method |
| CN102207978A (en) * | 2011-06-30 | 2011-10-05 | 北京新媒传信科技有限公司 | Database access method and system |
| CN104580454A (en) * | 2014-12-31 | 2015-04-29 | 乐视网信息技术（北京）股份有限公司 | Data synchronizing method, device and system |
| CN104598623A (en) * | 2015-02-03 | 2015-05-06 | 东南大学 | Comprehensive sensing network stratified data management system |
| CN105956139A (en) * | 2016-05-12 | 2016-09-21 | 国电南瑞科技股份有限公司 | Method for synchronizing database in two machines |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8595382B2 (en) * | 2010-06-07 | 2013-11-26 | Salesforce.Com, Inc. | System, method and computer program product for performing a synchronization of data |
-
2017
- 2017-01-04 CN CN201710005137.XA patent/CN106657376B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101008908A (en) * | 2006-01-25 | 2007-08-01 | 联想(北京)有限公司 | Synchronous data copy system and method |
| CN102207978A (en) * | 2011-06-30 | 2011-10-05 | 北京新媒传信科技有限公司 | Database access method and system |
| CN104580454A (en) * | 2014-12-31 | 2015-04-29 | 乐视网信息技术（北京）股份有限公司 | Data synchronizing method, device and system |
| CN104598623A (en) * | 2015-02-03 | 2015-05-06 | 东南大学 | Comprehensive sensing network stratified data management system |
| CN105956139A (en) * | 2016-05-12 | 2016-09-21 | 国电南瑞科技股份有限公司 | Method for synchronizing database in two machines |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106657376A (en) | 2017-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11514076B2 (en) | Cooperative naming for configuration items in a distributed configuration management database environment | |
| US10915549B2 (en) | Techniques for keeping a copy of a pluggable database up to date with its source pluggable database in read-write mode | |
| WO2021238701A1 (en) | Data migration method and device | |
| CN113297320B (en) | Distributed database system and data processing method | |
| US20180349458A1 (en) | Consistent query execution for big data analytics in a hybrid database | |
| CN107577420B (en) | File processing method and device and server | |
| CN109542907B (en) | Database cache construction method and device, computer equipment and storage medium | |
| CN104572689A (en) | Data synchronizing method, device and system | |
| US20120084407A1 (en) | Real-load tuning of database applications | |
| US10642530B2 (en) | Global occupancy aggregator for global garbage collection scheduling | |
| CN113704291A (en) | Data query method and device, storage medium and electronic equipment | |
| CN110955719B (en) | Data access processing equipment, system and method | |
| CN106657376B (en) | Data synchronization processing method and device | |
| US11704327B2 (en) | Querying distributed databases | |
| CN111625600B (en) | Data storage processing method, system, computer equipment and storage medium | |
| CN113297231A (en) | Database processing method and device | |
| US20220300504A1 (en) | Generating a global delta in distributed databases | |
| CN110245148B (en) | Data storage method, device, system and medium | |
| CN115080666A (en) | Data synchronization method, system, electronic device and storage medium | |
| CN109325057B (en) | Middleware management method, device, computer equipment and storage medium | |
| CN110019403B (en) | Query method and related device | |
| CN113220760B (en) | Data processing method, device, server and storage medium | |
| WO2018145739A1 (en) | Methods, client and server relating to a distributed database | |
| US20240086419A1 (en) | Electronic Apparatus and Method for Managing Feature Information | |
| CN112948461B (en) | Method, apparatus, storage medium and program product for calendar data processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |