CN106657376A - Data synchronization processing method and device - Google Patents
Data synchronization processing method and device Download PDFInfo
- Publication number
- CN106657376A CN106657376A CN201710005137.XA CN201710005137A CN106657376A CN 106657376 A CN106657376 A CN 106657376A CN 201710005137 A CN201710005137 A CN 201710005137A CN 106657376 A CN106657376 A CN 106657376A
- Authority
- CN
- China
- Prior art keywords
- data
- server
- store
- data store
- synchronization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
The invention discloses a data synchronization processing method and device. The method comprises the following steps of sending a data timing synchronization request to a second server and receiving one or more data searched and sent on the second server according to data updating time information after the second server responds to the data timing synchronization request, wherein the timing synchronization request carries data updating time information; and sending a real-time data synchronization request to the second server according to a preset data request and receiving one or more second data searched and sent on the second server after the second server responds to the real-time data synchronization request. According to the method and the device, a problem of data synchronization of large data volume is solved when the data volume is too large and the total synchronization cannot be adopted while the change time cannot be accurately recorded in a data source, so that the data synchronization efficiency is improved.
Description
Technical field
It relates to data synchronization technology field, more particularly to a kind of data synchronizing processing method and data synchronization processing
Device.
Background technology
With developing rapidly for informationization technology, IT application in enterprise becomes increasingly popular.Some all departments of enterprise divide
The information system of oneself is built one after another by company.So, when the shared of data, integration are realized in these different systems, number
It is that a kind of Jing is commonly encountered and very important demand according to the bi-directional synchronization of (such as on-the-job personnel's data and Personnel Who Left data).
In correlation technique, mainly there is two ways when synchronizing to the data of big data quantity at present:One is full dose data
The method of synchronization, two is the incremental data method of synchronization.Full dose data syn-chronization mode requires that both sides' system has stronger digital independent energy
Power and stable network, time-consuming and big to both sides' system pressure for which.And the incremental data method of synchronization then requires data source
The such as renewal time modification information of each data of system accurate recording, and realize that logic is deleted.But when data volume is excessive and nothing
Method adopt full dose data syn-chronization mode, while data source systems again cannot each data of accurate recording modification information when, can cause
Data synchronization efficiency is low, and this data syn-chronization to big data quantity proposes new requirement.In addition, the data after synchronization are in purpose
When used in system, the reading efficiency of the data of big data quantity how is improved, need the digital independent scheme for adapting to therewith, it is related
Lack corresponding solution in technology at present.
Therefore, it is necessary to providing a kind of new technical scheme improves one or more problem present in such scheme.
It should be noted that information is only used for strengthening the reason of background of this disclosure disclosed in above-mentioned background section
Solution, therefore can include not constituting the information to prior art known to persons of ordinary skill in the art.
The content of the invention
The purpose of the disclosure is to provide a kind of data synchronizing processing method and data synchronization processing device, and then is at least existed
Restriction and the defect due to correlation technique is overcome to a certain extent and caused one or more problem.
Other characteristics of the disclosure and advantage will be apparent from by detailed description below, or partially by the disclosure
Practice and acquistion.
According to the first aspect of the embodiment of the present disclosure, there is provided a kind of data synchronizing processing method, a first service is applied to
Device, methods described includes:
A data timing synchronization request is sent to a second server, the second server response data is received and is determined
When synchronization request after according to data update temporal information find and send on the second server one or more
First data;Wherein, the Timing Synchronization request carries the data renewal temporal information;
Asked to send real time data synchronization request to the second server according to a preset data, receive second clothes
Business device respond find on the second server after real time data synchronization request and send one or more the
Two data.
In a kind of exemplary embodiment of the disclosure, the first server is provided with the first table data store and the second number
According to storage table;Methods described also includes:
Second data are inquired about whether in first table data store, when second data are in the described first number
During according in storage table, second data in first table data store are updated;
When second data not in first table data store when, whether inquire about second data described the
In two table data stores, when second data are in second table data store, second table data store is updated
In second data;
When second data not in second table data store when, add second data and count to described second
According to storage table.
In a kind of exemplary embodiment of the disclosure, second data updated in first table data store
Afterwards, methods described also includes:
Judge that the object that second data are characterized whether there is, if not existing, by second data from described
First table data store is transferred to second table data store;If existing, not mobile data.
In a kind of exemplary embodiment of the disclosure, it is described update in second table data store before storage it is described
After second data, methods described also includes:
Judge that the object that second data are characterized whether there is, if existing, by second data from described the
Two table data stores are transferred to first table data store;If not existing, not mobile data.
In a kind of exemplary embodiment of the disclosure, the first server is provided with the first table data store and the second number
According to storage table;Methods described also includes:
By in the first table data store described in first data Cun Chudao, and check in first table data store and be
It is no to there are threeth data of the usage frequency less than preset value, if existing, the 3rd data are moved to into second data
In storage table.
According to the second aspect of the embodiment of the present disclosure, there is provided a kind of data synchronization processing device, a first service is applied to
Device, described device includes:
Data timing synchronization module, for sending a data timing synchronization request to a second server, receives described the
Two servers responded and searched on the second server according to data renewal temporal information after the data timing synchronization request
To and one or more first data for sending;Wherein, the Timing Synchronization request carries the data renewal temporal information;
Real time data synchronization module, for asking same in real time to second server transmission data according to a preset data
Step request, receives and is found simultaneously on the second server after the second server response real time data synchronization request
The data of one or more for sending second.
In a kind of exemplary embodiment of the disclosure, the first server is provided with the first table data store and the second number
According to storage table;Described device also includes:
First inquiry update module, for inquiring about second data whether in first table data store, works as institute
When stating the second data in first table data store, second data in first table data store are updated;
Second inquiry update module, for when second data not in first table data store when, inquire about institute
The second data are stated whether in second table data store, when second data are in second table data store,
Update second data in second table data store;
Data add module, for when second data not in second table data store when, add described the
Two data are to second table data store.
In a kind of exemplary embodiment of the disclosure, described device also includes:
First judges shift module, for second data updated in first table data store it
Afterwards, judge that the object that second data are characterized whether there is, if not existing, by second data from the described first number
Second table data store is transferred to according to storage table;If existing, not mobile data.
In a kind of exemplary embodiment of the disclosure, described device also includes:
Second judges shift module, for described second of the storage before described renewal in second table data store
After data, judge that the object that second data are characterized whether there is, if existing, by second data from described the
Two table data stores are transferred to first table data store;If not existing, not mobile data.
In a kind of exemplary embodiment of the disclosure, the first server is provided with the first table data store and the second number
According to storage table;Described device also includes:
3rd judges shift module, for by the first table data store described in first data Cun Chudao, and checks
The 3rd data of preset value are less than in first table data store with the presence or absence of usage frequency, if existing, by the described 3rd
Data are moved in second table data store.
The technical scheme that embodiment of the disclosure is provided can include following beneficial effect:
In a kind of embodiment of the disclosure, by above-mentioned data synchronizing processing method and device, by data timing it is synchronous and
Real time data synchronization combines, right for the data of accurate recording change time in data source adopt timing batch synchronization data
The data for changing the time without accurate recording in data source adopt real-time synchronization;Thus it is possible, on the one hand, when data volume is excessive and nothing
Method adopts full dose synchronization, at the same in data source again cannot the accurate recording change time when, the data syn-chronization for solving big data quantity is asked
Topic, improves to a certain extent data synchronization efficiency;On the other hand, due to without adopting real-time synchronization mode completely, certain
The requirement of the communication network to both sides' system is reduced in degree, the pressure to both sides' system is reduced.
It should be appreciated that the general description of the above and detailed description hereinafter are only exemplary and explanatory, not
The disclosure can be limited.
Description of the drawings
Accompanying drawing herein is merged in specification and constitutes the part of this specification, shows the enforcement for meeting the disclosure
Example, and be used to explain the principle of the disclosure together with specification.It should be evident that drawings in the following description are only the disclosure
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can be with basis
These accompanying drawings obtain other accompanying drawings.
Fig. 1 schematically shows the first data synchronizing processing method flow chart in disclosure exemplary embodiment;
Fig. 2 schematically shows the second data synchronizing processing method flow chart in disclosure exemplary embodiment;
Fig. 3 schematically shows the 3rd data synchronizing processing method flow chart in disclosure exemplary embodiment;
Fig. 4 schematically shows data synchronization processing application scenarios schematic diagram in disclosure exemplary embodiment;
Fig. 5 schematically shows the first data synchronization processing schematic device in disclosure exemplary embodiment;
Fig. 6 schematically shows the second data synchronization processing schematic device in disclosure exemplary embodiment;
Fig. 7 schematically shows the 3rd data synchronization processing schematic device in disclosure exemplary embodiment;
Fig. 8 schematically shows another data synchronization processing schematic device in disclosure exemplary embodiment.
Specific embodiment
Example embodiment is described more fully with referring now to accompanying drawing.However, example embodiment can be with various shapes
Formula is implemented, and is not understood as limited to example set forth herein;Conversely, thesing embodiments are provided so that the disclosure will more
Fully and completely, and by the design of example embodiment those skilled in the art is comprehensively conveyed to.Described feature, knot
Structure or characteristic can be combined in any suitable manner in one or more embodiments.
Additionally, accompanying drawing is only the schematic illustrations of the disclosure, it is not necessarily drawn to scale.Identical accompanying drawing mark in figure
Note represents same or similar part, thus will omit repetition thereof.Some block diagrams shown in accompanying drawing are work(
Energy entity, not necessarily must be corresponding with physically or logically independent entity.These work(can be realized using software form
Energy entity, or these functional entitys are realized in one or more hardware modules or integrated circuit, or at heterogeneous networks and/or place
These functional entitys are realized in reason device device and/or microcontroller device.
A kind of data synchronizing processing method is provide firstly in this example embodiment, the method can apply to one first
On server, the first server for example can be the server for running purpose system.With reference to shown in Fig. 1, the data are same
Step processing method can include:
Step S101:A data timing synchronization request is sent to a second server, the second server response is received
Update what temporal information found on the second server and sent according to data after the data timing synchronization request
One or more first data;Wherein, the Timing Synchronization request carries the data renewal temporal information.
Step S102:Asked to send real time data synchronization request to the second server according to a preset data, received
The second server responds for finding on the second server and sending after the real time data synchronization request
Individual or multiple second data.
By above-mentioned data synchronizing processing method, full dose synchronization cannot be adopted when data volume is excessive, while in data source
Again cannot accurate recording change the time when, solve big data quantity data synchronization problems, data syn-chronization is improved to a certain extent
Efficiency;On the other hand, due to without adopting real-time synchronization mode completely, the communication to both sides' system being reduced to a certain extent
The requirement of network, reduces the pressure to both sides' system.
Below, each step of the said method in this example embodiment will be carried out in more detail referring to figs. 1 to Fig. 4
Explanation.
In step S101, a data timing synchronization request is sent to a second server, receive the second server
Respond and find and send on the second server according to data renewal temporal information after the data timing synchronization request
One or more first data come;Wherein, the Timing Synchronization request carries the data renewal temporal information.
In this example embodiment, the second server can be run an origin system server, the origin system
For example can be branch company's plateform system, branch company's plateform system can for example store record agent's information (such as name
Or job number etc.).And the purpose system run in the first server for example can be a dangerous Training Management Information System.
Exemplary, the dangerous Training Management Information System needs synchronously to obtain agent's information from the origin system.Due to source
Information record updates the situation not in time of there may be in system, then the procuratorial information data that have been accurate recordings a bit
The renewal time, some then update the time without accurate recording data.This portion of the renewal time of data for accurate recording
Divided data, described danger Training Management Information System can send a timing synchronization request to the origin system, and the Timing Synchronization please
Ask the time range condition of the data to be asked that can carry, such as data in first 3 days of current time.The mesh
System receive after Timing Synchronization request, parsing obtains the time range condition, according to the time range condition
Compare lookup to meet agent's information of the condition and return to the origin system in batches.
In step s 102, asked to send real time data synchronization request to the second server according to a preset data,
Receive and find and send on the second server after the second server response real time data synchronization request
One or more second data.
Exemplary, for the partial data that the time is updated without accurate recording data, can be by the purpose system
Real-time synchronization is initiated to the origin system to ask to obtain one or more data,
In this example embodiment, the synchronization of data is by the way of timed increase is synchronous and real-time synchronization combines come reality
It is existing.For the data of accurate recording change time in origin system, by comparing the renewal time come timing batch synchronization data;It is right
Time inaccurate data are updated in origin system, then synchronization request is initiated by purpose system, it is synchronous specific one or many
Data.So, full dose synchronization cannot be adopted when data volume is excessive, while again cannot the accurate recording change time in data source
When, the data synchronization problems of big data quantity are solved, the efficiency of data syn-chronization is improve to a certain extent.
It is in one exemplary embodiment, described in order to improve after data syn-chronization to the purpose system with reference to shown in Fig. 2
The search efficiency of data in purpose system.The first table data store and the second data storage can be provided with the first server
Table.For example, first table data store can be the frequently-used data Table A in the purpose system, second data storage
Table can be tables of data B that is of little use in the purpose system.Methods described can also include step S103~step S105.Its
In:
Step S103:Second data are inquired about whether in first table data store, when second data exist
When in first table data store, second data in first table data store are updated.
In one exemplary embodiment, after second data updated in first table data store, institute
The method of stating can also include:Judge that the object that second data are characterized whether there is, if not existing, by the described second number
Second table data store is transferred to according to from first table data store;If existing, not mobile data.
Exemplary, second data can act on behalf of personal data, and the object that second data are characterized is acted on behalf of
People.For example, the purpose system initiates real-time synchronization request to origin system, and by certain in origin system or many datas
In being synchronized to purpose system.Afterwards the synchronous data of the purpose system queries whether there is in frequently-used data Table A, if depositing
Then updating the data in frequently-used data Table A.After renewal, whether purpose system belongs to normal according to point Table Properties clearly data
With data, if being not belonging to, the data are moved to from frequently-used data Table A and are of little use in tables of data B;If belonging to, number is not moved
According to.For example, to purpose system, whether agent of the purpose system according to representated by this acts on behalf of personal data for sync agent personal data
On-job attribute information judges that this acts on behalf of whether personal data belongs to frequently-used data, if not on-job, this is acted on behalf of into personal data from normal
It is moved to data Table A and is of little use in tables of data B;If on-job, not mobile data.
Step S104:When second data not in first table data store when, inquiring about second data is
It is no in second table data store, when second data are in second table data store, update described second
Second data in table data store.
Exemplary, continue with above-mentioned illustration.The synchronous data of the purpose system queries whether there is in normal
With in data Table A, if the data of synchronization are not present in frequently-used data Table A, inspection is to be present in be of little use in tables of data B.
If existing, the data being of little use in tables of data B are updated.
In one exemplary embodiment, after second data updated in second table data store, institute
The method of stating can also include:Judge that the object that second data are characterized whether there is, if existing, by second data
First table data store is transferred to from second table data store;If not existing, not mobile data.
Exemplary, renewal is of little use after the data in tables of data B, and purpose system is according to point Table Properties clearly data
It is no to belong to frequently-used data, if belonging to, will be moved in frequently-used data Table A in data never frequently-used data table B;If being not belonging to,
Then not mobile data.For example, the acting on behalf of after personal data in tables of data B that be of little use is updated, the purpose system is according to the agent
The whether on-job attribute information of agent representated by data judges that this acts on behalf of whether personal data belongs to frequently-used data, if on-job,
Never frequently-used data table B is moved in frequently-used data Table A then this to be acted on behalf of into personal data;If not on-job, not mobile data.
Step S105:When second data not in second table data store when, add second data and arrive
Second table data store.
Exemplary, the synchronous data of above-mentioned inspection whether there is when in tables of data B that is of little use, if not existing, add
Plus the synchronous data are to being of little use in tables of data B.
In this example embodiment, synchronously after data point table storage used in purpose system update, frequently-used data and
Be of little use data timing or conversion in real time.Can be indexed and point table mode with adopting simultaneously on the digital independent of big data quantity, according to
The a certain attribute of data carries out a point table storage, to improve the efficiency that data query is subsequently carried out in purpose system.This example reality
The mode of applying improves the data reading performance using redundancy of big data quantity in purpose system.
With reference to shown in Fig. 3, in one exemplary embodiment, on the basis of above-described embodiment, in the first server
The first table data store and the second table data store can be provided with.First table data store can be normal in purpose system
Data Table A is used, second table data store can be tables of data B that is of little use in the purpose system.Methods described may be used also
To include:
Step S1011:By in the first table data store described in first data Cun Chudao, and check first data
, if existing, the 3rd data are moved to into institute less than the 3rd data of preset value with the presence or absence of usage frequency in storage table
In stating the second table data store.
Exemplary, the usage frequency is of little use data less than the 3rd data of preset value, and the preset value can be with
Arrange as the case may be, it is without limitation.During Timing Synchronization data, each Timing Synchronization according to data in origin system more
The new time is synchronized to the data increment for meeting time requirement in the conventional Table A of purpose system.Afterwards purpose system is according to a point table
With the presence or absence of the data of data, i.e. usage frequency less than preset value that are of little use in the conventional Table A of attribute field inspection, if existing,
This part data that are of little use are moved to into the table B that is of little use.So data point table can be stored according to the attribute of synchronous data,
Frequently-used data can also be realized simultaneously and the real-time or regular conversion of the data that are of little use, be easy to improve inquiry during later stage inquiry data
Efficiency.
This example embodiment is made with reference to an application scenarios schematic diagram of this example embodiment shown in Fig. 4
Further instruction.
With individual dangerous Training Management Information System NTMS systems (purpose system) to information platform BIP systems of branch company in this application scene
System (origin system) request sync agent personal data as a example by be specifically described this example embodiment in said method flow process.Institute
Stating the agent's information in NTMS systems needs from BIP systems to obtain, and the agent's information table data amount in BIP systems is huge,
And the adjustment of partial information does not record the renewal time.It is (right that agent's table in NTMS systems is divided into leaving office table according to personnel state
Should be of little use table B) and on-job table (the conventional Table A of correspondence).The flow process of the synchronization of agent's data timing and real-time synchronization is entered below
Row explanation.
First, data timing synchronization:
Step 1):The timing daily of NTMS systems initiates Timing Synchronization request to BIP systems.Such as synchronization request update date
For the data of nearest 3 days.
Step 2):BIP system queries update dates are the data of nearest 3 days, if not having, without the need for synchronous.If having, BIP
System will meet the data synchronization updating of condition in the on-job table of NTMS systems.
Step 3):NTMS systems judge whether the agent after updating is on-job, and not on-job agent is transferred to into leaving office
In table.
2nd, real time data synchronization:
Step 1):User is input into agent's job number, the synchronous procuratorial information of request in NTMS systems.
Step 2):BIP system searchings are to agent's information and return is synchronized to NTMS systems.
Step 3):The synchronous agent of NTMS system queries whether there is in on-job table, if existing, update on-job table
In the procuratorial information.
Step 4):Step 3) in update in on-job table after the procuratorial information, judge that whether the agent after renewal exists
Duty, if not on-job, leaving office table is transferred to by agent's information from on-job table;If on-job, not mobile data.
Step 5):Step 3) in, if the agent of synchronization is not present in on-job table, check leaving office table.If being present in
Leaving office table, then update the procuratorial information in leaving office table;If not existing, add the procuratorial information to leaving office table.
Step 6):Step 5) in update in leaving office table after the procuratorial information, NTMS systems judge the agency after updating
Whether people is on-job, if on-job, the agent is transferred to into on-job table from leaving office table;If not on-job, not mobile data.
Combine with real-time synchronization mode to improve data syn-chronization effect by the way that data timing is synchronous in this example embodiment
Rate, carries out data point table storage after data syn-chronization to purpose system, to improve the facility of the follow-up searching data in purpose system
Property and search efficiency.This example embodiment has taken into account the accuracy and synchronous efficiency of data reading performance using redundancy and data syn-chronization.
Although it should be noted that describe each step of method in the disclosure with particular order in the accompanying drawings,
This does not require that or implies must perform these steps according to the particular order, or have to carry out the step shown in whole
Desired result could be realized.It is additional or alternative, it is convenient to omit some steps, multiple steps are merged into into a step and is held
OK, and/or by a step execution of multiple steps etc. are decomposed into.In addition, being also easy to be understood by, these steps can be
For example either synchronously or asynchronously perform in multiple module/process/threads.
Further, in this example embodiment, a kind of data synchronization processing device is additionally provided.The device can be applied
In a first server, the first server for example can be the server for running purpose system.With reference to shown in Fig. 5, dress
Put 100 can include the sum of data timing synchronization module 101 factually when synchronization module 102.Wherein:
The data timing synchronization module 101, for sending a data timing synchronization request to a second server, receives
The second server to be responded and update temporal information in the second server according to data after the data timing synchronization request
On one or more first data for finding and sending;Wherein, when the Timing Synchronization request carries the data renewal
Between information;
The real time data synchronization module 102, for being asked to send number to the second server according to a preset data
Synchronization request when factually, after the reception second server response real time data synchronization request on the second server
One or more second data for finding and sending.
With reference to shown in Fig. 6, in this exemplary embodiment, can be provided with the first server the first table data store and
Second table data store;Described device 100 can also include the first inquiry inquiry and of update module 104 of update module 103, second
Data add module 105.Wherein:
The first inquiry update module 103, for whether inquiring about second data in first table data store
In, when second data are in first table data store, update described second in first table data store
Data.
It is described second inquiry update module 104, for when second data not in first table data store when,
Second data are inquired about whether in second table data store, when second data are in second table data store
When middle, second data in second table data store are updated.
The data add module 105, for when second data not in second table data store when, addition
Second data are to second table data store.
With reference to shown in Fig. 7, in this exemplary embodiment, described device 100 can also judge shift module including first
106, for after second data updated in first table data store, judging the second data institute table
The object levied whether there is, if not existing, second data is transferred to into described second from first table data store
Table data store;If existing, not mobile data.
With reference to shown in Fig. 7, in this exemplary embodiment, described device 100 can also judge shift module including second
107, for after second data that stored before described renewal in second table data store, judging described second
The object that data are characterized whether there is, if existing, second data is transferred to into institute from second table data store
State the first table data store;If not existing, not mobile data.
With reference to shown in Fig. 7, in this exemplary embodiment, can be provided with the first server the first table data store and
Second table data store;Described device 100 can also judge shift module 108 including the 3rd, for first data to be deposited
In storing up first table data store, and check in first table data store with the presence or absence of usage frequency less than preset value
The 3rd data, if exist, the 3rd data are moved in second table data store.
With regard to the device in above-described embodiment, wherein modules perform the concrete mode of operation in relevant the method
Embodiment in be described in detail, explanation will be not set forth in detail herein.
Although it should be noted that some modules or list of the equipment for action executing are referred in above-detailed
Unit, but this division is not enforceable.In fact, according to embodiment of the present disclosure, it is above-described two or more
The feature and function of module either unit can embody in a module or unit.Conversely, an above-described mould
The feature and function of block either unit can be to be embodied by multiple modules or unit with Further Division.As module or list
The part that unit shows can be or may not be physical location, you can with positioned at a place, or can also be distributed to
On multiple NEs.Some or all of module therein can according to the actual needs be selected to realize the open scheme of wood
Purpose.Those of ordinary skill in the art are not in the case where creative work is paid, you can to understand and implement.
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented
Mode can be realized by software, it is also possible to be realized by way of software is with reference to necessary hardware.Therefore, according to the disclosure
The technical scheme of embodiment can be embodied in the form of software product, the software product can be stored in one it is non-volatile
Property storage medium (can be CD-ROM, USB flash disk, portable hard drive etc.) in or network on, including some instructions are so that a calculating
Equipment (can be personal computer, server or network equipment etc.) performs the method according to disclosure embodiment.
Fig. 8 is illustrated according to a kind of schematic diagram of data synchronization processing device 400 in disclosure example embodiment.For example,
Device 400 may be provided in a server.With reference to Fig. 8, device 400 includes process assembly 422, its further include one or
Multiple processors, and the memory resource by representated by memory 432, can be by the execution of process assembly 422 for storage
Instruction, such as application program.The application program stored in memory 432 can include one or more each correspondence
In the module of one group of instruction.Additionally, process assembly 422 is configured to execute instruction, to perform said method.
Device 400 can also include that a power supply module 426 is configured to the power management of performs device 400, and one has
Line or radio network interface 450 are configured to for device 400 to be connected to network, and input and output (I/O) interface 458.Dress
Putting 400 can operate based on being stored in the operating system of memory 432, such as Windows ServerTM, Mac OS XTM,
UnixTM, LinuxTM, FreeBSDTM or similar.
Those skilled in the art will readily occur to its of the disclosure after considering specification and putting into practice invention disclosed herein
Its embodiment.The application is intended to any modification, purposes or the adaptations of the disclosure, these modifications, purposes or
Person's adaptations follow the general principle of the disclosure and including the undocumented common knowledge in the art of the disclosure
Or conventional techniques.Description and embodiments are considered only as exemplary, and the true scope of the disclosure and spirit are by appended
Claim is pointed out.
Claims (10)
1. a kind of data synchronizing processing method, is applied to a first server, it is characterised in that methods described includes:
A data timing synchronization request is sent to a second server, the second server response data timing is received same
Step request after according to data update temporal information find on the second server and send one or more first
Data;Wherein, the Timing Synchronization request carries the data renewal temporal information;
Asked to send real time data synchronization request to the second server according to a preset data, receive the second server
Respond one or more second numbers for finding on the second server after the real time data synchronization request and sending
According to.
2. data synchronizing processing method according to claim 1, it is characterised in that the first server is provided with first
Table data store and the second table data store;Methods described also includes:
Second data are inquired about whether in first table data store, when second data are deposited in first data
When in storage table, second data in first table data store are updated;
When second data not in first table data store when, whether inquire about second data in the described second number
According to storage table, when second data are in second table data store, in updating second table data store
Second data;
When second data not in second table data store when, add second data and deposit to second data
Storage table.
3. data synchronizing processing method according to claim 2, it is characterised in that the renewal first data storage
After second data in table, methods described also includes:
Judge that the object that second data are characterized whether there is, if not existing, by second data from described first
Table data store is transferred to second table data store;If existing, not mobile data.
4. data synchronizing processing method according to claim 2, it is characterised in that the renewal second data storage
Before in table after second data of storage, methods described also includes:
Judge that the object that second data are characterized whether there is, if existing, by second data from the described second number
First table data store is transferred to according to storage table;If not existing, not mobile data.
5. data synchronizing processing method according to claim 1, it is characterised in that the first server is provided with first
Table data store and the second table data store;Methods described also includes:
By in the first table data store described in first data Cun Chudao, and check whether deposited in first table data store
In usage frequency less than the 3rd data of preset value, if existing, the 3rd data are moved to into second data storage
In table.
6. a kind of data synchronization processing device, is applied to a first server, it is characterised in that described device includes:
Data timing synchronization module, for sending a data timing synchronization request to a second server, receives second clothes
Business device responded and found simultaneously on the second server according to data renewal temporal information after the data timing synchronization request
The data of one or more for sending first;Wherein, the Timing Synchronization request carries the data renewal temporal information;
Real time data synchronization module, for being asked to be asked to second server transmission real time data synchronization according to a preset data
Ask, receive and find and send on the second server after the second server response real time data synchronization request
One or more second data come.
7. data synchronization processing device according to claim 6, it is characterised in that the first server is provided with the first number
According to storage table and the second table data store;Described device also includes:
First inquiry update module, for inquiring about second data whether in first table data store, when described the
When two data are in first table data store, second data in first table data store are updated;
Second inquiry update module, for when second data not in first table data store when, inquire about described the
Whether two data, when second data are in second table data store, update in second table data store
Second data in second table data store;
Data add module, for when second data not in second table data store when, add it is described second number
According to second table data store.
8. data synchronization processing device according to claim 7, it is characterised in that described device also includes:
First judges shift module, for after second data updated in first table data store, sentencing
The object that second data of breaking are characterized whether there is, if not existing, second data be deposited from first data
Storage table is transferred to second table data store;If existing, not mobile data.
9. data synchronization processing device according to claim 7, it is characterised in that described device also includes:
Second judges shift module, for second data stored before described renewal in second table data store
Afterwards, judge that the object that second data are characterized whether there is, if existing, by second data from the described second number
First table data store is transferred to according to storage table;If not existing, not mobile data.
10. data synchronization processing device according to claim 6, it is characterised in that the first server is provided with
One table data store and the second table data store;Described device also includes:
3rd judges shift module, for by the first table data store described in first data Cun Chudao, and checks described
The 3rd data of preset value are less than in first table data store with the presence or absence of usage frequency, if existing, by the 3rd data
In being moved to second table data store.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710005137.XA CN106657376B (en) | 2017-01-04 | 2017-01-04 | Data synchronization processing method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710005137.XA CN106657376B (en) | 2017-01-04 | 2017-01-04 | Data synchronization processing method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106657376A true CN106657376A (en) | 2017-05-10 |
CN106657376B CN106657376B (en) | 2020-08-28 |
Family
ID=58842524
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710005137.XA Active CN106657376B (en) | 2017-01-04 | 2017-01-04 | Data synchronization processing method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106657376B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107679195A (en) * | 2017-10-09 | 2018-02-09 | 杭州安恒信息技术有限公司 | Half master-slave database synchronous method and system based on the transmission of HTTPS agreements |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101008908A (en) * | 2006-01-25 | 2007-08-01 | 联想(北京)有限公司 | Synchronous data copy system and method |
CN102207978A (en) * | 2011-06-30 | 2011-10-05 | 北京新媒传信科技有限公司 | Database access method and system |
US20110302327A1 (en) * | 2010-06-07 | 2011-12-08 | Salesforce.Com, Inc. | System, method and computer program product for performing a synchronization of data |
CN104580454A (en) * | 2014-12-31 | 2015-04-29 | 乐视网信息技术(北京)股份有限公司 | Data synchronizing method, device and system |
CN104598623A (en) * | 2015-02-03 | 2015-05-06 | 东南大学 | Comprehensive sensing network stratified data management system |
CN105956139A (en) * | 2016-05-12 | 2016-09-21 | 国电南瑞科技股份有限公司 | Method for synchronizing database in two machines |
-
2017
- 2017-01-04 CN CN201710005137.XA patent/CN106657376B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101008908A (en) * | 2006-01-25 | 2007-08-01 | 联想(北京)有限公司 | Synchronous data copy system and method |
US20110302327A1 (en) * | 2010-06-07 | 2011-12-08 | Salesforce.Com, Inc. | System, method and computer program product for performing a synchronization of data |
CN102207978A (en) * | 2011-06-30 | 2011-10-05 | 北京新媒传信科技有限公司 | Database access method and system |
CN104580454A (en) * | 2014-12-31 | 2015-04-29 | 乐视网信息技术(北京)股份有限公司 | Data synchronizing method, device and system |
CN104598623A (en) * | 2015-02-03 | 2015-05-06 | 东南大学 | Comprehensive sensing network stratified data management system |
CN105956139A (en) * | 2016-05-12 | 2016-09-21 | 国电南瑞科技股份有限公司 | Method for synchronizing database in two machines |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107679195A (en) * | 2017-10-09 | 2018-02-09 | 杭州安恒信息技术有限公司 | Half master-slave database synchronous method and system based on the transmission of HTTPS agreements |
Also Published As
Publication number | Publication date |
---|---|
CN106657376B (en) | 2020-08-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10740352B2 (en) | Cooperative naming for configuration items in a distributed configuration management database environment | |
CN103019960B (en) | Distributed caching method and system | |
CN104090889B (en) | Data processing method and system | |
CN102521712B (en) | A kind of process instance data processing method and device | |
US11822540B2 (en) | Data read method and apparatus, computer device, and storage medium | |
CN104601680B (en) | A kind of method for managing resource and device | |
CN101771723A (en) | Data synchronization method | |
CN107547606B (en) | Data processing method, cluster manager, resource manager and data processing system | |
CN107247758B (en) | Data processing method based on bank core system | |
CN106934048A (en) | Online data moving method, agent node | |
EP2380090B1 (en) | Data integrity in a database environment through background synchronization | |
CN110727738B (en) | Global routing system based on data fragmentation, electronic equipment and storage medium | |
CN104809130A (en) | Method, equipment and system for data query | |
CN108319617A (en) | Determine the method, apparatus and method for handover control, device of database principal and subordinate's difference | |
CN103533023A (en) | Cloud service application cluster synchronization system and synchronization method based on cloud service characteristics | |
CN109325056A (en) | A kind of big data processing method and processing device, communication equipment | |
CN109254981A (en) | A kind of data managing method and device of distributed cache system | |
CN103607418A (en) | Large-scale data partitioning system and partitioning method based on cloud service data characteristics | |
CN101778131A (en) | Data synchronization system | |
US20210064473A1 (en) | Method and device for failover in hbase system, and non-transitory computer-readable storage medium | |
CN1271812C (en) | Wireless facility synchronizing system and method | |
CN114185991A (en) | Method and related device for realizing data synchronization based on distributed database | |
CN101789963A (en) | Data synchronization system | |
EP3061011B1 (en) | Method for optimizing index, master database node and subscriber database node | |
CN106250501A (en) | Report processing method and reporting system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |