CN110019062A - Method of data synchronization and system - Google Patents
Method of data synchronization and system Download PDFInfo
- Publication number
- CN110019062A CN110019062A CN201710694394.9A CN201710694394A CN110019062A CN 110019062 A CN110019062 A CN 110019062A CN 201710694394 A CN201710694394 A CN 201710694394A CN 110019062 A CN110019062 A CN 110019062A
- Authority
- CN
- China
- Prior art keywords
- log
- database
- sequence numbers
- synchronized
- journal queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Present disclose provides a kind of method of data synchronization, applied to primary database and from the Database Systems of database schema, which comprises obtain the operational order to the primary database；Log is generated, the log includes the write operation order and corresponding log-sequence numbers；The log is stored in the first journal queue；Corresponding log is obtained from first journal queue according to from the current log-sequence numbers to be synchronized of database, wherein, described successively to realize from database root according to the sequence of the log-sequence numbers synchronous with the data of the primary database, the current log-sequence numbers to be synchronized are used to indicate the next log to be synchronized from database；The log acquired described in parsing executes the corresponding operational order of the log from database to described.
Description
Technical field
This disclosure relates to field of computer technology, more particularly, to a kind of method of data synchronization method and a kind of data
Synchronization system.
Background technique
With the fast development of computer technology, the data volume stored in database is increasing.In database server
In the case where disposing framework with principal and subordinate, primary database and it should be consistent from the data in database.
Realize that the data of master-slave database are synchronous usually using the methods of full dose duplication or incremental replication in the prior art.
For example, when replacing primary database or alreading exceed primary database log range from the synchronization log of database, using full dose
Clone method；Shorter in master-slave database turn-off time, data volume update is smaller, is not above master from the synchronization log of database
When database journal range, using incremental replication method.
During realizing present inventive concept, at least there are the following problems in the prior art for inventor's discovery, and full dose is multiple
For system when data volume is larger, elapsed time is longer, and cannot externally provide service during replicating.When replacing primary database,
Full dose duplication will be carried out from database by belonging to the multiple of same system, be resulted in waste of resources.
Summary of the invention
In view of this, present disclose provides a kind of method of data synchronization of optimization and systems.
An aspect of this disclosure provides a kind of method of data synchronization, is applied to primary database and from database frame
The Database Systems of structure, which comprises obtain the operational order to the primary database, generate log, the log packet
The write operation order and corresponding log-sequence numbers are included, the log is stored in the first journal queue, according to from data
The current log-sequence numbers to be synchronized in library obtain corresponding log from first journal queue, wherein described from database
, the current to be synchronized log sequence synchronous with the data of the primary database is successively realized according to the sequence of the log-sequence numbers
Number be used to indicate the next log to be synchronized from database, and the log acquired described in parsing, to it is described from
Database executes the operational order.
In accordance with an embodiment of the present disclosure, aforesaid operations order includes write operation order, and the write operation order includes writing
Enter the first data of the primary database, it is described to execute the corresponding operational order packet of the corresponding log from database to described
It includes: first data write-in is described from database.
In accordance with an embodiment of the present disclosure, above-mentioned first journal queue uses when the log quantity of storage is more than preset threshold
The operating mode of first in first out.
In accordance with an embodiment of the present disclosure, the above method further include: the log is stored in the second journal queue, it is described
The access speed of second journal queue is less than the access speed of first journal queue, judges from the current to be synchronized of database
Log-sequence numbers whether there is in first journal queue, and in the current log sequence to be synchronized from database
When number being not present in first journal queue, obtained from second journal queue and the current log to be synchronized
The corresponding log of serial number.
In accordance with an embodiment of the present disclosure, above-mentioned basis is from the current log-sequence numbers to be synchronized of database from described first day
Corresponding log is obtained in will queue, comprising: be present in described from the current log-sequence numbers to be synchronized of database described
When in one journal queue, log corresponding with the currently log-sequence numbers to be synchronized is obtained from first journal queue.
In accordance with an embodiment of the present disclosure, the above method further include: to it is described from database execute the operational order it
Afterwards, the current log-sequence numbers to be synchronized from database are updated.
In accordance with an embodiment of the present disclosure, the above method is when with multiple Database Systems, in which: the log is also
System banner including Database Systems belonging to the primary database, it is described according to from the current to be synchronized of database
Log-sequence numbers obtain corresponding log from first journal queue, comprising: according to it is described from database belonging to database
System banner and the current log-sequence numbers to be synchronized obtain corresponding log from first journal queue.
Another aspect of the disclosure provides a kind of data synchronous system, is applied to primary database and from database
The Database Systems of framework, the system comprises: first obtains module, log generation module, the first memory module, the second acquisition
Module and synchronization module.Wherein, first module acquisition is obtained to the operational order of the primary database.Log generation module is raw
At log, the log includes the write operation order and corresponding log-sequence numbers.First memory module deposits the log
Storage is in the first journal queue.Second obtains module according to from the current log-sequence numbers to be synchronized of database from described first day
Corresponding log is obtained in will queue, wherein it is described from database root according to the sequence of the log-sequence numbers successively realize with it is described
The data of primary database are synchronous, the current log-sequence numbers to be synchronized be used to indicate it is described to be synchronized from database it is next
Log.Synchronization module parses the obtained log, executes the operational order from database to described.
In accordance with an embodiment of the present disclosure, aforesaid operations order includes write operation order, and the write operation order includes writing
Enter the first data of the primary database, it is described to execute the corresponding operational order packet of the corresponding log from database to described
It includes: first data write-in is described from database.
In accordance with an embodiment of the present disclosure, above-mentioned first journal queue uses when the log quantity of storage is more than preset threshold
The operating mode of first in first out.
In accordance with an embodiment of the present disclosure, above system further include: the second memory module, judgment module and third obtain
Module.Wherein, the log is stored in the second journal queue by the second memory module, the access speed of second journal queue
Degree is less than the access speed of first journal queue.Judgment module judges
It is no to be present in first journal queue.Third obtain module the current log-sequence numbers to be synchronized from database not
When being present in first journal queue, obtained from second journal queue and the current log-sequence numbers to be synchronized
Corresponding log.
In accordance with an embodiment of the present disclosure, above-mentioned second acquisition module is also used to described from the current to be synchronized of database
When log-sequence numbers are present in first journal queue, from first journal queue obtain with it is described currently it is to be synchronized
The corresponding log of log-sequence numbers.
In accordance with an embodiment of the present disclosure, above system further includes update module.Update module is held to described from database
After the row operational order, the current log-sequence numbers to be synchronized from database are updated.
In accordance with an embodiment of the present disclosure, above system is when with multiple Database Systems, in which: the log is also
System banner including Database Systems belonging to the primary database.It is described according to from the current to be synchronized of database
Log-sequence numbers obtain corresponding log from first journal queue, comprising: according to it is described from database belonging to database
System banner and the current log-sequence numbers to be synchronized obtain corresponding log from first journal queue.
Another aspect of the present disclosure provides a kind of data synchronous system, comprising: one or more processors, storage dress
It sets, for storing one or more programs, wherein when one or more of programs are executed by one or more of processors
When, so that one or more of processors realize method as described above.
Another aspect of the present disclosure provides a kind of computer-readable medium, is stored thereon with executable instruction, the instruction
Processor is set to realize method as described above when being executed by processor.
Another aspect of the present disclosure provides a kind of computer program, and the computer program, which includes that computer is executable, to be referred to
It enables, described instruction is when executed for realizing method as described above.
In accordance with an embodiment of the present disclosure, it can at least partly avoid carrying out master-slave database using the method that full dose replicates
Synchronous problem, and the technical effect for shortening master-slave database synchronization time, improving synchronous efficiency therefore may be implemented.
Detailed description of the invention
By referring to the drawings to the description of the embodiment of the present disclosure, the above-mentioned and other purposes of the disclosure, feature and
Advantage will be apparent from, in the accompanying drawings:
Fig. 1 diagrammatically illustrates the exemplary system frame that can apply method of data synchronization according to the embodiment of the present disclosure
Structure；
Fig. 2 diagrammatically illustrates the flow chart of the method for data synchronization according to the embodiment of the present disclosure；
Fig. 3 diagrammatically illustrates the block diagram of the data synchronous system according to the embodiment of the present disclosure；
Fig. 4 diagrammatically illustrates the box for being adapted for carrying out the synchronous computer system of data according to the embodiment of the present disclosure
Figure.
Specific embodiment
Hereinafter, will be described with reference to the accompanying drawings embodiment of the disclosure.However, it should be understood that these descriptions are only exemplary
, and it is not intended to limit the scope of the present disclosure.In addition, in the following description, descriptions of well-known structures and technologies are omitted, with
Avoid unnecessarily obscuring the concept of the disclosure.
Term as used herein is not intended to limit the disclosure just for the sake of description specific embodiment.Used here as
Word " one ", " one (kind) " and "the" etc. also should include " multiple ", " a variety of " the meaning, unless in addition context clearly refers to
Out.In addition, the terms "include", "comprise" as used herein etc. show the presence of the feature, step, operation and/or component,
But it is not excluded that in the presence of or add other one or more features, step, operation or component.
There are all terms (including technical and scientific term) as used herein those skilled in the art to be generally understood
Meaning, unless otherwise defined.It should be noted that term used herein should be interpreted that with consistent with the context of this specification
Meaning, without that should be explained with idealization or excessively mechanical mode.
It, in general should be according to this using statement as " at least one in A, B and C etc. " is similar to
Field technical staff is generally understood the meaning of the statement to make an explanation (for example, " system at least one in A, B and C "
Should include but is not limited to individually with A, individually with B, individually with C, with A and B, with A and C, have B and C, and/or
System etc. with A, B, C).Using statement as " at least one in A, B or C etc. " is similar to, generally come
Saying be generally understood the meaning of the statement according to those skilled in the art to make an explanation (for example, " having in A, B or C at least
One system " should include but is not limited to individually with A, individually with B, individually with C, with A and B, have A and C, have
B and C, and/or the system with A, B, C etc.).It should also be understood by those skilled in the art that substantially arbitrarily indicating two or more
The adversative conjunction and/or phrase of optional project shall be construed as either in specification, claims or attached drawing
A possibility that giving including one of these projects, either one or two projects of these projects.For example, phrase " A or B " should
A possibility that being understood to include " A " or " B " or " A and B ".
Embodiment of the disclosure provides a kind of method of data synchronization and can apply the data synchronous system of this method,
Applied to primary database and from the Database Systems of database schema.This method comprises: obtaining to the primary database
Operational order generates log, and the log includes the write operation order and corresponding log-sequence numbers, and the log is stored
In the first journal queue, phase is obtained from first journal queue according to from the current log-sequence numbers to be synchronized of database
The log answered, wherein described successively to be realized and the data of the primary database from database root according to the sequence of the log-sequence numbers
Synchronous, the current log-sequence numbers to be synchronized are used to indicate the next log to be synchronized from database, and parsing
The log acquired executes the operational order from database to described.
Fig. 1 diagrammatically illustrates the exemplary system architecture that can apply method of data synchronization according to the embodiment of the present disclosure
100。
As shown in Figure 1, system architecture 100 may include terminal device 101,102,103, network according to this embodiment
104 and server 105.Network 104 between terminal device 101,102,103 and server 105 to provide communication link
Medium.Network 104 may include various connection types, such as wired, wireless communication link or fiber optic cables etc..
User can be used terminal device 101,102,103 and be interacted by network 104 with server 105, to receive or send out
Send message etc..
Terminal device 101,102,103 can be with display screen and support that data are transmitted and the various electronics of read-write are set
It is standby, including but not limited to smart phone, tablet computer, pocket computer on knee and desktop computer etc..
Server 105 can be to provide the server of various services, such as utilize terminal device 101,102,103 to user
The website browsed provides the back-stage management server (merely illustrative) supported.Back-stage management server can be to the use received
The data such as family request analyze etc. processing, and by processing result (such as according to user's request or the webpage of generation, believe
Breath or data etc.) feed back to terminal device.
It should be noted that method of data synchronization provided by the embodiment of the present disclosure can generally be executed by server 105.
Correspondingly, data synchronous system provided by the embodiment of the present disclosure generally can be set in server 105.The embodiment of the present disclosure
Provided method of data synchronization can also by be different from server 105 and can with terminal device 101,102,103 and/or clothes
The server or server cluster that business device 105 communicates execute.Correspondingly, data synchronous system provided by the embodiment of the present disclosure
It can be set in the service that is different from server 105 and can be communicated with terminal device 101,102,103 and/or server 105
In device or server cluster.Alternatively, method of data synchronization provided by the embodiment of the present disclosure can also by terminal device 101,
102 or 103 execute, or can also be executed by being different from 101,102 or 103 other terminal devices of terminal device.Correspondingly,
Data synchronous system provided by the embodiment of the present disclosure also can be set in terminal device 101,102 or 103, or be set to
Different from other terminal devices of terminal device 101,102 or 103.
For example, Database Systems are stored in one or more database servers.In terminal device 101,102 or 103
Any one (for example, terminal device 101, but not limited to this) receive user to the write operation requests of primary database, then eventually
End equipment 101 can be performed locally method of data synchronization provided by the embodiment of the present disclosure, which is generated log
It is stored in the first journal queue, and the data under corresponding log-sequence numbers is written from database.Or terminal device 101 exists
After user is received to the write operation requests of primary database, other terminal devices, server or clothes are sent by write operation requests
Business device cluster, and other terminal devices, server or server cluster by receiving the operation requests are implemented to execute the disclosure
Write operation generation log is stored in the first journal queue by method of data synchronization provided by example, and by corresponding day
Data under will serial number are written from database.Or terminal device 101 is receiving user to the write operation requests of primary database
Afterwards, any one is sent by the operation requests to be stored in the database server of the Database Systems, write behaviour by receiving this
Make the database server requested to execute method of data synchronization provided by the embodiment of the present disclosure.
It should be understood that the number of terminal device, network and server in Fig. 1 is only schematical.According to realization need
It wants, can have any number of terminal device, network and server.
Below with reference to the system architecture of Fig. 1, it is described with reference to Figure 2 synchronous according to the data of disclosure illustrative embodiments
Method.It should be noted that above system framework is merely for convenience of understanding the spirit of the disclosure and principle and showing, the disclosure
Embodiment it is unrestricted in this regard.On the contrary, embodiment of the present disclosure can be applied to applicable system architecture.
The embodiment of the present disclosure provides a kind of method of data synchronization.
Fig. 2 diagrammatically illustrates the flow chart of the method for data synchronization according to the embodiment of the present disclosure.
As shown in Fig. 2, this method includes operation S201~S209, this method be can be applied to primary database and from number
According to the Database Systems of library framework.
According to the embodiment of the present disclosure, when Database Systems are the system of client/server, a Database Systems are usually wrapped
Include a primary database and at least one from database, belong to the primary database of same Database Systems and from database
Data should be consistent, that is, should be synchronous with master data holding from database when the data in primary database change.
The synchronous method of the data that the embodiment of the present disclosure provides can be used for a Database Systems, can be used for multiple data base sets
System.
Specifically, in operation S201, the operational order to primary database is obtained.In the embodiments of the present disclosure, operational order
Including the operational order changed to the data in primary database, such as the operation such as can be increase, modification, deletion.
According to the embodiment of the present disclosure, the operational order to primary database includes write operation order, wherein write operation order packet
Include the first data of primary database to be written.Write operation order can be first data new to primary database write-in, can also be with
It is to replace original a certain data with the first data.
In operation S202, log is generated according to the operational order that acquires, wherein log include the operational order and
Corresponding log-sequence numbers.
According to the embodiment of the present disclosure, the operational order that will acquire is packaged into log, includes that the operation is ordered in the log
Order and corresponding log-sequence numbers.That is, recording at least one modification information for being directed to master data in each log.Log-sequence numbers are for example
It can be incremented by successively, for example, currently the log-sequence numbers of existing log are 10, then the log-sequence numbers of the next log generated can
Think 11.Log for example may include: { 11 (log-sequence numbers), write operation (action type), the first data (number to be written
According to).
It can also include belonging to the master data that is directed to of operational order with multiple Database Systems, in log
Database Systems system banner.In the embodiments of the present disclosure, each Database Systems can have unique system banner, often
May include in a Database Systems a primary database and at least one from database, belong to the one of a Database Systems
A primary database and at least one from database system banner having the same.Log-sequence numbers can be under each Database Systems
It is incremented by successively, for example, the log-sequence numbers of Database Systems A can be the log of Database Systems B incremented by successively 1 since 0
Serial number is also possible to incremented by successively 1 since 0.Log for example may include: that { A (system banner), 11 (log-sequence numbers), writes behaviour
Make (action type), the first data (data to be written) }.
In operation S203, generated log is stored in the first journal queue.
According to the embodiment of the present disclosure, the first journal queue be can store in memory, and the first journal queue can have capacity
Limitation, such as the log quantity being stored in the first journal queue is no more than preset threshold, is more than default threshold in log quantity
When value, the first journal queue uses the operating mode of first in first out, that is, the new log into the first journal queue can replace most
The log of advanced enqueue.
In the embodiments of the present disclosure, the first journal queue is stored in memory, the access speed of log can be accelerated, but
It is since memory headroom is valuable, there is capacity limit in the first journal queue in the embodiment of the present disclosure and using first in first out
Operating mode, guarantee to be stored with newest log information in the first journal queue, and be not take up excessive memory.
First journal queue can store log by the way of the array of regular length, such as array length is 4 (a0、
a1、a2、a3), then a0The log that lower storage log-sequence numbers are 0, a1The log that lower storage log-sequence numbers are 1, a2Lower storage log sequence
Number be 2 log, a3The log that lower storage log-sequence numbers are 3, when the log of log serial number 4 enters the first journal queue
When, then replace a0In No. 0 log originally storing.
According to the embodiment of the present disclosure, with multiple Database Systems, the log of same system mark can be with
It is stored together, for example, the log for belonging to Database Systems A is stored in array [an] in, the log for belonging to Database Systems B is deposited
Storage is in array [bn] in.
It is appreciated that when only storing a part of newest log information in the first journal queue, if a certain from database
Renewal speed it is slower, then can lose some log informations being extruded, therefore the embodiment of the present disclosure further includes operation S204.
In operation S204, log is stored in the second journal queue.Wherein, the access speed of the second journal queue is less than
The storage speed of first journal queue.
According to the embodiment of the present disclosure, the second journal queue can not have capacity limit, then every log can be in second day
Persistent storage is carried out in will queue.Second journal queue can also have capacity limit, but the capacity of the second journal queue can
To be greater than the capacity of the first journal queue, to store more log informations.
In the embodiments of the present disclosure, log is stored in the second journal queue, is can be after generating log, by the log
It is stored in the first journal queue and the second journal queue, is also possible to deposit the log of from the first journal queue " extrusion "
Storage is in the second journal queue.
According to the embodiment of the present disclosure, the log in the second journal queue can store in the form of a file, in each file
The log of fixed quantity is stored, for example, storing 100 logs in each file, then the file for storing log-sequence numbers 0~99 can be with
It is named as 0, the file of storage log-sequence numbers 100~199 can be named as 1, convenient for searching.
With multiple Database Systems, the log of same system mark be can store together, for example, belonging to
It is stored in file A in the log of Database Systems A, the log for belonging to Database Systems B is stored in file B.
It, can be with although the second journal queue in the embodiment of the present disclosure is slow compared to first journal queue's access speed
More log contents are stored, are lost in order to avoid not being updated synchronous log also from database.
In operation S205, judge to whether there is from the current log-sequence numbers to be synchronized of database in the first journal queue
In.Wherein, current to be synchronized day synchronous with the data of primary database is successively realized according to the sequence of log-sequence numbers from database root
Will serial number is used to indicate the next log to be synchronized from database.
According to the embodiment of the present disclosure, judging to whether there is from the current log-sequence numbers to be synchronized of database on 1st
It can also include: to issue to request from database before in will queue, with current log-sequence numbers to be synchronized in the request.According to
The embodiment of the present disclosure, after operation corresponding from the upper log-sequence numbers of database completion, activly request obtains to be synchronized next
The corresponding log of log-sequence numbers, it is synchronous with the data of primary database to realize.It can be subtracted by actively issuing request from database
Few time delay, each from data after the completing oneself of the task, direct activly request obtains the log of next step, can save
Time, and each may be implemented not synchronize same content simultaneously from database.It, can also be with it is appreciated that in addition to the above method
It is whether the data synchronous system active detecting of the embodiment of the present disclosure completes the corresponding operation of a upper log-sequence numbers from database, if
It is completed, it is determined that should be from the current log-sequence numbers to be synchronized of database.
In the embodiments of the present disclosure, after determining current log-sequence numbers to be synchronized, according to the current log sequence to be synchronized
Number judge in the first journal queue with the presence or absence of the log to be synchronized.
It, can be according to current to be synchronized when the first journal queue stores log by the way of the array of regular length
Log-sequence numbers calculate array index, judge the log stored in the corresponding array of the subscript log-sequence numbers whether with currently to same
The log-sequence numbers of the log of step are consistent.When array length be 2 Nth power when, the calculation formula of array index can be (currently to
The log-sequence numbers of synchronous log) & (array length -1), for example, current log-sequence numbers to be synchronized are that 4 (log-sequence numbers are since 0
It is incremented by successively 1), array length 4, then array index=(0100) & (0011)=0000=0, then judge a0The day of middle storage
Whether the log-sequence numbers of will are 4, and indicating the current log-sequence numbers to be synchronized if 4, there are in the first journal queue.Work as array
When length is not 2 Nth power, the calculation formula of array index can be current log-sequence numbers to be synchronized and array length complementation
Number, for example, current log-sequence numbers to be synchronized are 4 (log-sequence numbers 1) incremented by successively since 0, array lengths 3, then under array
Mark=4mod 3=1, then judge a1Whether the log-sequence numbers of middle storage are 4, indicate the current log-sequence numbers to be synchronized if 4
There are in the first journal queue.
With multiple Database Systems, according to it is to be synchronized from database belonging to Database Systems mark
And current log-sequence numbers to be synchronized judge in the first journal queue with the presence or absence of the log to be synchronized.
If current log-sequence numbers to be synchronized are present in the first journal queue, execute operation S206 and otherwise execute behaviour
Make S207.
In operation S206, obtained from the first journal queue accordingly according to the current log-sequence numbers to be synchronized from database
Log.
In the embodiments of the present disclosure, however, it is determined that first should be present in from the log-sequence numbers of database currently log to be synchronized
In journal queue, then the log is obtained from the first journal queue.
In operation S207, obtained from the second journal queue accordingly according to the current log-sequence numbers to be synchronized from database
Log.
According to the embodiment of the present disclosure, however, it is determined that the should be not present in from the log-sequence numbers of database currently log to be synchronized
In one journal queue, then the log is obtained from the second journal queue.
In the embodiments of the present disclosure, when the log in the second journal queue stores in the form of a file, and each file
When the log of middle storage fixed quantity, it can first determine which file is current log-sequence numbers to be synchronized belong to, then in this document
Pass through binary search to corresponding log down.For example, current log-sequence numbers to be synchronized are 125, determine that the serial number belongs to file
Then entitled 1 file passes through binary search to corresponding log under this document.
In operation S208, the log acquired is parsed, executes the corresponding operational order of the log to from database.
According to the embodiment of the present disclosure, the current log to be synchronized of acquisition is parsed, obtains corresponding operation order, for example,
It can be and the operation such as add, modify or delete, executing identical operational order to from database.For example, operational order is
When write operation order, write first data into from data.
In operation S209, the current log-sequence numbers to be synchronized from data are updated.
It is updated current after operational order corresponding from the upper log of database completion according to the embodiment of the present disclosure
Log-sequence numbers to be synchronized.
Embodiment of the disclosure, by will be stored in journal queue to the operational order of primary database, so that from data
Library can obtain the modification information of primary database from the journal queue and synchronize the modification information, thus realization and primary database
Synchronization.That is, only synchronizing the modification information that primary database generates from database, full dose duplication is avoided, to save synchronization
Time improves data synchronization efficiency.
Also, the embodiment of the present disclosure uses the first journal queue and the second journal queue and stores log information, and first day
It stores newer log information in will queue, and there is faster access speed, can be improved the synchronous efficiency of data, second
More full log information is stored in journal queue, it can be to avoid the loss of master data modification information.
Fig. 3 diagrammatically illustrates the block diagram of the data synchronous system 300 according to the embodiment of the present disclosure.
As shown in figure 3, data synchronous system 300 includes the first acquisition module 310, the storage of log generation module 320, first
Module 330, second obtains module 340, synchronization module 350, the second memory module 360, judgment module 370, third and obtains module
380 and update module 390.
Specifically, first the acquisition of module 310 is obtained to the operational order of primary database.According to the embodiment of the present disclosure, first
The operation S201 described above with reference to Fig. 2 can for example be executed by obtaining module 310, and details are not described herein.
Log generation module 320 generates log according to the operational order acquired, wherein log includes the operational order
And corresponding log-sequence numbers.According to the embodiment of the present disclosure, log generation module 320 can for example be executed and be retouched above with reference to Fig. 2
The operation S202 stated, details are not described herein.
Generated log is stored in the first journal queue by the first memory module 330.According to the embodiment of the present disclosure,
One memory module 330 can for example execute the operation S203 above with reference to Fig. 2 description, and details are not described herein.
Second acquisition module 340 is obtained from the first journal queue according to from the current log-sequence numbers to be synchronized of database
Corresponding log.In the embodiments of the present disclosure, however, it is determined that should be present in from the log-sequence numbers of database currently log to be synchronized
In first journal queue, then the log is obtained from the first journal queue.Module 340 is obtained according to the embodiment of the present disclosure, second
Such as the operation S206 described above with reference to Fig. 2 can be executed, details are not described herein.
Synchronization module 350 parses the log acquired, executes the corresponding operational order of the log to from database.According to
The embodiment of the present disclosure, synchronization module 350 can for example execute the operation S208 above with reference to Fig. 2 description, and details are not described herein.
Log is stored in the second journal queue by the second memory module 360.Wherein, the access speed of the second journal queue
Less than the storage speed of the first journal queue.According to the embodiment of the present disclosure, the second memory module 360 can for example execute ginseng above
The operation S204 of Fig. 2 description is examined, details are not described herein.
Judgment module 370 judges to whether there is from the current log-sequence numbers to be synchronized of database in the first journal queue
In.Wherein, current to be synchronized day synchronous with the data of primary database is successively realized according to the sequence of log-sequence numbers from database root
Will serial number is used to indicate the next log to be synchronized from database.According to the embodiment of the present disclosure, judgment module 370 for example can be with
The operation S205 described above with reference to Fig. 2 is executed, details are not described herein.
Third obtains module 380 and obtains from the second journal queue according to from the current log-sequence numbers to be synchronized of database
Corresponding log.According to the embodiment of the present disclosure, third, which obtains module 380, can for example execute the operation described above with reference to Fig. 2
S207, details are not described herein.
Update module 390 updates the current log-sequence numbers to be synchronized from data.According to the embodiment of the present disclosure, when from data
After the corresponding operational order of a upper log is completed in library, current log-sequence numbers to be synchronized are updated.Update module 390 for example may be used
To execute the operation S209 described above with reference to Fig. 2, details are not described herein.
Embodiment of the disclosure, by will be stored in journal queue to the operational order of primary database, so that from data
Library can obtain the modification information of primary database from the journal queue and synchronize the modification information, thus realization and primary database
Synchronization.That is, only synchronizing the modification information that primary database generates from database, full dose duplication is avoided, to save synchronization
Time improves data synchronization efficiency.
Also, the embodiment of the present disclosure uses the first journal queue and the second journal queue and stores log information, and first day
It stores newer log information in will queue, and there is faster access speed, can be improved the synchronous efficiency of data, second
More full log information is stored in journal queue, it can be to avoid the loss of master data modification information.
It is understood that first obtains module 310, log generation module 320, the acquisition of the first memory module 330, second
Module 340, synchronization module 350, the second memory module 360, judgment module 370, third obtain module 380 and update module
390 may be incorporated in a module and realize or any one module therein can be split into multiple modules.Alternatively,
At least partly function of one or more modules in these modules can be combined at least partly function of other modules, and
It is realized in a module.According to an embodiment of the invention, first obtains module 310, log generation module 320, first stores
Module 330, second obtains module 340, synchronization module 350, the second memory module 360, judgment module 370, third and obtains module
At least one of 380 and update module 390 can at least be implemented partly as hardware circuit, such as field programmable gate
Array (FPGA), programmable logic array (PLA), system on chip, the system on substrate, the system in encapsulation, dedicated integrated electricity
Road (ASIC), or can be realized with carrying out the hardware such as any other rational method that is integrated or encapsulating or firmware to circuit,
Or it is realized with software, the appropriately combined of hardware and firmware three kinds of implementations.Alternatively, first obtains module 310, log life
Module 340 is obtained at module 320, the first memory module 330, second, synchronization module 350, the second memory module 360, judges mould
Block 370, third acquisition at least one of module 380 and update module 390 can at least be implemented partly as computer
Program module can execute the function of corresponding module when the program is run by computer.
Fig. 4 diagrammatically illustrates the box for being adapted for carrying out the synchronous computer system of data according to the embodiment of the present disclosure
Figure.Computer system shown in Fig. 4 is only an example, should not function to the embodiment of the present disclosure and use scope bring and appoint
What is limited.
As shown in figure 4, include processor 401 according to the computer system 400 of the embodiment of the present disclosure, it can be according to storage
It is loaded into random access storage device (RAM) 403 in the program in read-only memory (ROM) 402 or from storage section 408
Program and execute various movements appropriate and processing.Processor 401 for example may include general purpose microprocessor (such as CPU), refer to
Enable set processor and/or related chip group and/or special microprocessor (for example, specific integrated circuit (ASIC)), etc..Processing
Device 401 can also include the onboard storage device for caching purposes.Processor 401 may include describing for executing with reference to Fig. 2
The method flow according to the embodiment of the present disclosure different movements single treatment units either multiple processing units.
In RAM 403, it is stored with system 400 and operates required various programs and data.Processor 401, ROM 402 with
And RAM 403 is connected with each other by bus 404.Processor 401 is held by executing the program in ROM 402 and/or RAM 403
The row various operations synchronous above with reference to the data that Fig. 2 is described.It is noted that described program also can store except ROM 402
In one or more memories other than RAM 403.Processor 401 can also be stored in one or more of by execution
Program in memory executes the synchronous various operations of the data that describe above with reference to Fig. 2.
In accordance with an embodiment of the present disclosure, system 400 can also include input/output (I/O) interface 405, input/output
(I/O) interface 405 is also connected to bus 404.System 400 can also include be connected to I/O interface 405 with one in lower component
Item is multinomial: the importation 406 including keyboard, mouse etc.；Including such as cathode-ray tube (CRT), liquid crystal display (LCD)
Deng and loudspeaker etc. output par, c 407；Storage section 408 including hard disk etc.；And including such as LAN card, modulatedemodulate
Adjust the communications portion 409 of the network interface card of device etc..Communications portion 409 executes communication process via the network of such as internet.
Driver 410 is also connected to I/O interface 405 as needed.Detachable media 411, such as disk, CD, magneto-optic disk, semiconductor
Memory etc. is mounted on as needed on driver 410, in order to be pacified as needed from the computer program read thereon
It is packed into storage section 408.
In accordance with an embodiment of the present disclosure, it may be implemented as computer software journey above with reference to the method for flow chart description
Sequence.For example, embodiment of the disclosure includes a kind of computer program product comprising carry meter on a computer-readable medium
Calculation machine program, the computer program include the program code for method shown in execution flow chart.In such embodiments,
The computer program can be downloaded and installed from network by communications portion 409, and/or be pacified from detachable media 411
Dress.When the computer program is executed by processor 401, the above-mentioned function of limiting in the system of the embodiment of the present disclosure is executed.Root
According to embodiment of the disclosure, system as described above, unit, module, unit etc. can by computer program module come
It realizes.
It should be noted that computer-readable medium shown in the disclosure can be computer-readable signal media or meter
Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not
Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter
The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires
Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.In the disclosure, computer readable storage medium can be it is any include or storage journey
The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this
In open, computer-readable signal media may include in a base band or as the data-signal that carrier wave a part is propagated,
Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited
In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for
By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium
Program code can transmit with any suitable medium, including but not limited to: wireless, electric wire, optical cable, RF etc. are above-mentioned
Any appropriate combination.In accordance with an embodiment of the present disclosure, computer-readable medium may include above-described ROM 402
And/or one or more memories other than RAM 403 and/or ROM 402 and RAM 403.
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule
The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
As on the other hand, the disclosure additionally provides a kind of computer-readable medium, which can be
Included in equipment described in above-described embodiment；It is also possible to individualism, and without in the supplying equipment.Above-mentioned calculating
Machine readable medium carries one or more program, when said one or multiple programs are executed by the equipment, makes
The equipment is obtained to perform the following operations:
It obtains to the operational order of primary database, generates log, the log includes the operational order and corresponding
The log is stored in the first journal queue by log-sequence numbers, according to the current log-sequence numbers to be synchronized from database from
Obtain corresponding log in first journal queue, wherein it is described from database root according to the log-sequence numbers sequence successively
Realization is synchronous with the data of the primary database, and the current log-sequence numbers to be synchronized are used to indicate described same from database
Next log of step, and the log acquired described in parsing execute the operational order from database to described.
In accordance with an embodiment of the present disclosure, aforesaid operations order includes write operation order, and the write operation order includes writing
Enter the first data of the primary database, it is described to execute the corresponding operational order packet of the corresponding log from database to described
It includes: first data write-in is described from database.
In accordance with an embodiment of the present disclosure, above-mentioned first journal queue uses when the log quantity of storage is more than preset threshold
The operating mode of first in first out.
In accordance with an embodiment of the present disclosure, the above method further include: the log is stored in the second journal queue, it is described
The access speed of second journal queue is less than the access speed of first journal queue, judges from the current to be synchronized of database
Log-sequence numbers whether there is in first journal queue, and in the current log sequence to be synchronized from database
When number being not present in first journal queue, obtained from second journal queue and the current log to be synchronized
The corresponding log of serial number.
In accordance with an embodiment of the present disclosure, above-mentioned basis is from the current log-sequence numbers to be synchronized of database from described first day
Corresponding log is obtained in will queue, comprising: be present in described from the current log-sequence numbers to be synchronized of database described
When in one journal queue, log corresponding with the currently log-sequence numbers to be synchronized is obtained from first journal queue.
In accordance with an embodiment of the present disclosure, the above method further include: to it is described from database execute the operational order it
Afterwards, the current log-sequence numbers to be synchronized from database are updated.
In accordance with an embodiment of the present disclosure, the above method is when with multiple Database Systems, in which: the log is also
System banner including Database Systems belonging to the primary database, it is described according to from the current to be synchronized of database
Log-sequence numbers obtain corresponding log from first journal queue, comprising: according to it is described from database belonging to database
System banner and the current log-sequence numbers to be synchronized obtain corresponding log from first journal queue.
Embodiment of the disclosure is described above.But the purpose that these embodiments are merely to illustrate that, and
It is not intended to limit the scope of the present disclosure.Although respectively describing each embodiment above, but it is not intended that each reality
Use cannot be advantageously combined by applying the measure in example.The scope of the present disclosure is defined by the appended claims and the equivalents thereof.It does not take off
From the scope of the present disclosure, those skilled in the art can make a variety of alternatives and modifications, these alternatives and modifications should all fall in this
Within scope of disclosure.
Claims (16)
1. a kind of method of data synchronization, applied to primary database and from the Database Systems of database schema, the method
Include:
Obtain the operational order to the primary database；
Log is generated, the log includes the operational order and corresponding log-sequence numbers；
The log is stored in the first journal queue；
Corresponding log is obtained from first journal queue according to from the current log-sequence numbers to be synchronized of database,
In, it is described successively realized from database root according to the sequence of the log-sequence numbers it is synchronous with the data of the primary database, it is described to work as
Preceding log-sequence numbers to be synchronized are used to indicate the next log to be synchronized from database；
The log acquired described in parsing executes the corresponding operational order of the log from database to described.
2. according to the method described in claim 1, wherein:
The operational order includes write operation order, and the write operation order includes the first number that the primary database is written
According to；
It is described that execute the corresponding operational order of the corresponding log from database include: that institute is written in first data to described
It states from database.
3. according to the method described in claim 1, wherein, first journal queue is more than default threshold in the log quantity of storage
Using the operating mode of first in first out when value.
4. according to the method described in claim 3, further include:
The log is stored in the second journal queue, the access speed of second journal queue is less than first log
The access speed of queue；
Judge to whether there is in first journal queue from the current log-sequence numbers to be synchronized of database；
It is described be not present in first journal queue from the current log-sequence numbers to be synchronized of database when, from described
Log corresponding with the currently log-sequence numbers to be synchronized is obtained in two journal queues.
5. according to the method described in claim 4, wherein, the basis is from the current log-sequence numbers to be synchronized of database from institute
It states and obtains corresponding log in the first journal queue, comprising:
It is described be present in first journal queue from the current log-sequence numbers to be synchronized of database when, from described first
Log corresponding with the currently log-sequence numbers to be synchronized is obtained in journal queue.
6. according to the method described in claim 1, further include:
After to the corresponding operational order from the database execution log, update described from the current to same of database
The log-sequence numbers of step.
7. method described according to claim 1~any one of 6, when with multiple Database Systems, in which:
The log further includes the system banner of Database Systems belonging to the primary database；
The current log-sequence numbers to be synchronized according to from database obtain accordingly from first journal queue
Log, comprising: according to it is described from database belonging to Database Systems mark and the current log-sequence numbers to be synchronized from
Corresponding log is obtained in first journal queue.
8. a kind of data synchronous system, applied to primary database and from the Database Systems of database schema, the system
Include:
First obtains module, obtains the operational order to the primary database；
Log generation module generates log, and the log includes the operational order and corresponding log-sequence numbers；
The log is stored in the first journal queue by the first memory module；
Second obtains module, obtains phase from first journal queue according to from the current log-sequence numbers to be synchronized of database
The log answered, wherein described successively to be realized and the data of the primary database from database root according to the sequence of the log-sequence numbers
Synchronous, the current log-sequence numbers to be synchronized are used to indicate the next log to be synchronized from database；
Synchronization module, the log acquired described in parsing execute the corresponding operational order of the log from database to described.
9. system according to claim 8, in which:
The operational order includes write operation order, and the write operation order includes the first number that the primary database is written
According to；
It is described that execute the corresponding operational order of the corresponding log from database include: that institute is written in first data to described
It states from database.
10. system according to claim 8, wherein first journal queue is more than default in the log quantity of storage
Using the operating mode of first in first out when threshold value.
11. system according to claim 10, further includes:
The log is stored in the second journal queue by the second memory module, and the access speed of second journal queue is small
In the access speed of first journal queue；
Judgment module judges to whether there is in first journal queue from the current log-sequence numbers to be synchronized of database；
Third obtains module, is not present in first journal queue from the current log-sequence numbers to be synchronized of database described
When middle, log corresponding with the currently log-sequence numbers to be synchronized is obtained from second journal queue.
12. system according to claim 11, wherein the second acquisition module is also used to:
It is described be present in first journal queue from the current log-sequence numbers to be synchronized of database when, from described first
Log corresponding with the currently log-sequence numbers to be synchronized is obtained in journal queue.
13. system according to claim 8, further includes:
Update module updates described from database after to the corresponding operational order from the database execution log
Current log-sequence numbers to be synchronized.
14. the system according to any one of claim 8~13, when with multiple Database Systems, in which:
The log further includes the system banner of Database Systems belonging to the primary database；
The current log-sequence numbers to be synchronized according to from database obtain accordingly from first journal queue
Log, comprising: according to it is described from database belonging to Database Systems mark and the current log-sequence numbers to be synchronized from
Corresponding log is obtained in first journal queue.
15. a kind of data synchronous system, comprising:
One or more processors；
Storage device, for storing one or more programs,
Wherein, when one or more of programs are executed by one or more of processors, so that one or more of
Processor realizes method according to any one of claims 1 to 7.
16. a kind of computer-readable medium, is stored thereon with executable instruction, which makes processor real when being executed by processor
Existing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710694394.9A CN110019062A (en) | 2017-08-14 | 2017-08-14 | Method of data synchronization and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710694394.9A CN110019062A (en) | 2017-08-14 | 2017-08-14 | Method of data synchronization and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110019062A true CN110019062A (en) | 2019-07-16 |
Family
ID=67186114
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710694394.9A Pending CN110019062A (en) | 2017-08-14 | 2017-08-14 | Method of data synchronization and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110019062A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110941623A (en) * | 2019-11-12 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Data synchronization method and device |
| CN111026755A (en) * | 2019-12-06 | 2020-04-17 | 中国银行股份有限公司 | Transaction serial number obtaining method and device based on full-quantity serial number generator |
| CN112732728A (en) * | 2019-10-28 | 2021-04-30 | 北京京东尚科信息技术有限公司 | Data synchronization method and system |
| CN113010607A (en) * | 2021-04-06 | 2021-06-22 | 工银科技有限公司 | Method, device, computer system and storage medium for data synchronization between systems |
| CN113177093A (en) * | 2021-05-24 | 2021-07-27 | 商汤国际私人有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN113553382A (en) * | 2021-08-06 | 2021-10-26 | 上海达梦数据库有限公司 | Data page disk refreshing method, device, equipment and storage medium |
| WO2022142665A1 (en) * | 2020-12-28 | 2022-07-07 | 深圳壹账通智能科技有限公司 | Database cluster-based data processing method and apparatus, and electronic device |
| CN114780634A (en) * | 2022-03-01 | 2022-07-22 | 广州思创科技股份有限公司 | Real-time database synchronization method and device and storage medium |
| CN115905155A (en) * | 2023-01-05 | 2023-04-04 | 天津南大通用数据技术股份有限公司 | Parallel transmission method for logic log synchronization |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101464890A (en) * | 2008-12-30 | 2009-06-24 | 中兴通讯股份有限公司 | Mixed log generation method and resolution method |
| US20120143820A1 (en) * | 2008-07-22 | 2012-06-07 | International Business Machines Corporation | Embedded change logging for data synchronization |
| CN105159795A (en) * | 2015-08-21 | 2015-12-16 | 小米科技有限责任公司 | Data synchronization method, apparatus and system |
| CN105354113A (en) * | 2015-11-27 | 2016-02-24 | 上海爱数信息技术股份有限公司 | Server, and system and method for managing server |
| CN107026880A (en) * | 2016-02-01 | 2017-08-08 | 北京京东尚科信息技术有限公司 | Method of data synchronization and device |
-
2017
- 2017-08-14 CN CN201710694394.9A patent/CN110019062A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120143820A1 (en) * | 2008-07-22 | 2012-06-07 | International Business Machines Corporation | Embedded change logging for data synchronization |
| CN101464890A (en) * | 2008-12-30 | 2009-06-24 | 中兴通讯股份有限公司 | Mixed log generation method and resolution method |
| CN105159795A (en) * | 2015-08-21 | 2015-12-16 | 小米科技有限责任公司 | Data synchronization method, apparatus and system |
| CN105354113A (en) * | 2015-11-27 | 2016-02-24 | 上海爱数信息技术股份有限公司 | Server, and system and method for managing server |
| CN107026880A (en) * | 2016-02-01 | 2017-08-08 | 北京京东尚科信息技术有限公司 | Method of data synchronization and device |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112732728A (en) * | 2019-10-28 | 2021-04-30 | 北京京东尚科信息技术有限公司 | Data synchronization method and system |
| CN110941623A (en) * | 2019-11-12 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Data synchronization method and device |
| CN111026755A (en) * | 2019-12-06 | 2020-04-17 | 中国银行股份有限公司 | Transaction serial number obtaining method and device based on full-quantity serial number generator |
| CN111026755B (en) * | 2019-12-06 | 2023-05-02 | 中国银行股份有限公司 | Transaction sequence number acquisition method and device based on full sequence number generator |
| WO2022142665A1 (en) * | 2020-12-28 | 2022-07-07 | 深圳壹账通智能科技有限公司 | Database cluster-based data processing method and apparatus, and electronic device |
| CN113010607A (en) * | 2021-04-06 | 2021-06-22 | 工银科技有限公司 | Method, device, computer system and storage medium for data synchronization between systems |
| CN113177093A (en) * | 2021-05-24 | 2021-07-27 | 商汤国际私人有限公司 | Data synchronization method and device, electronic equipment and storage medium |
| CN113553382A (en) * | 2021-08-06 | 2021-10-26 | 上海达梦数据库有限公司 | Data page disk refreshing method, device, equipment and storage medium |
| CN113553382B (en) * | 2021-08-06 | 2023-06-02 | 上海达梦数据库有限公司 | Method, device, equipment and storage medium for brushing data pages |
| CN114780634A (en) * | 2022-03-01 | 2022-07-22 | 广州思创科技股份有限公司 | Real-time database synchronization method and device and storage medium |
| CN115905155A (en) * | 2023-01-05 | 2023-04-04 | 天津南大通用数据技术股份有限公司 | Parallel transmission method for logic log synchronization |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110019062A (en) | Method of data synchronization and system | |
| CN109189835B (en) | Method and device for generating data wide table in real time | |
| CN108920698B (en) | Data synchronization method, device, system, medium and electronic equipment | |
| US11468013B2 (en) | Prioritizing content item synchronization based on sharing | |
| CN109413127A (en) | A kind of method of data synchronization and device | |
| US11074225B2 (en) | Synchronization of index copies in an LSM tree file system | |
| CN109447635B (en) | Information storage method and device for block chain | |
| CN109657174A (en) | Method and apparatus for more new data | |
| CN110704000B (en) | Data processing method, device, electronic equipment and storage medium | |
| CN109150929B (en) | Data request processing method and device under high concurrency scene | |
| CN110019087A (en) | Data processing method and its system | |
| CN109241033A (en) | The method and apparatus for creating real-time data warehouse | |
| CN110019496A (en) | Data read-write method and system | |
| CN110781197B (en) | Hive offline synchronous verification method and device and electronic equipment | |
| CN110019310A (en) | Data processing method and system, computer system, computer readable storage medium | |
| CN111753226A (en) | Page loading method and device | |
| CN112988583A (en) | Method and device for testing syntax compatibility of database | |
| CN111107133A (en) | Generation method of difference packet, data updating method, device and storage medium | |
| CN110020373A (en) | The method and apparatus that static page is stored, browsed | |
| CN113742376A (en) | Data synchronization method, first server and data synchronization system | |
| CN117609226A (en) | Information stream data storage method and device, electronic equipment and readable medium | |
| CN110727694A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN109241040B (en) | Data cleaning method and device | |
| CN110019525A (en) | A kind of method and apparatus of data-base capacity-enlarging | |
| CN111177109A (en) | Method and device for deleting overdue key |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |