CN109446268A - A kind of method of data synchronization and device - Google Patents

A kind of method of data synchronization and device Download PDF

Info

Publication number
CN109446268A
CN109446268A CN201811173931.6A CN201811173931A CN109446268A CN 109446268 A CN109446268 A CN 109446268A CN 201811173931 A CN201811173931 A CN 201811173931A CN 109446268 A CN109446268 A CN 109446268A
Authority
CN
China
Prior art keywords
information
data
execution thread
datalogging
storage equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811173931.6A
Other languages
Chinese (zh)
Inventor
汤成山
陈正
殷舒
刘胜
吴锋海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Union Mobile Pay Co Ltd
Original Assignee
Union Mobile Pay Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Union Mobile Pay Co Ltd filed Critical Union Mobile Pay Co Ltd
Priority to CN201811173931.6A priority Critical patent/CN109446268A/en
Publication of CN109446268A publication Critical patent/CN109446268A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/548Queue

Abstract

The invention discloses a kind of method of data synchronization and devices.The method of data synchronization, comprising: the first storage equipment obtains the record information of the N data in tables of data to be synchronized;N data record information is put into the corresponding isochronous queue of the tables of data to be synchronized by the first storage equipment;The first storage equipment obtains the record identification of every data record information in the isochronous queue;N data record information in the isochronous queue is submitted to M execution thread by the first storage equipment;The datalogging information for submitting to the M execution thread is synchronized to the second storage equipment by the M execution thread by the first storage equipment.

Description

A kind of method of data synchronization and device
Technical field
The present invention relates to database field more particularly to a kind of method of data synchronization and device.
Background technique
In Internet service implementation procedure, often same database is deployed on different hosts.However, due to Business Stream The database (referred to as source database) of the succession of journey, a certain host is first updated, later by the update of the database at it It is synchronous on the corresponding database of his host (target database).How the update of source database to be synchronized to target database in time It is a critical issue.
In the prior art, it has the disadvantage in that 1, synchronize slowly.The efficiency for being synchronized to object library is very low, especially in source data In the case that the data volume of library partial data table is bigger, the synchronous time is longer;2, delay is high.Not due to datalogging information It can be synchronized to target database in time, and mass data is caused to be saved bit by bit, further result in higher synchronization delay, it cannot be real-time Synchrodata records information.
Therefore, how to reduce occur in the prior art synchronize phenomenon slow, that delay is high, be one and urgently to be resolved ask Topic.
Summary of the invention
The embodiment of the invention provides a kind of method of data synchronization, synchronize between database in the prior art for solving Synchronizing for occurring in journey is slow, postpones high problem.
The embodiment of the invention provides a kind of method of data synchronization, comprising:
First storage equipment obtains the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;
N data record information is put into the corresponding synchronous team of the tables of data to be synchronized by the first storage equipment Column;
The first storage equipment obtains the record identification of every data record information in the isochronous queue;
N data record information in the isochronous queue is submitted to M execution line by the first storage equipment Journey;Wherein, the datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;
The first storage equipment will submit to the data record of the M execution thread by the M execution thread Synchronizing information to second storage equipment.
Optionally, the first storage equipment obtains every data record in the isochronous queue by the synchronizing thread The record identification of information, comprising:
The first storage equipment is closed by the synchronizing thread according to the mapping of datalogging information and record identification System determines the record identification of every data record information in the isochronous queue.
Optionally, in the isochronous queue every data record information record identification, record information for the data and reflect The cryptographic Hash penetrated.
Optionally, the N data record information in the isochronous queue is submitted to M by the first storage equipment Execution thread, comprising:
For each execution thread in the M execution thread, the first storage equipment is according to predetermined period, each Datalogging information is extracted in predetermined period from the isochronous queue and is committed to the execution thread;Each predetermined period when Between length be less than predetermined time period.
Optionally, datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the execution The quantity of the datalogging information of thread is less than or equal to processing batch threshold value;The processing batch threshold value is each predetermined period Inside allow to submit to the quantity maximum value of the datalogging information of the execution thread.
In the embodiment of the present invention, the N data record information in isochronous queue is submitted to M execution by the first storage equipment Thread can allow multiple thread synchronization N datas to record information, to greatly promote synchrodata by increasing M when n is large The efficiency for recording information, creates a further reduction the delay that datalogging information in isochronous queue is synchronized to the second storage equipment, And reduce saving bit by bit for datalogging information in isochronous queue;In addition, submit to same execution thread is to have identical note The datalogging information of mark is recorded, the load of each execution thread is more balanced.
Based on same inventive concept, the embodiment of the invention also provides a kind of data synchronization units, comprising:
Obtain module: for obtaining the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;By institute It states N data record information and is put into the corresponding isochronous queue of the tables of data to be synchronized;And it obtains every in the isochronous queue The record identification of data record information;
Processing module: for the N data record information in the isochronous queue to be submitted to M execution thread; Wherein, the datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;And it is logical The M execution thread is crossed, the datalogging information for submitting to the M execution thread is synchronized to the second storage equipment.
Optionally, the acquisition module, is specifically used for:
The synchronous team is determined according to the mapping relations of datalogging information and record identification by the synchronizing thread The record identification of every data record information in column.
Optionally, in the isochronous queue every data record information record identification, record information for the data and reflect The cryptographic Hash penetrated.
Optionally, the processing module, is specifically used for:
For each execution thread in the M execution thread, according to predetermined period, from described in each predetermined period Datalogging information is extracted in isochronous queue and is committed to the execution thread;When the time span of each predetermined period is less than default Between length.
Optionally, the processing module, is also used to:
Datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the execution thread The quantity of datalogging information is less than or equal to processing batch threshold value;The processing batch threshold value is to allow in each predetermined period Submit to the quantity maximum value of the datalogging information of the execution thread.
Detailed description of the invention
Fig. 1 is the corresponding execution module schematic diagram of method of data synchronization in the embodiment of the present application;
Fig. 2 is the corresponding process schematic of method of data synchronization in the embodiment of the present application;
Fig. 3 is the corresponding specific steps flow chart of method of data synchronization in the embodiment of the present application;
Fig. 4 is the corresponding structural schematic diagram of data synchronization unit in the embodiment of the present application.
Specific embodiment
In order to better understand the above technical scheme, below in conjunction with Figure of description and specific embodiment to above-mentioned Technical solution is described in detail, it should be understood that the specific features in the embodiment of the present invention and embodiment are to skill of the present invention The detailed description of art scheme, rather than the restriction to technical solution of the present invention, in the absence of conflict, the embodiment of the present invention And the technical characteristic in embodiment can be combined with each other.
The embodiment of the present invention is described in further detail with reference to the accompanying drawings of the specification.
Database is to be long-term stored at interior, organized, the sharable data acquisition system of computer, and lane database has many Tables of data, each table have very data record again, and same type of data record can be placed in a table, such as student status information table. Every data is made of one or more fields, such as student status information table includes multiple fields: name, student number, admission time, surname Name is exactly a field.Using when doing business, database is often accessed, database is operated.Common operation Have: deleting data, several datas are deleted from database;More new data makes an amendment datas several in database.Specifically Which kind of operation is done to which data, can by data base management system the operation of operation data library execute sentence and realize, often Once the operation information of database can be all written in database manipulation log, including operating time, the tables of data of operation, behaviour Make type, specific data record of operation etc..Source database update is synchronized to target database i.e. according to database manipulation day Will carries out.
A kind of method of data synchronization that the application proposes, source database update the process for being synchronized to target database by Fig. 1 Shown in each module execute, the schematic diagram of the process is as shown in Figure 2.
The effect of each module in Fig. 1 are as follows:
Log read module 101: source database operation log is read;
Log analyzing module 102: the database manipulation log read is resolved to a plurality of number of another data format According to record information, it is put into journal queue shown in Fig. 2;
Data distribution module 103:, will be in journal queue according to the sequencing of the operating time of every data record information In each table (datalogging information including table 1 to table K) in Fig. 2 is added to the corresponding isochronous queue of the table (including Fig. 2 In table 1 arrive table K isochronous queue).
Every table is corresponding and only corresponds to an isochronous queue.
Table data distribution module 104: the synchronization of table K (is arrived including the table 1 in Fig. 2 by the corresponding synchronizing thread of every table Thread) from respective isochronous queue taking-up datalogging information, the datalogging information that same record identifies is submitted to same A execution thread (arriving the respective synchronizing thread 1-k of table K including the table 1 in Fig. 2).
Data simultaneous module 105: by each execution thread according to every data record information operating time it is successive Sequentially, the update of source database is synchronized on object library.
Below with reference to Fig. 3, it is the corresponding specific steps flow chart of method of data synchronization in the embodiment of the present application, is discussed in detail The method of data synchronization corresponds to step.Following steps only by taking a tables of data to be synchronized as an example, all hold by other tables of data to be synchronized The same step of row.
Step 301: the first storage equipment obtains the record information of the N data in tables of data to be synchronized.
N is the integer greater than 0.
Step 302: N data record information is put into the tables of data to be synchronized and corresponded to by the first storage equipment Isochronous queue.
Step 303: the first storage equipment obtains the record identification of every data record information in the isochronous queue.
Step 304: the N data record information in the isochronous queue is submitted to M by the first storage equipment A execution thread.
Wherein, the datalogging information with identical recordings mark is submitted to same execution thread;M is whole greater than 0 Number.
Step 305: the first storage equipment will submit to the M execution thread by the M execution thread Datalogging information is synchronized to the second storage equipment.
Before step 301, the first storage equipment obtains database manipulation log first, and by database manipulation log It is converted into a plurality of datalogging information of another data format.
Specifically, since database has operated the corresponding operating time each time, to prevent the synchronous disorder of data, first It stores equipment and obtains database manipulation log by the sequencing of the operating time of each operation note.Moreover, the first storage Equipment is put into a plurality of datalogging information obtained after database manipulation log is parsed in journal queue, and journal queue includes institute There is the datalogging information of tables of data.
In step 301, for the tables of data to be synchronized, the first storage equipment obtains first to be converted by database manipulation log A plurality of datalogging information in, the corresponding N data of the tables of data records information.
Specifically, each tables of data corresponds to a synchronizing thread.First storage equipment is corresponding by tables of data to be synchronized Synchronizing thread, obtain the corresponding N data record letter of the tables of data to be synchronized in a plurality of datalogging information of journal queue Breath.
In step 302, the corresponding isochronous queue of tables of data to be synchronized, the above-mentioned N item number that the first storage equipment is got It is put into the corresponding isochronous queue of tables of data to be synchronized according to record information.
Specifically, the first storage equipment is recorded in day by every data by the corresponding synchronizing thread of tables of data to be synchronized N data record information is put into the corresponding isochronous queue of tables of data to be synchronized by the order in will queue.
In step 303, the first storage equipment obtains the isochronous queue by the corresponding synchronizing thread of tables of data to be synchronized In every data record information record identification.
Specifically, the first storage equipment is by the synchronizing thread, according to datalogging information and record identification Mapping relations determine the record identification of every data record information in the isochronous queue.
For example, record identification is the unique index that every data records information.Unique index is datalogging information It is middle can the unique identification datalogging information field, there is no any a plurality of data record for having identical unique index in tables of data Information, such as the identification card number in student status information table.
Wherein, mapping is defined as: there is corresponding relationship f between two nonempty sets A and B, and for each in A A element x, as soon as always there is unique element y corresponding with it in B, this mapping corresponded to from A to B is denoted as f:A → B.Its In, b be known as element a in the case where mapping f as being denoted as: b=f (a).A is known as primary image of the b about mapping f.All elements in set A Elephant collection be collectively referred to as mapping f codomain, be denoted as f (A).Obviously, data record information only maps a record identification.
For example, in the isochronous queue every data record information record identification, record information for the data The cryptographic Hash of mapping.In the embodiment of the present invention, hash function is the storage location and the datalogging information of datalogging information Unique index between establish a determining corresponding relationship f, datalogging information is exactly according to the value that hash function is determined Cryptographic Hash.
In step 304, the first storage equipment, will be in the isochronous queue by the corresponding synchronizing thread of tables of data to be synchronized The N data record information submit to M execution thread.
Synchronizing thread has got the record identification of every data record information in isochronous queue in step 303, such as Cryptographic Hash.
Datalogging information with identical cryptographic Hash is submitted to same execution thread by synchronizing thread.Synchronizing thread calculates Every data record information correspond to the process of cryptographic Hash are as follows: be used to calculate in selected isochronous queue cryptographic Hash unique index and Hash function.Information is recorded for data every in isochronous queue, by preset hash function, according to defined in hash function The corresponding relationship of unique index and cryptographic Hash calculates the cryptographic Hash of the datalogging information.And cryptographic Hash and M execution thread There is also corresponding relationship, synchronizing threads, and the datalogging information is submitted to corresponding execution thread for some execution thread, here Cryptographic Hash is corresponding and only corresponds to an execution thread.For example, major key is special unique index, and major key is student number, Hash Function is that student number takes the remainder to 10, and the datalogging information that cryptographic Hash is 1 is submitted to execution thread one.
It should be noted that synchronizing thread is during above-mentioned submission by the time sum number for the datalogging information submitted Constraint of both amount.
Specifically, for each execution thread in the M execution thread, the first storage equipment is according to default week Phase extracts datalogging information from the isochronous queue in each predetermined period and is committed to the execution thread;It is each pre- If the time span in period is less than predetermined time period.
Predetermined period is the period defined by configuration file, if synchronizing thread will not in a predetermined period The datalogging information of corresponding record mark all submits to execution thread, can only be submitted again until next predetermined period. For example, predetermined period is 1 second, if cryptographic Hash is not all submitted to execution thread one for 1 by synchronizing thread, then next time When submission, there is 1 second time to continue to submit remaining datalogging information.
In addition, datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the execution line The quantity of the datalogging information of journey is less than or equal to processing batch threshold value;The processing batch threshold value is in each predetermined period Allow to submit to the quantity maximum value of the datalogging information of the execution thread.
Handling batch threshold value is the upper limit of the number defined by configuration file.That is, even if synchronizing thread exists In predetermined period 1 second, but if having reached processing batch threshold value, synchronizing thread also stops in the predetermined period to the execution line Journey submits datalogging information.When the datalogging information in execution thread is less than processing batch threshold value, could continue to submit Datalogging information.For example, processing batch threshold value is 20, and at the 0.8th second of a cycle, synchronizing thread submitted to execution The datalogging information item number of thread one has reached 20, then stops submitting.Start timing in next predetermined period, executes Datalogging information item number is 0 in thread one, and synchronizing thread could continue to submit datalogging information.
In step 305, the first storage equipment will submit to the number of the M execution thread by the M execution thread The method of synchronization according to record synchronizing information to the second storage equipment is concurrent.I.e. each execution thread is completed (i.e. in primary submit Reach processing batch threshold value after one predetermined period or in a predetermined period) after, respectively corresponding synchrodata is remembered Synchronizing information is recorded to the second storage equipment, is independent of each other.Each execution thread is per subsynchronous a part of number in M execution thread According to final M execution thread completes the synchronization of N data record information.It is further to note that each execution thread will be every After data record information is converted into data base manipulation statement, by executing data base manipulation statement, complete to synchronize.
In the embodiment of the present invention, the N data record information in isochronous queue is submitted to M execution by the first storage equipment Thread can allow multiple thread synchronization N datas to record information, to greatly promote synchrodata by increasing M when n is large The efficiency for recording information, creates a further reduction the delay that datalogging information in isochronous queue is synchronized to the second storage equipment, And reduce saving bit by bit for datalogging information in isochronous queue;In addition, submit to same execution thread is to have identical note The datalogging information of mark is recorded, the load of each execution thread is more balanced.
Based on same inventive concept, as shown in figure 4, the embodiment of the invention also provides a kind of data synchronization unit, packet It includes:
Obtain module 401: for obtaining the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;It will The N data record information is put into the corresponding isochronous queue of the tables of data to be synchronized;And it obtains in the isochronous queue The record identification of every data record information;
Processing module 402: for the N data record information in the isochronous queue to be submitted to M execution line Journey;Wherein, the datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;With And by the M execution thread, the datalogging information for submitting to the M execution thread is synchronized to the second storage and is set It is standby.
Optionally, the acquisition module 401, is specifically used for:
The synchronous team is determined according to the mapping relations of datalogging information and record identification by the synchronizing thread The record identification of every data record information in column.
Optionally, in the isochronous queue every data record information record identification, record information for the data and reflect The cryptographic Hash penetrated.
Optionally, the processing module 402, is specifically used for:
For each execution thread in the M execution thread, according to predetermined period, from described in each predetermined period Datalogging information is extracted in isochronous queue and is committed to the execution thread;When the time span of each predetermined period is less than default Between length.
Optionally, the processing module 402, is also used to:
Datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the execution thread The quantity of datalogging information is less than or equal to processing batch threshold value;The processing batch threshold value is to allow in each predetermined period Submit to the quantity maximum value of the datalogging information of the execution thread.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more, The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of device (system) and computer program product Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates, Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one The step of function of being specified in a box or multiple boxes.
Although preferred embodiments of the present invention have been described, it is created once a person skilled in the art knows basic Property concept, then additional changes and modifications may be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to include these modifications and variations.

Claims (10)

1. a kind of method of data synchronization characterized by comprising
First storage equipment obtains the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;
N data record information is put into the corresponding isochronous queue of the tables of data to be synchronized by the first storage equipment;
The first storage equipment obtains the record identification of every data record information in the isochronous queue;
N data record information in the isochronous queue is submitted to M execution thread by the first storage equipment;Its In, the datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;
The first storage equipment will submit to the datalogging information of the M execution thread by the M execution thread It is synchronized to the second storage equipment.
2. the method as described in claim 1, which is characterized in that the first storage equipment obtains institute by the synchronizing thread State the record identification of every data record information in isochronous queue, comprising:
The first storage equipment is by the synchronizing thread, according to the mapping relations of datalogging information and record identification, really The record identification of every data record information in the fixed isochronous queue.
3. method according to claim 2 characterized by comprising
The record identification of every data record information, the cryptographic Hash of information MAP is recorded for the data in the isochronous queue.
4. method a method according to any one of claims 1-3, which is characterized in that the first storage equipment will be in the isochronous queue The N data record information submit to M execution thread, comprising:
For each execution thread in the M execution thread, the first storage equipment is according to predetermined period, each default Datalogging information is extracted in period from the isochronous queue and is committed to the execution thread;The time of each predetermined period is long Degree is less than predetermined time period.
5. method as claimed in claim 4, which is characterized in that further include:
Datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the data of the execution thread The quantity for recording information is less than or equal to processing batch threshold value;The processing batch threshold value is to allow to submit in each predetermined period To the quantity maximum value of the datalogging information of the execution thread.
6. a kind of data synchronization unit characterized by comprising
Obtain module: for obtaining the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;By the N item Datalogging information is put into the corresponding isochronous queue of the tables of data to be synchronized;And obtain every data in the isochronous queue Record the record identification of information;
Processing module: for the N data record information in the isochronous queue to be submitted to M execution thread;Wherein, Datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;And pass through institute M execution thread is stated, the datalogging information for submitting to the M execution thread is synchronized to the second storage equipment.
7. device as claimed in claim 6, which is characterized in that the acquisition module is specifically used for:
It is determined in the isochronous queue by the synchronizing thread according to the mapping relations of datalogging information and record identification The record identification of every data record information.
8. device as claimed in claim 7 characterized by comprising
The record identification of every data record information, the cryptographic Hash of information MAP is recorded for the data in the isochronous queue.
9. device a method according to any one of claims 1-3, which is characterized in that the processing module is specifically used for:
For each execution thread in the M execution thread, according to predetermined period, from the synchronization in each predetermined period Datalogging information is extracted in queue and is committed to the execution thread;It is long that the time span of each predetermined period is less than preset time Degree.
10. device as claimed in claim 9, which is characterized in that the processing unit is also used to:
Datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the data of the execution thread The quantity for recording information is less than or equal to processing batch threshold value;The processing batch threshold value is to allow to submit in each predetermined period To the quantity maximum value of the datalogging information of the execution thread.
CN201811173931.6A 2018-10-09 2018-10-09 A kind of method of data synchronization and device Pending CN109446268A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811173931.6A CN109446268A (en) 2018-10-09 2018-10-09 A kind of method of data synchronization and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811173931.6A CN109446268A (en) 2018-10-09 2018-10-09 A kind of method of data synchronization and device

Publications (1)

Publication Number Publication Date
CN109446268A true CN109446268A (en) 2019-03-08

Family

ID=65546012

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811173931.6A Pending CN109446268A (en) 2018-10-09 2018-10-09 A kind of method of data synchronization and device

Country Status (1)

Country Link
CN (1) CN109446268A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110196884A (en) * 2019-05-31 2019-09-03 北京大米科技有限公司 Method for writing data, storage medium and electronic equipment based on distributed data base
CN112163042A (en) * 2020-09-24 2021-01-01 杭州安恒信息技术股份有限公司 Method and device for synchronizing variable data, electronic device and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102023899A (en) * 2010-12-14 2011-04-20 中兴通讯股份有限公司 Multithreaded data synchronization method and device
CN103885986A (en) * 2012-12-21 2014-06-25 阿里巴巴集团控股有限公司 Main and auxiliary database synchronization method and device
CN104699541A (en) * 2015-03-30 2015-06-10 北京奇虎科技有限公司 Method, device, data transmission assembly and system for synchronizing data
CN106980546A (en) * 2016-01-18 2017-07-25 阿里巴巴集团控股有限公司 A kind of task asynchronous execution method, apparatus and system
CN108228366A (en) * 2017-12-29 2018-06-29 北京奇虎科技有限公司 A kind for the treatment of method and apparatus of data flow
CN108459917A (en) * 2018-03-15 2018-08-28 欧普照明股份有限公司 A kind of message distribution member, message handling system and message distribution method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102023899A (en) * 2010-12-14 2011-04-20 中兴通讯股份有限公司 Multithreaded data synchronization method and device
CN103885986A (en) * 2012-12-21 2014-06-25 阿里巴巴集团控股有限公司 Main and auxiliary database synchronization method and device
CN104699541A (en) * 2015-03-30 2015-06-10 北京奇虎科技有限公司 Method, device, data transmission assembly and system for synchronizing data
CN106980546A (en) * 2016-01-18 2017-07-25 阿里巴巴集团控股有限公司 A kind of task asynchronous execution method, apparatus and system
CN108228366A (en) * 2017-12-29 2018-06-29 北京奇虎科技有限公司 A kind for the treatment of method and apparatus of data flow
CN108459917A (en) * 2018-03-15 2018-08-28 欧普照明股份有限公司 A kind of message distribution member, message handling system and message distribution method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
国家税务总局信息中心: "《税务系统数据中心建设技术指南》", 31 May 2008 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110196884A (en) * 2019-05-31 2019-09-03 北京大米科技有限公司 Method for writing data, storage medium and electronic equipment based on distributed data base
CN112163042A (en) * 2020-09-24 2021-01-01 杭州安恒信息技术股份有限公司 Method and device for synchronizing variable data, electronic device and storage medium
CN112163042B (en) * 2020-09-24 2024-01-23 杭州安恒信息技术股份有限公司 Multi-variable data synchronization method and device, electronic device and storage medium

Similar Documents

Publication Publication Date Title
US10255108B2 (en) Parallel execution of blockchain transactions
CN110334152A (en) A kind of method of data synchronization, device and server
US9047330B2 (en) Index compression in databases
CN108133007A (en) A kind of method of data synchronization and system
CN109002474A (en) A kind of data migration method and device
CN108121757A (en) A kind of method of data synchronization, device, system, computing device and storage medium
CN107590207A (en) Method of data synchronization and device, electronic equipment
CN104598550B (en) A kind of update method and device of Internet video index
US10198346B1 (en) Test framework for applications using journal-based databases
US10133767B1 (en) Materialization strategies in journal-based databases
CN104794155B (en) The method, apparatus and system of data load
CN109919691A (en) A kind of system of data processing, method and device
CN110413595A (en) A kind of data migration method and relevant apparatus applied to distributed data base
CN109446268A (en) A kind of method of data synchronization and device
CN109299096A (en) A kind of processing method of pipelined data, device and equipment
CN104462036B (en) A kind of method and system of the format information of synchro edit document
CN104714957A (en) List structure changing method and device
CN110019200A (en) A kind of foundation of index, application method and device
CN108073595A (en) It is a kind of to realize data update and the method and device of snapshot in olap database
CN107133243A (en) A kind of data processing method and server
CN110471943A (en) Real time data statistic device and method and computer readable storage medium
US10262000B1 (en) Global distributed file append using log-structured file system
CN105955971B (en) A kind of implementation method and device of key assignments caching
CN107622059A (en) A kind of method and system for improving database search efficiency
CN109582476A (en) Data processing method, apparatus and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190308