CN109446268A - A kind of method of data synchronization and device - Google Patents
A kind of method of data synchronization and device Download PDFInfo
- Publication number
- CN109446268A CN109446268A CN201811173931.6A CN201811173931A CN109446268A CN 109446268 A CN109446268 A CN 109446268A CN 201811173931 A CN201811173931 A CN 201811173931A CN 109446268 A CN109446268 A CN 109446268A
- Authority
- CN
- China
- Prior art keywords
- information
- data
- execution thread
- datalogging
- storage equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Abstract
The invention discloses a kind of method of data synchronization and devices.The method of data synchronization, comprising: the first storage equipment obtains the record information of the N data in tables of data to be synchronized;N data record information is put into the corresponding isochronous queue of the tables of data to be synchronized by the first storage equipment;The first storage equipment obtains the record identification of every data record information in the isochronous queue;N data record information in the isochronous queue is submitted to M execution thread by the first storage equipment;The datalogging information for submitting to the M execution thread is synchronized to the second storage equipment by the M execution thread by the first storage equipment.
Description
Technical field
The present invention relates to database field more particularly to a kind of method of data synchronization and device.
Background technique
In Internet service implementation procedure, often same database is deployed on different hosts.However, due to Business Stream
The database (referred to as source database) of the succession of journey, a certain host is first updated, later by the update of the database at it
It is synchronous on the corresponding database of his host (target database).How the update of source database to be synchronized to target database in time
It is a critical issue.
In the prior art, it has the disadvantage in that 1, synchronize slowly.The efficiency for being synchronized to object library is very low, especially in source data
In the case that the data volume of library partial data table is bigger, the synchronous time is longer;2, delay is high.Not due to datalogging information
It can be synchronized to target database in time, and mass data is caused to be saved bit by bit, further result in higher synchronization delay, it cannot be real-time
Synchrodata records information.
Therefore, how to reduce occur in the prior art synchronize phenomenon slow, that delay is high, be one and urgently to be resolved ask
Topic.
Summary of the invention
The embodiment of the invention provides a kind of method of data synchronization, synchronize between database in the prior art for solving
Synchronizing for occurring in journey is slow, postpones high problem.
The embodiment of the invention provides a kind of method of data synchronization, comprising:
First storage equipment obtains the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;
N data record information is put into the corresponding synchronous team of the tables of data to be synchronized by the first storage equipment
Column;
The first storage equipment obtains the record identification of every data record information in the isochronous queue;
N data record information in the isochronous queue is submitted to M execution line by the first storage equipment
Journey;Wherein, the datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;
The first storage equipment will submit to the data record of the M execution thread by the M execution thread
Synchronizing information to second storage equipment.
Optionally, the first storage equipment obtains every data record in the isochronous queue by the synchronizing thread
The record identification of information, comprising:
The first storage equipment is closed by the synchronizing thread according to the mapping of datalogging information and record identification
System determines the record identification of every data record information in the isochronous queue.
Optionally, in the isochronous queue every data record information record identification, record information for the data and reflect
The cryptographic Hash penetrated.
Optionally, the N data record information in the isochronous queue is submitted to M by the first storage equipment
Execution thread, comprising:
For each execution thread in the M execution thread, the first storage equipment is according to predetermined period, each
Datalogging information is extracted in predetermined period from the isochronous queue and is committed to the execution thread;Each predetermined period when
Between length be less than predetermined time period.
Optionally, datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the execution
The quantity of the datalogging information of thread is less than or equal to processing batch threshold value;The processing batch threshold value is each predetermined period
Inside allow to submit to the quantity maximum value of the datalogging information of the execution thread.
In the embodiment of the present invention, the N data record information in isochronous queue is submitted to M execution by the first storage equipment
Thread can allow multiple thread synchronization N datas to record information, to greatly promote synchrodata by increasing M when n is large
The efficiency for recording information, creates a further reduction the delay that datalogging information in isochronous queue is synchronized to the second storage equipment,
And reduce saving bit by bit for datalogging information in isochronous queue;In addition, submit to same execution thread is to have identical note
The datalogging information of mark is recorded, the load of each execution thread is more balanced.
Based on same inventive concept, the embodiment of the invention also provides a kind of data synchronization units, comprising:
Obtain module: for obtaining the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;By institute
It states N data record information and is put into the corresponding isochronous queue of the tables of data to be synchronized;And it obtains every in the isochronous queue
The record identification of data record information;
Processing module: for the N data record information in the isochronous queue to be submitted to M execution thread;
Wherein, the datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;And it is logical
The M execution thread is crossed, the datalogging information for submitting to the M execution thread is synchronized to the second storage equipment.
Optionally, the acquisition module, is specifically used for:
The synchronous team is determined according to the mapping relations of datalogging information and record identification by the synchronizing thread
The record identification of every data record information in column.
Optionally, in the isochronous queue every data record information record identification, record information for the data and reflect
The cryptographic Hash penetrated.
Optionally, the processing module, is specifically used for:
For each execution thread in the M execution thread, according to predetermined period, from described in each predetermined period
Datalogging information is extracted in isochronous queue and is committed to the execution thread;When the time span of each predetermined period is less than default
Between length.
Optionally, the processing module, is also used to:
Datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the execution thread
The quantity of datalogging information is less than or equal to processing batch threshold value;The processing batch threshold value is to allow in each predetermined period
Submit to the quantity maximum value of the datalogging information of the execution thread.
Detailed description of the invention
Fig. 1 is the corresponding execution module schematic diagram of method of data synchronization in the embodiment of the present application;
Fig. 2 is the corresponding process schematic of method of data synchronization in the embodiment of the present application;
Fig. 3 is the corresponding specific steps flow chart of method of data synchronization in the embodiment of the present application;
Fig. 4 is the corresponding structural schematic diagram of data synchronization unit in the embodiment of the present application.
Specific embodiment
In order to better understand the above technical scheme, below in conjunction with Figure of description and specific embodiment to above-mentioned
Technical solution is described in detail, it should be understood that the specific features in the embodiment of the present invention and embodiment are to skill of the present invention
The detailed description of art scheme, rather than the restriction to technical solution of the present invention, in the absence of conflict, the embodiment of the present invention
And the technical characteristic in embodiment can be combined with each other.
The embodiment of the present invention is described in further detail with reference to the accompanying drawings of the specification.
Database is to be long-term stored at interior, organized, the sharable data acquisition system of computer, and lane database has many
Tables of data, each table have very data record again, and same type of data record can be placed in a table, such as student status information table.
Every data is made of one or more fields, such as student status information table includes multiple fields: name, student number, admission time, surname
Name is exactly a field.Using when doing business, database is often accessed, database is operated.Common operation
Have: deleting data, several datas are deleted from database;More new data makes an amendment datas several in database.Specifically
Which kind of operation is done to which data, can by data base management system the operation of operation data library execute sentence and realize, often
Once the operation information of database can be all written in database manipulation log, including operating time, the tables of data of operation, behaviour
Make type, specific data record of operation etc..Source database update is synchronized to target database i.e. according to database manipulation day
Will carries out.
A kind of method of data synchronization that the application proposes, source database update the process for being synchronized to target database by Fig. 1
Shown in each module execute, the schematic diagram of the process is as shown in Figure 2.
The effect of each module in Fig. 1 are as follows:
Log read module 101: source database operation log is read;
Log analyzing module 102: the database manipulation log read is resolved to a plurality of number of another data format
According to record information, it is put into journal queue shown in Fig. 2;
Data distribution module 103:, will be in journal queue according to the sequencing of the operating time of every data record information
In each table (datalogging information including table 1 to table K) in Fig. 2 is added to the corresponding isochronous queue of the table (including Fig. 2
In table 1 arrive table K isochronous queue).
Every table is corresponding and only corresponds to an isochronous queue.
Table data distribution module 104: the synchronization of table K (is arrived including the table 1 in Fig. 2 by the corresponding synchronizing thread of every table
Thread) from respective isochronous queue taking-up datalogging information, the datalogging information that same record identifies is submitted to same
A execution thread (arriving the respective synchronizing thread 1-k of table K including the table 1 in Fig. 2).
Data simultaneous module 105: by each execution thread according to every data record information operating time it is successive
Sequentially, the update of source database is synchronized on object library.
Below with reference to Fig. 3, it is the corresponding specific steps flow chart of method of data synchronization in the embodiment of the present application, is discussed in detail
The method of data synchronization corresponds to step.Following steps only by taking a tables of data to be synchronized as an example, all hold by other tables of data to be synchronized
The same step of row.
Step 301: the first storage equipment obtains the record information of the N data in tables of data to be synchronized.
N is the integer greater than 0.
Step 302: N data record information is put into the tables of data to be synchronized and corresponded to by the first storage equipment
Isochronous queue.
Step 303: the first storage equipment obtains the record identification of every data record information in the isochronous queue.
Step 304: the N data record information in the isochronous queue is submitted to M by the first storage equipment
A execution thread.
Wherein, the datalogging information with identical recordings mark is submitted to same execution thread;M is whole greater than 0
Number.
Step 305: the first storage equipment will submit to the M execution thread by the M execution thread
Datalogging information is synchronized to the second storage equipment.
Before step 301, the first storage equipment obtains database manipulation log first, and by database manipulation log
It is converted into a plurality of datalogging information of another data format.
Specifically, since database has operated the corresponding operating time each time, to prevent the synchronous disorder of data, first
It stores equipment and obtains database manipulation log by the sequencing of the operating time of each operation note.Moreover, the first storage
Equipment is put into a plurality of datalogging information obtained after database manipulation log is parsed in journal queue, and journal queue includes institute
There is the datalogging information of tables of data.
In step 301, for the tables of data to be synchronized, the first storage equipment obtains first to be converted by database manipulation log
A plurality of datalogging information in, the corresponding N data of the tables of data records information.
Specifically, each tables of data corresponds to a synchronizing thread.First storage equipment is corresponding by tables of data to be synchronized
Synchronizing thread, obtain the corresponding N data record letter of the tables of data to be synchronized in a plurality of datalogging information of journal queue
Breath.
In step 302, the corresponding isochronous queue of tables of data to be synchronized, the above-mentioned N item number that the first storage equipment is got
It is put into the corresponding isochronous queue of tables of data to be synchronized according to record information.
Specifically, the first storage equipment is recorded in day by every data by the corresponding synchronizing thread of tables of data to be synchronized
N data record information is put into the corresponding isochronous queue of tables of data to be synchronized by the order in will queue.
In step 303, the first storage equipment obtains the isochronous queue by the corresponding synchronizing thread of tables of data to be synchronized
In every data record information record identification.
Specifically, the first storage equipment is by the synchronizing thread, according to datalogging information and record identification
Mapping relations determine the record identification of every data record information in the isochronous queue.
For example, record identification is the unique index that every data records information.Unique index is datalogging information
It is middle can the unique identification datalogging information field, there is no any a plurality of data record for having identical unique index in tables of data
Information, such as the identification card number in student status information table.
Wherein, mapping is defined as: there is corresponding relationship f between two nonempty sets A and B, and for each in A
A element x, as soon as always there is unique element y corresponding with it in B, this mapping corresponded to from A to B is denoted as f:A → B.Its
In, b be known as element a in the case where mapping f as being denoted as: b=f (a).A is known as primary image of the b about mapping f.All elements in set A
Elephant collection be collectively referred to as mapping f codomain, be denoted as f (A).Obviously, data record information only maps a record identification.
For example, in the isochronous queue every data record information record identification, record information for the data
The cryptographic Hash of mapping.In the embodiment of the present invention, hash function is the storage location and the datalogging information of datalogging information
Unique index between establish a determining corresponding relationship f, datalogging information is exactly according to the value that hash function is determined
Cryptographic Hash.
In step 304, the first storage equipment, will be in the isochronous queue by the corresponding synchronizing thread of tables of data to be synchronized
The N data record information submit to M execution thread.
Synchronizing thread has got the record identification of every data record information in isochronous queue in step 303, such as
Cryptographic Hash.
Datalogging information with identical cryptographic Hash is submitted to same execution thread by synchronizing thread.Synchronizing thread calculates
Every data record information correspond to the process of cryptographic Hash are as follows: be used to calculate in selected isochronous queue cryptographic Hash unique index and
Hash function.Information is recorded for data every in isochronous queue, by preset hash function, according to defined in hash function
The corresponding relationship of unique index and cryptographic Hash calculates the cryptographic Hash of the datalogging information.And cryptographic Hash and M execution thread
There is also corresponding relationship, synchronizing threads, and the datalogging information is submitted to corresponding execution thread for some execution thread, here
Cryptographic Hash is corresponding and only corresponds to an execution thread.For example, major key is special unique index, and major key is student number, Hash
Function is that student number takes the remainder to 10, and the datalogging information that cryptographic Hash is 1 is submitted to execution thread one.
It should be noted that synchronizing thread is during above-mentioned submission by the time sum number for the datalogging information submitted
Constraint of both amount.
Specifically, for each execution thread in the M execution thread, the first storage equipment is according to default week
Phase extracts datalogging information from the isochronous queue in each predetermined period and is committed to the execution thread;It is each pre-
If the time span in period is less than predetermined time period.
Predetermined period is the period defined by configuration file, if synchronizing thread will not in a predetermined period
The datalogging information of corresponding record mark all submits to execution thread, can only be submitted again until next predetermined period.
For example, predetermined period is 1 second, if cryptographic Hash is not all submitted to execution thread one for 1 by synchronizing thread, then next time
When submission, there is 1 second time to continue to submit remaining datalogging information.
In addition, datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the execution line
The quantity of the datalogging information of journey is less than or equal to processing batch threshold value;The processing batch threshold value is in each predetermined period
Allow to submit to the quantity maximum value of the datalogging information of the execution thread.
Handling batch threshold value is the upper limit of the number defined by configuration file.That is, even if synchronizing thread exists
In predetermined period 1 second, but if having reached processing batch threshold value, synchronizing thread also stops in the predetermined period to the execution line
Journey submits datalogging information.When the datalogging information in execution thread is less than processing batch threshold value, could continue to submit
Datalogging information.For example, processing batch threshold value is 20, and at the 0.8th second of a cycle, synchronizing thread submitted to execution
The datalogging information item number of thread one has reached 20, then stops submitting.Start timing in next predetermined period, executes
Datalogging information item number is 0 in thread one, and synchronizing thread could continue to submit datalogging information.
In step 305, the first storage equipment will submit to the number of the M execution thread by the M execution thread
The method of synchronization according to record synchronizing information to the second storage equipment is concurrent.I.e. each execution thread is completed (i.e. in primary submit
Reach processing batch threshold value after one predetermined period or in a predetermined period) after, respectively corresponding synchrodata is remembered
Synchronizing information is recorded to the second storage equipment, is independent of each other.Each execution thread is per subsynchronous a part of number in M execution thread
According to final M execution thread completes the synchronization of N data record information.It is further to note that each execution thread will be every
After data record information is converted into data base manipulation statement, by executing data base manipulation statement, complete to synchronize.
In the embodiment of the present invention, the N data record information in isochronous queue is submitted to M execution by the first storage equipment
Thread can allow multiple thread synchronization N datas to record information, to greatly promote synchrodata by increasing M when n is large
The efficiency for recording information, creates a further reduction the delay that datalogging information in isochronous queue is synchronized to the second storage equipment,
And reduce saving bit by bit for datalogging information in isochronous queue;In addition, submit to same execution thread is to have identical note
The datalogging information of mark is recorded, the load of each execution thread is more balanced.
Based on same inventive concept, as shown in figure 4, the embodiment of the invention also provides a kind of data synchronization unit, packet
It includes:
Obtain module 401: for obtaining the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;It will
The N data record information is put into the corresponding isochronous queue of the tables of data to be synchronized;And it obtains in the isochronous queue
The record identification of every data record information;
Processing module 402: for the N data record information in the isochronous queue to be submitted to M execution line
Journey;Wherein, the datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;With
And by the M execution thread, the datalogging information for submitting to the M execution thread is synchronized to the second storage and is set
It is standby.
Optionally, the acquisition module 401, is specifically used for:
The synchronous team is determined according to the mapping relations of datalogging information and record identification by the synchronizing thread
The record identification of every data record information in column.
Optionally, in the isochronous queue every data record information record identification, record information for the data and reflect
The cryptographic Hash penetrated.
Optionally, the processing module 402, is specifically used for:
For each execution thread in the M execution thread, according to predetermined period, from described in each predetermined period
Datalogging information is extracted in isochronous queue and is committed to the execution thread;When the time span of each predetermined period is less than default
Between length.
Optionally, the processing module 402, is also used to:
Datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the execution thread
The quantity of datalogging information is less than or equal to processing batch threshold value;The processing batch threshold value is to allow in each predetermined period
Submit to the quantity maximum value of the datalogging information of the execution thread.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of device (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Although preferred embodiments of the present invention have been described, it is created once a person skilled in the art knows basic
Property concept, then additional changes and modifications may be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as
It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (10)
1. a kind of method of data synchronization characterized by comprising
First storage equipment obtains the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;
N data record information is put into the corresponding isochronous queue of the tables of data to be synchronized by the first storage equipment;
The first storage equipment obtains the record identification of every data record information in the isochronous queue;
N data record information in the isochronous queue is submitted to M execution thread by the first storage equipment;Its
In, the datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;
The first storage equipment will submit to the datalogging information of the M execution thread by the M execution thread
It is synchronized to the second storage equipment.
2. the method as described in claim 1, which is characterized in that the first storage equipment obtains institute by the synchronizing thread
State the record identification of every data record information in isochronous queue, comprising:
The first storage equipment is by the synchronizing thread, according to the mapping relations of datalogging information and record identification, really
The record identification of every data record information in the fixed isochronous queue.
3. method according to claim 2 characterized by comprising
The record identification of every data record information, the cryptographic Hash of information MAP is recorded for the data in the isochronous queue.
4. method a method according to any one of claims 1-3, which is characterized in that the first storage equipment will be in the isochronous queue
The N data record information submit to M execution thread, comprising:
For each execution thread in the M execution thread, the first storage equipment is according to predetermined period, each default
Datalogging information is extracted in period from the isochronous queue and is committed to the execution thread;The time of each predetermined period is long
Degree is less than predetermined time period.
5. method as claimed in claim 4, which is characterized in that further include:
Datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the data of the execution thread
The quantity for recording information is less than or equal to processing batch threshold value;The processing batch threshold value is to allow to submit in each predetermined period
To the quantity maximum value of the datalogging information of the execution thread.
6. a kind of data synchronization unit characterized by comprising
Obtain module: for obtaining the record information of the N data in tables of data to be synchronized;N is the integer greater than 0;By the N item
Datalogging information is put into the corresponding isochronous queue of the tables of data to be synchronized;And obtain every data in the isochronous queue
Record the record identification of information;
Processing module: for the N data record information in the isochronous queue to be submitted to M execution thread;Wherein,
Datalogging information with identical recordings mark is submitted to same execution thread;M is the integer greater than 0;And pass through institute
M execution thread is stated, the datalogging information for submitting to the M execution thread is synchronized to the second storage equipment.
7. device as claimed in claim 6, which is characterized in that the acquisition module is specifically used for:
It is determined in the isochronous queue by the synchronizing thread according to the mapping relations of datalogging information and record identification
The record identification of every data record information.
8. device as claimed in claim 7 characterized by comprising
The record identification of every data record information, the cryptographic Hash of information MAP is recorded for the data in the isochronous queue.
9. device a method according to any one of claims 1-3, which is characterized in that the processing module is specifically used for:
For each execution thread in the M execution thread, according to predetermined period, from the synchronization in each predetermined period
Datalogging information is extracted in queue and is committed to the execution thread;It is long that the time span of each predetermined period is less than preset time
Degree.
10. device as claimed in claim 9, which is characterized in that the processing unit is also used to:
Datalogging information is extracted from the isochronous queue in each predetermined period and is committed to the data of the execution thread
The quantity for recording information is less than or equal to processing batch threshold value;The processing batch threshold value is to allow to submit in each predetermined period
To the quantity maximum value of the datalogging information of the execution thread.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811173931.6A CN109446268A (en) | 2018-10-09 | 2018-10-09 | A kind of method of data synchronization and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811173931.6A CN109446268A (en) | 2018-10-09 | 2018-10-09 | A kind of method of data synchronization and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109446268A true CN109446268A (en) | 2019-03-08 |
Family
ID=65546012
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811173931.6A Pending CN109446268A (en) | 2018-10-09 | 2018-10-09 | A kind of method of data synchronization and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109446268A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110196884A (en) * | 2019-05-31 | 2019-09-03 | 北京大米科技有限公司 | Method for writing data, storage medium and electronic equipment based on distributed data base |
CN112163042A (en) * | 2020-09-24 | 2021-01-01 | 杭州安恒信息技术股份有限公司 | Method and device for synchronizing variable data, electronic device and storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102023899A (en) * | 2010-12-14 | 2011-04-20 | 中兴通讯股份有限公司 | Multithreaded data synchronization method and device |
CN103885986A (en) * | 2012-12-21 | 2014-06-25 | 阿里巴巴集团控股有限公司 | Main and auxiliary database synchronization method and device |
CN104699541A (en) * | 2015-03-30 | 2015-06-10 | 北京奇虎科技有限公司 | Method, device, data transmission assembly and system for synchronizing data |
CN106980546A (en) * | 2016-01-18 | 2017-07-25 | 阿里巴巴集团控股有限公司 | A kind of task asynchronous execution method, apparatus and system |
CN108228366A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | A kind for the treatment of method and apparatus of data flow |
CN108459917A (en) * | 2018-03-15 | 2018-08-28 | 欧普照明股份有限公司 | A kind of message distribution member, message handling system and message distribution method |
-
2018
- 2018-10-09 CN CN201811173931.6A patent/CN109446268A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102023899A (en) * | 2010-12-14 | 2011-04-20 | 中兴通讯股份有限公司 | Multithreaded data synchronization method and device |
CN103885986A (en) * | 2012-12-21 | 2014-06-25 | 阿里巴巴集团控股有限公司 | Main and auxiliary database synchronization method and device |
CN104699541A (en) * | 2015-03-30 | 2015-06-10 | 北京奇虎科技有限公司 | Method, device, data transmission assembly and system for synchronizing data |
CN106980546A (en) * | 2016-01-18 | 2017-07-25 | 阿里巴巴集团控股有限公司 | A kind of task asynchronous execution method, apparatus and system |
CN108228366A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | A kind for the treatment of method and apparatus of data flow |
CN108459917A (en) * | 2018-03-15 | 2018-08-28 | 欧普照明股份有限公司 | A kind of message distribution member, message handling system and message distribution method |
Non-Patent Citations (1)
Title |
---|
国家税务总局信息中心: "《税务系统数据中心建设技术指南》", 31 May 2008 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110196884A (en) * | 2019-05-31 | 2019-09-03 | 北京大米科技有限公司 | Method for writing data, storage medium and electronic equipment based on distributed data base |
CN112163042A (en) * | 2020-09-24 | 2021-01-01 | 杭州安恒信息技术股份有限公司 | Method and device for synchronizing variable data, electronic device and storage medium |
CN112163042B (en) * | 2020-09-24 | 2024-01-23 | 杭州安恒信息技术股份有限公司 | Multi-variable data synchronization method and device, electronic device and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10255108B2 (en) | Parallel execution of blockchain transactions | |
CN110334152A (en) | A kind of method of data synchronization, device and server | |
US9047330B2 (en) | Index compression in databases | |
CN108133007A (en) | A kind of method of data synchronization and system | |
CN109002474A (en) | A kind of data migration method and device | |
CN108121757A (en) | A kind of method of data synchronization, device, system, computing device and storage medium | |
CN107590207A (en) | Method of data synchronization and device, electronic equipment | |
CN104598550B (en) | A kind of update method and device of Internet video index | |
US10198346B1 (en) | Test framework for applications using journal-based databases | |
US10133767B1 (en) | Materialization strategies in journal-based databases | |
CN104794155B (en) | The method, apparatus and system of data load | |
CN109919691A (en) | A kind of system of data processing, method and device | |
CN110413595A (en) | A kind of data migration method and relevant apparatus applied to distributed data base | |
CN109446268A (en) | A kind of method of data synchronization and device | |
CN109299096A (en) | A kind of processing method of pipelined data, device and equipment | |
CN104462036B (en) | A kind of method and system of the format information of synchro edit document | |
CN104714957A (en) | List structure changing method and device | |
CN110019200A (en) | A kind of foundation of index, application method and device | |
CN108073595A (en) | It is a kind of to realize data update and the method and device of snapshot in olap database | |
CN107133243A (en) | A kind of data processing method and server | |
CN110471943A (en) | Real time data statistic device and method and computer readable storage medium | |
US10262000B1 (en) | Global distributed file append using log-structured file system | |
CN105955971B (en) | A kind of implementation method and device of key assignments caching | |
CN107622059A (en) | A kind of method and system for improving database search efficiency | |
CN109582476A (en) | Data processing method, apparatus and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190308 |