CN105183898A - Data sync method and data sync system - Google Patents

Data sync method and data sync system Download PDF

Info

Publication number
CN105183898A
CN105183898A CN201510634866.2A CN201510634866A CN105183898A CN 105183898 A CN105183898 A CN 105183898A CN 201510634866 A CN201510634866 A CN 201510634866A CN 105183898 A CN105183898 A CN 105183898A
Authority
CN
China
Prior art keywords
data
marker bit
flag
content position
correspondence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510634866.2A
Other languages
Chinese (zh)
Inventor
谭建南
郑程
李雄锋
王天兴
武绍龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201510634866.2A priority Critical patent/CN105183898A/en
Publication of CN105183898A publication Critical patent/CN105183898A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/275Synchronous replication

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a data sync method and a data sync system. The data sync method and the data sync system are utilized to sync data in a primary database to a target database. The primary database comprises at least one storage datum, and each storage datum comprises a content bit. The data sync method comprises the steps that flag data are set in the primary database, when one content bit in one of the storage data is modified, a flag bit is set in a corresponding flag datum, and the content of the corresponding content bit is written in the target database according to the flag bit when the flag data are scanned and the flag bit is scanned. According to the data sync method and the sync system, the modified storage data are flagged, the method is simple, the data synchronization efficiency of a cross-database is improved, the flag bit occupies small memory, the instantaneity and the consistency of the data synchronization are achieved, the cost performance is high, and the data sync method and the data sync system have the advantages of reducing data synchronization quantity and improving the synchronization efficiency.

Description

Method of data synchronization and data synchronous system
Technical field
The present invention relates to database field, be specifically related to a kind of method of data synchronization and data synchronous system.
Background technology
Nowadays, there are two kinds of problems at present in the data syn-chronization between integration across database:
1) rely on other intermediate systems, make synchro system too complicated, cause system unstable.Time bug appears in system, the debugging quantities of system is large, and time efficiency is low;
2) real-time and consistance that comparatively complicated technology ensures data is relied on.Technology is too complicated, is difficult to co mpiler optimization and generates efficient object code.Executing efficiency is low, and code refactoring time cost is high, and whole programming process is not cost-effective.
Therefore, this area needs to propose a kind of simple method of data synchronization efficiently, ensures real-time and the consistance of data syn-chronization, also decreases the synchronous amount of data simultaneously to a certain extent.
Summary of the invention
The present invention proposes a kind of method of data synchronization, for by the data syn-chronization in raw data base to target database, described raw data base comprise at least one store data, store data described in each and comprise content position, it is characterized in that, described method of data synchronization comprises:
In described raw data base, flag data is set;
When a content position of one of them storage data is modified, marker bit is set in the described flag data of correspondence; And
Scanning described flag data, when scanning this marker bit, according to this marker bit, the content of this content position of correspondence being write described target database.
In one embodiment, described flag data has identical form with described storage data, and when a content position of one of them storage data is modified, the step arranging marker bit in the described flag data of correspondence comprises further:
According to the address at revised place, content position, marker bit is set in the identical address of the flag data of described correspondence.
In one embodiment, described address is according to the line position of described content position and row established data position, position.
In one embodiment, described raw data base comprises data form, and described storage data are memory row race, and the step arranging flag data in described raw data base comprises:
Newly-built flag column race in each data form.
In one embodiment, when a content position of one of them storage data is modified, the step arranging marker bit in the described flag data of correspondence comprises:
For the row and column of the memory row race at place, described content position, marker bit is set in the colleague mutually and same column of described flag column race, whether changes to mark described content position.
In one embodiment, after according to this marker bit the content of this content position of correspondence being write the step of described target database, also comprise:
Delete the marker bit of described content position correspondence.
In one embodiment, described raw data base is HBase database, and described target database is MongoDB database.
In one embodiment, described marker bit is write marker bit and/or delete flag position.
One embodiment of the invention also proposes a kind of data synchronous system, for by the data syn-chronization in raw data base to target database, described raw data base comprises at least one and stores data, and store data described in each and comprise content position, described data synchronous system comprises:
Memory Allocation unit, for arranging the internal memory in order to storage mark data in described raw data base;
Writing unit: when a content position for storing data when one of them is modified, write marker bit in the described flag data of correspondence;
Scanning transmitting element: for scanning in this internal memory whether there is marker bit, and when scanning described marker bit, according to this marker bit, the content of this content position of correspondence is write described target database.
In one embodiment, also comprise:
Delete cells, for deleting the marker bit of the content position correspondence after synchronous success.
In one embodiment, described flag data has identical form with described storage data, and said write unit, according to the address at revised place, content position, arranges described marker bit in the identical address of the flag data of described correspondence.
In one embodiment, described storage data are memory row race, a newly-built flag column race in the data form of described Memory Allocation unit in described raw data base; Whether said write unit often going and often arranging also for described memory row race, arrange described marker bit, change to mark described content position in the colleague mutually and same column of described flag column race.
In one embodiment, described marker bit is write marker bit and/or delete flag position.
One embodiment of the invention also proposes a kind of data synchronous system, for by the data syn-chronization in raw data base to target database, described raw data base comprises at least one and stores data, store data described in each and comprise content position, a Memory Allocation unit is used for the internal memory arranged in described raw data base in order to storage mark data; One writing unit is used for when a content position of one of them storage data is modified, and in the described flag data of correspondence, write marker bit, it is characterized in that, this data synchronous system comprises:
Scanning transmitting element: for scanning in this internal memory whether there is marker bit, and when scanning described marker bit, according to this marker bit, the content of this content position of correspondence is write described target database; And
Delete cells, for deleting the marker bit of the content position correspondence after synchronous success.
Known by foregoing description, compared to prior art, the present invention at least tool has the following advantages:
1) usage flag position marks storage data amended in database, and method is simple, instead of the technical scheme of more complicated, improves the efficiency of data syn-chronization.
2) shared by marker bit, internal memory is negligible, and exchange real-time and the consistance of data syn-chronization for minimum internal memory, cost performance is high.
3) because the marker bit of each retouching operation in a database only can safeguard portion, when the carrying out of identical content position repeatedly being revised simultaneously, be as the criterion with Last modification operation and data carried out one subsynchronous, decreasing data syn-chronization amount, improve synchronous efficiency.
4) when the data successful synchronization of content position corresponding to marker bit is to target database, this marker bit is deleted; When synchronization failure, this marker bit is left intact, until this marker bit is just deleted by data syn-chronization success.The method improves system synchronization accuracy rate.
5) do not rely on other intermediate systems, the scope of application is wider.
Accompanying drawing explanation
Figure 1 shows that the process flow diagram of the method for data synchronization of one embodiment of the invention.
Figure 2 shows that at least one storage in the raw data base of one embodiment of the invention stores the data layout figure of data.
Figure 3 shows that the data layout figure of the flag data of the storage data corresponding to Fig. 2.
Figure 4 shows that the flow chart of steps of the method for data synchronization of one embodiment of the invention.
Figure 5 shows that the module map of the data synchronous system of one embodiment of the invention.
Embodiment
Here will be described exemplary embodiment in detail, its sample table shows in the accompanying drawings.When description below relates to accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawing represents same or analogous key element.Embodiment described in following exemplary embodiment does not represent all embodiments consistent with the application.On the contrary, they only with as in appended claims describe in detail, the partial example of equipment that some aspects of the application are consistent and method.
Figure 1 shows that the schematic diagram of the method for data synchronization of one embodiment of the invention.Problem to be solved by this invention is the data synchronization problems of integration across database, particularly, sets up synchronous approach between raw data base and target database.This method is not only simple efficient, can not only ensure real-time and the consistance of data syn-chronization, also decrease the synchronous amount of data simultaneously to a certain extent.
The method of data synchronization that one embodiment of the invention proposes is used for by the data syn-chronization in raw data base to target database, and wherein this raw data base comprises at least one storage data, and each stores data and comprises content position, and this synchronous method comprises following flow process:
Step 1, arranges flag data in raw data base;
Step 2, when a content position of one of them storage data is modified, arranges marker bit in the described flag data of correspondence; And
Step 3, scans described flag data, according to this marker bit, the content of this content position of correspondence is write described target database.
Accordingly, one embodiment of the invention proposes a kind of data synchronous system, for by the data syn-chronization in raw data base to target database, described raw data base comprise at least one store data, store data described in each and comprise content position, described data synchronous system comprises:
Memory Allocation unit, for arranging the internal memory in order to storage mark data in described raw data base;
Writing unit: when a content position for storing data when one of them is modified, write marker bit in the described flag data of correspondence;
Scanning transmitting element: for scanning in this internal memory whether there is marker bit, and when scanning described marker bit, according to this marker bit, the content of this content position of correspondence is write described target database.
Below in conjunction with the drawings and specific embodiments, the solution of the present invention is specifically described.
Figure 2 shows that at least one storage in the raw data base of one embodiment of the invention stores the data layout figure of data.As shown in Figure 2, in the present embodiment, these storage data comprise address and content position, the two one_to_one corresponding, such as, address is made up of the rower (rowkey) in this data layout and row mark (c1, c2, c3, c4 etc.), the position of each content position all can be determined by address, such as, the content of the content position that (rowKey=00001, column (d1)=c2) this address is corresponding is " Jack "; Content position corresponding to (rowKey=00002, column (d1)=c3) this address is " 22 ".Therefore, in same storage data, each content position has unique corresponding address.One or more content position and address is stored in this raw data base.
Figure 3 shows that the data layout figure of the flag data stored in the raw data base of one embodiment of the invention.Here " mutually corresponding data layout " refers to that each marker bit has unique corresponding address, and the content position stored in data can be inquired by this address, namely, its address can be known by the content position arranging race d1, can be inquired the marker bit of corresponding address in row race d2 by this address, vice versa.In brief, marker bit, address and content position three are uniquely corresponding.
Such as, according to (rowKey=00001, column=c2) this address of Tu3Lie race d2, put/delete mark can be corresponded to, can store according to this address the content position " Jack " inquiring correspondence in data simultaneously.
In above-mentioned steps, first can open up one piece of region of memory in raw data base, for storage mark data, this step can be performed by java program, also can by other means, and the present invention is not particularly limited.
In step 1, this flag data and aforesaid storage data can have mutually corresponding data layout, and this flag data comprises at least one address and marker bit, this address and this marker bit one_to_one corresponding.
In step 3, can passing marker data, judge whether each flag data equals special value.In this step, for Fig. 3, user can arrange put/delete mark, such as, when storing the content position of data in step 2 through amendment, then corresponding marker bit can be modified to " 1 " or other special values, so that detecting device (observer) scans.In other embodiments, described put/Delete mark also can be arbitrary data, when detecting device detects these data, carries out next step.This step can be performed by detecting device, also can be performed by other hardware or software, be not particularly limited.
In step 3, passing marker data, according to this marker bit by the content of correspondence write target database, when namely detecting that flag data equals special value, according to the unique corresponding address of marker bit, determine to store content position corresponding in data, and by this content position write target database.The present embodiment take target database as MongoDB database is example, and the content position determined in step 3 is synchronized in MongoDB database.
In above-described embodiment, raw data base and target database are non-relational database.But in other embodiments, the type of raw data base and target database is not particularly limited, such as, can be relevant database, non-relational database etc.
In other embodiments, such as raw data base is that this is distributed, towards the PostgreSQL database of row for HBase, marker bit can be set in the different lines of HBase, whether change with the data marking corresponding content position, then will change the data syn-chronization of row to other databases.Concrete, safeguard one piece of marker bit with same column name in row race new in the row that HBase is identical according to wanting synchrodata, and in each row of data block, the marker bit of each row only has portion.By program timing passing marker position, then according to the row name of marker bit find these row data and by the database of data syn-chronization to other.Marker bit is very little and can be stored in internal memory, thus can be close to real-time time synchrodata to other database; Data only have successful synchronization just can delete corresponding marker bit to other database, ensure the data consistency between database; The data of all only synchronous up-to-date amendment when at every turn carrying out data syn-chronization, decrease the synchronous amount of data.
Further, the data that content position stores and corresponding marker bit can be placed in the different lines race of same table and store, also can be placed on different table but store in same column race, all can mark in the marker bit of correspondence amendment (put/delete) operation storing data at every turn and (only preserve a mark value, old mark can cover by new mark), and detecting device (Observer) scans these marker bits at certain intervals, corresponding for marker bit often go (rowKey decision) is revised the content synchronization of row to other database.
Fig. 4 is the process flow diagram of the method for data synchronization of one embodiment of the invention.As shown in Figure 4, in one embodiment, the step 1 i.e. step of " arranging flag data in raw data base " is specially:
One piece of region of memory is opened up, the newly-built flag data form corresponding to each data table memory lattice in this region of memory in raw data base.
Particularly, when raw data base is HBase database, this step is: at newly-built Ge Lie race (d) of each HBase table, safeguard one piece of region of memory, for the often row of each row of data, mark whether to change (only preserving portion) in respective column of all going together mutually in row race (d).This step can be described as " system initialization ".
In one embodiment, the step that namely step 2 " when revising one of them and storing a content position of data, arranges marker bit " in the described flag data of correspondence is specially:
Storage data are write at every turn or deletion action time, the relevant position in flag data is needed to upgrade the marker bit corresponding to this content position, each marker bit only safeguards portion in internal memory, therefore can carry out the operation of multiple write, deletion simultaneously, be as the criterion to operate for the last time.
Particularly, when raw data base is HBase database, this step is: when carrying out put or delete operation to HBase at every turn, need update mark position in the middle corresponding line respective column of row race (d), and each marker bit only safeguards portion in internal memory, when therefore carrying out multiple put or delete operation, be as the criterion with last put or delete operation simultaneously.This step can be called " marker bit renewal ".
In one embodiment, the step 3 i.e. step of " scan described flag data, according to this marker bit, the content of this content position of correspondence is write described target database " is specially:
Interval at regular intervals, the marker bit in scanning raw data base, for the marker bit of change, takes out the content position of the correspondence storing data, by this content bit synchronization to other databases according to its address.
Particularly, when raw data base is HBase database, this step is: the marker bit scanning different Biao Zhonglie race (d) in HBase every certain time interval (gap size depends on the height of system to requirement of real-time).For the marker bit of change, take out the content of this row particular column according to the rowKey of its corresponding row and row name, and then by the data syn-chronization that takes out to other databases.This step can be called " data synchronous ".
In one embodiment, after same EOS, the method also comprises:
Step 4 ': the marker bit deleting described content position correspondence.Particularly, when raw data base is HBase database, this step is: when data successful synchronization corresponding to this marker bit is to other databases, and then deleted by this marker bit, reduces the data volume of the every wheel scan of detecting device (Observer); When data syn-chronization corresponding to this marker bit is to other failed databases, this marker bit is left intact, when detecting device (Observer) lower whorl scans this marker bit again, again again by data syn-chronization corresponding for this marker bit to other databases, by that analogy, until this marker bit is just deleted to other databases by successful synchronization by data.Only be absorbed in the process responsibility of oneself processing stage of each like this, and other processing procedure need not be paid close attention to.
In one embodiment, as shown in Figure 1, after same EOS, the method also comprises:
Step 4: synchronous successfully message is sent to user.
Fig. 5 is the module map of the data synchronous system of one embodiment of the invention.As shown in Figure 5, another embodiment of the present invention also proposes a kind of data synchronous system, for by the data syn-chronization in raw data base to target database, described raw data base comprise at least one store data, store data described in each and comprise content position, described data synchronous system comprises:
Memory Allocation unit 10, for arranging internal memory in raw data base, for storage mark data;
Writing unit 20: when a content position for storing data when one of them is modified, write marker bit in the flag data of correspondence;
Scanning transmitting element 30: for scanning in this internal memory whether there is marker bit, and when scanning described marker bit, according to this marker bit, the content of this content position of correspondence is write described target database.
In an embodiment of data synchronous system of the present invention, when described storage data are memory row race, described Memory Allocation unit 10 is a newly-built flag column race in each data form.
In an embodiment of data synchronous system of the present invention, this writing unit 20, according to the address of revised content position, arranges marker bit in the identical address of the flag data of correspondence.Further, described address is according to the line position of described content position and row established data position, position.
In an embodiment of data synchronous system of the present invention, said write unit 20 can also, for the often row of the often row of described memory row race, mark whether to change in the colleague mutually and same column of described flag column race.Further, if do not changed, then marker bit is not set.
In an embodiment of data synchronous system of the present invention, also comprise:
Delete cells 40, for deleting the marker bit of the content position correspondence after synchronous success.
In an embodiment of data synchronous system of the present invention, also comprise:
Reporting unit, for sending synchronous success message to user after synchronous success.
In an embodiment of data synchronous system of the present invention, raw data base can be HBase database, and target database can be MongoDB database.
In an embodiment of data synchronous system of the present invention, described marker bit is write marker bit and/or delete flag position.
As shown in wire frame in Fig. 5, yet another embodiment of the invention proposes a kind of data synchronous system, for synchrodata between raw data base and target database.Wherein, store in raw data base and store data and flag data, a Memory Allocation unit 10 for arranging the internal memory in order to storage mark data in described raw data base; One writing unit 20 writes data in a content position of these storage data, and in the flag data corresponding to storage data, arranges marker bit when writing data, and this data synchronous system comprises:
Scanning transmitting element 30: for scanning in this internal memory whether there is marker bit, and when scanning described marker bit, according to this marker bit, the content of this content position of correspondence is write described target database; And
Delete cells 40, for deleting the marker bit of the content position correspondence after synchronous success.
Known by foregoing description, compared to prior art, the present invention at least tool has the following advantages:
1) usage flag position marks storage data amended in database, and method is simple, instead of the technical scheme of more complicated, improves the efficiency of data syn-chronization.
When raw data base is HBase database, the amendment of usage flag position to the row of each row of data in HBase marks, and method is simple, improves the efficiency of data syn-chronization in HBase.Do not affect HBase performance and do not revise HBase kernel prerequisite under, achieve by HBase real time data synchronization to other databases, effectively to solve in database data inconsistency and non real-time nature in read and write abruption model.
2) shared by marker bit, internal memory is negligible, and exchange real-time and the consistance of data syn-chronization for minimum internal memory, cost performance is high.
3) because the marker bit of each retouching operation in a database only safeguards portion, when the carrying out of identical content position repeatedly being revised simultaneously, be as the criterion with Last modification operation and data carried out one subsynchronous, decreasing data syn-chronization amount, improve synchronous efficiency.
When raw data base is HBase database, because the marker bit of retouching operation each in HBase only safeguards portion, when the carrying out of same column repeatedly being revised simultaneously, be as the criterion with Last modification operation and data carried out one subsynchronous, decrease data syn-chronization amount, improve synchronous efficiency.
4) when data successful synchronization corresponding to marker bit is to target database, this marker bit is then deleted; When synchronization failure, this marker bit is left intact, until this marker bit is just deleted by data syn-chronization success.The method improves system synchronization accuracy rate.
5) do not rely on other intermediate systems, the scope of application is wider.
Those skilled in the art, at consideration instructions and after putting into practice disclosure herein, will easily expect other embodiment of the application.The application is intended to contain any modification of the present disclosure, purposes or adaptations, and these modification, purposes or adaptations are followed the general principle of the application and comprised the undocumented common practise in the art of the application or conventional techniques means.Instructions and embodiment are only regarded as exemplary, and true scope and the spirit of the application are pointed out by claim.
Should be understood that, the application is not limited to precision architecture described above and illustrated in the accompanying drawings, and can carry out various amendment and change not departing from its scope.The scope of the application is only limited by appended claim.

Claims (14)

1. a method of data synchronization, for by the data syn-chronization in raw data base to target database, described raw data base comprise at least one store data, store data described in each and comprise content position, it is characterized in that, described method of data synchronization comprises:
In described raw data base, flag data is set;
When a content position of one of them storage data is modified, marker bit is set in the described flag data of correspondence; And
Scanning described flag data, when scanning this marker bit, according to this marker bit, the content of this content position of correspondence being write described target database.
2. method of data synchronization as claimed in claim 1, it is characterized in that, described flag data has identical form with described storage data, and when a content position of one of them storage data is modified, the step arranging marker bit in the described flag data of correspondence comprises further:
According to the address at revised place, content position, marker bit is set in the identical address of the flag data of described correspondence.
3. method of data synchronization as claimed in claim 2, is characterized in that, described address is line position according to described content position and row established data position, position.
4. method of data synchronization as claimed in claim 1, it is characterized in that, described raw data base comprises data form, and described storage data are memory row race, and the step arranging flag data in described raw data base comprises:
Newly-built flag column race in each data form.
5. method of data synchronization as claimed in claim 4, is characterized in that, when a content position of one of them storage data is modified, the step arranging marker bit in the described flag data of correspondence comprises:
For the row and column of the memory row race at place, described content position, marker bit is set in the colleague mutually and same column of described flag column race, whether changes to mark described content position.
6. method of data synchronization as claimed in claim 1, is characterized in that, after according to this marker bit the content of this content position of correspondence being write the step of described target database, also comprises:
Delete the marker bit of described content position correspondence.
7. method of data synchronization as claimed in claim 4, it is characterized in that, described raw data base is HBase database, and described target database is MongoDB database.
8. method of data synchronization as claimed in claim 1, is characterized in that, described marker bit is write marker bit and/or delete flag position.
9. a data synchronous system, for by the data syn-chronization in raw data base to target database, described raw data base comprise at least one store data, store data described in each and comprise content position, described data synchronous system comprises:
Memory Allocation unit, for arranging the internal memory in order to storage mark data in described raw data base;
Writing unit: when a content position for storing data when one of them is modified, write marker bit in the described flag data of correspondence;
Scanning transmitting element: for scanning in this internal memory whether there is marker bit, and when scanning described marker bit, according to this marker bit, the content of this content position of correspondence is write described target database.
10. data synchronous system as claimed in claim 9, is characterized in that, also comprise:
Delete cells, for deleting the marker bit of the content position correspondence after synchronous success.
11. data synchronous systems as claimed in claim 9, it is characterized in that, described flag data has identical form with described storage data, and said write unit, according to the address at revised place, content position, arranges described marker bit in the identical address of the flag data of described correspondence.
12. data synchronous systems as claimed in claim 11, is characterized in that,
Described storage data are memory row race, a newly-built flag column race in the data form of described Memory Allocation unit in described raw data base; Whether said write unit often going and often arranging also for described memory row race, arrange described marker bit, change to mark described content position in the colleague mutually and same column of described flag column race.
13. data synchronous systems as claimed in claim 9, is characterized in that, described marker bit is write marker bit and/or delete flag position.
14. 1 kinds of data synchronous systems, for by the data syn-chronization in raw data base to target database, described raw data base comprises at least one and stores data, store data described in each and comprise content position, a Memory Allocation unit is used for the internal memory arranged in described raw data base in order to storage mark data; One writing unit is used for when a content position of one of them storage data is modified, and in the described flag data of correspondence, write marker bit, it is characterized in that, this data synchronous system comprises:
Scanning transmitting element: for scanning in this internal memory whether there is marker bit, and when scanning described marker bit, according to this marker bit, the content of this content position of correspondence is write described target database; And
Delete cells, for deleting the marker bit of the content position correspondence after synchronous success.
CN201510634866.2A 2015-09-29 2015-09-29 Data sync method and data sync system Pending CN105183898A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510634866.2A CN105183898A (en) 2015-09-29 2015-09-29 Data sync method and data sync system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510634866.2A CN105183898A (en) 2015-09-29 2015-09-29 Data sync method and data sync system

Publications (1)

Publication Number Publication Date
CN105183898A true CN105183898A (en) 2015-12-23

Family

ID=54905979

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510634866.2A Pending CN105183898A (en) 2015-09-29 2015-09-29 Data sync method and data sync system

Country Status (1)

Country Link
CN (1) CN105183898A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105656802A (en) * 2016-03-09 2016-06-08 成都爆米花信息技术有限公司 Data synchronization method
CN105787077A (en) * 2016-03-02 2016-07-20 百度在线网络技术(北京)有限公司 Data synchronizing method and device
CN105825133A (en) * 2016-03-09 2016-08-03 成都爆米花信息技术有限公司 Synchronous data storage method
CN107038150A (en) * 2016-02-03 2017-08-11 阿里巴巴集团控股有限公司 Filling method, system, terminal and the server of list content
CN107943829A (en) * 2017-10-20 2018-04-20 珠海许继芝电网自动化有限公司 A kind of cross-safety zone database synchronization method
CN113297280A (en) * 2021-06-10 2021-08-24 北京开科唯识技术股份有限公司 Data processing method and device, electronic equipment and storage medium
CN113495877A (en) * 2020-04-03 2021-10-12 北京罗克维尔斯科技有限公司 Data synchronization method and system
US11386089B2 (en) 2020-01-13 2022-07-12 The Toronto-Dominion Bank Scan optimization of column oriented storage

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1411215A (en) * 2001-10-03 2003-04-16 卓联半导体V·N·有限公司 Pacing synchronizing method for rout selecting information in data exchange environmemt
CN1731400A (en) * 2005-08-16 2006-02-08 杭州华为三康技术有限公司 Method of data query and method of inter-board data synchronization in distributed system
CN101419616A (en) * 2008-12-10 2009-04-29 阿里巴巴集团控股有限公司 Data synchronization method and apparatus
CN103886091A (en) * 2014-04-01 2014-06-25 无锡科技职业学院 Database synchronization method based on record marks
CN104486387A (en) * 2014-12-02 2015-04-01 浪潮(北京)电子信息产业有限公司 Data synchronization processing method and system
CN104820701A (en) * 2015-05-11 2015-08-05 北京瑞星信息技术有限公司 Method and system for recording and synchronizing data

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1411215A (en) * 2001-10-03 2003-04-16 卓联半导体V·N·有限公司 Pacing synchronizing method for rout selecting information in data exchange environmemt
CN1731400A (en) * 2005-08-16 2006-02-08 杭州华为三康技术有限公司 Method of data query and method of inter-board data synchronization in distributed system
CN101419616A (en) * 2008-12-10 2009-04-29 阿里巴巴集团控股有限公司 Data synchronization method and apparatus
CN103886091A (en) * 2014-04-01 2014-06-25 无锡科技职业学院 Database synchronization method based on record marks
CN104486387A (en) * 2014-12-02 2015-04-01 浪潮(北京)电子信息产业有限公司 Data synchronization processing method and system
CN104820701A (en) * 2015-05-11 2015-08-05 北京瑞星信息技术有限公司 Method and system for recording and synchronizing data

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107038150A (en) * 2016-02-03 2017-08-11 阿里巴巴集团控股有限公司 Filling method, system, terminal and the server of list content
CN107038150B (en) * 2016-02-03 2021-03-05 阿里巴巴集团控股有限公司 Filling-in method, system, terminal and server of form content
CN105787077A (en) * 2016-03-02 2016-07-20 百度在线网络技术(北京)有限公司 Data synchronizing method and device
CN105656802A (en) * 2016-03-09 2016-06-08 成都爆米花信息技术有限公司 Data synchronization method
CN105825133A (en) * 2016-03-09 2016-08-03 成都爆米花信息技术有限公司 Synchronous data storage method
CN107943829A (en) * 2017-10-20 2018-04-20 珠海许继芝电网自动化有限公司 A kind of cross-safety zone database synchronization method
US11386089B2 (en) 2020-01-13 2022-07-12 The Toronto-Dominion Bank Scan optimization of column oriented storage
CN113495877A (en) * 2020-04-03 2021-10-12 北京罗克维尔斯科技有限公司 Data synchronization method and system
CN113297280A (en) * 2021-06-10 2021-08-24 北京开科唯识技术股份有限公司 Data processing method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN105183898A (en) Data sync method and data sync system
CN101162149B (en) Method for realizing remote map guidance data rapid renewing of networking vehicle mounted guidance terminal
CN107688999A (en) A kind of parallel transaction based on block chain performs method
CN102799679B (en) Hadoop-based massive spatial data indexing updating system and method
CN112286941B (en) Big data synchronization method and device based on Binlog + HBase + Hive
CN102982085A (en) System and method of data migration
CN103488710B (en) The non-fixed-length data method of efficient storage in big data page
CN106250226A (en) Task Scheduling Mechanism based on concordance hash algorithm and system
CN102929795A (en) NandFlash bad block management method
CN100507921C (en) Words display process in embedded system and system thereof
CN102033948A (en) Method and device for updating data
CN105912601A (en) Partition storage method for distributed real-time memory database of energy management system
CN102411634A (en) Data storage method for improving instantaneity of embedded type database
CN106339387B (en) Increase the method for data synchronization and device of server in a kind of data-base cluster newly
CN111143368A (en) Relational database data comparison method and system
CN111324577A (en) Method and device for reading and writing Yml file
CN103246549A (en) Method and system for data transfer
US10229142B2 (en) Method and system for handling binary large objects
CN102486753A (en) Method and device for constructing and accessing cache as well as storage system
CN109814895A (en) A kind of database update method and system of automation
CN103150273A (en) Bit-level memory controller and method thereof
CN104049947A (en) Dynamic Rename Based Register Reconfiguration Of A Vector Register File
CN109033353A (en) A kind of Power quality management system shared drive update method
CN111522827A (en) Data updating method and device and electronic equipment
CN105488047B (en) Metadata reading/writing method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20151223

RJ01 Rejection of invention patent application after publication