CN109656992A - A kind of data transmission account checking method, device and equipment - Google Patents
A kind of data transmission account checking method, device and equipment Download PDFInfo
- Publication number
- CN109656992A CN109656992A CN201811426737.4A CN201811426737A CN109656992A CN 109656992 A CN109656992 A CN 109656992A CN 201811426737 A CN201811426737 A CN 201811426737A CN 109656992 A CN109656992 A CN 109656992A
- Authority
- CN
- China
- Prior art keywords
- data
- source
- destination
- consistent
- inconsistent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000005540 biological transmission Effects 0.000 title abstract description 20
- 230000001360 synchronised effect Effects 0.000 claims abstract description 47
- 238000004422 calculation algorithm Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 5
- 235000013399 edible fruits Nutrition 0.000 claims 1
- 230000005012 migration Effects 0.000 description 7
- 238000013508 migration Methods 0.000 description 7
- 241001269238 Data Species 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 239000000284 extract Substances 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013524 data verification Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of data transmission account checking methods, device, equipment and computer readable storage medium, wherein this method comprises: determination need to realize that the synchronous storage unit of data is source, need to will hold for the purpose of storage unit that the data of the source are synchronized to；During the incremental data of the source is synchronized to the destination, judge whether the data in the source and the destination are consistent, if it is, it is then returned after preset time period and executes the step for judging whether the data in the source and the destination are consistent, if not, inconsistent data are then retransmitted to the destination by the source, and is returned after preset time period and executes the step for judging whether the data in the source and the destination are consistent.The application ensure that the data consistency of source and destination in such a way that this timing reconciliation is transmitted.
Description
Technical field
The present invention relates to data synchronization technology field, more specifically to a kind of data transmission account checking method, device,
Equipment and computer readable storage medium.
Background technique
Data synchronization technology refer to the data by source (need to carry out data synchronous side) be synchronized to destination (need by
The side that the data of source are synchronized to) so that the technology of the being consistent property of data of the data of destination and source, data are synchronous
Technology is commonly applied in the data-storage systems such as database.
In the prior art when needing the Data Migration of source to destination, it usually needs the number that will first be saved in source
Destination is synchronized to according to migrating to destination, then by the data that the Data Migration moment starts to generate variation in source, wherein source
The migration of the data of middle preservation is the migration of data on stock, and the synchronization for the data for generating variation in source is incremental data
It is synchronous.Inventor test discovery, realize incremental data synchronizing process in, if external environment is complicated, as data high concurrent,
Data volume is big, data are transmitted and environment is written passes the case where losing there are when unusual fluctuations, often will appear data leakage,
And then the data of source and destination is caused to cannot achieve consistency.
Source and purpose end data are not can guarantee in conclusion existing during realizing that data are synchronous in the prior art
The case where consistency.
Summary of the invention
The object of the present invention is to provide a kind of data to transmit account checking method, device, equipment and computer readable storage medium,
It is able to solve and existing during realizing that data are synchronous in the prior art not can guarantee source and destination data consistency
The case where.
To achieve the goals above, the invention provides the following technical scheme:
A kind of data transmission account checking method, comprising:
Determination need to realize that the synchronous storage unit of data is source, the storage unit that need to be synchronized to the data of the source
For the purpose of hold；
During the incremental data of the source is synchronized to the destination, the source and the purpose are judged
Whether the data in end are consistent, execute the judgement source and the mesh if it is, returning after preset time period
End in the whether consistent step of data, if it is not, then inconsistent data are retransmitted to the destination by the source,
And it is returned after preset time period and executes the step for judging whether the data in the source and the destination are consistent.
Preferably, inconsistent data are retransmitted to after the destination by the source, further includes:
Judge whether the data in the source and the destination are consistent, if it is, determining that this reconciliation transfers
At if it is not, then inconsistent data are retransmitted to the destination by the source, and returning and execute the judgement source
The whether consistent step of data in end and the destination, until until the number of progress data re-transmission reaches preset times.
Preferably, judge whether the data in the source and the destination are consistent, comprising:
Calculate separately the data in the source and the destination using hash algorithm, obtain respectively with the source and
The corresponding cryptographic Hash of the destination；
Whether cryptographic Hash corresponding with the source and the destination is identical respectively for judgement, if it is, described in determining
Data in source and the destination are consistent, if it is not, then determining that the data in the source and the destination are inconsistent.
Preferably, the data in the source and the destination are calculated separately using hash algorithm, comprising:
The data in the source and the destination are calculated separately using MD5 algorithm.
Preferably, the incremental data of the source is synchronized to the destination, comprising:
The corresponding trigger of source and snapshot unit are created, indicates that the trigger changes in the data of the source
When capture variation data, and the data of capture are written into the snapshot unit；
Snapshot unit described in timing scan, and the data that scanning obtains are synchronized in the destination.
Preferably, after judging whether data in the source and the destination are consistent, further includes:
Result that whether data judged in the source and the destination unanimously obtain is written to being pre-created
In comparison result table, for inquiry.
A kind of data transmission account checking apparatus, comprising:
Determining module is used for: determination need to realize that the synchronous storage unit of data is source, need to be same by the data of the source
It is held for the purpose of the storage unit of step extremely；
Reconciliation module, is used for: during the incremental data of the source is synchronized to the destination, described in judgement
Whether the data in source and the destination are consistent, execute the judgement institute if it is, returning after preset time period
The whether consistent step of data in source and the destination is stated, if it is not, then by inconsistent data by the source weight
The destination is reached, and is returned after preset time period and executes the data judged in the source and the destination
Whether consistent step.
Preferably, further includes:
It checks module, is used for: after inconsistent data are retransmitted to the destination by the source, judging the source
Whether the data in end and the destination are consistent, if it is, determining that this reconciliation is transmitted, if it is not, then by different
The data of cause are retransmitted to the destination by the source, and return and execute in the judgement source and the destination
The whether consistent step of data, until the number for carrying out data re-transmission reaches preset times.
A kind of data transmission reconciliation equipment, comprising:
Memory, for storing computer program；
Processor realizes the step of the as above any one data transmission account checking method when for executing the computer program
Suddenly.
A kind of computer readable storage medium is stored with computer program on the computer readable storage medium, described
The step of as above any one data transmit account checking method is realized when computer program is executed by processor.
The present invention provides a kind of data transmission account checking method, device, equipment and computer readable storage mediums, wherein
This method comprises: determination need to realize that the synchronous storage unit of data is source, the storage that need to be synchronized to the data of the source
It is held for the purpose of unit；During the incremental data of the source is synchronized to the destination, the source and institute are judged
Whether the data stated in destination consistent, if it is, returned after preset time period execute the judgement source and
The whether consistent step of data in the destination, if it is not, then inconsistent data are retransmitted to by the source described
Destination, and return to execution is described to judge whether the data in the source and the destination are consistent after preset time period
The step of.It is every by pre- during the incremental data of source is synchronized to destination in technical solution disclosed by the invention
If the period then judges whether the data of source and destination are consistent, and when the judgment result is No by by inconsistent data
Destination is retransmitted to by source, to ensure that the data of source and destination are consistent in such a way that this timing reconciliation is transmitted
Property.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of invention for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is the flow chart that a kind of data provided in an embodiment of the present invention transmit account checking method；
Fig. 2 is the structural schematic diagram that a kind of data provided in an embodiment of the present invention transmit account checking apparatus.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
It, can be with referring to Fig. 1, it illustrates a kind of flow chart of data transmission account checking method provided in an embodiment of the present invention
Include:
S11: determination need to realize that the synchronous storage unit of data is source, the storage unit that need to be synchronized to the data of source
For the purpose of hold.
It should be noted that a kind of data transmission account checking method, device, equipment and computer provided in an embodiment of the present invention
Readable storage medium storing program for executing can be applied in any scene for needing to realize that data are synchronous, below with technical solution provided by the present application
Applied to being specifically described in this scene of database.In addition, a kind of data provided in an embodiment of the present invention transmit reconciliation side
The step of not indicating subject in method, account checking apparatus can be transmitted for corresponding data by executing subject, which transmits reconciliation dress
Setting can specifically be can be by Middleware implementation by ETL Middleware implementation, so that reconciliation function and ETL function be combined closely.
Specifically, middleware is a kind of independent system software or service routine, can be in different storage units by middleware
Between shared resource；ETL is the abbreviation of Extract Transformation Load, that is, extracts, converts, load；To ETL
Middleware extracts data from source, then converts to data, data are finally loaded into destination.
In addition, the reconciliation in a kind of data transmission account checking method provided in an embodiment of the present invention refers to source and destination
Data whether consistent (unanimously referring both in the application is identical) check, wherein the storage list of source and destination meaning
Member can be database or table, text file in database etc..Also, any storage unit for needing to realize that data are synchronous
Can be used as source, and it is corresponding need to by storage unit that the data of source are synchronized to then for the purpose of hold, on this basis
Realize the data synchronization process between any storage unit for needing to realize that data are synchronous.
S12: during the incremental data of source is synchronized to destination, judge that the data in source and destination are
It is no consistent, if it is, returning to the whether consistent step of data for executing and judging in source and destination after preset time period
Suddenly, it if it is not, then inconsistent data are retransmitted to destination by source, and is returned after preset time period and executes judgement source
The whether consistent step of data in end and destination.
It should be noted that the process of Data Migration for realizing source to destination includes: the data that will be saved in source
Migration to realize data on stock is migrated into destination, and after the completion of Data Migration, by data changed in source
Real-time or Timing Synchronization realizes the synchronization of incremental data into destination.During incremental data is synchronous, source is judged
Whether data consistent in data and destination in end, if it is, illustrate source to the incremental data of destination synchronize successfully and
There is no situations such as malice is distorted is carried out to data in destination, without carrying out data re-transmission, otherwise, then illustrate source to purpose
The incremental data synchronization failure at end exists and carries out situations such as malice is distorted to data in destination, it is therefore desirable to by source and
Inconsistent data are retransmitted to destination by source in destination, to realize the consistency of source and purpose end data.Wherein, in advance
If the specific value of period can be set according to actual needs, no matter judging result is to be and carry out pair in the present embodiment
After should operating or judging result is no and after carrying out respective operations, requires to return after preset time period and executes judgement
Timing is needed to judge one of data in source and destination in source and destination in data whether consistent step namely the application
Cause property, to retransmit the consistency for guaranteeing two side datas by data when two side datas are inconsistent.
In technical solution disclosed by the invention, during the incremental data of source is synchronized to destination, every process
Preset time period then judges whether the data of source and destination are consistent, and when the judgment result is No by by inconsistent number
It is retransmitted to destination according to by source, to ensure that the data one of source and destination in such a way that this timing reconciliation is transmitted
Cause property.In addition, in the application during realizing reconciliation transmission, it is thus only necessary to retransmit number inconsistent in source and destination
According to, i.e. abnormal data, rather than full dose is transmitted, to reduce network load.
A kind of data provided in an embodiment of the present invention transmit account checking method, and inconsistent data are retransmitted to purpose by source
After end, can also include:
Judge whether the data in source and destination are consistent, if it is, determine that this reconciliation is transmitted, if
It is no, then inconsistent data are retransmitted to destination by source, and return to execute judge data in source and destination are whether
Consistent step, until the number for carrying out data re-transmission reaches preset times.
It should be noted that in order to guarantee that source and the data of destination are with uniformity after this carries out reconciliation transmission,
Need to judge again whether the data of source and destination are consistent after carrying out data re-transmission, and this is determined based on judging result
Secondary reconciliation is transmitted still retransmits corresponding data again.The number for why being arranged to carry out data re-transmission in the application reaches
Do not return again to the step for executing and judge whether data in source and destination consistent to preset times, be because of there may be
Other factors lead to the case where cannot achieve consistency of the data exception in source and destination, even if carrying out data again at this time
Re-transmission also cannot achieve two sides data consistency, therefore in order to avoid the waste of resource, stop the step of reconciliation is transmitted；And this
When can export corresponding miscue, with by staff intervention solve the problems, such as.Wherein, preset times can be according to practical need
It is determined, when the number of progress data re-transmission reaches preset times generally in this reconciliation transmission process, does not arrive also every
The time for needing to carry out reconciliation transmission in reconciliation transmission process is then executed by preset time period, naturally it is also possible to according to practical need
Other settings are carried out, it is within the scope of the present invention.
A kind of data provided in an embodiment of the present invention transmit account checking method, judge data in source and destination whether one
It causes, may include:
The data in source and destination are calculated separately using hash algorithm, are obtained corresponding with source and destination respectively
Cryptographic Hash；
Whether cryptographic Hash corresponding with source and destination is identical respectively for judgement, if it is, determining source and destination
In data it is consistent, if it is not, then determining that the data in source and destination are inconsistent.
It should be noted that when whether data consistent in judging source and destination, can be by the data of two sides by
Realization is compared in item, but this mode needs the time longer, therefore, calculates separately source using hash algorithm in the application
Data in end and destination, obtain cryptographic Hash corresponding with source and destination respectively and confirm if two cryptographic Hash are identical
Two side datas are consistent, otherwise then confirm that two side datas are inconsistent.Wherein, source and destination correspond to cryptographic Hash and can be by dividing
It is other that Hash calculation obtained is carried out to source total data, destination total data, it needs to carry out data re-transmission in determination at this time
When need to compare the data of source and destination one by one and determine inconsistent data, and be then not necessarily to when two side datas are consistent
It is compared one by one by data again and determines inconsistent data and re-transmission, to improve realization effect the time required to greatly reducing
Rate；Data every in source and destination can also be calculated into corresponding cryptographic Hash, to compare one by one when comparing realizing
The corresponding cryptographic Hash of every data can also while determining source and whether consistent purpose end data in source and destination
To determine the inconsistent data in two sides, since cryptographic Hash digit is less than corresponding data, comparing can be reduced
Workload, and then improve and realize efficiency.Certainly other data comparison methods can also be set according to actual needs, in the present invention
Protection scope within.
A kind of data provided in an embodiment of the present invention transmit account checking method, calculate separately source and purpose using hash algorithm
Data in end may include:
The data in source and destination are calculated separately using MD5 algorithm.
It should be noted that hash algorithm in the prior art is more, realized in the application using MD5 algorithm, this be by
Simply easily realize so as to improve calculating speed, and have any modification in corresponding benefit data in the calculating process of MD5 algorithm
Can all there be very big change in the cryptographic Hash obtained with MD5 algorithm, therefore can guarantee the accuracy of comparing.
A kind of data provided in an embodiment of the present invention transmit account checking method, and the incremental data of source is synchronized to destination,
May include:
The corresponding trigger of source and snapshot unit are created, instruction trigger captures change when the data of source change
The data of change, and the data of capture are written into snapshot unit；
Timing scan snapshot unit, and the data that scanning obtains are synchronized in destination.
It should be noted that realizing that source is synchronous to destination incremental data when storage unit is the table in database
During, related object (including trigger and snapshot unit), when source changes, trigger meeting can be created first
It captures the data of variation and then the data of variation is written into snapshot unit, to pass through timing scan snapshot unit and incite somebody to action
Data therein are synchronized to the incremental data that source can be realized to destination in destination and synchronize, easy realization easy to operate.Its
In, trigger is a class object of database, which relies on the table object of database, if to table carry out newly-increased data,
It modifies data, delete data, then will start the corresponding trigger of the table automatically, trigger after actuation, can be executed corresponding
Database manipulation, concrete operations are the definition when creating trigger.And snapshot table (snapshot unit) is the mirror image of database table,
What is stored inside this table is the operation content of database table, such as database table newly-increased one records, then also new in snapshot table
Increase a record, and this record identification is newly-increased by action type field；If database table modifies a record, fastly
It is recorded according to also storage is corresponding in table, and this record identification is modification by action type field；Database table deletes one
Record then also stores a corresponding record in snapshot table, and this record identification is to delete by action type field.
A kind of data provided in an embodiment of the present invention transmit account checking method, judge data in source and destination whether one
After cause, can also include:
The result whether data judged in source and destination unanimously obtain is written to the comparison result being pre-created
In table, for inquiry.
After whether data are consistent in judging source and destination in the present embodiment, it can will compare obtained result and write
Enter into comparison result table, which may include that data are consistent, data are inconsistent, shortage of data etc., and then true based on the table
It is fixed whether to need to carry out data re-transmission, facilitate the storage and inquiry of information, it is ensured that the visual of data syn-chronization situation is looked into.
It is further to note that the every step for including in a kind of data transmission account checking method provided in an embodiment of the present invention
Suddenly can be by establishing corresponding model, then indicate corresponding model realization, verification of data model can be such as created for fixed
When judge whether source and purpose end data consistent, and the obtained result of judgement is written into comparison result table, creates data
Model is retransmitted to carry out data re-transmission based on the result in comparison result table or determine without carrying out data re-transmission；Deng.To logical
This modelling configuration is crossed, has ensured the flexibility of timed task.
The embodiment of the invention also provides a kind of data to transmit account checking apparatus, as shown in Fig. 2, may include:
Determining module 11, is used for: determination need to realize that the synchronous storage unit of data is source, need to be synchronous by the data of source
It is held for the purpose of storage unit extremely；
Reconciliation module 12, is used for: during the incremental data of source is synchronized to destination, judging source and purpose
Whether the data in end are consistent, if it is, returning to the data for executing and judging in source and destination after preset time period
Whether consistent step, if it is not, then inconsistent data are retransmitted to destination by source, and returned after preset time period
Receipt row judges the whether consistent step of the data in source and destination.
A kind of data provided in an embodiment of the present invention transmit account checking apparatus, can also include:
It checks module, is used for: after inconsistent data are retransmitted to destination by source, judging in source and destination
Data it is whether consistent, if it is, determine this reconciliation be transmitted, if it is not, then by inconsistent data by source weight
Destination is reached, and returns to the whether consistent step of the data for executing and judging in source and destination, until carrying out data re-transmission
Number reach preset times until.
A kind of data provided in an embodiment of the present invention transmit account checking apparatus, and reconciliation module and inspection module may each comprise:
Judging unit is used for: calculate separately the data in source and destination using hash algorithm, obtain respectively with source
And the corresponding cryptographic Hash of destination；Whether cryptographic Hash corresponding with source and destination is identical respectively for judgement, if it is, determining
Data in source and destination are consistent, if it is not, then determining that the data in source and destination are inconsistent.
A kind of data provided in an embodiment of the present invention transmit account checking apparatus, and judging unit may include:
Judgment sub-unit is used for: calculating separately the data in source and destination using MD5 algorithm.
A kind of data provided in an embodiment of the present invention transmit account checking apparatus, can also include:
Synchronization module is used for: the corresponding trigger of creation source and snapshot unit, and instruction trigger is sent out in the data of source
The data of capture variation when changing, and the data of capture are written into snapshot unit；Timing scan snapshot unit, and will sweep
The data retouched are synchronized in destination.
A kind of data provided in an embodiment of the present invention transmit account checking apparatus, can also include:
Writing module is used for: after judging whether data in source and destination are consistent, will judge source and destination
In the result that whether unanimously obtains of data be written into the comparison result table being pre-created, for inquiry.
The embodiment of the invention also provides a kind of data to transmit reconciliation equipment, may include:
Memory, for storing computer program；
Processor realizes the step of as above any item data transmits account checking method when for executing computer program.
The embodiment of the invention also provides a kind of computer readable storage medium, it is stored on computer readable storage medium
Computer program realizes the step of as above any item data transmits account checking method when computer program is executed by processor.
It should be noted that a kind of data transmission account checking apparatus provided in an embodiment of the present invention, equipment and computer-readable
The explanation of relevant portion refers in a kind of data transmission account checking method provided in an embodiment of the present invention and corresponds to portion in storage medium
The detailed description divided, details are not described herein.In addition in above-mentioned technical proposal provided in an embodiment of the present invention with it is right in the prior art
The consistent part of technical solution realization principle and unspecified is answered, in order to avoid excessively repeat.
The foregoing description of the disclosed embodiments can be realized those skilled in the art or using the present invention.To this
A variety of modifications of a little embodiments will be apparent for a person skilled in the art, and the general principles defined herein can
Without departing from the spirit or scope of the present invention, to realize in other embodiments.Therefore, the present invention will not be limited
It is formed on the embodiments shown herein, and is to fit to consistent with the principles and novel features disclosed in this article widest
Range.
Claims (10)
1. a kind of data transmit account checking method characterized by comprising
Determination need to realize that the synchronous storage unit of data is source, and the storage unit that need to be synchronized to the data of the source is mesh
End；
During the incremental data of the source is synchronized to the destination, judge in the source and the destination
Data it is whether consistent, execute the judgement source and the destination if it is, returning after preset time period
In the whether consistent step of data, if it is not, then inconsistent data are retransmitted to the destination by the source, and pass through
The execution step for judging whether the data in the source and the destination are consistent is returned after crossing preset time period.
2. the method according to claim 1, wherein inconsistent data are retransmitted to the mesh by the source
End after, further includes:
Judge whether the data in the source and the destination are consistent, if it is, determining that this reconciliation is transmitted, such as
Fruit is no, then inconsistent data is retransmitted to the destination by the source, and return execute the judgement source and
The whether consistent step of data in the destination, until the number for carrying out data re-transmission reaches preset times.
3. according to the method described in claim 2, it is characterized in that, judging whether is data in the source and the destination
Unanimously, comprising:
Calculate separately the data in the source and the destination using hash algorithm, obtain respectively with the source and described
The corresponding cryptographic Hash of destination；
Whether cryptographic Hash corresponding with the source and the destination is identical respectively for judgement, if it is, determining the source
And the data in the destination are consistent, if it is not, then determining that the data in the source and the destination are inconsistent.
4. according to the method described in claim 3, it is characterized in that, calculating separately the source and the mesh using hash algorithm
End in data, comprising:
The data in the source and the destination are calculated separately using MD5 algorithm.
5. according to the method described in claim 4, it is characterized in that, the incremental data of the source is synchronized to the purpose
End, comprising:
The corresponding trigger of source and snapshot unit are created, indicates that the trigger is caught when the data of the source change
The data of variation are obtained, and the data of capture are written into the snapshot unit；
Snapshot unit described in timing scan, and the data that scanning obtains are synchronized in the destination.
6. according to the method described in claim 5, it is characterized in that, judging whether is data in the source and the destination
After consistent, further includes:
The result whether data judged in the source and the destination unanimously obtain is written to the comparison being pre-created
As a result in table, for inquiry.
7. a kind of data transmit account checking apparatus characterized by comprising
Determining module is used for: determination need to realize that the synchronous storage unit of data is source, need to be synchronized to the data of the source
Storage unit for the purpose of hold；
Reconciliation module, is used for: during the incremental data of the source is synchronized to the destination, judging the source
And whether the data in the destination are consistent, execute the judgement source if it is, returning after preset time period
The whether consistent step of data in end and the destination, if it is not, then inconsistent data are retransmitted to by the source
The destination, and return to whether execute the data judged in the source and the destination after preset time period
Consistent step.
8. device according to claim 7, which is characterized in that further include:
Check module, be used for: after inconsistent data are retransmitted to the destination by the source, judge the source and
Whether the data in the destination are consistent, if it is, determining that this reconciliation is transmitted, if it is not, then by inconsistent
Data are retransmitted to the destination by the source, and return and execute the data judged in the source and the destination
Whether consistent step, until carry out data re-transmission number reach preset times until.
9. a kind of data transmit reconciliation equipment characterized by comprising
Memory, for storing computer program；
Processor realizes that data transmit reconciliation side as described in any one of claim 1 to 6 when for executing the computer program
The step of method.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program realizes that data transmit account checking method as described in any one of claim 1 to 6 when the computer program is executed by processor
The step of.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811426737.4A CN109656992A (en) | 2018-11-27 | 2018-11-27 | A kind of data transmission account checking method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811426737.4A CN109656992A (en) | 2018-11-27 | 2018-11-27 | A kind of data transmission account checking method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109656992A true CN109656992A (en) | 2019-04-19 |
Family
ID=66111536
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811426737.4A Pending CN109656992A (en) | 2018-11-27 | 2018-11-27 | A kind of data transmission account checking method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109656992A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110245164A (en) * | 2019-05-09 | 2019-09-17 | 阿里巴巴集团控股有限公司 | A kind of data backflow detection method, device and equipment |
| CN111552701A (en) * | 2020-04-30 | 2020-08-18 | 中国建设银行股份有限公司 | Method for determining data consistency in distributed cluster and distributed data system |
| CN112214454A (en) * | 2020-12-02 | 2021-01-12 | 长沙树根互联技术有限公司 | Data processing method, ETL system, server and storage medium |
| CN113742422A (en) * | 2021-08-20 | 2021-12-03 | 广州市易工品科技有限公司 | Data synchronization accuracy verification method and device |
| CN117992545A (en) * | 2024-02-05 | 2024-05-07 | 智诚计算机辅助设计（深圳）有限公司 | Method, system and readable storage medium for checking data synchronization of bill of materials |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050044088A1 (en) * | 2003-08-21 | 2005-02-24 | Lindsay Bruce G. | System and method for asynchronous data replication without persistence for distributed computing |
| US20100114841A1 (en) * | 2008-10-31 | 2010-05-06 | Gravic, Inc. | Referential Integrity, Consistency, and Completeness Loading of Databases |
| CN102929946A (en) * | 2012-09-27 | 2013-02-13 | 山东中创软件工程股份有限公司 | Data synchronization method, device and system |
| CN103905397A (en) * | 2012-12-28 | 2014-07-02 | 腾讯科技（深圳）有限公司 | Data synchronization method and system |
| CN105589961A (en) * | 2015-12-21 | 2016-05-18 | 武汉达梦数据库有限公司 | Method and system for detecting data consistency of real-time synchronous system of database |
| CN107423436A (en) * | 2017-08-04 | 2017-12-01 | 郑州云海信息技术有限公司 | A kind of method migrated for online data between distinct type data-base |
-
2018
- 2018-11-27 CN CN201811426737.4A patent/CN109656992A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050044088A1 (en) * | 2003-08-21 | 2005-02-24 | Lindsay Bruce G. | System and method for asynchronous data replication without persistence for distributed computing |
| US20100114841A1 (en) * | 2008-10-31 | 2010-05-06 | Gravic, Inc. | Referential Integrity, Consistency, and Completeness Loading of Databases |
| CN102929946A (en) * | 2012-09-27 | 2013-02-13 | 山东中创软件工程股份有限公司 | Data synchronization method, device and system |
| CN103905397A (en) * | 2012-12-28 | 2014-07-02 | 腾讯科技（深圳）有限公司 | Data synchronization method and system |
| CN105589961A (en) * | 2015-12-21 | 2016-05-18 | 武汉达梦数据库有限公司 | Method and system for detecting data consistency of real-time synchronous system of database |
| CN107423436A (en) * | 2017-08-04 | 2017-12-01 | 郑州云海信息技术有限公司 | A kind of method migrated for online data between distinct type data-base |
Non-Patent Citations (1)
| Title |
|---|
| 卢晶琦等: "《移动通信理论与实践》", 《西安电子科技大学出版社》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110245164A (en) * | 2019-05-09 | 2019-09-17 | 阿里巴巴集团控股有限公司 | A kind of data backflow detection method, device and equipment |
| CN111552701A (en) * | 2020-04-30 | 2020-08-18 | 中国建设银行股份有限公司 | Method for determining data consistency in distributed cluster and distributed data system |
| CN111552701B (en) * | 2020-04-30 | 2023-07-21 | 中国建设银行股份有限公司 | Method for determining data consistency in distributed cluster and distributed data system |
| CN112214454A (en) * | 2020-12-02 | 2021-01-12 | 长沙树根互联技术有限公司 | Data processing method, ETL system, server and storage medium |
| CN112214454B (en) * | 2020-12-02 | 2021-02-26 | 长沙树根互联技术有限公司 | Data processing method, ETL system, server and storage medium |
| CN113742422A (en) * | 2021-08-20 | 2021-12-03 | 广州市易工品科技有限公司 | Data synchronization accuracy verification method and device |
| CN117992545A (en) * | 2024-02-05 | 2024-05-07 | 智诚计算机辅助设计（深圳）有限公司 | Method, system and readable storage medium for checking data synchronization of bill of materials |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109656992A (en) | A kind of data transmission account checking method, device and equipment | |
| WO2019154394A1 (en) | Distributed database cluster system, data synchronization method and storage medium | |
| CN107729366B (en) | Universal multi-source heterogeneous large-scale data synchronization system | |
| CN105095013B (en) | Date storage method, restoration methods, relevant apparatus and system | |
| AU2012273366B2 (en) | Managing replicated virtual storage at recovery sites | |
| CN106302806B (en) | A kind of method of data synchronization, system, synchronous obtaining method and relevant apparatus | |
| CN107148617B (en) | Automatic configuration of log-coordinated storage groups | |
| CN110673932B (en) | Multi-database log with multi-project transaction support | |
| US10831741B2 (en) | Log-shipping data replication with early log record fetching | |
| US20140324773A1 (en) | Data synchronization method and system and data access apparatus | |
| US8463746B2 (en) | Method and system for replicating data | |
| CN107209704A (en) | Detect the write-in lost | |
| CN105824846B (en) | Data migration method and device | |
| CN105912428B (en) | Realize that source data is converted into the system and method for virtual machine image in real time | |
| CN106610854A (en) | Model update method and device | |
| CN107609188B (en) | Data synchronization verification method based on golden gate | |
| CN107004010A (en) | Control multidatabase system | |
| CN104239476A (en) | Method, device and system for synchronizing databases | |
| CN102265277A (en) | Operation method and device for data memory system | |
| CN103795754A (en) | Method and system for data synchronization among multiple systems | |
| CN106790713B (en) | Across data center virtual machine migration method under cloud computing environment | |
| CN105049258B (en) | The data transmission method of network disaster tolerance system | |
| CN109471699A (en) | The virtual machine incremental backup system of difference bitmap characteristic based on Qcow2 image file | |
| US10255341B2 (en) | Mode switching in high availability disaster recovery (HADR) systems | |
| CN104462562A (en) | Data migration system and method based on data warehouse automation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190419 |
|
| RJ01 | Rejection of invention patent application after publication |