CN106897342A - A kind of data verification method and equipment - Google Patents
A kind of data verification method and equipment Download PDFInfo
- Publication number
- CN106897342A CN106897342A CN201610576517.4A CN201610576517A CN106897342A CN 106897342 A CN106897342 A CN 106897342A CN 201610576517 A CN201610576517 A CN 201610576517A CN 106897342 A CN106897342 A CN 106897342A
- Authority
- CN
- China
- Prior art keywords
- data
- database
- time
- renewal time
- consistent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000013524 data verification Methods 0.000 title claims abstract description 20
- 238000012795 verification Methods 0.000 claims description 16
- 238000013500 data storage Methods 0.000 claims description 8
- 238000003860 storage Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 12
- 238000004590 computer program Methods 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/273—Asynchronous replication or reconciliation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2308—Concurrency control
- G06F16/2315—Optimistic concurrency control
- G06F16/2322—Optimistic concurrency control using timestamps
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application discloses a kind of data verification method and equipment, including：The first data that the first database updates in setting time are obtained, and determines the renewal time of first data；The data of data item identical second for existing with being included in first data are searched whether from the second database；According to lookup result and the renewal time of first data, whether the data verified in first database are consistent with the data in second database.Relative in the prior art, whether the data in total data verification disparate databases in database are consistent, the technical scheme that the embodiment of the present application is provided, whether the data in two databases of the data check updated in database are consistent, so that the time consumed in checking procedure is fewer, efficiency comparison is high.
Description
Technical field
The application is related to field of computer technology, more particularly to a kind of data verification method and equipment.
Background technology
In distributed data-storage system, used as MDL, another database is used as backup number for a database
According to storehouse, MDL can externally provide reading and writing data service, and backup database keeps and the data syn-chronization between MDL,
And when MDL breaks down, backup database can externally provide reading and writing data service.
Generally, MDL is when receiving data and being stored data, the data sync storage that can be stored
Into backup database, in this manner it is ensured that between MDL and backup database data it is consistent.But, actually should
In, because there is time delay in the data syn-chronization operation between MDL and backup database, or some reasons (for example,
Communication abnormality, the hardware fault of backup database or software fault between database) caused by part number in backup database
According to losing or damage so that data in MDL are inconsistent with data in backup database.
In the prior art, master can be solved by verifying the data consistency between MDL and backup database
The inconsistent problem of data between database and backup database.Specifically, it is possible, firstly, to the whole that will be stored in MDL
The total data stored in data and backup database is contrasted；Secondly, the data lost in backup database are determined；Most
Afterwards, the data of loss are updated in backup database.In this manner it is ensured that in data in MDL and backup database
Data it is consistent.
But, in actual applications, because the data of storage in MDL (or backup database) are relatively more, therefore,
, it is necessary to consume big when the total data stored in the total data that will be stored in MDL with backup database is contrasted
The time of amount, cause the efficiency comparison when the data consistency between MDL and backup database is verified low.
The content of the invention
The embodiment of the present application provides a kind of data verification method and equipment, existing in MDL is verified for solving
Data it is whether consistent with the data in backup database when the low problem of efficiency comparison.
The embodiment of the present application provides a kind of data verification method, and methods described is applied to distributed data-storage system, institute
The method of stating includes：
The first data that the first database updates in setting time are obtained, and determines the renewal of first data
Time；
The data of data item identical second for existing with being included in first data are searched whether from the second database；
According to lookup result and the renewal time of first data, verify data in first database with it is described
Whether the data in the second database are consistent.
The embodiment of the present application provides a kind of data check equipment, and the equipment application is in distributed data-storage system, institute
The equipment of stating includes：
Acquiring unit, obtains the first data that the first database updates in setting time, and determine described first
The renewal time of data；
Searching unit, searches whether the data item identical for existing with being included in first data from the second database
Second data；
Verification unit, the renewal time of lookup result and first data according to the searching unit, verification is described
Whether the data in the first database are consistent with the data in second database.
The above-mentioned technical proposal that the embodiment of the present application is used can reach following beneficial effect：
The technical scheme that the embodiment of the present application is provided, when whether the data in verifying two databases are consistent, can obtain
Data that a database updates in setting time and the renewal time of the data are taken, and in another database
Search whether there are the data, in order to determine whether another database in same time updates the data, and then verify two
Whether the data in individual database are consistent.Relative in the prior art, the total data in database verifies different pieces of information
Whether the data in storehouse are consistent, the technical scheme that the embodiment of the present application is provided, according to the data check updated in database
Whether the data in disparate databases are consistent so that the time consumed in checking procedure is fewer, and efficiency comparison is high.
Brief description of the drawings
Accompanying drawing described herein is used for providing further understanding of the present application, constitutes the part of the application, this Shen
Schematic description and description please does not constitute the improper restriction to the application for explaining the application.In the accompanying drawings：
A kind of schematic flow sheet of data verification method that Fig. 1 is provided for the embodiment of the present application；
A kind of schematic flow sheet of data verification method that Fig. 2 is provided for the embodiment of the present application；
A kind of schematic diagram of data verification method that Fig. 3 (a) is provided for the embodiment of the present application；
A kind of schematic diagram of data verification method that Fig. 3 (b) is provided for the embodiment of the present application；
A kind of schematic diagram of data verification method that Fig. 3 (c) is provided for the embodiment of the present application；
A kind of structural representation of data check equipment that Fig. 4 is provided for the embodiment of the present application.
Specific embodiment
In order to realize the purpose of the application, a kind of data verification method and equipment are provided in the embodiment of the present application, obtained
The first data that first database updates in setting time, and determine the renewal time of first data；From second
The data of data item identical second for existing with being included in first data are searched whether in database；According to lookup result and
The renewal time of first data, whether verify data in data in first database and second database
Unanimously.
When whether the data in verifying two databases are consistent, a database can be obtained and occurred in setting time
The renewal time of the data of renewal and the data, and search whether there are the data in another database, in order to true
Whether fixed another database updates the data, and then whether the data verified in two databases are consistent in same time.Phase
For in the prior art, whether the data in total data verification disparate databases in database are consistent, the application reality
The technical scheme of example offer is applied, whether the data in the data check disparate databases updated in database are consistent,
So that the time consumed in checking procedure is fewer, efficiency comparison is high.
The technical scheme that the embodiment of the present application is provided, can apply to distributed data-storage system, in the distribution
In data-storage system, comprising a MDL and at least one backup database, wherein, MDL can be carried externally
For reading and writing data service, when MDL breaks down, backup database can externally provide reading and writing data service, the application
The technical scheme that embodiment is provided, can verify data in data in each backup database and MDL whether one
Cause.
In actual applications, because the MDL is used to externally provide reading and writing data service, backup database is to institute
The data stored in MDL are stated to be backed up, therefore, verifying between the MDL and the backup database
During data consistency, can be with the data in MDL as foundation, in the data and MDL in verification backup database
Data it is whether consistent.
In addition, in the embodiment of the present application, master data can also be verified with the data in backup database as foundation
Whether the data in storehouse are consistent with the data in backup database.
In the technical scheme that the application is provided, first database can be MDL, or backup number
According to storehouse, second database is the databases different from first database, in the embodiment of the present application, can be with described
First database be MDL, second database be backup database as a example by illustrate.
It should be noted that in the embodiment of the present application, can be according to the time of setting, the first data described in cyclic check
Whether the data in storehouse are consistent with the data in second database, so, before the setting time, it may be determined that institute
The data stated in the first database are consistent with the data in second database, in the setting time, can according to
Whether the data that the data that first database updates in the setting time update with second database
Unanimously, whether the data for verifying in first database are consistent with the data in second database.
Technical scheme is clearly and completely retouched with reference to the application specific embodiment and corresponding accompanying drawing
State.Obviously, described embodiment is only some embodiments of the present application, rather than whole embodiments.Based in the application
Embodiment, the every other embodiment that those of ordinary skill in the art are obtained under the premise of creative work is not made,
Belong to the scope of the application protection.
Below in conjunction with accompanying drawing, the technical scheme that each embodiment of the application is provided is described in detail.
Embodiment 1
Step 101：The first data that the first database updates in setting time are obtained, and determines first number
According to the renewal time.
In a step 101, when whether the data in verifying the first database are consistent with the data in the second database, can
To obtain the data that first database updates in setting time, and determine described in first database update
The time of one data.
First database can be MDL, in the embodiment of the present application, can be with first database
Data be foundation, whether the data verified in second database consistent with the data in first database.
When whether the data in verifying first database are consistent with the data in second database, can obtain
Take the first data that first database updates in setting time.In the embodiment of the present application, the setting time
Can be a time point, or a time period, be not specifically limited, for example, the setting time is a time
Point, then, the first data that first database updates in a certain setting time point can be obtained, if the setting
Time is a time period, then, the first data that first database updates in certain time period can be obtained.
The setting time can determine according to the renewal frequency of data in first database, for example, described first
The renewal frequency of data is than very fast in database, then, it may be determined that the setting time is a certain shorter time period, except this
Outside, the setting time can also determine according to actual needs, also be not specifically limited here.
It should be noted that being that first database is sent out in setting time due to what is obtained in the embodiment of the present application
Raw the first data for updating, therefore, the data volume of first data of acquisition is much smaller than storage in first database
The data volume of total data, for example, the data volume that first database updates within 1 hour is than larger, then, can
To determine setting time as a minute, first data, first database of acquisition updated in one minute
Data, so, the data volume of the data volume much smaller than the total data stored in first database of acquisition.
In actual applications, whether the data in the data in judging first database with second database
When consistent, the foundation of judgement can be included in the data item and data item that first database updates in setting time
Data content, or data the renewal time, therefore, in the embodiment of the present application, exist first database is obtained
After the first data updated in setting time, the renewal time of first data can also be determined.
Specifically, first database can record the renewal of first data when first data are updated
Time, and by the renewal time of first data it is corresponding with first data store into first database, so,
When first data are got, first number can be determined from first database according to first data
According to the renewal time.
When the renewal time of first data is recorded, the precision of the renewal time of first data is less than described
The renewal frequency of the first database, for example, first database updates a secondary data every 1s, then first data
The precision of renewal time is less than 1s, so, can distinguish the renewal time of different pieces of information, it is ensured that the accuracy of data check.
Under normal circumstances, the precision of the renewal time of data is higher, and the accuracy of data check is higher.
Step 102：The data item identical for existing with being included in first data is searched whether from the second database
Second data.
In a step 102, after the first data that first database updates in setting time are got, can
According to first data for obtaining, the data for existing with being included in first data are searched whether from the second database
The item data of identical second, in order to determine whether second database updates first data.
In the embodiment of the present application, can be referred to comprising multiple data item, data item here in first data
The different data category included in first data, for example, the data item can be user name, user cipher, etc.,
Each data item includes data content, for example, the user name a that the user included in user name uses, includes in user cipher
The password b that user uses.
Specifically, in the data item phase for searching whether to exist with included in first data from second database
With the second data when, the data item that will can be included in the data item that included in first data and second database
Matched, and determined to whether there is and the data included in first data in second database according to matching result
The item data of identical second.
In addition, in actual applications, can also search whether to deposit from second database by other method
The data of data item identical second included in first data, are not especially limited here.
In the data item identical for searching whether to exist with included in first data from second database
During two data, lookup result comprises at least following several：
The first result：In second database in the absence of with the data item identical that includes in first data
Two data；
Second result：The data item identical second for existing in second database and being included in first data
Data.
The data item for not existing for above-mentioned the first result, in second database and being included in first data
The data of identical second, can be do not exist in second database and first data in any one data for including
Exist in data of identical second, or second database with included in first data several are (small
The number of the data item contained in first packet) data of data item identical second.
For example, the data item included in first data is A, B, C and D, if do not existed in second database
Data item A, B, C and D, then, it may be determined that do not exist in second database and the data included in first data
The item data of identical second；If only existing data item A, B and C in second database, then, it may be determined that described second
The data of data item identical second for not existing in database and being included in first data.
The data item phase for existing for above-mentioned second result, in second database and being included in first data
With the second data, refer to existing in second database identical with each data item included in first data
The second data.
Still with the data item that is included in the first data described above as A, as a example by B, C and D, if the second data stock
In data item A, B, C and D, then, it may be determined that exist in second database and the data included in first data
The item data of identical second.
The data item identical second for existing with being included in first data is searched whether from second database
After data, can be according to lookup result, the data verified in first database are with the data in second database
It is no consistent.
Step 103：According to lookup result and the renewal time of first data, the number in first database is verified
According to whether consistent with the data in second database.
In step 103, can be according to institute in the lookup result described in above-mentioned steps 102 and first database
State the renewal time of the first data, verify data in data in first database and second database whether one
Cause.
Specifically, two kinds of lookup results described in step 102 can be respectively directed to, in verification first database
Whether data are consistent with the data in second database.
For the first result：
When the data item identical not existed during lookup result is second database with included in first data
During the second data, determine that data in first database are inconsistent with data in second database.
Do not found from second database and counted with the data item identical second included in first data
It is inconsistent according to, it may be determined that data in second database and data in first database.
For second result：
According to lookup result and the renewal time of first data, verify data in first database with it is described
Whether the data in the second database are consistent, including：
When the data item identical for existing during lookup result is second database with included in first data
During two data, the renewal time of second data is determined；
It is determined that first data the renewal Time Inconsistency for updating time and second data when, it is determined that described
Data in first database are inconsistent with data in second database.
The data of data item identical second for being found from second database and being included in first data, can
To illustrate, comprising the data item in first data in second database, now, in order to verify first database
In data it is whether consistent with the data in second database, when may further determine that the renewal of second data
Between.
Specifically, second database can record the renewal of second data when second data are updated
Time, and the renewal time correspondence of second data and second data is stored into second database, this
Sample, after second data are found, can determine described second according to second data from second database
The renewal time of data.
It is determined that after the renewal time of second data, can be by the renewal time of second data and described first
The renewal time of data is compared, in order to determine the data in first database whether with second database in
Data it is whether consistent.
In the embodiment of the present application, enter with the renewal time of second data by the renewal time of first data
When row compares, comparative result comprises at least following several situations：
The first situation：The renewal time consistency for updating time and second data of first data；
Second situation：The renewal Time Inconsistency for updating time and second data of first data.
For the first situation：
Renewal time and the renewal time consistency of second data of first data, refer to first data
In the renewal time of data item for including and the corresponding data item included in second data renewal time consistency.
For example, the data item included in first data is A, B, C and D, the renewal time of A, B, C and D is respectively t1、
t2、t3And t4, the data item included in second data is also A, B, C and D, if it is determined that A, B, C in the second database
It is also respectively t with the renewal time of D1、t2、t3And t4, then, it may be determined that the renewal time of first data and described
The renewal time consistency of two data.
Now, counted with the data item identical second that includes in first data due to existing in second database
According to, and second data the renewal time consistency for updating time and first data, it may be said that bright, second data
Storehouse and first database update second data (i.e. described first data) in the identical time, hence, it can be determined that
Data in first database are consistent with the data in second database.
For second situation：
The renewal Time Inconsistency for updating time and second data of first data, can be second number
The renewal time of the renewal time of each data item included in and the corresponding data item included in first data
Included in inconsistent, or second data several (data item contained less than second packet
Number) data item renewal time and the corresponding data item included in first data renewal Time Inconsistency.
It is t still with the renewal time of data item A, B, C and the D that are included in the first data described above1、t2、t3And t4For
Example, if the renewal time of A, B, C and the D in second data is respectively t11、t21、t31And t41, then, it may be determined that institute
State the renewal time of the first data and the renewal Time Inconsistency of second data；If A, B, C in second data
It is respectively t with the renewal time of D1、t2、t31And t41, then, it is also possible to determine the renewal time of first data with it is described
The renewal Time Inconsistency of the second data.
Now, although exist in second database and counted with the data item identical second included in first data
According to, but, the renewal Time Inconsistency for updating time and first data of second data, it may be said that bright, described the
Two databases do not upgrade in time second data, hence, it can be determined that the data and described in first database
Data in two databases are inconsistent.
For example, the data item that contains of first packet is user cipher, before user updates user cipher, described the
One database is consistent with the user cipher stored in second database, after user updates user cipher, described the
One database update user cipher, second database does not update user cipher, now, although in second database
There is user cipher this data item, but, due in second database without user cipher is updated, i.e., described second number
According to renewal time and the renewal Time Inconsistency of user cipher in first database of user cipher in storehouse, therefore, it can
Determine that data in first database are inconsistent with data in second database.
When it is determined that the data in data in first database and second database are inconsistent, in order that
Data in second database are consistent with the data in first database, can update second database.
Alternatively, when it is determined that the data in data in first database and second database are inconsistent,
Methods described also includes：
Using first data and the renewal time of first data, second database is updated so that institute
The data stated in the first database are consistent with the data in second database.
Specifically, according to the content of above-mentioned record, the number in first data can in the following two cases be determined
According to inconsistent with data in second database, including：
The first situation：In second database in the absence of with the data item identical that includes in first data
Two data；
Second situation：The data item identical second for existing in second database and being included in first data
Data, but, the renewal Time Inconsistency for updating time and second data of first data.
Above-mentioned two situations are directed to separately below, illustrate how to update second database.
For the first situation：
Counted with the data item identical second included in first data it is determined that not existing in second database
According to when, first data can be updated in second database, the data of the second database described in completion.
After first data are updated into second database, exist and described first in second database
The data of data item identical second included in data, now, in order to ensure the data in the data in second database
It is consistent with the data in first database, second data can be updated according to the renewal time of first data
The renewal time, i.e., according to the renewal time of first data, determine the renewal time of second data so that described
The renewal time consistency for updating time and first data of two data.
For second situation：
Second database does not update second data, at this point it is possible to according to first data, update described
The data not upgraded in time in second data.
After second data are updated, in order in ensureing the data in second database and first database
Data it is consistent, the renewal time of second data according to the renewal time of first data, can be updated, it is ensured that update
The renewal time consistency for updating time and first data of second data afterwards, and then cause first database
In data it is consistent with the data in second database.
It should be noted that in actual applications, it is possible to use the technical scheme that the embodiment of the present application is provided, according to setting
Whether the data that the cycle is verified in two databases are consistent, it is also possible to according to actual conditions, aperiodically verify two databases
In data it is whether consistent, be not specifically limited here.
The technical scheme that the embodiment of the present application is provided, when whether the data in verifying two databases are consistent, can obtain
Data that a database updates in setting time and the renewal time of the data are taken, and in another database
Search whether there are the data, in order to determine whether another database in same time updates the data, and then verify two
Whether the data in individual database are consistent.Relative in the prior art, the total data in database verifies different pieces of information
Whether the data in storehouse are consistent, the technical scheme that the embodiment of the present application is provided, according to the data check updated in database
Whether the data in disparate databases are consistent so that the time consumed in checking procedure is fewer, and efficiency comparison is high.
Embodiment 2
A kind of schematic flow sheet of data verification method that Fig. 2 is provided for the embodiment of the present application.Methods described is as described below.
Step 201：The first data that first database updates in setting time are obtained, and determines described
The renewal time of one data.
The setting time can determine according to actual conditions.
After first data are obtained, first data can be determined according to the method described in above-described embodiment 1
The renewal time, description is not repeated herein.
Step 202：The data item identical for existing with being included in first data is searched whether from the second database
Second data.
Specifically, can search whether exist from second database by the method described in above-described embodiment 1
With the data of data item identical second included in first data.
If lookup result be exist in second database and first data in the data item identical that includes
During the second data, step 203 is performed；If lookup result be second database in do not exist and first data in wrap
During data item the second data of identical for containing, step 205 is performed.
Step 203：Determine the renewal time of second data.
Specifically, the renewal time of second data can be determined according to the method described in above-described embodiment 1, here
Description is not repeated.
Step 204：Judge second data the renewal time whether the renewal time consistency with first data.
It is determined that after the renewal time of second data, can determine whether the renewal time of second data is
The no renewal time consistency with first data.
It is determined that second data the renewal Time Inconsistency for updating time and first data when, perform step
205；It is determined that second data the renewal time consistency for updating time and first data when, perform step 206.
Step 205：Using first data and the renewal time of first data, second data are updated
Storehouse.
Specifically, can be according to the method described in above-described embodiment 1, using first data and first number
According to the renewal time, update second database, description is not repeated herein.
After second database is updated, the data and second database in first database can be caused
In data it is consistent.
Step 206：Determine that the data in first database are consistent with the data in second database.
Embodiment 3
A kind of schematic diagram of data check that Fig. 3 (a) is provided for the embodiment of the present application.
In Fig. 3 (a), according to the first data that MDL updates in setting time, from backup database search with
The data of data item identical second included in first data, when not existing second data in backup database, according to
The renewal time of the first data and the first data in MDL updates backup database.
A kind of schematic diagram of data check that Fig. 3 (b) is provided for the embodiment of the present application.
In Fig. 3 (b), according to the first data that MDL updates in setting time, from backup database search with
The data of data item identical second included in first data, when there are second data in backup database, but the second number
According to the renewal Time Inconsistency for updating time and the first data when, the renewal time according to the first data and the first data is more
New backup database.
A kind of schematic diagram of data check that Fig. 3 (c) is provided for the embodiment of the present application.
In Fig. 3 (c), according to the first data that MDL updates in setting time, from backup database search with
The data of data item identical second included in first data, when there are second data in backup database, and the second number
According to the renewal time consistency for updating time and the first data when, it may be determined that in data in MDL and backup database
Data it is consistent.
Embodiment 4
A kind of structural representation of data check equipment that Fig. 4 is provided for the embodiment of the present application.The data check equipment
Distributed data-storage system is applied to, the data check equipment includes：Acquiring unit 41, searching unit 42 and verification unit
43, wherein：
Acquiring unit 41, obtains the first data for being updated in setting time of the first database, and determines described the
The renewal time of one data；
Searching unit 42, searches whether in the presence of identical with the data item included in first data from the second database
The second data；
Verification unit 43, the renewal time of lookup result and first data according to the searching unit 42, verification
Whether the data in first database are consistent with the data in second database.
The verification unit 43 is according to the lookup result of the searching unit 42 and the renewal time of first data, school
Whether the data tested in first database are consistent with the data in second database, including：
Exist in the lookup result of the searching unit 42 is for second database and included with first data
Data item the second data of identical when, determine the renewal time of second data；
It is determined that first data the renewal Time Inconsistency for updating time and second data when, it is determined that described
Data in first database are inconsistent with data in second database.
Alternatively, the verification unit 43, in the lookup result of the searching unit 42 is for second database not
In the presence of with first data in include data item the second data of identical when, determine data in first database with
Data in second database are inconsistent.
Alternatively, the data check equipment also includes：Updating block 44, wherein：
The updating block 44, data and the described second number in the verification unit 43 determines first database
According to the data in storehouse it is inconsistent when, using first data and the renewal time of first data, update described second
Database so that the data in first database are consistent with the data in second database.
Alternatively, the verification unit 43, it is determined that the renewal time of first data with second data more
During new time consistency, determine that the data in first database are consistent with the data in second database.
It should be noted that the data check equipment that the embodiment of the present application is provided can be realized by hardware mode, also may be used
Realized with by software mode, do not limited here.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program
Product.Therefore, the application can be using the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.And, the application can be used and wherein include the computer of computer usable program code at one or more
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) is produced
The form of product.
The application is the flow with reference to method, equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram are described.It should be understood that every first-class during flow chart and/or block diagram can be realized by computer program instructions
The combination of flow and/or square frame in journey and/or square frame and flow chart and/or block diagram.These computer programs can be provided
The processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced for reality by the instruction of computer or the computing device of other programmable data processing devices
The device of the function of being specified in present one flow of flow chart or multiple one square frame of flow and/or block diagram or multiple square frames.
These computer program instructions may be alternatively stored in can guide computer or other programmable data processing devices with spy
In determining the computer-readable memory that mode works so that instruction of the storage in the computer-readable memory is produced and include finger
Make the manufacture of device, the command device realize in one flow of flow chart or multiple one square frame of flow and/or block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that in meter
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented treatment, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net
Network interface and internal memory.
Internal memory potentially includes the volatile memory in computer-readable medium, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Internal memory is computer-readable medium
Example.
Computer-readable medium includes that permanent and non-permanent, removable and non-removable media can be by any method
Or technology realizes information Store.Information can be computer-readable instruction, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), electric erasable
Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM),
Digital versatile disc (DVD) or other optical storages, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus
Or any other non-transmission medium, can be used to store the information that can be accessed by a computing device.Defined according to herein, calculated
Machine computer-readable recording medium does not include temporary computer readable media (transitory media), such as data-signal and carrier wave of modulation.
Also, it should be noted that term " including ", "comprising" or its any other variant be intended to nonexcludability
Comprising so that process, method, commodity or equipment including a series of key elements not only include those key elements, but also wrapping
Include other key elements being not expressly set out, or also include for this process, method, commodity or equipment is intrinsic wants
Element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that wanted including described
Also there is other identical element in process, method, commodity or the equipment of element.
It will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer program product.
Therefore, the application can be using the embodiment in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Form.And, the application can be used to be can use in one or more computers for wherein including computer usable program code and deposited
The shape of the computer program product implemented on storage media (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
Formula.
Embodiments herein is the foregoing is only, the application is not limited to.For those skilled in the art
For, the application can have various modifications and variations.It is all any modifications made within spirit herein and principle, equivalent
Replace, improve etc., within the scope of should be included in claims hereof.
Claims (10)
1. a kind of data verification method, it is characterised in that methods described is applied to distributed data-storage system, methods described bag
Include：
The first data that the first database updates in setting time are obtained, and when determining the renewal of first data
Between；
The data of data item identical second for existing with being included in first data are searched whether from the second database；
According to lookup result and the renewal time of first data, the data and described second in first database are verified
Whether the data in database are consistent.
2. data verification method as claimed in claim 1, it is characterised in that according to lookup result and first data more
Whether new time, the data verified in first database are consistent with the data in second database, including：
Counted with the data item identical second included in first data when existing during lookup result is second database
According to when, determine the renewal time of second data；
It is determined that first data the renewal Time Inconsistency for updating time and second data when, determine described first
Data in database are inconsistent with data in second database.
3. data verification method as claimed in claim 2, it is characterised in that methods described also includes：
When the data item identical second not existed during lookup result is second database with included in first data
During data, determine that data in first database are inconsistent with data in second database.
4. the data verification method as described in any one of claims 1 to 3, it is characterised in that it is determined that first database
In data and second database in data it is inconsistent when, methods described also includes：
Using first data and the renewal time of first data, second database is updated so that described the
Data in one database are consistent with the data in second database.
5. data verification method as claimed in claim 2, it is characterised in that methods described also includes：
It is determined that first data the renewal time consistency for updating time and second data when, determine first number
It is consistent with the data in second database according to the data in storehouse.
6. a kind of data check equipment, it is characterised in that the equipment application in distributed data-storage system, the equipment bag
Include：
Acquiring unit, obtains the first data that the first database updates in setting time, and determine first data
The renewal time；
Searching unit, searches whether the data item identical second for existing with being included in first data from the second database
Data；
Verification unit, the renewal time of lookup result and first data according to the searching unit, verification described first
Whether the data in database are consistent with the data in second database.
7. data check equipment as claimed in claim 6, it is characterised in that lookup result and institute according to the searching unit
State the renewal time of the first data, verify data in data in first database and second database whether one
Cause, including：
When the data for existing during the lookup result of the searching unit is second database with included in first data
During item the second data of identical, the renewal time of second data is determined；
It is determined that first data the renewal Time Inconsistency for updating time and second data when, determine described first
Data in database are inconsistent with data in second database.
8. data check equipment as claimed in claim 7, it is characterised in that
The verification unit, does not exist and the described first number in the lookup result of the searching unit is for second database
During data item the second data of identical included in, in determining data in first database and second database
Data it is inconsistent.
9. the data check equipment as described in any one of claim 6 to 8, it is characterised in that the equipment also includes：Update single
Unit, wherein：
The updating block, in the data during the verification unit determines first database with second database
When data are inconsistent, using first data and the renewal time of first data, second database is updated, made
The data obtained in first database are consistent with the data in second database.
10. data check equipment as claimed in claim 7, it is characterised in that
The verification unit, it is determined that first data the renewal time consistency for updating time and second data when,
Determine that the data in first database are consistent with the data in second database.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610576517.4A CN106897342B (en) | 2016-07-20 | 2016-07-20 | Data verification method and equipment |
| CN202011205265.7A CN112487083B (en) | 2016-07-20 | 2016-07-20 | Data verification method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610576517.4A CN106897342B (en) | 2016-07-20 | 2016-07-20 | Data verification method and equipment |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011205265.7A Division CN112487083B (en) | 2016-07-20 | 2016-07-20 | Data verification method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106897342A true CN106897342A (en) | 2017-06-27 |
| CN106897342B CN106897342B (en) | 2020-10-09 |
Family
ID=59190868
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011205265.7A Active CN112487083B (en) | 2016-07-20 | 2016-07-20 | Data verification method and device |
| CN201610576517.4A Active CN106897342B (en) | 2016-07-20 | 2016-07-20 | Data verification method and equipment |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011205265.7A Active CN112487083B (en) | 2016-07-20 | 2016-07-20 | Data verification method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN112487083B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108762686A (en) * | 2018-06-04 | 2018-11-06 | 平安科技（深圳）有限公司 | Consistency verification of data flow control method, device, electronic equipment and storage medium |
| CN109614393A (en) * | 2018-10-26 | 2019-04-12 | 阿里巴巴集团控股有限公司 | Verification of data method and device |
| CN109669989A (en) * | 2018-12-29 | 2019-04-23 | 江苏满运软件科技有限公司 | Data verification method, system, equipment and medium |
| CN112699137A (en) * | 2021-01-04 | 2021-04-23 | 远光软件股份有限公司 | Cross-system financial data processing method and device |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112487083B (en) * | 2016-07-20 | 2024-03-12 | 创新先进技术有限公司 | Data verification method and device |
| JP2021189569A (en) * | 2020-05-26 | 2021-12-13 | 富士通株式会社 | Data update program, data update device, and data update method |
| CN112883119B (en) * | 2021-04-30 | 2022-05-17 | 腾讯科技（深圳）有限公司 | Data synchronization method and device, computer equipment and computer readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582920A (en) * | 2009-06-09 | 2009-11-18 | 中兴通讯股份有限公司 | Method and device for verifying and synchronizing data blocks in distributed file system |
| CN103605809A (en) * | 2013-12-10 | 2014-02-26 | 厦门诚创网络有限公司 | Data synchronization method |
| US20140365441A1 (en) * | 2010-05-18 | 2014-12-11 | Ca, Inc. | Systems and methods to determine security holes of a backup image |
| CN104462568A (en) * | 2014-12-26 | 2015-03-25 | 山东中创软件商用中间件股份有限公司 | Data reconciliation method, device and system |
| CN104462477A (en) * | 2014-12-18 | 2015-03-25 | 深圳市科漫达智能管理科技有限公司 | Data synchronizing method, device and system based on timestamp |
| CN105335443A (en) * | 2014-08-13 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Method and device for abnormity detection in data synchronization |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1117680A (en) * | 1997-06-26 | 1999-01-22 | Fujitsu Ltd | Matching processor between exchange system and maintenance operation system |
| JP2001060164A (en) * | 1999-05-18 | 2001-03-06 | Hitachi Ltd | Method and system for processing data, device for executing the same and recording medium recording processing program therefor |
| WO2006039003A2 (en) * | 2004-08-20 | 2006-04-13 | Viisage Technology, Inc. | Method and system to authenticate an object |
| JP2005267663A (en) * | 2005-06-13 | 2005-09-29 | Fujitsu Ltd | Document proofreading device |
| JP4738145B2 (en) * | 2005-11-28 | 2011-08-03 | 株式会社東芝 | Engineering database system and its handling method |
| US7890547B2 (en) * | 2006-03-22 | 2011-02-15 | Oy International Business Machines Ab | Content delivery server |
| JP5054065B2 (en) * | 2009-05-14 | 2012-10-24 | 株式会社エヌ・ティ・ティ・ドコモ | Database apparatus, database alignment system, and database alignment method |
| EP2506162A1 (en) * | 2011-03-31 | 2012-10-03 | Itsystems AG | Finding a data item of a plurality of data items stored in a digital data storage |
| US9298752B2 (en) * | 2013-08-26 | 2016-03-29 | Dropbox, Inc. | Facilitating data migration between database clusters while the database continues operating |
| JP6032566B2 (en) * | 2014-03-14 | 2016-11-30 | Ｎｅｃソリューションイノベータ株式会社 | Identification data processing apparatus and identification data processing method |
| CN204882852U (en) * | 2015-07-28 | 2015-12-16 | 国家电网公司 | Long -range calibration equipment of electric energy meter parameter |
| CN204989451U (en) * | 2015-07-30 | 2016-01-20 | 国家电网公司 | On --spot check -up communication tester of electric energy meter |
| CN112487083B (en) * | 2016-07-20 | 2024-03-12 | 创新先进技术有限公司 | Data verification method and device |
-
2016
- 2016-07-20 CN CN202011205265.7A patent/CN112487083B/en active Active
- 2016-07-20 CN CN201610576517.4A patent/CN106897342B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582920A (en) * | 2009-06-09 | 2009-11-18 | 中兴通讯股份有限公司 | Method and device for verifying and synchronizing data blocks in distributed file system |
| US20140365441A1 (en) * | 2010-05-18 | 2014-12-11 | Ca, Inc. | Systems and methods to determine security holes of a backup image |
| CN103605809A (en) * | 2013-12-10 | 2014-02-26 | 厦门诚创网络有限公司 | Data synchronization method |
| CN105335443A (en) * | 2014-08-13 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Method and device for abnormity detection in data synchronization |
| CN104462477A (en) * | 2014-12-18 | 2015-03-25 | 深圳市科漫达智能管理科技有限公司 | Data synchronizing method, device and system based on timestamp |
| CN104462568A (en) * | 2014-12-26 | 2015-03-25 | 山东中创软件商用中间件股份有限公司 | Data reconciliation method, device and system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108762686A (en) * | 2018-06-04 | 2018-11-06 | 平安科技（深圳）有限公司 | Consistency verification of data flow control method, device, electronic equipment and storage medium |
| CN108762686B (en) * | 2018-06-04 | 2021-01-01 | 平安科技（深圳）有限公司 | Data consistency check flow control method and device, electronic equipment and storage medium |
| CN109614393A (en) * | 2018-10-26 | 2019-04-12 | 阿里巴巴集团控股有限公司 | Verification of data method and device |
| CN109669989A (en) * | 2018-12-29 | 2019-04-23 | 江苏满运软件科技有限公司 | Data verification method, system, equipment and medium |
| CN112699137A (en) * | 2021-01-04 | 2021-04-23 | 远光软件股份有限公司 | Cross-system financial data processing method and device |
| CN112699137B (en) * | 2021-01-04 | 2023-09-12 | 远光软件股份有限公司 | Cross-system financial data processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112487083A (en) | 2021-03-12 |
| CN106897342B (en) | 2020-10-09 |
| CN112487083B (en) | 2024-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106897342A (en) | A kind of data verification method and equipment | |
| AU2018253478B2 (en) | Testing insecure computing environments using random data sets generated from characterizations of real data sets | |
| CN107957957A (en) | The acquisition methods and device of test case | |
| US20200201560A1 (en) | Data storage method, apparatus, and device for multi-layer blockchain-type ledger | |
| CN104778123B (en) | A kind of method and device of detecting system performance | |
| CN106897348A (en) | A kind of data storage, data check, data source tracing method and equipment | |
| CN106557486A (en) | A kind of storage method and device of data | |
| US10521407B2 (en) | Grouping of database objects | |
| CN107016016A (en) | A kind of method and device of data processing | |
| CN106899654A (en) | A kind of sequence value generation method, apparatus and system | |
| CN106897338A (en) | A kind of data modification request processing method and processing device for database | |
| CN110019111A (en) | Data processing method, device, storage medium and processor | |
| US11366821B2 (en) | Epsilon-closure for frequent pattern analysis | |
| CN107832446B (en) | Configuration item information searching method and computing device | |
| US11086906B2 (en) | System and method for reconciliation of data in multiple systems using permutation matching | |
| CN106547658A (en) | A kind of automated testing method and device | |
| US11609897B2 (en) | Methods and systems for improved search for data loss prevention | |
| CN107609011A (en) | The maintaining method and device of a kind of data-base recording | |
| US8095548B2 (en) | Methods, program product, and system of data management having container approximation indexing | |
| CN107133163A (en) | A kind of method and apparatus for verifying description class API | |
| CN106570029A (en) | Data processing method and data processing system of distributed relation type database | |
| CN106708648A (en) | Text data storage checking method and system | |
| CN106920576A (en) | A kind of method and system of inspection Nand Flash mass | |
| CN106294700A (en) | The storage of a kind of daily record and read method and device | |
| CN108809751A (en) | A kind of policy test method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200921 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200921 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220412 Address after: Room 602, No. 618, Wai Road, Huangpu District, Shanghai 200010 Patentee after: Ant fortune (Shanghai) Financial Information Service Co.,Ltd. Address before: Ky1-9008 business centre, 27 Hospital Road, Georgetown, grand caiman, UK Patentee before: Innovative advanced technology Co.,Ltd. |
|
| TR01 | Transfer of patent right |