CN110020550A - Check appraisal procedure, device and the equipment of platform - Google Patents

Check appraisal procedure, device and the equipment of platform Download PDF

Info

Publication number
CN110020550A
CN110020550A CN201910130759.4A CN201910130759A CN110020550A CN 110020550 A CN110020550 A CN 110020550A CN 201910130759 A CN201910130759 A CN 201910130759A CN 110020550 A CN110020550 A CN 110020550A
Authority
CN
China
Prior art keywords
content information
data
data record
fault location
rule
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910130759.4A
Other languages
Chinese (zh)
Other versions
CN110020550B (en
Inventor
姜楠
吴坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Advanced New Technologies Co Ltd
Advantageous New Technologies Co Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201910130759.4A priority Critical patent/CN110020550B/en
Publication of CN110020550A publication Critical patent/CN110020550A/en
Application granted granted Critical
Publication of CN110020550B publication Critical patent/CN110020550B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Bioethics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Storage Device Security (AREA)
  • Debugging And Monitoring (AREA)

Abstract

This specification embodiment provides a kind of appraisal procedure, device and equipment for checking platform, and in the appraisal procedure of verification platform, verification platform receives the content information of the data record currently changed in the database that data duplication centre is sent.The content information of the data record is obtained after parsing by change log progress of the data duplication centre to database.Obtain corresponding direct fault location rule.According to direct fault location rule, the content information of data record is distorted.According to preset verification rule, the content information after distorting is checked, to obtain checked result.The checked result is used to assess the data difference ability of discovery of verification platform.

Description

Check appraisal procedure, device and the equipment of platform
Technical field
This specification one or more embodiment is related to field of computer technology more particularly to a kind of assessment for checking platform Method, device and equipment.
Background technique
Verification platform is for checking the data in truthful data library.In order to assess the data difference hair of verification platform Existing ability, in traditional technology, it will usually the data in the truthful data library checked be distorted by rehearsal, then see core Whether data difference can be detected to platform.However, the operation for distorting the data in truthful data library needs after rehearsal Rollback.In addition, it is possible that the place that downstream relies on this data reads the data of mistake, causing during rehearsal Downstream data is contaminated.
Accordingly, it is desirable to provide a kind of method of more reliably assessment verification platform.
Summary of the invention
This specification one or more embodiment describes a kind of appraisal procedure, device and equipment for checking platform, can be with The assessment that verification platform is realized in the case where not distorting to the data in truthful data library, thereby ensures that truthful data Safety.
In a first aspect, providing a kind of appraisal procedure for checking platform, comprising:
Verification platform receives the content information of the data record currently changed in the database that data duplication centre is sent;
The content information of the data record is parsed by change log of the data duplication centre to the database It obtains afterwards;
Obtain corresponding direct fault location rule;
According to the direct fault location rule, the content information of the data record is distorted;
According to preset verification rule, the content information after described distort is checked, to obtain checked result;It is described Checked result is used to assess the data difference ability of discovery of the verification platform.
Second aspect provides a kind of appraisal procedure for checking platform, comprising:
Obtain the change log of database;
The change log is parsed, to obtain the content letter of the data record currently changed in the database Breath;
The content information of the data record is sent to verification platform;So that the verification platform obtains corresponding failure note Enter rule, and according to the direct fault location rule, the content information of the data record is distorted;Also make the verification flat Platform is checked the content information after described distort, according to preset verification rule to obtain checked result;The verification knot Fruit is used to assess the data difference ability of discovery of the verification platform.
The third aspect provides a kind of assessment device for checking platform, comprising:
Receiving unit, the content letter of the data record currently changed in the database of duplication centre transmission for receiving data Breath;
The content information of the data record is parsed by change log of the data duplication centre to the database It obtains afterwards;
Acquiring unit, for obtaining corresponding direct fault location rule;
Unit is distorted, the direct fault location rule for obtaining according to the acquiring unit, to the data record Content information is distorted;
Unit is checked, for distorting the progress core of the content information after unit is distorted to described according to preset verification rule It is right, to obtain checked result;The checked result is used to assess the data difference ability of discovery of verification platform.
Fourth aspect provides a kind of assessment device for checking platform, comprising:
Acquiring unit, for obtaining the change log of database;
Resolution unit, the change log for obtaining to the acquiring unit parse, to obtain the data The content information of the data record currently changed in library;
Transmission unit, for sending the content information of the data record to verification platform;So that the verification platform obtains Corresponding direct fault location rule is taken, and according to the direct fault location rule, the content information of the data record is distorted; Also make the verification platform according to preset verification rule, the content information after described distort is checked, to be checked As a result;The checked result is used to assess the data difference ability of discovery of the verification platform.
5th aspect provides a kind of assessment equipment for checking platform, comprising:
Memory;
One or more processors;And
One or more programs wherein the storage of one or more of programs is in the memory, and are configured to It is executed by one or more of processors, described program performs the steps of when being executed by the processor
Receive the content information of the data record currently changed in the database that data duplication centre is sent;
The content information of the data record is parsed by change log of the data duplication centre to the database It obtains afterwards;
Obtain corresponding direct fault location rule;
According to the direct fault location rule, the content information of the data record is distorted;
According to preset verification rule, the content information after described distort is checked, to obtain checked result;It is described Checked result is used to assess the data difference ability of discovery of verification platform.
6th aspect provides a kind of assessment equipment for checking platform, comprising:
Memory;
One or more processors;And
One or more programs wherein the storage of one or more of programs is in the memory, and are configured to It is executed by one or more of processors, described program performs the steps of when being executed by the processor
Obtain the change log of database;
The change log is parsed, to obtain the content letter of the data record currently changed in the database Breath;
The content information of the data record is sent to verification platform;So that the verification platform obtains corresponding failure note Enter rule, and according to the direct fault location rule, the content information of the data record is distorted;Also make the verification flat Platform is checked the content information after described distort, according to preset verification rule to obtain checked result;The verification knot Fruit is used to assess the data difference ability of discovery of the verification platform.
Appraisal procedure, device and the equipment for the verification platform that this specification one or more embodiment provides, check platform Receive the content information of the data record currently changed in the database that data duplication centre is sent.The content of the data record is believed Breath is obtained after parsing by change log progress of the data duplication centre to database.Obtain corresponding direct fault location rule. According to direct fault location rule, the content information of data record is distorted.According to preset verification rule, in after distorting Hold information to be checked, to obtain checked result.The checked result is used to assess the data difference ability of discovery of verification platform.? In the scheme that i.e. this specification provides, the content information of data record is obtained by being parsed to change log, this can be with Reduce the access pressure of database.Verification platform can be distorted and be checked to the content information later, so as to not The assessment that verification platform is realized in the case where distorting to the data in truthful data library, thereby ensures that the peace of truthful data Quan Xing.
Detailed description of the invention
In order to illustrate more clearly of the technical solution of this specification embodiment, will make below to required in embodiment description Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some embodiments of this specification, right For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings Its attached drawing.
Fig. 1 is the appraisal procedure application scenarios schematic diagram for the verification platform that this specification provides;
Fig. 2 is the appraisal procedure flow chart for the verification platform that this specification one embodiment provides;
Fig. 3 is the appraisal procedure flow chart for the verification platform that another embodiment of this specification provides;
Fig. 4 is the assessment schematic device for the verification platform that this specification one embodiment provides;
Fig. 5 is the assessment schematic device that this illustrates the verification platform that another embodiment provides;
Fig. 6 is the assessment equipment schematic diagram for the verification platform that this specification one embodiment provides;
Fig. 7 is the assessment equipment schematic diagram for the verification platform that another embodiment of this specification provides.
Specific embodiment
With reference to the accompanying drawing, the scheme provided this specification is described.
Before the scheme that description this specification provides, first the inventive concept of this programme is made the following instructions.
According to the content of background technique it is found that in traditional technology, in order to assess the data difference ability of discovery of verification platform, Data in truthful data library would generally be distorted.However the data modified in truthful data library are usually risk operations, And after rehearsal, it is also necessary to restore the data of modification back.In addition, a usual data are modified, downstream institute There is the place for relying on the data to be likely to lead to entire link data inaccuracy, the situation because read wrong data It is difficult to restore.
In order to guarantee the safety of truthful data, it may be considered that come out the reading data in truthful data library, then needle The data read out are distorted.However the operation for reading truthful data library will increase the access pressure in truthful data library. In order to reduce the access pressure in truthful data library, it may be considered that parsed by the change log to truthful data library, to obtain Take the data in truthful data library.The change log of database would generally in detail recording needle to each row of data in database ( Claim a data record) performed by operation and the row data modification details.Therefore, the change log, Ke Yizhun are based on Really get each row of data in truthful data library.
Above it is exactly the inventive concept of this programme, the scheme of this specification offer is provided based on the inventive concept.
Fig. 1 is the appraisal procedure application scenarios schematic diagram for the verification platform that this specification provides.In Fig. 1, verification platform can To subscribe to the change log of at least one database.After completing above-mentioned subscription operation, data duplication centre can be to data The change log in library is monitored.When there is new change log to generate, data duplication centre can obtain the change log. Certainly, in practical applications, data duplication centre can also periodically acquire above-mentioned change log.It should be noted that due to Different types of database, the journal format and log content of corresponding change log are usually different.In order to shield This otherness is covered, data duplication centre can parse the change log got, to be translated into general format Change log, the change log of the general format is referred to as standardized messages.The standardized messages include at least data The content information of the data record currently changed in library.In addition, it can include the table of the library name of database, affiliated tables of data Title, major key (primary key, PK) and dependency identification (for example, transaction journal number etc.) etc..
Later, above-mentioned standard message can be sent to verification platform by data duplication centre.In the verification platform in advance It is stored with the direct fault location rule by drilling platforms push.In one example, for the different data in different databases Table, drilling platforms can push different direct fault location rules.In another example, unified direct fault location can also be set Rule does not distinguish database and tables of data.For by taking said one example as an example, disappear receiving above-mentioned standard After breath, above-mentioned library name and table name can be based on by the awatch-drc component in verification platform, obtain corresponding event Barrier injection rule.According to direct fault location rule, the content information of data record is distorted.By the data record after distorting Content information is stored into storage unit.
After being spaced specified duration, verification platform can be remembered from the data after reading stored distort in storage unit The content information of record, and it is checked based on preset verification rule, to obtain checked result.Based on the checked result, It can realize that the data difference ability of discovery to verification platform is assessed.For example, when the checked result is data in the presence of poor Different time, then the data difference ability of discovery of the verification platform is preferable.When the checked result is that difference is not present in data, then the core It is poor to the data difference ability of discovery of platform.
It is that the overview of the appraisal procedure of verification platform is below described in detail the appraisal procedure above.
Fig. 2 is the appraisal procedure flow chart for the verification platform that this specification one embodiment provides.The execution of the method Main body can be the equipment with processing capacity: server or system or platform, can be the verification platform in Fig. 1 e.g.. As shown in Fig. 2, the method can specifically include:
Step 202, verification platform receives the interior of the data record currently changed in the database that data duplication centre is sent Hold information.
The content information of the data record can be to be solved by change log of the data duplication centre to above-mentioned database It is obtained after analysis.Specifically, verification platform can in advance subscription database change log.Complete above-mentioned subscription operation it Afterwards, data duplication centre can be monitored the change log of database.When there is new change log to generate, data duplication Center can obtain the change log.Certainly, in practical applications, data duplication centre can also periodically acquire above-mentioned change More log.
It should be noted that due to different types of database, the journal format of corresponding change log and log Content is usually different.In order to shield this otherness, data duplication centre can be carried out the change log got Parsing, to be translated into the change log of general format, the change log of the general format is referred to as standardized messages. The standardized messages at least may include the content information of the data record currently changed in database.In addition, it can include The library name of database, the table name of affiliated tables of data and action type etc..In the present specification, the content of data record Information may include multiple fields and corresponding field value.Here after field value may include value and change before changing Value.For by taking action type is to increase (Insert) operation as an example, value before changing can be understood as sky, and the value after change is For the field value newly increased.
After conversion obtains above-mentioned standard message, which can be sent to verification by data duplication centre Platform.The content information of above-mentioned data record can be got to check platform.
Step 204, corresponding direct fault location rule is obtained.
Here direct fault location rule can be to be pushed in advance by drilling platforms.In one example, for different Different tables of data in database, drilling platforms can push different direct fault location rules.In this example embodiment, database, The corresponding relationship of tables of data and direct fault location rule can be as shown in table 1.
Table 1
It in practical applications, can also include that failure is infused in order to ensure the accuracy of direct fault location, in above-mentioned corresponding relationship Enter field, it specifically can be as shown in table 2.
Table 2
It should be noted that when in upper corresponding relationship not including direct fault location field, it can be in the subsequent process distorted In, determine that direct fault location field, this specification are not construed as limiting this by parsing direct fault location rule.
In addition it is also possible to unified setting direct fault location rule, i.e., all databases and tables of data set unified event Barrier injection rule, this specification are not construed as limiting this.
It should be noted that when setting different direct fault location rules for the different data table in disparate databases, Can also be read from above-mentioned standard message the affiliated database of the data record currently changed library name and affiliated data The table name of table.Later, the corresponding relationship based on database, tables of data and direct fault location rule obtains and corresponds to library name And the direct fault location rule of table name.For by taking corresponding relationship is table 1 as an example, work as library name are as follows: library x, table name are as follows: table a When, the direct fault location rule that gets can be with are as follows: rule 1.
Step 206, according to direct fault location rule, the content information of data record is distorted.
Direct fault location rule in this specification can have corresponding rule match conditions.The rule match conditions are at least The condition of satisfaction needed for field value including part field or whole fields in data record.Only when meeting the rule When with condition, just the content information of data record is distorted.
As an example it is assumed that the content information of data record is as follows: field A=1;Field B=2;Field C=3.And it obtains Direct fault location rule rule match conditions it is as follows: field A=1 and field B=2, then the content information of data record is full Sufficient rule match conditions, so as to be distorted to the content information of data record according to direct fault location rule.
Certainly, in practical applications, above-mentioned rule match conditions can not also be set.When not setting above-mentioned rule match item When part, directly according to direct fault location rule, the content information of data record is distorted.
About above-mentioned direct fault location rule, it can be finger for set by direct fault location field and distort mode, it e.g., can Think that the field value by direct fault location field adds 1;Or, or the field value of direct fault location field is revised as arbitrary value Etc..
When in above-mentioned corresponding relationship further including direct fault location field, step 206 is specifically as follows: it is based on corresponding relationship, Determine direct fault location field.Such as, direct fault location field can be determined from table 2 according to acquired direct fault location rule.Root According to direct fault location field, the field to match is selected from multiple fields in the content information of data record.According to failure Injection rule, distorts the corresponding field value of the field to match.For also by taking previous example as an example, it is assumed that above-mentioned correspondence The direct fault location field recorded in relationship are as follows: field C, and direct fault location rule are as follows: field value adds 1, then can be to above-mentioned data The field value of field C in the content information of record adds 1, the field value after being distorted: 4.Namely the data record after distorting Content information it is as follows: field A=1;Field B=2;Field C=4.
Optionally, it after the content information for getting the data record after above-mentioned distort, can state on local storage The content information of data record after distorting.It specifically, can be by the content information of the data record after distorting with key_value Form store into corresponding storage unit.Wherein, key value may include the PK of above-mentioned data record, and value value can wrap Include the content information of data record.Certainly, in practical applications, above-mentioned key value can also include library name, the table of data record Title and dependency identification etc..
Step 208, according to preset verification rule, the content information after distorting is checked, to obtain checked result.
Here preset verification rule can be used for corresponding data in the content information after distorting and target matrix The content information of record is compared.Goal tables of data can have with tables of data belonging to the data record that currently changes There is correlation.For example, when user A transfers accounts to user B, database can generate two datas record: A outflow record with And the inflow record of B, and two data record can be respectively recorded to two tables of data: in tables of data A and tables of data B.That , if current data is recorded as the outflow record of A, tables of data B is target matrix.
It should be noted that when verification platform also stores the content information of data record after distorting into storage unit When, it can be after being spaced specified duration, the content information of the data record after reading above-mentioned distort in storage unit.When So, in practical applications, it can not also be spaced above-mentioned specified duration, and directly read the content of the data record after above-mentioned distort Information, this specification are not construed as limiting this.
Read certain distort after data record content information after, which is specifically as follows: obtain The dependency identification of the data record currently changed.According to dependency identification, from each item of locally stored target matrix Corresponding data record is searched in data record.If finding, the content information of corresponding data record is read.In after distorting Hold information to be compared with the content information that corresponding data records, to obtain checked result.
It is understood that above-mentioned comparison process can be and the part field in content information is compared.With Aforementioned user A transfers accounts to for for the example of user B, can be and will produce amount of money correlation in the outflow record of A in tables of data A The field value that amount of money relevant field is transferred in the field value of field and the inflow record of B in tables of data B is compared.
Checked result obtained above can be used for assessing the data difference ability of discovery of verification platform.Such as, when the verification When as a result having differences for data, then the data difference ability of discovery of the verification platform is preferable.When the checked result be data not When having differences, then the data difference ability of discovery of the verification platform is poor.
It certainly, can be based on multiple checked result, to the data difference of verification platform in order to guarantee the accuracy assessed Different ability of discovery is assessed, and this specification is not construed as limiting this.
To sum up, the appraisal procedure for the verification platform that this specification one embodiment provides, data duplication centre passes through logarithm It is parsed according to the change log in library, gets the content information of the data record currently changed in database.Later, data are multiple The content information of the data record is sent to verification platform by center processed, is distorted by verification platform to it and stores storage In unit, it is possible thereby to avoid distorting and bring a series of problems the data in truthful data library.In addition, verification is flat Platform directly can read data from storage unit during checking data, and not have to access truthful data library, it is possible thereby to Reduce the access pressure in truthful data library.
Fig. 3 is the appraisal procedure flow chart for the verification platform that another embodiment of this specification provides.The method is held Row main body can be the equipment with processing capacity: server or system or platform, e.g., can be multiple for the data in Fig. 1 Center processed.As shown in figure 3, the method can specifically include:
Step 302, the change log of database is obtained.
Specifically, verification platform can in advance subscription database change log.After completing above-mentioned subscription operation, number The change log of database can be monitored according to duplication centre.When there is new change log to generate, data duplication centre The change log can be obtained.Certainly, in practical applications, data duplication centre can also periodically acquire above-mentioned change day Will.
Step 304, change log is parsed, to obtain the content letter of the data record currently changed in database Breath.
Due to different types of database, the journal format and log content of corresponding change log are usually different Sample.In order to shield this otherness, data duplication centre can parse the change log got, be converted Change log for the change log of general format, the general format is referred to as standardized messages.The standardized messages are extremely It less may include the content information of the data record currently changed in database.In addition, it can include the library name of database, Table name and action type of affiliated tables of data etc..In the present specification, the content information of data record may include more A field and corresponding field value.Here field value may include the value after value and change before changing.To operate class Type is to increase for for (Insert) is operated, and value before changing can be understood as sky, and the value after change is the word newly increased Segment value.
Step 306, the content information of data record is sent to verification platform.
Platform is checked after receiving the content information of data record, available corresponding direct fault location rule.It should Direct fault location rule can be to be pushed in advance by drilling platforms.In one example, for the difference in different databases Tables of data, drilling platforms can push different direct fault location rules.In this example embodiment, database, tables of data and failure The corresponding relationship of injection rule can be as shown in table 1.Certainly, in practical applications, setting direct fault location rule can also be unified, This specification is not construed as limiting this.
It should be noted that when setting different direct fault location rules for the different data table in disparate databases, Verification platform can also receive the library name of the affiliated database of data record that currently change and affiliated from data duplication centre The table name of tables of data.Later, the corresponding relationship based on database, tables of data and direct fault location rule obtains and corresponds to library The direct fault location of title and table name rule.For by taking corresponding relationship is table 1 as an example, work as library name are as follows: library x, table name are as follows: When table a, the direct fault location rule that gets can be with are as follows: rule 1.
After getting above-mentioned direct fault location rule, verification platform can be according to direct fault location rule, to data record Content information distorted.Direct fault location rule in this specification can have corresponding rule match conditions.The rule Matching condition includes at least the condition met needed for the field value of part field or whole fields in data record.Only when When meeting the rule match conditions, just the content information of data record is distorted.
Certainly, in practical applications, above-mentioned rule match conditions can not also be set.When not setting above-mentioned rule match item When part, directly according to direct fault location rule, the content information of data record is distorted.
About above-mentioned direct fault location rule, it can be finger for set by direct fault location field and distort mode, it e.g., can Think that the field value by direct fault location field adds 1;Or, or the field value of direct fault location field is revised as arbitrary value Etc..
The above-mentioned process of distorting is specifically as follows: being based on corresponding relationship, determines direct fault location field.According to direct fault location word Section, selects the field to match from multiple fields in the content information of data record.According to direct fault location rule, to phase The corresponding field value of matched field is distorted.
Optionally, it after the content information for getting the data record after above-mentioned distort, can state on local storage The content information of data record after distorting.It specifically, can be by the content information of the data record after distorting with key_value Form store into corresponding storage unit.Wherein, key value may include the PK of above-mentioned data record, and value value can wrap Include the content information of data record.Certainly, in practical applications, above-mentioned key value can also include library name, the table of data record Title and dependency identification etc..
Complete it is above-mentioned distort process after, verification platform can be according to preset verification rule, to the content letter after distorting Breath is checked, to obtain checked result.
Here preset verification rule can be used for corresponding data in the content information after distorting and target matrix The content information of record is compared.Goal tables of data can have with tables of data belonging to the data record that currently changes There is correlation.It should be noted that when verification platform is also by the content information storage of data record after distorting to storage unit It, can be after being spaced specified duration when middle, the content information of the data record after reading above-mentioned distort in storage unit.When So, in practical applications, it can not also be spaced above-mentioned specified duration, and directly read the content of the data record after above-mentioned distort Information, this specification are not construed as limiting this.
Read certain distort after data record content information after, which is specifically as follows: obtain The dependency identification of the data record currently changed.According to dependency identification, from each item of locally stored target matrix Corresponding data record is searched in data record.If finding, the content information of corresponding data record is read.In after distorting Hold information to be compared with the content information that corresponding data records, to obtain checked result.
It is understood that above-mentioned comparison process can be and the part field in content information is compared.
Checked result obtained above can be used for assessing the data difference ability of discovery of verification platform.Such as, when the verification When as a result having differences for data, then the data difference ability of discovery of the verification platform is preferable.When the checked result be data not When having differences, then the data difference ability of discovery of the verification platform is poor.
It certainly, can be based on multiple checked result, to the data difference of verification platform in order to guarantee the accuracy assessed Different ability of discovery is assessed, and this specification is not construed as limiting this.
To sum up, the appraisal procedure for the verification platform that this specification embodiment provides, can be in truthful data library Data realize the assessment of verification platform in the case where being distorted, thereby ensure that the safety of truthful data.
Accordingly with the appraisal procedure of above-mentioned verification platform, a kind of verification platform that this specification one embodiment also provides Assessment device, as shown in figure 4, the apparatus may include:
Receiving unit 402, for receiving data duplication centre send database in currently change data record it is interior Hold information.
The content information of the data record is obtained after being parsed by change log of the data duplication centre to database 's.
Acquiring unit 404, for obtaining corresponding direct fault location rule.
Unit 406 is distorted, the direct fault location rule for obtaining according to acquiring unit 404 believes the content of data record Breath is distorted.
Unit 408 is checked, for being carried out to the content information after unit 406 is distorted is distorted according to preset verification rule Verification, to obtain checked result.The checked result is used to assess the data difference ability of discovery of verification platform.
Optionally, acquiring unit 404 are also used to obtain the library name of database and the table of the affiliated tables of data of data record Title.
Acquiring unit 404 specifically can be used for:
Corresponding relationship based on database, tables of data and direct fault location rule obtains and corresponds to library name and table name The direct fault location rule of title.
Optionally, direct fault location rule has corresponding rule match conditions.
Distorting unit 406 specifically can be used for:
Judge whether the content information of data record meets rule match conditions.
If it is satisfied, then being distorted according to direct fault location rule to the content information of data record.
Optionally, above-mentioned corresponding relationship can also include direct fault location field, and the content information of data record may include Multiple fields and corresponding field value.
Distorting unit 406 specifically can be used for:
Based on corresponding relationship, direct fault location field is determined.
According to direct fault location field, the word to match is selected from multiple fields in the content information of data record Section.
According to direct fault location rule, the corresponding field value of the field to match is distorted.
Optionally, which can also include:
Storage unit 410, in the content information that the data record after distorting is locally stored.
Verification unit 408 specifically can be used for:
It is spaced after specified duration, reads the content information of the data record after distorting what is be locally stored.
According to preset verification rule, the content information of the data record after the distorting of reading is checked, to obtain Checked result.
Optionally, preset verification rule is for recording corresponding data in the content information after distorting and target matrix Content information be compared.
Verification unit 408 also specifically can be used for:
Obtain the dependency identification of data record.
According to dependency identification, corresponding data note is searched from the pieces of data of locally stored target matrix record Record.
If finding, the content information of corresponding data record is read.
Content information after distorting is compared with the content information that corresponding data records, to obtain checked result.
The function of each functional module of this specification above-described embodiment device can pass through each step of above method embodiment Rapid to realize, therefore, the specific work process for the device that this specification one embodiment provides does not repeat again herein.
The assessment device for the verification platform that this specification one embodiment provides, receiving unit 402 receive in data duplication The content information of the data record currently changed in the database that the heart is sent.The content information of the data record is replicated by data Center carries out the change log of database obtained after parsing.Acquiring unit 404 obtains corresponding direct fault location rule.It distorts Unit 406 distorts the content information of data record according to direct fault location rule.Unit 408 is checked according to preset core To rule, the content information after distorting is checked, to obtain checked result.The checked result is used to assess verification platform Data difference ability of discovery.The safety of truthful data is thereby ensured that as a result,.
The assessment device for the verification platform that this specification one embodiment provides can be a mould of verification platform in Fig. 1 Block or unit.
Accordingly with the appraisal procedure of above-mentioned verification platform, a kind of verification platform that this specification one embodiment also provides Assessment device, as shown in figure 5, the apparatus may include:
Acquiring unit 502, for obtaining the change log of database.
Resolution unit 504, the change log for obtaining to acquiring unit 502 parse, with obtain in database when The content information of the data record of preceding change.
Transmission unit 506, for sending the content information of data record to verification platform.So that verification platform is obtained and is corresponded to Direct fault location rule, and according to direct fault location rule, the content information of data record is distorted.Also make to check platform root According to preset verification rule, the content information after distorting is checked, to obtain checked result.Checked result is for assessing core To the data difference ability of discovery of platform.
The function of each functional module of this specification above-described embodiment device can pass through each step of above method embodiment Rapid to realize, therefore, the specific work process for the device that this specification one embodiment provides does not repeat again herein.
The assessment device for the verification platform that this specification one embodiment provides, it can be ensured that the safety of truthful data.
The assessment device for the verification platform that this specification one embodiment provides can be one of data duplication centre in Fig. 1 A module or unit.
Accordingly with the appraisal procedure of above-mentioned verification platform, this specification embodiment additionally provides a kind of commenting for verification platform Equipment is estimated, as shown in fig. 6, the equipment may include: memory 602, one or more processors 604 and one or more journeys Sequence.Wherein, which stores in the memory 602, and is configured to be held by one or more processors 604 Row, the program perform the steps of when being executed by processor 604
Receive the content information of the data record currently changed in the database that data duplication centre is sent.
The content information of the data record is obtained after being parsed by change log of the data duplication centre to database 's.
Obtain corresponding direct fault location rule.
According to direct fault location rule, the content information of data record is distorted.
According to preset verification rule, the content information after distorting is checked, to obtain checked result.The verification knot Fruit is used to assess the data difference ability of discovery of verification platform.
The assessment equipment for the verification platform that this specification one embodiment provides, it can be ensured that the safety of truthful data.
Accordingly with the appraisal procedure of above-mentioned verification platform, this specification embodiment additionally provides a kind of commenting for verification platform Equipment is estimated, as shown in fig. 7, the equipment may include: memory 702, one or more processors 704 and one or more journeys Sequence.Wherein, which is stored in memory 702, and is configured to be held by one or more processors 704 Row, the program perform the steps of when being executed by processor 704
Obtain the change log of database.
Change log is parsed, to obtain the content information of the data record currently changed in database.
The content information of data record is sent to verification platform.So that verification platform obtains corresponding direct fault location rule, And according to direct fault location rule, the content information of data record is distorted.Advise verification platform according to preset verification Then, the content information after distorting is checked, to obtain checked result.The checked result is used to assess the data of verification platform Difference ability of discovery.
The assessment equipment for the verification platform that this specification one embodiment provides, it can be ensured that the safety of truthful data.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for equipment reality For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method Part explanation.
The step of method in conjunction with described in this disclosure content or algorithm can realize in a manner of hardware, It can be and the mode of software instruction is executed by processor to realize.Software instruction can be made of corresponding software module, software Module can be stored on RAM memory, flash memory, ROM memory, eprom memory, eeprom memory, register, hard Disk, mobile hard disk, CD-ROM or any other form well known in the art storage medium in.A kind of illustrative storage Jie Matter is coupled to processor, to enable a processor to from the read information, and information can be written to the storage medium. Certainly, storage medium is also possible to the component part of processor.Pocessor and storage media can be located in ASIC.In addition, should ASIC can be located in server.Certainly, pocessor and storage media can also be used as discrete assembly and be present in server.
Those skilled in the art are it will be appreciated that in said one or multiple examples, function described in the invention It can be realized with hardware, software, firmware or their any combination.It when implemented in software, can be by these functions Storage in computer-readable medium or as on computer-readable medium one or more instructions or code transmitted. Computer-readable medium includes computer storage media and communication media, and wherein communication media includes convenient for from a place to another Any medium of one place transmission computer program.Storage medium can be general or specialized computer can access it is any Usable medium.
It is above-mentioned that this specification specific embodiment is described.Other embodiments are in the scope of the appended claims It is interior.In some cases, the movement recorded in detail in the claims or step can be come according to the sequence being different from embodiment It executes and desired result still may be implemented.In addition, process depicted in the drawing not necessarily require show it is specific suitable Sequence or consecutive order are just able to achieve desired result.In some embodiments, multitasking and parallel processing be also can With or may be advantageous.
Above-described specific embodiment has carried out into one the purpose of this specification, technical scheme and beneficial effects Step is described in detail, it should be understood that being not used to limit this foregoing is merely the specific embodiment of this specification The protection scope of specification, all any modifications on the basis of the technical solution of this specification, made, change equivalent replacement Into etc., it should all include within the protection scope of this specification.

Claims (16)

1. a kind of appraisal procedure for checking platform, comprising:
Verification platform receives the content information of the data record currently changed in the database that data duplication centre is sent;
The content information of the data record is obtained after being parsed by change log of the data duplication centre to the database It arrives;
Obtain corresponding direct fault location rule;
According to the direct fault location rule, the content information of the data record is distorted;
According to preset verification rule, the content information after described distort is checked, to obtain checked result;The verification As a result for assessing the data difference ability of discovery of the verification platform.
2. according to the method described in claim 1, further include:
Obtain the library name of the database and the table name of the affiliated tables of data of the data record;
It is described to obtain corresponding direct fault location rule, comprising:
Corresponding relationship based on database, tables of data and direct fault location rule, is obtained corresponding to the library name and the table The direct fault location rule of title.
3. according to the method described in claim 1, the direct fault location rule has corresponding rule match conditions;
It is described regular according to the direct fault location, the content information of the data record is distorted, comprising:
Judge whether the content information of the data record meets the rule match conditions;
If it is satisfied, then being distorted according to the direct fault location rule to the content information of the data record.
4. according to the method described in claim 2, further including direct fault location field in the corresponding relationship;The data record Content information includes multiple fields and corresponding field value;
It is described regular according to the direct fault location, the content information of the data record is distorted, comprising:
Based on the corresponding relationship, the direct fault location field is determined;
According to the direct fault location field, the field to match is selected from the multiple field;
According to the direct fault location rule, the corresponding field value of the field to match is distorted.
5. according to the method described in claim 1, also being wrapped after the content information to the data record is distorted It includes:
In the content information that the data record after distorting is locally stored;
It is described that the content information after described distort is checked according to preset verification rule, to obtain checked result, packet It includes:
It is spaced after specified duration, reads the content information of the data record after distorting what is be locally stored;
According to the preset verification rule, the content information of the data record after distorting described in reading is checked, with Obtain checked result.
6. according to the method described in claim 5, the preset verification rule is used for the content information after distorting and target The content information that corresponding data records in tables of data is compared;
It is described that the content information after described distort is checked according to preset verification rule, to obtain checked result, packet It includes:
Obtain the dependency identification of the data record;
According to the dependency identification, the corresponding number is searched from the pieces of data of locally stored target matrix record According to record;
If finding, the content information of the corresponding data record is read;
Content information after described distort is compared with the content information that the corresponding data records, to obtain the verification As a result.
7. a kind of appraisal procedure for checking platform, comprising:
Obtain the change log of database;
The change log is parsed, to obtain the content information of the data record currently changed in the database;
The content information of the data record is sent to verification platform;So that the verification platform obtains corresponding direct fault location rule Then, and according to the direct fault location rule, the content information of the data record is distorted;Also make the verification platform root According to preset verification rule, the content information after described distort is checked, to obtain checked result;The checked result is used In the data difference ability of discovery for assessing the verification platform.
8. a kind of assessment device for checking platform, comprising:
Receiving unit, the content information of the data record currently changed in the database of duplication centre transmission for receiving data;
The content information of the data record is obtained after being parsed by change log of the data duplication centre to the database It arrives;
Acquiring unit, for obtaining corresponding direct fault location rule;
Unit is distorted, the direct fault location rule for obtaining according to the acquiring unit, to the content of the data record Information is distorted;
Unit is checked, for regular according to preset verification, the content information after unit is distorted distorted to described and checks, with Obtain checked result;The checked result is used to assess the data difference ability of discovery of verification platform.
9. device according to claim 8,
The acquiring unit is also used to obtain the library name of the database and the table name of the affiliated tables of data of the data record Claim;
The acquiring unit is specifically used for:
Corresponding relationship based on database, tables of data and direct fault location rule obtains and corresponds to the library name and described The direct fault location rule of table name.
10. device according to claim 8, the direct fault location rule has corresponding rule match conditions;
The unit of distorting is specifically used for:
Judge whether the content information of the data record meets the rule match conditions;
If it is satisfied, then being distorted according to the direct fault location rule to the content information of the data record.
It further include direct fault location field in the corresponding relationship 11. device according to claim 9;The data record Content information include multiple fields and corresponding field value;
The unit of distorting is specifically used for:
Based on the corresponding relationship, the direct fault location field is determined;
According to the direct fault location field, the field to match is selected from the multiple field;
According to the direct fault location rule, the corresponding field value of the field to match is distorted.
12. device according to claim 8, further includes:
Storage unit, in the content information that the data record after distorting is locally stored;
The verification unit is specifically used for:
It is spaced after specified duration, reads the content information of the data record after distorting what is be locally stored;
According to the preset verification rule, the content information of the data record after distorting described in reading is checked, with Obtain checked result.
13. device according to claim 12, the preset verification rule is used for the content information after distorting and mesh The content information of corresponding data record is compared in mark tables of data;
The verification unit also particularly useful for:
Obtain the dependency identification of the data record;
According to the dependency identification, the corresponding number is searched from the pieces of data of locally stored target matrix record According to record;
If finding, the content information of the corresponding data record is read;
Content information after described distort is compared with the content information that the corresponding data records, to obtain the verification As a result.
14. a kind of assessment device for checking platform, comprising:
Acquiring unit, for obtaining the change log of database;
Resolution unit, the change log for obtaining to the acquiring unit parse, to obtain in the database The content information of the data record currently changed;
Transmission unit, for sending the content information of the data record to verification platform;So that the verification platform acquisition pair The direct fault location rule answered, and according to the direct fault location rule, the content information of the data record is distorted;Also make The verification platform is checked the content information after described distort, according to preset verification rule to obtain checked result; The checked result is used to assess the data difference ability of discovery of the verification platform.
15. a kind of assessment equipment for checking platform, comprising:
Memory;
One or more processors;And
One or more programs wherein the storage of one or more of programs is in the memory, and are configured to by institute One or more processors execution is stated, described program performs the steps of when being executed by the processor
Receive the content information of the data record currently changed in the database that data duplication centre is sent;
The content information of the data record is obtained after being parsed by change log of the data duplication centre to the database It arrives;
Obtain corresponding direct fault location rule;
According to the direct fault location rule, the content information of the data record is distorted;
According to preset verification rule, the content information after described distort is checked, to obtain checked result;The verification As a result for assessing the data difference ability of discovery of verification platform.
16. a kind of assessment equipment for checking platform, comprising:
Memory;
One or more processors;And
One or more programs wherein the storage of one or more of programs is in the memory, and are configured to by institute One or more processors execution is stated, described program performs the steps of when being executed by the processor
Obtain the change log of database;
The change log is parsed, to obtain the content information of the data record currently changed in the database;
The content information of the data record is sent to verification platform;So that the verification platform obtains corresponding direct fault location rule Then, and according to the direct fault location rule, the content information of the data record is distorted;Also make the verification platform root According to preset verification rule, the content information after described distort is checked, to obtain checked result;The checked result is used In the data difference ability of discovery for assessing the verification platform.
CN201910130759.4A 2019-02-21 2019-02-21 Assessment method, device and equipment for verification platform Active CN110020550B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910130759.4A CN110020550B (en) 2019-02-21 2019-02-21 Assessment method, device and equipment for verification platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910130759.4A CN110020550B (en) 2019-02-21 2019-02-21 Assessment method, device and equipment for verification platform

Publications (2)

Publication Number Publication Date
CN110020550A true CN110020550A (en) 2019-07-16
CN110020550B CN110020550B (en) 2023-09-05

Family

ID=67189061

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910130759.4A Active CN110020550B (en) 2019-02-21 2019-02-21 Assessment method, device and equipment for verification platform

Country Status (1)

Country Link
CN (1) CN110020550B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110673993A (en) * 2019-09-19 2020-01-10 聚好看科技股份有限公司 Fault injection method, platform and system
CN111339100A (en) * 2020-02-28 2020-06-26 中国工商银行股份有限公司 Data checking method and device
CN112148721A (en) * 2020-09-25 2020-12-29 新华三大数据技术有限公司 Data checking method and device, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101458705A (en) * 2008-12-29 2009-06-17 阿里巴巴集团控股有限公司 Data collating method between different utility systems, apparatus and system
CN105989059A (en) * 2015-02-09 2016-10-05 阿里巴巴集团控股有限公司 Data record checking method and device
CN106326219A (en) * 2015-06-16 2017-01-11 阿里巴巴集团控股有限公司 Business system data check method, apparatus and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101458705A (en) * 2008-12-29 2009-06-17 阿里巴巴集团控股有限公司 Data collating method between different utility systems, apparatus and system
CN105989059A (en) * 2015-02-09 2016-10-05 阿里巴巴集团控股有限公司 Data record checking method and device
CN106326219A (en) * 2015-06-16 2017-01-11 阿里巴巴集团控股有限公司 Business system data check method, apparatus and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
黄斌: ""同步数字体系网络管理双机冗余数据安全机制及离线操作的研究与应用"", 《广东电力》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110673993A (en) * 2019-09-19 2020-01-10 聚好看科技股份有限公司 Fault injection method, platform and system
CN110673993B (en) * 2019-09-19 2023-05-05 聚好看科技股份有限公司 Fault injection method, platform and system
CN111339100A (en) * 2020-02-28 2020-06-26 中国工商银行股份有限公司 Data checking method and device
CN111339100B (en) * 2020-02-28 2023-05-26 中国工商银行股份有限公司 Data checking method and device
CN112148721A (en) * 2020-09-25 2020-12-29 新华三大数据技术有限公司 Data checking method and device, electronic equipment and storage medium
CN112148721B (en) * 2020-09-25 2022-08-19 新华三大数据技术有限公司 Data checking method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN110020550B (en) 2023-09-05

Similar Documents

Publication Publication Date Title
CN106780045B (en) Policy information corrects method and apparatus
CN110020550A (en) Check appraisal procedure, device and the equipment of platform
CN108777141B (en) Test apparatus, test method, and storage medium
US20120158625A1 (en) Creating and Processing a Data Rule
CN106886509A (en) A kind of academic dissertation form automatic testing method
US7996818B1 (en) Method for testing using client specified references
CN110221959B (en) Application program testing method, device and computer readable medium
US20160283357A1 (en) Call stack relationship acquiring method and apparatus
CN112307124B (en) Database synchronous verification method, device, equipment and storage medium
CN110471838A (en) Method of calibration, device, computer equipment and the storage medium of test case
CN109471634A (en) The inspection method and equipment of source code format
CN109582504A (en) A kind of data reconstruction method and device for apple equipment
CN106713011A (en) Method and system for obtaining test data
CN111913880A (en) Application software testing method and device
CN109189672A (en) Automatic test approach, server and the computer readable storage medium of micro services
CN113900955A (en) Automatic testing method, device, equipment and storage medium
CN113342647A (en) Test data generation method and device
CN117499287A (en) Web testing method, device, storage medium and proxy server
CN117032646A (en) Index configuration method, index execution method and system
CN116701187A (en) JSON data verification method and device
Dramko et al. DIRE and its data: Neural decompiled variable renamings with respect to software class
CN116226391A (en) Specific field name error correction method and system, storage medium and terminal
CN115455059A (en) Method, device and related medium for analyzing user behavior based on underlying data
CN112241328B (en) Data processing method, device and system
CN106776264B (en) Application program code testing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20201019

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Innovative advanced technology Co.,Ltd.

Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant before: Advanced innovation technology Co.,Ltd.

Effective date of registration: 20201019

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Advanced innovation technology Co.,Ltd.

Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands

Applicant before: Alibaba Group Holding Ltd.

GR01 Patent grant
GR01 Patent grant