CN109597706A

CN109597706A - It is a kind of to check the detection method of variance data, apparatus and system

Info

Publication number: CN109597706A
Application number: CN201811147299.8A
Authority: CN
Inventors: 湛滨瑜
Original assignee: Alibaba Group Holding Ltd
Current assignee: Advanced New Technologies Co Ltd; Advantageous New Technologies Co Ltd
Priority date: 2018-09-29
Filing date: 2018-09-29
Publication date: 2019-04-09
Anticipated expiration: 2038-09-29
Also published as: CN109597706B

Abstract

This specification provides a kind of detection method of verification variance data, apparatus and system, when there is verification variance data in verification of data, noise measuring is carried out to verification variance data, i.e. by obtaining the corresponding transaction journal data of different application systems, judge whether the transaction journal data of not homologous ray match, determine whether current verification variance data is true variance data, or verification noise.If it is determined that verification variance data is that noise is checked in wrong report, then the identification and detection of verification noise, the time and efforts of the investigation of abnormal data when reducing verification of data can be realized without abnormal investigation.

Description

It is a kind of to check the detection method of variance data, apparatus and system

Technical field

This specification belongs to computer field more particularly to a kind of detection method for checking variance data, apparatus and system.

Background technique

With the development of computer technology, a large amount of data can be generated in computer system operational process, some business need The data to generate to different systems are checked, and whether confirmation business datum is accurate.The data magnitude of verification is more than one hundred million daily Pen, since based on data subregion offset existing for big data task, Security distillation, (collect Transfer unit, is adopted CTU Collect transmission unit) etc. reasons, cause check noise the case where appearance.Verification noise can indicate due to verification means etc. Limitation leads to checked result to have differences data, but the situation i.e. wrong report that data itself are not variant.Check going out for noise It is existing, feeling of fatigue is brought to the investigation and positioning of problem on line, also brings the noise difference of unnecessary daily developer Investigation, disposition manpower consumption, while can also be disposed to difference normal on line and bring great interference.

Summary of the invention

This specification is designed to provide a kind of detection method of verification variance data, apparatus and system, realizes verification The identification and detection of noise, the time and efforts of the investigation of abnormal data when reducing verification of data.

First aspect this specification embodiment provides a kind of detection method for checking variance data, comprising:

Receive verification variance data；

According to the verification time of the verification variance data, it is corresponding to obtain the verification variance data within the scope of specified time Application system transaction journal data；

Judge whether the logical relation of the information content in the transaction journal data matches, if so, determining the verification Variance data is verification noise data.

Further, in another embodiment of the method, the determination verification variance data is verification noise Data, comprising:

Judge that the log content in the transaction journal data of the application system, stl status code, log are associated with odd numbers pair Whether at least one in the business diary answered matches, if at least one matching, it is determined that the verification variance data is verification Noise data.

Further, in another embodiment of the method, the method also includes:

If judging, the transaction journal data of the application system are mismatched, it is determined that the verification variance data is abnormal number According to the abnormal investigation of verification abnormal data progress.

Further, in another embodiment of the method, the method also includes:

If judging, the transaction journal data of the application system are mismatched, and unmatched affairs day is obtained from database The corresponding business datum of will data carries out data difference detection.

Further, in another embodiment of the method, the transaction journal data of the application system are using following Mode obtains:

According to the execution parameter of the application system and as a result, the log of the application system is output to preset caching Region；

Monitor whether the corresponding affairs of the application system are submitted；

If the corresponding affairs of the application system are submitted, by the day of application system described in the preset buffer zone Will is output to disk, obtains the transaction journal data of the application system；

If the corresponding transaction rollback of the application system, deletes application system described in the preset buffer zone Log.

Second aspect, present description provides a kind of verification of data methods, comprising:

Business datum is obtained, verification of data is carried out to the business datum；

If verification of data, which determines, has verification variance data, according to the verification time of the verification variance data, obtain The transaction journal data for checking the corresponding application system of variance data within the scope of specified time；

The third aspect, present description provides a kind of detection devices for checking variance data, comprising:

Data reception module, for receiving verification variance data；

Transaction journal obtains module, for the verification time according to the verification variance data, obtains specified time range The interior transaction journal data for checking the corresponding application system of variance data；

Data match module, for judging whether the logical relation of the information content in the transaction journal data matches, if It is, it is determined that the verification variance data is verification noise data.

Further, in another embodiment of described device, the data match module is specifically used for:

Further, in another embodiment of described device, the data match module is also used to:

Further, in another embodiment of described device, described device further includes transaction journal generation module, is used for The transaction journal data of the application system are generated using following methods:

Fourth aspect, present description provides the processing equipments of verification variance data detection, comprising: at least one processor And the memory for storage processor executable instruction, the processor realize above-mentioned first aspect when executing described instruction The detection method of the verification variance data.

5th aspect, present description provides a kind of verification of data devices, comprising:

Verification of data module carries out verification of data to the business datum for obtaining business datum；

There is verification variance data if determining for verification of data, according to the verification difference number in data acquisition module According to the verification time, obtain the transaction journal data of the corresponding application system of the verification variance data within the scope of specified time；

Variance data detection module, for judge the information content in the transaction journal data logical relation whether Match, if so, determining that the verification variance data is verification noise data.

6th aspect, present description provides a kind of verification of data systems, comprising: application system, database, verification are flat Platform, the detection device for checking variance data, for the application system for executing service request, the database is described for storing The business datum of application system, the verification platform are used to check the business datum of the application system, the verification difference number According to detection device be used to execute the detection method of verification variance data described in above-mentioned first aspect.

Detection method, device, processing equipment, the system for the verification variance data that this specification provides, go out in verification of data When now checking variance data, noise measuring is carried out to verification variance data, i.e., by obtaining the corresponding affairs of different application systems Daily record data, judges whether the transaction journal data of not homologous ray match, and determines whether current verification variance data is true Variance data, or verification noise.If it is determined that verification variance data is that noise is checked in wrong report, then it can be without abnormal row It looks into, realizes the identification and detection of verification noise, the time and efforts of the investigation of abnormal data when reducing verification of data.

Detailed description of the invention

In order to illustrate more clearly of this specification embodiment or technical solution in the prior art, below will to embodiment or Attached drawing needed to be used in the description of the prior art is briefly described, it should be apparent that, the accompanying drawings in the following description is only The some embodiments recorded in this specification, for those of ordinary skill in the art, in not making the creative labor property Under the premise of, it is also possible to obtain other drawings based on these drawings.

Fig. 1 is the flow diagram that the detection method of variance data is checked in this specification one embodiment；

Fig. 2 is the flow diagram of verification of data method in this specification one embodiment；

Fig. 3 is the flow diagram of verification of data in the another embodiment of this specification；

Fig. 4 is the modular structure schematic diagram of the detection device one embodiment for the verification variance data that this specification provides；

Fig. 5 is the structural schematic diagram of verification of data device in one embodiment of this specification；

Fig. 6 is the verification of data flow diagram of verification of data system in this specification embodiment；

Fig. 7 is the hardware block diagram using the detection service device of the verification variance data of the embodiment of the present application.

Specific embodiment

In order to make those skilled in the art more fully understand the technical solution in this specification, below in conjunction with this explanation Attached drawing in book embodiment is clearly and completely described the technical solution in this specification embodiment, it is clear that described Embodiment be only this specification a part of the embodiment, instead of all the embodiments.The embodiment of base in this manual, Every other embodiment obtained by those of ordinary skill in the art without making creative efforts, all should belong to The range of this specification protection.

With the increase of computer process ability, the data volume that computer system generates also constantly is increasing, Mou Xieye Business scene may be related to multiple application systems when executing corresponding business, and different application systems can generate different industry Business data.For the accuracy for ensuring service executing result or business datum record, it may be necessary to the business of different application systems Data are checked, and by way of verification, are compared the consistency of the business datum in two or more application systems, are found industry Business data in there are inconsistent, mistake, lose, have more the problems such as when, need to correct in time.

In audit process, due to based on big data task processing during or other verification means itself it is endless It is kind, and then there may be difference (include but are not limited only to data subregion, Security distillation, CTU etc.) for a variety of causes, due to nuclear rivals The limitation of the reasons such as section causes checked result to have differences data, but the situation referred to as wrong report that data itself are not variant, It is properly termed as verification noise.

A kind of detection method for checking variance data is provided in this specification embodiment, it is poor verification occur in verification of data Heteromerism according to when, noise measuring is carried out to verification variance data, i.e., by obtaining the corresponding transaction journal data of different application systems, Judge whether the transaction journal data of not homologous ray match, determines whether current verification variance data is true difference number According to, or verification noise.If it is determined that it is to check noise that verification variance data, which is wrong report i.e. verification variance data, then it can be without Abnormal investigation, realizes the identification and detection of verification noise, the investigation time and efforts of abnormal data when reducing verification of data.

The detection method that variance data is checked in this specification can be applied in client or server, and client can be with It is smart phone, tablet computer, intelligent wearable device (smartwatch, virtual reality glasses, virtual implementing helmet etc.), intelligence The electronic equipments such as mobile unit.

Specifically, Fig. 1 is the flow diagram for checking the detection method of variance data in this specification one embodiment, such as Shown in Fig. 1, the overall process of the detection method of the verification variance data provided in this specification one embodiment may include:

Step 102 receives verification variance data.

In the specific implementation process, when checking data, if discovery data it is inconsistent, there are mistake, loss, It when the problems such as having more, can determine and have differences data, can detect to variance data determine whether checked result is accurate Determine whether variance data is verification noise data.Verification variance data may include the business datum for difference occur, verification Time, mark of the corresponding application system of data etc..

Such as: the execution of certain affairs needs application system A, B, C cooperation to complete, if to the industry in the affairs implementation procedure When data of being engaged in carry out verification of data, there is inconsistent phenomenon in discovery data, then business datum when can execute the affairs It, can also be using inconsistent data as verification variance data, such as: if finding the order amount of money when verification as verification variance data It is inconsistent, then it can regard data relevant to the amount of money as verification variance data.

Step 104, according to it is described verification variance data the verification time, obtain specified time within the scope of the verification difference The transaction journal data of the corresponding application system of data.

Log can be indicated for recording server, the i.e. equipment such as network application of Web application within a period of time in past The process of generation and the daily record data of related data, general daily record data can store in the equipment such as disk, solid state hard disk.Thing Business log is the file that one and database file separate, and transaction journal can store all changes carried out to database, and It is whole to record insertion, update, deletion, submission, rollback and database patterns of change.Transaction journal be also referred to as before rolling log or It redoes log.

For generic log, if after log has been output to disk, and rollback occurs for affairs, log itself can not return Rolling causes log and affairs in the presence of consistency problem largely.Transaction journal is with generic log the difference lies in that passing through Affairs control to log output, namely pass through transactional synchronization device principle, it is defeated to carry out log again after the completion of local matter is submitted Out, local matter rewind journal also can rollback.In this way, can be exported with the promotion affairs of high degree and log one Cause property.Affairs can indicate a kind of mechanism, a kind of sequence of operation, it contains one group of database manipulation order, this group command is wanted It all executes or does not execute all, affairs are single as the smallest control when executing concurrent operations on the database system Member uses.Transaction rollback can indicate the process that the state before affairs start is returned in affairs implementation procedure, such as: in affairs Some point break down, then all updates can roll back to the state before affairs start.

This specification embodiment determines after there is verification variance data, available specified time model when checking data The transaction journal data of different application systems in enclosing.Specified time range can be arranged according to practical application, such as: can basis The verification time for checking variance data was used as specified time range for 1 minute to 2 minutes before the verification time.Application system can be with It is selected according to the corresponding affairs of verification variance data, such as: being produced if verification variance data belongs in some affairs implementation procedure Raw data, then the transaction journal data of the application system needed for the available affairs execute, alternatively, available verification is poor Heteromerism according to the application system at place transaction journal data.Certainly, according to actual needs it is also an option that other methods obtain The transaction journal data of specified application system, such as: the corresponding application system of available verification variance data is associated to answer It is associated to indicate there are business association or have data communication between each other or exist up and down with the transaction journal data of system Trip relationship etc..

Such as: in the 9 points of 30 minutes progress verification of datas of the morning on the 12nd of September in 2018, there is verification variance data in discovery, if Determine that the verification variance data corresponds to affairs a, affairs a needs application system A, B, C cooperation to complete.It then can be flat by O&M Channel is fished in the logs such as platform StarAgent, obtains application system A, B, C at 9 points in the morning on the 12nd of September in 2018-2018 years 28 minutes 9 Transaction journal data in month 12 morning, 9 points of 29 minutes this time ranges.

When obtaining the transaction journal data of application system, it is corresponding that specified variance data can also be obtained according to actual needs Transaction journal data or specified log file name transaction journal data.Such as: if it is determined that verification variance data it is relatively more, then The transaction journal data of the corresponding application system of variance data are specified in available part, or obtain specified log file name pair The transaction journal data answered.

It, can be first by the daily record data of application system before carrying out verification of data in this specification one embodiment Output is transaction journal data, it is ensured that the generation method of the consistency of log and affairs, the transaction journal data of application system can With reference to such as under type:

In the specific implementation process, an affairs usually require multiple application systems completions, in this specification embodiment In, for an affairs, the log for the multiple application systems that can included respectively is output to preset buffer zone, application The log of system, which includes at least, to be had: the execution parameter and implementing result of application system.

Such as: by taking some affairs is 500 yuan of user's withdrawal as an example, the execution of the affairs, which can include at least, 3 applications System.Wherein, application system A carries out authentication to user, and application system B inquires the remaining sum of user account, and application system C is held Withhold operation of the row to 500 yuan of user account.It is understood that the submission of such a affairs is completed, application system A, Application system B and application system C must will be successfully completed, i.e. application system A verifying user identity is legal, and application system B is looked into The remaining sum for asking user account is more than or equal to 500 yuan, and application system C successfully withholds 500 yuan in user account.If application system A, at least one application system is not successfully completed in application system B and application system C, then the affairs execute failure, i.e. affairs Rollback, such as: application system B inquires situations such as remaining sum of user account is less than 500 yuan.

By taking application system B as an example, according to the execution parameter of remaining sum this application system of inquiry user account and knot is executed The log of application system B is output to preset buffer zone by fruit.Specifically, the execution parameter of application system B at least can be with Include: user account information, query time and operator etc., the implementing result of application system B are the remaining of user account Volume.By the log B of application system B, i.e., above-mentioned execution parameter and implementing result are output to preset buffer zone.Equally, according to The execution parameter and implementing result of application system A and application system C, by the log A of application system A and application system C with And log C is output to the preset buffer zone.

For each application system, the implementing result of affairs belonging to application system is monitored, such as: it can be worked as by registration The transactional synchronization device of preceding affairs realizes class to monitor the implementing result of the affairs.Wherein, the implementing result of the affairs includes There are submission and rollback.If affairs belonging to the application system are submitted, by the day of application system in preset buffer zone Will is output to disk, obtains the transaction journal data of the application system.

Such as: by taking the affairs of 500 yuan of user's withdrawal in above-described embodiment as an example, if the affairs are submitted, it will be output to The log C of the log A of application system A in the buffer zone, the log B of application system B and application system C are exported respectively To disk, transaction journal data are generated.After the log of the application system in the buffer zone is output to disk, The log of application system described in the buffer zone can be deleted.

If transaction rollback belonging to the application system, i.e. the affairs execute failure, then the application that the affairs have executed The log of system and the implementing result of affairs are inconsistent, can delete the log of application system described in the buffer zone.

Such as: by taking user withdraws the money 500 yuan of affairs as an example, if the affairs since application system C executes failure, such as: Since network failure leads to 500 yuan of failures of withholing in user account, then the transaction rollback, and then application system A and application The operation data of system B not will be updated in database, then, it the application system A that is output in the buffer zone and answers It is inconsistent with the implementing result of the affairs with the log A and log B of system B, it can be by the log A in the buffer zone It is deleted with log B.

Using the method for above-described embodiment, the generation of transaction journal data may be implemented, guarantee affairs to a certain extent With the consistency of log, the detection for subsequent verification noise provides data basis.

In addition, the transaction journal of application system generates, it may not be necessary to modify computer in this specification one embodiment Program code is directly accessed transactional log component, so that it may the generation to transaction journal data is realized, to ensure application system The consistency of daily record data and affairs.

Step 106 judges whether the logical relation of the information content in the transaction journal data matches, if so, determining The verification variance data is verification noise data.

It, can be to the affairs day of each application system got after getting the transaction journal data of each application system Will data are matched, and judge whether the logical relation of the information content in the transaction journal data of different application systems matches, such as: Whether temporal logic, transactional execution state logic, spatial logic, keyword in different application system transaction journal data etc. Matching.If the transaction journal data of different application systems be it is matched, can determine currently check out verification abnormal data be Noise is checked, i.e. the data belong to normal data, can be without the investigation of abnormal data.

In this specification one embodiment, if judging, the transaction journal data of different application systems are mismatched, such as: the amount of money It is inconsistent, then can determine the verification abnormal data be abnormal data, abnormal warning can be carried out, to the verification abnormal data into The further abnormal investigation of row.Such as: if judging, the transaction journal data of different application systems are mismatched, can be by manually carrying out Abnormal investigation, whether confirmation verification abnormal data is true abnormal data, or adopts and carry out data again with other methods Verification, determines whether checked result is accurate.

It should be noted that the matching of transaction journal data, does not indicate that transaction journal data are identical, it can be determined that each Whether the information content in the transaction journal data of a application system meets the logic of affairs execution, if depositing in transaction journal data Execution of business logic is not being met, it is also assumed that transaction journal data mismatch.Such as: user withdraws the money in above-described embodiment 500 yuan of affairs, if application system B inquires remaining sum in the account of user and is lower than 500 yuan, but the implementing result of application system C It is 500 yuan of successes of withholing, it may be considered that the transaction journal data of application system B, C mismatch.To different application systems When transaction journal data are matched, matching rule can be set according to actual data cases.Such as: time, the amount of money, order Number, User ID, the amount of money in specified time, transaction execution results etc. it is whether consistent etc., other content can also be matched certainly, this Specification embodiment is not especially limited.

In this specification one embodiment, the determination verification variance data is verification noise data, be can wrap It includes:

In the specific implementation process, log content may include parameter, the implementing result etc. that affairs execute, such as: above-mentioned User withdraws the money 500 yuan in embodiment, and application system B is used to inquire the remaining sum of user account, the transaction journal data of application system B Log content may include affairs execution parameters memorizing transaction execution results, i.e., user account information, query time and Operator and the remaining sum of user account etc..Stl status can indicate that affairs execute whether successful or affairs are to submit or return Rolling, different stl status codes can indicate different transaction execution results, and such as: 1 can indicate success, and 0 can indicate to fail. The possible corresponding implementation procedure of different affairs, that is, business is different, and log association odd numbers can indicate in an affairs implementation procedure For being associated with the mark of each application system, such as: the completion of an order may need multiple application systems, can by order number To be associated with out relevant application system.Business diary can indicate the generic log for being different from transaction journal.

After getting the transaction journal data of different application systems, it can be determined that in the transaction journal data of each application system Log content, stl status code, in the corresponding business diary of log association odd numbers at least one of whether match, if wherein extremely One item missing matching can then determine current verification variance data as verification noise data, i.e. verification is made mistakes, the verification difference number According to being normal data.Certainly, according to actual applicable cases, it is also possible to need log content, stl status code, log association table Number corresponding business diary matches, and just can determine that current verification variance data, specifically can basis for verification noise data Actual needs setting matching rule, this specification embodiment are not especially limited.

Such as: user's online shopping this affairs that place an order may need multiple application systems to execute completion, if ordering checking the pen When the data of list, determine there is verification abnormal data such as: the order amount of money is mismatched, then the application of available this order execution The transaction journal data of system.Can by the log content of different application systems user identity information, merchant identification information, Product name, order number etc. are matched, can be using the verification abnormal data as verification noise if log content successful match Data.The stl status code of different application systems can also be checked, if the application state code of one of application system For failure, the application state code of other application systems is success, then illustrates to mismatch, and needs further to be verified.

It is matched by being associated with the contents such as the corresponding business diary of odd numbers to log content, stl status code, log, it can Fast and accurately to detect whether the transaction journal data of each application system match, detects verification noise data, improve The efficiency of verification of data.

In this specification one embodiment, if judging, the transaction journal data of the application system are mismatched, from data The corresponding business datum of unmatched transaction journal data is obtained in library, carries out data difference detection.

In the specific implementation process, if judge that the transaction journal data of application system mismatch, number can also be used Technology, which is fished for, according to library carries out data difference detection.Such as: if matching by Transaction Information, determine 100 transaction journal numbers According to the amount of money it is unequal i.e. data mismatch, then this 100 transaction journal data can be obtained from database in the database Corresponding business datum, is matched again.Data and transaction journal data in combined data library carry out core to variance data It is right, the efficiency of variance data verification not only can be improved, the accuracy of variance data verification can also be improved.

There is verification variance data in verification of data in the detection method for the verification variance data that this specification embodiment provides When, noise measuring is carried out to verification variance data, i.e., by obtaining the corresponding transaction journal data of different application systems, judgement is not Whether the transaction journal data of homologous ray match, and determine whether current verification variance data is true variance data, still Check noise.If it is determined that verification variance data is that noise is checked in wrong report, then it can realize verification without abnormal investigation and make an uproar The identification and detection of sound, the time and efforts of the investigation of abnormal data when reducing verification of data.

Fig. 2 is the flow diagram of verification of data method in this specification one embodiment, as shown in Fig. 2, this specification Embodiment provide verification of data method may include:

Step 202 obtains business datum, carries out verification of data to the business datum.

In the specific implementation process, each service request may need multiple application systems to cooperate completion accordingly Task, service request can indicate needing to be implemented for task, such as: user withdraws the money, pay invoice.Service request is being performed When, each application system can generate corresponding business datum, and business datum can store in database or other storage equipment.It can To utilize data synchronization technology, the corresponding business datum of service request is obtained.It according to the actual application can be to business datum Subregion is carried out, and verification of data is carried out to the business datum of subregion, verification executes the business of the application system of service request affairs Whether data are consistent, if there are verification variance datas.Specific checking method can be selected according to actual needs, this theory Bright book embodiment is not especially limited.In this specification one embodiment, verification of data can be periodically carried out, can also received Verification of data is carried out after to service request preset time.

Such as: the done through network service requesting information of user is received, relevant application system executes the service request, and Generate corresponding business datum.After receiving the service requesting information 1 minute, verification executes the application of the service requesting information The business datum of system judges whether the business datum of each application system is consistent.

If step 204, verification of data, which determine, has verification variance data, when according to the verification of the verification variance data Between, obtain the transaction journal data for checking the corresponding application system of variance data within the scope of specified time.

If determining that verification variance data, i.e. application system occurs in the corresponding business datum of the service request in verification of data The business datum of system has differences, then within the scope of available specified time application system transaction journal data.It is being counted When according to verification, the log for the application system checked can be exported as transaction journal, such as: can be in application system Transactional log component is accessed, the concrete meaning of transaction journal can refer to the record of above-described embodiment, and details are not described herein again.Affairs The acquisition methods of daily record data can refer to the record of above-described embodiment, and details are not described herein again.

Such as: in above-described embodiment, the done through network corresponding application system of service requesting information of user is executed in verification Business datum when, it is found that the amount of money of order is inconsistent, then it is available execute the service requesting information application system thing Business daily record data.

Step 206 judges whether the logical relation of the information content in the transaction journal data matches, if so, determining The verification variance data is verification noise data.

The transaction journal data of each application system are matched, such as: log content, stl status code, log are closed The corresponding business diary data of receipts or other documents in duplicate number are matched, and specific matching process can refer to the record of above-described embodiment, herein It repeats no more.If the transaction journal Data Matching of application system, it can determine that verification variance data is verification noise, that is, check Variance data is really normal data, can be set to normally, not need to carry out abnormal investigation, if the transaction journal number of application system It according to mismatch, then can determine that verification abnormal data is true abnormal data, can be searched different by manually carrying out abnormal investigation Normal reason and amendment etc..

Such as: in above-described embodiment, the done through network corresponding application system of service requesting information of user is executed in verification Business datum when, it is found that the amount of money of order is inconsistent, obtain execute the service requesting information application system transaction journal Data.After the transaction journal data of each application system are matched, the affairs of wherein application system A and application system B are determined Order number is inconsistent in daily record data, then can determine there are abnormal data, can manually be checked, can also obtain application The data for executing the service requesting information of system A, B in the database, are further checked.

Fig. 3 is the flow diagram of verification of data in the another embodiment of this specification, as shown in figure 3, this specification is implemented The detailed process of verification of data can refer to as follows in example:

Step 1: export the log for the application system for being used to check for transaction journal, guarantee log and affairs it is consistent Property.This process can not need code revision, it is only necessary to access transactional log component, may be implemented defeated to transaction journal Automatic sensing out, to ensure the consistency of daily record data and affairs.Application system executes after receiving service requesting information When service requesting information, corresponding business datum i.e. business diary can be generated, business diary is possibly stored to database such as: disk It can store the business datum of multiple application systems in, in database.

Step 2: DB (database, the database) data of service request record are synchronous by data, it is synchronized to verification Platform, that is, verification of data system carries out subregion.

Step 3: trigger data checks task, verification of data is carried out in data of the verification platform to subregion, in verification of data When, discovery has differences data.

Step 4: for verification variance data, difference specified time range, specified poor can be fished for according to the verification time The transaction journal data of different data area, specified log file name generate log and fish for script, pass through the logs such as StarAgent Fish for the transaction journal data that multiple application systems are fished in channel.

Step 5: the transaction journal fished for for specified time range, specified variance data range, specified log file name Data carry out verification difference noise analysis.It may determine that log content, the log shape of the transaction journal data of each application system Whether state code, the corresponding business diary of log association odd numbers exactly match, correctly.If all key business summary journals are just It is really errorless, then determine to check variance data to check noise, end；If calculating transaction journal data to have differences, determine Checked result has differences, can be by manually immediately intervention is checked.

This specification embodiment can be checked with the reduction of high degree and be made an uproar by the ingenious combination with transaction journal data Sound, and fish for stability problem there is no DB, applicability is wider, and almost to all system adaptations, the invasion of 0 code can be with The verification noise problem of puzzlement for a long time is solved to a certain extent.

Various embodiments are described in a progressive manner for the above method in this specification, identical between each embodiment Similar part may refer to each other, and each embodiment focuses on the differences from other embodiments.Correlation Place illustrates referring to the part of embodiment of the method.

Based on the detection method of verification variance data described above, this specification one or more embodiment also provides one The detection device of kind verification variance data.The device may include the system for having used this specification embodiment the method (including distributed system), software (application), module, component, server, client etc. simultaneously combine the necessary dress for implementing hardware It sets.Based on same innovation thinking, for example following implementation of the device in one or more embodiments that this specification embodiment provides Described in example.Since the implementation that device solves the problems, such as is similar to method, the reality of the specific device of this specification embodiment The implementation that may refer to preceding method is applied, overlaps will not be repeated.Used below, term " unit " or " module " can To realize the combination of the software and/or hardware of predetermined function.Although device described in following embodiment is preferably come with software It realizes, but the realization of the combination of hardware or software and hardware is also that may and be contemplated.

Specifically, Fig. 4 is the modular structure of the detection device one embodiment for the verification variance data that this specification provides Schematic diagram, as shown in figure 4, the detection device of the verification variance data provided in this specification includes: data reception module 41, thing Business log acquisition module 42, data match module 43, in which:

Data reception module 41 can be used for receiving verification variance data；

Transaction journal obtains module 42, can be used for the verification time according to the verification variance data, when obtaining specified Between in range the corresponding application system of the verification variance data transaction journal data；

Data match module 43, can be used for judging the information content in the transaction journal data logical relation whether Match, if so, determining that the verification variance data is verification noise data.

There is verification variance data in verification of data in the detection device for the verification variance data that this specification embodiment provides When, noise measuring is carried out to verification variance data, i.e., by obtaining the corresponding transaction journal data of different application systems, judgement is not Whether the transaction journal data of homologous ray match, and determine whether current verification variance data is true variance data, still Check noise.If it is determined that verification variance data is that noise is checked in wrong report, then it can realize verification without abnormal investigation and make an uproar The identification and detection of sound, the time and efforts of the investigation of abnormal data when reducing verification of data.

On the basis of the above embodiments, the data match module is specifically used for:

This specification embodiment provide verification variance data detection device, by log content, stl status code, The contents such as the corresponding business diary of log association odd numbers are matched, and can fast and accurately detect the affairs of each application system Whether daily record data matches, and detects verification noise data, improves the efficiency of verification of data.

On the basis of the above embodiments, the data match module is also used to:

The detection device for the verification variance data that this specification embodiment provides is determining that verification variance data is abnormal number According to rear, abnormal data is further checked, it can be ensured that the accuracy of verification of data result carries out repairing for data in time Just.

On the basis of the above embodiments, the data match module is also used to:

This specification embodiment, data and transaction journal data in combined data library, checks variance data, no The efficiency that variance data verification only can be improved can also improve the accuracy of variance data verification.

On the basis of the above embodiments, described device further includes transaction journal generation module, for using following methods Generate the transaction journal data of the application system:

The generation of transaction journal data may be implemented in this specification embodiment, guarantees affairs and log to a certain extent Consistency, for it is subsequent verification noise detection provide data basis.

It should be noted that device described above can also include other embodiment party according to the description of embodiment of the method Formula.Concrete implementation mode is referred to the description of related method embodiment, does not repeat one by one herein.

This specification embodiment also provides a kind of processing equipment of different quotation anomaly data detection of foreign exchange, comprising: at least one A processor and memory for storage processor executable instruction, the processor are realized above-mentioned when executing described instruction The detection method of the verification variance data of embodiment, such as:

Receive verification variance data；

According to the verification time of the verification variance data, the transaction journal number of application system within the scope of specified time is obtained According to；

Judge whether the transaction journal data of the application system match, if so, determining that the verification variance data is Check noise data.

The storage medium may include the physical unit for storing information, usually by after information digitalization again with benefit The media of the modes such as electricity consumption, magnetic or optics are stored.It may include: that letter is stored in the way of electric energy that the storage medium, which has, The device of breath such as, various memory, such as RAM, ROM；The device of information is stored in the way of magnetic energy such as, hard disk, floppy disk, magnetic Band, core memory, magnetic bubble memory, USB flash disk；Using optical mode storage information device such as, CD or DVD.Certainly, there are also it Readable storage medium storing program for executing of his mode, such as quantum memory, graphene memory etc..

It should be noted that processing equipment described above can also include other implement according to the description of embodiment of the method Mode.Concrete implementation mode is referred to the description of related method embodiment, does not repeat one by one herein.

Fig. 5 is the structural schematic diagram of verification of data device in one embodiment of this specification, as shown in figure 5, in this specification The verification of data device of offer include: verification of data module 51, transaction journal obtain module 52, variance data detection module 53, Wherein:

Verification of data module 51 can be used for obtaining business datum, carry out verification of data to the business datum；

Data acquisition module 52 determines there is verification variance data if can be used for verification of data, according to the verification The verification time of variance data obtains the transaction journal for checking the corresponding application system of variance data within the scope of specified time Data；

Variance data detection module 53 can be used for judging that the logical relation of the information content in the transaction journal data is No matching, if so, determining that the verification variance data is verification noise data.

This specification is implemented, and by the ingenious combination with transaction journal data, can check noise with the reduction of high degree, And stability problem is fished for there is no DB (database, database), applicability is wider, almost to all system adaptations, 0 Code invasion can solve to perplex verification noise problem for a long time to a certain extent.

Fig. 6 is the verification of data flow diagram of verification of data system in this specification embodiment, as shown in fig. 6, this theory In bright book embodiment, verification of data system may include:

Application system 61, database 62, verification platform 63, the detection device 64 for checking variance data, the application system 61 for executing service request, and the database 62 is used to store the business datum of the application system, the verification platform 63 For checking the business datum of the application system 61, the detection device 64 of the verification variance data is for executing above-mentioned implementation The detection method for the verification variance data that example is recorded.

When practical application, the detection device 64 for checking variance data be can be set in verification platform 63, can also be by independent System complete.

The verification of data system that this specification provides can be the detection system of individually verification variance data, can also answer In a variety of Data Analysis Services systems.The system may include any one verification variance data in above-described embodiment Detection device.The system can be individual server, also may include the one or more institutes for having used this specification State server cluster, system (including distributed system), the software (application), reality of method or one or more embodiment devices Operating device, logic gates device, quantum computer etc. simultaneously combine the necessary terminal installation for implementing hardware.The verification is poor The detection system of heteromerism evidence may include at least one processor and the memory for storing computer executable instructions, the place The step of reason device realizes method described in above-mentioned any one or multiple embodiments when executing described instruction.

Embodiment of the method provided by this specification embodiment can mobile terminal, terminal, server or It is executed in similar arithmetic unit.For running on the server, Fig. 7 is the verification variance data using the embodiment of the present application Detection service device hardware block diagram.As shown in fig. 7, server 10 may include that one or more (only shows one in figure It is a) (processor 100 can include but is not limited to the processing of Micro-processor MCV or programmable logic device FPGA etc. to processor 100 Device), memory 200 for storing data and the transmission module 300 for communication function.This neighborhood ordinary skill people Member does not cause to limit it is appreciated that structure shown in Fig. 7 only signal to the structure of above-mentioned electronic device.For example, service Device 10 may also include the more or less component than shown in Fig. 7, such as can also include other processing hardware, such as data Library or multi-level buffer, GPU, or with the configuration different from shown in Fig. 7.

Memory 200 can be used for storing the software program and module of application software, such as the core in this specification embodiment Program instruction/module corresponding to the detection method of variance data, processor 100 are stored in memory 200 by operation Software program and module, thereby executing various function application and data processing.Memory 200 may include high speed random storage Device may also include nonvolatile memory, such as one or more magnetic storage device, flash memory or other are non-volatile solid State memory.In some instances, memory 200 can further comprise the memory remotely located relative to processor 100, this A little remote memories can pass through network connection to terminal 10.The example of above-mentioned network include but is not limited to internet, Intranet, local area network, mobile radio communication and combinations thereof.

Transmission module 300 is used to that data to be received or sent via a network.Above-mentioned network specific example may include The wireless network that the communication providers of terminal 10 provide.In an example, transmission module 300 includes that a network is suitable Orchestration (Network Interface Controller, NIC), can be connected by base station with other network equipments so as to Internet is communicated.In an example, transmission module 300 can be radio frequency (Radio Frequency, RF) module, For wirelessly being communicated with internet.

It is above-mentioned that this specification specific embodiment is described.Other embodiments are in the scope of the appended claims It is interior.In some cases, the movement recorded in detail in the claims or step can be come according to the sequence being different from embodiment It executes and desired result still may be implemented.In addition, process depicted in the drawing not necessarily require show it is specific suitable Sequence or consecutive order are just able to achieve desired result.In some embodiments, multitasking and parallel processing be also can With or may be advantageous.

Method or apparatus described in above-described embodiment that this specification provides can realize that business is patrolled by computer program It collects and records on a storage medium, the storage medium can be read and be executed with computer, realize this specification embodiment institute The effect of description scheme.

This specification embodiment provide above-mentioned verification variance data detection method or device can in a computer by Processor executes corresponding program instruction to realize, such as using the c++ language of windows operating system in the realization of the end PC, linux System is realized or other are for example realized using android, iOS system programming language in intelligent terminal, and is based on quantum Processing logic realization of computer etc..

It should be noted that specification device described above, computer storage medium, system are implemented according to correlation technique The description of example can also include other embodiments, and concrete implementation mode is referred to the description of corresponding method embodiment, It does not repeat one by one herein.

All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for hardware+ For program class embodiment, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to side The part of method embodiment illustrates.

This specification embodiment is not limited to meet industry communication standard, standard computer data processing sum number According to situation described in storage rule or this specification one or more embodiment.The right way of conduct is made in certain professional standards or use by oneself In formula or the practice processes of embodiment description embodiment modified slightly also may be implemented above-described embodiment it is identical, it is equivalent or The implementation result being anticipated that after close or deformation.Using these modifications or deformed data acquisition, storage, judgement, processing side The embodiment of the acquisitions such as formula still may belong within the scope of the optional embodiment of this specification embodiment.

In the 1990s, the improvement of a technology can be distinguished clearly be on hardware improvement (for example, Improvement to circuit structures such as diode, transistor, switches) or software on improvement (improvement for method flow).So And with the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit. Designer nearly all obtains corresponding hardware circuit by the way that improved method flow to be programmed into hardware circuit.Cause This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, programmable logic device (Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate Array, FPGA)) it is exactly such a integrated circuit, logic function determines device programming by user.By designer Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, designs and makes without asking chip maker Dedicated IC chip.Moreover, nowadays, substitution manually makes IC chip, this programming is also used instead mostly " is patrolled Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development, And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language (Hardware Description Language, HDL), and HDL is also not only a kind of, but there are many kind, such as ABEL (Advanced Boolean Expression Language)、AHDL(Altera Hardware Description Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL (Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware Description Language) etc., VHDL (Very-High-Speed is most generally used at present Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also answer This understands, it is only necessary to method flow slightly programming in logic and is programmed into integrated circuit with above-mentioned several hardware description languages, The hardware circuit for realizing the logical method process can be readily available.

Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing The computer for the computer readable program code (such as software or firmware) that device and storage can be executed by (micro-) processor can Read medium, logic gate, switch, specific integrated circuit (Application Specific Integrated Circuit, ASIC), the form of programmable logic controller (PLC) and insertion microcontroller, the example of controller includes but is not limited to following microcontroller Device: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320 are deposited Memory controller is also implemented as a part of the control logic of memory.It is also known in the art that in addition to Pure computer readable program code mode is realized other than controller, can be made completely by the way that method and step is carried out programming in logic Controller is obtained to come in fact in the form of logic gate, switch, specific integrated circuit, programmable logic controller (PLC) and insertion microcontroller etc. Existing identical function.Therefore this controller is considered a kind of hardware component, and to including for realizing various in it The device of function can also be considered as the structure in hardware component.Or even, it can will be regarded for realizing the device of various functions For either the software module of implementation method can be the structure in hardware component again.

System, device, module or the unit that above-described embodiment illustrates can specifically realize by computer chip or entity, Or it is realized by the product with certain function.It is a kind of typically to realize that equipment is computer.Specifically, computer for example may be used Think personal computer, laptop computer, vehicle-mounted human-computer interaction device, cellular phone, camera phone, smart phone, individual Digital assistants, media player, navigation equipment, electronic mail equipment, game console, tablet computer, wearable device or The combination of any equipment in these equipment of person.

Although this specification one or more embodiment provides the method operating procedure as described in embodiment or flow chart, It but may include more or less operating procedure based on conventional or without creativeness means.The step of being enumerated in embodiment Sequence is only one of numerous step execution sequence mode, does not represent and unique executes sequence.Device in practice or When end product executes, can be executed according to embodiment or the execution of method shown in the drawings sequence or parallel (such as it is parallel The environment of processor or multiple threads, even distributed data processing environment).The terms "include", "comprise" or its Any other variant is intended to non-exclusive inclusion so that include the process, methods of a series of elements, product or Equipment not only includes those elements, but also including other elements that are not explicitly listed, or further include for this process, Method, product or the intrinsic element of equipment.In the absence of more restrictions, being not precluded is including the element There is also other identical or equivalent elements in process, method, product or equipment.The first, the second equal words are used to indicate name Claim, and does not indicate any particular order.

For convenience of description, it is divided into various modules when description apparatus above with function to describe respectively.Certainly, implementing this The function of each module can be realized in the same or multiple software and or hardware when specification one or more, it can also be with The module for realizing same function is realized by the combination of multiple submodule or subelement etc..Installation practice described above is only It is only illustrative, for example, in addition the division of the unit, only a kind of logical function partition can have in actual implementation Division mode, such as multiple units or components can be combined or can be integrated into another system or some features can be with Ignore, or does not execute.Another point, shown or discussed mutual coupling, direct-coupling or communication connection can be logical Some interfaces are crossed, the indirect coupling or communication connection of device or unit can be electrical property, mechanical or other forms.

The present invention be referring to according to the method for the embodiment of the present invention, the process of device (system) and computer program product Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates, Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or The function of being specified in multiple boxes.

These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one The step of function of being specified in a box or multiple boxes.

In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net Network interface and memory.

Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/or The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium Example.

Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data. The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM), Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage, graphene stores or other Magnetic storage device or any other non-transmission medium, can be used for storage can be accessed by a computing device information.According to herein In define, computer-readable medium does not include temporary computer readable media (transitory media), such as the data of modulation Signal and carrier wave.

It will be understood by those skilled in the art that this specification one or more embodiment can provide as method, system or calculating Machine program product.Therefore, this specification one or more embodiment can be used complete hardware embodiment, complete software embodiment or The form of embodiment combining software and hardware aspects.Moreover, this specification one or more embodiment can be used at one or It is multiple wherein include computer usable program code computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) on the form of computer program product implemented.

This specification one or more embodiment can computer executable instructions it is general on It hereinafter describes, such as program module.Generally, program module includes executing particular task or realization particular abstract data type Routine, programs, objects, component, data structure etc..This this specification one can also be practiced in a distributed computing environment Or multiple embodiments, in these distributed computing environments, by being held by the connected remote processing devices of communication network Row task.In a distributed computing environment, program module can be located at the local and remote computer including storage equipment In storage medium.

All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method Part explanation.In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", The description of " specific example " or " some examples " etc. means specific features described in conjunction with this embodiment or example, structure, material Or feature is contained at least one embodiment or example of this specification.In the present specification, to the signal of above-mentioned term Property statement be necessarily directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described It may be combined in any suitable manner in any one or more of the embodiments or examples.In addition, without conflicting with each other, this The technical staff in field can be by the spy of different embodiments or examples described in this specification and different embodiments or examples Sign is combined.

The foregoing is merely the embodiments of this specification one or more embodiment, are not limited to book explanation Book one or more embodiment.To those skilled in the art, this specification one or more embodiment can have various Change and variation.All any modification, equivalent replacement, improvement and so within the spirit and principle of this specification, should all wrap It is contained within scope of the claims.

Claims

1. a kind of detection method for checking variance data, comprising:

Receive verification variance data；

According to the verification time of the verification variance data, the verification variance data is corresponding within the scope of acquisition specified time is answered With the transaction journal data of system；

Judge whether the logical relation of the information content in the transaction journal data matches, if so, determining the verification difference Data are verification noise data.

2. the method as described in claim 1, the determination verification variance data is verification noise data, comprising:

Judge that log content in the transaction journal data of the application system, stl status code, log association odd numbers are corresponding Whether at least one in business diary matches, if at least one matching, it is determined that the verification variance data is verification noise Data.

3. the method as described in claim 1, the method also includes:

If judging, the transaction journal data of the application system are mismatched, it is determined that the verification variance data is abnormal data, Abnormal investigation is carried out to the verification abnormal data.

4. the method as described in claim 1, the method also includes:

If judging, the transaction journal data of the application system are mismatched, and unmatched transaction journal number is obtained from database According to corresponding business datum, data difference detection is carried out.

5. the transaction journal data of the method as described in claim 1, the application system are obtained using following manner:

According to the execution parameter of the application system and as a result, the log of the application system is output to preset buffer area Domain；

If the corresponding affairs of the application system are submitted, and the log of application system described in the preset buffer zone is defeated Disk is arrived out, obtains the transaction journal data of the application system；

If the corresponding transaction rollback of the application system, deletes the day of application system described in the preset buffer zone Will.

6. a kind of verification of data method, comprising:

If verification of data, which determines, has verification variance data, according to the verification time of the verification variance data, obtain specified The transaction journal data for checking the corresponding application system of variance data in time range；

7. a kind of detection device for checking variance data, comprising:

Data reception module, for receiving verification variance data；

Transaction journal obtains module, for the verification time according to the verification variance data, obtains institute within the scope of specified time State the transaction journal data of the corresponding application system of verification variance data；

Data match module, for judging whether the logical relation of the information content in the transaction journal data matches, if so, Determine the verification variance data for verification noise data.

8. device as claimed in claim 7, the data match module is specifically used for:

9. device as claimed in claim 7, the data match module is also used to:

10. device as claimed in claim 7, the data match module is also used to:

11. device as claimed in claim 7, described device further includes transaction journal generation module, for using following methods Generate the transaction journal data of the application system:

12. it is a kind of verification variance data detection processing equipment, comprising: at least one processor and for storage processor can The memory executed instruction, the processor realize the described in any item methods of claim 1-5 when executing described instruction.

13. a kind of verification of data device, comprising:

There is verification variance data if determining for verification of data in data acquisition module, according to the verification variance data The time is checked, the transaction journal data for checking the corresponding application system of variance data within the scope of specified time are obtained；

Variance data detection module, for judging whether the logical relation of the information content in the transaction journal data matches, if It is, it is determined that the verification variance data is verification noise data.

14. a kind of verification of data system, comprising: application system, database, verification platform, the detection device for checking variance data, The application system is used to store the business datum of the application system, the core for executing service request, the database It is used to check the business datum of the application system to platform, the detection device of the verification variance data is for executing above-mentioned power Benefit requires the detection method of the described in any item verification variance datas of 1-5.