Verification of data method, device and equipment
Technical field
The present embodiments relate to a kind of verification of data method, device and equipment, belong to field of computer technology.
Background technology
With the development of computer technology, more and more there is the mass data between multisystem and interact and extensive
The synchronous situation of the mass data of distributed system, the situation of interaction and synchronization for mass data, the verification of data
Just most important, still, existing verification of data mode is less efficient, it is impossible to be adapted to mass data or large file verification
Demand.
By taking the system architecture of existing fund process of exchange as an example, the fund process of exchange of prior art as shown in figure 1, with
After family needs the data processing by multiple systems shown in Fig. 1 when carrying out fund transaction, it can just be finally completed, with base in figure
Gold applies to purchase process as example.In multiple systems shown in Fig. 1, fund transaction system is as important in fund transaction chain
Link, therefore, to assure that the fund transaction record stored in its database all by Fund Company's (such as each fund sells system on a commission basis) just
Really processing, then be accomplished by the fund transaction record (friendship for interacting and producing with fund marketing system in oneself database
Easy record) and the fund trade confirmation file beamed back of the corresponding TA systems of Fund Company checked that (the fund trade confirmation is literary
Part is generated by TA systems (open-ended fund registration settlement system)).Fund transaction system is directed to fund transaction data, mainly
Carry out the verification of following item:Whether fund transaction record has processing to omit, the trade share in fund transaction record whether with
The trade share recorded in fund trade confirmation file is consistent.
In the prior art, the verification mode of fund transaction data is as follows:Fund transaction system reads fund trade confirmation text
Part, according to the TA system codings and transaction number included in fund trade confirmation file, fund is obtained into the database of oneself
Transaction record, and checked item by item, after the completion of verification, mark is carried out to fund transaction record.
There is following defect in prior art:
The verification mode of prior art is first read in fund trade confirmation file one by one completely by the way of serially checking
Inquired about, obtained in the TA system codings and transaction number of fund transaction record, the database for then going fund transaction system
The transaction record corresponding with TA system codings and transaction number stored in database, is then rechecked in two transaction records
Whether trade share is consistent, in this serial verification mode, and verification every time is required for carrying out database primary retrieval, and core
It is single to order, cause the extremely inefficient of whole collation process.When run into fund trading volume it is very big when, can not meet at all batch
Transaction data verification demand.
The content of the invention
The embodiment of the present invention provides a kind of verification of data method, device and equipment, to improve the verification for mass data
Efficiency.
To achieve these goals, the invention provides a kind of verification of data method, including:
The polygon data to be checked from multiple different data sources are obtained, wherein, data to be checked described in per side are right respectively
Answer a data source;
The data to be checked on each side are subjected to data fractionation according to identical hash rule of classification respectively, number of packet is generated
Multigroup subdata to be checked identical and with corresponding relation;
Multigroup subdata to be checked is checked respectively according to the corresponding relation.
Present invention also offers a kind of verification of data device, including:
Acquisition module, for obtaining the polygon data to be checked from multiple different data sources, wherein, treat core described in per side
One data source is corresponded to respectively to data;
Grouping module is hashed, for the data to be checked on each side to be carried out into data respectively according to identical hash rule of classification
Split, generation number of packet is identical and has multigroup subdata to be checked of corresponding relation;
Module is checked, for being checked respectively multigroup subdata to be checked according to the corresponding relation.
Present invention also offers a kind of electronic equipment, including:
Memory, for storage program;
Processor, coupled to the memory, for performing described program, for:
The polygon data to be checked from multiple different data sources are obtained, wherein, data to be checked described in per side are right respectively
Answer a data source;
The data to be checked on each side are subjected to data fractionation according to identical hash rule of classification respectively, number of packet is generated
Multigroup subdata to be checked identical and with corresponding relation;
Multigroup subdata to be checked is checked respectively according to the corresponding relation.
Verification of data method provided in an embodiment of the present invention, device and equipment, are employed from many of different data sources
While data to be checked carry out hash packet, the mode of batch verification is then carried out again, mass data is effectively beaten
Packet is dissipated, being formed has to being convenient for the multi-group data of verification of data with relation, so as to improve the efficiency of verification of data.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
Fig. 1 is the system architecture schematic diagram of the fund process of exchange of prior art.
Fig. 2 is the structural representation of the fund transaction system of the embodiment of the present invention.
Fig. 3 is the schematic flow sheet of the verification of data method of the embodiment of the present invention one.
Fig. 4 is the structural representation of the verification of data device of the embodiment of the present invention two.
Fig. 5 is the structural representation of the verification of data device of the embodiment of the present invention three.
Fig. 6 is the handling process schematic diagram of the verification engine modules of the embodiment of the present invention three.
Fig. 7 is the structural representation of the electronic equipment of the embodiment of the present invention four.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing the disclosure in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Complete conveys to those skilled in the art.
Term is explained
TA systems:TA systems are the abbreviations that Chinese clearing houses' open-ended fund register settlement system.For registering investment
Fund share of the person in Shanghai securities account or Shenzhen account.Chinese clearing houses Shanghai branch company and Shenzhen branch company point
Dui Ying not Shanghai TA systems and Shenzhen TA systems.
Hash:The input (be called and do preliminary mapping, pre-image) of random length, by hashing algorithm, fixation is transformed into
The output of length, the output is exactly hashed value, and this data handling procedure is referred to as hash, and it is difficult by output that hash operations, which have,
It is anti-the characteristics of push away input.
Hash packet:Using some or all inputs as hash operations of data to be grouped, hashed value is calculated,
It is then based on hashed value and is carrying out packet, because the hashed value after hash operations has changed original data
Therefore original data, are grouped by rule based on hashed value, can sufficiently be broken up original data.
The technical principle of the embodiment of the present invention is, the polygon data to be checked from different data sources are first carried out
Hash packet, then carries out batch verification again, so that mass data carried out effectively to break up packet, being formed has correspondence pass
System is convenient for the multi-group data of verification of data, so as to improve the efficiency of verification of data.
By taking the verification of data demand of fund transaction system as an example, as shown in figure 1, fund transaction system is merchandised in whole fund
, it is necessary to check fund transaction record data and fund trade confirmation data in link, wherein, fund transaction record data
Come from the information exchange between fund marketing system and formed, its source comes from user side, and is stored in fund friendship
In the database of easy system itself, and the fund transaction that fund trade confirmation data come from fund registration settlement system return is true
Recognize file.To be in the following embodiments TA systems using Chinese clearing houses' open-ended fund registration settlement system as specific
Example describes technical scheme in detail, it will however be appreciated by the skilled person that the technical side of following examples
Case is equally applicable to other fund registration settlement systems similar with TA systemic-functions.
In actual applications, fund transaction system can carry out verification of data in units of the period, for example, will in the past one day
The generation of fund transaction system fund transaction record data and the fund trade confirmation data that receive of the same day checked (base
The confirmation of gold transaction was completed at T+1 days).
As shown in Fig. 2 the checking method of the data in the embodiment of the present invention can be by being arranged in fund transaction system
Verification of data device realizes that the verification of data device can obtain fund in the specified verification time (such as daily) at 24 points
The fund transaction record data of the previous day stored in the database of transaction system, and it is true to obtain the fund transaction that the same day receives
Recognize file (for example receive and be stored in special document storage system), and it is true to be therefrom extracted from the fund transaction of TA systems
Recognize data, the characteristics of being merchandised due to fund includes transaction number in fund transaction record data and fund trade confirmation data
With TA System Numbers, verification of data device can carry out hash packet according to transaction number and/or TA System Numbers, i.e., first calculate
The hashed value of TA System Numbers and/or transaction number, then the hashed value further according to generation is grouped, so that fund be merchandised
Record data and fund trade confirmation data are fully broken up, to improve verification efficiency.Due to for fund transaction record number
It is identical according to the hashing algorithm and rule of classification that are used with fund trade confirmation data, therefore, the fund transaction note after packet
Record data and fund trade confirmation data are with certain correspondence, so as to ensure that each can be each other between being grouped
Correspondence, to carry out effective ratio pair.
It is grouped, can be realized efficiently for the data in mass data or big file by the way of hash packet
The effect that data are broken up on ground, because hashing algorithm has the spy the Input transformation of random length into the output of regular length
Point, therefore, it is possible to control the size for exporting hashed value, so as to be more efficiently grouped based on hashed value.In addition, adopting
With the mode of hash packet, it can be grouped with the original order for upsetting data, so as to avoid the collection of shortage of data situation
It is middle to occur, so as to effectively improve the efficiency of verification of data, after shortage of data is found, also allow for carrying out at manpower intervention
Reason, the verification without influenceing other grouped datas.
It should be noted that verification of data device can also be set independently of fund transaction system, such as with independent clothes
The form of business device is present, and is communicated by way of information exchange with fund transaction system, obtains related data and is simultaneously compared
It is right.
Embodiment one
As shown in figure 3, its schematic flow sheet for the verification of data method of the embodiment of the present invention one, it includes:
Step 101:The polygon data to be checked from multiple different data sources are obtained, wherein, per side data to be checked point
Dui Ying not a data source.The executive agent of the step can be the verification of data being arranged in fund transaction system in Fig. 2
Device.
Here the fund that the database and TA systems for the fund transaction system that data source can correspond in Fig. 2 are returned is handed over
Easily confirm file, that is to say, that the situation of example is bilateral verification of data in Fig. 2, wherein the data on one side are to be stored in base
Fund transaction record data in the database of golden transaction system, another side is recorded on the fund in fund trade confirmation file
Trade confirmation data.
Fund trade confirmation data may be from the fund trade confirmation file returned in one or more TA systems, example
Such as, in Chinese scope, TA systems are under the jurisdiction of Chinese clearing houses, mainly by the TA systems of Shanghai branch company and come from depth
The TA systems of ditch between fields branch company carry out operation maintenance, at present, and and perhaps more banks and stock trader commission organization are complete at present for TA systems
Into docking, that is to say, that TA systems can be distributed in multiple banks and stock trader is sold on a commission basis in the management system of system, to be settled accounts
Service.But, in fund trade system, TA systems are the fund trade confirmations from different TA systems with uniqueness
Data are unduplicated, therefore, still regard the fund trade confirmation data from multiple TA systems as one side data.
In actual applications, it is distributed system that fund transaction system, which also occurs, there are multiple reciprocity fund transaction
System scenario, each fund transaction system can be mutually synchronized data, in this case, from different fund transaction systems
Fund trade confirmation record data just constitutes polygonal data, i.e., finally to check data and be:Merchandised from different funds and be
The fund trade confirmation data that the fund trade confirmation record data of system and one or more TA systems are returned.
Step 102:The data to be checked on each side are subjected to data fractionation according to identical hash rule of classification respectively, generated
Number of packet is identical and has multigroup subdata to be checked of corresponding relation.Wherein, every group of subdata to be checked also includes a plurality of
Data Entry.The executive agent of the step can be the verification of data device being arranged in fund transaction system in Fig. 2.
Specifically, transaction number and TA systems be may each comprise in fund transaction record data and fund trade confirmation data
Number (which TA system mark comes from).In addition, it can include transaction content data, wherein transaction content data typically may be used
Think the data such as turnover, trading item (apply to purchase, redeem).Below using the hash grouping process of fund transaction record data as
Example is illustrated, and the hash grouping process of fund trade confirmation data and the hash grouping process of fund transaction record data are one
Sample, simply the source of data is different.
For example, the transaction record data instance such as following table extracted from the database of fund transaction system:
Then, hash packet is carried out for data above, because TA System Numbers and transaction number can be right well
Each bar transaction record is distinguished, therefore hash calculating can be carried out for TA System Numbers and/or transaction number (when to TA systems volume
Number and transaction number when carrying out hash and calculating, can first combine both into string number or character string), then according to default
Hash rule of classification carry out data fractionation respectively, generate multigroup fund transaction record data.Specific hashing algorithm can root
According to data volume number and data itself the characteristics of depending on.
With data instance above, wherein, transaction number is that center section is substituted with ellipsis from 001 to 550.Hash
Algorithm can be that then the character string after TA System Numbers and transaction number combination divided by 100 are taken the remainder, for example, with fifth line
Character string after data instance, TA System Numbers and transaction number combination is " TA02005 ", and above-mentioned remove is carried out to the character string
After 100 hash operations then taken the remainder, obtained hashed value is " 5 ".550 whole TA System Numbers and transaction are compiled
Number combination after character string carry out hash calculating after, can obtain remainder be 0 to 50 multiple hashed values, so can according to
550 original data are divided into 50 groups of subdatas to be checked to hashed value, every group of subdata to be checked there are 11 data entries.
Certainly, hashing algorithm can also be divided by 20 take the remainder, and the hashed value so obtained can be less, and obtained packet also can be less,
Every group of data strip mesh number can be more some more.
On the other hand, the trade confirmation data extracted from trade confirmation file are also hashed using identical and be grouped
Rule carries out hash packet, and the number of packet finally given is identical and has the both sides of corresponding relation data to be checked.
The data that be can be seen that from the process of hash packet above after packet have upset the sequence of initial data, by original
Beginning data sufficiently break up, the data consecutive miss and the inconsistent defect of batch data that will likely can so exist
It is distributed in the group that each is broken up, so as to more easily check out the Data Entry of existing defects, improves verification of data
Efficiency.In addition, by hashing algorithm, after the hashed value of pieces of data has been calculated, directly can just be carried out according to hashed value
Packet, has upset the order of initial data, and initial data carried out sufficiently to break up, and realizes efficiently data and divides
Group, because during actual computer disposal, the verification task between each packet can be performed parallel, because
This, the collation process between each group will not influence each other, and the termination of part verification task does not interfere with overall data collation process.
Step 103:Multigroup subdata to be checked is checked respectively according to corresponding relation.The executive agent of the step can
Think the verification of data device being arranged in fund transaction system in Fig. 2.
The step can be specially:Merchandised from each group fund transaction record subdata with corresponding relation and each group fund
Confirm in subdata, take out fund transaction record Data Entry and fund trade confirmation Data Entry to be checked one by one respectively;
Data Matching judgement is carried out according to transaction number, if it does, then the verification of content-data is traded, in specific verification
It can be that dealing money etc. is checked to hold, depending on the specific rules of verification can be according to data content actually to be checked,
The form that the structure of verification can be reported is exported.If it find that unmatched situation, it is determined that to there is shortage of data, this
In the case of kind, it is understood that there may be certain one side shortage of data in polygonal data to be checked, then warning message, claimant can be generated
Work intervention is handled.
Wherein, before data to be compared are taken out from each group of data with corresponding relation, sequence can also be included
Processing, specifically, according to identical ordering rule (for example can according to transaction number order), to fund transaction record subnumber
Carried out according to the fund transaction record Data Entry in each group fund trade confirmation subdata and fund trade confirmation Data Entry
Sequence, then performs the process for taking out data to be checked and the follow-up collation process of progress above again.Broken up point by data
After group, then it is ranked up for every group of data, because every group of data volume is less, can fully improves sequence efficiency, and then improve
Verification of data efficiency.
The verification of data method that the present embodiment is provided, employs and carries out the polygon data to be checked from different pieces of information
Hash packet, the mode of batch verification is then carried out again, mass data has been carried out effectively to break up packet, formed with to
Relation is convenient for the multi-group data of verification of data, so as to improve the efficiency of verification of data.In actual applications, can be with
Multi-group data is compared parallel, so as to increase substantially verification of data efficiency.
It is grouped, can be realized efficiently for the data in mass data or big file by the way of hash packet
The effect that data are broken up on ground, because hashing algorithm has the spy the Input transformation of random length into the output of regular length
Point, therefore, it is possible to control the size for exporting hashed value, so as to be more efficiently grouped based on hashed value.In addition, adopting
With the mode of hash packet, it can be grouped with the original order for upsetting data, so as to avoid the collection of shortage of data situation
It is middle to occur, so as to effectively improve the efficiency of verification of data, after shortage of data is found, also allow for carrying out at manpower intervention
Reason, the verification without influenceing other grouped datas
Embodiment two
As shown in figure 4, the present embodiment is related to a kind of verification of data device, it includes:
Acquisition module 11, for obtaining the polygon data to be checked from multiple different data sources, wherein, wait to check per side
Data correspond to a data source respectively, wherein, the polygon data to be checked from multiple different data sources can be specially:Storage
Fund transaction record data in fund transaction system, from the text of the trade confirmation from one or more TA systems received
The fund trade confirmation data extracted in part.
Grouping module 12 is hashed, for the data to be checked on each side to be entered into line number respectively according to identical hash rule of classification
According to fractionation, generation number of packet is identical and has multigroup subdata to be checked of corresponding relation.Specifically, fund transaction record number
According to in fund trade confirmation data include transaction number and TA System Numbers, then by the data to be checked on each side according to identical
Hash rule of classification carry out data fractionation respectively, generation number of packet is identical and multigroup subnumber to be checked with corresponding relation
According to can include:Transaction number and/or TA System Numbers in fund transaction record data and fund trade confirmation data,
Data fractionation is carried out respectively according to identical hash rule of classification, and generation quantity is identical and there is multigroup fund of corresponding relation to hand over
Easy record data and fund trade confirmation data.
Module 13 is checked, for being checked respectively multigroup subdata to be checked according to corresponding relation.Wherein, fund is handed over
Transaction content data can also be included in easy record data and fund trade confirmation data, then checking module can be specifically for:
From each group fund transaction record subdata with corresponding relation and each group fund trade confirmation subdata, take out one by one respectively
Fund transaction record Data Entry and fund trade confirmation Data Entry to be checked;Data Matching is carried out according to transaction number
Judge, if it does, then being traded the verification of content-data, specifically, dealing money can be checked, if it find that
Unmatched situation, it is determined that to there is shortage of data.In addition, extracting Data Entry from each group of data with corresponding relation
Before, in addition to:According to identical ordering rule, in fund transaction record subdata and each group fund trade confirmation subdata
Fund transaction record Data Entry and fund trade confirmation Data Entry be ranked up.Then, can for the data after sequence
With according to clooating sequence, from each group fund transaction record subdata with corresponding relation and each group fund trade confirmation subdata
In, then taking out fund transaction record Data Entry and fund trade confirmation Data Entry to be checked one by one respectively.
The verification of data device that the present embodiment is provided, employs and carries out the polygon data to be checked from different pieces of information
Hash packet, the mode of batch verification is then carried out again, mass data has been carried out effectively to break up packet, formed with to
Relation is convenient for the multi-group data of verification of data, so as to improve the efficiency of verification of data.In actual applications, can be with
Multi-group data is compared parallel, so as to increase substantially verification of data efficiency.
It is grouped, can be realized efficiently for the data in mass data or big file by the way of hash packet
The effect that data are broken up on ground, because hashing algorithm has the spy the Input transformation of random length into the output of regular length
Point, therefore, it is possible to control the size for exporting hashed value, so as to be more efficiently grouped based on hashed value.In addition, adopting
With the mode of hash packet, it can be grouped with the original order for upsetting data, so as to avoid the collection of shortage of data situation
It is middle to occur, so as to effectively improve the efficiency of verification of data, after shortage of data is found, also allow for carrying out at manpower intervention
Reason, the verification without influenceing other grouped datas.
Embodiment three
As shown in figure 5, the present embodiment is related to another verification of data device, the verification of data device of the present embodiment is to be based on
Practical application in fund transaction system and design, specifically include following module:Data source management module 21, data processing
Module management module 22, verification scene management module 23, task template management module 24, verification task module 25, verification engine
Module 26, collating report's generation module 27, business callback module 28.
Data source management module 21 is mainly used in carrying out data source configuration, and data source support, number are provided for check system
Database, file, open storage are can come from according to source, database can be the local general database of system, or
Hbase (a kind of distributed, towards row PostgreSQL database) database, Ali's cloud OTS (open architecture data, services) etc.,
File can be the various data files that from external reception or locally generate, and the data source of open storage can be such as Ali's cloud
The data sources such as the open storage servers such as OOS (Object-Oriented Storage, object storage).
Example as in the previous examples, in fund transaction system, fund transaction record data come from the number of its own
According to storehouse, and fund trade confirmation data then come from the fund trade confirmation file that fund transaction system is received and stored.
Data processing module management module 22, for providing the data processing template to the disposal ability of data, such as data
The data processing template of scheduling algorithm etc. is changed in hash packet, cleaning.The one or more data processings of data processing matrix polymerization
Device, while supporting self-defining data processor, each data processing can be considered as an algorithm process unit, can receive other
Processing module (such as the verification engine modules behind) are called.Data processing module can include being used to perform at hash packet
The hash packet handler of reason, for perform data sorting processing sorting processor and made by oneself according to actual needs
Self-defining data processor of adopted Functional Design etc..
Scene management module 23 is checked, for describing using which data source, using which data processing template to data
Handled, how to be fetched from data to be checked, being matched and being checked etc. using what kind of verification rule, checking scene
Mainly include data source, data processing module, access script, Data Matching script, verification rule and alarm strategy etc., wherein
Data source and data processing template will mainly illustrate access script, Data Matching script, core already explained above below
To rule and alarm strategy.
Wherein, access script is performed for the script of access processing, and how description takes out a line from data to be checked
Or multirow data are used for being checked.Json (JavaScript Object Notation, a kind of lightweight can specifically be used
Data interchange format) description access script, groovy can also be used in addition, and (one kind is based on JVM (Java Virtual Machine)
Agile development language) script describes more complicated access rule.
Data Matching script is performed for the script checked in verification advance row data, is carrying out both sides or polygon
During verification, after data are taken out, both sides or polygonal data are matched, the match is successful, then it is assumed that can be checked, if
Matching is unsuccessful, then illustrates do not possess verification condition, in fact it could happen that, it is necessary at manpower intervention situations such as unilateral shortage of data
Reason.
How data are checked and be provided the dependency rule of the result of verification for description by verification rule.Two
Side or polygonal data recall specific verification rule and handled, verification rule can have one or more after the match is successful,
When there is multiple verification rules, serial process will be performed, as long as there is a verification rule not pass through, then the data are to confirm as
Verification does not pass through.
Alarm strategy, for describe each verification scene in, if there is verification data it is inconsistent in the case of how
Alarmed, the type of alarm such as SMS alarm, instant message alarm, mail notification.
Task template management module 25, for describing how verification task is carried out, it mainly includes time parameter method, task simultaneously
The content of several aspects such as row ability, task time-out, verification scene.
Time parameter method description performs task according to which type of time parameter method, for example, daily 24 points of execution verification task.
How many computing resource needed to use during the tasks in parallel ability description verification tasks carrying.
Whether task execution time describes the maximum duration of tasks carrying, for determining tasks carrying because of some unknown causes
Time-out.
Task module 25 is checked, in system operation, whether timing scan verification task template to judge current time
The time parameter method of matching task template, if the match is successful, creates verification task.
Engine modules 26 are checked, when checking tasks carrying, the scene transfer that can handle task gives verification engine, then
Engine analytic kernel is checked to scene, and performs verification.Verification engine modules 26 are the core that the embodiment of the present invention performs collation process
Core module, data source management module 21, data processing module management module 22, verification scene management module 23, task above
Template management module 24, verification task module 25 are that the verification engine modules 26 provide business support.The verification engine modules 26
The core of the verification of data device corresponding to embodiment two can be considered as.
The handling process performed by engine modules 26 is checked as shown in fig. 6, mainly including:
Step 201:According to the situation of data source, the Task-decomposing for obtaining data to be checked is appointed for multiple data acquisitions
Business.
Here the decomposable process of data acquisition task is illustrated so that data source is database and file as an example, first from verification
Data source configuration is obtained in scene management module 23, is then read out respectively according to the different type of file and database and treats core
To data.
During data are read, according to the size of table or file, internal cutting is carried out, multiple data acquisitions are generated
Subtask, so that convenient carry out parallel processing.
For example:Fund transaction record data have divided 10 databases to be stored, and each database has 100 tables, each
The acquisition task of fund transaction record data can be cut into 1000 by qualified record number probably at thousands of in table
Data acquisition subtask.
For another example there are 98 TA systems (being distributed in each big bank and stock trader commission organization), each TA systems in the whole nation at present
A trade confirmation file can be sent to fund transaction system daily, each trade confirmation file is both less than 100M, so
In the case of, it can directly be decomposed into 100 data acquisition subtasks for being directed to trade confirmation file.
Step 202:Read data and carry out hash packet transaction.The step mainly includes following processing:
Step 202a:Hash packet subtask is got, hash packet subtask can be that task template management module is pre-
First defining for task;
Step 202b:The data to be checked that traversal has been got, and configured using data processing template management module
Data processor, is handled successively by hashing script;
Step 202c:Data to be checked are write by corresponding file according to hashed value.
Step 203:Generation verification subtask.
For example:In one verification scene, data source D1 and data source D2 are contained, wherein D1 uses data processing template
P1, D2 use data processing template P2.For example, after hash packet, D1 generates file F1D1, F2D1, F3D1, D2 generations
File F1D2, F2D2, F3D2, file here correspond to above-mentioned subdata check, are grouped in specific hash
During, can be file by subdata to be checked establishment, and the progress packet core pair in units of file.According to rule of classification,
Data source D1 will generate following three verification subtask:
Verification task 1:F1D1, F1D2;
Verification task 2:F2D1, F2D2;
Verification task 3:F3D1, F3D2;
Step 204:Verification subtask is performed, the step mainly includes following processing:
Step 204a:After verification subtask T1 is got, to the file F1D1 and F1D2 to be checked included in T1 files;
Step 204b:File F1D1 and F1D2 are checked, for example, F1D1 sizes 10M, F1D2 size 10M.
Step 204c:Judge whether currently available internal memory meets requirement, for example, currently available memory value is obtained for 100M,
Confirmation can perform this verification task.
Step 204d:File F1D1 and F1D2 are read in internal memory, and distinguished using the sequence script in verification scene
It is ranked up;
In file F1D1 after verification subdata after sequence, Data Entry (is followed successively by transaction number, TA systems as follows
Numbering, dealing money):
001, ta01,100;
002, ta01,101;
003, ta01,104;
In file F1D2 after verification subdata after sequence, Data Entry is as follows:
001, ta01,100;
002, ta01,102;
003, ta01,104;
Step 204e:Access script, matched rule and verification rule are obtained from verification scene management module, data core is performed
To processing.Wherein, access script takes out a data from file every time.By taking F1D1 as an example, detailed process is as follows:
The 1st data is taken out from F1D1:001, ta01,100
The 1st data is taken out from F1D2:001, ta01,100
Determine whether two datas possess the basis of verification using matched rule, matched rule is here:Compare two
Whether the transaction number of data is consistent, is all 001 by the transaction number for comparing both sides, the matching of two datas, can enter to advance
The verification of one step, if there is the warning message of mismatch, then output data missing, and terminates verification of data task.There is number
It is usually that in a packet, the quantity of the data to be checked on both sides is inconsistent according to unmatched situation, many on one side, another side is few
, that is, shortage of data is occurred in that, in this case, it is necessary to which manpower intervention is handled.From this point of view, because the embodiment of the present invention will
Data in mass data and big file fully break up, and the situation of shortage of data has been distributed into multiple small data point
In group, accordingly even when there is the situation for stopping verification of data task, also it is off appointing for the verification that current data lacks group
Business, the verification operation without influenceing whole data, also, because data fully break up, the data volume being each grouped
Also it is relatively small, also allow for manpower intervention processing.
If two datas are matched, determine whether both sides data are checked unanimously using verification rule, rule is checked here
For:Whether consistent compare turnover.For example both sides dealing money is 100, then output data checks consistent checked result, such as
The transaction on fruit both sides and then inconsistent, then output data check inconsistent checked result.
This is arrived, this time access verification operation is completed, and then takes F1D1 and F1D2 the 2nd data to repeat above-mentioned matching again
And audit process, until total data verification is finished.
Collating report's generation module 27, for generating collating report according to checked result and achieving, so that user checks.Core
To can content as follows in report:Data source, verification scene are checked, record is checked, checks abnormal.
Business callback module 28, for performing corresponding readjustment by system according to different checked results.Verification has been performed
Cheng Hou, has two results, by or do not pass through, business callback module can basis configuration readjustment strategy, according to different
Checked result, performs corresponding readjustment.The purpose of readjustment be in order to verification task complete take result after, business is driven automatically
System carries out flow below.
Example IV
As shown in fig. 7, it is the structural representation of the electronic equipment of the embodiment of the present invention four, specifically include:Memory 710
With processor 720.
Memory 710, for storage program.
In addition to said procedure, memory 710 is also configured to the other various data of storage to support in electronic equipment
On operation.
Memory 710 can realize by any kind of volatibility or non-volatile memory device or combinations thereof,
Such as static RAM (SRAM), Electrically Erasable Read Only Memory (EEPROM), erasable programmable is read-only
Memory (EPROM), programmable read only memory (PROM), read-only storage (ROM), magnetic memory, flash memory, disk
Or CD.
Processor 720, coupled to memory 710, for performing the program in memory 710, for:
The polygon data to be checked from multiple different data sources are obtained, wherein, one is corresponded to respectively per side data to be checked
Individual data source;
The data to be checked on each side are subjected to data fractionation according to identical hash rule of classification respectively, number of packet is generated
Multigroup subdata to be checked identical and with corresponding relation;
Multigroup subdata to be checked is checked respectively according to corresponding relation.
Further, as shown in fig. 7, electronic equipment can also include:Communication component 730, power supply module 740, audio-frequency assembly
750th, other components such as display 760.Members are only schematically provided in Fig. 7, are not meant to that electronic equipment only includes Fig. 7
Shown component.
Communication component 730 is configured to facilitate the communication of wired or wireless way between electronic equipment and other equipment.Electricity
Sub- equipment can access the wireless network based on communication standard, such as WiFi, 2G or 3G, or combinations thereof.It is exemplary at one
In embodiment, communication component 730 receives broadcast singal or broadcast correlation from external broadcasting management system via broadcast channel
Information.In one exemplary embodiment, communication component 730 also includes near-field communication (NFC) module, to promote junction service.
For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band (UWB) skill can be based in NFC module
Art, bluetooth (BT) technology and other technologies are realized.
Power supply module 740, electric power is provided for the various assemblies of electronic equipment.Power supply module 740 can include power management
System, one or more power supplys, and other generate, manage and distribute the component that electric power is associated with for electronic equipment.
Audio-frequency assembly 750 is configured as output and/or input audio signal.For example, audio-frequency assembly 750 includes a Mike
Wind (MIC), when electronic equipment be in operator scheme, when such as call model, logging mode and speech recognition mode, microphone by with
It is set to reception external audio signal.The audio signal received can be further stored in memory 710 or via communication set
Part 730 is sent.In certain embodiments, audio-frequency assembly 750 also includes a loudspeaker, for exports audio signal.
Display 760 includes screen, and its screen can include liquid crystal display (LCD) and touch panel (TP).If screen
Curtain includes touch panel, and screen may be implemented as touch-screen, to receive the input signal from user.Touch panel includes one
Individual or multiple touch sensors are with the gesture on sensing touch, slip and touch panel.Touch sensor can not only sense tactile
Touch or sliding action border, but also detection and touch or slide related duration and pressure.
One of ordinary skill in the art will appreciate that:Realizing all or part of step of above-mentioned each method embodiment can lead to
The related hardware of programmed instruction is crossed to complete.Foregoing program can be stored in a computer read/write memory medium.The journey
Sequence upon execution, performs the step of including above-mentioned each method embodiment;And foregoing storage medium includes:ROM, RAM, magnetic disc or
Person's CD etc. is various can be with the medium of store program codes.
Finally it should be noted that:Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations;To the greatest extent
The present invention is described in detail with reference to foregoing embodiments for pipe, it will be understood by those within the art that:Its according to
The technical scheme described in foregoing embodiments can so be modified, or which part or all technical characteristic are entered
Row equivalent substitution;And these modifications or replacement, the essence of appropriate technical solution is departed from various embodiments of the present invention technology
The scope of scheme.