CN112241328B - Data processing method, device and system - Google Patents
Data processing method, device and system Download PDFInfo
- Publication number
- CN112241328B CN112241328B CN202010949493.9A CN202010949493A CN112241328B CN 112241328 B CN112241328 B CN 112241328B CN 202010949493 A CN202010949493 A CN 202010949493A CN 112241328 B CN112241328 B CN 112241328B
- Authority
- CN
- China
- Prior art keywords
- data
- calculation result
- parameter information
- verification
- verified
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title abstract description 8
- 238000004364 calculation method Methods 0.000 claims abstract description 147
- 238000012795 verification Methods 0.000 claims abstract description 126
- 238000000034 method Methods 0.000 claims abstract description 35
- 238000012545 processing Methods 0.000 claims description 47
- 230000005540 biological transmission Effects 0.000 claims description 20
- 238000000605 extraction Methods 0.000 claims description 4
- 238000004883 computer application Methods 0.000 abstract description 2
- 230000007474 system interaction Effects 0.000 description 20
- 238000010586 diagram Methods 0.000 description 4
- 238000013519 translation Methods 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/543—User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
Abstract
The embodiment of the invention provides a data processing method, a device and a system, and relates to the technical field of computer application. The method comprises the steps of receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result; if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas; extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula; and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result. The technical scheme of the invention improves the problem positioning efficiency.
Description
Technical Field
The embodiment of the invention relates to the technical field of computer application, in particular to a data processing method, device and system.
Background
With the development of internet technology, the degree of various service modes is more and more complex, and the data transmission involved in the service modes is more and more complex. Taking the order service related to the service industry as an example, order data is typically transmitted between multiple systems, such as billing systems, accounting systems, etc. To ensure the correctness of data transmission, after the current system receives the data transmitted by the previous system, the data is usually checked. When the verification fails, the data with problems in the data needs to be positioned.
In the conventional scheme, locating data with problems among a plurality of systems is completed by manual operation. Longer time and complex process and lower positioning efficiency.
Disclosure of Invention
The embodiment of the invention provides a data processing method, a data processing device and a data processing system, which are used for improving problem positioning efficiency.
A first aspect of the present invention provides a data processing method, comprising:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
Extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
A second aspect of the present invention provides a data processing apparatus comprising:
the receiving module is used for receiving data to be verified, which are sent by the target system, wherein the data to be verified comprise a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
the first determining module is used for determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result;
the extraction module is used for extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and the second determining module is used for determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
A third aspect of the present invention provides a data processing system comprising a storage component and a processing component;
the storage component stores one or more computer instructions, wherein the one or more computer instructions are for the processing component to invoke and execute;
the processing assembly is configured to:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
According to the invention, by utilizing the verification tool packaged with a plurality of verification formulas, after receiving the data to be verified sent by the target system, determining the verification formulas corresponding to the target system, extracting corresponding parameter information from the data to be verified according to the field identifications included in the verification formulas, and verifying the data to be verified according to the parameter information, the verification result capable of reflecting the problem between system interactions is obtained, the problem between system interactions is automatically positioned, the problems of long positioning time and complicated positioning process caused by manual operation in the traditional scheme are solved, and the positioning efficiency is improved.
These and other aspects of the invention will be more readily apparent from the following description of the embodiments.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the conventional solutions, the drawings that are required to be used in the description of the embodiments or the conventional solutions will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to the drawings without any inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of one embodiment of a data processing method provided by the present invention;
FIG. 2 is a schematic diagram of an embodiment of a data processing apparatus according to the present invention;
FIG. 3 is a schematic diagram illustrating one embodiment of a data processing system provided by the present invention.
DETAILED DESCRIPTION OF EMBODIMENT (S) OF INVENTION
In order to enable those skilled in the art to better understand the present invention, the following description will make clear and complete descriptions of the technical solutions according to the embodiments of the present invention with reference to the accompanying drawings.
In some of the flows described in the specification and claims of the present invention and in the foregoing figures, a plurality of operations occurring in a particular order are included, but it should be understood that the operations may be performed out of order or performed in parallel, with the order of operations such as 101, 102, etc., being merely used to distinguish between the various operations, the order of the operations themselves not representing any order of execution. In addition, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first" and "second" herein are used to distinguish different messages, devices, modules, etc., and do not represent a sequence, and are not limited to the "first" and the "second" being different types.
The embodiment of the invention is mainly suitable for the scene of problem positioning during intersystem interaction, which is generally referred to as data transmission between systems. In order to ensure the correctness of the data, the current system usually checks the data after receiving the data transmitted by the previous system adjacent to the current system, and if the data passes the check, the data is correctly transmitted between the two systems; if the verification is not passed, the data is indicated to be transmitted between the two systems in error, and the problem location is needed.
Taking transmission of order data in the service industry as an example, for a certain service order, the order data is typically transmitted in a plurality of systems such as a billing system, a settlement system, an accounting system, and the like. For example, the billing system calculates the data of the order to obtain a bill amount, so that the data of the bill and the calculated bill amount are transmitted to the settlement system, the settlement system calculates the data of the bill to obtain another bill amount, and if the calculated bill amounts are consistent, the check is passed, and the settlement system can transmit the data of the bill and the bill amount to the billing system for processing; if the calculated bill amounts are inconsistent, the verification is not passed, and the problem positioning is needed.
In the conventional scheme, problem positioning between system interactions is completed by manual operation. Longer time and complex process and lower positioning efficiency.
Therefore, in order to improve the positioning efficiency, the inventor proposes the technical scheme of the invention, namely, the data to be checked sent by the target system is received, wherein the data to be checked comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result; if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas; extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula; and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
By using a verification tool packaged with a plurality of verification formulas, after receiving data to be verified sent by a target system, determining the verification formulas corresponding to the target system, extracting corresponding parameter information from the data to be verified according to field identifiers included in the verification formulas, and verifying the data to be verified according to the parameter information, the verification result capable of reflecting the problem between system interactions is obtained, automatic positioning of the problem between the system interactions is achieved, the problems that manual operation is needed in a traditional scheme, positioning time is long and a positioning process is complicated are solved, and positioning efficiency is improved.
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.
As shown in fig. 1, a flowchart of an embodiment of a data processing method according to the present invention may include the following steps:
101: receiving data to be verified sent by a target system; the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result.
In this embodiment, data may be transferred between multiple systems. For example, in a certain service mode, data can be sequentially transmitted among the A system, the B system and the C system according to the service flow. Wherein the target system may refer to any one of a plurality of systems involved in data transmission, such as the a-system. The data sent by the target system to the next system adjacent to the target system can be the data to be checked, for example, the data M is sent by the system A to the system B, and the data M can be the data to be checked.
The data to be verified can comprise a plurality of field identifiers, and the field identifiers can indicate fields for identifying parameter information. Alternatively, there may be a variety of implementations of field identification, such as digital field identification, e.g., 1001, 1002, 1003, etc., or alphabetic field identification, e.g., aa, bb, cc, etc. The implementation manner of the field identifier may be set according to actual situations, which is not particularly limited.
Besides the field identifiers, the data to be verified can also comprise parameter information corresponding to each of the field identifiers. The parameter information may comprise parameter values, i.e. digital parameter information. The parameter value may correspond to a field identification. If the parameter value corresponding to the field identifier 1001 may be 10, the parameter value corresponding to the field identifier 1002 may be 9, the parameter value corresponding to the field identifier 1003 may be 8, etc.
Besides the field identification and the parameter information corresponding to each of the field identifications, the data to be checked can also comprise a first data calculation result. The first data calculation result may be a calculation result obtained by calculating parameter information included in the data to be verified by the target system, and the first data calculation result may be a numerical value and also corresponds to the field identifier. Taking field identifiers 1001, 1002, 1003, 1004, etc. as examples, parameter values corresponding to the field identifiers 1001, 1002, and 1003 may be 10, 9, and 8, respectively, and a value corresponding to the field identifier 1004 may be a first data calculation result, such as 27. At this time, the first data calculation result may be obtained by adding up and calculating by the target system according to the parameter values 10, 9 and 8 included in the data to be verified.
In practical application, the field identifier, parameter information corresponding to each of the plurality of field identifiers, and the first data calculation result included in the target system may be set according to the actual service scenario. Taking an order processing business mode as an example in a service industry scene, the order processing business mode can relate to an order processing system comprising a plurality of systems such as a billing system, a settlement system, an entry system and the like. According to the order processing flow, order data can be sequentially transmitted among the billing system, the settlement system and the posting system. Taking the billing system as a target system for example, the billing system may send order data N to the settlement system, and the order data N may be the data to be checked. The order data N may include a plurality of field identifiers, such as 10001, 10002, 10003, etc., where the field identifier 10001 may represent an original price of the order commodity, the field identifier 10002 may represent a coupon price, the field identifier 10003 may represent a payment price, etc. The method can also comprise parameter information corresponding to each field identifier, for example, the parameter value corresponding to 10001 is 100, the original price of the ordered commodity is 100 yuan, the parameter value corresponding to 10002 is 10, the price of the coupon is 10 yuan, and the like. The method can also comprise a first data calculation result, for example, the first data calculation result corresponding to 10003 is 90, and the real payment price can be 90 yuan.
102: if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas.
In this embodiment, the process of obtaining the second data calculation result locally according to the data to be verified may be that after the target system sends the data to be verified to a next system adjacent to the target system, the next system calculates according to the parameter information included in the data to be verified, so as to obtain the second data calculation result. If the system a sends the data M to be checked to the system B, the system B may calculate to obtain a second data calculation result according to the parameter information included in the data M to be checked. Taking an order processing business mode as an example in a service industry scene, the real payment amount obtained by the billing system according to the order data can be used as a first data calculation result, and the real payment amount obtained by the settlement system according to the order data can be used as a second data calculation result.
In general, in the same service mode, when the B system performs calculation processing according to the parameter information included in the data M to be checked, the processing mode is the same as that of the a system, and the second data calculation result obtained by the B system processing should be the same as the first data calculation result obtained by the a system processing. If the second data calculation result is different from the first data calculation result, it indicates that in the service mode, an error occurs in the transmission process of the data M between the a system and the B system according to the service flow, or an error occurs in the processing process of the data M in the a system, or an error occurs in the processing process of the data M in the B system, and so on.
Therefore, when the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, the data to be checked sent by the target system can be checked. I.e., a verification formula corresponding to the target system may be determined from a verification tool that encapsulates a plurality of verification formulas. The checking formula can be a calculation formula used for data processing in the service mode, has high accuracy, and can be used for calculating parameter information in data to be checked to obtain a calculation result.
In practical application, the complexity of the service mode is higher, the data to be checked can be sourced from different platforms, and a plurality of corresponding target systems can be provided, so that different data processing modes and different check formulas can be provided for different target systems. Therefore, a plurality of verification formulas can be packaged into one verification tool, and when verification is performed, the verification formula corresponding to the target system is determined from the verification tools packaged with the plurality of verification formulas. Specifically, codes of a plurality of check formulas may be consolidated so as to be an integral body, so that a check tool in which a plurality of check formulas are packaged may be obtained.
For convenience of user operation, the verification tool can be applied to web pages. The webpage can also comprise a data input box to be checked and a check button. And responding to the data input operation to be verified triggered by the user in the page, acquiring the data to be verified from the target system, for example, acquiring transmission data from a data transmission log of the target system, and then responding to the verification operation triggered by the user to verify the data to be verified.
Optionally, the data to be verified may include identification information of the target system, and determining, from the verification tool packaged with the plurality of verification formulas, the verification formula corresponding to the target system may include:
and determining a verification formula corresponding to the identification information from a verification tool packaged with a plurality of verification formulas according to the corresponding relation between the preset identification information and the verification formulas.
If a certain service mode relates to three different target systems of an A1 system, an A2 system and an A3 system. The A1, A2, A3 may be identification information of the target system, which may be included in the data to be verified. The data to be checked transmitted by the A1 system can use a check formula 1, the data to be checked transmitted by the A2 system can use a check formula 2, the data to be checked transmitted by the A3 system can use a check formula 3, and the corresponding relation can be preset.
After receiving the data to be verified sent by the target system, according to the identification information, such as A1, of the target system contained in the data to be verified, a verification formula corresponding to the identification information, namely a verification formula 1, can be determined from a verification tool packaged with a plurality of verification formulas, such as the verification formula 1, the verification formula 2, the verification formula 3 and the like, according to the corresponding relation between the preset identification information and the verification formula, namely the corresponding relation between the A1 and the verification formula 1.
103: and extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula.
After the verification formula corresponding to the target system is obtained, corresponding parameter information can be extracted from the data to be verified according to the field identification included in the verification formula. The check formula comprises a field identifier, and the check formula can be represented by the field identifier and an operation symbol. For example, if the field identifiers included in the data to be checked are 1001, 1002, 1003, 1004, and the like, the check formula may be 1001+1002+1003=1004, and the like. The operation mode involved in the check formula can be set according to the actual service mode, which is not particularly limited.
From the check formula, the field identifications included in the check formula for calculation, i.e., the field identifications located on the left of the equation in the check formula, such as 1001, 1002, and 1003, may be determined. Then according to the field identifier, corresponding parameter information can be extracted from the data to be verified, if the parameter value corresponding to the field identifier 1001 is 10, the parameter value corresponding to the field identifier 1002 is 9, and the parameter value corresponding to the field identifier 1003 is 8, the parameter values of 10, 9 and 8 are extracted for calculation.
104: and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
And checking according to the extracted parameter information, and determining a checking result of the data to be checked. If the calculation result obtained by calculating according to the extracted parameter information is inconsistent with the calculation result obtained by calculating by the target system, it can be determined that an error or the like occurs in the processing process of the data to be checked in the target system.
In this embodiment, by using a verification tool that encapsulates a plurality of verification formulas, after receiving data to be verified sent by a target system, determining a verification formula corresponding to the target system, extracting corresponding parameter information from the data to be verified according to a field identifier included in the verification formula, and verifying the data to be verified according to the parameter information, a verification result that can reflect a problem between system interactions is obtained, automatic positioning of the problem between system interactions is achieved, the problems that in a traditional scheme, manual operation is required to be used, positioning time is long, and a positioning process is complicated are solved, and positioning efficiency is improved.
In practical application, the problem between system interactions may have multiple situations, and the verification result of the data to be verified may also have multiple implementation manners according to the extracted parameter information.
As an optional implementation manner, determining the verification result of the data to be verified according to the extracted parameter information may include:
if the number of the extracted parameter information is smaller than the number of the parameter information contained in the data to be checked, determining that the checking result of the data to be checked is: the data transmission is incomplete.
The number of parameter information included in the data to be verified may refer to the number of parameter information corresponding to each of the plurality of field identifiers. Taking the field identifiers 1001, 1002, 1003 and 1004 included in the data to be checked as examples, the check formula is 1001+1002+1003=1004, and the number of parameter information included in the data to be checked may refer to the number of parameter information corresponding to the field identifiers 1001, 1002 and 1003 respectively, that is, 3.
In general, the number of parameter information extracted should be the same as the number of parameter information included in the data to be verified, that is, the number of parameter information extracted should be 3, which is the parameter information corresponding to the field identifier 1001, the parameter information corresponding to the field identifier 1002, and the parameter information corresponding to the field identifier 1003, respectively. If the number of the parameter information is not consistent, the number of the extracted parameter information is smaller than the number of the parameter information contained in the data to be checked, and if the number of the extracted parameter information is 2, the condition that part of the parameter information is missing in the data to be checked can be indicated. If the extracted parameter information corresponding to the field identifier 1001 and the parameter information corresponding to the field identifier 1002 are the parameter information corresponding to the field identifier 1003, the parameter information corresponding to the missing field identifier 1003 in the data to be verified is indicated.
At this time, it may be determined that the verification result of the data to be verified is: the data transmission is incomplete. Further, the verification result may be determined as: the data transmission is incomplete, and the parameter information corresponding to the field identifier 1003 is missing.
By comparing the number of the extracted parameter information with the number of the parameter information contained in the data to be checked by using the checking tool, whether the data to be checked has the problem of incomplete data transmission or not can be determined, the incomplete specific data can be further determined according to a checking formula and field identification, the automatic positioning of the problem between system interactions is realized, and the positioning efficiency is improved.
As another alternative implementation manner, determining the verification result of the data to be verified according to the extracted parameter information may include:
if the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be verified, determining a third data calculation result according to a verification formula and the extracted parameter information;
if the third data calculation result is different from the first data calculation result, determining that a calculation formula of the target system for acquiring the first data calculation result is wrong.
If the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be checked, which indicates that the data to be checked does not have the problem of incomplete data transmission, calculation can be performed according to the checking formula and the extracted parameter information so as to obtain a third data calculation result. Specifically, the field identifier included in the left side of the check formula equation may be combined, and the extracted parameter information is substituted into the check formula to perform calculation, so as to obtain a third data calculation result. If the check formula is 1001+1002+1003=1004, and the extracted parameter information is the parameter value 10 corresponding to the field identifier 1001, the parameter value 9 corresponding to the field identifier 1002, and the parameter value 8 corresponding to the field identifier 1003, respectively, 10, 9, and 8 are substituted into the check formula, and 10+9+8 is calculated, so that a third data calculation result, that is, 27 is obtained.
Comparing the third data calculation result with the first data calculation result, both calculation results should be the same in general case, i.e. both the first data calculation result and the third data calculation result should be 27. If the two calculation results are different, for example, the first calculation result is 11, it may indicate that an error occurs in the processing process of the data to be verified in the target system, for example, an error in a calculation formula used for obtaining the first data calculation result in the target system.
At this time, it may be determined that the calculation formula of the target system for acquiring the first data calculation result is wrong. Further, a calculation formula for acquiring the first data calculation result in the target system may be acquired, for example, the calculation formula in the target system is 1001+1002-1003=1004, resulting in the first data calculation result being 11. Therefore, the prompt information of the calculation formula for acquiring the first data calculation result in the modification target system can be output so as to prompt the user to modify the calculation formula.
The third data calculation result is obtained by calculating the extracted parameter information by using the verification formula in the verification tool, and the third data calculation result is compared with the first data calculation result, so that whether the processing process of the data to be verified in the target system is problematic can be determined, and when the two calculation results are different, the calculation formula of the target system for obtaining the first data calculation result is incorrect, the automatic positioning of the problem between the system interactions is realized, and the positioning efficiency is improved.
In practical applications, besides the possible problem of the processing procedure of the data to be checked in the target system, the processing procedure of the data to be checked in the next system of the target system may also be problematic, so that problems occur between the system interactions. Taking the example that the A system sends the data M to be checked to the B system, when the second data calculation result obtained by the B system according to the data to be checked is different from the first data calculation result obtained by the A system, if the processing process of the data M to be checked in the A system is considered to have a problem, and when the processing process in the B system is not the problem, the third data calculation result obtained by using the checking tool is different from the first data calculation result and the second data calculation result. At this time, it may be determined that there is a problem in the processing procedure of the data M to be verified in the a system, for example, a calculation formula for obtaining the first data calculation result in the a system is wrong. If the third data calculation result obtained by using the verification tool is the same as the first data calculation result and different from the second data calculation result, at this time, it may be determined that the processing procedure of the data M to be verified in the a system is not problematic, and the processing procedure in the B system is problematic, for example, a calculation formula for obtaining the second data calculation result in the B system is incorrect. If the third data calculation result is different from the first data calculation result and the second data calculation result, it can be determined that the processing procedures of the data to be checked in the system a and the system B are both problematic, for example, the calculation formula used for obtaining the first data calculation result in the system a and the calculation formula used for obtaining the second data calculation result in the system B are both incorrect.
The third data calculation result is obtained by checking and calculating the data to be checked sent by the target system by using the checking tool, and the calculation result is compared with the first data calculation result obtained by the target system and the second data calculation result obtained by the target system which is obtained by the next system which is obtained locally, so that the problem of the data to be checked in the target system or the processing process of the next system which is obtained by the target system can be determined, the calculation formula of the target system which is used for obtaining the first data calculation result or the calculation formula of the next system which is used for obtaining the second data calculation result is further determined to be incorrect, the automatic positioning of the problem between the system interactions is realized, and the positioning efficiency is improved.
In practical application, considering that the complexity of the service mode is higher, the data to be transmitted is more, and a plurality of parameter values corresponding to a certain field identifier may be provided. Thus, in some embodiments, parameter values or parameter identifications, which may be indexes of parameter values, may be included in the parameter information. According to the field identifier included in the verification formula, extracting the corresponding parameter information from the data to be verified may include:
extracting corresponding parameter identifiers from data to be checked for target field identifiers of a preset type, wherein the target field identifiers of the preset type refer to field identifiers with a plurality of corresponding parameter values;
And querying a preset dictionary according to the extracted parameter identification and the target field identification so as to acquire parameter values corresponding to the target field identification and the parameter identification from the preset dictionary.
In this embodiment, field identifiers corresponding to a plurality of parameter values may be used as a preset type of field identifier. For the field identifier of the preset type included in the checking formula, the corresponding parameter identifier, such as a, b, c, and the like, can be extracted from the data to be checked.
The parameter identifier may be used as an index of the parameter value and corresponds to the parameter value one by one, for example, the parameter value corresponding to the parameter identifier a may be 5, the parameter value corresponding to the parameter identifier b may be 4, the parameter value corresponding to the parameter identifier c may be 3, and the like. In order to conveniently obtain the parameter values corresponding to the target field identifier and the parameter identifier, the corresponding relation between the field identifier of the preset type and the parameter identifier and the corresponding relation between the parameter identifier and the parameter value can be stored in a dictionary in advance, and the dictionary is preset in a verification tool. The method includes that a call code of the dictionary is set in the verification tool, and then the verification tool can be utilized to call a preset dictionary according to the extracted parameter identification and the target field identification, and parameter values corresponding to the target field identification and the parameter identification are obtained according to the corresponding relation. If a certain field identifier 1005 corresponds to three parameter identifiers a, b and c, and the parameter values corresponding to the three parameter identifiers are 5, 4 and 3, respectively, and the corresponding parameter identifier b is extracted from the data to be checked according to the target field identifier 1005 included in the check formula, then the corresponding parameter value 4 can be obtained from the preset dictionary by using a check tool. In practical application, if the field identifier corresponds to a parameter value, the correspondence between the field identifier and the parameter value may be stored in the dictionary in advance. And will not be described in detail herein.
In this embodiment, when the parameter information corresponding to the field identifier is the parameter identifier, the parameter value corresponding to the target field identifier and the parameter identifier is obtained by using the preset dictionary in the verification tool, and the corresponding parameter value is not required to be obtained by manual operation, so that the automatic positioning of the problem between the system interactions is realized, and the positioning efficiency is improved.
In some embodiments, in addition to the correspondence, paraphrase information corresponding to the field identification may be included in the preset dictionary. The method may further comprise:
if the checking result of the data to be checked is incomplete data transmission, outputting the paraphrase information corresponding to the untransmitted field identification.
Taking an order processing business mode as an example in a service industry scene, for example, a field identifier 10001 can represent the original price of an order commodity, then the original price of the order commodity can be the explanation information of the field identifier 10001, a field identifier 10002 can represent the price of a coupon, then the price of the coupon can be the explanation information of the field identifier 10002, a field identifier 10003 can represent a payment price, then the payment price can be the explanation information of the field identifier 10003, and the like, and the corresponding relation can be prestored in a dictionary, so that when the problem of incomplete data transmission of data to be checked exists, the explanation information corresponding to the field identifier which is not transmitted is obtained from the preset dictionary and is output. Specifically, the page may further include a translation button, and in response to a translation operation triggered by the user, the paraphrase information corresponding to the untransmitted field identifier may be output. If the parameter information corresponding to the field identifier 10002 is missing, the output information may be the field identifier 10002, one item of coupon price, missing, etc.
The preset dictionary may further include paraphrasing information of the parameter value, where the paraphrasing information may have a plurality of implementation forms, for example, the parameter value corresponding to the field identifier 10001 is 100, and the paraphrasing information of the parameter value may be 100 yuan. The field identifier and the paraphrasing information of the parameter value included in the preset dictionary may be set according to the actual service mode, which is not particularly limited.
In the embodiment, the interpretation information of the field identification is stored in the preset dictionary, so that a translation function is provided, visual output of the verification result is realized, the problem is convenient for a user to be clear, and the understanding degree of the user on the problem between system interactions is improved.
As shown in fig. 2, a schematic structural diagram of an embodiment of a data processing apparatus according to the present invention may include the following modules:
a receiving module 201, configured to receive data to be verified sent by a target system, where the data to be verified includes a plurality of field identifiers, parameter information corresponding to each of the plurality of field identifiers, and a first data calculation result;
a first determining module 202, configured to determine a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result;
The extracting module 203 is configured to extract corresponding parameter information from the data to be verified according to the field identifier included in the verification formula;
the second determining module 204 is configured to determine a verification result of the data to be verified according to the extracted parameter information, where the verification result reflects an error cause of the first data calculation result.
In this embodiment, by using a verification tool that encapsulates a plurality of verification formulas, after receiving data to be verified sent by a target system, determining a verification formula corresponding to the target system, extracting corresponding parameter information from the data to be verified according to a field identifier included in the verification formula, and verifying the data to be verified according to the parameter information, a verification result that can reflect a problem between system interactions is obtained, automatic positioning of the problem between system interactions is achieved, the problems that in a traditional scheme, manual operation is required to be used, positioning time is long, and a positioning process is complicated are solved, and positioning efficiency is improved.
In some embodiments, the second determination module 204 may include:
the first determining unit is configured to determine that the verification result of the data to be verified is: the data transmission is incomplete.
In some embodiments, the second determination module 204 may include:
the second determining unit is used for determining a third data calculation result according to a verification formula and the extracted parameter information if the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be verified;
and the third determining unit is used for determining that a calculation formula of the target system for acquiring the first data calculation result is wrong if the third data calculation result is different from the first data calculation result.
In some embodiments, parameter values or parameter identifications are included in the parameter information, the parameter identifications being indexes of the parameter values; the extraction module 203 may include:
the extraction unit is used for extracting corresponding parameter identifiers from the data to be checked for target field identifiers of a preset type, which are included in the check formula, wherein the target field identifiers of the preset type refer to field identifiers with a plurality of corresponding parameter values;
and the acquisition unit is used for inquiring the preset dictionary according to the extracted parameter identification and the target field identification so as to acquire parameter values corresponding to the target field identification and the parameter identification from the preset dictionary.
In this embodiment, when the parameter information corresponding to the field identifier is the parameter identifier, the parameter value corresponding to the target field identifier and the parameter identifier is obtained by using the preset dictionary in the verification tool, and the corresponding parameter value is not required to be obtained by manual operation, so that the automatic positioning of the problem between the system interactions is realized, and the positioning efficiency is improved.
In some embodiments, the preset dictionary may include paraphrasing information corresponding to the field identifier and paraphrasing information corresponding to the parameter value; the apparatus may further include:
and the output module is used for outputting the paraphrase information corresponding to the field identification which is not transmitted if the verification result of the data to be verified is that the data transmission is incomplete.
In the embodiment, the interpretation information of the field identification is stored in the preset dictionary, so that a translation function is provided, visual output of the verification result is realized, the problem is convenient for a user to be clear, and the understanding degree of the user on the problem between system interactions is improved.
In some embodiments, the data to be verified may include identification information of the target system; the first determination module 202 may include:
and the fourth determining unit is used for determining the verification formula corresponding to the identification information from the verification tools packaged with the multiple verification formulas according to the corresponding relation between the preset identification information and the verification formulas.
Referring now to FIG. 3, a schematic diagram of an embodiment of a data processing system according to the present invention includes a storage component 301 and a processing component 302;
the storage component 301 stores one or more computer instructions, wherein the one or more computer instructions are for execution by the processing component 302;
The processing component 302 is configured to:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
In this embodiment, by using a verification tool that encapsulates a plurality of verification formulas, after receiving data to be verified sent by a target system, determining a verification formula corresponding to the target system, extracting corresponding parameter information from the data to be verified according to a field identifier included in the verification formula, and verifying the data to be verified according to the parameter information, a verification result that can reflect a problem between system interactions is obtained, automatic positioning of the problem between system interactions is achieved, the problems that in a traditional scheme, manual operation is required to be used, positioning time is long, and a positioning process is complicated are solved, and positioning efficiency is improved.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course by means of hardware. Based on such understanding, the foregoing technical solution may be embodied essentially or in part as a software product, which may be stored in a computer-readable storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the method described in the various embodiments or portions of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A method of data processing, comprising:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
And determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
2. The method according to claim 1, wherein the determining the verification result of the data to be verified according to the extracted parameter information includes:
if the number of the extracted parameter information is smaller than the number of the parameter information contained in the data to be checked, determining that the checking result of the data to be checked is: the data transmission is incomplete.
3. The method according to claim 1, wherein the determining the verification result of the data to be verified according to the extracted parameter information includes:
if the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be verified, determining a third data calculation result according to the verification formula and the extracted parameter information;
if the third data calculation result is different from the first data calculation result, determining that a calculation formula of the target system for acquiring the first data calculation result is wrong.
4. The method according to claim 1, wherein the parameter information includes a parameter value or a parameter identification, the parameter identification being an index of the parameter value;
The extracting corresponding parameter information from the data to be checked according to the field identifier included in the check formula includes:
extracting corresponding parameter identifiers from the data to be checked for target field identifiers of a preset type, which are included in the check formula, wherein the target field identifiers of the preset type refer to field identifiers with a plurality of corresponding parameter values;
and inquiring a preset dictionary according to the extracted parameter identification and the target field identification so as to acquire parameter values corresponding to the target field identification and the parameter identification from the preset dictionary.
5. The method of claim 4, wherein the preset dictionary includes paraphrase information corresponding to field identifications;
the method further comprises the steps of:
and if the verification result of the data to be verified is incomplete data transmission, outputting the paraphrase information corresponding to the untransmitted field identification.
6. The method according to claim 1, wherein the data to be verified includes identification information of the target system;
the determining the verification formula corresponding to the target system from the verification tool packaged with a plurality of verification formulas comprises the following steps:
And determining a verification formula corresponding to the identification information from a verification tool packaged with a plurality of verification formulas according to the corresponding relation between the preset identification information and the verification formulas.
7. A data processing apparatus, comprising:
the receiving module is used for receiving data to be verified, which are sent by the target system, wherein the data to be verified comprise a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
the first determining module is used for determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result;
the extraction module is used for extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and the second determining module is used for determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
8. The apparatus of claim 7, wherein the second determining module comprises:
The first determining unit is configured to determine, if the number of the extracted parameter information is smaller than the number of parameter information included in the data to be verified, that a verification result of the data to be verified is: the data transmission is incomplete.
9. The apparatus of claim 7, wherein the second determining module comprises:
the second determining unit is used for determining a third data calculation result according to the verification formula and the extracted parameter information if the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be verified;
and the third determining unit is used for determining that a calculation formula of the target system for acquiring the first data calculation result is wrong if the third data calculation result is different from the first data calculation result.
10. A data processing system, comprising a storage component and a processing component;
the storage component stores one or more computer instructions, wherein the one or more computer instructions are for the processing component to invoke and execute;
the processing assembly is configured to:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
If the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010949493.9A CN112241328B (en) | 2020-09-10 | 2020-09-10 | Data processing method, device and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010949493.9A CN112241328B (en) | 2020-09-10 | 2020-09-10 | Data processing method, device and system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112241328A CN112241328A (en) | 2021-01-19 |
CN112241328B true CN112241328B (en) | 2024-01-23 |
Family
ID=74170722
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010949493.9A Active CN112241328B (en) | 2020-09-10 | 2020-09-10 | Data processing method, device and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112241328B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116910695B (en) * | 2023-09-11 | 2024-01-05 | 哈尔滨工程大学三亚南海创新发展基地 | Marking method of equipment monitoring result and checking method of equipment monitoring data |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006057171A1 (en) * | 2004-11-29 | 2006-06-01 | Nec Corporation | Signature and verifying method, and signature and verifying device |
CN1812314A (en) * | 2005-01-24 | 2006-08-02 | 中兴通讯股份有限公司 | Data with different rate group frame transmitting method and device |
CN101673217A (en) * | 2009-08-26 | 2010-03-17 | 用友软件股份有限公司 | Method for realizing remote program call and system thereof |
CN102769616A (en) * | 2012-07-04 | 2012-11-07 | 珠海金山网络游戏科技有限公司 | Delay calculation method based on game movement logic client and server synchronization |
CN103246574A (en) * | 2012-02-10 | 2013-08-14 | 阿里巴巴集团控股有限公司 | Verification method and verification device for data accuracy |
CN103595661A (en) * | 2013-11-28 | 2014-02-19 | 杭州华三通信技术有限公司 | Message fragmentation restructuring method and device |
CN104410477A (en) * | 2014-11-27 | 2015-03-11 | 中国航天科工集团第三研究院第八三五七研究所 | Cyclic redundancy check method used for optical fiber channel |
CN104600657A (en) * | 2015-01-30 | 2015-05-06 | 国网北京经济技术研究院 | Power system fault calculation result calibration method |
CN106603707A (en) * | 2016-12-29 | 2017-04-26 | 腾讯科技(深圳)有限公司 | Data processing method, terminal and server |
CN106911428A (en) * | 2017-02-23 | 2017-06-30 | 北京龙鼎源科技股份有限公司 | The transmission method and device of information |
WO2017152618A1 (en) * | 2016-03-09 | 2017-09-14 | 中兴通讯股份有限公司 | Verification method and device, and terminal |
CN110399428A (en) * | 2019-07-26 | 2019-11-01 | 北京奇艺世纪科技有限公司 | A kind of data verification method, device and electronic equipment |
CN110825634A (en) * | 2019-11-04 | 2020-02-21 | 深圳前海微众银行股份有限公司 | Parameter quality checking method, device and equipment and computer readable storage medium |
-
2020
- 2020-09-10 CN CN202010949493.9A patent/CN112241328B/en active Active
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006057171A1 (en) * | 2004-11-29 | 2006-06-01 | Nec Corporation | Signature and verifying method, and signature and verifying device |
CN1812314A (en) * | 2005-01-24 | 2006-08-02 | 中兴通讯股份有限公司 | Data with different rate group frame transmitting method and device |
CN101673217A (en) * | 2009-08-26 | 2010-03-17 | 用友软件股份有限公司 | Method for realizing remote program call and system thereof |
CN103246574A (en) * | 2012-02-10 | 2013-08-14 | 阿里巴巴集团控股有限公司 | Verification method and verification device for data accuracy |
CN102769616A (en) * | 2012-07-04 | 2012-11-07 | 珠海金山网络游戏科技有限公司 | Delay calculation method based on game movement logic client and server synchronization |
CN103595661A (en) * | 2013-11-28 | 2014-02-19 | 杭州华三通信技术有限公司 | Message fragmentation restructuring method and device |
CN104410477A (en) * | 2014-11-27 | 2015-03-11 | 中国航天科工集团第三研究院第八三五七研究所 | Cyclic redundancy check method used for optical fiber channel |
CN104600657A (en) * | 2015-01-30 | 2015-05-06 | 国网北京经济技术研究院 | Power system fault calculation result calibration method |
WO2017152618A1 (en) * | 2016-03-09 | 2017-09-14 | 中兴通讯股份有限公司 | Verification method and device, and terminal |
CN106603707A (en) * | 2016-12-29 | 2017-04-26 | 腾讯科技(深圳)有限公司 | Data processing method, terminal and server |
CN106911428A (en) * | 2017-02-23 | 2017-06-30 | 北京龙鼎源科技股份有限公司 | The transmission method and device of information |
CN110399428A (en) * | 2019-07-26 | 2019-11-01 | 北京奇艺世纪科技有限公司 | A kind of data verification method, device and electronic equipment |
CN110825634A (en) * | 2019-11-04 | 2020-02-21 | 深圳前海微众银行股份有限公司 | Parameter quality checking method, device and equipment and computer readable storage medium |
Non-Patent Citations (3)
Title |
---|
Distance based verification techniques for online signature verification system;Mohit Arora;2015 2nd International Conference on Recent Advances in Engineering & Computational Sciences (RAECS);全文 * |
一种基于数据冗余校验的数字化变电站继电保护装置防误方法;许宗光;文继锋;李彦;顾浩;;电力系统保护与控制(05);全文 * |
面向权威DNS的数据一致性保障机制;王骞等;计算机与现代化;全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN112241328A (en) | 2021-01-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111177005A (en) | Service application testing method, device, server and storage medium | |
CN110287069B (en) | ESB interface automatic test method, server and computer readable storage medium | |
CN109189669A (en) | Test method, electronic device and the readable storage medium storing program for executing of business scenario | |
CN110109818A (en) | Monitoring method, device, terminal and the readable storage medium storing program for executing of back end interface data | |
CN112241328B (en) | Data processing method, device and system | |
CN114116496A (en) | Automatic testing method, device, equipment and medium | |
CN110020550B (en) | Assessment method, device and equipment for verification platform | |
CN109871408B (en) | Multi-type database adaptation method, device, electronic equipment and storage medium | |
CN114840527A (en) | Data processing method, device and computer readable storage medium | |
CN109617755B (en) | Acceptance method and device of access system | |
CN114692589A (en) | Method, device and equipment for generating electronic receipt file and computer storage medium | |
WO2022142040A1 (en) | Billing data verification method and apparatus, computer device and storage medium | |
CN108804889B (en) | Website registration method and device | |
CN107016613B (en) | Data modification method and device | |
CN111427796A (en) | System testing method and device and electronic equipment | |
CN117036115A (en) | Contract data verification method, device and server | |
CN110688823A (en) | XML file verification method and device | |
CN114661671A (en) | File processing method and device, computer readable storage medium and electronic equipment | |
CN113868137A (en) | Method, device and system for processing buried point data and server | |
CN112307088A (en) | Method, device and equipment for inquiring state of process node and storage medium | |
CN112131100A (en) | Metadata-based front-end and back-end verification method and device | |
CN113704131B (en) | Interface function test method, device, storage medium and equipment | |
CN111242592B (en) | Resource transfer detection method, device, server and computer readable storage medium | |
CN111144867B (en) | Method and device for generating region code mapping relation | |
CN114996539B (en) | Information processing method, device and equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |