CN112241328B - Data processing method, device and system - Google Patents

Data processing method, device and system Download PDF

Info

Publication number
CN112241328B
CN112241328B CN202010949493.9A CN202010949493A CN112241328B CN 112241328 B CN112241328 B CN 112241328B CN 202010949493 A CN202010949493 A CN 202010949493A CN 112241328 B CN112241328 B CN 112241328B
Authority
CN
China
Prior art keywords
data
calculation result
parameter information
verification
verified
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010949493.9A
Other languages
Chinese (zh)
Other versions
CN112241328A (en
Inventor
赵伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changsha Youheng Network Technology Co Ltd
Original Assignee
Changsha Youheng Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changsha Youheng Network Technology Co Ltd filed Critical Changsha Youheng Network Technology Co Ltd
Priority to CN202010949493.9A priority Critical patent/CN112241328B/en
Publication of CN112241328A publication Critical patent/CN112241328A/en
Application granted granted Critical
Publication of CN112241328B publication Critical patent/CN112241328B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/543User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/547Remote procedure calls [RPC]; Web services

Abstract

The embodiment of the invention provides a data processing method, a device and a system, and relates to the technical field of computer application. The method comprises the steps of receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result; if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas; extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula; and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result. The technical scheme of the invention improves the problem positioning efficiency.

Description

Data processing method, device and system
Technical Field
The embodiment of the invention relates to the technical field of computer application, in particular to a data processing method, device and system.
Background
With the development of internet technology, the degree of various service modes is more and more complex, and the data transmission involved in the service modes is more and more complex. Taking the order service related to the service industry as an example, order data is typically transmitted between multiple systems, such as billing systems, accounting systems, etc. To ensure the correctness of data transmission, after the current system receives the data transmitted by the previous system, the data is usually checked. When the verification fails, the data with problems in the data needs to be positioned.
In the conventional scheme, locating data with problems among a plurality of systems is completed by manual operation. Longer time and complex process and lower positioning efficiency.
Disclosure of Invention
The embodiment of the invention provides a data processing method, a data processing device and a data processing system, which are used for improving problem positioning efficiency.
A first aspect of the present invention provides a data processing method, comprising:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
Extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
A second aspect of the present invention provides a data processing apparatus comprising:
the receiving module is used for receiving data to be verified, which are sent by the target system, wherein the data to be verified comprise a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
the first determining module is used for determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result;
the extraction module is used for extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and the second determining module is used for determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
A third aspect of the present invention provides a data processing system comprising a storage component and a processing component;
the storage component stores one or more computer instructions, wherein the one or more computer instructions are for the processing component to invoke and execute;
the processing assembly is configured to:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
According to the invention, by utilizing the verification tool packaged with a plurality of verification formulas, after receiving the data to be verified sent by the target system, determining the verification formulas corresponding to the target system, extracting corresponding parameter information from the data to be verified according to the field identifications included in the verification formulas, and verifying the data to be verified according to the parameter information, the verification result capable of reflecting the problem between system interactions is obtained, the problem between system interactions is automatically positioned, the problems of long positioning time and complicated positioning process caused by manual operation in the traditional scheme are solved, and the positioning efficiency is improved.
These and other aspects of the invention will be more readily apparent from the following description of the embodiments.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the conventional solutions, the drawings that are required to be used in the description of the embodiments or the conventional solutions will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to the drawings without any inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of one embodiment of a data processing method provided by the present invention;
FIG. 2 is a schematic diagram of an embodiment of a data processing apparatus according to the present invention;
FIG. 3 is a schematic diagram illustrating one embodiment of a data processing system provided by the present invention.
DETAILED DESCRIPTION OF EMBODIMENT (S) OF INVENTION
In order to enable those skilled in the art to better understand the present invention, the following description will make clear and complete descriptions of the technical solutions according to the embodiments of the present invention with reference to the accompanying drawings.
In some of the flows described in the specification and claims of the present invention and in the foregoing figures, a plurality of operations occurring in a particular order are included, but it should be understood that the operations may be performed out of order or performed in parallel, with the order of operations such as 101, 102, etc., being merely used to distinguish between the various operations, the order of the operations themselves not representing any order of execution. In addition, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first" and "second" herein are used to distinguish different messages, devices, modules, etc., and do not represent a sequence, and are not limited to the "first" and the "second" being different types.
The embodiment of the invention is mainly suitable for the scene of problem positioning during intersystem interaction, which is generally referred to as data transmission between systems. In order to ensure the correctness of the data, the current system usually checks the data after receiving the data transmitted by the previous system adjacent to the current system, and if the data passes the check, the data is correctly transmitted between the two systems; if the verification is not passed, the data is indicated to be transmitted between the two systems in error, and the problem location is needed.
Taking transmission of order data in the service industry as an example, for a certain service order, the order data is typically transmitted in a plurality of systems such as a billing system, a settlement system, an accounting system, and the like. For example, the billing system calculates the data of the order to obtain a bill amount, so that the data of the bill and the calculated bill amount are transmitted to the settlement system, the settlement system calculates the data of the bill to obtain another bill amount, and if the calculated bill amounts are consistent, the check is passed, and the settlement system can transmit the data of the bill and the bill amount to the billing system for processing; if the calculated bill amounts are inconsistent, the verification is not passed, and the problem positioning is needed.
In the conventional scheme, problem positioning between system interactions is completed by manual operation. Longer time and complex process and lower positioning efficiency.
Therefore, in order to improve the positioning efficiency, the inventor proposes the technical scheme of the invention, namely, the data to be checked sent by the target system is received, wherein the data to be checked comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result; if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas; extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula; and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
By using a verification tool packaged with a plurality of verification formulas, after receiving data to be verified sent by a target system, determining the verification formulas corresponding to the target system, extracting corresponding parameter information from the data to be verified according to field identifiers included in the verification formulas, and verifying the data to be verified according to the parameter information, the verification result capable of reflecting the problem between system interactions is obtained, automatic positioning of the problem between the system interactions is achieved, the problems that manual operation is needed in a traditional scheme, positioning time is long and a positioning process is complicated are solved, and positioning efficiency is improved.
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.
As shown in fig. 1, a flowchart of an embodiment of a data processing method according to the present invention may include the following steps:
101: receiving data to be verified sent by a target system; the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result.
In this embodiment, data may be transferred between multiple systems. For example, in a certain service mode, data can be sequentially transmitted among the A system, the B system and the C system according to the service flow. Wherein the target system may refer to any one of a plurality of systems involved in data transmission, such as the a-system. The data sent by the target system to the next system adjacent to the target system can be the data to be checked, for example, the data M is sent by the system A to the system B, and the data M can be the data to be checked.
The data to be verified can comprise a plurality of field identifiers, and the field identifiers can indicate fields for identifying parameter information. Alternatively, there may be a variety of implementations of field identification, such as digital field identification, e.g., 1001, 1002, 1003, etc., or alphabetic field identification, e.g., aa, bb, cc, etc. The implementation manner of the field identifier may be set according to actual situations, which is not particularly limited.
Besides the field identifiers, the data to be verified can also comprise parameter information corresponding to each of the field identifiers. The parameter information may comprise parameter values, i.e. digital parameter information. The parameter value may correspond to a field identification. If the parameter value corresponding to the field identifier 1001 may be 10, the parameter value corresponding to the field identifier 1002 may be 9, the parameter value corresponding to the field identifier 1003 may be 8, etc.
Besides the field identification and the parameter information corresponding to each of the field identifications, the data to be checked can also comprise a first data calculation result. The first data calculation result may be a calculation result obtained by calculating parameter information included in the data to be verified by the target system, and the first data calculation result may be a numerical value and also corresponds to the field identifier. Taking field identifiers 1001, 1002, 1003, 1004, etc. as examples, parameter values corresponding to the field identifiers 1001, 1002, and 1003 may be 10, 9, and 8, respectively, and a value corresponding to the field identifier 1004 may be a first data calculation result, such as 27. At this time, the first data calculation result may be obtained by adding up and calculating by the target system according to the parameter values 10, 9 and 8 included in the data to be verified.
In practical application, the field identifier, parameter information corresponding to each of the plurality of field identifiers, and the first data calculation result included in the target system may be set according to the actual service scenario. Taking an order processing business mode as an example in a service industry scene, the order processing business mode can relate to an order processing system comprising a plurality of systems such as a billing system, a settlement system, an entry system and the like. According to the order processing flow, order data can be sequentially transmitted among the billing system, the settlement system and the posting system. Taking the billing system as a target system for example, the billing system may send order data N to the settlement system, and the order data N may be the data to be checked. The order data N may include a plurality of field identifiers, such as 10001, 10002, 10003, etc., where the field identifier 10001 may represent an original price of the order commodity, the field identifier 10002 may represent a coupon price, the field identifier 10003 may represent a payment price, etc. The method can also comprise parameter information corresponding to each field identifier, for example, the parameter value corresponding to 10001 is 100, the original price of the ordered commodity is 100 yuan, the parameter value corresponding to 10002 is 10, the price of the coupon is 10 yuan, and the like. The method can also comprise a first data calculation result, for example, the first data calculation result corresponding to 10003 is 90, and the real payment price can be 90 yuan.
102: if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas.
In this embodiment, the process of obtaining the second data calculation result locally according to the data to be verified may be that after the target system sends the data to be verified to a next system adjacent to the target system, the next system calculates according to the parameter information included in the data to be verified, so as to obtain the second data calculation result. If the system a sends the data M to be checked to the system B, the system B may calculate to obtain a second data calculation result according to the parameter information included in the data M to be checked. Taking an order processing business mode as an example in a service industry scene, the real payment amount obtained by the billing system according to the order data can be used as a first data calculation result, and the real payment amount obtained by the settlement system according to the order data can be used as a second data calculation result.
In general, in the same service mode, when the B system performs calculation processing according to the parameter information included in the data M to be checked, the processing mode is the same as that of the a system, and the second data calculation result obtained by the B system processing should be the same as the first data calculation result obtained by the a system processing. If the second data calculation result is different from the first data calculation result, it indicates that in the service mode, an error occurs in the transmission process of the data M between the a system and the B system according to the service flow, or an error occurs in the processing process of the data M in the a system, or an error occurs in the processing process of the data M in the B system, and so on.
Therefore, when the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, the data to be checked sent by the target system can be checked. I.e., a verification formula corresponding to the target system may be determined from a verification tool that encapsulates a plurality of verification formulas. The checking formula can be a calculation formula used for data processing in the service mode, has high accuracy, and can be used for calculating parameter information in data to be checked to obtain a calculation result.
In practical application, the complexity of the service mode is higher, the data to be checked can be sourced from different platforms, and a plurality of corresponding target systems can be provided, so that different data processing modes and different check formulas can be provided for different target systems. Therefore, a plurality of verification formulas can be packaged into one verification tool, and when verification is performed, the verification formula corresponding to the target system is determined from the verification tools packaged with the plurality of verification formulas. Specifically, codes of a plurality of check formulas may be consolidated so as to be an integral body, so that a check tool in which a plurality of check formulas are packaged may be obtained.
For convenience of user operation, the verification tool can be applied to web pages. The webpage can also comprise a data input box to be checked and a check button. And responding to the data input operation to be verified triggered by the user in the page, acquiring the data to be verified from the target system, for example, acquiring transmission data from a data transmission log of the target system, and then responding to the verification operation triggered by the user to verify the data to be verified.
Optionally, the data to be verified may include identification information of the target system, and determining, from the verification tool packaged with the plurality of verification formulas, the verification formula corresponding to the target system may include:
and determining a verification formula corresponding to the identification information from a verification tool packaged with a plurality of verification formulas according to the corresponding relation between the preset identification information and the verification formulas.
If a certain service mode relates to three different target systems of an A1 system, an A2 system and an A3 system. The A1, A2, A3 may be identification information of the target system, which may be included in the data to be verified. The data to be checked transmitted by the A1 system can use a check formula 1, the data to be checked transmitted by the A2 system can use a check formula 2, the data to be checked transmitted by the A3 system can use a check formula 3, and the corresponding relation can be preset.
After receiving the data to be verified sent by the target system, according to the identification information, such as A1, of the target system contained in the data to be verified, a verification formula corresponding to the identification information, namely a verification formula 1, can be determined from a verification tool packaged with a plurality of verification formulas, such as the verification formula 1, the verification formula 2, the verification formula 3 and the like, according to the corresponding relation between the preset identification information and the verification formula, namely the corresponding relation between the A1 and the verification formula 1.
103: and extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula.
After the verification formula corresponding to the target system is obtained, corresponding parameter information can be extracted from the data to be verified according to the field identification included in the verification formula. The check formula comprises a field identifier, and the check formula can be represented by the field identifier and an operation symbol. For example, if the field identifiers included in the data to be checked are 1001, 1002, 1003, 1004, and the like, the check formula may be 1001+1002+1003=1004, and the like. The operation mode involved in the check formula can be set according to the actual service mode, which is not particularly limited.
From the check formula, the field identifications included in the check formula for calculation, i.e., the field identifications located on the left of the equation in the check formula, such as 1001, 1002, and 1003, may be determined. Then according to the field identifier, corresponding parameter information can be extracted from the data to be verified, if the parameter value corresponding to the field identifier 1001 is 10, the parameter value corresponding to the field identifier 1002 is 9, and the parameter value corresponding to the field identifier 1003 is 8, the parameter values of 10, 9 and 8 are extracted for calculation.
104: and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
And checking according to the extracted parameter information, and determining a checking result of the data to be checked. If the calculation result obtained by calculating according to the extracted parameter information is inconsistent with the calculation result obtained by calculating by the target system, it can be determined that an error or the like occurs in the processing process of the data to be checked in the target system.
In this embodiment, by using a verification tool that encapsulates a plurality of verification formulas, after receiving data to be verified sent by a target system, determining a verification formula corresponding to the target system, extracting corresponding parameter information from the data to be verified according to a field identifier included in the verification formula, and verifying the data to be verified according to the parameter information, a verification result that can reflect a problem between system interactions is obtained, automatic positioning of the problem between system interactions is achieved, the problems that in a traditional scheme, manual operation is required to be used, positioning time is long, and a positioning process is complicated are solved, and positioning efficiency is improved.
In practical application, the problem between system interactions may have multiple situations, and the verification result of the data to be verified may also have multiple implementation manners according to the extracted parameter information.
As an optional implementation manner, determining the verification result of the data to be verified according to the extracted parameter information may include:
if the number of the extracted parameter information is smaller than the number of the parameter information contained in the data to be checked, determining that the checking result of the data to be checked is: the data transmission is incomplete.
The number of parameter information included in the data to be verified may refer to the number of parameter information corresponding to each of the plurality of field identifiers. Taking the field identifiers 1001, 1002, 1003 and 1004 included in the data to be checked as examples, the check formula is 1001+1002+1003=1004, and the number of parameter information included in the data to be checked may refer to the number of parameter information corresponding to the field identifiers 1001, 1002 and 1003 respectively, that is, 3.
In general, the number of parameter information extracted should be the same as the number of parameter information included in the data to be verified, that is, the number of parameter information extracted should be 3, which is the parameter information corresponding to the field identifier 1001, the parameter information corresponding to the field identifier 1002, and the parameter information corresponding to the field identifier 1003, respectively. If the number of the parameter information is not consistent, the number of the extracted parameter information is smaller than the number of the parameter information contained in the data to be checked, and if the number of the extracted parameter information is 2, the condition that part of the parameter information is missing in the data to be checked can be indicated. If the extracted parameter information corresponding to the field identifier 1001 and the parameter information corresponding to the field identifier 1002 are the parameter information corresponding to the field identifier 1003, the parameter information corresponding to the missing field identifier 1003 in the data to be verified is indicated.
At this time, it may be determined that the verification result of the data to be verified is: the data transmission is incomplete. Further, the verification result may be determined as: the data transmission is incomplete, and the parameter information corresponding to the field identifier 1003 is missing.
By comparing the number of the extracted parameter information with the number of the parameter information contained in the data to be checked by using the checking tool, whether the data to be checked has the problem of incomplete data transmission or not can be determined, the incomplete specific data can be further determined according to a checking formula and field identification, the automatic positioning of the problem between system interactions is realized, and the positioning efficiency is improved.
As another alternative implementation manner, determining the verification result of the data to be verified according to the extracted parameter information may include:
if the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be verified, determining a third data calculation result according to a verification formula and the extracted parameter information;
if the third data calculation result is different from the first data calculation result, determining that a calculation formula of the target system for acquiring the first data calculation result is wrong.
If the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be checked, which indicates that the data to be checked does not have the problem of incomplete data transmission, calculation can be performed according to the checking formula and the extracted parameter information so as to obtain a third data calculation result. Specifically, the field identifier included in the left side of the check formula equation may be combined, and the extracted parameter information is substituted into the check formula to perform calculation, so as to obtain a third data calculation result. If the check formula is 1001+1002+1003=1004, and the extracted parameter information is the parameter value 10 corresponding to the field identifier 1001, the parameter value 9 corresponding to the field identifier 1002, and the parameter value 8 corresponding to the field identifier 1003, respectively, 10, 9, and 8 are substituted into the check formula, and 10+9+8 is calculated, so that a third data calculation result, that is, 27 is obtained.
Comparing the third data calculation result with the first data calculation result, both calculation results should be the same in general case, i.e. both the first data calculation result and the third data calculation result should be 27. If the two calculation results are different, for example, the first calculation result is 11, it may indicate that an error occurs in the processing process of the data to be verified in the target system, for example, an error in a calculation formula used for obtaining the first data calculation result in the target system.
At this time, it may be determined that the calculation formula of the target system for acquiring the first data calculation result is wrong. Further, a calculation formula for acquiring the first data calculation result in the target system may be acquired, for example, the calculation formula in the target system is 1001+1002-1003=1004, resulting in the first data calculation result being 11. Therefore, the prompt information of the calculation formula for acquiring the first data calculation result in the modification target system can be output so as to prompt the user to modify the calculation formula.
The third data calculation result is obtained by calculating the extracted parameter information by using the verification formula in the verification tool, and the third data calculation result is compared with the first data calculation result, so that whether the processing process of the data to be verified in the target system is problematic can be determined, and when the two calculation results are different, the calculation formula of the target system for obtaining the first data calculation result is incorrect, the automatic positioning of the problem between the system interactions is realized, and the positioning efficiency is improved.
In practical applications, besides the possible problem of the processing procedure of the data to be checked in the target system, the processing procedure of the data to be checked in the next system of the target system may also be problematic, so that problems occur between the system interactions. Taking the example that the A system sends the data M to be checked to the B system, when the second data calculation result obtained by the B system according to the data to be checked is different from the first data calculation result obtained by the A system, if the processing process of the data M to be checked in the A system is considered to have a problem, and when the processing process in the B system is not the problem, the third data calculation result obtained by using the checking tool is different from the first data calculation result and the second data calculation result. At this time, it may be determined that there is a problem in the processing procedure of the data M to be verified in the a system, for example, a calculation formula for obtaining the first data calculation result in the a system is wrong. If the third data calculation result obtained by using the verification tool is the same as the first data calculation result and different from the second data calculation result, at this time, it may be determined that the processing procedure of the data M to be verified in the a system is not problematic, and the processing procedure in the B system is problematic, for example, a calculation formula for obtaining the second data calculation result in the B system is incorrect. If the third data calculation result is different from the first data calculation result and the second data calculation result, it can be determined that the processing procedures of the data to be checked in the system a and the system B are both problematic, for example, the calculation formula used for obtaining the first data calculation result in the system a and the calculation formula used for obtaining the second data calculation result in the system B are both incorrect.
The third data calculation result is obtained by checking and calculating the data to be checked sent by the target system by using the checking tool, and the calculation result is compared with the first data calculation result obtained by the target system and the second data calculation result obtained by the target system which is obtained by the next system which is obtained locally, so that the problem of the data to be checked in the target system or the processing process of the next system which is obtained by the target system can be determined, the calculation formula of the target system which is used for obtaining the first data calculation result or the calculation formula of the next system which is used for obtaining the second data calculation result is further determined to be incorrect, the automatic positioning of the problem between the system interactions is realized, and the positioning efficiency is improved.
In practical application, considering that the complexity of the service mode is higher, the data to be transmitted is more, and a plurality of parameter values corresponding to a certain field identifier may be provided. Thus, in some embodiments, parameter values or parameter identifications, which may be indexes of parameter values, may be included in the parameter information. According to the field identifier included in the verification formula, extracting the corresponding parameter information from the data to be verified may include:
extracting corresponding parameter identifiers from data to be checked for target field identifiers of a preset type, wherein the target field identifiers of the preset type refer to field identifiers with a plurality of corresponding parameter values;
And querying a preset dictionary according to the extracted parameter identification and the target field identification so as to acquire parameter values corresponding to the target field identification and the parameter identification from the preset dictionary.
In this embodiment, field identifiers corresponding to a plurality of parameter values may be used as a preset type of field identifier. For the field identifier of the preset type included in the checking formula, the corresponding parameter identifier, such as a, b, c, and the like, can be extracted from the data to be checked.
The parameter identifier may be used as an index of the parameter value and corresponds to the parameter value one by one, for example, the parameter value corresponding to the parameter identifier a may be 5, the parameter value corresponding to the parameter identifier b may be 4, the parameter value corresponding to the parameter identifier c may be 3, and the like. In order to conveniently obtain the parameter values corresponding to the target field identifier and the parameter identifier, the corresponding relation between the field identifier of the preset type and the parameter identifier and the corresponding relation between the parameter identifier and the parameter value can be stored in a dictionary in advance, and the dictionary is preset in a verification tool. The method includes that a call code of the dictionary is set in the verification tool, and then the verification tool can be utilized to call a preset dictionary according to the extracted parameter identification and the target field identification, and parameter values corresponding to the target field identification and the parameter identification are obtained according to the corresponding relation. If a certain field identifier 1005 corresponds to three parameter identifiers a, b and c, and the parameter values corresponding to the three parameter identifiers are 5, 4 and 3, respectively, and the corresponding parameter identifier b is extracted from the data to be checked according to the target field identifier 1005 included in the check formula, then the corresponding parameter value 4 can be obtained from the preset dictionary by using a check tool. In practical application, if the field identifier corresponds to a parameter value, the correspondence between the field identifier and the parameter value may be stored in the dictionary in advance. And will not be described in detail herein.
In this embodiment, when the parameter information corresponding to the field identifier is the parameter identifier, the parameter value corresponding to the target field identifier and the parameter identifier is obtained by using the preset dictionary in the verification tool, and the corresponding parameter value is not required to be obtained by manual operation, so that the automatic positioning of the problem between the system interactions is realized, and the positioning efficiency is improved.
In some embodiments, in addition to the correspondence, paraphrase information corresponding to the field identification may be included in the preset dictionary. The method may further comprise:
if the checking result of the data to be checked is incomplete data transmission, outputting the paraphrase information corresponding to the untransmitted field identification.
Taking an order processing business mode as an example in a service industry scene, for example, a field identifier 10001 can represent the original price of an order commodity, then the original price of the order commodity can be the explanation information of the field identifier 10001, a field identifier 10002 can represent the price of a coupon, then the price of the coupon can be the explanation information of the field identifier 10002, a field identifier 10003 can represent a payment price, then the payment price can be the explanation information of the field identifier 10003, and the like, and the corresponding relation can be prestored in a dictionary, so that when the problem of incomplete data transmission of data to be checked exists, the explanation information corresponding to the field identifier which is not transmitted is obtained from the preset dictionary and is output. Specifically, the page may further include a translation button, and in response to a translation operation triggered by the user, the paraphrase information corresponding to the untransmitted field identifier may be output. If the parameter information corresponding to the field identifier 10002 is missing, the output information may be the field identifier 10002, one item of coupon price, missing, etc.
The preset dictionary may further include paraphrasing information of the parameter value, where the paraphrasing information may have a plurality of implementation forms, for example, the parameter value corresponding to the field identifier 10001 is 100, and the paraphrasing information of the parameter value may be 100 yuan. The field identifier and the paraphrasing information of the parameter value included in the preset dictionary may be set according to the actual service mode, which is not particularly limited.
In the embodiment, the interpretation information of the field identification is stored in the preset dictionary, so that a translation function is provided, visual output of the verification result is realized, the problem is convenient for a user to be clear, and the understanding degree of the user on the problem between system interactions is improved.
As shown in fig. 2, a schematic structural diagram of an embodiment of a data processing apparatus according to the present invention may include the following modules:
a receiving module 201, configured to receive data to be verified sent by a target system, where the data to be verified includes a plurality of field identifiers, parameter information corresponding to each of the plurality of field identifiers, and a first data calculation result;
a first determining module 202, configured to determine a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result;
The extracting module 203 is configured to extract corresponding parameter information from the data to be verified according to the field identifier included in the verification formula;
the second determining module 204 is configured to determine a verification result of the data to be verified according to the extracted parameter information, where the verification result reflects an error cause of the first data calculation result.
In this embodiment, by using a verification tool that encapsulates a plurality of verification formulas, after receiving data to be verified sent by a target system, determining a verification formula corresponding to the target system, extracting corresponding parameter information from the data to be verified according to a field identifier included in the verification formula, and verifying the data to be verified according to the parameter information, a verification result that can reflect a problem between system interactions is obtained, automatic positioning of the problem between system interactions is achieved, the problems that in a traditional scheme, manual operation is required to be used, positioning time is long, and a positioning process is complicated are solved, and positioning efficiency is improved.
In some embodiments, the second determination module 204 may include:
the first determining unit is configured to determine that the verification result of the data to be verified is: the data transmission is incomplete.
In some embodiments, the second determination module 204 may include:
the second determining unit is used for determining a third data calculation result according to a verification formula and the extracted parameter information if the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be verified;
and the third determining unit is used for determining that a calculation formula of the target system for acquiring the first data calculation result is wrong if the third data calculation result is different from the first data calculation result.
In some embodiments, parameter values or parameter identifications are included in the parameter information, the parameter identifications being indexes of the parameter values; the extraction module 203 may include:
the extraction unit is used for extracting corresponding parameter identifiers from the data to be checked for target field identifiers of a preset type, which are included in the check formula, wherein the target field identifiers of the preset type refer to field identifiers with a plurality of corresponding parameter values;
and the acquisition unit is used for inquiring the preset dictionary according to the extracted parameter identification and the target field identification so as to acquire parameter values corresponding to the target field identification and the parameter identification from the preset dictionary.
In this embodiment, when the parameter information corresponding to the field identifier is the parameter identifier, the parameter value corresponding to the target field identifier and the parameter identifier is obtained by using the preset dictionary in the verification tool, and the corresponding parameter value is not required to be obtained by manual operation, so that the automatic positioning of the problem between the system interactions is realized, and the positioning efficiency is improved.
In some embodiments, the preset dictionary may include paraphrasing information corresponding to the field identifier and paraphrasing information corresponding to the parameter value; the apparatus may further include:
and the output module is used for outputting the paraphrase information corresponding to the field identification which is not transmitted if the verification result of the data to be verified is that the data transmission is incomplete.
In the embodiment, the interpretation information of the field identification is stored in the preset dictionary, so that a translation function is provided, visual output of the verification result is realized, the problem is convenient for a user to be clear, and the understanding degree of the user on the problem between system interactions is improved.
In some embodiments, the data to be verified may include identification information of the target system; the first determination module 202 may include:
and the fourth determining unit is used for determining the verification formula corresponding to the identification information from the verification tools packaged with the multiple verification formulas according to the corresponding relation between the preset identification information and the verification formulas.
Referring now to FIG. 3, a schematic diagram of an embodiment of a data processing system according to the present invention includes a storage component 301 and a processing component 302;
the storage component 301 stores one or more computer instructions, wherein the one or more computer instructions are for execution by the processing component 302;
The processing component 302 is configured to:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
In this embodiment, by using a verification tool that encapsulates a plurality of verification formulas, after receiving data to be verified sent by a target system, determining a verification formula corresponding to the target system, extracting corresponding parameter information from the data to be verified according to a field identifier included in the verification formula, and verifying the data to be verified according to the parameter information, a verification result that can reflect a problem between system interactions is obtained, automatic positioning of the problem between system interactions is achieved, the problems that in a traditional scheme, manual operation is required to be used, positioning time is long, and a positioning process is complicated are solved, and positioning efficiency is improved.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course by means of hardware. Based on such understanding, the foregoing technical solution may be embodied essentially or in part as a software product, which may be stored in a computer-readable storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the method described in the various embodiments or portions of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A method of data processing, comprising:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
if the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
And determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
2. The method according to claim 1, wherein the determining the verification result of the data to be verified according to the extracted parameter information includes:
if the number of the extracted parameter information is smaller than the number of the parameter information contained in the data to be checked, determining that the checking result of the data to be checked is: the data transmission is incomplete.
3. The method according to claim 1, wherein the determining the verification result of the data to be verified according to the extracted parameter information includes:
if the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be verified, determining a third data calculation result according to the verification formula and the extracted parameter information;
if the third data calculation result is different from the first data calculation result, determining that a calculation formula of the target system for acquiring the first data calculation result is wrong.
4. The method according to claim 1, wherein the parameter information includes a parameter value or a parameter identification, the parameter identification being an index of the parameter value;
The extracting corresponding parameter information from the data to be checked according to the field identifier included in the check formula includes:
extracting corresponding parameter identifiers from the data to be checked for target field identifiers of a preset type, which are included in the check formula, wherein the target field identifiers of the preset type refer to field identifiers with a plurality of corresponding parameter values;
and inquiring a preset dictionary according to the extracted parameter identification and the target field identification so as to acquire parameter values corresponding to the target field identification and the parameter identification from the preset dictionary.
5. The method of claim 4, wherein the preset dictionary includes paraphrase information corresponding to field identifications;
the method further comprises the steps of:
and if the verification result of the data to be verified is incomplete data transmission, outputting the paraphrase information corresponding to the untransmitted field identification.
6. The method according to claim 1, wherein the data to be verified includes identification information of the target system;
the determining the verification formula corresponding to the target system from the verification tool packaged with a plurality of verification formulas comprises the following steps:
And determining a verification formula corresponding to the identification information from a verification tool packaged with a plurality of verification formulas according to the corresponding relation between the preset identification information and the verification formulas.
7. A data processing apparatus, comprising:
the receiving module is used for receiving data to be verified, which are sent by the target system, wherein the data to be verified comprise a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
the first determining module is used for determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result;
the extraction module is used for extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and the second determining module is used for determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
8. The apparatus of claim 7, wherein the second determining module comprises:
The first determining unit is configured to determine, if the number of the extracted parameter information is smaller than the number of parameter information included in the data to be verified, that a verification result of the data to be verified is: the data transmission is incomplete.
9. The apparatus of claim 7, wherein the second determining module comprises:
the second determining unit is used for determining a third data calculation result according to the verification formula and the extracted parameter information if the number of the extracted parameter information is equal to the number of the parameter information contained in the data to be verified;
and the third determining unit is used for determining that a calculation formula of the target system for acquiring the first data calculation result is wrong if the third data calculation result is different from the first data calculation result.
10. A data processing system, comprising a storage component and a processing component;
the storage component stores one or more computer instructions, wherein the one or more computer instructions are for the processing component to invoke and execute;
the processing assembly is configured to:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifiers, parameter information corresponding to the field identifiers and a first data calculation result;
If the second data calculation result obtained locally according to the data to be checked is different from the first data calculation result, determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas;
extracting corresponding parameter information from the data to be checked according to the field identification included in the check formula;
and determining a verification result of the data to be verified according to the extracted parameter information, wherein the verification result reflects the error reason of the first data calculation result.
CN202010949493.9A 2020-09-10 2020-09-10 Data processing method, device and system Active CN112241328B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010949493.9A CN112241328B (en) 2020-09-10 2020-09-10 Data processing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010949493.9A CN112241328B (en) 2020-09-10 2020-09-10 Data processing method, device and system

Publications (2)

Publication Number Publication Date
CN112241328A CN112241328A (en) 2021-01-19
CN112241328B true CN112241328B (en) 2024-01-23

Family

ID=74170722

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010949493.9A Active CN112241328B (en) 2020-09-10 2020-09-10 Data processing method, device and system

Country Status (1)

Country Link
CN (1) CN112241328B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116910695B (en) * 2023-09-11 2024-01-05 哈尔滨工程大学三亚南海创新发展基地 Marking method of equipment monitoring result and checking method of equipment monitoring data

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006057171A1 (en) * 2004-11-29 2006-06-01 Nec Corporation Signature and verifying method, and signature and verifying device
CN1812314A (en) * 2005-01-24 2006-08-02 中兴通讯股份有限公司 Data with different rate group frame transmitting method and device
CN101673217A (en) * 2009-08-26 2010-03-17 用友软件股份有限公司 Method for realizing remote program call and system thereof
CN102769616A (en) * 2012-07-04 2012-11-07 珠海金山网络游戏科技有限公司 Delay calculation method based on game movement logic client and server synchronization
CN103246574A (en) * 2012-02-10 2013-08-14 阿里巴巴集团控股有限公司 Verification method and verification device for data accuracy
CN103595661A (en) * 2013-11-28 2014-02-19 杭州华三通信技术有限公司 Message fragmentation restructuring method and device
CN104410477A (en) * 2014-11-27 2015-03-11 中国航天科工集团第三研究院第八三五七研究所 Cyclic redundancy check method used for optical fiber channel
CN104600657A (en) * 2015-01-30 2015-05-06 国网北京经济技术研究院 Power system fault calculation result calibration method
CN106603707A (en) * 2016-12-29 2017-04-26 腾讯科技(深圳)有限公司 Data processing method, terminal and server
CN106911428A (en) * 2017-02-23 2017-06-30 北京龙鼎源科技股份有限公司 The transmission method and device of information
WO2017152618A1 (en) * 2016-03-09 2017-09-14 中兴通讯股份有限公司 Verification method and device, and terminal
CN110399428A (en) * 2019-07-26 2019-11-01 北京奇艺世纪科技有限公司 A kind of data verification method, device and electronic equipment
CN110825634A (en) * 2019-11-04 2020-02-21 深圳前海微众银行股份有限公司 Parameter quality checking method, device and equipment and computer readable storage medium

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006057171A1 (en) * 2004-11-29 2006-06-01 Nec Corporation Signature and verifying method, and signature and verifying device
CN1812314A (en) * 2005-01-24 2006-08-02 中兴通讯股份有限公司 Data with different rate group frame transmitting method and device
CN101673217A (en) * 2009-08-26 2010-03-17 用友软件股份有限公司 Method for realizing remote program call and system thereof
CN103246574A (en) * 2012-02-10 2013-08-14 阿里巴巴集团控股有限公司 Verification method and verification device for data accuracy
CN102769616A (en) * 2012-07-04 2012-11-07 珠海金山网络游戏科技有限公司 Delay calculation method based on game movement logic client and server synchronization
CN103595661A (en) * 2013-11-28 2014-02-19 杭州华三通信技术有限公司 Message fragmentation restructuring method and device
CN104410477A (en) * 2014-11-27 2015-03-11 中国航天科工集团第三研究院第八三五七研究所 Cyclic redundancy check method used for optical fiber channel
CN104600657A (en) * 2015-01-30 2015-05-06 国网北京经济技术研究院 Power system fault calculation result calibration method
WO2017152618A1 (en) * 2016-03-09 2017-09-14 中兴通讯股份有限公司 Verification method and device, and terminal
CN106603707A (en) * 2016-12-29 2017-04-26 腾讯科技(深圳)有限公司 Data processing method, terminal and server
CN106911428A (en) * 2017-02-23 2017-06-30 北京龙鼎源科技股份有限公司 The transmission method and device of information
CN110399428A (en) * 2019-07-26 2019-11-01 北京奇艺世纪科技有限公司 A kind of data verification method, device and electronic equipment
CN110825634A (en) * 2019-11-04 2020-02-21 深圳前海微众银行股份有限公司 Parameter quality checking method, device and equipment and computer readable storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Distance based verification techniques for online signature verification system;Mohit Arora;2015 2nd International Conference on Recent Advances in Engineering & Computational Sciences (RAECS);全文 *
一种基于数据冗余校验的数字化变电站继电保护装置防误方法;许宗光;文继锋;李彦;顾浩;;电力系统保护与控制(05);全文 *
面向权威DNS的数据一致性保障机制;王骞等;计算机与现代化;全文 *

Also Published As

Publication number Publication date
CN112241328A (en) 2021-01-19

Similar Documents

Publication Publication Date Title
CN111177005A (en) Service application testing method, device, server and storage medium
CN110287069B (en) ESB interface automatic test method, server and computer readable storage medium
CN109189669A (en) Test method, electronic device and the readable storage medium storing program for executing of business scenario
CN110109818A (en) Monitoring method, device, terminal and the readable storage medium storing program for executing of back end interface data
CN112241328B (en) Data processing method, device and system
CN114116496A (en) Automatic testing method, device, equipment and medium
CN110020550B (en) Assessment method, device and equipment for verification platform
CN109871408B (en) Multi-type database adaptation method, device, electronic equipment and storage medium
CN114840527A (en) Data processing method, device and computer readable storage medium
CN109617755B (en) Acceptance method and device of access system
CN114692589A (en) Method, device and equipment for generating electronic receipt file and computer storage medium
WO2022142040A1 (en) Billing data verification method and apparatus, computer device and storage medium
CN108804889B (en) Website registration method and device
CN107016613B (en) Data modification method and device
CN111427796A (en) System testing method and device and electronic equipment
CN117036115A (en) Contract data verification method, device and server
CN110688823A (en) XML file verification method and device
CN114661671A (en) File processing method and device, computer readable storage medium and electronic equipment
CN113868137A (en) Method, device and system for processing buried point data and server
CN112307088A (en) Method, device and equipment for inquiring state of process node and storage medium
CN112131100A (en) Metadata-based front-end and back-end verification method and device
CN113704131B (en) Interface function test method, device, storage medium and equipment
CN111242592B (en) Resource transfer detection method, device, server and computer readable storage medium
CN111144867B (en) Method and device for generating region code mapping relation
CN114996539B (en) Information processing method, device and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant