CN112241328A - Data processing method, device and system - Google Patents
Data processing method, device and system Download PDFInfo
- Publication number
- CN112241328A CN112241328A CN202010949493.9A CN202010949493A CN112241328A CN 112241328 A CN112241328 A CN 112241328A CN 202010949493 A CN202010949493 A CN 202010949493A CN 112241328 A CN112241328 A CN 112241328A
- Authority
- CN
- China
- Prior art keywords
- data
- verified
- parameter information
- calculation result
- verification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 10
- 238000004364 calculation method Methods 0.000 claims abstract description 153
- 238000012795 verification Methods 0.000 claims abstract description 131
- 238000012545 processing Methods 0.000 claims abstract description 45
- 238000000034 method Methods 0.000 claims description 32
- 230000005540 biological transmission Effects 0.000 claims description 15
- 238000012546 transfer Methods 0.000 claims description 5
- 238000000605 extraction Methods 0.000 claims description 4
- 238000004883 computer application Methods 0.000 abstract description 2
- 230000007474 system interaction Effects 0.000 description 20
- 230000008569 process Effects 0.000 description 18
- 238000010586 diagram Methods 0.000 description 4
- 238000013519 translation Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/543—User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The embodiment of the invention provides a data processing method, a data processing device and a data processing system, and relates to the technical field of computer application. Receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifications, parameter information corresponding to the field identifications and a first data calculation result; if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result, determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas; extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula; and determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data. The technical scheme of the invention improves the problem positioning efficiency.
Description
Technical Field
The embodiment of the invention relates to the technical field of computer application, in particular to a data processing method, device and system.
Background
With the development of internet technology, the degree of various service modes is more and more complex, and the data transmission involved in the service modes is more and more complex. Taking the order business involved in the service industry as an example, the order data is usually transmitted between a plurality of systems, such as a billing system, a settlement system, and the like. To ensure the correctness of data transmission, the data transmitted by the previous system is usually checked after the current system receives the data. When the verification fails, the data with problems in the data needs to be located.
In the conventional scheme, the positioning of data with problems among a plurality of systems is completed by manual operation. The time is long, the process is complicated, and the positioning efficiency is low.
Disclosure of Invention
The embodiment of the invention provides a data processing method, a data processing device and a data processing system, which are used for improving problem positioning efficiency.
A first aspect of the present invention provides a data processing method, including:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifications, parameter information corresponding to the field identifications and a first data calculation result;
if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result, determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas;
extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula;
and determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data.
A second aspect of the present invention provides a data processing apparatus comprising:
the system comprises a receiving module, a verification module and a verification module, wherein the receiving module is used for receiving data to be verified sent by a target system, and the data to be verified comprises a plurality of field identifications, parameter information corresponding to the field identifications and a first data calculation result;
the first determining module is used for determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas if a second data calculation result obtained locally according to the data to be checked is different from the first data calculation result;
the extraction module is used for extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula;
and the second determining module is used for determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data.
A third aspect of the invention provides a data processing system comprising a storage component and a processing component;
the storage component stores one or more computer instructions, wherein the one or more computer instructions are for the processing component to invoke execution;
the processing component is to:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifications, parameter information corresponding to the field identifications and a first data calculation result;
if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result, determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas;
extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula;
and determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data.
According to the method and the device, through the utilization of the verification tool packaged with the multiple verification formulas, after the data to be verified sent by the target system is received, the verification formula corresponding to the target system is determined, the corresponding parameter information is extracted from the data to be verified according to the field identification included in the verification formula, then the data to be verified is verified according to the parameter information, so that the verification result capable of reflecting the problem between system interactions is obtained, the problem between the system interactions is automatically positioned, the problems that the positioning time is long and the positioning process is complicated due to the fact that manual operation is needed in the traditional scheme are solved, and the positioning efficiency is improved.
These and other aspects of the invention are apparent from and will be elucidated with reference to the embodiments described hereinafter.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments or the conventional solutions of the present invention, the drawings used in the description of the embodiments or the conventional solutions will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart of one embodiment of a data processing method provided by the present invention;
FIG. 2 is a schematic diagram of a data processing apparatus according to an embodiment of the present invention;
FIG. 3 is a block diagram of an embodiment of a data processing system according to the invention.
DETAILED DESCRIPTION OF EMBODIMENT (S) OF INVENTION
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention.
In some of the flows described in the present specification and claims and in the above figures, a number of operations are included that occur in a particular order, but it should be clearly understood that these operations may be performed out of order or in parallel as they occur herein, with the order of the operations being indicated as 101, 102, etc. merely to distinguish between the various operations, and the order of the operations by themselves does not represent any order of performance. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.
The embodiment of the invention is mainly suitable for the scene of problem location during the interaction between systems, and the interaction between the systems generally refers to data transmission between the systems. In order to ensure the correctness of the data, the current system usually checks the data after receiving the data transmitted by the previous system adjacent to the current system, and if the data passes the check, the data is correctly transmitted between the two systems; if the verification is not passed, the data is transmitted between the two systems in error, and problem location is required.
Taking the transmission of order data in the service industry as an example, for a certain service order, the order data is usually transmitted in a plurality of systems such as a billing system, a settlement system, and an accounting system. For example, the billing system may perform calculation processing on the data of the order to obtain a billing amount, so as to transmit the data of the bill and the calculated billing amount to the settlement system, and the settlement system performs calculation processing on the data of the bill to obtain another billing amount, if the two calculated billing amounts are consistent, the verification is passed, and the settlement system may transmit the data of the bill and the billing amount to the posting system for processing; if the bill amounts calculated by the two methods are inconsistent, the verification is not passed, and problem positioning is required.
In the traditional scheme, problem positioning between system interaction is completed by manual operation. The time is long, the process is complicated, and the positioning efficiency is low.
Therefore, in order to improve the positioning efficiency, the inventor proposes a technical solution of the present invention, that is, receiving data to be checked sent by a target system, where the data to be checked includes a plurality of field identifiers, parameter information corresponding to each of the plurality of field identifiers, and a first data calculation result; if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result, determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas; extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula; and determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data.
By utilizing the verification tool packaged with a plurality of verification formulas, after data to be verified sent by a target system is received, the verification formula corresponding to the target system is determined, corresponding parameter information is extracted from the data to be verified according to field identification included in the verification formula, and then the data to be verified is verified according to the parameter information, so that a verification result capable of reflecting the problem between system interaction is obtained, automatic positioning of the problem between system interaction is realized, the problems that manual operation is needed in the traditional scheme, the positioning time is long and the positioning process is complicated are solved, and the positioning efficiency is improved.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, which is a flowchart of an embodiment of a data processing method provided by the present invention, the method may include the following steps:
101: receiving data to be checked sent by a target system; the data to be verified comprises a plurality of field identifications, parameter information corresponding to the field identifications and a first data calculation result.
In this embodiment, data may be transmitted between a plurality of systems. For example, in a certain service mode, data can be transmitted among the system a, the system B and the system C in sequence according to a service flow. Wherein the target system may refer to any of a plurality of systems involved in the data transmission, such as the a-system. The data sent by the target system to the next system adjacent to the target system can be the data to be verified, and if the system a sends the data M to the system B, the data M can be the data to be verified.
The data to be checked may include a plurality of field identifications, and the field identification may refer to a field that identifies parameter information. Alternatively, the field identification may have multiple implementations, such as a numeric field identification, e.g., 1001, 1002, 1003, etc., or an alphabetic field identification, e.g., aa, bb, cc, etc. The implementation manner of the field identifier may be set according to an actual situation, which is not specifically limited.
Besides the field identification, the data to be verified may also include parameter information corresponding to each of the plurality of field identifications. The parameter information may include parameter values, i.e., digital type parameter information. The parameter value may correspond to a field identification. If the parameter value corresponding to the field id 1001 may be 10, the parameter value corresponding to the field id 1002 may be 9, the parameter value corresponding to the field id 1003 may be 8, etc.
Besides the parameter information corresponding to the field identifier and the field identifiers, the data to be verified can also comprise a first data calculation result. The first data calculation result may be a calculation result obtained by calculating parameter information included in the data to be verified by the target system, and the first data calculation result may be a numerical value and also corresponds to the field identifier. Taking the field ids of 1001, 1002, 1003, 1004, etc. as an example, the parameter values corresponding to the field ids 1001, 1002, and 1003 may be 10, 9, and 8, respectively, and the value corresponding to the field id 1004 may be the first data calculation result, such as 27. At this time, the first data calculation result may be obtained by the target system performing a summation calculation based on the parameter values 10, 9, and 8 included in the data to be verified.
In practical application, the field identifier included in the target system, the parameter information corresponding to each of the plurality of field identifiers, and the first data calculation result may be set according to an actual service scenario. Taking the service industry scenario, the order processing business model is taken as an example, and may relate to an order processing system including a plurality of systems such as a billing system, a settlement system, an entry system, and the like. According to the order processing flow, order data can be transmitted among the bill system, the settlement system and the posting system in sequence. Taking the billing system as the target system as an example, the billing system may send the order data N to the settlement system, and the order data N may be the data to be verified. The order data N may include a field identifier, such as a plurality of field identifiers 10001, 10002, 10003, etc., where the field identifier 10001 may represent an original price of an order item, the field identifier 10002 may represent a coupon price, and the field identifier 10003 may represent a payment price, etc. The method may further include a plurality of fields to identify respective corresponding parameter information, for example, 10001 corresponds to a parameter value of 100, which may indicate that the original price of the ordered item is 100 yuan, 10002 corresponds to a parameter value of 10, which may indicate that the price of the coupon is 10 yuan, and so on. A first data calculation result may also be included, such as 10003 corresponding to a first data calculation result of 90, which may indicate that the real payment price is 90 yuan, etc.
102: and if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result, determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas.
In this embodiment, the process of locally obtaining the second data calculation result according to the data to be verified may be that, after the target system sends the data to be verified to the next system adjacent to the target system, the next system performs calculation according to the parameter information included in the data to be verified, so as to obtain the second data calculation result. If the system a sends the data M to be verified to the system B, the system B may calculate to obtain a second data calculation result according to the parameter information included in the data M to be verified. Taking the service industry scene and the order processing business mode as an example, the real payment amount obtained by the billing system according to the order data can be used as a first data calculation result, and the real payment amount obtained by the settlement system according to the order data can be used as a second data calculation result.
In general, in the same service mode, when the system B performs calculation processing according to the parameter information included in the data M to be verified, the processing method is the same as that of the system a, and the second data calculation result processed by the system B should be the same as the first data calculation result processed by the system a. If the second data calculation result is different from the first data calculation result, it indicates that, in the service mode, the data M has an error in the transmission process between the system a and the system B according to the service flow, or the data M has an error in the processing process in the system a, or the data M has an error in the processing process in the system B, and the like.
Therefore, when the second data calculation result obtained locally according to the data to be verified is different from the first data calculation result, the data to be verified sent by the target system can be verified. That is, the check formula corresponding to the target system may be determined from the check tool in which a plurality of check formulas are packaged. The check formula may be a calculation formula used for data processing in the service mode, and the check formula has high accuracy and may be used to calculate parameter information in the data to be checked to obtain a calculation result.
In practical application, the complexity of the service mode is high, the data to be verified can be from different platforms, and there may be a plurality of corresponding target systems, so that there may be different data processing modes and different verification formulas for different target systems. Therefore, a plurality of verification formulas can be packaged into one verification tool, and during verification, the verification formula corresponding to the target system is determined from the verification tools packaged with the plurality of verification formulas. Specifically, the codes of the plurality of check formulas may be arranged to be integrated, so that the check tool encapsulating the plurality of check formulas may be obtained.
For the convenience of user operation, the verification tool can be applied to a webpage. The webpage page also comprises a data input box to be verified and a verification button. In response to a data input operation to be verified triggered by a user in a page, data to be verified may be obtained from a target system, for example, transmission data may be obtained from a data transmission log of the target system, and then the data to be verified may be verified in response to a verification operation triggered by the user.
Optionally, the to-be-verified data may include identification information of the target system, and determining the verification formula corresponding to the target system from the verification tool in which a plurality of verification formulas are encapsulated may include:
and determining a check formula corresponding to the identification information from the check tools packaged with the plurality of check formulas according to the corresponding relation between the preset identification information and the check formulas.
If a certain traffic pattern involves three different target systems, namely, a1 system, a2 system and A3 system. A1, a2, A3 may be the identification information of the target system, which may be included in the data to be checked. The data to be verified transmitted by the a1 system may use the verification formula 1, the data to be verified transmitted by the a2 system may use the verification formula 2, the data to be verified transmitted by the A3 system may use the verification formula 3, and the above corresponding relationship may be preset.
After receiving data to be verified sent by a target system, according to identification information of the target system, such as a1, included in the data to be verified, a verification formula corresponding to the identification information, i.e., verification formula 1, may be determined from verification tools in which multiple verification formulas, such as verification formula 1, verification formula 2, and verification formula 3, are packaged, according to a preset corresponding relationship between the identification information and the verification formula, i.e., a corresponding relationship between a1 and the verification formula 1.
103: and extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula.
After the check formula corresponding to the target system is obtained, corresponding parameter information can be extracted from the data to be checked according to the field identification included in the check formula. The check formula includes a field identifier, and the check formula can be represented by the field identifier and an operation symbol. For example, if the field identifiers included in the data to be checked are 1001, 1002, 1003, 1004, and the like, the check formula may be 1001+1002+1003 ═ 1004, and the like. The operation mode related to the check formula may be set according to the actual service mode, which is not specifically limited.
According to the check formula, the field identification included in the check formula for calculation, that is, the field identification located on the left side of the equation in the check formula, such as 1001, 1002, and 1003, can be determined. According to the field identifier, corresponding parameter information can be extracted from the data to be verified, and if the parameter value corresponding to the field identifier 1001 is 10, the parameter value corresponding to the field identifier 1002 is 9, and the parameter value corresponding to the field identifier 1003 is 8, the parameter values of 10, 9, and 8 are extracted for calculation.
104: and determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data.
And verifying according to the extracted parameter information, so that a verification result of the data to be verified can be determined. For example, if the calculation result obtained by calculation according to the extracted parameter information is inconsistent with the calculation result obtained by calculation of the target system, it may be determined that an error occurs in the processing process of the data to be verified in the target system.
In the embodiment, by using the verification tool packaged with a plurality of verification formulas, after receiving the data to be verified sent by the target system, the verification formula corresponding to the target system is determined, corresponding parameter information is extracted from the data to be verified according to the field identification included in the verification formula, and then the data to be verified is verified according to the parameter information, so that a verification result capable of reflecting the problem between system interactions is obtained, automatic positioning of the problem between system interactions is realized, the problems that manual operation is needed in the conventional scheme, the positioning time is long and the positioning process is complicated are solved, and the positioning efficiency is improved.
In practical application, there may be various problems between system interactions, and there may also be various implementation manners for determining the verification result of the data to be verified according to the extracted parameter information.
As an optional implementation manner, determining a verification result of the data to be verified according to the extracted parameter information may include:
if the extracted parameter information quantity is less than the parameter information quantity contained in the data to be verified, determining that the verification result of the data to be verified is as follows: the data transfer is incomplete.
The number of the parameter information included in the data to be checked may refer to the number of the parameter information corresponding to each of the plurality of field identifiers. Taking as an example that the field identifiers included in the data to be verified are 1001, 1002, 1003, and 1004, and the verification formula is 1001+1002+1003 — 1004, the parameter information amount included in the data to be verified may refer to the amount of the parameter information corresponding to each of the field identifiers 1001, 1002, and 1003, that is, 3.
In general, the number of extracted parameter information should be the same as the number of parameter information included in the data to be verified, that is, the number of extracted parameter information should also be 3, and the extracted parameter information is the parameter information corresponding to the field identifier 1001, the parameter information corresponding to the field identifier 1002, and the parameter information corresponding to the field identifier 1003, respectively. If the two numbers are not consistent, the number of the extracted parameter information is smaller than the number of the parameter information contained in the data to be verified, and if the number of the extracted parameter information is 2, it can be shown that part of the parameter information is missing in the data to be verified. If the extracted parameter information is the parameter information corresponding to the field identifier 1001 and the parameter information corresponding to the field identifier 1002, but the parameter information corresponding to the field identifier 1003 is not available, it indicates that the parameter information corresponding to the field identifier 1003 is missing in the data to be verified.
At this time, it may be determined that the verification result of the data to be verified is: the data transfer is incomplete. Further, the verification result may be determined as: the data transmission is incomplete, and the parameter information corresponding to the field identifier 1003 is missing.
By comparing the extracted parameter information quantity with the parameter information quantity contained in the data to be verified by using the verification tool, whether the data to be verified has the problem of incomplete data transmission can be determined, incomplete specific data can be further determined according to a verification formula and field marks, automatic positioning of problems among system interaction is realized, and positioning efficiency is improved.
As another optional implementation manner, determining a verification result of the data to be verified according to the extracted parameter information may include:
if the quantity of the extracted parameter information is equal to the quantity of the parameter information contained in the data to be verified, determining a third data calculation result according to the verification formula and the extracted parameter information;
and if the third data calculation result is different from the first data calculation result, determining that the calculation formula used by the target system for obtaining the first data calculation result is wrong.
If the extracted quantity of the parameter information is equal to the quantity of the parameter information contained in the data to be verified, which indicates that the data to be verified does not have the problem of incomplete data transmission, calculation can be performed according to the verification formula and the extracted parameter information to obtain a third data calculation result. Specifically, the extracted parameter information may be substituted into the check formula in combination with the field identifier included on the left side of the check formula equation, and calculation may be performed to obtain the third data calculation result. If the check formula is 1001+1002+1003 ═ 1004, and the extracted parameter information is the parameter value 10 corresponding to the field identifier 1001, the parameter value 9 corresponding to the field identifier 1002, and the parameter value 8 corresponding to the field identifier 1003, respectively, then 10, 9, and 8 are substituted into the check formula to calculate 10+9+8, thereby obtaining the third data calculation result, that is, 27.
Comparing the third data calculation with the first data calculation, normally both calculations should be the same, i.e. both the first data calculation and the third data calculation should be 27. If the two calculation results are different, for example, the first calculation result is 11, it may indicate that an error occurs in the processing process of the data to be verified in the target system, for example, an error in a calculation formula used for obtaining the first calculation result of the data in the target system.
At this time, it may be determined that the calculation formula used by the target system to obtain the first data calculation result is incorrect. Further, a calculation formula for obtaining the first data calculation result in the target system may be obtained, for example, the calculation formula is 1001+ 1002-. Therefore, prompt information for modifying the calculation formula used for acquiring the first data calculation result in the target system can be output, so that a user is prompted to modify the calculation formula.
The extracted parameter information is calculated by using the check formula in the check tool to obtain a third data calculation result, and the third data calculation result is compared with the first data calculation result, so that whether the processing process of the data to be checked in the target system has a problem can be determined, and the calculation formula of the target system for obtaining the first data calculation result is determined to be wrong when the two calculation results are different, so that the automatic positioning of the problem between system interaction is realized, and the positioning efficiency is improved.
In practical applications, in addition to the problem of the processing process of the data to be verified in the target system, the processing process of the data to be verified in the latter system of the target system may also have a problem, thereby causing a problem between system interactions. Taking the example that the system a sends the data M to be verified to the system B, if the second data calculation result obtained by the system B according to the data to be verified is different from the first data calculation result obtained by the system a, if it is considered that there is a problem in the processing process of the data M to be verified in the system a, and there is no problem in the processing process of the system B, the third data calculation result obtained by using the verification tool should be different from the first data calculation result and the third data calculation result should be the same as the second data calculation result. At this time, it may be determined that there is a problem in the processing of the data M to be verified in the system a, such as an error in the calculation formula used for obtaining the calculation result of the first data in the system a. If the third data calculation result obtained by using the verification tool is the same as the first data calculation result but different from the second data calculation result, it may be determined that there is no problem in the processing procedure of the data M to be verified in the system a, but there is a problem in the processing procedure of the system B, for example, the calculation formula for obtaining the second data calculation result in the system B is incorrect. If the third data calculation result is different from both the first data calculation result and the second data calculation result, it can be determined that there is a problem in the processing of the data to be verified in both the system a and the system B, for example, the calculation formula for obtaining the first data calculation result in the system a and the calculation formula for obtaining the second data calculation result in the system B are both wrong.
The data to be verified sent by the target system is verified and calculated by using the verification tool to obtain a third data calculation result, and the calculation result is compared with the first data calculation result obtained by the target system and the second data calculation result obtained by a system behind the target system, so that the problem in the processing process of the data to be verified in the target system or the system behind the target system can be determined, the calculation formula for obtaining the first data calculation result by the target system or the calculation formula for obtaining the second data calculation result by the system behind the target system is further determined to be wrong, the automatic positioning of the problem between system interaction is realized, and the positioning efficiency is improved.
In practical application, considering that the complexity of a service mode is high and there are many data to be transmitted, there may be a plurality of parameter values corresponding to a certain field identifier. Thus, in some embodiments, a parameter value or parameter identification may be included in the parameter information, which may be an index to the parameter value. Extracting corresponding parameter information from the data to be verified according to the field identifier included in the verification formula, which may include:
for a preset type of target field identification included in the check formula, extracting corresponding parameter identification from the data to be checked, wherein the preset type of target field identification refers to field identification with a plurality of corresponding parameter values;
and querying a preset dictionary according to the extracted parameter identifications and the target field identifications so as to obtain parameter values corresponding to the target field identifications and the parameter identifications from the preset dictionary.
In this embodiment, the field identifiers corresponding to the plurality of parameter values may be used as field identifiers of a preset type. For the field identifier of the preset type included in the check formula, corresponding parameter identifiers, such as a, b, and c, may be extracted from the data to be checked.
The parameter identifier is used as an index of the parameter value, and may be in one-to-one correspondence with the parameter value, for example, the parameter value corresponding to the parameter identifier a may be 5, the parameter value corresponding to the parameter identifier b may be 4, the parameter value corresponding to the parameter identifier c may be 3, and the like. In order to obtain the parameter values corresponding to the target field identifier and the parameter identifier, the corresponding relationship between the preset type of field identifier and the parameter identifier and the corresponding relationship between the parameter identifier and the parameter value may be stored in a dictionary in advance, and the dictionary may be set in a verification tool in advance. If the calling code of the dictionary is set in the verification tool, the preset dictionary may be called by using the verification tool according to the extracted parameter identifier and the target field identifier, and the parameter value corresponding to the target field identifier and the parameter identifier is obtained according to the corresponding relationship. For example, if a certain field identifier 1005 corresponds to three parameter identifiers a, b, and c, the parameter values corresponding to the three parameter identifiers are 5, 4, and 3, respectively, and the corresponding parameter identifier b is extracted from the data to be verified according to the target field identifier 1005 included in the verification formula, then the corresponding parameter value 4 may be obtained from the preset dictionary by using the verification tool. In practical applications, if the field identifier corresponds to a parameter value, the corresponding relationship between the field identifier and the parameter value may also be stored in the dictionary in advance. And will not be described in detail herein.
In the embodiment, by presetting the dictionary in the verification tool, when the parameter information corresponding to the field identifier is the parameter identifier, the parameter value corresponding to the target field identifier and the parameter identifier can be obtained by using the preset dictionary in the verification tool, and the corresponding parameter value is not required to be obtained by manual operation, so that automatic positioning of problems between system interaction is realized, and positioning efficiency is improved.
In some embodiments, in addition to the correspondence, paraphrase information corresponding to the field identification may be included in the preset dictionary. The method may further comprise:
and if the verification result of the data to be verified is that the data transmission is incomplete, outputting paraphrase information corresponding to the field identification which is not transmitted.
Taking a service industry scenario, as an example, if the field identifier 10001 may represent an original price of an order commodity, the original price of the order commodity may be paraphrase information of the field identifier 10001, the field identifier 10002 may represent a coupon price, the coupon price may be paraphrase information of the field identifier 10002, the field identifier 10003 may represent a payment price, the payment price may be paraphrase information of the field identifier 10003, and the like, where the correspondence may be stored in a dictionary in advance, so that when there is a problem of incomplete data transmission in the data to be verified, paraphrase information corresponding to the field identifier that is not transmitted is obtained from a preset dictionary and output. Specifically, a translation button can be further included in the page, and in response to a translation operation triggered by a user, paraphrase information corresponding to the untransmitted field identification can be output. For example, if the parameter information corresponding to the field identifier 10002 is missing, the output information may be the field identifier 10002, the coupon price, the missing, or the like.
The preset dictionary may further include paraphrase information of the parameter value, and the paraphrase information may have various implementation forms, for example, a field identifier 10001 corresponds to the parameter value of 100, the paraphrase information of the parameter value may be 100 yuan, and the like. The paraphrase information of the field identifier and the parameter value included in the preset dictionary may be set according to the actual service mode, which is not specifically limited.
In the embodiment, the paraphrase information of the field identification is stored in the preset dictionary, so that the translation function is provided, the visual output of the verification result is realized, the user can conveniently determine the problem, and the improvement of the understanding degree of the user on the problem between system interactions is facilitated.
As shown in fig. 2, which is a schematic structural diagram of an embodiment of a data processing apparatus provided in the present invention, the apparatus may include the following modules:
a receiving module 201, configured to receive data to be verified sent by a target system, where the data to be verified includes multiple field identifiers, parameter information corresponding to each of the multiple field identifiers, and a first data calculation result;
the first determining module 202 is configured to determine a check formula corresponding to the target system from a check tool in which a plurality of check formulas are encapsulated if a second data calculation result obtained locally according to the data to be checked is different from a first data calculation result;
the extracting module 203 is configured to extract corresponding parameter information from the data to be verified according to the field identifier included in the verification formula;
the second determining module 204 is configured to determine a checking result of the data to be checked according to the extracted parameter information, where the checking result reflects an error reason of the calculation result of the first data.
In the embodiment, by using the verification tool packaged with a plurality of verification formulas, after receiving the data to be verified sent by the target system, the verification formula corresponding to the target system is determined, corresponding parameter information is extracted from the data to be verified according to the field identification included in the verification formula, and then the data to be verified is verified according to the parameter information, so that a verification result capable of reflecting the problem between system interactions is obtained, automatic positioning of the problem between system interactions is realized, the problems that manual operation is needed in the conventional scheme, the positioning time is long and the positioning process is complicated are solved, and the positioning efficiency is improved.
In some embodiments, the second determining module 204 may include:
a first determining unit, configured to determine, if the extracted quantity of the parameter information is less than the quantity of the parameter information included in the data to be verified, that a verification result of the data to be verified is: the data transfer is incomplete.
In some embodiments, the second determining module 204 may include:
the second determining unit is used for determining a third data calculation result according to the checking formula and the extracted parameter information if the extracted parameter information quantity is equal to the parameter information quantity contained in the data to be checked;
and the third determining unit is used for determining that the calculation formula of the target system for acquiring the first data calculation result is wrong if the third data calculation result is different from the first data calculation result.
In some embodiments, the parameter information includes a parameter value or a parameter identifier, and the parameter identifier is an index of the parameter value; the extraction module 203 may include:
the extraction unit is used for extracting corresponding parameter identifiers from the data to be verified for preset types of target field identifiers included in the verification formula, wherein the preset types of target field identifiers refer to field identifiers with a plurality of corresponding parameter values;
and the acquisition unit is used for querying the preset dictionary according to the extracted parameter identification and the target field identification so as to acquire the parameter value corresponding to the target field identification and the parameter identification from the preset dictionary.
In the embodiment, by presetting the dictionary in the verification tool, when the parameter information corresponding to the field identifier is the parameter identifier, the parameter value corresponding to the target field identifier and the parameter identifier can be obtained by using the preset dictionary in the verification tool, and the corresponding parameter value is not required to be obtained by manual operation, so that automatic positioning of problems between system interaction is realized, and positioning efficiency is improved.
In some embodiments, paraphrase information corresponding to the field identification and paraphrase information corresponding to the parameter value may be included in the preset dictionary; the apparatus may further include:
and the output module is used for outputting paraphrase information corresponding to the untransmitted field identification if the verification result of the data to be verified is incomplete in data transmission.
In the embodiment, the paraphrase information of the field identification is stored in the preset dictionary, so that the translation function is provided, the visual output of the verification result is realized, the user can conveniently determine the problem, and the improvement of the understanding degree of the user on the problem between system interactions is facilitated.
In some embodiments, the data to be verified may include identification information of the target system; the first determining module 202 may include:
and the fourth determining unit is used for determining the check formula corresponding to the identification information from the check tools packaged with the plurality of check formulas according to the corresponding relation between the preset identification information and the check formulas.
Fig. 3 is a schematic structural diagram of a data processing system according to an embodiment of the present invention, which includes a storage component 301 and a processing component 302;
the processing component 302 is to:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifications, parameter information corresponding to the field identifications and a first data calculation result;
if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result, determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas;
extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula;
and determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data.
In the embodiment, by using the verification tool packaged with a plurality of verification formulas, after receiving the data to be verified sent by the target system, the verification formula corresponding to the target system is determined, corresponding parameter information is extracted from the data to be verified according to the field identification included in the verification formula, and then the data to be verified is verified according to the parameter information, so that a verification result capable of reflecting the problem between system interactions is obtained, automatic positioning of the problem between system interactions is realized, the problems that manual operation is needed in the conventional scheme, the positioning time is long and the positioning process is complicated are solved, and the positioning efficiency is improved.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that the embodiments may be implemented by software plus a necessary general hardware platform, and may also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A data processing method, comprising:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifications, parameter information corresponding to the field identifications and a first data calculation result;
if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result, determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas;
extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula;
and determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data.
2. The method according to claim 1, wherein the determining the verification result of the data to be verified according to the extracted parameter information comprises:
if the extracted parameter information quantity is less than the parameter information quantity contained in the data to be verified, determining that the verification result of the data to be verified is as follows: the data transfer is incomplete.
3. The method according to claim 1, wherein the determining the verification result of the data to be verified according to the extracted parameter information comprises:
if the quantity of the extracted parameter information is equal to the quantity of the parameter information contained in the data to be verified, determining a third data calculation result according to the verification formula and the extracted parameter information;
and if the third data calculation result is different from the first data calculation result, determining that a calculation formula used by the target system for obtaining the first data calculation result is wrong.
4. The method according to claim 1, wherein the parameter information includes a parameter value or a parameter identifier, and the parameter identifier is an index of the parameter value;
the extracting corresponding parameter information from the data to be verified according to the field identifier included in the verification formula includes:
for a preset type of target field identification included in the check formula, extracting a corresponding parameter identification from the data to be checked, wherein the preset type of target field identification refers to a field identification with a plurality of corresponding parameter values;
and querying a preset dictionary according to the extracted parameter identification and the target field identification so as to obtain a parameter value corresponding to the target field identification and the parameter identification from the preset dictionary.
5. The method according to claim 4, wherein the predetermined dictionary comprises paraphrase information corresponding to field identifications;
the method further comprises the following steps:
and if the verification result of the data to be verified is incomplete in data transmission, outputting paraphrase information corresponding to the field identification which is not transmitted.
6. The method according to claim 1, wherein the data to be verified includes identification information of the target system;
the determining a check formula corresponding to the target system from a check tool in which a plurality of check formulas are packaged comprises:
and determining a check formula corresponding to the identification information from check tools packaged with a plurality of check formulas according to the corresponding relation between the preset identification information and the check formulas.
7. A data processing apparatus, comprising:
the system comprises a receiving module, a verification module and a verification module, wherein the receiving module is used for receiving data to be verified sent by a target system, and the data to be verified comprises a plurality of field identifications, parameter information corresponding to the field identifications and a first data calculation result;
the first determining module is used for determining a check formula corresponding to the target system from a check tool packaged with a plurality of check formulas if a second data calculation result obtained locally according to the data to be checked is different from the first data calculation result;
the extraction module is used for extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula;
and the second determining module is used for determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data.
8. The apparatus of claim 7, wherein the second determining module comprises:
a first determining unit, configured to determine, if the extracted quantity of the parameter information is less than the quantity of the parameter information included in the data to be verified, that a verification result of the data to be verified is: the data transfer is incomplete.
9. The apparatus of claim 7, wherein the second determining module comprises:
a second determining unit, configured to determine a third data calculation result according to the check formula and the extracted parameter information if the extracted quantity of the parameter information is equal to the quantity of the parameter information included in the data to be checked;
and the third determining unit is used for determining that the calculation formula used by the target system for acquiring the first data calculation result is wrong if the third data calculation result is different from the first data calculation result.
10. A data processing system, comprising a storage component and a processing component;
the storage component stores one or more computer instructions, wherein the one or more computer instructions are for the processing component to invoke execution;
the processing component is to:
receiving data to be verified sent by a target system, wherein the data to be verified comprises a plurality of field identifications, parameter information corresponding to the field identifications and a first data calculation result;
if a second data calculation result obtained locally according to the data to be verified is different from the first data calculation result, determining a verification formula corresponding to the target system from a verification tool packaged with a plurality of verification formulas;
extracting corresponding parameter information from the data to be verified according to the field identification included in the verification formula;
and determining a checking result of the data to be checked according to the extracted parameter information, wherein the checking result reflects the error reason of the calculation result of the first data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010949493.9A CN112241328B (en) | 2020-09-10 | 2020-09-10 | Data processing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010949493.9A CN112241328B (en) | 2020-09-10 | 2020-09-10 | Data processing method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112241328A true CN112241328A (en) | 2021-01-19 |
| CN112241328B CN112241328B (en) | 2024-01-23 |
Family
ID=74170722
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010949493.9A Active CN112241328B (en) | 2020-09-10 | 2020-09-10 | Data processing method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112241328B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116910695A (en) * | 2023-09-11 | 2023-10-20 | 哈尔滨工程大学三亚南海创新发展基地 | Marking method of equipment monitoring result and checking method of equipment monitoring data |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006057171A1 (en) * | 2004-11-29 | 2006-06-01 | Nec Corporation | Signature and verifying method, and signature and verifying device |
| CN1812314A (en) * | 2005-01-24 | 2006-08-02 | 中兴通讯股份有限公司 | Data with different rate group frame transmitting method and device |
| CN101673217A (en) * | 2009-08-26 | 2010-03-17 | 用友软件股份有限公司 | Method for realizing remote program call and system thereof |
| CN102769616A (en) * | 2012-07-04 | 2012-11-07 | 珠海金山网络游戏科技有限公司 | Delay calculation method based on game movement logic client and server synchronization |
| CN103246574A (en) * | 2012-02-10 | 2013-08-14 | 阿里巴巴集团控股有限公司 | Verification method and verification device for data accuracy |
| CN103595661A (en) * | 2013-11-28 | 2014-02-19 | 杭州华三通信技术有限公司 | Message fragmentation restructuring method and device |
| CN104410477A (en) * | 2014-11-27 | 2015-03-11 | 中国航天科工集团第三研究院第八三五七研究所 | Cyclic redundancy check method used for optical fiber channel |
| CN104600657A (en) * | 2015-01-30 | 2015-05-06 | 国网北京经济技术研究院 | Power system fault calculation result calibration method |
| CN106603707A (en) * | 2016-12-29 | 2017-04-26 | 腾讯科技（深圳）有限公司 | Data processing method, terminal and server |
| CN106911428A (en) * | 2017-02-23 | 2017-06-30 | 北京龙鼎源科技股份有限公司 | The transmission method and device of information |
| WO2017152618A1 (en) * | 2016-03-09 | 2017-09-14 | 中兴通讯股份有限公司 | Verification method and device, and terminal |
| CN110399428A (en) * | 2019-07-26 | 2019-11-01 | 北京奇艺世纪科技有限公司 | A kind of data verification method, device and electronic equipment |
| CN110825634A (en) * | 2019-11-04 | 2020-02-21 | 深圳前海微众银行股份有限公司 | Parameter quality checking method, device and equipment and computer readable storage medium |
-
2020
- 2020-09-10 CN CN202010949493.9A patent/CN112241328B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006057171A1 (en) * | 2004-11-29 | 2006-06-01 | Nec Corporation | Signature and verifying method, and signature and verifying device |
| CN1812314A (en) * | 2005-01-24 | 2006-08-02 | 中兴通讯股份有限公司 | Data with different rate group frame transmitting method and device |
| CN101673217A (en) * | 2009-08-26 | 2010-03-17 | 用友软件股份有限公司 | Method for realizing remote program call and system thereof |
| CN103246574A (en) * | 2012-02-10 | 2013-08-14 | 阿里巴巴集团控股有限公司 | Verification method and verification device for data accuracy |
| CN102769616A (en) * | 2012-07-04 | 2012-11-07 | 珠海金山网络游戏科技有限公司 | Delay calculation method based on game movement logic client and server synchronization |
| CN103595661A (en) * | 2013-11-28 | 2014-02-19 | 杭州华三通信技术有限公司 | Message fragmentation restructuring method and device |
| CN104410477A (en) * | 2014-11-27 | 2015-03-11 | 中国航天科工集团第三研究院第八三五七研究所 | Cyclic redundancy check method used for optical fiber channel |
| CN104600657A (en) * | 2015-01-30 | 2015-05-06 | 国网北京经济技术研究院 | Power system fault calculation result calibration method |
| WO2017152618A1 (en) * | 2016-03-09 | 2017-09-14 | 中兴通讯股份有限公司 | Verification method and device, and terminal |
| CN106603707A (en) * | 2016-12-29 | 2017-04-26 | 腾讯科技（深圳）有限公司 | Data processing method, terminal and server |
| CN106911428A (en) * | 2017-02-23 | 2017-06-30 | 北京龙鼎源科技股份有限公司 | The transmission method and device of information |
| CN110399428A (en) * | 2019-07-26 | 2019-11-01 | 北京奇艺世纪科技有限公司 | A kind of data verification method, device and electronic equipment |
| CN110825634A (en) * | 2019-11-04 | 2020-02-21 | 深圳前海微众银行股份有限公司 | Parameter quality checking method, device and equipment and computer readable storage medium |
Non-Patent Citations (3)
| Title |
|---|
| MOHIT ARORA: "Distance based verification techniques for online signature verification system", 2015 2ND INTERNATIONAL CONFERENCE ON RECENT ADVANCES IN ENGINEERING & COMPUTATIONAL SCIENCES (RAECS) * |
| 王骞等: "面向权威DNS的数据一致性保障机制", 计算机与现代化 * |
| 许宗光;文继锋;李彦;顾浩;: "一种基于数据冗余校验的数字化变电站继电保护装置防误方法", 电力系统保护与控制, no. 05 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116910695A (en) * | 2023-09-11 | 2023-10-20 | 哈尔滨工程大学三亚南海创新发展基地 | Marking method of equipment monitoring result and checking method of equipment monitoring data |
| CN116910695B (en) * | 2023-09-11 | 2024-01-05 | 哈尔滨工程大学三亚南海创新发展基地 | Marking method of equipment monitoring result and checking method of equipment monitoring data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112241328B (en) | 2024-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109491905A (en) | Head end test method, apparatus and electronic equipment | |
| CN108255725B (en) | Test method and device | |
| CN109189669A (en) | Test method, electronic device and the readable storage medium storing program for executing of business scenario | |
| CN109213758B (en) | Data access method, device, equipment and computer readable storage medium | |
| CN111309505B (en) | Page exception handling method and device and electronic equipment | |
| CN109784738B (en) | Approval method and approval device | |
| CN106875167B (en) | Detection method and device for fund transaction path in electronic payment process | |
| CN110852719A (en) | Electronic contract signing method and device, electronic equipment and storage medium | |
| CN111367904A (en) | Service processing method and device and server | |
| CN109582550A (en) | A kind of method, apparatus and server obtaining full dose business scenario failure collection | |
| CN112241328A (en) | Data processing method, device and system | |
| CN114238295A (en) | Data sorting method and device based on grouping | |
| CN110188083B (en) | Interface information mining method and device | |
| CN108804889B (en) | Website registration method and device | |
| CN111427796A (en) | System testing method and device and electronic equipment | |
| CN111914548A (en) | Intelligent document filling method and system and related equipment | |
| CN114048732A (en) | Multi-terminal information processing method, device, equipment and storage medium | |
| CN113704123A (en) | Interface test method, device, equipment and storage medium | |
| CN112307088A (en) | Method, device and equipment for inquiring state of process node and storage medium | |
| CN113407593A (en) | Data sampling method and device, electronic equipment and readable storage medium | |
| CN112396425A (en) | Identification code processing method and device | |
| CN112882957B (en) | Test task validity checking method and device | |
| CN112181803B (en) | Data processing method and device | |
| CN117632707A (en) | Test method and system thereof | |
| CN115408463A (en) | Work order automatic processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |