CN110502502B - Data checking method, device, equipment and computer readable storage medium - Google Patents
Data checking method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110502502B CN110502502B CN201910767885.0A CN201910767885A CN110502502B CN 110502502 B CN110502502 B CN 110502502B CN 201910767885 A CN201910767885 A CN 201910767885A CN 110502502 B CN110502502 B CN 110502502B
- Authority
- CN
- China
- Prior art keywords
- data
- sequence
- received
- serial number
- issued
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a data checking method, a device, equipment and a computer readable storage medium, wherein the method comprises the following steps: when the detection reaches the first preset time, reading the numerical value of the received data in the first preset system to accumulate, and generating a receiving sum; accumulating the values of the issued data in the second preset system to generate an issued sum, and comparing the received sum with the issued sum to generate a comparison result; if the comparison result is that the comparison fails, comparing the received serial numbers corresponding to the received data with the issued serial numbers corresponding to the issued data, and determining the missing target serial numbers in the received serial numbers. When the big data processing technology is based on verifying that the data are inconsistent, the first preset system is corrected by the target serial number causing the inconsistency, and consistency of recorded data and issued data is ensured.
Description
Technical Field
The present invention relates generally to the field of data processing technology, and in particular, to a data checking method, apparatus, device, and computer readable storage medium.
Background
With the development of network technology, the data volume generated according to the network is huge and the types are various; for data generated by a user based on account operation, firstly recording the data, and then issuing the recorded data to a user account for display; thereafter, consistency between the recorded data and the delivered data is re-checked to ensure accurate recording of the delivered data.
At present, consistency between recorded data and issued data is checked, usually based on an accounting formula; when checking, firstly distinguishing the recorded data from the issued data, and then calling a check formula to check the distinguished recorded data and the issued data; in this case, the large amount of data easily causes errors in discrimination, and thus, inaccuracy in collation.
Disclosure of Invention
The invention mainly aims to provide a data checking method, a device, equipment and a computer readable storage medium, which aim to solve the problem that in the prior art, data checking is inaccurate due to the fact that recorded data are distinguished and data are sent down in error.
In order to achieve the above object, the present invention provides a data collation method comprising the steps of:
When the detection reaches the first preset time, reading the numerical value of the received data in the first preset system to accumulate, and generating a receiving sum;
accumulating the values of the issued data in a second preset system to generate an issued sum, and comparing the received sum with the issued sum to generate a comparison result, wherein the first preset system is in communication connection with the second preset system;
if the comparison result is that the comparison fails, comparing the received serial numbers corresponding to the received data with the issued serial numbers corresponding to the issued data, and determining the missing target serial numbers in the received serial numbers.
Preferably, the step of comparing the received serial number corresponding to each received data with the issued serial number corresponding to each issued data, and determining the missing target serial number in each received serial number includes:
reading a receiving serial number and a receiving time corresponding to each received data, and sequencing each receiving serial number according to each receiving time to generate a first sequence;
reading the issuing serial numbers and issuing time corresponding to the issuing data, and sequencing the issuing serial numbers according to the issuing time to generate a second sequence;
And comparing the first sequence with the second sequence to determine the missing target serial numbers in the received serial numbers.
Preferably, the step of comparing the first sequence with the second sequence to determine a missing target serial number in each received serial number includes:
reading a first intermediate element of the first sequence and a second intermediate element of the second sequence, and judging whether the first intermediate element is consistent with the second intermediate element;
if the first intermediate element is consistent with the second intermediate element, setting a lower subsequence of the first sequence as a new first sequence, setting a lower subsequence of the second sequence as a new second sequence, and executing the step of reading the first intermediate element of the first sequence and the second intermediate element of the second sequence until the first intermediate element and the second intermediate element are inconsistent;
when the first intermediate element and the second intermediate element are inconsistent, comparing between the first element and the second element according to the arrangement sequence of the first element in the first sequence and the second element in the second sequence;
and when the first element and the second element which are inconsistent in the arrangement sequence appear, determining the second element which is inconsistent as a target serial number which is missed in each receiving serial number.
Preferably, the step of determining whether the first intermediate element is consistent with the second intermediate element further includes:
and when the first intermediate element and the second intermediate element are inconsistent, setting the upper subsequence of the first sequence as a new first sequence, setting the upper subsequence of the second sequence as a new second sequence, and executing the step of comparing between each first element and each second element according to the arrangement sequence of the first element in the first sequence and the second element in the second sequence.
Preferably, the step of determining the missing target serial numbers in the received serial number set further includes:
and sending target data corresponding to each target serial number to a first preset system as the received data, and executing the step of reading the numerical value of the received data in the first preset system to accumulate and generate a receiving sum until the comparison result is successful in comparison, thereby completing the data check between the first preset system and the second preset system.
Preferably, the step of determining the missing target serial numbers in the received serial number set further includes:
When the detection reaches the second preset time, counting the times of generating the comparison result to generate the total comparison times, counting the number of comparison failures of the comparison result to generate the total failure times;
comparing the total number of failures with the total number of comparison to generate a failure rate, and judging whether the failure rate is larger than a preset threshold value or not;
if the preset threshold value is larger than the preset threshold value, outputting preset early warning information.
Preferably, the step of reading the value of the received data in the first preset system to accumulate when the detection reaches the first preset time includes:
when a data transmission request of a user account is received, reading transmission data corresponding to the data transmission request;
issuing the transmission data to the user account based on the second preset system, and generating a transmission serial number;
and sending the transmission data and the transmission serial number to the first preset system to be recorded in the first preset system.
In addition, in order to achieve the above object, the present invention also proposes a data collation apparatus including:
the reading module is used for reading the numerical value of the received data in the first preset system to accumulate when the detection reaches the first preset time, so as to generate a receiving sum;
The comparison module is used for accumulating the numerical values of the issued data in the second preset system to generate an issued sum, comparing the received sum with the issued sum to generate a comparison result, wherein the first preset system is in communication connection with the second preset system;
and the determining module is used for comparing the received serial numbers corresponding to the received data with the issued serial numbers corresponding to the issued data if the comparison result is that the comparison fails, and determining the missing target serial numbers in the received serial numbers.
In addition, in order to achieve the above object, the present invention also proposes a data collation apparatus including: a memory, a processor, a communication bus, and a data collation program stored on the memory;
the communication bus is used for realizing connection communication between the processor and the memory;
the processor is configured to execute the data collation program to implement the steps of:
when the detection reaches the first preset time, reading the numerical value of the received data in the first preset system to accumulate, and generating a receiving sum;
accumulating the values of the issued data in a second preset system to generate an issued sum, and comparing the received sum with the issued sum to generate a comparison result, wherein the first preset system is in communication connection with the second preset system;
If the comparison result is that the comparison fails, comparing the received serial numbers corresponding to the received data with the issued serial numbers corresponding to the issued data, and determining the missing target serial numbers in the received serial numbers.
In addition, to achieve the above object, the present invention also provides a computer-readable storage medium storing one or more programs executable by one or more processors for:
when the detection reaches the first preset time, reading the numerical value of the received data in the first preset system to accumulate, and generating a receiving sum;
accumulating the values of the issued data in a second preset system to generate an issued sum, and comparing the received sum with the issued sum to generate a comparison result, wherein the first preset system is in communication connection with the second preset system;
if the comparison result is that the comparison fails, comparing the received serial numbers corresponding to the received data with the issued serial numbers corresponding to the issued data, and determining the missing target serial numbers in the received serial numbers.
According to the data checking method, the data recorded by the first preset system is read to serve as the numerical value of the received data to generate the receiving sum, the numerical value of the issued data in the second preset system is generated to be the issued sum, and the comparison between the receiving sum and the issued sum realizes the checking between the recorded data and the issued data, so that the distinction between the issued data and the recorded data is avoided, and the checking accuracy is ensured. Meanwhile, if the comparison result is a comparison failure, the difference exists between the received data and the issued data, and at the moment, the received serial number and the issued serial number are compared to determine the missing target serial number in the received serial number; the target serial number is a cause of inconsistent received data and issued data, and the first preset system lacks records of target data corresponding to the target serial number; and then, the target data corresponding to the target serial number is sent to a first preset system for recording, so that the difference data is quickly corrected, and the consistency between the recorded data and the actual issued data is ensured.
Drawings
FIG. 1 is a flow chart of a first embodiment of a data collation method of the present invention;
FIG. 2 is a schematic diagram of functional blocks of a first embodiment of the data collation apparatus of the present invention;
FIG. 3 is a schematic diagram of a device architecture of a hardware operating environment involved in a method according to an embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The invention provides a data checking method.
Referring to fig. 1, fig. 1 is a flowchart of a data checking method according to a first embodiment of the present invention. In this embodiment, the data collation method includes:
step S10, when the detection reaches the first preset time, reading the numerical value of the received data in the first preset system to accumulate, and generating a receiving sum;
the data checking method of the embodiment is applied to the server and is suitable for checking the data recorded in the first preset system and the data actually issued in the second preset system through the server; the first preset system is a system which is preset for recording data, and the second preset system is a system which is preset for issuing the data to a user account, and the first preset system and the second preset system are both in communication connection with the server. When a user operates based on the account to generate operation data, in order to quickly respond to the user operation, the operation data is firstly issued to the user account based on a second preset system for display, and the effectiveness of the user operation is represented; and recording the operation data based on the first preset system to carry out backup processing on the operation data, and taking the data recorded in the first preset system as the received data of the first preset system. The operation data generated by the user operation may be recharging data generated by the recharging operation or purchasing data generated by the purchasing operation, and is not limited thereto, so long as the operation with the data checking requirement is applicable.
Understandably, before checking the issue data and the receive data, it is necessary to generate the operation data into the record data of the first preset system and the issue data of the second preset system; specifically, before step S10, it includes:
step a1, when a data transmission request of a user account is received, reading transmission data corresponding to the data transmission request;
when the user has a recharging requirement, the recharging amount is set through the user account of the user, and a recharging request is initiated, and the recharging request is sent to the server as a data transmission request. When the server receives the data transmission request, the server reads the corresponding transmission data, wherein the transmission data is substantially a recharging amount, and represents the recharging amount required by the user to the user account.
Step a2, the transmission data is issued to the user account based on the second preset system, and a transmission serial number is generated;
further, in order to quickly meet the recharging requirement of the user, the second preset system is used for transmitting the transmission data serving as the recharging amount to the user account, and the user can check the recharging amount on the user account. In addition, a transmission serial number is generated for the operation, and the completion of the recharging operation is represented. Wherein the transmission serial number can be generated according to a preset format; if the transmission serial number is set to be composed of a character and five-digit numerical values, the character is different according to different operation types, and the character for recharging operation is C; thus, for the initial transmission serial number of the recharge, C00000, the subsequent accumulation is performed on the basis of the last digit value of 0.
And a step a3 of sending the transmission data and the transmission serial number to the first preset system so as to record in the first preset system.
Furthermore, after the recharging demands of the users are responded quickly, the transmission data and the transmission serial numbers are sent to the first preset system in an asynchronous task mode, and the recharging amount and the transmission serial numbers of the recharging operation are recorded by the first preset system.
It is understood that the recharging operation may occur at any time when the operation habits of different users are different, and the server is preset with a first preset time in order to check the data recorded by the first preset system and the data issued by the second preset system. When the first preset time is detected to be reached, reading the data recorded in the first preset system as received data; the data recorded in the first preset system is substantially transmission data, so that the data recorded in the first preset system is read as receiving data, and the data recorded in the first preset system is substantially transmission data within the first preset time is read as receiving data. And then, carrying out accumulation operation on the numerical values of all the received data to obtain a receiving sum, wherein the receiving sum is the recharging sum of all recharging data of which the recharging operation is carried out by all users in a first preset time.
Step S20, accumulating the numerical values of the issued data in a second preset system to generate an issued sum, and comparing the received sum with the issued sum to generate a comparison result, wherein the first preset system is in communication connection with the second preset system;
further, the data issued in the second preset system is read as the issued data, and the data issued by the second preset system is substantially the transmission data, so that the data issued in the second preset system is read as the issued data, and the data issued by the second preset time is substantially read as the issued data. And then, carrying out accumulation operation on the numerical values of all the issuing data to obtain an issuing sum, wherein the issuing sum is a recharging sum recorded by recharging data of each recharging operation carried out on each user in a first preset time.
Further, a comparison is made between the generated received sum and the issued sum, and a comparison result is generated which characterizes the consistency between the two. If the comparison determines that the receiving sum is consistent with the issuing sum, the comparison result is that the comparison is successful, the record of the recharging operation of each pen by the first preset system is the same as the recharging operation of each pen by the second preset system in the first preset time, and the first preset system does not miss the record of the recharging operation of each pen; when the receiving sum and the issuing sum are inconsistent, the comparison result is a comparison failure, the record of the recharging operation of each pen by the first preset system and the recharging operation of each pen by the second preset system are different in the first preset time, and the failure of the asynchronous task may cause the failure of sending the transmission data and the transmission serial number to the first preset system, so that the condition of missing the record of the recharging operation of a certain pen occurs.
Step S30, if the comparison result is that the comparison fails, comparing the received serial numbers corresponding to the received data with the issued serial numbers corresponding to the issued data, and determining the missing target serial numbers in the received serial numbers;
further, the transmission serial number generated in the process of transmitting the transmission data in the second preset system is the transmission serial number corresponding to the transmission data in the second preset system, and after the transmission serial number is sent to the first preset system, the transmission serial number is used as the receiving serial number corresponding to the receiving data in the first preset system. And comparing the received data serial numbers corresponding to the received data with the issued serial numbers corresponding to the issued data according to the comparison result of the comparison failure, and determining the target serial numbers between the received serial numbers and the issued serial numbers. Because each piece of issuing data issued by the second preset system is transmitted to the first preset system and recorded as receiving data, the issuing serial number corresponding to each piece of issuing data has a receiving serial number corresponding to each piece of receiving data. When the receiving sum and the issuing sum are inconsistent, the difference exists between the receiving data and the issuing data, so that the issuing serial numbers and the receiving serial numbers do not have one-to-one correspondence. And determining various serial numbers causing the difference between the two serial numbers by comparing the issued serial numbers with the received serial numbers, wherein the serial numbers causing the difference are serial numbers which are inconsistent between the two serial numbers, and the serial numbers are used as target serial numbers, and represent serial numbers which exist in a second preset system but are failed to be sent to a first preset system and are recorded in the first preset system.
And then, the server also sends the target data corresponding to each target serial number to the first preset system to complete data checking between the first preset system and the second preset system.
Specifically, since each target serial number is a serial number existing in the second preset system but not in the first preset system, corresponding issuing data is necessarily existing in the second preset system, the corresponding issuing data is used as target data, each target data is sent to the first preset system, and recording is performed in the first preset system. It should be noted that, because there is a correspondence between the issuing data and the issuing serial numbers in the second preset system, in the process of sending the target data corresponding to each target serial number to the first preset system, each target serial number will be correspondingly sent to the first preset system, so that the first preset system re-records each missing serial number and the data corresponding to the missing serial number.
It is understood that, after the target data and the target serial number of each item which are missed before are sent to the first preset system for complementary recording, in order to ensure the consistency between the data recorded by the first preset system at the first preset time and the data issued by the second preset system within the first preset time, a mechanism for rechecking on the basis of each item of target data is provided. Specifically, target data corresponding to each target serial number is sent to a first preset system as receiving data, and the receiving data in the first preset system is updated; then accumulating all received data in a first preset system to generate a new received sum, and comparing whether the new received sum is consistent with the issued sum or not; if the data is consistent, the comparison is successful, the first preset system records the received data completely, and the data check between the first preset system and the second preset system is completed. If the comparison result is inconsistent, the target serial number between the receiving serial number and the issuing serial number is continuously determined, the consignment data in the first preset system is updated according to the target serial number, new comparison of the receiving sum and the issuing sum is formed, and the data check between the first preset system and the second preset system is completed until a comparison result which is successfully compared is generated.
It should be noted that, in the checking process, there may be a one-to-one correspondence between the received serial number and the issued serial number, but the received sum and the issued sum are inconsistent, at this time, it is described that the first preset system records all received data, but the recorded data size, that is, the recharging amount has an error. At this time, comparing each item of received data with each item of issued data, and finding out difference data which does not have a one-to-one correspondence relationship between the received data and the issued data, wherein the difference data is the data which causes the inconsistent receiving sum and the issued sum. And determining the issuing data and the receiving data which cause the difference data as target issuing data and target receiving data respectively, and replacing the target receiving data in the first preset system with the target issuing data so as to correct the receiving data which record errors in the first preset system.
According to the data checking method, the data recorded by the first preset system is read to serve as the numerical value of the received data to generate the receiving sum, the numerical value of the issued data in the second preset system is generated to be the issued sum, and the comparison between the receiving sum and the issued sum realizes the checking between the recorded data and the issued data, so that the distinction between the issued data and the recorded data is avoided, and the checking accuracy is ensured. Meanwhile, if the comparison result is a comparison failure, the difference exists between the received data and the issued data, and at the moment, the received serial number and the issued serial number are compared to determine the missing target serial number in the received serial number; the target serial number is a cause of inconsistent received data and issued data, and the first preset system lacks records of target data corresponding to the target serial number; and then, the target data corresponding to the target serial number is sent to a first preset system for recording, so that the difference data is quickly corrected, and the consistency between the recorded data and the actual issued data is ensured.
Further, in another embodiment of the data checking method of the present invention, the step of comparing the received serial number corresponding to each received data with the issued serial number corresponding to each issued data, and determining the missing target serial number in each received serial number includes:
step S31, reading the receiving serial numbers and the receiving time corresponding to the received data, and sequencing the receiving serial numbers according to the receiving time to generate a first sequence;
it is understood that each item of the issuing data in the second preset system is issued to the user account at different times according to the difference of the user operation time, and correspondingly, the receiving data transmitted to the first preset system by the asynchronous task also has different receiving times. When comparing the received serial numbers with the issued serial numbers, firstly reading the received serial numbers and the receiving time corresponding to the received data, sequencing the received serial numbers according to the sequence among the receiving times, arranging the received serial numbers with the preceding receiving time in the front, arranging the received serial numbers with the following receiving time in the rear, and generating a first sequence.
Step S32, reading the issuing serial numbers and issuing time corresponding to the issuing data, and sorting the issuing serial numbers according to the issuing time to generate a second sequence;
Further, the issuing serial numbers and the issuing time corresponding to the issuing data are read, the issuing serial numbers are ordered according to the sequence among the issuing times, the issuing serial numbers with the front issuing time are arranged in the front, the issuing serial numbers with the rear issuing time are arranged in the rear, and a second sequence is generated.
And step S33, comparing the first sequence with the second sequence to determine the missing target serial numbers in the received serial numbers.
Further, comparing the first sequence with the second sequence according to the arrangement sequence of each receiving serial number in the first sequence and the arrangement sequence of each issuing serial number in the second sequence, and determining whether the receiving serial numbers and the issuing serial numbers with the same arrangement sequence in the first sequence and the second sequence are consistent; if the serial numbers are consistent, the serial numbers recorded in the first preset system are consistent with the serial numbers generated in the second preset system, otherwise, the serial numbers recorded in the first preset system are inconsistent with the serial numbers generated in the second preset system, and the serial numbers with missing records exist in the first preset system. Then, according to inconsistent receiving serial numbers and issuing serial numbers in the same arrangement sequence, determining the target serial numbers of missing records in each receiving serial number; specifically, the step of comparing the first sequence with the second sequence to determine the missing target serial numbers in each received serial number includes:
Step S331, reading a first intermediate element of the first sequence and a second intermediate element of the second sequence, and judging whether the first intermediate element is consistent with the second intermediate element;
further, in order to increase the contrast speed between the first sequence and the second sequence, a mechanism is provided for extracting intermediate elements located between the first sequence and the second sequence for comparison. Wherein each receiving serial number forming the first sequence is a first element of the first sequence, each issuing serial number forming the second sequence is a second element of the second sequence, the first element positioned in the middle of the first sequence is a first intermediate element, and the second element positioned in the middle of the second sequence is a second intermediate element. As for the first sequence P1: [ A1, A2, A3, A4, A5, A7, A8] and a second sequence P2: [ A1, A2, A3, A4, A5, A6, A7, A8], the first intermediate element being A4 and the second intermediate element also being A4. When the intermediate elements between the first intermediate element and the second intermediate element are extracted for comparison, the first intermediate element of the first sequence and the second intermediate element of the second sequence are read, and then the first intermediate element and the second intermediate element are compared, and whether the first intermediate element and the second intermediate element are consistent is judged; if the first element and the second element are consistent, the first element positioned in the first intermediate element front in the first sequence and the second element positioned in the second intermediate element front in the second sequence are identical, and the target serial number of the missing record in the first sequence is positioned in the rear column of the second sequence. Otherwise, if the first intermediate element and the second intermediate element are inconsistent, the target serial number indicating the missing record is located in the first sequence.
Step S332, if the first intermediate element and the second intermediate element are identical, setting the lower subsequence of the first sequence to be a new first sequence, setting the lower subsequence of the second sequence to be a new second sequence, and executing the step of reading the first intermediate element of the first sequence and the second intermediate element of the second sequence until the first intermediate element and the second intermediate element are not identical;
further, when the comparison determines that the first intermediate element and the second intermediate element are consistent, it is explained that there is an inconsistent element between each first element located in the first sequence and each second element located in the second sequence. At this time, each first element located in the following column of the first intermediate element is determined as a lower subsequence of the first sequence, and each second element located in the following column of the second intermediate element is determined as a lower subsequence of the second sequence. Thereafter, the first sequence is updated with a lower subsequence of the first sequence, and the lower subsequence of the first sequence is set as a new first sequence; meanwhile, the second sequence is updated by using the lower subsequence of the second sequence, and the lower subsequence of the second sequence is set as a new second sequence. As for the first sequence P1 and the second sequence P2, since the first intermediate element A4 and the second intermediate element A4 are identical, the first sequence [ A5, A7, A8] is set to be a new first sequence, and the second sequence [ A5, A6, A7, A8] is set to be a new second sequence. And then, for the new first sequence and the new second sequence, continuing to read the first intermediate element and the second intermediate element in the new first sequence and the new second sequence to judge, and stopping updating the first sequence and the second sequence when the first intermediate element and the second intermediate element are inconsistent, and searching the target serial number of the missing record according to the inconsistent first intermediate element and second intermediate element.
Step S333, when the first intermediate element and the second intermediate element are inconsistent, comparing between each of the first element and each of the second element according to the arrangement order of the first element in the first sequence and the second element in the second sequence;
further, when the first intermediate element and the second intermediate element are determined to be inconsistent through comparison, reading each first element and each second element one by one according to the arrangement sequence of each first element in the updated first sequence and the arrangement sequence of each second element in the updated second sequence, comparing the first element and each second element, and judging whether the read first element and each second element have a one-to-one correspondence. For the updated first sequence P1 and the updated second sequence P2, the first intermediate element and the second intermediate element are respectively A6 and A7, which are inconsistent, so that the comparison of each first element and each second element is read one by one according to the respective arrangement sequence.
Step S334, when the first element and the second element that are inconsistent in the arrangement sequence occur, determining the second element that is inconsistent as the target serial number that is missing in each of the received serial numbers.
Furthermore, when the first elements and the second elements are compared according to the arrangement sequence, the first element and the second element which are inconsistent in the first sequence and the second sequence are the target serial numbers which cause the inconsistent receiving sum and the issuing sum. As for P1 above: [ A5, A7, A8] and P2: [ A5, A6, A7, A8], according to the arrangement sequence, firstly reading the first element A5 arranged at the first position in P1 and the second element A5 arranged at the first position in P2 for comparison; continuously reading the first element A7 and the second element A6 which are respectively arranged at the second position for comparison because the first element A7 and the second element A6 are consistent, wherein the first element and the second element are inconsistent in the first sequence and the second sequence for the first time, so that a target serial number is determined by the first element and the second element; and determining the second inconsistent element, namely A6, as the target serial numbers of the missed records in the first sequence, namely the missed target serial numbers in each receiving serial number.
It should be noted that, the number of the missing records in the first preset system may be multiple, and when the target serial number is determined, the difference value between the number of the first elements in the first sequence and the number of the second elements in the second sequence is firstly determined; when the difference value is 1, the received data of the missing record is only one, and the first inconsistent second element is determined as the target serial number. When the difference value is greater than 1, the missing record receiving data are multiple, the missing second element is added into the first sequence after the first inconsistent second element is determined as the target serial number, and based on the arrangement sequence of the added elements, the elements arranged after the addition are continuously read and judged, and other missing target serial numbers are determined. If the first element in the first sequence P1 is [ A5, A8], since the difference between P1 and P2 is greater than 1, after determining A6 as the target serial number, adding A6 to P1 to make the first element of P1 be [ A5, A6, A8]; and then reading the first element A8 positioned in the back row of the A6 and the second element A7 in the second sequence, comparing, determining other target serial numbers in each receiving serial number, and finishing the determination of the target serial numbers in each receiving serial number until the number of the determined target serial numbers is consistent with the difference value.
Understandably, when it is determined in step S331 that there is an inconsistency between the first intermediate element and the second intermediate element, it is explained that there is an inconsistency between the first elements in the first sequence located in front of the first intermediate element and the second elements in the second sequence located in front of the second intermediate element. At this time, each first element located in the first intermediate element front is determined as a higher-order subsequence of the first sequence, and each second element located in the second intermediate element front is determined as a higher-order subsequence of the second sequence. Then, the first sequence is updated by using the upper sub-sequence of the first sequence, and the upper sub-sequence of the first sequence is set as a new first sequence; and simultaneously, updating the second sequence by using the upper subsequence of the second sequence, and setting the upper subsequence of the second sequence as a new second sequence. Similarly, for the new first sequence and the new second sequence, according to the arrangement sequence of the respective elements, reading the respective first elements and the respective second elements one by one for comparison, and judging whether the read respective first elements and the respective second elements have a one-to-one correspondence relationship or not, so as to determine the missing target serial numbers in the respective receiving serial numbers.
According to the embodiment, the received serial numbers are generated into the first sequence, the issued serial numbers are generated into the second sequence, and a mechanism for extracting intermediate elements positioned in the first sequence and the second sequence for comparison is arranged to determine the missing target serial numbers in the received serial numbers, so that the comparison quantity between the first elements in the first sequence and the second elements in the second sequence is reduced, the comparison speed is improved, and the target serial numbers in the received serial numbers and the issued serial numbers can be rapidly determined.
Further, in another embodiment of the data checking method of the present invention, the step of determining the missing target serial numbers in the received serial number set includes:
step S50, counting the times of generating the comparison result when the detection reaches the second preset time, generating the total comparison times, counting the number of comparison failures of the comparison result, and generating the total failure times;
further, in this embodiment, the number of times of checking the inconsistency is counted, and the performance of recording the data by the first preset system is determined according to the duty ratio of the number of times of checking the inconsistency. Specifically, a second preset time for judging the performance of the first preset system is preset according to the requirement, and when the second preset time is detected, the times of comparison results generated in the second preset time are counted to generate total comparison times; the total comparison times represent the checking times of the server on the data recorded by the first preset system and the data issued by the second preset system in the second preset time. Meanwhile, counting the number of comparison failures of comparison results generated in a second preset time to generate total failure times; the total number of failures characterizes the number of times that the server is inconsistent with the issued data in each check within a second preset time.
Step S60, the total times of failure and the total times of comparison are compared to generate a failure rate, and whether the failure rate is larger than a preset threshold value is judged;
further, a ratio is made between the total number of failures and the total number of comparisons, generating a failure rate characterizing the size of the failure ratio. In addition, a preset threshold value is preset in the server according to the requirement, the failure rate is compared with the preset threshold value, and whether the failure rate is larger than the preset threshold value is judged.
And step S70, if the preset threshold value is larger than the preset threshold value, outputting preset early warning information.
If the failure rate is greater than the preset threshold, it indicates that the number of times of checking inconsistency is too large in the second preset time, which may be that the first preset system has poor performance on data recording due to problems in asynchronous tasks instead of accidental anomalies due to network reasons. At this time, preset early warning information is output to remind the first preset system or asynchronous task to be checked and optimized. If the failure rate is not greater than the preset threshold, the number of times of checking inconsistency is not excessive, the performance of the first preset system on the data record is normal, and optimization of the first preset system or the asynchronous task is not needed.
In addition, considering that the inconsistency caused by the first preset system or the asynchronous task has some similar characteristics, such as easy omission of records at a certain time point, easy omission of recorded data when the recorded data is larger or smaller than a certain value, or inconsistency of recorded values caused by the format of received data, and the like. Presetting the possible reasons as a plurality of reason types, comparing the inconsistent situations with the reason types, and determining a target reason type causing the inconsistency; and then adding each target reason type into preset early warning information so as to quickly find problems and optimize the problems.
According to the embodiment, the total times of failure and the total times of comparison are generated to be failure rates, and the failure rates are used for reflecting the quality of the recording performance of the first preset system, so that the first preset system is reminded to be optimized; when the recording performance of the first preset system is poor, the method can be optimized in time, and the accuracy of data record issuing is ensured.
In addition, referring to fig. 2, the present invention provides a data checking device, in a first embodiment of the data checking device of the present invention, the data checking device includes:
the reading module 10 is configured to read the values of the received data in the first preset system and accumulate the values when the detected value reaches the first preset time, so as to generate a received sum;
The comparison module 20 is configured to accumulate values of the issued data in the second preset system, generate an issued sum, and compare the received sum with the issued sum to generate a comparison result, where the first preset system is in communication connection with the second preset system;
and the determining module 30 is configured to compare the received serial numbers corresponding to the received data with the issued serial numbers corresponding to the issued data, and determine the missing target serial numbers in the received serial numbers if the comparison result is that the comparison fails.
In the data checking device of this embodiment, the reading module 10 reads the data recorded by the first preset system as the value of the received data to generate a receiving sum, and the comparing module 20 generates the value of the issued data of the second preset system as the issued sum, so that the comparison between the receiving sum and the issued sum realizes the checking between the received data and the issued data, avoids the distinction between the issued data and the received data, and ensures the checking accuracy. Meanwhile, if the comparison result is a comparison failure, the difference exists between the received data and the issued data, and at the moment, the determination module 30 compares the received serial number with the issued serial number to determine the missing target serial number in the received serial number; the target serial number is a cause of inconsistent received data and issued data, and the first preset system lacks records of target data corresponding to the target serial number; and then, the target data corresponding to the target serial number is sent to a first preset system for recording, so that the difference data is quickly corrected, and the consistency between the received data and the actual issued data is ensured.
Further, in another embodiment of the data collation apparatus of the present invention, the determination module further includes:
the reading unit is used for reading the receiving serial numbers and the receiving time corresponding to the received data, and sequencing the receiving serial numbers according to the receiving time to generate a first sequence;
the ordering unit is used for reading the issuing serial numbers and the issuing time corresponding to the issuing data, ordering the issuing serial numbers according to the issuing time and generating a second sequence;
and the comparison unit is used for comparing the first sequence with the second sequence and determining the missing target serial numbers in the received serial numbers.
Further, in another embodiment of the data collation apparatus of the present invention, the collation unit is further configured to:
reading a first intermediate element of the first sequence and a second intermediate element of the second sequence, and judging whether the first intermediate element is consistent with the second intermediate element;
if the first intermediate element is consistent with the second intermediate element, setting a lower subsequence of the first sequence as a new first sequence, setting a lower subsequence of the second sequence as a new second sequence, and executing the step of reading the first intermediate element of the first sequence and the second intermediate element of the second sequence until the first intermediate element and the second intermediate element are inconsistent;
When the first intermediate element and the second intermediate element are inconsistent, comparing between the first element and the second element according to the arrangement sequence of the first element in the first sequence and the second element in the second sequence;
and when the first element and the second element which are inconsistent in the arrangement sequence appear, determining the second element which is inconsistent as a target serial number which is missed in each receiving serial number.
Further, in another embodiment of the data collation apparatus of the present invention, the collation unit is further configured to:
and when the first intermediate element and the second intermediate element are inconsistent, setting the upper subsequence of the first sequence as a new first sequence, setting the upper subsequence of the second sequence as a new second sequence, and executing the step of comparing between each first element and each second element according to the arrangement sequence of the first element in the first sequence and the second element in the second sequence.
Further, in another embodiment of the data collation apparatus of the present invention, the transmission module is further configured to:
and sending target data corresponding to each target serial number to a first preset system as the received data, and executing the step of reading the numerical value of the received data in the first preset system to accumulate and generate a receiving sum until the comparison result is successful in comparison, thereby completing the data check between the first preset system and the second preset system.
Further, in another embodiment of the data collation apparatus of the present invention, the data collation apparatus further comprises:
the statistics module is used for counting the times of generating the comparison result when the detection reaches the second preset time, generating the total comparison times, counting the number of comparison failures of the comparison result, and generating the total failure times;
the judging module is used for making a ratio of the total failure times to the total comparison times to generate a failure rate and judging whether the failure rate is larger than a preset threshold value or not;
and the output module is used for outputting preset early warning information if the preset threshold value is larger than the preset threshold value.
Further, in another embodiment of the data collation apparatus of the present invention, the data collation apparatus further comprises:
the receiving module is used for reading transmission data corresponding to the data transmission request when the data transmission request of the user account is received;
the generation module is used for issuing the transmission data to the user account based on the second preset system and generating a transmission serial number;
the sending module is further configured to send the transmission data and the transmission serial number to the first preset system, so as to record in the first preset system.
The virtual function blocks of the data collation apparatus are stored in the memory 1005 of the data collation apparatus shown in fig. 3, and when the processor 1001 executes the data collation program, the functions of the blocks in the embodiment shown in fig. 2 are realized.
Referring to fig. 3, fig. 3 is a schematic device structure of a hardware running environment related to a method according to an embodiment of the present invention.
The data checking device in the embodiment of the invention can be a PC (personal computer ) or terminal devices such as a smart phone, a tablet personal computer, an electronic book reader, a portable computer and the like.
As shown in fig. 3, the data collation apparatus may include: a processor 1001, such as a CPU (Central Processing Unit ), a memory 1005, and a communication bus 1002. Wherein a communication bus 1002 is used to enable connected communication between the processor 1001 and a memory 1005. The memory 1005 may be a high-speed RAM (random access memory ) or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the data collation device may also include a user interface, a network interface, a camera, RF (Radio Frequency) circuitry, sensors, audio circuitry, wiFi (Wireless Fidelity, wireless broadband) module, and so on. The user interface may comprise a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface may further comprise a standard wired interface, a wireless interface. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface).
It will be appreciated by those skilled in the art that the data collation device structure shown in fig. 3 does not constitute a limitation of the data collation device, and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 3, an operating system, a network communication module, and a data collation program may be included in a memory 1005 as one type of computer-readable storage medium. The operating system is a program that manages and controls the hardware and software resources of the data collation apparatus, supporting the execution of the data collation program and other software and/or programs. The network communication module is used to enable communication between components within the memory 1005 and with other hardware and software in the data collation apparatus.
In the data collation apparatus shown in fig. 3, a processor 1001 is configured to execute a data collation program stored in a memory 1005, implementing the steps in the respective embodiments of the data collation method described above.
The present invention provides a computer-readable storage medium storing one or more programs executable by one or more processors for implementing the steps in the embodiments of the above-described data collation method.
It should also be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a computer readable storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the invention, and all equivalent structural changes made by the specification and drawings of the present invention or direct/indirect application in other related technical fields are included in the scope of the present invention.
Claims (8)
1. A data collation method, characterized by comprising the steps of:
when the detection reaches the first preset time, reading the numerical value of the received data in the first preset system to accumulate, and generating a receiving sum;
accumulating the values of the issued data in a second preset system to generate an issued sum, and comparing the received sum with the issued sum to generate a comparison result, wherein the first preset system is in communication connection with the second preset system;
if the comparison result is that the comparison fails, comparing a receiving serial number set corresponding to the received data with a transmitting serial number set corresponding to the transmitting data, and determining a missing target serial number in the receiving serial number set;
the step of comparing the received serial number set corresponding to the received data with the issued serial number set corresponding to the issued data, and determining the missing target serial number in the received serial number set comprises the following steps:
Reading a receiving serial number and a receiving time corresponding to each received data, and sequencing each receiving serial number according to each receiving time to generate a first sequence;
reading the issuing serial numbers and issuing time corresponding to the issuing data, and ordering the issuing serial numbers according to the issuing time to generate a second sequence;
comparing the first sequence with the second sequence, and determining a missing target serial number in a received serial number set;
the step of comparing the first sequence with the second sequence to determine the missing target serial numbers in the received serial number set comprises the following steps:
reading a first intermediate element of the first sequence and a second intermediate element of the second sequence, and judging whether the first intermediate element is consistent with the second intermediate element;
if the first intermediate element is consistent with the second intermediate element, setting a lower subsequence of the first sequence as a new first sequence, setting a lower subsequence of the second sequence as a new second sequence, and executing the step of reading the first intermediate element of the first sequence and the second intermediate element of the second sequence until the first intermediate element and the second intermediate element are inconsistent;
When the first intermediate element and the second intermediate element are inconsistent, comparing between the first element and the second element according to the arrangement sequence of the first element in the first sequence and the second element in the second sequence;
and when the first element and the second element which are inconsistent in the arrangement sequence appear, determining the second element which is inconsistent as a target serial number which is missed in the receiving serial number set.
2. The data collation method according to claim 1, wherein the step of judging whether the first intermediate element is identical to the second intermediate element further comprises, after the step of judging whether the first intermediate element is identical to the second intermediate element:
and when the first intermediate element and the second intermediate element are inconsistent, setting the upper subsequence of the first sequence as a new first sequence, setting the upper subsequence of the second sequence as a new second sequence, and executing the step of comparing between each first element and each second element according to the arrangement sequence of the first element in the first sequence and the second element in the second sequence.
3. The data collation method according to claim 1, wherein the step of determining the missing target serial numbers in the received serial number set further comprises:
And sending target data corresponding to each target serial number to a first preset system as the received data, and executing the step of reading the numerical value of the received data in the first preset system to accumulate and generate a receiving sum until the comparison result is successful in comparison, thereby completing the data check between the first preset system and the second preset system.
4. A data collation method according to any one of claims 1 to 3, wherein the step of determining a missing target running number in the received running number set comprises, after:
when the detection reaches the second preset time, counting the times of generating the comparison result to generate the total comparison times, counting the number of comparison failures of the comparison result to generate the total failure times;
comparing the total number of failures with the total number of comparison to generate a failure rate, and judging whether the failure rate is larger than a preset threshold value or not;
if the preset threshold value is larger than the preset threshold value, outputting preset early warning information.
5. A data collation method according to any one of claims 1 to 3, wherein the step of reading the value of the received data in the first predetermined system for accumulation when the detection reaches the first predetermined time comprises, before:
When a data transmission request of a user account is received, reading transmission data corresponding to the data transmission request;
issuing the transmission data to the user account based on the second preset system, and generating a transmission serial number;
and sending the transmission data and the transmission serial number to the first preset system to be recorded in the first preset system.
6. A data collation apparatus for use in the data collation method according to any one of claims 1 to 5, characterized in that the data collation apparatus comprises:
the reading module is used for reading the numerical value of the received data in the first preset system to accumulate when the detection reaches the first preset time, so as to generate a receiving sum;
the comparison module is used for accumulating the numerical values of the issued data in the second preset system to generate an issued sum, comparing the received sum with the issued sum to generate a comparison result, wherein the first preset system is in communication connection with the second preset system;
and the determining module is used for comparing the received serial numbers corresponding to the received data with the issued serial numbers corresponding to the issued data if the comparison result is that the comparison fails, and determining the missing target serial numbers in the received serial numbers.
7. A data collation apparatus, characterized by comprising: a memory, a processor, a communication bus, and a data collation program stored on the memory;
the communication bus is used for realizing connection communication between the processor and the memory;
the processor is configured to execute the data collation program to realize the steps of the data collation method according to any one of claims 1 to 5.
8. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a data collation program, which when executed by a processor, realizes the steps of the data collation method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910767885.0A CN110502502B (en) | 2019-08-15 | 2019-08-15 | Data checking method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910767885.0A CN110502502B (en) | 2019-08-15 | 2019-08-15 | Data checking method, device, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110502502A CN110502502A (en) | 2019-11-26 |
| CN110502502B true CN110502502B (en) | 2023-06-23 |
Family
ID=68588842
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910767885.0A Active CN110502502B (en) | 2019-08-15 | 2019-08-15 | Data checking method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110502502B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113157804B (en) * | 2021-03-26 | 2022-10-04 | 北京市商汤科技开发有限公司 | Account checking method and device for synchronous data, computer equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006092391A (en) * | 2004-09-27 | 2006-04-06 | Keyence Corp | Data collator |
| CN103605703A (en) * | 2013-11-08 | 2014-02-26 | 北京奇虎科技有限公司 | Method and system for data consistency detection among multiple platforms |
| WO2018120457A1 (en) * | 2016-12-29 | 2018-07-05 | 平安科技（深圳）有限公司 | Data processing method, apparatus, device, and computer readable storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9659047B2 (en) * | 2014-12-03 | 2017-05-23 | Netapp, Inc. | Data deduplication utilizing extent ID database |
-
2019
- 2019-08-15 CN CN201910767885.0A patent/CN110502502B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006092391A (en) * | 2004-09-27 | 2006-04-06 | Keyence Corp | Data collator |
| CN103605703A (en) * | 2013-11-08 | 2014-02-26 | 北京奇虎科技有限公司 | Method and system for data consistency detection among multiple platforms |
| WO2018120457A1 (en) * | 2016-12-29 | 2018-07-05 | 平安科技（深圳）有限公司 | Data processing method, apparatus, device, and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110502502A (en) | 2019-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3376389A1 (en) | Data processing method and device | |
| US9256513B2 (en) | Method, apparatus and computer readable medium for automatic debugging and error prevention | |
| CN107861832B (en) | Data verification method and device and readable storage medium | |
| CN110262878B (en) | Timed task processing method, device, equipment and computer readable storage medium | |
| CN112684982B (en) | Data migration method, system, equipment and computer readable storage medium | |
| CN110264171B (en) | Distributed bill processing method, device, equipment and computer readable storage medium | |
| CN112817866A (en) | Recording playback method, device, system, computer equipment and storage medium | |
| CN110502502B (en) | Data checking method, device, equipment and computer readable storage medium | |
| CN108897765A (en) | A kind of batch data introduction method and its system | |
| CN115495496A (en) | Data export method, device, electronic equipment, storage medium and program product | |
| CN110609967B (en) | List generation method and device and storage medium | |
| CN111625580A (en) | Data processing method, device and equipment | |
| CN111353841B (en) | Document data processing method, device and system | |
| CN108829495B (en) | Verification method, device, equipment and storage medium for multi-database modification transaction | |
| CN111402620B (en) | Arrival reminding method, device, terminal and storage medium | |
| CN102843369B (en) | The Network Access Method at UI interface and system | |
| CN112256672A (en) | Database change approval method and device | |
| US11665114B2 (en) | Information processing apparatus and non-transitory computer readable medium for determination of message and member suitability for tasks | |
| CN105989021A (en) | Document processing method and device | |
| CN112632083A (en) | Method, device and equipment for updating index data | |
| CN111488252A (en) | Flow playback method and device | |
| CN114004662B (en) | Resource verification and cancellation method and device, storage medium and computing equipment | |
| CN116991542B (en) | Virtual machine snapshot method, system, electronic equipment and computer storage medium | |
| CN113254357A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN116954980A (en) | Verification rule configuration method, data verification method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |