CN113435170A

CN113435170A - Data verification method and device, electronic equipment and storage medium

Info

Publication number: CN113435170A
Application number: CN202110707659.0A
Authority: CN
Inventors: 陆海鹏
Original assignee: Ping An International Smart City Technology Co Ltd
Current assignee: Ping An International Smart City Technology Co Ltd
Priority date: 2021-06-24
Filing date: 2021-06-24
Publication date: 2021-09-24

Abstract

The embodiment of the application discloses a data verification method and device, electronic equipment and a storage medium, and is applied to the technical field of data processing. The method comprises the following steps: when a table verification instruction is detected, a table to be verified is obtained according to the table verification instruction, an instruction set configured for the table to be verified is obtained, the instruction set comprises a serial number of the column to be verified of the table to be verified and a corresponding verification item list, the verification item list comprises at least one verification item, each row of data of the table to be verified is read, column data corresponding to the serial number of the column to be verified is obtained from each row of data, the column data is verified according to the verification item list, a verification result is obtained, the row of data where the column data is located is added into a target table according to the verification result, and the target table is output through a user terminal. By adopting the embodiment of the application, the table data checking efficiency can be improved. The present application relates to blockchain techniques, such as target tables and the like may be written to a blockchain.

Description

Data verification method and device, electronic equipment and storage medium

Technical Field

The present application relates to the field of data processing technologies, and in particular, to a data verification method and apparatus, an electronic device, and a storage medium.

Background

The table data check is a very complicated and error-prone task in the actual project. If the abnormal table data is not found in time, the loss will be caused to the individual or the company. For example, after importing the table data into the system database, the system may run abnormally due to the abnormal table data in the system database. It can be seen that the table data check is very important. At present, table data verification needs to firstly display a table at the front end, then operate the table to select a target cell in the table, and then perform a series of complex and cumbersome configurations for the target cell in the table to perform the verification of the table data. However, when the table data is checked in this way, especially when the number of tables is large or the tables are very complex, the efficiency of checking the table data is very low.

Disclosure of Invention

The embodiment of the application provides a data verification method, a data verification device, electronic equipment and a storage medium, and can improve the efficiency of table data verification.

In one aspect, an embodiment of the present application provides a data verification method, where the method includes:

when a table checking instruction is detected, acquiring a table to be checked according to the table checking instruction, and acquiring an instruction set configured for the table to be checked; the instruction set comprises a serial number of a column to be verified of the table to be verified and a verification item list corresponding to the serial number of the column to be verified, and the verification item list comprises at least one verification item;

reading each row of data of the table to be verified, and acquiring column data corresponding to the serial number of the column to be verified from each row of data;

verifying the column data according to the verification item list to obtain a verification result;

and adding the row data of the column data into a target table according to the verification result, and outputting the target table through a user terminal.

In a possible implementation manner, the verifying the column data according to the check item list to obtain a verification result includes:

sorting all the check items in the check item list by using a weight parameter list to obtain a sorted check item list; the weight parameter list comprises the weight parameter of each check item in a plurality of check items;

and verifying the column data according to the sorted check item list to obtain a verification result.

In one possible embodiment, the method further comprises:

acquiring the average verification duration of each verification item in the plurality of verification items;

determining a weight parameter of each check item according to the average check duration of each check item;

and generating the weight parameter list according to the weight parameter of each check item.

In a possible implementation manner, the verifying the column of data according to the sorted check item list to obtain a verification result includes:

determining a check function corresponding to each check item in the sorted check item list;

and according to the checking sequence indicated by the sorted checking item list, sequentially calling the checking functions corresponding to the checking items to check the column data to obtain a checking result.

In a possible implementation manner, the obtaining, from each row of data, column data corresponding to the column serial number to be checked includes:

reading the serial number of the column to be checked from the instruction set;

generating a column sequence number table comprising the sequence numbers of the columns to be checked;

and traversing the column sequence number table to acquire column data corresponding to the column sequence number to be verified from each row of data.

In a possible implementation manner, the adding, according to the verification result, the row data where the column data is located to the target table includes:

when the verification result is a verification failure result, adding row data where the column data is located to a verification failure table; the table which fails in the verification is the target table;

when the verification result is a successful verification result, adding the row data of the column data to a successfully verified table; and the table which is successfully verified is the target table.

In a possible embodiment, the table to be checked includes at least two sub-tables to be checked; the method further comprises the following steps:

counting the number of the sub-tables to be checked;

creating a target number of threads according to the number of the sub-tables to be checked, and distributing at least one sub-table to be checked for each thread in the target number of threads;

the verifying the column data according to the verification item list to obtain a verification result includes:

and calling each thread to check the column data corresponding to the serial number of the column to be checked according to the check item list corresponding to the serial number of the column to be checked in at least one sub-table to be checked distributed respectively, so as to obtain the check result.

In one aspect, an embodiment of the present application provides a data verification apparatus, where the apparatus includes:

the system comprises an acquisition module, a verification module and a verification module, wherein the acquisition module is used for acquiring a table to be verified according to a table verification instruction when the table verification instruction is detected, and acquiring an instruction set configured for the table to be verified; the instruction set comprises a serial number of a column to be verified of the table to be verified and a verification item list corresponding to the serial number of the column to be verified, and the verification item list comprises at least one verification item;

the obtaining module is further configured to read each row of data of the table to be verified, and obtain column data corresponding to the column serial number to be verified from each row of data;

the verification module is used for verifying the column data according to the verification item list to obtain a verification result;

and the output module is used for adding the row data of the column data into a target table according to the verification result and outputting the target table through a user terminal.

In one aspect, an embodiment of the present application provides an electronic device, where the electronic device includes a processor and a memory, where the memory is used to store a computer program, the computer program includes program instructions, and the processor is configured to call the program instructions, and perform the following steps: when a table checking instruction is detected, acquiring a table to be checked according to the table checking instruction, and acquiring an instruction set configured for the table to be checked; the instruction set comprises a serial number of a column to be verified of the table to be verified and a verification item list corresponding to the serial number of the column to be verified, and the verification item list comprises at least one verification item; reading each row of data of the table to be verified, and acquiring column data corresponding to the serial number of the column to be verified from each row of data; verifying the column data according to the verification item list to obtain a verification result; and adding the row data of the column data into a target table according to the verification result, and outputting the target table through a user terminal.

In one aspect, the present application provides a computer-readable storage medium, which stores a computer program, where the computer program includes program instructions, and the program instructions, when executed by a processor, are used to perform some or all of the steps of the above method.

In the embodiment of the application, when a table verification instruction is detected, a table to be verified can be obtained according to the table verification instruction, an instruction set configured for the table to be verified is obtained, each row of data of the table to be verified is read, column data corresponding to the serial number of the column to be verified is obtained from each row of data, the column data is verified according to a verification item list included in the instruction set, a verification result is obtained, row data where the column data is located is added into a target table according to the verification result, and the target table is output through a user terminal. By implementing the method, the check item list corresponding to the serial number of the column to be checked in the table to be checked can be obtained according to the obtained instruction set configured for the table to be checked, the column data can be checked by utilizing the check item list, the flexibility of table data checking can be improved through the check item list, the configuration process of data checking can be simplified, and further the efficiency of table data checking can be improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic diagram of an application architecture according to an embodiment of the present application;

fig. 2 is a schematic flowchart of a data verification method according to an embodiment of the present application;

FIG. 3 is a schematic diagram illustrating a scenario of a configuration instruction set according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a target table according to an embodiment of the present application;

fig. 5 is a schematic flowchart of a data verification method according to an embodiment of the present application;

FIG. 6 is a schematic diagram illustrating a scenario of a configuration instruction set according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a target table according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a data verification apparatus according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

The data verification method provided by the embodiment of the application is implemented in electronic equipment, and the electronic equipment can be terminal equipment or a server. The terminal device can be a smart phone, a tablet computer, a notebook computer, a desktop computer and the like. The server may be an independent physical server, a server cluster or a distributed system configured by a plurality of physical servers, a cloud server, or the like, but is not limited thereto. The application relates to a block chain technology, and an electronic device can write related data such as a target table, a check function corresponding to a check item and the like into a block chain, so that the electronic device can obtain required information such as the target table on the block chain.

Referring to fig. 1, fig. 1 is a schematic view of an application architecture provided in an embodiment of the present application, through which a data verification method provided in the present application can be executed. Specifically, fig. 1 may include an electronic device, and a user terminal for outputting a target form. The electronic device can acquire the table to be checked according to the table checking instruction sent by the user terminal by executing the technical scheme of the application, and check the table to be checked by using the instruction set configured for the table to be checked, so that the target table can be obtained according to the checking result, the target table is output by the user terminal, and the user terminal can also respond to the operation of the target user to perform data correction processing on the target table, so that the table data checking efficiency can be effectively improved.

It should be understood that fig. 1 merely represents an application architecture provided by the present technical solution by way of example, and does not limit the specific architecture of the present technical solution, that is, the present technical solution may also provide other forms of application architectures.

In some embodiments, the electronic device may execute the data verification method according to actual business requirements, so as to improve the efficiency of table data verification. The technical scheme of the application can be applied to a checking scene of any table data, namely, the electronic device can check the column data in the table to be checked according to the checking item list included in the instruction set through the technical scheme of the application, and obtain the target table according to the checking result. For example, the technical scheme of the application can be used in a scene of importing the table data into the system database, and if a large amount of non-compliant or incorrect data exists in the table data in the system database, the system may operate abnormally, so that the electronic device can verify the column data in the table to be verified through the technical scheme of the application to realize verification before data import, and thus correct table data can be obtained. It can be understood that, in the application scenario, the target table based on the verification processing can be acquired before data import through the technical scheme of the application, and the correct table data can be acquired according to the target table, so that the correct table data can be imported subsequently to ensure that the system operates normally.

It should be understood that the foregoing scenarios are only examples, and do not constitute a limitation on application scenarios of the technical solutions provided in the embodiments of the present application, and the technical solutions of the present application may also be applied to other scenarios. For example, as can be known by those skilled in the art, with the evolution of system architecture and the emergence of new service scenarios, the technical solution provided in the embodiments of the present application is also applicable to similar technical problems.

Based on the above description, the present application embodiment proposes a data verification method, which may be performed by the above-mentioned electronic device. As shown in fig. 2, the flow of the data verification method according to the embodiment of the present application may include the following steps:

s201, when a table verification instruction is detected, obtaining a table to be verified according to the table verification instruction, and obtaining an instruction set configured for the table to be verified.

The instruction set may include a to-be-verified column sequence number of the to-be-verified table and a verification item list corresponding to the to-be-verified column sequence number, where the verification item list includes at least one verification item.

In one possible embodiment, when the table verification instruction is detected, the electronic device may be triggered to acquire the table to be verified, for example, the electronic device is triggered to acquire the table to be verified from a specified storage area. In an embodiment, the table verification instruction may carry identification information of the table to be verified (for example, the identification information includes a name of the table to be verified), or carry location indication information of the table to be verified (for example, the location information includes a storage path of the table to be verified). Correspondingly, when the table verification instruction is detected, the table to be verified can be obtained according to the identification information or the position information of the table to be verified carried by the table verification instruction. The form to be verified may be one form or multiple forms, for example, multiple forms of data belonging to the same type (when the form is multiple forms of data, the form may also be a sub-form to be verified, that is, the form to be verified may include at least two sub-forms to be verified), and the multiple forms of data of the same type are in the same data format of each column constituting the multiple forms of data. The form verification instruction may be sent by the target terminal to the electronic device. When the form to be verified is one or more, the principle and process of verification are the same, and for convenience of explanation, the form to be verified is taken as an example for explanation.

In a possible implementation manner, the electronic device obtains the instruction set configured for the table to be verified, where the instruction set is configured by the target terminal and then sent to the electronic device, or the instruction set is configured by the target terminal and is stored in the electronic device in advance, and when the electronic device obtains the table to be verified, the stored instruction set configured for the table to be verified is obtained. It is understood that instruction sets configured for a plurality of types of table data may be stored in the electronic device in advance, and the target terminal may manage the instruction sets in the electronic device, such as adding, deleting, and modifying.

In a possible embodiment, the configuration method of the instruction set may be configured in the target terminal through a command, or may be configured through a configuration interface provided by the target terminal. And configuring the serial number of the column to be verified in the table to be verified and a verification item list corresponding to the serial number of the column to be verified during configuration. Each check term may correspond to a check function, and the check term may include but is not limited to: checking a front space and a rear space, checking a null value, checking characters containing judgment, checking a fixed value, checking date validity, comparing data values, checking data length, checking enterprise unified social coding validity and the like; accordingly, the check function corresponding to the check term may include, but is not limited to: the data verification method comprises a space verification function before and after data, a data null value verification function, a character inclusion judgment verification function, a fixed value verification function, a date validity verification function, a data value size comparison verification function, a data length verification function and an enterprise unified social coding validity verification function. It can be understood that, when a single column of data needs to be verified, that is, when a column of data corresponding to a single column of serial number to be verified needs to be verified, a check item list corresponding to the column of serial number to be verified and a check item list corresponding to one column of serial number to be verified need to be configured, and check item lists between serial numbers of columns to be verified are independent.

For example, as shown in fig. 3, fig. 3 is a scene schematic diagram of a configuration instruction set provided in the embodiment of the present application, where a target user (which may be a related service person) may perform configuration for an instruction set of a table to be verified through a configuration interface provided by a target terminal, first select a column number 8 to be verified, select a check item 1 corresponding to the column number 8 to be verified, generate a check item list corresponding to the column number 8 to be verified based on the selected check item, and may continue configuration of the column number to be verified and the check item list by triggering a "new addition" control.

S202, reading each row of data of the table to be verified, and acquiring column data corresponding to the serial number of the column to be verified from each row of data.

In one possible implementation manner, the electronic device sequentially reads each row of data in the table to be verified, and sequentially obtains corresponding column data from the read row of data according to the column serial number to be verified, so as to verify the column data. The electronic device may specifically acquire the column data corresponding to the column serial number to be verified from each row of data by reading the column serial number to be verified from an instruction set corresponding to the table to be verified, and acquiring the corresponding column data from each row of data according to the read column serial number to be verified; or, after the read to-be-verified column sequence number, a column sequence number table including the to-be-verified column sequence number is generated, and the column sequence number table is traversed to acquire the column data corresponding to the to-be-verified column sequence number from each row of data.

In some embodiments, the electronic device may sequentially verify the column data corresponding to the to-be-verified column serial number included in each row of data after reading each row of data, or may read the next row of data again and verify the column data corresponding to the to-be-verified column serial number included in the next row of data after reading one row of data and completing verification of the column data corresponding to the to-be-verified column serial number included in the next row of data until all the row of data is verified. The verification process refers to a process of verifying column data according to the check item list.

And S203, verifying the column data according to the verification item list to obtain a verification result.

In a possible implementation manner, the electronic device may obtain the serial number of the column to be verified and the corresponding check item list from the instruction set, and verify the column data corresponding to the serial number of the column to be verified according to the check item list corresponding to the serial number of the column to be verified, thereby obtaining a verification result. It can be understood that one row of data corresponds to one verification result, and when the table to be verified includes a plurality of row of data, a plurality of verification results are obtained. The verification result may be a result of successful verification or a result of failed verification, and the verification result may include information of successful verification or information of failed verification.

In one possible embodiment, the check item list includes at least one check item, and the check item may be used to check the column data. Therefore, the electronic device verifies the column data according to the check item list, and the verification result may be obtained specifically by determining the check function corresponding to each check item in the check item list, and sequentially calling the check function corresponding to each check item to verify the column data corresponding to the to-be-verified column serial number according to the verification sequence indicated by the check item list corresponding to the to-be-verified column serial number, so as to obtain the verification result. The determining of the check function corresponding to each check item in the check item list may specifically be that the check item is used as a parameter to check the check function corresponding to the check item in the function call interface; the specific step of calling the check function corresponding to each check item to check the column data corresponding to the to-be-checked column serial number may be to transmit the column data to the check function to check. It can be understood that, when the column data is verified according to the verification sequence indicated by the verification item list, when the verification function of the verification item indicates that the verification is failed, it indicates that the column data corresponding to the column serial number to be verified is a verification failure, and also indicates that the verification result of the row data where the column data is located is a verification failure, the electronic device may not verify the column data any more, and may perform verification of the column data corresponding to the next column serial number to be verified.

For example, the serial numbers of the columns to be verified of the table to be verified are 1 and 5, the check item list corresponding to the serial number 1 of the table to be verified is data null check/data front and back space check/fixed value check, the check item list corresponding to the serial number 5 of the table to be verified is data length check function/date validity check, the electronic device reads the ith row of data and obtains the column data corresponding to the serial numbers 1 and 5 in the ith row of data, according to the check sequence indicated by the check item list, the check functions (data null check function/data front and back space check function/fixed value check function) corresponding to each check item are sequentially called to check the column data corresponding to the column serial number 1, if the data column data is checked by calling the data front and back space check functions, the check result is check failure, namely, the check result of the ith row of data fails, the electronic equipment does not check the column data corresponding to the column serial number 1 any more, and checks the column data corresponding to the next column serial number to be checked, namely, checks the column data corresponding to the column serial number 5, wherein the checking mode can be the same as that of the column data corresponding to the column serial number 1; optionally, the verification result may further include a reason of the verification failure, that is, the verification result may include that the verification result is the verification failure when the column data with the column serial number x in the ith row of data is subjected to space verification before and after the data.

And S204, adding the row data of the column data into the target table according to the verification result, and outputting the target table through the user terminal.

In one possible implementation, the electronic device may add the row data where the column data is located to the target table according to the verification result. Specifically, the electronic device may add the row data where the column data is located to the target table according to the verification result, where the electronic device determines a display mode matched with the row data where the column data is located according to the verification result, and adds the column data to the target table through the matched display mode. For example, the display mode of the row data where the column data with the verification result of successful verification is located is not marked, the display mode of the row data where the column data with the verification result of failed verification is located is underlined, and further, the column data with the verification failure may be displayed in different colors according to the reason of the verification failure, and if the column data fails verification during null verification, the column data is displayed in a red state, and the like.

For example, as shown in fig. 4, fig. 4 is a schematic diagram of a target table provided in an embodiment of the present application, where row data without any mark is row data with successful verification, row data with underline is row data with failed verification, and in the row data with failed verification, column data without any mark is column data not corresponding to a column number to be verified, that is, data verification is not performed, column data with double underline is column data with successful verification, and column data marked with red (gray in fig. 4) is column data with failed verification when null value verification is performed; further optionally, the corresponding check result may be output when the target table is output.

In some embodiments, after obtaining the target form, the electronic device may output the target form through the user terminal, and the target user may view the target form obtained after the form to be checked is checked through the user terminal, and may perform a correlation process on the target form, such as a data correction process.

In the embodiment of the application, when a table verification instruction is detected, the electronic device may obtain a table to be verified according to the table verification instruction, obtain an instruction set configured for the table to be verified, read each row of data of the table to be verified, obtain column data corresponding to a column number to be verified from each row of data, verify the column data according to the verification item list to obtain a verification result, add the row of data where the column data is located to the target table according to the verification result, and output the target table through the user terminal. By implementing the method provided by the embodiment of the application, the check item list corresponding to the serial number of the column to be checked in the table to be checked can be obtained according to the obtained instruction set configured for the table to be checked, the column data is checked by using the check item list, the flexibility of table data checking can be improved through the check item list, the configuration process of data checking can be simplified, and further the efficiency of table data checking can be improved.

Referring to fig. 5, fig. 5 is a schematic flowchart illustrating a data verification method according to an embodiment of the present application, where the method can be executed by the above-mentioned electronic device. As shown in fig. 5, the flow of the data verification method in the embodiment of the present application may include the following steps:

s501, when a table verification instruction is detected, obtaining a table to be verified according to the table verification instruction, and obtaining an instruction set configured for the table to be verified.

In a possible embodiment, the instruction set may include, in addition to the check item list corresponding to a single to-be-checked column sequence number, a check item list having an associated column sequence number to be checked, that is, when a preset condition is satisfied, column data corresponding to the associated column sequence number to be checked of the to-be-checked column sequence number may be checked to implement association check. If the table to be checked has a plurality of column sequence numbers with an association relationship, association configuration can be realized through the instruction set, so that checking efficiency is improved.

It can be understood that, when configuring the instruction set of the table to be verified, if the configuration of verifying the serial number of the associated column to be verified needs to be performed, the check item list corresponding to the serial number of the column to be verified and the associated verification condition may be configured, and the check item list corresponding to the serial number of the associated column to be verified may be configured. Therefore, a check item list corresponding to one to-be-checked column serial number (to-be-checked associated column serial number) may be independent or may not be independent between the to-be-checked column serial numbers (to-be-checked associated column serial numbers). And the serial number of the associated column to be verified only aims at the serial number of the column to be verified, and for the table to be verified, the serial number of the associated column to be verified can also be called as the serial number of the column to be verified. For example, the column number to be checked 8 has the associated column number to be checked 2, and for the table to be checked, the column number to be checked may be 8, 2. In addition, the method for verifying the column data by using the check item list of the to-be-verified column serial number may be the same as the method for verifying the column data by using the check item list of the to-be-verified associated column serial number.

For example, as shown in fig. 6, fig. 6 is a scene schematic diagram of a configuration instruction set provided in the embodiment of the present application, where a target user (which may be a relevant service person) may configure an instruction set for a table to be checked through a configuration interface provided by a target terminal, first select a column serial number 8 to be checked, select check items 1 and 2 corresponding to the column serial number 8 to be checked, and generate a check item list corresponding to the column serial number to be checked based on the selected check item; and setting a correlation verification condition, namely performing correlation verification when the column data corresponding to the column serial number 8 is verified as indicated by the verification item 2 and if verification shows that the column data is 'product production'; selecting a serial number 2 of the associated column to be verified, selecting a verification item 1 corresponding to the serial number 2 of the associated column to be verified, and generating a verification item list corresponding to the serial number 2 of the associated column to be verified based on the selected verification item; the configuration of the serial number of the column to be verified and the verification item list can be continued by triggering the 'newly added' control; the resulting instruction set for the above configuration may illustratively have the structure:

{

"8" [ "nullCheck", "spaceCheck",// wherein "8" represents the column data corresponding to the column serial number 8 to be checked, "nullCheck" represents null check, and "spaceCheck" represents the check of the previous and next spaces;

{

"production of product" [ {// wherein "production of product" means that when a fixed value verification is performed, the column of data is production of product, and the following verification is performed;

"1" [ "dateCheck" ],// wherein, "1" represents the column data corresponding to the column number 1 to be checked, and "dateCheck" represents the date validity check;

"2" [ "nullCheck", "spaceCk", "fixValueCcek: zzz" ],// wherein "2" represents the column data corresponding to the column number 2 to be checked, and "fixValueCcek: zzz" represents the fixed value check;

"3" [ "societyCodeCheck" ]// wherein, "3" represents the column data corresponding to the column serial number 3 to be checked, and "societyCodeCheck" represents the validity check of the unified social code of the enterprise;

},

{

"product operation" [ {// wherein, "product operation" means that when a fixed value check is performed, the column of data is the product operation, and the following check is performed;

"2":["nullCheck","spaceCheck","fixValueChcek:aaa"],

"4" [ "dateCheck" ],// wherein "4" represents the column data corresponding to the column number 4 to be checked

"5" [ "fixValueCcek: ccc" ]// wherein "5" represents the column data corresponding to the column number 5 to be checked

}

]

}

S502, reading each row of data of the table to be verified, and acquiring column data corresponding to the serial number of the column to be verified from each row of data. For a specific implementation of step S502, refer to the above description of step S202.

S503, sorting all the check items in the check item list by using the weight parameter list to obtain a sorted check item list.

The check items in the check item list are sorted from large to small according to the weight parameters corresponding to the check items, and the sorted check item list can represent the optimal check sequence for checking the column data.

In one possible embodiment, the weight parameter of the check item may be set by the relevant service personnel. For example, if the check item list is fixed value check/previous and subsequent space check/null value check, the weight parameters of each check item in the check item list are obtained according to the weight parameter list of the check item, namely [ null value check-1 ], [ previous and subsequent space check-0.8 ], [ fixed value check-0.7 ], so that after the plurality of check items in the check item list are sequenced, the sequenced check item list is obtained as null value check/previous and subsequent space check/fixed value check. The checking sequence indicated by the sorted checking item list is used for checking, so that the checking efficiency can be improved.

Or, the manner of determining the weight parameter of the check item may also be that an average check duration of each check item in the plurality of check items is obtained, the weight parameter of each check item is determined according to the average check duration of each check item, and a weight parameter list is generated according to the weight of each check item. The average verification duration may be an average time for verifying the table data by calling a verification function corresponding to the verification term, and the longer the average verification duration is, the longer the time consumed by the verification term is, so that the larger the weight parameter of the verification term with the shorter average verification duration may be. Further, an average error checking rate of each check item may be obtained, where the average error checking rate may be a probability that the column of data is erroneous, that is, a check result is a probability of a check failure, and the larger the average error checking rate is, the larger the probability that the check result is a failure is, and thus, the larger the average error checking rate is, the larger the weight parameter of the check item may be. Optionally, the weight parameter of the check item may be determined comprehensively according to the obtained average check duration and the average error rate, so as to ensure that the value of the weight parameter is more accurate.

S504, verifying the column data according to the sorted check item list to obtain a verification result.

In a possible implementation manner, the specific manner of the electronic device performing verification may be to determine a verification function corresponding to each verification item in a sorted list of verification items corresponding to the sequence number of the column to be verified, and sequentially call the verification function corresponding to each verification item to verify the column data corresponding to the sequence number of the column to be verified according to a verification sequence indicated by the sorted list of verification items, so as to obtain a verification result. The specific description of the manner of determining the check function and obtaining the check result may refer to the related description of step S203, which is not described herein again.

And S505, adding the row data of the column data to the target table according to the verification result, and outputting the target table through the user terminal.

In one possible implementation, there is one check result for each row of data. Therefore, when the verification result is a verification failure result, the electronic device may add the row of data where the row of data is located to the verification failure table, where the verification failure table is the target table; and when the verification result is a successful verification result, adding the row data where the row of data is located to the successfully verified table, wherein the successfully verified table is the target table. That is, the electronic device adds the row data that was successfully verified to the table that was successfully verified, adds the row data that was unsuccessfully verified to the table that was unsuccessfully verified, and outputs the target tables (the table that was successfully verified and the table that was unsuccessfully verified) through the user terminal.

Further, after the electronic device outputs the target form and the corresponding verification result through the user terminal, the target user may perform data correction processing on the form that fails to be verified at the user terminal, the user terminal may send the corrected form to the electronic device after obtaining the corrected form based on the user operation, that is, when the correct form corresponds to the form that fails to be verified, and when receiving the corrected form, the electronic device may obtain a final form corresponding to the form to be verified according to the corrected form and the form that is correct to be verified, and may store the final form (for example, import the final form into a system database).

For example, as shown in fig. 7, fig. 7 is a schematic diagram of a target table provided in the embodiment of the present application, where the target table includes a table with successful verification and a table with failed verification, the table with successful verification includes row data with successful verification, and the table with failed verification includes row data with failed verification and may also include a verification result with failed verification; optionally, when the target terminal outputs the target table, the table with successful verification and the table with failed verification may be checked separately (i.e., fig. 7(1)), or may be selected to be checked in a combined manner (i.e., as shown in fig. 4); optionally, the target terminal may perform data correction processing on the table that fails to be verified to obtain a corresponding correct table (i.e., fig. 7 (2)); when the electronic device receives the correct table corresponding to the table failed in verification, the final table corresponding to the table to be verified can be obtained according to the correct table and the table correct in verification, that is, each line of data in the correct table can be inserted into the corresponding position in the table correct in verification according to the primary key of each line of data in the correct table, so as to obtain the final table (fig. 7 (3)).

Optionally, as a possible implementation manner, when the to-be-verified table includes at least two to-be-verified sub-tables, in order to accelerate verification, a thread creating manner may be used, that is, the number of the to-be-verified sub-tables is counted, the number of the target data threads is created according to the number of the to-be-verified sub-tables, at least one to-be-verified sub-table is allocated to each thread of the number of the target data threads, and then the electronic device verifies the column data according to the verification item list to obtain the verification result, specifically, each thread is called to verify the column data corresponding to the to-be-verified column serial number according to the verification item list corresponding to the to-be-verified column serial number in the at least one to-be-verified sub-table allocated to each thread, so as to obtain the verification result. The specific implementation manner of calling the thread to verify the allocated sub-table to be verified can be the same as the specific implementation manner of verifying the corresponding table to be verified described above; each row of data in the sub-table to be checked may correspond to a check result, and thus the obtained target table may be a sub-table to be checked corresponding to a target table, or a sub-table to be checked corresponding to a table that is checked successfully and a table that is checked unsuccessfully (i.e., two target tables).

In the embodiment of the application, when a table verification instruction is detected, the electronic device may obtain a table to be verified according to the table verification instruction, obtain an instruction set configured for the table to be verified, read each row of data of the table to be verified, obtain column data corresponding to a column number to be verified from each row of data, sort each verification item in the verification item list by using the weight parameter list to obtain a sorted verification item list, verify the column data according to the sorted verification item list to obtain a verification result, add the row of data where the column data is located to the target table according to the verification result, and output the target table through the user terminal. By implementing the method provided by the embodiment of the application, the check item list corresponding to the sequence number of the to-be-checked column can be sorted by using the weight parameter list of the check item according to the acquired instruction set configured for the to-be-checked table, the column data can be checked by using the sorted check item list, the optimal check sequence can be acquired by using the sorted check item list, and the flexibility and the efficiency of checking the table data can be further improved.

Please refer to fig. 8, fig. 8 is a schematic structural diagram of a data verification apparatus provided in the present application. It should be noted that the data verification apparatus shown in fig. 8 is used for executing the method of the embodiment shown in fig. 2 and fig. 5 of the present application, and for convenience of description, only the portion related to the embodiment of the present application is shown, and details of the specific technology are not disclosed, and reference is made to the embodiment shown in fig. 2 and fig. 5 of the present application. The data verification apparatus 800 may include: an acquisition module 801, a verification module 802 and an output module 803. Wherein:

an obtaining module 801, configured to, when a table verification instruction is detected, obtain a table to be verified according to the table verification instruction, and obtain an instruction set configured for the table to be verified; the instruction set comprises a serial number of a column to be verified of the table to be verified and a verification item list corresponding to the serial number of the column to be verified, and the verification item list comprises at least one verification item;

the obtaining module 801 is further configured to read each row of data of the table to be verified, and obtain column data corresponding to the column serial number to be verified from each row of data;

the verification module 802 is configured to verify the column data according to the verification item list to obtain a verification result;

and the output module 803 is configured to add the row data where the column data is located to a target table according to the verification result, and output the target table through a user terminal.

In a possible implementation manner, when the verification module 802 is configured to verify the column data according to the check item list to obtain a verification result, specifically:

In one possible implementation, the checking module 802 is further configured to:

In a possible implementation manner, when the checking module 802 is configured to check the column data according to the sorted check item list to obtain a checking result, specifically:

In a possible implementation manner, when the obtaining module 801 is configured to obtain the column data corresponding to the to-be-verified column serial number from each row of data, specifically:

reading the serial number of the column to be checked from the instruction set;

In a possible implementation manner, when the output module 803 is used to add the row data where the column data is located to the target table according to the verification result, it is specifically used to:

In one possible embodiment, the table to be checked comprises at least two sub-tables to be checked; the verification module 802 is further configured to:

counting the number of the sub-tables to be checked;

the verification module 802 is configured to, when being configured to verify the column data according to the verification item list to obtain a verification result, specifically configured to:

In the embodiment of the application, when a table verification instruction is detected, an obtaining module obtains a table to be verified according to the table verification instruction, and obtains an instruction set configured for the table to be verified, wherein the instruction set comprises a serial number of a column to be verified of the table to be verified and a check item list corresponding to the serial number of the column to be verified, and the check item list comprises at least one check item; the acquisition module reads each row of data of the table to be verified and acquires column data corresponding to the serial number of the column to be verified from each row of data; the verification module verifies the column data according to the verification item list to obtain a verification result; and the output module adds the row data of the column data to the target table according to the verification result and outputs the target table through the user terminal. By implementing the device, the check item list corresponding to the serial number of the column to be checked in the table to be checked can be obtained according to the obtained instruction set configured for the table to be checked, the column data can be checked by utilizing the check item list, the flexibility of table data checking can be improved through the check item list, the configuration process of data checking can be simplified, and further the efficiency of table data checking can be improved.

Each functional module in the embodiments of the present application may be integrated into one module, or each module may exist alone physically, or two or more modules are integrated into one module. The integrated module may be implemented in a form of hardware, or may be implemented in a form of software functional module, which is not limited in this application.

Referring to fig. 9, fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in fig. 9, the electronic device 900 includes: at least one processor 901, memory 902. Optionally, the electronic device may further include a network interface. The processor 901, the memory 902 and the network interface may exchange data with each other, the network interface may be controlled by the processor 901 to send and receive messages, the memory 902 is used to store a computer program, the computer program includes program instructions, and the processor 901 is used to execute the program instructions stored in the memory 902. Wherein the processor 901 is configured to call the program instructions to execute the above method.

The memory 902 may include volatile memory (volatile memory), such as random-access memory (RAM); the memory 902 may also include a non-volatile memory (non-volatile memory), such as a flash memory (flash memory), a solid-state drive (SSD), etc.; the memory 902 may also comprise a combination of memories of the kind described above.

The processor 901 may be a Central Processing Unit (CPU). In one embodiment, the processor 901 may also be a Graphics Processing Unit (GPU). The processor 901 may also be a combination of a CPU and a GPU.

In one possible implementation, the memory 902 is used to store program instructions. The processor 901 may call the program instructions to perform the following steps:

In a possible embodiment, when the processor 901 is configured to verify the column data according to the check item list to obtain a verification result, specifically, to:

In one possible implementation, the processor 901 is further configured to:

In a possible embodiment, when the processor 901 is configured to verify the column data according to the sorted check item list to obtain a verification result, specifically, to:

In a possible embodiment, when the processor 901 is configured to obtain the column data corresponding to the to-be-verified column serial number from each row of data, specifically, to:

reading the serial number of the column to be checked from the instruction set;

In a possible embodiment, when the processor 901 is configured to add the row data where the column data is located to the target table according to the verification result, specifically configured to:

In one possible embodiment, the table to be checked comprises at least two sub-tables to be checked; the processor 901 is further configured to:

counting the number of the sub-tables to be checked;

In a specific implementation, the apparatus, the processor 901, the memory 902, and the like described in this embodiment of the application may execute the implementation described in the above method embodiment, and may also execute the implementation described in this embodiment of the application, which is not described herein again.

Also provided in embodiments of the present application is a computer (readable) storage medium storing a computer program comprising program instructions that, when executed by a processor, cause the processor to perform some or all of the steps performed in the above-described method embodiments. Alternatively, the computer storage media may be volatile or nonvolatile. The computer-readable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the blockchain node, and the like.

The block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism and an encryption algorithm. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.

Reference herein to "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which may be stored in a computer storage medium, and the computer storage medium may be a computer readable storage medium, and when executed, the programs may include the processes of the above embodiments of the methods. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

While the present disclosure has been described with reference to particular embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present disclosure.

Claims

1. A method for data verification, the method comprising:

2. The method of claim 1, wherein the verifying the column of data according to the check item list to obtain a verification result comprises:

3. The method of claim 2, further comprising:

4. The method of claim 2, wherein the verifying the column data according to the sorted list of check entries to obtain a verification result comprises:

5. The method according to claim 1, wherein the obtaining of the column data corresponding to the column serial number to be verified from each row of data includes:

reading the serial number of the column to be checked from the instruction set;

6. The method according to claim 1, wherein the adding the row data where the column data is located to the target table according to the verification result comprises:

7. The method according to claim 1, wherein the table to be verified comprises at least two sub-tables to be verified; the method further comprises the following steps:

counting the number of the sub-tables to be checked;

8. A data verification apparatus, the apparatus comprising:

9. An electronic device comprising a processor and a memory, wherein the memory is configured to store a computer program comprising program instructions, and wherein the processor is configured to invoke the program instructions to perform the method of any of claims 1-7.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program comprising program instructions that, when executed by a processor, cause the processor to carry out the method according to any one of claims 1-7.