CN111914543A - Report legality detection method, device, electronic device and readable storage medium - Google Patents

Abstract

The present application provides a method, device, electronic device, and readable storage medium for detecting the validity of a report, which are applied to the technical field of natural language processing, wherein the method includes: extracting from irregular reports to be detected by natural language understanding technology Detect elements, and check the consistency between the statistical result information of the detection elements and the corresponding total result information in the report to be inspected, so as to determine the legitimacy of the report to be inspected, thereby realizing the automatic detection of the legitimacy of the report to be inspected, improving the The efficiency of report validity detection is improved, and the detection accuracy is improved.

Description

Report legality detection method, device, electronic device and readable storage medium

technical field

The present application relates to the technical field of natural language understanding, and in particular, the present application relates to a method, apparatus, electronic device, and readable storage medium for detecting the validity of a report.

Background technique

International bank card organizations (such as UnionPay, MasterCard, jcb, Diners Club, American Express, VISA) usually conduct fund transactions with member banks every day and provide fund statements. Based on bank compliance requirements, member banks usually need to verify the legitimacy of the report content. Because the report is usually in an irregular format that is convenient for human reading, the current legality verification of the report usually adopts the method of manual verification. However, the manual verification method is time-consuming, labor-intensive and prone to errors.

SUMMARY OF THE INVENTION

The present application provides a method, device, electronic device and readable storage medium for detecting the legality of a report, which are used to provide a method for detecting the legality of a report, realize the automatic detection of the legality of the report, improve the efficiency of the detection, and reduce the labor of the inspection. cost, while improving the accuracy of detection. The technical scheme adopted in this application is as follows:

In a first aspect, a method for detecting the legitimacy of a report is provided, and the method includes:

Obtain the report to be tested, and the data of the report to be tested is unstructured data;

Extract multiple detection element information of the report to be detected based on natural language understanding technology;

Statistical statistics are performed on the extracted multiple detection element information to obtain statistical result information;

The obtained statistical result information is checked for consistency with the corresponding total result information in the report to be checked, and the validity of the report to be checked is determined based on the consistency check result.

Optionally, the report to be detected is a file in TXT format, PDF format or XML format.

Optionally, perform statistics on the extracted multiple detection element information to obtain statistical result information, which previously includes:

Add the extracted multiple detection element information to the EXCEL table;

The statistical analysis function based on EXCEL table determines the statistical result information of multiple detection element information.

Optionally, the method further includes:

determining at least one category information of a plurality of detection element information;

Determine the statistical result information of the detection elements corresponding to each category;

The obtained statistical result information and the corresponding total result information in the report to be detected are checked for consistency, including:

The statistical result information of each category is respectively checked for consistency with the corresponding aggregated result information of each category in the report to be detected.

In a second aspect, a report validity detection device is provided, and the device includes:

, which is used to obtain a report to be detected, and the data of the report to be detected is unstructured data;

The extraction module is used to extract multiple detection element information of the report to be detected based on natural language understanding technology;

The statistics module is used to perform statistics on the extracted multiple detection element information to obtain statistical result information;

The verification module is used to perform consistency verification between the obtained statistical result information and the corresponding aggregated result information in the report to be checked, and to determine the validity of the report to be checked based on the consistency check result.

Optionally, the report to be detected is a file in TXT format, PDF format or XML format.

Optionally, the device also includes:

Add a module to add the extracted multiple detection element information to the EXCEL table;

The first determination module is configured to determine statistical result information of a plurality of detection element information based on the statistical analysis function of the EXCEL table.

Optionally, the device also includes:

a second determining module, configured to determine at least one category information of a plurality of detection element information;

The third determination module is used to determine the statistical result information of the detection elements corresponding to each category;

The verification module is specifically configured to perform consistency verification between the statistical result information of each category and the corresponding aggregated result information of each category in the report to be detected.

In a third aspect, an electronic device is provided, the electronic device comprising:

one or more processors;

memory;

One or more application programs, wherein the one or more application programs are stored in memory and configured to be executed by one or more processors, and the one or more programs are configured to: execute the report shown in the first aspect. Sex detection method.

In a fourth aspect, a computer-readable storage medium is provided. The computer storage medium is used to store computer instructions, which, when executed on a computer, enable the computer to execute the report validity detection method shown in the first aspect.

The present application provides a method, device, electronic device and readable storage medium for detecting the validity of a report. Compared with the manual method of detecting reports in the prior art, the present application obtains reports to be detected, and the details of the reports to be detected are obtained. The data is unstructured data; multiple detection element information of the report to be detected is extracted based on natural language understanding technology; statistics are performed on the extracted multiple detection element information to obtain statistical result information; Consistency check is performed on the corresponding aggregated result information, and the validity of the report to be checked is determined based on the consistency check result. That is, the detection elements are extracted from the irregular reports to be detected by natural language understanding technology, and the statistical result information of the detected elements is checked for consistency with the corresponding total result information in the reports to be detected, so as to determine the status of the reports to be detected. The legality of the report can be automatically detected, thereby improving the efficiency of the report's legality detection and improving the accuracy of the detection.

Additional aspects and advantages of the present application will be set forth in part in the following description, which will become apparent from the following description, or may be learned by practice of the present application.

Description of drawings

The above and/or additional aspects and advantages of the present application will become apparent and readily understood from the following description of embodiments taken in conjunction with the accompanying drawings, wherein:

1 is a schematic flowchart of a method for detecting the validity of a report according to an embodiment of the application;

2 is a schematic structural diagram of a report validity detection device according to an embodiment of the application;

Fig. 3 is a kind of report form detection flow example diagram of the embodiment of the application;

4 is a schematic structural diagram of an electronic device according to an embodiment of the application;

Figure 5 is an example of a card organization report;

FIG. 6 is a pattern after processing the extracted detection elements.

Detailed ways

Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, but not to be construed as a limitation on the present application.

It will be understood by those skilled in the art that the singular forms "a," "an," and "the" as used herein can include the plural forms as well, unless expressly stated otherwise. It should be further understood that the word "comprising" used in the specification of this application refers to the presence of features, integers, steps, operations, elements and/or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and/or groups thereof. As used herein, the term "and/or" includes all or any element and all combination of one or more of the associated listed items.

In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

The technical solutions of the present application and how the technical solutions of the present application solve the above-mentioned technical problems will be described in detail below with specific examples. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.

The embodiment of the present application provides a method for detecting the validity of a report. As shown in FIG. 1 , the method may include the following steps:

Step S101, obtaining a report to be detected, the data of the report to be detected is unstructured data;

Wherein, the report to be detected is a file in TXT format, PDF format or XML format. The data of this type of text cannot be calculated directly on the data.

Step S102, extracting multiple detection element information of the report to be detected based on the natural language understanding technology;

Step S103, performing statistics on the extracted multiple detection element information to obtain statistical result information;

Specifically, the detection elements are extracted through natural language understanding technology, and the unstructured data that cannot be statistically analyzed is converted into structured data that can be statistically analyzed.

In step S104, the obtained statistical result information and the corresponding aggregated result information in the report to be checked are checked for consistency, and the validity of the report to be checked is determined based on the consistency check result.

Specifically, if the statistical result information of the extracted detection elements is consistent with the corresponding aggregated result information in the detection report, it means that the report is correct (legal); if not, it means that there is an error in the report and the report is illegal. If the report is illegal, the corresponding error information can be marked to remind the staff.

The embodiment of the present application provides a method for detecting the validity of a report. Compared with the prior art that requires manual verification of the legality of the report, the embodiment of the present application obtains the report to be detected, and the data of the report to be detected is not Structured data; extract multiple detection element information of the report to be detected based on natural language understanding technology; perform statistics on the extracted multiple detection element information to obtain statistical result information; The total result information is checked for consistency, and the validity of the report to be checked is determined based on the consistency check result. That is, the detection elements are extracted from the irregular reports to be detected by natural language understanding technology, and the statistical result information of the detected elements is checked for consistency with the corresponding total result information in the reports to be detected, so as to determine the status of the reports to be detected. The legality of the report can be automatically detected, thereby improving the efficiency of the report's legality detection and improving the accuracy of the detection.

The embodiment of the present application provides a possible implementation manner,

The embodiment of the present application provides a possible implementation manner to perform statistics on the extracted multiple detection element information to obtain statistical result information, which includes:

Add the extracted multiple detection element information to the EXCEL table;

The statistical analysis function based on EXCEL table determines the statistical result information of multiple detection element information.

For example, the summation data of multiple detection elements can be calculated directly through the summation function of the EXCEL table, and then compared with the corresponding totals in the report to be detected. If they are consistent, the report is legal, and the report is inconsistent. illegal.

The embodiment of the present application provides a possible implementation manner, and further, the method further includes:

determining at least one category information of a plurality of detection element information;

Determine the statistical result information of the detection elements corresponding to each category;

Specifically, the extracted detection elements may be detection elements of multiple categories, such as related elements of different products. The total data of the elements of each category of products can be calculated separately, and then compared with the total element data of each product in the report to be tested. If they are consistent, the report is legal; if they are inconsistent, the report is illegal.

The obtained statistical result information and the corresponding total result information in the report to be detected are checked for consistency, including:

The statistical result information of each category is respectively checked for consistency with the corresponding aggregated result information of each category in the report to be detected.

FIG. 3 shows an example flow chart of the validity of the report to be detected, wherein the report to be detected may be a MasterCard organization report. Figure 5 shows an example of a card organization report, in which the Mastercard report refers specifically to the T140 file report. The key elements of the report include the type of payment request of the transaction, the date of payment, the amount (including the loan direction), transaction remarks, and handling fee. Amount (including lending direction), settlement date, currency, etc.

Figure 6 shows the processed style of the extracted detection elements, which can be used to quickly verify the legality or other calculations by using the calculation formula of excel.

Among them, the report to be detected can be a TXT, PDF or XML report. Through natural language, the transaction elements are extracted to obtain the report shown in Figure 6. The number of transactions can be filtered and counted through different fields, so that the report can be verified in multiple dimensions. legality. For example, you can check whether Total is indeed equal to the data added in the previous lines, and you can check the validity of Count, different Amounts, and Fees respectively. Verify the self-consistency of the report.

The detection process is as follows:

Step 1: Enter the card to organize the report file, go to step 2

Step 2: Extract content as needed, organize regular expressions for keyword extraction 3.

Step 3: Match the regular expression results in sequence, and go to Step 4.

Step 4: If there is a search result, go to Step 5, otherwise go to Step 2.

Step 5: Extract the key elements of the matching result, record the relevant elements, and go to step 6.

Step 6: Determine whether the search text of the current matching band is located at the end of the document. If yes, go to step 7, otherwise go to step 2.

Step 7: Statistical analysis of all records, and comparison with the original text report, go to Step 8.

Step 8: If the comparison is successful, the report is legal, go to Step 9, if the comparison fails, the report is illegal, and go to Step 9.

Step 9: End.

FIG. 2 is a report validity detection device provided by an embodiment of the present application. The device 20 includes: an acquisition module 201, an extraction module 202, a statistics module 203, and a verification module 204, wherein,

The obtaining module 201 is used for obtaining a report to be detected, and the data of the report to be detected is unstructured data;

The extraction module 202 is used for extracting multiple detection element information of the report to be detected based on the natural language understanding technology;

The statistics module 203 is configured to perform statistics on the extracted multiple detection element information to obtain statistical result information;

The verification module 204 is configured to perform consistency verification between the obtained statistical result information and the corresponding aggregated result information in the report to be checked, and to determine the validity of the report to be checked based on the consistency check result.

The embodiment of the present application provides an apparatus for detecting the validity of a report. Compared with the prior art, which requires manual verification of the validity of the report, the embodiment of the present application obtains the report to be checked, and the data of the report to be checked is not Structured data; extract multiple detection element information of the report to be detected based on natural language understanding technology; perform statistics on the extracted multiple detection element information to obtain statistical result information; The total result information is checked for consistency, and the validity of the report to be checked is determined based on the consistency check result. That is, the detection elements are extracted from the irregular reports to be detected by natural language understanding technology, and the statistical result information of the detected elements is checked for consistency with the corresponding total result information in the reports to be detected, so as to determine the status of the reports to be detected. The legality of the report can be automatically detected, thereby improving the efficiency of the report's legality detection and improving the accuracy of the detection.

Optionally, the report to be detected is a file in TXT format, PDF format or XML format.

Optionally, the device also includes:

Add a module to add the extracted multiple detection element information to the EXCEL table;

The first determination module is configured to determine statistical result information of a plurality of detection element information based on the statistical analysis function of the EXCEL table.

Optionally, the device also includes:

a second determining module, configured to determine at least one category information of a plurality of detection element information;

The third determination module is used to determine the statistical result information of the detection elements corresponding to each category;

The verification module is specifically configured to perform consistency verification between the statistical result information of each category and the corresponding aggregated result information of each category in the report to be detected.

The report validity detection device in this embodiment can execute a report validity detection method provided in the above-mentioned embodiments of the present application, and the implementation principle thereof is similar, and details are not described herein again.

The embodiment of the present application provides an apparatus for detecting the validity of a report. Compared with the prior art, which requires manual verification of the validity of the report, the embodiment of the present application obtains the report to be checked, and the data of the report to be checked is not Structured data; extract multiple detection element information of the report to be detected based on natural language understanding technology; perform statistics on the extracted multiple detection element information to obtain statistical result information; The total result information is checked for consistency, and the validity of the report to be checked is determined based on the consistency check result. That is, the detection elements are extracted from the irregular reports to be detected by natural language understanding technology, and the statistical result information of the detected elements is checked for consistency with the corresponding total result information in the reports to be detected, so as to determine the status of the reports to be detected. The legality of the report can be automatically detected, thereby improving the efficiency of the report's legality detection and improving the accuracy of the detection.

The embodiment of the present application provides a report validity detection device, which is applicable to the method shown in the foregoing embodiment, and details are not described herein again.

An embodiment of the present application provides an electronic device. As shown in FIG. 4 , the electronic device 40 shown in FIG. 4 includes: a processor 401 and a memory 403 . The processor 401 is connected to the memory 403 , for example, through a bus 402 . Further, the electronic device 40 may also include a transceiver 404 . It should be noted that, in practical applications, the transceiver 404 is not limited to one, and the structure of the electronic device 40 does not constitute a limitation to the embodiments of the present application. The processor 401 is used in the embodiments of the present application to implement the functions of the modules shown in FIG. 2 . Transceiver 404 includes a receiver and a transmitter.

The processor 401 may be a CPU, a general purpose processor, a DSP, an ASIC, an FPGA or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with this disclosure. The processor 401 may also be a combination that realizes computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

The bus 402 may include a path to communicate information between the components described above. The bus 402 may be a PCI bus, an EISA bus, or the like. The bus 402 can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in FIG. 4, but it does not mean that there is only one bus or one type of bus.

The memory 403 can be ROM or other types of static storage devices that can store static information and instructions, RAM or other types of dynamic storage devices that can store information and instructions, or EEPROM, CD-ROM or other optical disk storage, optical disk storage. (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or capable of carrying or storing desired program code in the form of instructions or data structures and capable of being executed by a computer Access any other medium without limitation.

The memory 403 is used to store the application code for executing the solution of the present application, and the execution is controlled by the processor 401 . The processor 401 is configured to execute the application program code stored in the memory 403 to realize the function of the report validity detection apparatus provided by the embodiment shown in FIG. 2 .

The embodiment of the present application provides an electronic device. Compared with the prior art, which requires manual verification of the validity of the report, the embodiment of the present application obtains the report to be detected, and the data of the report to be detected is unstructured data. ; Extract multiple detection element information of the report to be detected based on natural language understanding technology; perform statistics on the extracted multiple detection element information to obtain statistical result information; Consistency check is performed, and the validity of the report to be tested is determined based on the consistency check result. That is, the detection elements are extracted from the irregular report to be inspected by natural language understanding technology, and the statistical result information of the inspection elements is checked for consistency with the corresponding total result information in the report to be inspected, so as to determine the content of the report to be inspected. The legality of the report can be automatically detected, thereby improving the efficiency of the report's legality detection and improving the accuracy of the detection.

The embodiments of the present application provide an electronic device suitable for the above method embodiments. It is not repeated here.

Embodiments of the present application provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the program is executed by a processor, the methods shown in the foregoing embodiments are implemented.

The embodiment of the present application provides a computer-readable storage medium. Compared with the prior art that requires manual verification of the validity of the report, the embodiment of the present application obtains the report to be detected, and the data of the report to be detected is not Structured data; extract multiple detection element information of the report to be detected based on natural language understanding technology; perform statistics on the extracted multiple detection element information to obtain statistical result information; The total result information is checked for consistency, and the validity of the report to be checked is determined based on the consistency check result. That is, the detection elements are extracted from the irregular reports to be detected by natural language understanding technology, and the statistical result information of the detected elements is checked for consistency with the corresponding total result information in the reports to be detected, so as to determine the status of the reports to be detected. The legality of the report can be automatically detected, thereby improving the efficiency of the report's legality detection and improving the accuracy of the detection.

The embodiments of the present application provide a computer-readable storage medium suitable for the foregoing method embodiments. It is not repeated here.

It should be understood that although the various steps in the flowchart of the accompanying drawings are sequentially shown in the order indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order and may be performed in other orders. Moreover, at least a part of the steps in the flowcharts of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution sequence is also It does not have to be performed sequentially, but may be performed alternately or alternately with other steps or at least a portion of sub-steps or stages of other steps.

The above are only part of the embodiments of the present application. It should be pointed out that for those skilled in the art, some improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as The protection scope of this application.

Claims (10)

1. A report validity detection method is characterized by comprising the following steps:

acquiring a report to be detected, wherein the data of the report to be detected is unstructured data;

extracting a plurality of detection element information of the report to be detected based on a natural language understanding technology;

counting the extracted information of the plurality of detection elements to obtain statistical result information;

and carrying out consistency check on the obtained statistical result information and the corresponding total result information in the report to be detected, and determining the legality of the report to be detected based on the consistency check result.

2. The method according to claim 1, wherein the report to be detected is a TXT format or PDF format or XML format file.

3. The method according to claim 1, wherein the step of performing statistics on the extracted plurality of detection factor information to obtain statistical result information comprises:

adding the extracted detection element information into an EXCEL table;

the statistical analysis function based on the EXCEL table determines statistical result information of the plurality of detection element information.

4. The method of claim 1, further comprising:

determining at least one category information of the plurality of detection element information;

determining statistical result information of the detection elements corresponding to each category;

the consistency check of the obtained statistical result information and the corresponding total result information in the report to be detected comprises the following steps:

and respectively carrying out consistency check on the statistical result information of each category and the corresponding total result information of each category in the report to be detected.

5. A report validity detection device is characterized by comprising:

the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring a report to be detected, and the data of the report to be detected is unstructured data;

the extraction module is used for extracting a plurality of detection element information of the report to be detected based on the natural language understanding technology;

the statistical module is used for carrying out statistics on the extracted information of the plurality of detection elements to obtain statistical result information;

and the checking module is used for performing consistency checking on the obtained statistical result information and the corresponding total result information in the report to be detected, and determining the legality of the report to be detected based on the consistency checking result.

6. The apparatus according to claim 5, wherein the report to be detected is a TXT format or PDF format or XML format file.

7. The method of claim 1, wherein the apparatus further comprises:

the adding module is used for adding the extracted detection element information into an EXCEL table;

and the first determination module is used for determining the statistical result information of the plurality of detection element information based on the statistical analysis function of the EXCEL table.

8. The apparatus of claim 5, further comprising:

a second determination module for determining at least one category information of the plurality of detection element information;

the third determining module is used for determining the statistical result information of the detection elements corresponding to all the categories;

and the checking module is specifically used for performing consistency checking on the statistical result information of each category and the corresponding total result information of each category in the report to be detected.

9. An electronic device, comprising:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to: executing the report validity detection method according to any one of claims 1 to 4.

10. A computer-readable storage medium for storing computer instructions which, when executed on a computer, cause the computer to perform the report validity detection method of any one of the preceding claims 1 to 4.

Images