WO2020134991A1

WO2020134991A1 - Automatic input method for paper form, apparatus , and computer device and storage medium

Info

Publication number: WO2020134991A1
Application number: PCT/CN2019/123877
Authority: WO
Inventors: 陈亮; 翁浦益; 田世亮; 王斌
Original assignee: 益萃网络科技（中国）有限公司
Priority date: 2018-12-29
Filing date: 2019-12-09
Publication date: 2020-07-02
Also published as: CN109784235A

Abstract

The present application relates to an automatic input method for a paper form, an apparatus, a computer device and a storage medium, wherein the method comprises: acquiring image data of a paper form to be input; performing text recognition of the image data by using OCR technology, and determining the type of the paper form to be input; calling a corresponding electronic template according to the type of the paper form to be input; and automatically inputting the recognition result into a corresponding electronic template to generate an electronic form. By acquiring image data of a paper form to be input, performing text recognition of the image data by using OCR technology to determine the type of the paper form to be input, calling a corresponding type of electronic template and automatically inputting the recognition result into the corresponding type of electronic template to generate an electronic form, the present application implements a paper form automatic input system, which greatly improves efficiency of paper form input, and solves the problems of low efficiency, long time consumption and error-prone possibility of manual input.

Description

Automatic entry method, device, computer equipment and storage medium for paper form

Technical field

The present application relates to the field of image recognition technology, in particular to an automatic entry method, device, computer equipment and storage medium for paper forms.

Background technique

With the development of Internet technology, the application of various management systems is becoming more and more extensive. Every enterprise faces the problem of transferring offline data to the online management system when applying the management system.

Especially for the current enterprise in the transaction of goods, the transaction voucher is generally recorded through a paper form. Therefore, when archiving records through the system, the content recorded in the paper form needs to be manually entered manually, but the manual entry The method is inefficient and takes a long time.

Summary of the invention

Based on this, it is necessary to provide an automatic entry method, device, computer equipment, and storage medium for paper forms that can be automatically entered in response to the above-mentioned problem of low manual entry efficiency.

In order to achieve the above objective, on the one hand, an embodiment of the present application provides an automatic entry method for a paper form. The method includes:

Get the image data of the paper form to be recorded;

Use OCR technology to perform text recognition on the image data and determine the type of paper form to be entered;

Call the corresponding electronic template according to the type of paper form to be entered;

The recognition result is automatically entered into the corresponding electronic template to generate an electronic form.

In one of the embodiments, after automatically inputting the recognition result into the corresponding electronic template to generate an electronic form, the method further includes: receiving a modification operation on the electronic form; and saving the modified electronic form.

In one of the embodiments, before determining the type of paper form to be entered, the method further includes: collecting various types of paper forms; learning and training various types of paper forms to extract various types of paper forms Keyword information corresponding to the paper form; establish a correspondence between the type and the keyword information.

In one of the embodiments, determining the type of paper form to be entered includes: judging whether the condition of the keyword information corresponding to the category is satisfied according to the recognition result; when the condition of the keyword information corresponding to the category is satisfied in the recognition result, then Determine the type of paper form to be entered according to the corresponding relationship.

In one embodiment, before calling the corresponding electronic template according to the type of the paper form to be entered, the method further includes: receiving and saving pre-set electronic templates of different types, wherein the electronic templates have corresponding types.

In one of the embodiments, obtaining the image data of the paper form to be recorded includes: collecting image data of the paper form to be recorded by an image collection device; receiving image data of the paper form to be recorded collected by the image collection device.

On the other hand, an embodiment of the present application also provides an automatic entry device for paper forms, including:

The image data acquisition module is used to acquire the image data of the paper form to be recorded;

Text recognition module, used for text recognition of image data using OCR technology, and to determine the type of paper form to be entered;

The electronic template calling module is used to call the corresponding electronic template according to the type of paper form to be entered;

The input module is used to automatically input the recognition result into the corresponding electronic template to generate an electronic form.

In one of the embodiments, it further includes: a modification module for receiving the modification operation of the electronic form; and a saving module for saving the modified electronic form.

In yet another aspect, an embodiment of the present application further provides a computer device, including a memory and a processor, where the memory stores a computer program, and when the processor executes the computer program, the steps of the method described above are implemented.

In still another aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method described above are implemented.

The method, device, computer equipment and storage medium for automatic entry of the paper form described above determine the type of paper form to be entered by acquiring image data of the paper form to be entered and using OCR technology to perform text recognition on the image data, and Call the corresponding type of electronic template, and automatically enter the recognition result into the corresponding type of electronic template to generate an electronic form, thereby realizing the automatic entry of the paper form system, which greatly improves the efficiency of paper form entry and solves the current problem. Manual manual entry leads to problems of low efficiency, long time-consuming and error-prone.

BRIEF DESCRIPTION

FIG. 1 is an application environment diagram of an automatic entry method of a paper form in an embodiment;

2 is a schematic flowchart of an automatic entry method of a paper form in an embodiment;

3 is a schematic flowchart of a method for automatically inputting a paper form in another embodiment;

FIG. 4A is a schematic representation of a form in which the paper form is a sales slip in an embodiment;

FIG. 4B is another schematic diagram showing that the paper form type is a sales slip in one embodiment;

5 is a schematic flowchart of a method for automatically inputting a paper form in another embodiment;

FIG. 6 is a schematic diagram of various representations of a sales form in a paper form in an embodiment;

7 is a schematic flowchart of a step of determining the type of a paper form to be entered in an embodiment;

8 is a schematic flowchart of a method for automatically inputting a paper form in another embodiment;

9 is a schematic flowchart of the step of obtaining image data of a paper form to be entered in an embodiment;

10 is a structural block diagram of an automatic entry device for paper forms in an embodiment;

FIG. 11 is an internal structure diagram of a computer device in an embodiment.

detailed description

In order to make the purpose, technical solutions and advantages of the present application more clear, the following describes the present application in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

This application provides an automatic entry method for paper forms, which can be applied in the application environment shown in FIG. 1. Among them, the terminal 102 communicates with the server 104 through the network. The method provided in this application can be run in the server shown in FIG. 1 or in the terminal shown in FIG. 1 or can be shown in FIG. 1 The server and the terminal run some steps of this method to complete the implementation and realization of this method. The terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices. The server 104 may be implemented by an independent server or a server cluster composed of multiple servers.

In one embodiment, as shown in FIG. 2, a method for automatically inputting a paper form is provided. The method is applied to the terminal in FIG. 1 as an example for illustration, and may include the following steps:

Step 202: Obtain image data of a paper form to be recorded.

Among them, the paper form to be entered refers to the paper form to be entered into the system. In this embodiment, in order to improve the manual entry method in the prior art to realize automatic entry through a computer, therefore, it is necessary to convert the paper form to be entered into image data that can be recognized by the computer, for example, it may be in RAW format , BMP format, TIFF format, GIF format, JPEG format, etc. So that the system can further process the image data after receiving the paper form to be recorded.

Step 204: Use OCR technology to perform text recognition on the image data and determine the type of paper form to be entered.

Among them, OCR (Optical Character Recognition, optical character recognition) technology is to convert the text of various bills, newspapers, books, manuscripts and other printed materials into image information through optical input methods such as scanning, and then use text recognition technology to convert the image information into Available computer input technology. In this embodiment, the open source OCR technology is used to identify the text in the form to be entered that has been converted into image data, thereby determining the type of paper form to be entered. Among them, the type of the paper form to be entered may be a definition characterizing the type of paper form, for example, the type may specifically be a sales order, a purchase order, an invoice, a courier order, etc.

Step 206: Call the corresponding electronic template according to the type of paper form to be entered.

At present, in addition to the function of archiving records, various management systems also need to be standardized and standardized in the process of archiving records, so that subsequent data filtering, query, and various statistics can be performed through the management system. Therefore, in this embodiment, various standardized electronic templates can be set in the system in advance. After determining the type of the paper form to be entered through the above steps, the corresponding system in the system can be called according to the type of the paper form to be entered. Standardized electronic template.

Step 208: Automatically input the recognition result into the corresponding electronic template to generate an electronic form.

Specifically, OCR technology will be used to perform text recognition on the paper form that has been converted into image data to be entered, and determine the type of paper form to be entered, so that the recognition result will be automatically entered into the corresponding type of electronic template to generate an electronic form .

In the above automatic entry method for paper forms, by acquiring the image data of the paper form to be entered, and using OCR technology to perform text recognition on the image data to determine the type of the paper form to be entered, and calling the corresponding type of electronic template, Automatically input the recognition result into the corresponding type of electronic template to generate an electronic form, so as to realize the automatic entry of the paper form system, which greatly improves the efficiency of paper form entry and solves the current low efficiency caused by manual entry , Time-consuming and error-prone problems.

In one embodiment, as shown in FIG. 3, after the recognition result is automatically entered into the corresponding electronic template to generate an electronic form, the following steps may also be included:

Step 302: Receive a modification operation on the electronic form.

Specifically, due to the variety of paper forms that appear in life, as shown in Figures 4A and 4B, although the same is a sales order, the information recorded is not exactly the same (the cashier, salesperson and payment recorded in Figure 4A The information such as the method is not recorded in FIG. 4B, and the specification information recorded in FIG. 4B is also not recorded in FIG. 4A), but the electronic template set in the system is standardized. Therefore, when the paper form to be entered is automatically entered into the corresponding type of electronic template by the above method to generate an electronic form, it can also be based on the fields set in the electronic template (while there is no corresponding field in the paper form), Add corresponding information to the corresponding fields in the electronic form to modify and update the electronic form.

Among them, the specific modification and update operation can be set by the program, the system automatically completes it, or it can be added manually. For example, for unified management of electronic forms, the form ID field can be added to the electronic template. Therefore, the system can automatically generate the form ID at the form ID according to the rules set by the program according to the program settings. The corresponding form ID number.

In addition, because many paper forms are filled in manually, and manual filling may have the problem of scribble, therefore, when using OCR technology to recognize text, it may not be recognized or recognized incorrectly due to scribble. Based on this, in order to ensure the accuracy of the electronic form, this embodiment may also add a link of manual verification, so as to modify the problems found in time after verification.

Step 304, save the modified electronic form.

The system is provided with a save operation for the electronic form, for example, the system can automatically save the electronic form according to the set time period, or it can be based on the user's instruction to save the electronic form, such as after generating the electronic form, or in After the electronic form is modified, all the instructions for saving the electronic form can be issued to the system, so that the electronic form is stored in the system.

In one embodiment, as shown in FIG. 5, before determining the type of the paper form to be entered, the following steps may also be included:

Step 502: Collect various types of paper forms.

Step 504: Perform learning training on various types of paper forms to extract keyword information corresponding to various types of paper forms.

Step 506: Establish a correspondence between types and keyword information.

As described in the above embodiment, various paper forms have various types, and there are usually multiple types of forms in the same enterprise, such as purchase orders, sales orders, and delivery orders. The information recorded in the form is also different, and the system needs to classify and manage various paper forms. As mentioned above, due to the difference in the form of the same type of form, in order to enable the system to recognize different types of forms, in this embodiment, various types of paper forms can be collected in advance, thus Learning and training various types of paper forms to extract keyword information corresponding to various types of paper forms.

Specifically, in this embodiment, the keyword information corresponding to the sales order is extracted as an example for illustration. In this embodiment, as shown in FIG. 6, after learning and training the collected paper sales form, it is found that the paper is basically The header information of the sales order usually includes "sales order", "sales voucher", "sales details", "sales list", "sales record", etc. Therefore, in the process of learning and training, the system extracts the type of sales order Corresponding keyword information, such as keyword information is "sales" AND ("document" OR "detail" OR "list" OR "record", etc.), and establish a correspondence between the form of sales order and the above keyword information relationship.

In one embodiment, as shown in FIG. 7, determining the type of paper form to be entered may specifically include the following steps:

Step 702: Determine whether there is keyword information corresponding to the category according to the recognition result.

Step 704, when there is keyword information corresponding to the category in the recognition result, the type of the paper form to be entered is determined according to the corresponding relationship.

In this embodiment, after text recognition is performed on the form to be input that has been converted into image data through OCR technology, the recognition result of the header information in the form to be entered and the form type and keywords determined through learning training described above can be used The correspondence of information determines the type of paper form to be entered.

Specifically, it can be determined whether the condition of the keyword information corresponding to the category is satisfied in the recognition result of the header information in the form to be entered. When the condition is met, the type of the form to be entered can be determined according to the corresponding relationship above to satisfy the condition The type corresponding to the keyword information of, so as to quickly determine the type of paper form to be entered, so as to further process the paper form to be entered.

In one embodiment, as shown in FIG. 8, before calling the corresponding electronic template according to the type of paper form to be entered, the following steps may be further included:

Step 802: Receive and save different preset electronic templates.

Among them, the electronic template has a corresponding type. As mentioned earlier, because the system needs to classify and standardize various paper forms, based on the same type of forms at present, their specific manifestations are also different. If they are simply entered into the system, it is difficult for the system to achieve standardized management. . Therefore, in this embodiment, the user can preset various types of electronic templates in the system according to actual needs, and establish the correspondence between the electronic templates and the types. Therefore, after determining the type of the paper form to be entered, the corresponding electronic template can be called according to the type of the paper form to be entered, so as to realize centralized and standardized electronic management of paper forms of the same type with different expression forms.

In one embodiment, as shown in FIG. 9, acquiring the image data to be entered into the paper form may include the following steps:

Step 902: Collect image data to be recorded in a paper form through an image collection device.

Among them, image acquisition devices include, but are not limited to, cameras, cameras, cameras, scanners, or other devices (phones, tablets, etc.) with camera functions. In this embodiment, the image data to be recorded in the paper form is collected by the image collection device, and the collected image data is transmitted to the system. Specifically, the image data can be transmitted by wired or wireless means. This embodiment It is not limited in.

Step 904: Receive image data collected by an image collection device and to be recorded in a paper form.

In this embodiment, the image data of the paper form to be entered is acquired by means of the image acquisition device, so that the image data of the paper form to be entered is directly obtained from the image acquisition device, thereby further providing the processing speed of the system and making the automatic entry efficiency higher.

It should be understood that although the steps in the flowcharts of FIGS. 2-9 are displayed in order according to the arrows, the steps are not necessarily executed in the order indicated by the arrows. Unless clearly stated in this article, the execution of these steps is not strictly limited in order, and these steps may be executed in other orders. Moreover, at least some of the steps in FIGS. 2-9 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but may be executed at different times. The execution order of is not necessarily sequential, but may be executed in turn or alternately with at least a part of other steps or sub-steps or stages of other steps.

In one embodiment, as shown in FIG. 10, a paper form automatic entry device is provided, including: an image data acquisition module 1001, a text recognition module 1002, an electronic template calling module 1003, and an entry module 1004, wherein:

The image data acquisition module 1001 is used to acquire image data to be entered into a paper form;

The text recognition module 1002 is used to perform text recognition on the image data using OCR technology and determine the type of paper form to be entered;

The electronic template calling module 1003 is used to call the corresponding electronic template according to the type of paper form to be entered;

The input module 1004 is used to automatically input the recognition result into the corresponding electronic template to generate an electronic form.

In one embodiment, it further includes: a modification module 1005 for receiving a modification operation on the electronic form; and a saving module 1006 for saving the modified electronic form.

In one embodiment, the method further includes: collecting various types of paper forms; learning and training various types of paper forms to extract keyword information corresponding to various types of paper forms; establishing types Correspondence with keyword information.

In one embodiment, the method further includes: judging whether the condition of the keyword information corresponding to the category is satisfied according to the recognition result; when the condition of the keyword information corresponding to the category is satisfied in the recognition result, determining the paper form to be entered according to the correspondence relationship type.

In one embodiment, the method further includes: receiving and saving different preset electronic templates, wherein the electronic templates have corresponding types.

In one embodiment, the image data acquisition module 1001 is specifically configured to: collect image data to be entered into a paper form through an image acquisition device; and receive image data to be entered into a paper form collected by the image acquisition device.

For the specific limitation of the automatic entry device for paper forms, reference may be made to the above limitation on the automatic entry method for paper forms, which will not be repeated here. Each module in the above paper form automatic entry device can be implemented in whole or in part by software, hardware, and a combination thereof. The above modules may be embedded in the hardware form or independent of the processor in the computer device, or may be stored in the memory in the computer device in the form of software so that the processor can call and execute the operations corresponding to the above modules.

In one embodiment, a computer device is provided. The computer device may be a terminal, and an internal structure diagram thereof may be as shown in FIG. 11. The computer equipment includes a processor, a memory, a network interface, a display screen, and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used to communicate with external terminals through a network connection. The computer program is executed by the processor to realize an automatic entry method of paper forms. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covered on the display screen, or may be a button, a trackball, or a touchpad provided on the computer device housing , Can also be an external keyboard, touchpad or mouse.

Those skilled in the art can understand that the structure shown in FIG. 11 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer equipment to which the solution of the present application is applied. The specific computer equipment may It includes more or fewer components than shown in the figure, or some components are combined, or have a different component arrangement.

In one embodiment, a computer device is provided, including a memory and a processor, and a computer program is stored in the memory, and the processor implements the computer program to implement the following steps when executing the computer program:

Get the image data of the paper form to be recorded;

In one embodiment, after automatically inputting the recognition result into the corresponding electronic template to generate an electronic form, the method further includes: receiving a modification operation on the electronic form; and saving the modified electronic form.

In one embodiment, before determining the type of paper form to be entered, the method further includes: collecting various types of paper forms; learning and training various types of paper forms to extract various types of paper Keyword information corresponding to the qualitative form; establish a correspondence between the type and the keyword information.

In one embodiment, determining the type of paper form to be entered includes: judging whether the condition of the keyword information corresponding to the category is satisfied according to the recognition result; when the condition of the keyword information corresponding to the category is satisfied in the recognition result, then according to The correspondence determines the type of paper form to be entered.

In one embodiment, obtaining the image data of the paper form to be entered includes: collecting image data of the paper form to be entered through an image acquisition device; receiving image data of the paper form to be entered collected by the image acquisition device.

In one embodiment, a computer-readable storage medium is provided on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

Get the image data of the paper form to be recorded;

In one embodiment, determining the type of paper form to be entered includes: judging whether the condition of the keyword information corresponding to the category is satisfied according to the recognition result; when the condition of the keyword information corresponding to the category is satisfied in the recognition result, according to The correspondence determines the type of paper form to be entered.

A person of ordinary skill in the art may understand that all or part of the processes in the method of the above embodiments may be completed by instructing relevant hardware through a computer program, and the computer program may be stored in a non-volatile computer readable storage In the medium, when the computer program is executed, the process of the foregoing method embodiments may be included. Wherein, any reference to the memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and/or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

The technical features of the above embodiments can be arbitrarily combined. In order to simplify the description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered as the scope described in this specification.

The above-mentioned embodiments only express several implementations of the present application, and their descriptions are more specific and detailed, but they should not be construed as limiting the scope of the invention patent. It should be noted that, for those of ordinary skill in the art, without departing from the concept of the present application, a number of modifications and improvements can also be made, which all fall within the protection scope of the present application. Therefore, the protection scope of the patent of this application shall be subject to the appended claims.

Claims

An automatic entry method for paper forms, characterized in that the method includes:

Get the image data of the paper form to be recorded;

Use OCR technology to perform text recognition on the image data and determine the type of the paper form to be entered;

Call the corresponding electronic template according to the type of the paper form to be entered;

The recognition result is automatically entered into the corresponding electronic template to generate an electronic form.
The method according to claim 1, wherein after automatically inputting the recognition result into a corresponding electronic template to generate an electronic form, the method further comprises:

Receive the modification of the electronic form;

Save the modified electronic form.
The method according to claim 1, wherein before determining the type of the paper form to be entered, the method further comprises:

Collect various types of paper forms;

Learn and train various types of paper forms to extract keyword information corresponding to various types of paper forms;

Establish a correspondence between the type and the keyword information.
The method according to claim 3, wherein the determining the type of the paper form to be entered includes:

Judging whether the condition of the keyword information corresponding to the category is satisfied according to the recognition result;

When the condition of the keyword information corresponding to the category is satisfied in the recognition result, the type of the paper form to be entered is determined according to the corresponding relationship.
The method according to claim 3, wherein before calling the corresponding electronic template according to the type of the paper form to be entered, further comprising:

Receive and save different types of pre-set electronic templates, the electronic templates have corresponding types.
The method according to any one of claims 1 to 5, wherein the acquiring image data of a paper form to be recorded includes:

Collect the image data to be entered into the paper form through the image acquisition equipment;

Receiving image data collected by the image collection device to be recorded in a paper form.
An automatic entry method for paper forms is characterized by including:

The image data acquisition module is used to acquire the image data of the paper form to be recorded;

A character recognition module, which is used for character recognition of the image data by using OCR technology and determining the type of the paper form to be entered;

The electronic template calling module is used to call the corresponding electronic template according to the type of the paper form to be entered;

The input module is used to automatically input the recognition result into the corresponding electronic template to generate an electronic form.
The device according to claim 7, further comprising:

A modification module, which is used to receive a modification operation on the electronic form;

Save module, used to save the modified electronic form.
A computer device includes a memory and a processor, and the memory stores a computer program, wherein when the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
A computer-readable storage medium on which a computer program is stored, characterized in that when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are realized.