JP2002007951A - Slip input method, its execution device, and storage medium recording its process program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology capable of improving the visibility of correction and confirmation when correcting the recognized result of an image-inputted slip. SOLUTION: This slip input method recognizing the image-inputted slip and inputting the description contents of the slip includes a step for displaying the contents inputted by the recognition of the image-inputted slip according to a prescribed format and accepting the correction items to the recognized result and a step for emphatically displaying specific image portions corresponding to the accepted correction items in the whole image data of the image- inputted slip.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a form input device for recognizing a form input as an image and inputting the contents of the form, and more particularly to a recognition result of characters written in an OCR form and image data of the entire OCR form. The present invention relates to a technology that is effective when applied to a form input device that displays on a display and highlights an image portion corresponding to a correction item of a recognition result.

[0002]

2. Description of the Related Art Conventionally, processing has been performed in which a form is input as image data, characters in the form image data are recognized, and characters in the form are input. Although the recognition rate of such character recognition has greatly improved in recent years, unread / misread characters may occur depending on the state of the characters written on the form, so that the characters recognized from the form image data and the form image data must be combined. It is necessary to display and compare on the same screen and correct characters that are erroneously recognized.

An image display method of an OCR system capable of displaying an entire image of an arbitrary region of an OCR form and an image of an attached document having an arbitrary content simultaneously on an OCR correction screen on a display device is disclosed in Japanese Patent Application Laid-Open No. HEI 1 (1999) -197605.
The one described in Japanese Patent Application No. 1-203401 is known.
In the image display method of the OCR system, the correction screen and the form image are simultaneously displayed on the left screen and the right screen on the display, respectively.

Further, the recognition data created by the character recognition device is displayed on the screen in correspondence with the original image and the converted character data on a line basis under simple display control, so that the recognition data can be easily confirmed and corrected. Japanese Patent Application Laid-Open No. 7-85214 discloses a recognition character correcting device configured to be able to achieve the above.

[0005]

When the characters recognized from the form image data and the form image data are displayed on the same screen and compared as described above, and the characters recognized erroneously are corrected, It is necessary to know which character in the form image data corresponds to the character recognized from the form image data. Also, in a form where a certain content is described in a plurality of items, such as when an address is described in a plurality of items, characters to be described in one item may be described in another related item. Since it is known that the character recognized from the form image data is related to which item in the form image data, the improvement of the correction efficiency can be expected.

[0006] However, in the conventional image display method of the OCR system, the right screen on the display can only display the entire form image. There was a problem that the part had to be searched through human hands.

[0007] Further, as in the case of describing a long address, in a form in which characters that could not be completely described in prescribed items are described following a spare item at a distant position such as the bottom of the form, related items are not related to each other. Although there may be a distance, when displaying the recognition result, it is easier to handle when displaying the contents of the related items written away at a close position, such as displaying the addresses collectively at one place. However, in the above-described conventional technology, there is a problem that highlighting when the recognition result is displayed in a format different from that of the form image data is not considered.

An object of the present invention is to solve the above-mentioned problem and to provide a technique capable of improving the visibility of correction / confirmation when correcting the recognition result of an image-inputted form.

[0009]

SUMMARY OF THE INVENTION According to the present invention, there is provided a form input device for recognizing a form input as an image and inputting the contents of the form, and a correction item for a recognition result of the form displayed according to a predetermined format. Is highlighted.

In the form input device of the present invention, a form input as an image is recognized, contents described in the form are input, the contents are displayed according to a predetermined format, and a correction item for a result of recognition is received. The screen and the input form image data are displayed, and a correction item for the recognition result is accepted.

[0011] When a correction item is designated by the user, the image enhancement frame data defined for the item number of the designated modification item is read, and the image enhancement frame data defined by the image enhancement frame data is read out. A frame is displayed at the coordinates, and a specific image portion corresponding to the received correction item is highlighted in the entire form image data input as the image.

With this highlighting, the user who intends to make a correction to the recognition result can efficiently check which part of the original form the correction item is to be corrected.

Further, by changing the predetermined format to a format desired by the user, the layout of the correction screen can be easily viewed and the work efficiency can be improved. Since the correction items on the correction screen and the coordinates of the corresponding highlighting frame on the form image data are associated by the item numbers, the highlighting corresponding to the correction items can be performed even if the layout of the correction screen is changed. it can.

As described above, according to the form input device of the present invention, the specific image portion corresponding to the correction item to the recognition result of the form displayed according to the predetermined format is highlighted, so that the form input image is input. It is possible to improve the visibility of correction / confirmation when correcting the recognition result of.

[0015]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A form input device according to an embodiment for recognizing a form input as an image and inputting the contents of the form will be described below.

FIG. 1 is a diagram showing a schematic configuration of an OCR system according to this embodiment. As shown in FIG.
The R system includes a form recognition processing unit 100 and a highlight display processing unit 101.

The form recognition processing section 100 is a processing section for displaying the contents inputted by recognizing the form inputted as an image according to a predetermined format, and accepting a correction item for the recognition result. The highlighting processing unit 101 is a processing unit that highlights a specific image portion corresponding to the received correction item in the entire form image data into which the image is input.

A program for causing the OCR system to function as the form recognition processing unit 100 and the highlight display processing unit 101 is recorded on a recording medium such as a CD-ROM, stored on a magnetic disk or the like, and then loaded into a memory and executed. Shall be performed. The recording medium for recording the program may be a recording medium other than the CD-ROM.

As shown in FIG. 1, an OCR system which is a form input device of the present embodiment is a central processing unit 1 for displaying OCR data and a form image on a screen.
A display device 2 having a graphic screen;
A keyboard device 3 for inputting characters, a form item definition file 4 recording attributes of items, screen display positions, and the like;
It is composed of OCR output data 5 storing recognition data and image data of the OCR form read from the OCR device.

The central processing unit 1 controls the display of OCR data / form image on the display device 2.
The output data display processing 6 is executed. The operator 7 can use the keyboard device 3 based on the OCR data displayed on the display device 2 to correct the improper read data.

FIG. 2 is a diagram showing an example of the relationship between OCR output data and screen display contents according to the present embodiment. As shown in FIG. 2, the highlight display processing unit 10 of the OCR output data display processing 6
In 1, the item emphasis frame setting process 11 and the related item emphasis frame setting process 12 are executed.

FIG. 3 is a diagram showing details of the screen display contents of FIG. 2 of the present embodiment. As shown in FIGS. 2 and 3, the item emphasis frame setting process 11 and the related item emphasis frame setting process 12 are
When the OCR correction screen / form whole image 13 displayed based on the CR output data 5 is displayed, it is started when the highlighting is instructed, and the item information of the item 14 to be highlighted is displayed in the form item definition file 4. From the form item definition data 15 defining the item information of the form in the
An emphasis frame is set on the whole form image 16 in the R output data 5 and an item 19 on the whole form image corresponding to the highlighted display item 18 on the OCR correction screen on the screen of the OCR correction screen / form whole image 17 is set. An emphasis frame is displayed in the item 20 to be performed.

FIG. 4 shows an item emphasis frame setting process 1 according to this embodiment.
FIG. 3 is a diagram showing an example of the first example. FIG. 4 illustrates a relationship between data and display items necessary for the item highlighting frame setting process 11 of the highlighting processing unit 101 in FIG.

FIG. 5 is a diagram showing details of the screen display contents of FIG. 4 of the present embodiment. As shown in FIGS. 4 and 5, data required for the item emphasis frame setting process 11 in FIG. 2 includes a form item definition file 4 having an item number and image emphasis frame data for each item in the OCR form, and a form The OCR output data 5 includes OCR read data and an entire form image. Form item definition data 15 of form item definition file 4
Is associated with the content of the correction screen by the item number, such as the item number [1] of “920” which is the data 21 of the OCR correction screen. The form item definition data 15 includes the modification screen definition information 23 indicating the predetermined format on the modification screen and the image emphasis frame data 24 for each item as the attribute of the item number.
Is stored. Further, the OCR output data 5 stores an entire form image 16.

First, the form recognition processing unit 100 displays the contents input by recognizing the form input image in accordance with a predetermined format indicated in the correction screen definition information 23,
The whole form image 16 of the OCR output data is displayed and the screen state 25 is set, and a correction item corresponding to the recognition result is received from the user who makes the correction.

The highlighting processing unit 101 obtains the image emphasis frame data 24 having the same item number of the correction item from the form item definition data 15 of the form item definition file 4, and converts it into the entire form image 16 in the OCR output data. By setting the image emphasis frame data 24, a screen state 26 in which an item emphasis frame is displayed on the entire form image is displayed.

FIG. 6 shows an item emphasis frame setting process 1 according to this embodiment.
3 is a flowchart illustrating a processing procedure of No. 1; The details of the item highlighting frame setting process 11 of the highlighting processing unit 101 will be described with reference to FIG.

First, the entire form image 16 is read into the memory (S41). Next, the item number of the item to be highlighted in the OCR correction screen is obtained from the form item definition file 4 (S42). The corresponding image emphasis frame data is acquired based on the acquired item number (S43), and the image emphasis frame is set in the entire form image 16 read into the memory in S41 (S44). Finally, the entire form image on the memory in which the image emphasis frame is set is drawn (S4).
5).

FIG. 7 is a diagram showing an example of the related item highlighting frame setting processing 12 of the present embodiment. FIG. 7 shows the relationship between data and display items necessary for the related item highlighting frame setting processing 12 of the highlighting processing section 101.

FIG. 8 is a diagram showing the details of the screen display contents of FIG. 7 of the present embodiment. As shown in FIGS. 7 and 8, data necessary for the related item highlighting frame setting process 12 in FIG.
A form item definition file 4 having an item number and emphasis frame information for each item in the form, and OCR read data / OCR output data 5 having an entire form image for each form. In this example, together with the image emphasis frame data 24 described above, the OCR
The related number 32 that stores information related to the item number [1] of the correction screen data 31 “920” is used. Also,
The OCR output data 5 stores an entire form image 16.

First, the modification screen definition information 23 of the form item definition file 4 and the entire form image 1 of the OCR output data
From 6, the screen state 33 is displayed. Next, the image emphasis frame data 24 corresponding to the item number [1] of the data 31 “920” of the OCR correction screen is obtained, and the image emphasis frame 34 is set in the entire form image 16 in the OCR output data, and at the same time, the related number is set. The screen state in which the item emphasis frame and the related item emphasis frame are displayed in the entire image of the form by acquiring the image emphasis frame data of the data whose item number [1] is 32 and setting the image emphasis frame 35 of the related item 36 is displayed.

FIG. 9 is a flowchart showing a processing procedure of the related item highlighting frame setting processing 12 of the present embodiment. The processing content of the related item highlighting frame setting processing 12 of the highlighting processing unit 101 will be described with reference to FIG.

First, the entire form image is read into the memory (S61). Next, the item number of the item to be highlighted in the OCR correction screen is obtained from the form item definition file 4 (S62). The corresponding image emphasis frame data 24 is obtained based on the obtained item number (S63), and the image emphasis frame is set in the entire form image on the memory (S6).
4).

Here, the form item definition data 15 having a related number corresponding to the related number of the highlighted item number
Is retrieved from the form item definition file 4 (S65). If there is the form item definition data 15 with the matching related number, the process returns to S63, acquires the image emphasis frame data 24, and sets the image emphasis frame. If there is no longer the form item definition data 15 with the matching related number, the entire form image on the memory in which the image emphasis frame and the related item emphasis frame are set is drawn (S66).

FIG. 10 is a diagram showing an example of a format change of the correction screen according to the present embodiment. FIG. 10 shows a case where a form in which a spare item describing a long address is arranged at the bottom is modified, and in this embodiment, the contents of the modification screen definition information 23 are changed as shown in FIG. OCR
The layout of the correction screen can be displayed differently from the image of the entire form.

In the case where a long address is described in a form in which an address that cannot be completely described in a prescribed item is described next to a spare item at a distant position such as a lower portion of the form, as shown in FIG. Although related items may be separated from each other, when the recognition result is displayed on the OCR correction screen, if the addresses are collectively displayed in one place, the user who makes the correction can more easily understand the contents of the correction. In this embodiment,
Since the correction items on the correction screen and the coordinates of the highlighting frames of the plurality of related items on the form image data are associated by the related numbers, even if the layout of the correction screen is changed, the plurality of related items corresponding to the correction items are changed. Items can be highlighted.

As described above, in the present embodiment, the item emphasis frame data is stored in the attribute of each item in the form item definition file, so that when the OCR correction screen and the entire form image are displayed, the designated items on the OCR correction screen are displayed. An emphasis frame can be displayed on a corresponding part of the entire form image. Also,
By storing the related item number in the attribute for each item in the form item definition file in the same way as the item emphasis frame data, the OCR
When the correction screen and the entire form image are displayed, it is possible to highlight an item related to the designated item on the OCR correction screen by highlighting a corresponding portion on the entire form image with a highlight frame.

As described above, according to the form input device of the present embodiment, a specific image portion corresponding to a correction item to a recognition result of a form displayed according to a predetermined format is highlighted, so that an image is input. It is possible to improve the visibility of correction / confirmation when correcting the recognition result of the form.

[0039]

According to the present invention, a specific image portion corresponding to a correction item to a recognition result of a form displayed according to a predetermined format is highlighted, so that the recognition result of the form input as an image is corrected. It is possible to improve the visibility of correction and confirmation.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a schematic configuration of an OCR system according to an embodiment.

FIG. 2 is a diagram illustrating an example of a relationship between OCR output data and screen display contents according to the present embodiment.

FIG. 3 is a diagram showing details of screen display contents of FIG. 2 of the embodiment.

FIG. 4 is a diagram illustrating an example of an item highlighting frame setting process 11 according to the present embodiment.

FIG. 5 is a diagram showing details of screen display contents of FIG. 4 of the present embodiment.

FIG. 6 is a flowchart illustrating a procedure of an item emphasis frame setting process 11 according to the embodiment.

FIG. 7 is a diagram illustrating an example of a related item highlighting frame setting process 12 according to the present embodiment.

FIG. 8 is a diagram showing details of screen display contents of FIG. 7 of the present embodiment.

FIG. 9 is a flowchart illustrating a processing procedure of a related item highlighting frame setting process 12 according to the embodiment.

FIG. 10 is a diagram illustrating an example of a format change of a correction screen according to the embodiment.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Central processing apparatus, 2 ... Display apparatus, 3 ... Keyboard apparatus, 4 ... Form item definition file, 5 ... OCR output data, 6 ... OCR output data display processing, 7 ... Operator,
100: form recognition processing unit, 101: highlight display processing unit, 1
1 ... Item emphasis frame setting process, 12 ... Related item emphasis frame setting process, 13 ... Form whole image, 14 ... Item to be highlighted, 15 ... Form item definition data, 16 ... Form whole image, 17 ... Form whole image, 18 … Highlighted item, 1
9: items on the entire form image corresponding to highlighting item 18, 20: related items, 21: data of OCR correction screen, 22: item number, 23: correction screen definition information, 24
... Image emphasis frame data, 25 ... Screen status, 26 ... Screen status, 31 ... OCR correction screen data, 32 ... Related number, 33 ... Screen status, 34 ... Image emphasis frame, 35 ... Image emphasis frame, 36 ... Screen status .

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Kenichi Manpo, 890 Kashimada, Saiwai-ku, Kawasaki-shi, Kanagawa Prefecture Information Systems Division, Hitachi, Ltd. (72) Kazutoshi Hirata 6, Oue-cho, Naka-ku, Yokohama-shi, Kanagawa 81 Hitachi Software Engineering Co., Ltd. In-house F-term (reference) 5B064 AA01 FA05 FA07 FA09 FA13

Claims (5)

[Claims] 1. A form input method for recognizing a form input with an image and inputting the contents of the form, wherein the contents input by the recognition of the form input with the image are displayed according to a predetermined format, and the recognition result is displayed. Receiving a correction item for the form, and highlighting a specific image portion corresponding to the received correction item in the entire form input image data. 2. The form input method according to claim 1, further comprising a step of highlighting an image portion corresponding to a related item related to the received correction item. 3. The form input method according to claim 1, wherein the predetermined form is different from a form displayed in form image data. 4. A form input device for recognizing an image-inputted form and inputting the contents of the form, wherein the input contents are displayed according to a predetermined format by recognizing the image-inputted form, and the recognition result is displayed. And a highlighting processing unit for highlighting a specific image portion corresponding to the received correction item in the whole of the input form image data. Form input device. 5. A computer-readable recording medium storing a program for causing a computer to function as a form input device for recognizing an image-input form and inputting the contents of the form. A form recognition processing unit for displaying the contents input by the recognition in accordance with a predetermined format and receiving a correction item corresponding to the recognition result; and a specification corresponding to the received correction item in the entire image input form image data. A recording medium on which a program for causing a computer to function as a highlighting processing section for highlighting an image portion is recorded.