JP5243228B2 - Character recognition device and method for generating confirmation screen of character recognition device - Google Patents

Description

  The present invention relates to a character recognition device that performs character recognition from image data, and more particularly to a character recognition device that can correct character recognition information obtained by performing character recognition from image data by a correction instruction.

  Generally, a character recognition device recognizes characters or character strings in input image data and outputs character data. In such a character recognition device, there are cases where it is not possible to accurately recognize characters from image data due to the density of character images, skill of handwritten characters, and the like. In such a case, it is necessary for the operator to check the image data and correct the character string. Further, even if the character can be recognized, there is a misrecognition of “1” and “7”, which still requires confirmation by the operator. Further, even when characters are recognized correctly, the characters themselves input as an image may be erroneously written, and confirmation work by the operator is still necessary. In particular, it is indispensable to check the character-recognized data by comparing the image data of the form and the character-recognized data in a scene involving payment at a financial institution or the like.

  Therefore, for example, image data corresponding to the recognition result character string is displayed at an upper position in the vicinity of the recognition result character string, thereby facilitating mutual confirmation work between the recognition result character string and the image data. ing. However, according to such display, since it is necessary to display both the recognition result character string and the image data for all items, the confirmation screen extends vertically depending on the number of items in the form. For this reason, the screen area necessary for display becomes too large, and there are cases where items to be checked cannot fit on one screen. If it does so, the confirmation work by scrolling a screen will be needed and work efficiency will fall.

In view of this, there is a proposal to display image data corresponding to directly below or directly above the recognition result character string when the cursor is positioned on the recognition result character string of the displayed character field (see, for example, Patent Document 1). Thereby, the vertical extension of the confirmation screen is suppressed, and the confirmation work is facilitated.
JP-A-4-216185

  However, displaying image data directly below or directly above the corresponding recognized character string has a problem in that other recognized character strings located directly below or directly above are hidden. The operator may check not only by comparing the image data with the recognized character string corresponding to the image data but also by considering other items. In such a case, if other items to be considered are hidden in the image display, the operator cannot perform efficient confirmation work.

  The present invention has been made in view of these points, and an object of the present invention is to provide a character recognition device that can be efficiently checked by an operator.

In the present invention, in order to solve the above-mentioned problem, in a character recognition device for generating a confirmation screen for character recognition information obtained by performing character recognition of image data, item image data is preliminarily set in units of items from the image data. Corresponding to the item image data including the correction target when accepting a correction instruction for the character recognition information, and an item definition means for cutting out, an association definition information storage means for storing association definition information in which a plurality of the items are associated and defined Display generating means for generating a confirmation screen that combines display of the character recognition information of a plurality of items to be displayed and display of the item image data corresponding to the character recognition information to be corrected, and the item image on the confirmation screen The display position of the data, the display position of the character recognition information corresponding to the item image data, and the association It includes an item image data display arrangement means for arranging the not overlap with the defined other display position of the character recognition information display position, and the item image data display arranging unit, the display of the item image data in the confirmation screen It is determined whether or not the position can be arranged at a display position that does not overlap with the display position of the character recognition information corresponding to the item image data and the display position of the other character recognition information defined in association with the item image data. when the item character recognition apparatus characterized that you placed on the display position of the display image data previously set is provided.

  According to the present invention, in order to solve the above problems, in a character recognition device for generating a confirmation screen of character recognition information obtained by performing character recognition of image data, an item image is defined in units of items determined in advance from the image data. Item extraction means for cutting out data, association definition information storage means for storing association definition information in which a plurality of the items are associated and defined, and the item image data including a correction target when receiving a correction instruction for the character recognition information Display generating means for generating a confirmation screen that combines the display of the character recognition information of a plurality of items corresponding to the item and the display of the item image data corresponding to the character recognition information to be corrected, and the display in the confirmation screen The display position of the item image data, the display position of the character recognition information corresponding to the item image data, and The character string of the item image data display and the corresponding character string of the character recognition information are displayed at a display position that does not overlap with the display position of the other character recognition information defined in association with the character string of the character recognition information. Item image data display arrangement means for arranging the image data display arrangement means arranged in parallel in the vicinity, wherein the item image data display arrangement means displays the display position of the item image data corresponding to the display position of the item image data on the confirmation screen. The display position of the other character recognition information that is defined in association with the corresponding character recognition information is arranged after being arranged at a display position that does not overlap with the display position of the character recognition information that has not yet been corrected. There is provided a character recognition device characterized in that it is arranged to avoid.

  Further, in the present invention, in order to solve the above-mentioned problem, in a character recognition device that generates a confirmation screen for character recognition information obtained by performing character recognition of image data, an input receiving means for receiving a correction instruction for the character recognition information Input information storage means for storing the input information of the correction instruction, item cutout means for cutting out item image data from the image data into predetermined item units, and when the correction instruction is received, a correction target is included Display generating means for generating a confirmation screen by combining display of the character recognition information of a plurality of items corresponding to the item image data and display of the item image data corresponding to the character recognition information to be corrected; Correct the display position of the item image data on the confirmation screen in the vicinity of the display position of the corresponding character recognition information. Item image data display arrangement means arranged at a display position that does not overlap with the display position of the unrecognized character recognition information, and the item image data display arrangement means corrects the character recognition information based on the input information. If the other character recognition information in the vicinity of the display position of the corresponding character recognition information is uncorrected, the item image data is displayed. A character recognition device is provided that is arranged at a preset display position.

  According to the disclosed character recognition apparatus, it is possible to easily compare character recognition information of other items to be considered on the confirmation screen, and an efficient confirmation operation by the operator can be performed.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. First, an outline of the present embodiment will be described, and then specific contents of the present embodiment will be described.
FIG. 1 is a diagram illustrating an outline of a character recognition device according to an embodiment. A character recognition device 100 shown in FIG. 1 receives image data 1 and outputs a confirmation display signal 6 (image signal) for displaying characters recognized from the image data 1 on a display device. The character recognition device 100 includes an item extraction unit 2, a display generation unit 3, an item image data display arrangement unit 4, and an association definition information storage unit 5.

The item cutout unit 2 cuts out an image portion corresponding to a predetermined item from the input image data 1 as item image data.
The display generation means 3 generates a confirmation screen that combines the character recognition information that is the result of character recognition of the item image data and the item image data, and outputs a confirmation display signal 6.

A display device (not shown) displays a confirmation screen based on the confirmation display signal 6.
The item image data display arrangement unit 4 displays the display position of the character recognition information corresponding to the item image data and the display position of other character recognition information defined in association based on the association definition information stored in the association definition information storage unit 5. The display of the item image data is arranged at a display position that does not overlap with the display.

  As a result, when the operator confirms the character recognition information on the confirmation screen, the display of the item image data does not overlap with the character recognition information of other items to be considered, and the character recognition of other items to be considered is recognized. Enables efficient work while checking information.

  Furthermore, since the display position of the item image data is dynamically controlled, there is no need to always provide an area for displaying the item image data, and the confirmation screen can be configured compactly. Making the confirmation screen compact contributes to the efficiency of the confirmation work by reducing the screen feeding work by the operator.

Hereinafter, the embodiment will be described more specifically.
[First Embodiment]
First, a first embodiment will be described in detail with reference to the drawings.

  FIG. 2 is a diagram illustrating a hardware configuration of the character recognition device according to the first embodiment. The entire character recognition apparatus 100 is controlled by a CPU (Central Processing Unit) 101. A random access memory (RAM) 102, a hard disk drive (HDD) 103, a communication interface 104, a graphic processing device 105, and an input / output interface 106 are connected to the CPU 101 via a bus 107.

  The RAM 102 temporarily stores at least part of an OS (Operating System) program and application programs to be executed by the CPU 101. The RAM 102 stores various data necessary for processing by the CPU 101. The HDD 103 stores an OS program and application programs. The communication interface 104 is connected to the network 30.

  A monitor 23 is connected to the graphic processing device 105. The graphic processing device 105 displays an image on the screen of the monitor 23 in accordance with a command from the CPU 101. The input / output interface 106 transmits signals sent from the scanner 20, the keyboard 21, and the mouse 22 to the CPU 101 via the bus 107. Further, a DMAC (Direct Memory Access Controller) (not shown) transmits a signal transmitted from the scanner 20 to the RAM 102 or the HDD 103 without passing through the CPU 101. With the hardware configuration as described above, the processing functions of this embodiment can be realized.

  FIG. 3 is a block diagram illustrating functions of the character recognition device according to the first embodiment. A character recognition apparatus 100 shown in FIG. 3 inputs image data 1 of a form scanned by the scanner 20, displays characters recognized from the image data 1 on a monitor 23, and corrects or confirms input using a keyboard 21 or a mouse 22. Is to accept. The character recognition device 100 includes an item extraction unit 2, a form definition information storage unit 7, a character recognition unit 8, a character recognition information storage unit 9, an item image data storage unit 10, an item image data display arrangement unit 4, and a screen definition information storage. Means 11, association definition information storage means 5, input reception means 13, input information storage means 12, and display generation means 3.

  The item cutout unit 2 cuts out an image portion corresponding to a predetermined item from the input image data 1 as item image data based on the item cutout information stored in the form definition information storage unit 7.

  The character recognition means 8 performs character recognition according to a predetermined character recognition algorithm for the item image data cut out by the item cutout means 2 in consideration of the character recognition information for each item stored in the form definition information storage means 7. The character recognition means 8 generates character recognition information as a result of character recognition.

  The character recognition information is information extracted by recognizing predetermined information from the item image data, and is not necessarily limited to characters in a narrow sense, but is a concept including significant information such as numbers, symbols, and symbols. The character recognition information is not limited to information of one character (minimum recognition unit), and in many cases is a character string composed of a plurality of characters.

The character recognition information storage unit 9 stores, for each item, character recognition information that is a result of the character recognition unit 8 recognizing characters from the item image data.
The item image data storage unit 10 stores the item image data extracted by the item extraction unit 2 for each item.

  The item image data display arrangement unit 4 performs control (display position setting) for arranging the item image data stored in the item image data storage unit 10 on the confirmation screen. The control for arranging the item image data on the confirmation screen is based on the screen definition information stored in the screen definition information storage unit 11, the association definition information stored in the association definition information storage unit 5, and the input information stored in the input information storage unit 12. Done.

  The display generation means 3 includes screen definition information stored in the screen definition information storage means 11, character recognition information stored in the character recognition information storage means 9, item image data instructed from the item image data display arrangement means 4, and display positions thereof. Based on the above, a confirmation screen to be displayed on the monitor 23 is generated.

  The form definition information storage unit 7 stores form definition information of the form from which the image data 1 is read. In the form definition information, item entry information used to extract item image data such as the number of items in the form from which it was read, the name of each item, the position and size of the entry column for each item, and input of the description contents Input form information about forms (for example, numbers, alphabets, kanji, kana, symbols, etc., number of digits or number of characters), itemized dictionaries to optimize character recognition (for example, financial institution name list, branch name) Character recognition information used for character recognition. The form definition information storage means 7 stores form definition information for each form when dealing with a plurality of types of forms.

  The screen definition information storage unit 11 stores screen definition information that defines a confirmation screen to be displayed on the monitor 23. The screen definition information defines the position, size, and color of elements to be displayed on the confirmation screen. Display elements include character recognition information, item image data, background images, and the like. Further, the screen definition information includes a display mode change (for example, character color, size, character recognition information unconfirmed state, correctable state, corrected state, confirmation state, etc.). Font changes, background color changes, etc.) are also stored. The screen definition information is used by the display generation means 3 to generate a confirmation screen. The screen definition information is also used by the item image data display arrangement unit 4 to control the display position of the item image data while avoiding interference between the display of the item image data and the character recognition information.

  The association definition information storage unit 5 stores association definition information in which a plurality of items are associated. The items associated with each other by the association definition information are items that should ensure the simultaneous visibility on the confirmation screen. Association is made when the character recognition information of one item is useful for confirming the character recognition information of the other item, and a list of a plurality of associated items is registered as association definition information.

The input receiving unit 13 receives an operation input by the operator from the keyboard 21 or the mouse 22.
The input information storage unit 12 stores the input information based on the operation input received by the input receiving unit 13. The input information includes input state information indicating an input state on the confirmation screen and input history information of an operation input history.

  According to such a character recognition device 100, the received image data 1 is cut into item image data by the item cutout means 2. The extracted item image data is stored in the item image data storage means 10. Further, character recognition information is obtained from the extracted item image data as an output result of character recognition by the character recognition means 8. The character recognition information is stored in the character recognition information storage unit 9. The display position of the item image data read out from the item image data storage unit 10 by the item image data display arrangement unit 4 on the confirmation screen is controlled by screen definition information, input information, and association definition information. The character recognition information read from the character recognition information storage unit 9 by the display generation unit 3 and the item image data whose display position is controlled are displayed on the confirmation screen generated by the display generation unit 3 based on the screen definition information. Is displayed.

  As a result, when the operator confirms the character recognition information on the confirmation screen, the display of the item image data does not overlap with the character recognition information of other items to be considered, and the character recognition of other items to be considered is recognized. Enables efficient work while checking information.

  Furthermore, since the display position of the item image data is dynamically controlled, there is no need to always provide an area for displaying the item image data, and the confirmation screen can be configured compactly. Making the confirmation screen compact contributes to the efficiency of the confirmation work by reducing the screen feeding work by the operator.

  FIG. 4 is a diagram illustrating an example of a form (transfer request form) according to the first embodiment. The transfer request form 50 is a form used when a customer makes a transfer request in a financial institution. The transfer request form 50 includes a transfer amount description column 53, a transfer bank name description column 54, a transfer branch name description column 55, and a transfer account number description column for describing information necessary for processing by the financial institution. 56, a transfer person name description column 57 and a client name description column 58 are provided. On the left side of each description column, items 51 indicating the contents to be described in the description column are described as headings. The customer enters the transaction content 52 requested in each entry column of the transfer request form 50.

  The customer submits a transfer request form 50 in which the transaction content 52 is entered to the counter. The teller reads the transfer request form 50 with the scanner 20 and generates the image data 1 of the transfer request form 50. The generated image data 1 of the transfer request form 50 is input to the character recognition device 100 to which the scanner 20 is connected. The transfer request form 50 is an example of a form, and various forms are prepared according to the handling work.

  The image data 1 input to the character recognition device 100 is cut out as item image data by the item cutout means 2 in the size of each item description column. Here, each item image data includes transfer amount image data, transfer destination bank name image data, transfer destination branch name image data, transfer destination account number image data, transfer person name image data, and client name image data.

  In extracting each item image data, the type of the form is specified from the image data 1 and the form definition information corresponding to the specified form is read from the form definition information storage means 7. The form definition information includes item extraction information used for extracting the item image data 1 such as the number of items of the form that is the reading source, each item name, the position of the entry column of each item, and the size.

  A form of a financial institution is an example, and if it can be captured as image data 1, it can be converted into image data. For example, there are various documents such as application forms, invoices, receipts, etc., cards such as cash cards and licenses, booklets such as passbooks, or combinations of multiple pages in general transactions.

  In addition, the image data 1 is not limited to the information converted into image data via a form with a scanner or digital camera as an optical reading means, but the image data 1 can be imaged without using a form with a touch panel as a coordinate reading means. Includes data.

  FIG. 5 is a diagram illustrating a form confirmation screen according to the first embodiment. The confirmation screen 60 is a screen on which the operator confirms the character recognition result of the transfer request form 50 in the financial institution, and is displayed on the monitor 23. The confirmation screen 60 displays a payment amount display field 63, a bank name display field 64, a bank name display field 65, a bank account number display field 66, a bank account transfer, in order to display a character recognition result that the operator needs to confirm. A personal name display field 67 and a client name display field 68 are provided. In each display column, character recognition information is displayed as a character recognition result of the contents entered by the customer. The character recognition information displayed on the confirmation screen 60 includes transfer amount recognition information and transfer account number recognition information as numeric strings, and transfer destination bank name recognition information, transfer destination branch name recognition information, transfer as character string recognition information. There are personal name recognition information and client name recognition information. In addition, you may make it handle the numerical sequence of character recognition information as a numerical value. On the left side of each display field, items 61 indicating the contents displayed in the display field are displayed as headings.

The confirmation screen 60 is a display example corresponding to the transfer request form 50, which is one of the forms, and confirmation screens corresponding to various forms are generated based on the screen definition information.
The operator selects the display contents displayed in the display column so as to be correctable by operating the keyboard 21 or the mouse 22, so that item image data not shown in FIG. 5 is displayed and the confirmation screen 60 is displayed. Check the character recognition results displayed in each display field.

  Next, item image data display processing for determining the display position of the item image data to be displayed on the confirmation screen 60 will be described. The item image data display process is executed by the character recognition device 100 when displaying the item image data.

FIG. 6 is a flowchart illustrating a procedure of item image data display processing according to the first embodiment. In the following, the process illustrated in FIG. 6 will be described in order of step number.
[Step S10] The display generation means 3 displays a cursor for a display field in a state where the displayed character recognition information can be corrected. The cursor is moved when the input receiving means 13 receives an operation of the keyboard 21 or the mouse 22. In the cursor display, in addition to moving the display column of the item to be corrected, the cursor is moved in the character string in the display column.

  In a state where the display column is focused by the cursor (a state where the cursor is positioned in the display column), the item image data corresponding to the character recognition information displayed in the display column is displayed on the confirmation screen 60. The item image data display arrangement unit 4 executes the processing from S20 to S40 in order to determine where the item image data is displayed.

  [Step S20] The item image data display arrangement unit 4 overlaps the display column of the adjacent item and the display of the item image data in order to avoid displaying the item image data at a position where the display column of the adjacent item is hidden. To check.

  [Step S30] The item image data display arrangement unit 4 checks the state of the display column of the adjacent item in order to avoid displaying the item image data at a position where the display column of the adjacent uninput item is hidden.

  [Step S40] In order to avoid displaying the item image data at a position where the related item display column is hidden, the item image data display arrangement unit 4 overlaps the display of the related item display column and the display of the item image data. To check.

  [Step S50] The item image data display arrangement unit 4 determines the display position of the item image data, and the display generation unit 3 generates a confirmation screen for displaying the item image data at the determined display position.

  In this way, even if the cursor is moved and displayed and the display column in the focused state is switched, the display position of the item image data is appropriately controlled by the item image data display arrangement unit 4, so that the operator can When checking the character recognition information, the display of the item image data and the character recognition information of other items that should be considered will not overlap, and it is efficient while checking the character recognition information of other items to be considered. Makes it possible.

  Furthermore, since the display position of the item image data is dynamically controlled, there is no need to always provide an area for displaying the item image data, and the confirmation screen can be configured compactly. Making the confirmation screen compact contributes to the efficiency of the confirmation work by reducing the screen feeding work by the operator.

Next, the overlap check process in FIG. 6 will be described in detail.
FIG. 7 is a flowchart illustrating a procedure of overlap check processing according to the first embodiment. In the following, the process illustrated in FIG. 7 will be described along with step numbers.

  [Step S21] The vertical / horizontal size of the item image data is calculated. By default, the vertical / horizontal size of the item image data is the size of the display column of the corresponding character recognition information. Therefore, the item image data display arrangement unit 4 refers to the screen definition information to obtain the vertical / horizontal size of the item image data. Also, as an option, the original size of the form, the enlarged or reduced size of the original size, and the like can be selected. In this case, the vertical / horizontal size of the item image data is obtained by referring to the screen definition information and the form definition information.

  [Step S22] When the calculated vertical / horizontal size item image data is displayed on the upper side adjacent to the character recognition information display column corresponding to the item image data, the character recognition information display column adjacent in the upward direction Check whether the item image data overlaps (the presence or absence of interference in the display area). If the character recognition information display field adjacent in the upward direction overlaps with the item image data, the process proceeds to step S23. If the character recognition information display field adjacent in the upward direction does not overlap with the item image data, the process proceeds to step S25.

  [Step S23] When the calculated vertical / horizontal size item image data is displayed on the lower side adjacent to the character recognition information display field corresponding to the item image data, the character recognition information display field adjacent in the downward direction is displayed. And whether the item image data overlaps (display area interference). When the display column of the character recognition information adjacent in the downward direction overlaps with the item image data, the overlap check process ends. If the character recognition information display field adjacent in the downward direction does not overlap with the item image data, the process proceeds to step S24.

[Step S24] The display position of the calculated item image data of vertical / horizontal size is set to the lower side adjacent to the display column of the corresponding character recognition information, and the overlap check process ends.
[Step S25] The display position of the calculated item image data of the vertical / horizontal size is set to the upper side adjacent to the corresponding character recognition information display field, and the overlap check process ends.

  In this way, the item image data display arrangement unit 4 checks the overlap between the display column of the adjacent item and the display of the item image data, and sets the display position of the item image data. It is possible to avoid displaying the item image data at a position where the column is hidden.

Next, the input completion check process in FIG. 6 will be described in detail.
FIG. 8 is a flowchart illustrating a procedure of the input check process according to the first embodiment. In the following, the process illustrated in FIG. 8 will be described in order of step number.

  This process is executed when the display position of the item image data is not set in the overlap check process. That is, this process is not executed when the display position of the item image data is set in the overlap check process.

  [Step S31] It is checked whether or not the upper (upper position) display field adjacent to the display field of the character recognition information corresponding to the item image data has been input. If the upper display field is not input, the process proceeds to step S32. If the upper display field has been input, the process proceeds to step S34.

  Note that “completed in the display field” means that the character recognition information displayed in the display field has been corrected or confirmed. “No entry in the display column” means that the character recognition information displayed in the display column has not been corrected or confirmed. The determination as to whether correction or confirmation has been made can be made by referring to the state information (corrected state, confirmation state) for each display column stored in the screen definition information storage unit 11.

  The determination can also be made based on the input information (input history) stored in the input information storage unit 12. At that time, in order to accept re-correction of the display field, the input completed state (corrected state, confirmed state) is canceled by a specific input history such as detection of the downward movement of the cursor, and the unentered state (unconfirmed state) You may make it.

  [Step S32] It is checked whether or not the lower (lower position) display field adjacent to the character recognition information display field corresponding to the item image data has been input. If the lower display field is not input, the process proceeds to step S35. If the lower display field has been input, the process proceeds to step S33.

  [Step S33] The display position of the item image data of the vertical / horizontal size calculated in step S21 is set to the lower side adjacent to the corresponding character recognition information display field, and the input check process is terminated.

  [Step S34] The display position of the item image data of the vertical / horizontal size calculated in step S21 is set on the upper side adjacent to the display column of the corresponding character recognition information, and the input check process is completed.

  [Step S35] The display position of the item image data of the vertical / horizontal size calculated in step S21 is set to a default position (for example, the upper side adjacent to the display column of the corresponding character recognition information), and the input check process is completed. To do.

  In this way, the item image data display arrangement unit 4 checks the state of the display column of the adjacent item and sets the display position of the item image data on the display column side of the adjacent input item. It is possible to avoid displaying the item image data at a position where the display column with the uninput item is hidden.

Next, the related item check process in FIG. 6 will be described in detail.
FIG. 9 is a flowchart illustrating a procedure of related item check processing according to the first embodiment. In the following, the process illustrated in FIG. 9 will be described in order of step number.

  [Step S41] It is checked whether the display position of the item image data set in the overlap check process or the input check process overlaps the display column of the related item (whether there is interference in the display area). If the display field does not overlap with the display field, and if the display field is not a related item even if it overlaps with the display field (if it is an unrelated item), the related item check process ends. If the overlapped display field is a related item, the process proceeds to step S42.

  Whether or not the item is a related item can be determined based on the association definition information stored in the association definition information storage unit 5. When the item image display item and the item in the display column determined to overlap are defined as elements of the same association definition list (association definition information), it is determined that the item is a related item.

  [Step S42] The display position of the set item image data is set on the opposite side of the display column of the corresponding character recognition information. That is, if the display position of the item image data is set on the upper side with respect to the display column of the corresponding character recognition information, the item image data is reset to the lower side. If the display position of the item image data is set to the lower side with respect to the corresponding character recognition information display field, the item image data is set to the upper side.

  [Step S43] It is checked whether the display position of the item image data set in step S42 overlaps the display column of the related item. If the display field does not overlap with the display field, and if the display field does not overlap with the display field, the related item check process ends. If the overlapped display field is a related item, the process proceeds to step S44.

  [Step S44] The display position of the set item image data is set to a fixed position. The fixed position is the display position of the item image data that is set when the display position of the item image data cannot be set near the corresponding display field. The fixed position is stored as fixed position information in the screen definition information storage unit 11. The fixed position information can be one fixed position in the form. In this case, it is not easy to compare both the item image data and the character recognition information, but it is easy to grasp the display position. Further, a fixed position may be set for each item. For example, the display position of the item image data may be a position adjacent to the display column of the related character recognition information. In this case, even if the comparison between both items is not easy, the comparison between both items can be facilitated.

  In this way, the item image data display arrangement unit 4 checks the display column of the related item and sets the display position of the item image data. Therefore, the item image data display arrangement unit 4 hides the display column with the related item. Can be avoided.

Next, a display example of the confirmation screen will be described in detail.
FIG. 10 is a diagram illustrating a display example of the overlap check on the confirmation screen according to the first embodiment. This is a display example in the middle of an operation input by the operator on the confirmation screen having a larger display area than the confirmation screen 60 of FIG. 5 generated from the image data 1 of the transfer request form 50 of FIG.

FIG. 10A is a display example in which the item image display is set to the upper side of the corresponding display column after the upper position overlap check.
The operator moves and displays the cursor to focus on the transfer amount item. In the focused state, an underbar is displayed at the least significant digit of “10,000” in the transfer amount display field 63. This state is a correctable state in which the operator can correct the character recognition information of the transfer amount item. Here, “10,000” is displayed as the item image data display 63a in order to confirm whether or not the operator has correctly recognized “10,000” as the character recognition information. In the item image data display 63a, the handwritten character of the customer is displayed as an image. As for the display position of the item image data display 63a, the upper position overlap check is performed in step S22, and there is no upper position overlap, so in step S25 the upper side of the transfer amount display column 63 corresponding to the item image data display 63a )

FIG. 10B shows a display example in which the item image display is set to the lower side of the corresponding display column after the lower position overlap check.
The operator confirms “10,000” in the transfer amount display column 63 (FIG. 10A), moves the cursor to the next transfer destination bank name display column 64, and focuses on the transfer destination bank name item. doing. In the focused state, an underscore is displayed at the end of the character string of “That bank” in the bank name display field 64 for the transfer destination. Here, in order for the operator to confirm whether or not “that bank”, which is the character recognition information, has been correctly recognized, “that bank” is displayed as the item image data display 64a. The item image data display 64a displays customer handwritten characters as images. Since the display position of the item image data display 64a has an upper position overlap, after the upper position overlap check in step S22, the lower position overlap check is performed in step S23. It becomes the lower side (position parallel in the vicinity) of the corresponding transfer destination bank name display column 64.

  The confirmation of the character recognition information (input item) is accepted when the operator presses the enter key on the keyboard 21, and the transfer amount display field 63 is changed from the correctable state to the corrected state or the confirmed state, and the internal state ( The state of the display element) is updated. Also, the status update is clearly indicated by changing the background color, the character color, or the typeface.

  FIG. 11 is a diagram illustrating a display example of an input check on the confirmation screen according to the first embodiment. 5 is a display example in the middle of an operation input by the operator on the confirmation screen 60 of FIG. 5 generated from the image data 1 of the transfer request form 50 of FIG.

  FIG. 11A shows a display example in which the item image display is set above the corresponding display column after the upper position overlap check. The operator moves and displays the cursor to focus on the transfer amount item. As for the display position of the item image data display 63a, the upper position overlap check is performed in step S22, and there is no upper position overlap, so in step S25 the upper side of the transfer amount display column 63 corresponding to the item image data display 63a )

  FIG. 11B is a display example in which the item image display is set to the upper side of the corresponding display column after the input completion check. The operator confirms “10,000” in the transfer amount display column 63 (FIG. 11A), moves the cursor to the next transfer destination bank name display column 64, and focuses on the item of the transfer destination bank name. doing. In the focused state, an underscore is displayed at the end of the character string of “That bank” in the bank name display field 64 for the transfer destination. Here, in order for the operator to confirm whether or not “that bank”, which is the character recognition information, has been correctly recognized, “that bank” is displayed as the item image data display 64a. The item image data display 64a displays customer handwritten characters as images. Since the display position of the item image data display 63a includes both the upper position overlap and the lower position overlap, the upper position input completion check is performed in step S31, and it is determined that the upper position input has been completed, so that the step S34 corresponds to the item image data display 64a. This is the upper side of the bank name display field 64 to be transferred (a position that overlaps with the transfer amount display field 63 that has been input in parallel in the vicinity).

  FIG. 12 is a diagram illustrating a display example of the related item check on the confirmation screen according to the first embodiment. 5 is a display example in the middle of an operation input by the operator on the confirmation screen 60 of FIG. 5 generated from the image data 1 of the transfer request form 50 of FIG. Here, the transfer destination bank name display field 64 and the transfer destination branch name display field 65 are defined in association with each other. For example, an association definition list (association definition information) such as list No 1 = {transfer destination bank name, transfer destination branch name} is stored in the association definition information storage means 5. As a result, the transfer destination branch name can be used as reference information for confirmation of the transfer destination bank name, and the transfer destination bank name can be used as reference information for confirmation of the transfer destination branch name. The efficiency of the operator's confirmation work is improved by making the confirmation possible at the same time. Specifically, when it is unclear whether the item image data display is “Any Bank” or “Aira Bank”, if both bank names exist, the branch name “Kakiku Branch” is determined. It can be a clue. Accordingly, the association definition is made between items in which one item contains information significant for confirmation of the other item. For example, the association is effective when the related item has a predetermined correspondence such as a postal code and an address, a name and a reading, and an identification code and a name.

  FIG. 12A shows a display example in which the item image display is set above the corresponding display column after the related item check. The operator moves and displays the cursor to focus on the bank name item. The display position of the item image data display 64a is the upper side of the transfer destination bank name display column 64 corresponding to the item image data display 64a by the overlap check processing S20 and the input check processing S30 (the transfer amount display column that has been input in parallel in the vicinity). 63). Here, since the input transfer amount display field 63 is not defined in association with the transfer destination bank name, the overlap between the item image data display 64a and the input transfer amount display field 63 is the display position related item check S41. It is determined that the unrelated items overlap. Therefore, the item image data display 64a is displayed at the display position set by the overlap check process S20 and the input check process S30.

  FIG. 12B is a display example in which the item image display is set below the corresponding display column after the related item check. The operator confirms “that bank” in the transfer destination bank name display field 64 (FIG. 12A), moves the cursor to the next transfer destination branch name display field 65 and displays the transfer destination branch name item. Focused. The display position of the item image data display 65a is the upper side of the transfer destination bank name display column 64 corresponding to the item image data display 65a by the overlap check processing S20 and the input check processing S30 (the name of the transfer destination bank that has been input in parallel in the vicinity). The position overlaps the display field 64). Here, since the input bank name display field 64 has been defined in association with the bank name, the overlap between the item image data display 65a and the input bank name display field 64 is the display position. In related item check S41, it is determined that related items overlap. In step S42, the display position is set on the reverse side. Accordingly, the item image data display 65a is on the opposite side of the display position set by the overlap check processing S20 and the input completion check processing S30, and below the transfer destination branch name display column 65 corresponding to the item image data display 64a. (A position that does not overlap the transfer destination bank name display field 64 that is a parallel and related item in the vicinity).

  FIG. 13 is a diagram illustrating a display example of the related item check on the confirmation screen according to the first embodiment. 5 is a display example in the middle of an operation input by the operator on the confirmation screen 60 of FIG. 5 generated from the image data 1 of the transfer request form 50 of FIG. Here, the transfer destination bank name display column 64, the transfer destination branch name display column 65, and the transfer destination account number display column 66 are defined in association with each other. For example, an association definition list such as list No 2 = {transfer destination bank name, transfer destination branch name, transfer destination account number} is stored in the association definition information storage means 5.

  In FIG. 13, the item of the transfer destination branch name is focused. Since the item at the upper position (transfer bank name) and the item at the lower position (transfer account number) are defined in association with the transfer branch name, the display position related item In checks S41 and S43, both the upper position and the lower position of the transfer destination branch name display field 65 are determined to be related items, and the item image data display is displayed at the fixed position 69 by S44.

  As described above, according to the character recognition device 100, since the association definition information in which a plurality of items are associated and defined is stored, the display position of the item image data on the display screen corresponds to the item image data. The character recognition information can be arranged at a display position that does not overlap with the display position of the character recognition information and the display position of the other character recognition information defined in association. When receiving a correction instruction, a display screen that combines display of multiple items of character recognition information corresponding to item image data including the correction target and display of item image data corresponding to the character recognition information to be corrected However, the problem that the character recognition information necessary for confirmation of correction cannot be confirmed by displaying the item image data does not occur.

  Accordingly, the item image data and the character recognition information of the item corresponding to the item image data can be easily compared, and the character recognition information of other items to be considered can be easily compared. Thereby, an efficient confirmation operation by an operator can be performed.

  Further, according to the present invention, the display position of the item image data on the display screen is arranged at a display position that does not overlap with the display position of the unrecognized character recognition information in the vicinity of the display position of the corresponding character recognition information. As a result, when receiving a correction instruction, the display of multiple items of character recognition information corresponding to the item image data including the correction target and the display of the item image data corresponding to the character recognition information to be corrected are combined. Even if the display screen is generated, there is no problem that the character recognition information necessary for confirmation of correction cannot be confirmed by displaying the item image data.

  Accordingly, the item image data and the character recognition information of the item corresponding to the item image data can be easily compared, and the character recognition information of other items to be considered can be easily compared. Thereby, an efficient confirmation operation by an operator can be performed.

[Second Embodiment]
FIG. 14 is a diagram illustrating a display example of the related item check on the confirmation screen according to the second embodiment. This embodiment is different from the first embodiment in that a group of a plurality of item image data displays defined in association is handled as one item image data display.

  The item image data display 64b is displayed as the item image data display in the transfer bank name display column 64. Further, the item image data display 64b is displayed as the item image data display in the transfer destination branch name display column 65.

  Thereby, even if the comparison in both units in one item unit is not the best position, the comparison in both units in the related item unit can be facilitated. In particular, it is excellent when it is desired to confirm the item image data display of related items at the same time.

[Third Embodiment]
FIG. 15 is a diagram illustrating a display example of a confirmation screen when the form according to the third embodiment is vertically written. This embodiment differs from the first embodiment in that the item image data display and the display column of each item are changed from horizontal writing to vertical writing on the confirmation screen 70. Thus, for vertical writing forms, the vertical writing character string of the item image data display and the vertical writing character string of the corresponding character recognition information are positioned in parallel in the vicinity of the vertical writing character string of the character recognition information. It is displayed on the confirmation screen 70 so as to be related. Thus, the present invention is not limited to a horizontally written description format, but can be applied to a vertically written description format.

[Fourth Embodiment]
FIG. 16 is a diagram illustrating a system configuration of a character recognition system according to the fourth embodiment. The first embodiment differs from the first embodiment in that the character recognition system 120 is configured by distributing and arranging the functions of the character recognition device 100 on a network.

  The character recognition system 120 includes a network 30, a form confirmation terminal 110 connected to the network 30, and a form confirmation server 111. The scanner 20a may be connected to any of the network 30, the form confirmation terminal 110, and the form confirmation server 111. The keyboard 21, mouse 22 and monitor 23 are connected to the form confirmation terminal 110. The form confirmation terminal 110 and the form confirmation server 111 have the same hardware configuration as that of the character recognition apparatus 100 in FIG. 2, and are connected to the network 30 via a communication interface to transmit / receive information to / from each other. According to such a character recognition system 120, the form confirmation server 111 is provided with at least one of the form definition information storage unit 7, the screen definition information storage unit 11, and the association definition information storage unit 5. It is possible to share common information when a plurality of confirmation terminals 110 are connected to the network 30. Further, the function of the form confirmation terminal 110 can be limited to input / output management, and other functions can be integrated into the form confirmation server 111. As described above, the function sharing between the form confirmation terminal 110 and the form confirmation server 111 can be arbitrarily set, and the function of one character recognition device 100 can be distributed on the network 30 to constitute the character recognition system 120. it can.

  The character recognition device of the present invention has been described based on the illustrated embodiment. However, the present invention is not limited to this, and the configuration of each part of the character recognition device 100 is an arbitrary configuration having the same function. Can be substituted. Moreover, other arbitrary structures and processes may be added to the present invention. Further, the present invention may be a combination of any two or more configurations (features) of the above-described embodiments.

  When a part of the processing functions provided in the character recognition device 100 is realized by software, a program describing the processing content of the function is provided. By executing the program on a computer, the above processing functions are realized on the computer.

  The program describing the processing contents can be recorded on a computer-readable medium. Examples of the computer-readable recording medium include a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory. Examples of the magnetic recording device include a hard disk device (HDD), a flexible disk (FD), and a magnetic tape. Examples of the optical disk include a DVD (Digital Versatile Disk), a DVD-RAM, a CD-ROM (Compact Disk Read Only Memory), and a CD-R (Recordable) / RW (ReWritable). Examples of the magneto-optical recording medium include an MO (Magnet-Optical disk).

  When distributing the program, for example, portable recording media such as a DVD and a CD-ROM in which the program is recorded are sold. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

  The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. In addition, each time the program is transferred from the server computer, the computer can sequentially execute processing according to the received program.

It is a figure which shows the outline | summary of the character recognition apparatus of embodiment. It is a figure which shows the hardware constitutions of the character recognition apparatus of 1st Embodiment. It is a block diagram which shows the function of the character recognition apparatus of 1st Embodiment. It is a figure which shows an example of the form (transfer request book) of 1st Embodiment. It is a figure which shows the confirmation screen of the form of 1st Embodiment. It is a flowchart which shows the procedure of the item image data display process of 1st Embodiment. It is a flowchart which shows the procedure of the overlap check process of 1st Embodiment. It is a flowchart which shows the procedure of the input completion check process of 1st Embodiment. It is a flowchart which shows the procedure of the related item check process of 1st Embodiment. It is a figure which shows the example of a display of the overlap check in the confirmation screen of 1st Embodiment. It is a figure which shows the example of a display of the input completion check in the confirmation screen of 1st Embodiment. It is a figure which shows the example of a display of the related item check in the confirmation screen of 1st Embodiment. It is a figure which shows the example of a display of the related item check in the confirmation screen of 1st Embodiment. It is a figure which shows the example of a display of the related item check in the confirmation screen of 2nd Embodiment. It is a figure which shows the example of a display of a confirmation screen when the form of 3rd Embodiment is vertical writing. It is a figure which shows the system configuration | structure of the character recognition system of 4th Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image data 2 Item extraction means 3 Display production | generation means 4 Item image data display arrangement means 5 Association definition information storage means 6 Confirmation display signal 100 Character recognition apparatus

Claims (8)

In a character recognition device that generates a confirmation screen of character recognition information obtained by performing character recognition of image data,
Item extraction means for extracting item image data from the image data in predetermined item units;
Association definition information storage means for storing association definition information in which a plurality of items are associated and defined;
When receiving the correction instruction for the character recognition information, the display of a plurality of items of the character recognition information corresponding to the item image data including the correction target, and the item image data corresponding to the character recognition information to be corrected Display generation means for generating a confirmation screen combined with the display;
An item that arranges the display position of the item image data on the confirmation screen at a display position that does not overlap with the display position of the character recognition information corresponding to the item image data and the display position of the other character recognition information defined in association with the item image data. Image data display arrangement means;
Equipped with a,
The item image data display arrangement means includes a display position of the item image data on the confirmation screen, a display position of the character recognition information corresponding to the item image data, and a display position of the other character recognition information defined in association with each other. and determines whether it is possible to place the non-overlapping display position, if it is determined that can not be arranged, the character recognition device characterized that you placed in the display position which is previously set the display of the item image data.   The association definition information is information that can specify a plurality of associated items, and the character recognition information of one item is associated with a relationship including information that is significant in confirming the character recognition information of another item. The character recognition device according to claim 1, wherein:   In a character recognition device that generates a confirmation screen of character recognition information obtained by performing character recognition of image data,
  Item extraction means for extracting item image data from the image data in predetermined item units;
  Association definition information storage means for storing association definition information in which a plurality of items are associated and defined;
  When receiving the correction instruction for the character recognition information, the display of a plurality of items of the character recognition information corresponding to the item image data including the correction target, and the item image data corresponding to the character recognition information to be corrected Display generation means for generating a confirmation screen combined with the display;
  The display position of the item image data on the confirmation screen is set to a display position that does not overlap with the display position of the character recognition information corresponding to the item image data and the display position of the other character recognition information defined in association with the item image data. Item image data display arrangement means for arranging image data display character strings and corresponding character recognition information character strings in a parallel positional relationship in the vicinity of the character recognition information character strings;
  With
  The item image data display arrangement means sets the display position of the item image data on the confirmation screen to the display position of the character recognition information that has not been confirmed to be corrected in the vicinity of the display position of the corresponding character recognition information. A character recognition device, wherein the character recognition device is arranged so as to avoid display positions of other character recognition information defined in association with the corresponding character recognition information after being arranged at non-overlapping display positions.   The character recognition device includes:
  Input receiving means for receiving the correction instruction;
  Input information storage means for storing input information of the correction instruction,
  The item image data display arrangement means includes:
  4. The character recognition apparatus according to claim 3, wherein it is determined whether or not the confirmation of correction of the character recognition information has been completed based on the input information.   In a character recognition device that generates a confirmation screen of character recognition information obtained by performing character recognition of image data,
  Input receiving means for receiving a correction instruction for the character recognition information;
  Input information storage means for storing input information of the correction instruction;
  Item extraction means for extracting item image data from the image data in predetermined item units;
  When receiving the correction instruction, the display of the plurality of items of character recognition information corresponding to the item image data including the correction target and the display of the item image data corresponding to the character recognition information to be corrected are combined. Display generation means for generating a confirmation screen,
  An item image in which the display position of the item image data on the confirmation screen is arranged at a display position that does not overlap with the display position of the character recognition information that has not been confirmed yet in the vicinity of the display position of the corresponding character recognition information. Data display arrangement means;
  With
  The item image data display arrangement means includes:
  It is determined whether the correction of the character recognition information has been confirmed based on the input information, and any other character recognition information in the vicinity of the display position of the corresponding character recognition information is corrected. A character recognition device characterized in that, when unconfirmed, the display of the item image data is arranged at a preset display position.   In a confirmation screen generation method of a character recognition device that generates a confirmation screen of character recognition information obtained by performing character recognition of image data,
  An item extracting step of extracting item image data from the image data in predetermined item units;
  An association definition information acquisition step for acquiring association definition information in which a plurality of the items are associated and defined;
  When receiving the correction instruction for the character recognition information, the display of a plurality of items of the character recognition information corresponding to the item image data including the correction target, and the item image data corresponding to the character recognition information to be corrected A display generation step for generating a confirmation screen combined with the display;
  An item that arranges the display position of the item image data on the confirmation screen at a display position that does not overlap with the display position of the character recognition information corresponding to the item image data and the display position of the other character recognition information defined in association with the item image data. An image data display arrangement step;
  With
  The item image data display arrangement step includes a display position of the item image data on the confirmation screen, a display position of the character recognition information corresponding to the item image data, and a display position of the other character recognition information defined in association with each other. A confirmation screen generation of a character recognition device, wherein the display of the item image data is arranged at a preset display position when it is determined that the item image data can be arranged at a display position that does not overlap with the display position. Method.   In a confirmation screen generation method of a character recognition device that generates a confirmation screen of character recognition information obtained by performing character recognition of image data,
  An item extracting step of extracting item image data from the image data in predetermined item units;
  An association definition information acquisition step for acquiring association definition information in which a plurality of the items are associated and defined;
  When receiving the correction instruction for the character recognition information, the display of a plurality of items of the character recognition information corresponding to the item image data including the correction target, and the item image data corresponding to the character recognition information to be corrected A display generation step for generating a confirmation screen combined with the display;
  The display position of the item image data on the confirmation screen is set to a display position that does not overlap with the display position of the character recognition information corresponding to the item image data and the display position of the other character recognition information defined in association with the item image data. An item image data display arrangement step in which a character string of image data display and a corresponding character string of the character recognition information are arranged in a parallel positional relationship in the vicinity of the character string of the character recognition information;
  With
  In the item image data display arrangement step, the display position of the item image data on the confirmation screen is set to the display position of the character recognition information that is not yet confirmed whether it is in the vicinity of the display position of the corresponding character recognition information. A method for generating a confirmation screen for a character recognition device, comprising: arranging at a non-overlapping display position and avoiding display positions of other character recognition information defined in association with the corresponding character recognition information.   In a confirmation screen generation method of a character recognition device that generates a confirmation screen of character recognition information obtained by performing character recognition of image data,
  An input information acquisition step of receiving an instruction to correct the character recognition information and acquiring the input information;
  An item extracting step of extracting item image data from the image data in predetermined item units;
  When receiving the correction instruction, the display of the plurality of items of character recognition information corresponding to the item image data including the correction target and the display of the item image data corresponding to the character recognition information to be corrected are combined. Display generation step for generating a confirmation screen,
  An item image in which the display position of the item image data on the confirmation screen is arranged at a display position that does not overlap with the display position of the character recognition information that has not been confirmed yet in the vicinity of the display position of the corresponding character recognition information. A data display arrangement step;
  With
  The item image data display arrangement step includes:
  It is determined whether the correction of the character recognition information has been confirmed based on the input information, and any other character recognition information in the vicinity of the display position of the corresponding character recognition information is corrected. A method for generating a confirmation screen for a character recognition device, wherein, when unconfirmed, the display of the item image data is arranged at a preset display position.

Images