JP4136282B2 - Image processing apparatus, image processing method, and storage medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing apparatus, an image processing method, and a storage medium that read and recognize a character string included in image data.
[0002]
[Prior art]
Conventionally, when reading specific information written on a form or the like, a template with information such as the position and size of the area where characters are written in advance is prepared, and the image data read by a photoelectric conversion device such as an image scanner A template is applied to and characters are recognized in the area.
[0003]
For example, when reading an address written on a form, first, template information corresponding to the form is extracted, and the recognition area of the form image is recognized using the position / size information of the address area stored in the template. Can be obtained.
[0004]
In addition, in order to select a template to be applied, a form ID at a predetermined position is first read, and the template is specified using the result. The form ID is an individually determined number that identifies the type of form.
[0005]
[Problems to be solved by the invention]
However, in the above-described conventional example, only a form in which a template already exists can be read. When a new form is input, an area is manually specified, a new template is created, or character recognition is performed. There was a drawback that information had to be entered manually without using it.
[0006]
The present invention has been made to solve the above problems, and an object of the present invention is to make it possible to read specific information on a form without a template.
[0007]
[Means for Solving the Problems]
In order to achieve the object of the present invention, for example, an image processing apparatus of the present invention comprises the following arrangement.
That is, storage means for storing the position information of the area of the character string included in the read image data, the position information of the cell surrounded by the ruled line, and the character code of the character string,
A specifying means for specifying a search target character string as a keyword,
Search means for searching for a character string corresponding to the keyword designated by the designation means from the storage means;
When there is a character string area different from the searched character string in the same cell as the cell containing the character string searched by the search means, the character code of the different character string is set as the keyword. As the value of
If there is no character string area different from the searched character string in the same cell as the cell containing the character string searched by the search means, the character string searched by the search means is included. Specifying means for specifying, as the value of the keyword, a character code of a character string existing in a cell located in the vicinity of the cell.
[0008]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, the present invention will be described in detail according to preferred embodiments with reference to the accompanying drawings.
[0009]
[First Embodiment]
FIG. 1 is a block diagram showing the configuration of an image processing apparatus for carrying out this embodiment.
[0010]
A CPU 101 controls the entire apparatus according to various control program codes stored in the ROM 102 or the external storage device 104.
[0011]
Reference numeral 102 denotes a ROM which stores program codes and data necessary for starting up the image processing apparatus. Also stored are program codes and setting data necessary after activation, character data used for character recognition, which will be described later, and command input from the keyboard 106 and pointing device 107.
[0012]
A RAM 103 temporarily stores various program codes read from the external storage device 104 or the ROM 102 and is used as a work area when the CPU 101 executes the program codes.
[0013]
Reference numeral 104 denotes an external storage device such as a magnetic disk, which stores books such as text files and image files.
[0014]
Reference numeral 105 denotes a display which displays image data (text data) or text data read from the external storage device 104 or the image scanner 108, or displays a system message from the image processing apparatus.
[0015]
A keyboard 106 can input various commands to the image processing apparatus together with the pointing device 107.
[0016]
Reference numeral 107 denotes a pointing device including a mouse and the like.
[0017]
Reference numeral 108 denotes an image scanner, from which a form is read and stored in the RAM 103 or the external storage device 104.
[0018]
Reference numeral 109 denotes a network interface (hereinafter referred to as network I / F), which can read and write files to other external storage devices via the network. When the image processing apparatus is implemented by a general-purpose computer or the like, an image processing method to be described later can be received via the network I / F 109 by a program code.
[0019]
A bus 111 connects the above-described units.
[0020]
FIG. 5 is a diagram illustrating an example of a form 501 to be processed by the image processing apparatus according to this embodiment. In the figure, a form 501 describes the contents to be described (book information) and its tags. Book information includes an address 506, a name 508, a reading 507 of the name 508, and a telephone number 509. As tags, an address tag 502, a name tag 504, a reading tag 503 of the name 508, a telephone number tag 505, and the like. is there. These fields are divided by ruled lines.
[0021]
An outline of processing executed by the image processing apparatus according to the present embodiment shown in FIG. 1 will be described with reference to a flowchart of the processing shown in FIG.
[0022]
In step S <b> 201, the book is read as image data from the scanner 108 and stored in the RAM 103. If the image data of the book is stored in advance in the file format in the external storage device 104, the file is read from the external storage device 104, developed and stored in the RAM 104 as image data.
[0023]
In step S202, a character area is extracted from the read book image data. At this time, position information (X, Y coordinate values) of the character area is stored in the RAM 103 as information relating to the character area. How to obtain the position information will be described later.
[0024]
In step S203, cells are extracted from the read book image data. Here, the cell is a rectangular area surrounded by ruled lines. For example, the character area is extracted by dividing the read book image data into M × N, thinning the divided small areas with OR, and combining the thinned book image data to form a small rectangle, Further, it can be realized by extracting a character line by combining rectangles in which the aspect ratio of each small rectangle is large and the short sides are close to each other. Alternatively, it is possible to extract a character region with high accuracy by a method as disclosed in JP-A-7-234918. The cell extraction can also be realized by the method described in JP-A-10-83431. Note that there is no problem even if the order of the processes in steps S202 and S203 is reversed. The extracted cell position information is stored in the RAM 103.
[0025]
In step S204, character recognition is performed on the character region extracted in the above process. As a character recognition method, a known method such as DP matching or a neural network is used, and a detailed description of this method is omitted because it is not in the scope of this embodiment. Further, as a result of character recognition, processing for replacing a recognized character with a character code is also included in the above-described known method, and thus description thereof is omitted. If text data (text file) as character code data in each character area is stored in advance in the external storage device 104 or the like, the above processing in this step is not necessary, and the inside of this text file is stored. Reading into the RAM 103 (load processing).
[0026]
The character code corresponding to each character area is linked to the character area data stored in the RAM 103. That is, it is specified in which character area each character code represents a character. Specifically, the position information of the recognized character area is attached to the character code.
[0027]
After the above character code is specified, in step S205, characters (tags) as keywords such as “address” and “telephone number” are input from the keyboard 106 or the pointing device 107, and the input keyword is used as the character code. Search by comparing. Here, “address”, “place”, “telephone number”, “Tel”, and the like representing the same meaning are regarded as the same, and a plurality of character codes are searched.
[0028]
In step S206, a cell in which information corresponding to the searched keyword located in the vicinity of the searched keyword is estimated and selected. The cell is generally specified with the upper left as the origin, the horizontal as X, and the vertical as Y. However, as described above, the positional relationship of each cell can be known by using the positional information of the cells stored in the RAM 103. In this case, the cell to be selected is the next column in the same row as the cell in which a keyword such as an address is described. For vertical writing, the next row in the same column is the cell to be selected. That is, the direction of the selected cell differs depending on the text information combination direction. As a result, for example, a cell in which an address 503 is described is selected for a cell in which an address tag 502 as a keyword is described.
[0029]
In step S207, the character code in the selected cell is specified by comparing the position information of this cell with the position information of the character code. That is, the character code in the selected cell is specified by the position information.
[0030]
As described above, specific information can be read without using a template from a form surrounded by ruled lines by the image processing apparatus and the image processing method according to the present embodiment. In addition, there is an effect that information having a plurality of expressions having the same meaning can be read correctly.
[0031]
Note that a file of book image data and various program codes in a storage device or the like at a remote location may be used using a communication unit via the network I / F 109. Further, regarding character recognition, there is no problem even if it includes a process for improving the recognition accuracy.
[0032]
Further, the program code according to the flowchart shown in FIG. 2 is stored in the external storage device 104 or the ROM 102.
[0033]
[Second Embodiment]
The configuration of the image processing apparatus in the present embodiment is the same as the configuration shown in FIG. 1, but the case where the book to be processed is in the format shown in FIG. 6 will be shown and described.
[0034]
In the book 601 shown in FIG. 6, keywords (tags) and values (book information) for the respective keywords are described in a format without ruled lines.
[0035]
An outline of the processing of the image processing apparatus in the present embodiment for the form 601 having the shape as shown in FIG. 6 will be described with reference to the flowchart of the processing shown in FIG.
[0036]
In step S301, the book 601 is read as image data and stored in the RAM 103, as in the process in step S201.
[0037]
In step S302, a character area is extracted from the image data stored in the RAM 103. As an example, when a character area is extracted from a form 601, in the same book 601 shown in FIG. 7, each character area (value part for each keyword part and each keyword) is as shown in FIG. Extracted. Similarly, the position information of each character area is also detected and stored in the RAM 103.
[0038]
In step S303, character recognition (or loading processing) is performed as in step S204.
[0039]
After the above character code is specified, in step S304, as in step S205, a keyword is input, and the input keyword is searched.
[0040]
In step S305, a character area in which corresponding information in the vicinity of the character area of the searched keyword is written is estimated and selected using the position information. In the case of vertical writing such as the book 601, the character area on the lower left side may be searched, and in the case of horizontal writing, it may be configured to search toward the lower right. As a result, for example, an address character area 702 is selected for an address tag character area 701 as a keyword.
[0041]
In step S306, the character code of the selected character area is set as the keyword value.
[0042]
As described above, according to the image processing apparatus and the image processing method of the present embodiment, there is an effect that specific information can be read without using a template even in a form without a ruled line.
[0043]
[Third Embodiment]
The configuration of the image processing apparatus in the present embodiment is the same as that shown in FIG. 1, but the case where the configuration of the book to be processed is in the format shown in FIG. 8 will be shown and described.
[0044]
In the book 801 shown in FIG. 8, a keyword (tag) and a value (book information) for each keyword are described as a set in the same cell.
[0045]
An outline of the processing of the image processing apparatus according to the present embodiment for the form 801 having the shape shown in FIG. 8 will be described with reference to the flowchart of the processing shown in FIG.
[0046]
Steps S401 to S405 are the same contents as steps S201 to S205.
[0047]
In step S406, if it is determined that the character area of the searched keyword does not exist in the cell, only the character area is processed, and the subsequent processing is the same as in the second embodiment. The process of S306 is executed.
[0048]
On the other hand, when the character area of the searched keyword exists in the cell, the process proceeds to step S407, and in the same cell as the searched keyword, a character area ( It is determined whether or not the other character area exists, and if it exists, the process proceeds to step S408, and the specific result of the character code of the other character area in this cell is set as the keyword value. For example, when an address is searched in FIG. 9, the character area 901 is taken as a keyword, and the character code of the character area 902 in the same cell 802 is the keyword value to be obtained.
[0049]
If the other character area does not exist in the same cell in step S407, one character area exists in one cell and the subsequent processing is the same as in the first embodiment. , S207 is executed.
[0050]
As described above, the image processing apparatus and the image processing method according to the present exemplary embodiment can identify a form in which a keyword and a keyword value are described in a ruled line without using a template. It is possible to read the information. Further, there is an effect that the character information corresponding to the keyword can be read for various forms of forms.
[0051]
[Other Embodiments]
Note that the above-described embodiment may be applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, and a printer), but an apparatus (for example, a copier, a facsimile machine) including a single device. Etc.).
[0052]
In addition, an object of the above-described embodiment is to supply a storage medium (or recording medium) that records a program code of software that realizes the functions of the above-described embodiment to a system or apparatus, and to perform a computer (or a computer of the system or apparatus) Needless to say, this can also be achieved by the CPU and MPU) reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the above-described embodiment. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an operating system (OS) running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.
[0053]
Furthermore, after the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion card or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.
[0054]
When the above-described embodiment is applied to the storage medium, the storage medium stores program code corresponding to the flowchart described above (shown in FIG. 2, and / or FIG. 3, and / or FIG. 4). Will be. Further, the above-mentioned storage medium may be a storage medium that stores information having a configuration as shown in FIG. 10, stores program codes according to the flowcharts shown in FIGS. Stores information related to the directory in which each program code is stored in the medium.
[0055]
【The invention's effect】
As described above, according to the present invention, there is an effect that it is possible to read specific information on a form without a template.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration of an image processing apparatus according to a first embodiment of the present invention.
FIG. 2 is a flowchart of processing executed by the image processing apparatus shown in FIG.
FIG. 3 is a flowchart of processing of an image processing apparatus for a book according to a second embodiment of the present invention.
FIG. 4 is a flowchart of processing of an image processing apparatus for a book according to a third embodiment of the present invention.
FIG. 5 is a diagram illustrating an example of a book to be processed by the image processing apparatus according to the first embodiment of the present invention.
FIG. 6 is a diagram illustrating an example of a book to be processed by the image processing apparatus according to the first embodiment of the present invention.
7 is a diagram for explaining extraction of each character area in the book shown in FIG. 6. FIG.
FIG. 8 is a diagram illustrating an example of a book to be processed by the image processing apparatus according to the third embodiment of the present invention.
9 is a diagram for explaining cell extraction and character area extraction in the book shown in FIG. 8; FIG.
FIG. 10 is a diagram illustrating a configuration of a storage medium that stores program codes executed by the image processing apparatus according to the first to third embodiments.

Claims (8)

The position information of the character string region included in image data Tsu read, memory means for storing the position information of the cell surrounded by the ruled lines, and a character code of the character string,
A specifying means for specifying a search target character string as a keyword,
Search means for searching for a character string corresponding to the keyword designated by the designation means from the storage means;
When there is a character string area different from the searched character string in the same cell as the cell containing the character string searched by the search means, the character code of the different character string is set as the keyword. As the value of
If there is no character string area different from the searched character string in the same cell as the cell containing the character string searched by the search means, the character string searched by the search means is included. An image processing apparatus comprising: specifying means for specifying a character code of a character string existing in a cell located in the vicinity of the cell as a value of the keyword . If the character string searched by the search means does not exist in the cell, the specifying means specifies the character code of the character string included in the vicinity area of the searched character string area as the value of the keyword. The image processing apparatus according to claim 1. The image data is image processing apparatus according to claim 1 or 2, characterized in that the image data of the book. The image processing apparatus according to any one of claims 1 to 3 , wherein the search unit searches a character string representing a similar meaning by equating. If the character string searched by the search means does not exist in the cell, the specifying means selects a neighborhood area of the searched character string area based on the direction of the character string, and the selected neighborhood The image processing apparatus according to claim 2 , wherein a character code of a character string included in the region is specified as a value of the keyword . The position information of the character string region included in image data Tsu read, and the position information of the cell surrounded by ruled lines, a storage step of storing, the character code of the character string in the memory,
A specification process for specifying a search target character string as a keyword,
A search step of searching the memory for a character string corresponding to the keyword specified in the specification step;
When a character string area different from the searched character string exists in the same cell as the cell containing the character string searched in the search step, the character code of the different character string is set as the keyword. As the value of
If there is no character string area other than the searched character string in the same cell as the cell containing the character string searched in the search step, the character string searched in the search step is included. And a specifying step of specifying a character code of a character string existing in a cell located in the vicinity of the cell as a value of the keyword . In the specifying step, when the character string searched in the searching step does not exist in the cell, the character code of the character string included in the vicinity region of the searched character string region is specified as the value of the keyword. The image processing method according to claim 6 . Storing a computer program for functioning as a respective means included in the image processing apparatus according to any one of claims 1 to 5 computers, computer-readable storage medium.

Images