JPH09204419A - Device and method for processing image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily judge whether any processing error is generated in area dividing processing or not by extracting a ruled line containing an original image having a format, discriminating whether the extracted result is correct or not based on format information and reporting the discriminated result. SOLUTION: The original image is read by a scanner 101 and transformed to binary image data and the ruled lines are extracted. For example, the ruled lines contained in the document of family register are extracted and from the positions, lengths and number or the Like of these ruled lines, the class of the family register document or items consisting of the family register document are identified. Further, the document of family register is Identified corresponding to the number of longitudinal ruled lines connected downward from the ruled lines. Next, ruled line extraction error discrimination processing is performed for discriminating the presence/absence of error in ruled line extraction processing based on the ruled lines. Concerning this discrimination, the presence/absence of error in ruled line extraction processing is discriminated by comparing the ruled lines provided by extraction processing with the ruled lines in the family register document. When there is any error, the presence of error is displayed on a display 108 and the correction of error is called to an operator.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and method for extracting ruled lines included in a document image having a predetermined format.

[0002]

2. Description of the Related Art In a conventional image processing apparatus, an original image having a plurality of ruled lines is divided into areas for each attribute included in the original image, and the area surrounded by the ruled lines is divided into attributes by an area dividing process. The area was extracted as one.

[0003]

However, in the above-mentioned conventional image processing apparatus, even if the region surrounded by the ruled lines can be extracted by the region dividing process, the operator needs to visually confirm whether or not there is a mistake in the region dividing process. was there. Further, if there is a mistake in the area division processing even if an area surrounded by a desired ruled line included in the original image is to be extracted as one of the items forming the original image, the item is mistakenly taken out. There was a problem.

The present invention has been made in view of the above problems, and it is possible to easily determine whether or not there is a processing error that occurs in the area division processing, and if there is a processing error, the processing error can be easily performed. It is an object of the present invention to provide an image processing apparatus and method that can be modified. Also,
By correcting the processing error that occurs in the ruled line extraction processing that extracts the ruled lines included in the original image, it is possible to always extract accurate ruled lines, and further, by performing the area division processing based on the extracted ruled lines, It is an object of the present invention to provide an image processing apparatus and a method thereof that reduce a processing error caused in the area division processing.

It is another object of the present invention to provide an image processing apparatus and method for improving the work efficiency of the operation in the area division processing.

[0006]

To achieve the above object, an image processing apparatus according to the present invention has the following configuration. That is, an image processing apparatus for extracting ruled lines included in a document image having a predetermined format, including storage means for storing format information regarding the predetermined format, and ruled lines included in the document image having the predetermined format. An extraction unit that extracts, a determination unit that determines whether the extraction result by the extraction unit is correct based on the format information, and a notification unit that notifies based on the determination result of the determination unit.

An image processing apparatus according to the present invention for achieving the above other object has the following configuration. That is, an image processing apparatus for extracting a ruled line included in a document image having a predetermined format, a storage unit for storing format information of a plurality of types of document images having a predetermined format, and the predetermined format. Extraction means for extracting a ruled line included in the document image, a discriminating means for discriminating the type of the document image having the predetermined format based on the feature of the ruled line extracted by the extracting means, and discriminating by the discriminating means. Based on the format information of the document image having a predetermined format corresponding to the type, the determination means to determine the correctness of the extraction result by the extraction means, based on the determination result of the determination means,
And an informing means for informing.

Further, preferably, when the result of the determination by the determination means is that the extraction result by the extraction means is positive, the original image having the predetermined format is divided into a plurality of areas based on the extraction result. A dividing means is further provided. Further, preferably, when the result of the determination by the determination unit indicates that the extraction result by the extraction unit is negative, the correction unit further corrects the extraction result. This is because the presence or absence of the extraction result can be corrected by providing the correction means.

Further, it is preferable that the apparatus further comprises instruction means for instructing whether or not to make a correction by the correction means. Further, preferably, the dividing unit divides the document image having the predetermined format into a plurality of regions based on the extraction result corrected by the correcting unit.

Further, preferably, the notifying means displays the judgment result by the judging means. Further, preferably, the notifying unit notifies the determination result by the determining unit using sound. In addition, preferably, when the result of the determination by the determination means indicates that the extraction result by the extraction means is negative, the area in which the extraction result may have failed is separated from the area in which the extraction result does not fail. A display means for displaying separately is further provided. This is because by displaying them separately, it is possible for the user to easily understand the ruled line that may have resulted in a failure in the extraction result.

Further, preferably, there is further provided a judging means for judging whether or not the division result by the dividing means is correct based on the format information. Further, preferably, when the result of the determination by the determining means indicates that the result of division by the dividing means is negative, there is further provided correction means for correcting the result of the division. This is because the presence or absence of the division result can be corrected by providing the correction means.

[0012] Further, preferably, it further comprises display means for displaying whether the result of the determination by the determination means is correct or not. By providing the display means, it is possible to inform the user of the correctness of the division result.
Further, preferably, when the result of the determination made by the determining means indicates that the result of the division by the dividing means is negative, there is further provided a notifying means for notifying that effect. This is because the provision of the notification means allows the user to be notified that the division result is negative.

An image processing method according to the present invention for achieving the above object has the following configuration. That is, an image processing method for extracting ruled lines included in a document image having a predetermined format, which includes a storage step of storing format information regarding the predetermined format in a storage medium, and a method of storing the format information in the document image having the predetermined format. An extraction step of extracting a ruled line to be performed, a determination step of determining whether the extraction result by the extraction step is correct based on the format information, and a notification step of notifying based on the determination result of the determination means.

An image processing method according to the present invention for achieving the above-mentioned other object has the following configuration. That is, it is an image processing method for extracting ruled lines included in a document image having a predetermined format, and a storage step of storing format information of a plurality of types of document images having a predetermined format in a storage medium; An extraction step of extracting a ruled line included in a document image having the format, an identification step of identifying the type of the document image having the predetermined format based on the feature of the ruled line extracted in the extraction step, and the identification Based on the format information of the original image having a predetermined format corresponding to the type identified in the step, a determination step of determining the correctness of the extraction result by the extraction step, and a notification based on the determination result of the determination step And a notification step.

Further, preferably, when the result of the determination in the determination step is that the extraction result in the extraction step is positive, the original image having the predetermined format is divided into a plurality of areas based on the extraction result. The method further includes a dividing step. Further, preferably, if the result of the determination in the determination step is that the extraction result of the extraction step is negative, a correction step of correcting the extraction result is further provided.

[0016] Preferably, the method further comprises an instructing step for instructing whether or not to make the correction by the correcting step. Further, preferably, the dividing step divides the original image having the predetermined format into a plurality of areas based on the extraction result corrected by the correcting step.

Further, preferably, the notification step displays the judgment result of the judgment step. Further, preferably, in the informing step, the determination result of the determining step is informed by sound. Also, preferably, when the result of the determination in the determination step is negative in the extraction result in the extraction step, the area in which the extraction result may be negative is separated from the area in which the extraction result is not negative. A display step of separately displaying is further provided.

Further, preferably, the method further comprises a determination step of determining whether the division result by the division step is correct based on the format information. Further, preferably, if the result of the determination in the determination step is that the division result by the division step is negative, a correction step of correcting the division result is further provided.

[0019] Preferably, the method further comprises a display step of displaying the result of the determination in the determination step, whether the division result of the division step is correct or not. Further, preferably, when the result of the determination in the determination step indicates that the result of the division by the division step is negative, there is further provided a notification step of notifying the fact.

A computer readable memory according to the present invention for achieving the above object has the following configuration. That is,
A computer-readable memory storing a program code for image processing, which extracts a code of a storage step of storing format information regarding the predetermined format in a storage medium and a ruled line included in a document image having the predetermined format. The code of the extraction step, the code of the determination step of determining the correctness of the extraction result by the extraction step based on the format information, and the code of the notification step of notifying based on the determination result of the determination means.

According to another aspect of the present invention, there is provided a computer readable memory having the following configuration. That is, it is a computer-readable memory storing a program code for image processing, and stores a code of a storage process for storing format information on each of document images having a plurality of types of predetermined formats in a storage medium, and the predetermined format. A code of an extraction step for extracting a ruled line included in the document image, and a code of an identification step for identifying the type of the document image having the predetermined format based on the feature of the ruled line extracted in the extraction step; Based on the format information of the document image having a predetermined format corresponding to the type identified in the identification step, the code of the determination step of determining the correctness of the extraction result by the extraction step, and the determination result of the determination step , And a code of a notification process for notification.

[0022]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a block diagram showing the functional arrangement of the image processing apparatus according to this embodiment. In FIG. 1, 101 is a scanner, which irradiates a document image with light and reads the reflected light to convert it into an electric signal. Further, the original image read by the scanner 101 is stored in the VRAM area of the RAM 107 as image data. A scanner interface 102 converts an electric signal obtained by the scanner 101 into a binary digital electric signal and transmits the binary digital electric signal to other device constituent elements. Reference numeral 103 denotes a mouse that functions as a pointing device. By moving the mouse 103, the cursor 100 displayed on the display 108 is moved. The contents can be executed by positioning the cursor 100 on a menu displayed on the screen and performing a drag operation or a click operation using a button (not shown) attached on the menu. A mouse interface 104 receives a signal from the mouse 103 and transmits it to another device component. Reference numeral 114 denotes a KB (keyboard), which inputs data and executes instructions via the keyboard. 11
Reference numeral 3 is a KB interface, which receives a signal from the KB 114 and transmits it to another device component.

Reference numeral 105 denotes a CPU, which executes control of the entire apparatus and processing such as area division described later and recognition processing described in the present invention. 106 is a ROM, and the CPU 105
It stores various data such as a control program executed by the computer, various processing programs, and font data. 107 is R
AM, which is used as a work area or the like for developing a document image and area division processing. Further, it has a VRAM area as a predetermined storage area for storing image data (binary image data) read by the scanner 101. 10
A display 8 displays the image data stored in the VRAM area of the RAM 107, the ruled line extraction processing result executed in this embodiment, and the like. 109 is a display interface.

Reference numeral 110 denotes an FDD (floppy disk drive), which is capable of reading and writing data by mounting the FD. Further, it is possible to execute a process by writing a program of a processing flow described later in the attached FD (not shown) and reading the program into the RAM 107 of the present apparatus. 111 is an FDD interface. Further, 112 is a bus for connecting the respective components of the apparatus.

Next, the processing executed in this embodiment will be described with reference to the flowchart of FIG. FIG. 2 is a flowchart showing a processing flow of processing executed in this embodiment. It should be noted that the processing executed in the present embodiment is such that a region surrounded by ruled lines forming the document image (hereinafter, this region is referred to as an item) is determined in advance, for example, a family register as shown in FIG. A case where the invention is applied to a document or the like will be described, but the invention is not limited to this. For example, any original image may be used as long as it has a predetermined configuration.

First, in step S201, the original image is read by the scanner 101 and converted into binary image data. In step S202, for the obtained binary image data,
Ruled line extraction processing for extracting the ruled lines included in the binary image data is performed. Then, information such as the coordinate data of the extracted ruled lines is stored as block data as shown in FIG. here,
The block data shown in FIG. 3 will be described.

FIG. 3 is a diagram showing the structure of block data according to the present embodiment. FIG. 3 shows start point coordinates (X1, Y1), end point coordinates (X2, Y2) for indicating the position of an item included in the binary image data expanded in the RAM 107, valid flag, item identification ID, recognition order, and attribute. , Stores information on the set direction. The start point coordinates indicate the position coordinates of the right end of each ruled line as shown in FIG. 6, and the end point coordinates indicate the position coordinates of the left end of each ruled line. The valid flag indicates whether or not the extracted ruled line is valid. The item identification ID is not used here. The recognition order is also not used here. The attribute stores an attribute which is a division unit in the area division processing. In the case of the present invention, the attribute indicating the ruled line is stored. The set direction is also not used here.

For example, for the family register document shown in FIG.
When the ruled line extraction processing in step S202 described above is performed, first, the ruled lines included in the family register document are extracted, and the type of the family register document and the items that make up the family register document are identified from the position, length, number of the ruled lines, and the like. . As shown in FIG. 7, if the ruled line 701, the ruled line 702, and the ruled line 703 are present as the processing result of the ruled line extraction processing, the type of the configuration of the item of the family register document (hereinafter referred to as “page type”) is , The page type in which the first person is described (hereinafter referred to as “first person type”). If there is no ruled line 701 or ruled line 702 and the X1 coordinate of the ruled line 703 is the same as the ruled line 704 at the upper end or the ruled line 705 at the lower end, the page type in which the first person is not described (hereinafter referred to as “non-first person type”) Is called).

Further, the family register document is identified by the number of vertical ruled lines extending from the ruled line 703. For example, in the case of the family register document shown in FIG. 7, both the adopted father and the adopted mother are identified as the described type. Next, S
At 203, based on the ruled line obtained by the ruled line extraction process of step S202, a ruled line extraction error determination process for determining whether or not there is a mistake in the ruled line extraction process is performed. The determination of this mistake is made by comparing the ruled line obtained by the ruled line extraction processing in step S202 described above with the ruled line of the family register document (see FIG. 6) whose ruled line configuration has been determined in advance to determine whether or not there is a ruled line extraction processing error. To judge. It is assumed that the family register document in which the ruled line configuration is predetermined is stored in the RAM 106.

It is judged that there is a mistake in the ruled line extraction processing, for example, as shown in FIG.
The ruled lines of the original image read in 1 are faint and the ruled lines 80
When it is not possible to extract the ruled line like 1 or when the extracted ruled line like the ruled line 803 is shortened, it is determined that there is an error in the ruled line extraction processing. This is because if the processing is continued as it is, a processing error in the block extraction processing (step S207) described later will occur, and the type and item of the family register document cannot be identified.

In step S204, ruled line extraction error determination result display processing for displaying the processing result of the ruled line extraction error determination processing on the display 108 is performed. In step S205, it is determined from the processing result of the ruled line extraction error determination result display processing whether or not there is an error in the ruled line extraction processing. If there is no mistake in the ruled line extraction processing, the fact that the processing has ended normally is displayed on the display 108, and the process proceeds to step S207. On the other hand, if there is a mistake in the ruled line extraction processing, the fact that there is a mistake in the ruled line extraction processing is displayed on the display 108, the operator is prompted to correct the mistake in the ruled line extraction processing, and the process proceeds to step S206. .

In step S206, after the fact that there is a mistake in the ruled line extraction processing is displayed by the ruled line extraction error determination result display processing, the current ruled line extraction state of the ruled line is displayed on the original document image. And the operator expands the correction target,
Ruled line correction processing is performed to correct the processing result of the ruled line extraction processing by image processing such as reduction, movement, deletion, or creation of a new block.

The corrected result is displayed by the operator using the mouse 10
By instructing by pressing the correction end button in 3
After the block data corresponding to the corrected item is updated, the process proceeds to step S207. For example, in the ruled line extraction error determination result display process, when a message indicating that there is a mistake in the ruled line extraction process is displayed on the display 108, the process result (FIG. 8) is displayed on the original document image (family register document in FIG. 6). To be done.

When the current processing result (FIG. 8) is displayed on the original document image image, the operator selects a new ruled line 901 (FIG. 8) from the unextracted ruled line 801 (FIG. 8). create. Similarly, the ruled line 803 (FIG. 8) is corrected (not shown). Then, when the operator designates the modification end button 902 with the mouse 103, the content of the block of the modified item is updated to the corresponding block data.

In step S207, block extraction processing is performed to extract the area (item) surrounded by the ruled lines included in the original image. Then, information such as coordinate data of the extracted items is stored as block data as shown in FIG. In this case, the start point coordinates (X1, Y1) and the end point coordinates (X2, Y
2), the valid flag, the item identification ID, the recognition order, the attribute, and the information on the set direction are stored. The start point coordinates indicate the position coordinates of the upper right corner of each item as shown in FIG. 11, and the end point coordinates indicate the position coordinates of the lower left corner of each item. The valid flag indicates whether or not the extracted item is valid. The item identification ID stores the item identification ID of each item according to the setting method described later. The recognition order stores the recognition order when recognizing the characters entered in each item. The attribute stores an attribute which is a division unit in the area division processing. In the case of the present invention, attributes indicating items (areas surrounded by ruled lines) are stored. The set direction stores information indicating the direction of characters written in each item (vertical writing or horizontal writing).

Next, in step S208, the item configuration of the document image is classified from the format information indicating the configuration of the item of the document image, and the item identification process for identifying the item configuring the document image is performed. When identifying the configuration of the item of the document image, the type of configuration of the item of the document image is classified according to the position, shape, area, number, etc. of blocks obtained by dividing the document image into regions, and each item is classified. Identify. Further, it is assumed that the format information is stored in the ROM 106 in advance.

Further, in order to classify and identify the items of the family register document used as the manuscript image of the present embodiment, IDs (item identification IDs) for classifying and identifying the respective items are shown in FIGS. Define as in c). And I of each item
The items of the family register document are classified and identified by combining D. Here, I shown in (a) to (c) of FIG.
The D (item identification ID) will be described.

FIG. 4A shows an ID that defines the type of page type of the family register document, which is written in the block area (see FIG. 6) surrounded by the ruled line at the top right of the family register document. “First person” or “non-first person” is defined as the type. 4B is an ID that defines the type of the person who describes the page of the family register document, and the type ID as shown in FIG. 4B is defined. (C) of FIG.
This is an ID that defines the item name of an item that constitutes the family register document, and the type ID as shown in FIG. 4C is defined.

Details of the item identification processing executed in step S208 will be described below with reference to FIG. FIG. 10 is a flowchart showing a detailed processing flow of the item identification processing of this embodiment. First, in step S1001,
Classify and identify the page type of family register documents. As a method of this identification, the page type of the family register document is identified by the shape of the block (item) at the upper right of the family register document.

As a method of identification, for example, when the width of the upper right block of the family register document is longer than its height, it is identified as "first person type", and otherwise it is identified as "non-first person type". To identify the page type. Alternatively, if the width of the upper right block is larger than the width of a block having the same Y1 coordinate as that of the block, the block is identified as "first-type", while the width of the upper right block is the block. Same as Y1 coordinate of
If the blocks having one coordinate have the same width, they can be identified as "non-first person type".

Returning to the explanation of the flow chart again. In step S1001, if the width of the upper right block of the family register document is longer than its height, the block is identified as "first person type", and the process proceeds to step S1004. On the other hand, if the width of the upper right block of the family register document is shorter than its height, the block is identified as "non-leader type", and step S1002.
Proceed to.

Once the page type of the family register document has been identified, a block (hereinafter referred to as a KEY block) that is a key for further detailed family register document identification and item identification is configured in the family register document. The relative position of each item is detected. First, in the case where the page type is the "first-person type", in step S1004, the block titled "Main registry", the block in the first row of the column in which the edited date is described, and the registration data The block in the first row of the column in which "etc." and the block with the title "Father" are detected as KEY0 to 3 blocks, and the address of each block data is as shown in FIG. Remember in the body.

Now, the KEY block data structure shown in FIG. 5 will be described. FIG. 5 is a diagram showing the configuration of the KEY block data structure of the present embodiment. In FIG. 5, the KEY block structure stores the information of the items that are the key for identifying the items constituting the family register document, and there are six KEY0 to 5 blocks as shown in the figure.
Then, the KEY to be detected according to the type of page type
A block is detected and the block data of the detected KEY block is stored.

Next, in step S1005, the detected K
Using the EY0 to 3 blocks, items are extracted in more detail for each item having information common to each of the KEY0 to 3 blocks, and the item identification ID is set for the extracted items. Details of this setting will be described later with reference to the flowchart of FIG. On the other hand, when the page type is the “non-first person type”, in step S1002, the block in the first row of the column in which the enrollment data of the first person is described and the block titled “Father” of the first person The block in the first row of the column where the second person's enrollment data etc. is written and the block with the title "Father" of the second person are detected as KEY2-5 blocks, respectively.
The block data of the detected KEY2 to 5 blocks is stored in the KEY block structure.

Next, in step S1003, the detected K
Using the EY2 to 5 blocks, the item is extracted in more detail for each item having the information common to each of the KEY2 to 5 blocks, and the item identification ID is set for the extracted item. Details of this setting will be described later with reference to the flowchart of FIG. First, the page type is "first-person type"
11 shows the process of setting the item identification ID in the case of
This will be described with reference to the flowchart of.

FIG. 11 is a flow chart showing the processing flow of the processing for setting the item identification ID when the page type of this embodiment is the "first person type". First, in step S1101, the KEY0 block (“main registry” in FIG. 6)
For each of the three blocks with the same width under the block labeled
Set D. In step S1102, four blocks to the left including the KEY1 block from the KEY1 block (the block in the first row of the column in which the knitting items are described in FIG. 6) and the blocks below the same block have the same item group (editing). Since the blocks can be regarded as items), item identification IDs are set in these blocks.

In step S1103, 10 blocks including the KEY2 block from the KEY2 block (the block in the first row of the column in which the registration data and the like in FIG. 6 are written) have the same item group (enrollment data, etc.). Column), the item identification I
Set D. In step S1104, the block below the item group including the KEY2 block has the same Y1 coordinate as the KEY3 block on the left including the KEY3 block from the KEY3 block (the block titled “father” in FIG. 6). There are blocks, and the number of blocks is counted. Then, in step S1105,
Based on the counted number of blocks, the item identification ID of the block under the item group including the KEY2 block is set. Details of this setting will be described later with reference to the flowchart of FIG.

Next, the page type is "non-first person type"
12 shows the process of setting the item identification ID in the case of
This will be described with reference to the flowchart of. FIG. 12 is a flowchart showing the processing flow of the processing for setting the item identification ID when the page type of the present embodiment is the “non-first person type”. First, in step S1201, nine blocks to the left including the KEY2 block from the KEY2 block (the block in the first row of the column in which the enrollment data etc. are written) have the same item group (entry data etc. column). Since these blocks can be regarded, item identification IDs are added to these blocks.
Set.

In step S1202, the nine blocks to the left of the KEY4 block (the block in the first row of the column in which the registration data of the second person is recorded) including the KEY4 block have the same item group (the second one). (Registration data column)
Since these blocks can be regarded as, the item identification IDs are set in these blocks. In step S1203, KEY
The block below the item group including 2 blocks is KEY.
There is a block having the same Y1 coordinate as the KEY3 block on the left from the 3 blocks (the block with the title "Father"), and the number of blocks is counted. Then, in step S1204,
Based on the counted number of blocks, the item identification ID of the block under the item group including the KEY2 block is set.

In step S1205, the block below the item group including the KEY4 block is the same as the KEY5 block on the left including the KEY5 block from the KEY5 block (the block with the title "father" of the second person) Y1. There is a block with coordinates, and the number of blocks is counted. Then, in step S1206,
Based on the counted number of blocks, the item identification ID of the block below the item group including the KEY4 block is set.

Next, the details of the process of setting the item identification ID of the block below the entry data column will be described with reference to FIG.
This will be described with reference to the flowchart of FIG. FIG. 13 is a flowchart showing a processing flow of processing for setting an item identification ID of a block below the entry data etc. column of the present embodiment. Note that the flowchart of FIG. 13 is the processing executed in step S1104 of the flowchart of FIG. 11, step S1204 of the flowchart of FIG. 12, and step S1205, but here, step S1104 of the flowchart of FIG. The case where the document is a family register document of "first person type" will be described as an example. In addition, step S12 of the flowchart of FIG.
04, step S1205, that is, when the page type is a "non-first person type" family register document,
Since it is realized by the same process, it is omitted here.

First, in step S1301, the number of blocks counted is determined. If the number of blocks is 4, it is determined that the type is the type in which only real parents are described (hereinafter referred to as "real child type"). It proceeds to step S1302. Also,
When the number of blocks is 5, it is determined that the type is one in which only one of the adoptive father and the adoptive mother is described (hereinafter referred to as “adoptive type A”), and the process proceeds to step S1305.
Further, when the number of blocks is 6, it is determined that both the adopted father and adopted mother are described (hereinafter referred to as “adopted type B”), and the process proceeds to step S1309.

If the counted number of blocks is 4, that is, if it is the "real child type", step S1302.
Then, it is determined whether or not the shape of the second block to the left of the KEY3 block is horizontally long. If it is horizontally long (YES in step S1302), "married (husband or wife) type"
Then, the process proceeds to step S1303. On the other hand, if it is not horizontally long (NO in step S1302), it is determined to be “unmarried type” and the process proceeds to step S1304.

In step S1303, "real child type"
Also, as the “married (husband or wife) type”, the item identification ID is set from the relative positional relationship with the KEY3 block. In step S1304, the item identification IDs are set as the “real child type” and the “unmarried type” based on the relative positional relationship with the KEY3 block. When the counted number of blocks is 5, that is, when the type is “adoptive type A”, in step S1305, it is determined whether or not the shape of the third block to the left of the KEY3 block is horizontally long. If it is horizontally long (YES in step S1305), it is determined to be “married (husband or wife) type” and the process proceeds to step S1306. On the other hand, if it is not horizontally long (N in step S1305)
O), the unmarried type is determined, and step S1307
Proceed to.

In step S1306, "real child type"
Also, as the “married (husband or wife) type”, the item identification ID is set from the relative positional relationship with the KEY3 block. In step S1307, the item identification IDs are set as the “real child type” and the “unmarried type” based on the relative positional relationship with the KEY3 block. When the number of counted blocks is 6, that is, when the block is “adoptive type B”, in step S1309, it is determined whether the shape of the fourth block to the left of the KEY3 block is horizontally long. If it is horizontally long (YES in step S1309), it is determined to be “married (husband or wife) type” and the process proceeds to step S910.
On the other hand, if it is not horizontally long (NO in step S1309),
The type is determined to be "unmarried" and the process proceeds to step S1311.

In step S1310, "real child type"
Also, as the “married (husband or wife) type”, the item identification ID is set from the relative positional relationship with the KEY3 block. In step S1311, the item identification IDs are set as the “real child type” and the “unmarried type” based on the relative positional relationship with the KEY3 block. As described above, according to the present embodiment, the presence or absence of a processing error in the ruled line extraction processing can be determined by identifying the configuration of the ruled lines included in the family register document. Further, even if there is a processing error in the ruled line extraction processing, the processing error can be corrected.

Further, since the area dividing process is performed based on the extracted ruled line or the corrected ruled line, the region dividing process can be performed accurately. Further, the ruled line extraction process, the ruled line extraction error determination process, the ruled line extraction error determination result display process, the block extraction process, and the item identification process described above are provided so that the error in the ruled line extraction process can be corrected. By doing so, it is possible to easily determine whether or not there is a mistake, improve operability, and reduce the time required for the entire processing.

As described above, the block extraction result classified by each item can be obtained. If it is determined that there is a ruled line extraction error in the ruled line extraction error determination process, the ruled line extraction error determination result display process determines a ruled line that may be incorrect on the original document image as another ruled line. The colors and shapes of the ruled lines can be changed and displayed for easy distinction.

Further, from the processing result of the item identification processing in step S208, it is further determined whether or not there is a mistake in the block extraction processing in step S207, and the operator further corrects the mistake in the block extraction processing. It can be configured. For example, it is easily realized by the flowchart as shown in FIG. 14 in which the above-described configuration is added after the item identification processing in step S208 of the flowchart in FIG.

FIG. 14 is a flow chart showing a processing flow of processing executed by another configuration of the present embodiment. First, in step S1401, the original image is read by the scanner 101 and converted into binary image data. In step S1402, a ruled line extraction process for extracting a ruled line included in the binary image data is performed on the obtained binary image data. Then, information such as the coordinate data of the extracted ruled lines is stored as block data as shown in FIG.

Next, in S1403, the above-mentioned step S1 is executed.
Based on the ruled line obtained by the ruled line extraction processing of 402, ruled line extraction error determination processing for determining whether there is a mistake in the ruled line extraction processing is performed. In step S1404, ruled line extraction error determination result display processing for displaying the processing result of the ruled line extraction error determination processing on the display 108 is performed. Step S140
In step 5, from the processing result of the ruled line extraction error determination result display processing,
It is determined whether or not there is an error in the ruled line extraction processing. If there is no mistake in the ruled line extraction processing, the fact that the processing has ended normally is displayed on the display 108, and the flow advances to step S1407. On the other hand, if there is a mistake in the area division processing, the fact that the area division processing has an error is displayed on the display 108, the operator is prompted to correct the mistake in the area division processing, and the process proceeds to step S1406.

In step S1406, after the area division determination result display processing indicates that there is an area division processing error, the area division state of the current block is displayed on the original document image. Then, the operator performs ruled line correction and correction processing for correcting the processing result of the ruled line extraction processing by image processing such as enlarging, reducing, moving, and deleting the correction target, or creating a new block.

The corrected result is displayed by the operator using the mouse 10
By instructing by pressing the correction end button in 3
After the block data corresponding to the corrected item is updated, the process proceeds to step S1407. Step S1407
Then, a block extraction process for extracting an area (item) surrounded by ruled lines included in the original image is performed. Then, information such as coordinate data of the extracted items is stored as block data as shown in FIG.

Next, in step S1408, the item configuration of the document image is classified from the format information indicating the configuration of the item of the document image, and the item identification process for identifying the item configuring the document image is performed. The item identification process is shown in FIG.
Since it is the same as step S208 of, the details thereof will be omitted. In step S1409, step S1407 described above.
Based on the items obtained by the block extraction process of
Block extraction error determination processing is performed to determine whether or not there is a block extraction processing error.

The case where it is determined that there is a mistake in the block extraction processing is in the case described below. For example, when a ruled line 1501 as shown in FIG. 15 is erroneously detected by the ruled line extraction process due to overlapping of characters and ruled lines included in the original image, noise, or the like, the ruled line extraction process is originally separated and extracted by the block extraction process. Blocks that should not be used are separated and extracted like block B1505 and block B1503. In this case, it is assumed that, due to the presence of the ruled lines 1504 and the like, this document image is determined to be the “leader type” in the ruled line extraction processing, and that there is no error in the ruled line extraction error determination processing. Then, in the block extraction processing, the width of the block B1502 is longer than the height, so it is determined to be the "first person type", but the block B150 below it is determined.
Since the width of 5 is longer than the height, there is a contradiction in distinguishing it from the "leader type". As a result, in this case, it is determined as an error in the block extraction processing.

In step S1410, block extraction error determination result display processing for displaying the processing result of the block extraction error determination processing on the display 108 is performed. Step S1
At 411, it is determined from the processing result of the block extraction error determination result display processing whether or not there is an error in the block extraction processing. If there is no mistake in the block extraction processing, the fact that the processing has ended normally is displayed on the display 108. On the other hand, if there is a mistake in the block extraction process, the fact that there is a mistake in the block extraction process is displayed on the display 108, and the operator is prompted to correct the mistake in the block extraction process.
Proceed to 2.

In step S1412, after the block extraction error determination result display process indicates that there is a block extraction error, the block extraction state of the current item is displayed on the original document image. Then, the operator performs block correction processing for correcting the processing result of the block extraction processing by image processing such as enlarging, reducing, moving, deleting the correction target, or creating a new block.

The corrected result is obtained by the operator using the mouse 10
By instructing by pressing the correction end button in 3
After the block data corresponding to the corrected item is updated, the item identification process is executed again in step S1408. For example, in the block extraction error determination result display process, when a message indicating that there is an error in the block extraction process is displayed on the display 108, the process result (FIG. 15) is displayed on the original document image (family register document of FIG. 6). To be done.

The current processing result (see FIG.
When 5) is displayed, the operator deletes the block B1505 that is erroneously extracted from the list, and modifies the block B1503 by transforming it into a block 1602 as shown in FIG. And the operator is mouse 1
When the correction end button 1603 is designated by 03, the contents of the block of the corrected item are updated to the corresponding block data, and the item identification process is executed again.

Then, block extraction determination processing is performed based on the result of the item identification processing. In this case, since the mistake in the block extraction processing has been corrected, after the fact is displayed on the display 108 by the block extraction determination result display processing, the processing ends normally. In addition, when a ruled line extraction error determination process determines a ruled line extraction process error, the ruled line correction process corrects the ruled line, or the block extraction process is performed without correcting the ruled line extraction process. By adopting a configuration in which any one of the correction processes for correcting the block including the processing error can be selected, the correction process that requires a shorter processing time can be selected. As a result, the entire process can be executed more efficiently.

For example, after the step S1405 of the flowchart of FIG. 14, it is easily realized by the flowchart shown in FIG. 17 in which the above-mentioned configuration is added. FIG. 17 is a flow chart showing a processing flow of processing executed by another configuration of the present embodiment. First, in step S1701, the original image is scanned by the scanner 101.
Read and convert to binary image data. Step S17
In 02, a ruled line extraction process for extracting a ruled line included in the binary image data is performed on the obtained binary image data. Then, information such as the coordinate data of the extracted ruled lines is stored as block data as shown in FIG.

Next, in S1703, the above-mentioned step S1 is executed.
Based on the ruled line obtained by the ruled line extraction process 702, a ruled line extraction error determination process for determining whether there is a mistake in the ruled line extraction process is performed. In step S1704, ruled line extraction error determination result display processing for displaying the processing result of the ruled line extraction error determination processing on the display 108 is performed. Step S170
In step 5, from the processing result of the ruled line extraction error determination result display processing,
It is determined whether or not there is an error in the ruled line extraction processing. If there is no mistake in the ruled line extraction processing, the fact that the processing has ended normally is displayed on the display 108, and the flow advances to step S1709. On the other hand, if there is a mistake in the area division processing, the fact that there is a mistake in the area division processing is displayed on the display 108, and step S17
Proceed to 07.

In step S1707, a correction selection process is performed which prompts the operator to correct the mistake in the area division process. When making a correction, the process advances to step S1708.
On the other hand, if the process is to be continued without correction, step S1
Proceed to 709. In step S1708, after the area division determination result display processing indicates that there is an area division error, the area division state of the current block is displayed on the original document image. Then, the operator performs ruled line correction and correction processing for correcting the processing result of the ruled line extraction processing by image processing such as enlarging, reducing, moving, and deleting the correction target, or creating a new block.

The corrected result is displayed by the operator using the mouse 10
By instructing by pressing the correction end button in 3
After the block data corresponding to the corrected item is updated, the process proceeds to step S1709. Step S1709
Then, a block extraction process for extracting an area (item) surrounded by ruled lines included in the original image is performed. Then, information such as coordinate data of the extracted items is stored as block data as shown in FIG.

Next, in step S1711, the item configuration of the document image is classified from the format information indicating the configuration of the item of the document image, and the item identification process for identifying the item configuring the document image is performed. The item identification process is shown in FIG.
Since it is the same as step S208 of, the details thereof will be omitted. In step S1712, the above step S1709.
Based on the items obtained by the block extraction process of
Block extraction error determination processing is performed to determine whether or not there is a block extraction processing error.

In step S1713, a block extraction error determination result display process for displaying the processing result of the block extraction error determination process on the display 108 is performed. Step S1
At 714, it is determined from the processing result of the block extraction error determination result display processing whether or not there is an error in the block extraction processing. If there is no mistake in the block extraction processing, the fact that the processing has ended normally is displayed on the display 108. On the other hand, if there is a mistake in the block extraction process, the fact that there is a mistake in the block extraction process is displayed on the display 108, and the operator is prompted to correct the mistake in the block extraction process.
Go to 0.

In step S1710, after the block extraction error determination result display process indicates that there is a block extraction error, the block extraction state of the current item is displayed on the original document image. Then, the operator performs block correction processing for correcting the processing result of the block extraction processing by image processing such as enlarging, reducing, moving, deleting the correction target, or creating a new block.

The corrected result is obtained by the operator using the mouse 10
By instructing by pressing the correction end button in 3
After the block data corresponding to the corrected item is updated, the item identification process is executed again in step S1711. Then, the block extraction determination process is performed based on the result of the item identification process. In this case, since the mistake in the block extraction processing has been corrected, after the fact is displayed on the display 108 by the block extraction determination result display processing, the processing ends normally.

Even when the present invention is applied to a system composed of a plurality of devices (eg, host computer, interface device, reader, printer, etc.), a device composed of one device (eg, copying machine, facsimile device). etc)
May be applied. Further, an object of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and a computer (or CPU or MPU) of the system or apparatus to store the storage medium. Needless to say, this can also be achieved by reading and executing the program code stored in the program.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk,
A CD-ROM, a CD-R, a magnetic tape, a non-volatile memory card, a ROM or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written in the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that a case where the CPU or the like included in the function expansion board or the function expansion unit performs some or all of the actual processing and the processing realizes the functions of the above-described embodiments is also included.

When the present invention is applied to the above-mentioned storage medium, the storage medium stores the program code corresponding to the above-mentioned flowchart. Briefly, the memory shown in FIG. 18 or FIG. Each module shown in the map example will be stored in the storage medium. That is, in FIG. 18, at least a “storage module”,
The program code of each of the “extraction module”, the “determination module”, and the “notification module” may be stored in the storage medium.

The "storage module" stores format information regarding a predetermined format. The “extraction module” extracts ruled lines included in a document image having a predetermined format. The "judgment module" judges whether the extraction result is correct based on the format information.
The "notification module" notifies based on the determination result.

Further, in FIG. 19, at least "storage module", "extraction module", "identification module",
The program code of each of the “determination module” and the “notification module” may be stored in the storage medium. The "storage module" stores each format information regarding a document image having a plurality of types of predetermined formats. The “extraction module” extracts ruled lines included in a document image having a predetermined format. The "identification module" identifies the type of document image having a predetermined format based on the characteristics of the extracted ruled lines. The “judgment module” judges whether the extraction result is correct or not based on the format information of the document image having a predetermined format corresponding to the identified type.
The "notification module" notifies based on the determination result.

[0086]

As is apparent from the above description, according to the present invention, it is possible to easily determine whether or not there is a processing error that occurs in the area division processing, and if there is a processing error, the processing error. It is possible to provide an image processing apparatus and method capable of easily modifying the image processing apparatus. In addition, by correcting the processing error that occurs in the ruled line extraction processing that extracts the ruled lines included in the original image, it is possible to always extract accurate ruled lines.
An object of the present invention is to provide an image processing apparatus and a method thereof that reduce a processing error caused by the area division processing by performing the area division processing based on the extracted ruled lines.

Further, it is possible to provide an image processing apparatus and method for improving the work efficiency of the operation in the area division processing.

[Brief description of drawings]

FIG. 1 is a block diagram showing a functional configuration of an image processing apparatus according to this embodiment.

FIG. 2 is a flowchart showing a processing flow of processing executed in this embodiment.

FIG. 3 is a diagram showing a configuration of block data according to the present embodiment.

FIG. 4 shows a structure of an item identification ID according to the present embodiment.

FIG. 5 is a diagram showing a configuration of a KEY block data structure according to the present embodiment.

FIG. 6 is a diagram showing an example of a document image according to the present embodiment.

FIG. 7 is a diagram showing a processing result of ruled line extraction processing executed on a document image according to the present embodiment.

FIG. 8 is a diagram showing a processing result when there is an error in the ruled line extraction processing executed for the document image of the present embodiment.

FIG. 9 is a diagram showing a process of correcting a process result when there is an error in the ruled line extraction process executed on the document image of the present embodiment.

FIG. 10 is a flowchart showing a detailed processing flow of item identification processing according to the present embodiment.

FIG. 11 is a flowchart showing a processing flow of processing for setting an item identification ID when the page type of the present embodiment is “first person type”.

FIG. 12 is a flowchart showing a processing flow of processing for setting an item identification ID when the page type of the present embodiment is “non-first person type”.

FIG. 13 is a flowchart showing a processing flow of processing of setting an item identification ID in a block below a field of enrollment data and the like according to the present embodiment.

FIG. 14 is a flowchart showing a processing flow of processing executed by another configuration of the present embodiment.

FIG. 15 is a diagram showing a processing result when there is an error in the block extraction processing executed for the document image of the present embodiment.

FIG. 16 is a diagram showing processing for correcting the processing result when there is an error in the block extraction processing executed for the original image according to the present embodiment.

FIG. 17 is a flowchart showing a processing flow of processing executed by another configuration of the present embodiment.

FIG. 18 is a diagram showing a structure of a memory map of an FD in which a program of a processing flow executed in the present invention is stored.

FIG. 19 is a diagram showing a structure of a memory map of an FD in which a program of a processing flow executed in the present invention is stored.

[Explanation of symbols]

 101 Scanner 102 Scanner Interface 103 Mouse 104 Mouse Interface 105 CPU 106 ROM 107 RAM 108 Display 109 Display Interface 110 FDD 111 FDD Interface 112 Bus 113 KB Interface 114 KB

Claims (28)

[Claims] 1. An image processing apparatus for extracting ruled lines included in a document image having a predetermined format, comprising: storage means for storing format information relating to the predetermined format, and a storage unit included in the document image having the predetermined format. Extraction means for extracting a ruled line to be extracted, determination means for determining whether the extraction result by the extraction means is correct based on the format information, and notification means for notifying based on the determination result of the determination means. A characteristic image processing device. 2. An image processing apparatus for extracting ruled lines included in a document image having a predetermined format, comprising: storage means for storing respective format information relating to a plurality of types of document images having a predetermined format; Extracting means for extracting a ruled line included in a document image having the format, identifying means for identifying the type of the document image having the predetermined format based on the feature of the ruled line extracted by the extracting means, and the identifying Determination means for determining whether the extraction result by the extraction means is correct based on the format information of the document image having a predetermined format corresponding to the type identified by the determination means, and to notify based on the determination result of the determination means An image processing apparatus comprising: a notification unit. 3. If the result of the determination by the determining means is that the extraction result by the extracting means is positive, a dividing means for dividing the original image having the predetermined format into a plurality of areas based on the extraction result is provided. The image processing device according to claim 1, further comprising: 4. If the result of the determination made by the determination means indicates that the extraction result by the extraction means is negative, a correction means for correcting the extraction result is further provided.
Alternatively, the image processing apparatus according to claim 2. 5. The image processing apparatus according to claim 4, further comprising instruction means for instructing whether or not to make a correction by the correction means. 6. The image according to claim 5, wherein the dividing unit divides the original image having the predetermined format into a plurality of areas based on the extraction result corrected by the correcting unit. Processing equipment. 7. The image processing apparatus according to claim 1, wherein the notification unit displays a determination result of the determination unit. 8. The informing means informs the determination result of the determining means using a sound.
Alternatively, the image processing apparatus according to claim 2. 9. If the result of the determination by the determination means indicates that the extraction result by the extraction means is negative, the area that may have failed in the extraction result is separated from the area in which the extraction result has not failed. The image processing apparatus according to claim 1, further comprising display means for displaying separately. 10. The image processing apparatus according to claim 1, further comprising a determination unit that determines whether or not the division result by the division unit is correct based on the format information. 11. The image according to claim 10, further comprising a correction unit that corrects the result of the division when the result of the determination by the determination unit indicates that the result of the division by the dividing unit is negative. Processing equipment. 12. The image processing apparatus according to claim 10, further comprising display means for displaying whether the result of the determination made by the determination means is correct or not. 13. The image processing apparatus according to claim 10, further comprising a notifying unit for notifying that the result of the determination made by the determining unit indicates that the result of the division by the dividing unit is negative. 14. An image processing method for extracting a ruled line included in an original image having a predetermined format, comprising a storage step of storing format information regarding the predetermined format in a storage medium, and an original having the predetermined format. An extraction step of extracting ruled lines included in the image, a determination step of determining whether the extraction result by the extraction step is correct based on the format information, and a notification step of notifying based on the determination result of the determination means. An image processing method comprising: 15. An image processing method for extracting ruled lines included in a document image having a predetermined format, comprising a storage step of storing respective format information regarding a plurality of types of document images having a predetermined format in a storage medium. An extracting step of extracting a ruled line included in the document image having the predetermined format, and an identifying step of identifying the type of the document image having the predetermined format based on the feature of the ruled line extracted in the extracting step. A determination step of determining whether the extraction result by the extraction step is correct, based on format information of a document image having a predetermined format corresponding to the type identified in the identification step, and based on the determination result of the determination step. And an informing step of informing. 16. If the result of the determination in the determination step is that the extraction result of the extraction step is positive, a division step of dividing the original image having the predetermined format into a plurality of areas based on the extraction result is performed. The image processing method according to claim 14 or 15, further comprising: 17. The method according to claim 14 or 15, further comprising a correction step of correcting the extraction result if the extraction result of the extraction step is negative as a result of the determination in the determination step. The image processing method described in. 18. The image processing method according to claim 17, further comprising an instructing step of instructing whether or not to perform the correction by the correction step. 19. The image according to claim 18, wherein the dividing step divides the original image having the predetermined format into a plurality of areas based on the extraction result corrected by the correcting step. Processing method. 20. The image processing method according to claim 14, wherein the notification step displays a determination result of the determination step. 21. The image processing method according to claim 14, wherein the notifying step notifies the determination result of the determining step using sound. 22. As a result of the judgment in the judgment step, if the extraction result of the extraction step is negative, the area that may have failed in the extraction result is separated from the area that has not failed in the extraction result. The image processing method according to claim 14 or 15, further comprising a display step of displaying separately. 23. The method according to claim 14, further comprising a determination step of determining whether or not the division result by the division step is correct based on the format information.
The image processing method according to 1. 24. The image according to claim 23, further comprising a correction step of correcting the result of the division when the result of the determination in the determination step indicates that the result of the division by the division step is negative. Processing method. 25. The image processing method according to claim 23, further comprising a display step of displaying, as a result of the determination in the determination step, whether or not the division result by the division step is correct. 26. The image processing method according to claim 23, further comprising a notifying step of notifying, when the result of the determination in the determination step shows that the division result by the division step is negative. 27. A computer-readable memory in which a program code for image processing is stored, including a code of a storage step of storing format information regarding the predetermined format in a storage medium, and an original image having the predetermined format. A code of an extraction step for extracting a ruled line to be extracted, a code of a determination step of determining whether the extraction result by the extraction step is correct based on the format information, and a notification step of informing based on the determination result of the determination means. A computer-readable memory comprising: a code. 28. A computer-readable memory storing a program code for image processing, the code of a storage step of storing format information on a document image having a plurality of types of predetermined formats in a storage medium; The code of the extraction step for extracting the ruled lines included in the original image having the format, and the code of the identification step for identifying the type of the original image having the predetermined format based on the characteristics of the ruled lines extracted in the extraction step And a code of a determination step of determining the correctness of the extraction result by the extraction step, based on the format information of the document image having a predetermined format corresponding to the type identified in the identification step, and the determination result of the determination step And a code of an informing step for informing the computer. Readable memory.