JP3276555B2 - Format recognition device and character reader - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a format recognizing device for recognizing the type of a form format, and a character reading device for recognizing the type of a form format and reading characters according to the recognition result.

[0002]

2. Description of the Related Art In an apparatus for reading characters in a form in which characters are written, generally, a character pattern is cut out and recognized using read control data corresponding to the type of each form format (for example, see References). "Edited by Shinichiro Hashimoto, Introduction to Character Recognition, p. 203-206, Showa 5
March 20, 2007, Ohmsha "). For example, the position of a character line, the position and number of fields, and the pitch and number of characters are used for extracting a character pattern, and the character type and font are used for reading control data for recognizing a character pattern. Conventionally, a form type number set for each type of form format is printed on a form provided to this type of apparatus, and read control data is read based on the recognition result of the type number.

[0003]

However, some forms have no form type number printed thereon.
For example, a private form such as a transfer request form or a commercial general form does not have a form type number printed thereon.Therefore, in the above-described conventional apparatus, when a character pattern is cut out and recognized for this kind of form, , No read control data is available.

[0004] The inventors of the present application have conducted various studies, and have found that the use of the ruled lines related to the form format allows the form format type to be recognized even when the form type number is not printed. .

The present application has been made in view of the above points, and a first object of the present application is to provide a form format recognition device for recognizing the type of a form format using ruled lines related to the form format, It is an object of the present invention to provide a character reading device that recognizes the type of a form using a ruled line related to the form, and cuts out and recognizes a character pattern using read control data corresponding to the recognition result.

As a technique similar to such a form format recognition technique, there is, for example, a table recognition apparatus disclosed in Japanese Patent Application Laid-Open No. 4-158487. This device is
Apparatus for recognizing the structure of a table and the characters in the table, means for creating a circumscribed rectangle list of connected black pixels, and estimating whether or not the connected black pixels in the rectangle are characters from the length of the sides of the circumscribed rectangle Means for performing character recognition in a rectangle based on the estimation result; means for erasing characters in a rectangle after character recognition is completed; and estimating and estimating the position of a ruled line from a histogram of black pixels after character erasure in the rectangle. Means for partially scanning the image data based on the determined ruled line positions to recognize the positions of the ruled lines forming the table.

However, this table recognizing apparatus only recognizes the position of each ruled line constituting the table, but does not recognize the type of the form format using the ruled line for selecting the read control data. Absent. Therefore, since the read control data cannot be used, it is impossible to cut out and recognize only the character pattern of a specific area to be read.

[0008]

According to a first aspect of the present invention, there is provided a format recognition apparatus for extracting a ruled line pattern representing a form format from form image data of an unknown form format, and storing the extracted ruled line pattern. A ruled line pattern memory, a format recognition dictionary that holds form format dictionary data, and a collation of extracted ruled line patterns with form format dictionary data, and a form format represented by the ruled line pattern based on the matching result. A format recognition unit that outputs one or a plurality of recognition results, a reference data memory that holds reference data representing characteristics of a known form format, and a reference data of a known form format corresponding to the recognition result of the form format. The display unit and the operator display the reference data based on the displayed reference data. An input device that outputs a format determination signal corresponding to an input operation of the determination result by an operator in the operation of determining the recognition result of the form format by using a reference data of different types, , Colors, brightness, or a combination thereof, so as to be distinguished and displayed.

A format recognition apparatus according to a second aspect of the present invention converts form image data of an unknown form
A ruled line extraction unit that extracts a ruled line pattern representing a form format, a ruled line pattern memory that stores the extracted ruled line pattern, a format recognition dictionary that holds dictionary data in the form format, and an extracted ruled line pattern A format recognition unit that checks against dictionary data and outputs one or more recognition results for a form format represented by a ruled line pattern based on the check result;
A reference data memory for holding reference data representing characteristics of a known form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. In the operation of determining the recognition result of the form format by using a format recognition device having an input device for outputting a format determination signal corresponding to the input operation of the determination result by the operator, the form, the line and the field represented by the graphic are referred to. It is characterized by being displayed as data.

A format recognition apparatus according to a third aspect of the present invention converts form image data of an unknown form
A ruled line extraction unit that extracts a ruled line pattern representing a form format, a ruled line pattern memory that stores the extracted ruled line pattern, a format recognition dictionary that holds dictionary data in the form format, and an extracted ruled line pattern A format recognition unit that checks against dictionary data and outputs one or more recognition results for a form format represented by a ruled line pattern based on the check result;
A reference data memory for holding reference data representing characteristics of a known form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. In the operation of determining the recognition result of the form format, in the format recognition device having an input device that outputs a format determination signal corresponding to the input operation of the determination result by the operator, the reference data,
Form width, form height, number of lines in the form, line position in the form, number of fields in the form, field position in the form, number of characters in the line or field, character pitch in the line or field, in the line Alternatively, one or a plurality of reference data selected from the font of the character in the field and the character type of the character in the line or the field is provided.

According to a fourth aspect of the present invention, a format recognition device converts form image data of an unknown form format from form image data.
A ruled line extraction unit that extracts a ruled line pattern representing a form format, a ruled line pattern memory that stores the extracted ruled line pattern, a format recognition dictionary that holds dictionary data in the form format, and an extracted ruled line pattern A format recognition unit that checks against dictionary data and outputs one or more recognition results for a form format represented by a ruled line pattern based on the check result;
A reference data memory for holding reference data representing characteristics of a known form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. An input device that outputs a format determination signal corresponding to an input operation of the determination result by an operator in the operation of determining the recognition result of the form format by using the first reference data as the number of lines in the form. , Line position in the form, the number of fields in the form, and one or more reference data selected from the field position in the form, the second reference data,
One or a plurality of reference data selected from the font of the character in the form and the character type of the character in the form, and the second reference data is a position near the display position of the first reference data or the first reference data. The data is displayed at a position overlapping the data display position.

According to a fifth aspect of the present invention, a format recognizing apparatus converts form image data of an unknown form format from form image data.
A ruled line extraction unit that extracts a ruled line pattern representing a form format, a ruled line pattern memory that stores the extracted ruled line pattern, a format recognition dictionary that holds dictionary data in the form format, and an extracted ruled line pattern A format recognition unit that checks against dictionary data and outputs one or more recognition results for a form format represented by a ruled line pattern based on the check result;
A reference data memory for holding reference data representing characteristics of a known form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. In a format recognition apparatus having an input device for outputting a format determination signal corresponding to an input operation of a determination result by an operator in a work of determining a recognition result of a form format, a row represented by a graphic is referred to as first reference data. , And the character type or font of the characters in the line is displayed as the second reference data,
The second reference data is displayed at a position near the display position of the first reference data or at a position overlapping with the display position of the first reference data.

A format recognition apparatus according to a sixth aspect of the present invention converts form image data of an unknown form
A ruled line extraction unit that extracts a ruled line pattern representing a form format, a ruled line pattern memory that stores the extracted ruled line pattern, a format recognition dictionary that holds dictionary data in the form format, and an extracted ruled line pattern A format recognition unit that checks against dictionary data and outputs one or more recognition results for a form format represented by a ruled line pattern based on the check result;
A reference data memory for holding reference data representing characteristics of a known form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. An input device that outputs a format determination signal corresponding to an input operation of the determination result by an operator in the operation of determining the recognition result of the form format by using a field represented by a graphic as first reference data. And the character type or font of the character in the field is displayed as the second reference data, and the second reference data is displayed in the vicinity of the display position of the first reference data or the display of the first reference data. It is characterized in that it is displayed at a position overlapping the position.

In the third to sixth aspects of the present invention, it is preferable that form image data of an unknown form format and the reference data corresponding to the image data are displayed in a superimposed manner.

In the third to sixth aspects of the present invention, it is desirable that the reference image data obtained in advance from a form having a known form format and the reference data be superimposed and displayed.

A format recognition apparatus according to a seventh aspect of the present invention comprises a format recognition system for performing a form format recognition process, a control data memory for holding read control data, and a character recognition unit according to the read control data corresponding to the form format recognition result. The character recognition system has a character extracting unit that extracts a character pattern from the form image data, a character pattern memory that stores the extracted character pattern, and character dictionary data. The character recognition dictionary and the extracted character pattern
A character recognizing unit for collating with character dictionary data and recognizing a character pattern based on the collation result; and a format recognition system for extracting a ruled line pattern representing a form format from form image data of an unknown form format. The extraction unit, a ruled line pattern memory for storing the extracted ruled line pattern, a format recognition dictionary for holding the dictionary data in the form format, and the extracted ruled line pattern are collated with the dictionary data in the form format. A format recognition unit that outputs one or a plurality of recognition results for a form format represented by a ruled line pattern based on the reference data memory that holds reference data representing characteristics of a known form format; Reference data in a known form format corresponding to the recognition result A display unit for displaying, and an input device for outputting a format determination signal corresponding to the input operation of the determination result by the operator in the operation of determining the recognition result of the form format based on the reference data displayed by the operator, In the character reading device, the recognition system performs a character recognition process in accordance with the read control data corresponding to the format determination signal. In the character reading device, the reference data memory is a control data memory, and the display unit controls the reading as the reference data. Displaying data.

According to the first to seventh aspects of the present invention, it is possible to obtain a format recognizing apparatus which is excellent in work efficiency and easily secures work accuracy.

[0018]

[0019]

[0020]

[0021]

[0022]

[0023]

[0024]

[0025]

[0026]

[0027]

[0028]

FIG. 1 is a functional block diagram schematically showing a configuration of a character reading device. The character reading device shown in the figure is an embodiment of the character reading device of claim 9 and includes an embodiment of the format recognition device of claim 1. In the following description, an embodiment of the format recognition apparatus of claim 1 will be described together with an embodiment of the character reading apparatus of claim 9.

A character reading apparatus 10 shown in FIG. 1 has a format recognition system 12 for recognizing a form format.
And a control data memory 14 for holding read control data.
And a character recognition system 16 for performing character recognition processing according to read control data corresponding to the form format recognition result.
And a control unit 17.

The format recognition system 12 includes a ruled line extraction unit 18 for extracting a ruled line pattern representing a form format from form image data of an unknown form format, a ruled line pattern memory 20 for storing the extracted ruled line pattern, The format recognition dictionary 22 holding the dictionary data and the extracted ruled line pattern are collated with the dictionary data in the form format by the pattern matching method, and one or a plurality of the form formats represented by the ruled line pattern are determined based on the collation result. And a format recognizing unit 24 that outputs the recognition result.

A reference data memory 26 for holding reference data representing characteristics of the known form format, a display unit 28 for displaying reference data of the known form format corresponding to the recognition result of the form format, An input device 30 for outputting a format determination signal corresponding to an input operation of the determination result by the operator in the operation of determining the recognition result of the form format based on the obtained reference data.

The character recognition system 16 includes a character extraction unit 32 for extracting a character pattern from the form image data, a character pattern memory 34 for storing the extracted character pattern, a character recognition dictionary 36 for storing character dictionary data, The extracted character pattern is compared with character dictionary data by a pattern matching method, and a character recognizing unit 38 for recognizing the character pattern based on the result of the comparison is provided. Character recognition processing is performed according to the corresponding read control data.

The control unit 17 controls the operation of the format recognition system 12 and the character recognition system 16 and controls the display of the display unit 28.

(Principle Explanation of Format Recognition) FIG.
Is a plan view showing an example of a form. On the paper surface 40a of the form 40 shown in FIG. 2A, an identification number 42 indicating the type of the form format (5 in the example shown in FIG. 2).
(A digit number), a ruled line 44 for dividing an area where a predetermined item is described, a character 46 (characters represented by 01 and 02 in the illustrated example) indicating an attribute of the predetermined item to be written, and the predetermined item are transmitted. Characters 48 written in order to save
BC, AIUEO, DEF, Kakikukeko, and Aioka Kikukuke). The identification number 42, the ruled line 44, and the character 46 are printed in advance before using the form, and the character 48 is added when the form is used. The area where the character 48 is added is blank before that.

By printing the ruled line 44, the paper 40
a is divided into a plurality of regions 50, and predetermined items are described in each of the divided regions 50 divided by the ruled lines 44. The predetermined items can be represented by characters, symbols, figures, and various other things.

The form format indicates the form (for example, the size, number, and shape of the divided areas 50 existing on the paper surface 40a, and the relative positional relationship between the divided areas 50) divided by the ruled lines 44. It was done.

The form 40 shown in FIG. 2B corresponds to the form 40 shown in FIG.
Is used for the same purpose as the form 40 of the
2 except that the identification number 42 is not described on FIG.
This is exactly the same as the form 40 in FIG. FIG. 2 (B)
As shown in (A) and (A), in the forms used for the same purpose, in most cases, the same form format or a very similar form format is used even if the presence or absence of the identification number 42 is different.

Therefore, FIG.
Even in the form 40 of (B), the type of the form format can be known by extracting the ruled line pattern from the form image data and recognizing the form format represented by the extracted ruled line pattern.

(Overall Operation Flow) Next, the overall operation flow of the character reader will be described. FIG. 3 is a diagram showing the overall operation flow of the character reading device of this embodiment.

First, form image data is obtained by the scanner 52. The scanner 52 optically scans the paper surface 40a of the form 40, generates form image data composed of quantized electric signals, for example, black and white binary electric signals, and stores the data in the form image memory 54. Here, a line drawing element is represented by a black bit, and a background pixel is represented by a white bit. The line drawing element is a pixel representing a line in the paper surface 40a, and the background pixel is a pixel representing a ground portion (a portion serving as a line background) of the paper surface 40a. The pressing surface for pressing the form 40 set on the scanner 52 has a color, for example, white, which is converted into a background pixel, like the ground on the paper surface 40a of the form 40. Therefore, the pressing surface is also represented by a white bit here.

When the form image data is stored in the form image memory 54, the control unit 17 activates the ruled line extraction unit 18 (start).

The activated ruled line extracting unit 18 scans the form image data stored in the form image memory 54 to extract ruled line patterns, and stores the extracted ruled line patterns in the ruled line pattern memory 20 (S1). .

When the ruled line extraction unit 18 finishes extracting the ruled line pattern, the control unit 17 activates the format recognition unit 24.

The activated format recognition unit 24 compares the ruled line pattern stored in the ruled line pattern memory 20 with the form data dictionary data stored in the format recognition dictionary 22 (S2). Based on this, the form format represented by the ruled line pattern is recognized, and this recognition result is output to the control unit 17 (S
3).

The control unit 17 converts the read control data corresponding to the input form format recognition result into reference data memory 26 as reference data of a known form format.
From (14), the read reference data is displayed on the display unit 28, and the form image data of unknown form format obtained from the recognition result is read from the form image memory 54 and displayed on the display unit 28 (S4). After that, it waits for the input of the format determination signal by the operator (S5).

The operator compares and refers to the reference data and the form image data whose form format is unknown, determines and determines the most probable recognition result, and operates the input device 30 to generate a format determination signal corresponding to the determined result. input.

When confirming the input of the format determination signal by the operator (S5), the control unit 17 transfers the read control data based on the format determination signal (S6). This transfer is performed between the control unit 17 and the character recognition system 16.

Here, the read control data memory 14 (2
6) stores read control data related to character pattern extraction and read control data related to character pattern recognition, and the control unit 17 controls the read control corresponding to the recognition result determined by the format determination signal. Data is selected from the read control data that has already been read, read control data relating to character pattern cutting out of the selected read control data is sent to the character cutout unit 32, and character pattern is recognized among the selected read control data. The associated read control data is output to the character recognition unit 38.

Next, the control unit 17 activates the character cutout unit 32 and the character recognition unit 38. Then, the character extraction unit 32
A character pattern is cut out from the form image data in units of one character, and the cut out character pattern is stored in a character pattern memory 34.
(S7). The character recognition unit 38 checks the extracted character pattern against the dictionary data of the character recognition dictionary 36 (S8), recognizes the character pattern based on the comparison result, and outputs the recognition result to the control unit 17 (S9). ). The control unit 17 inputs a character pattern recognition result for each character, and determines whether or not recognition has been completed for all characters on the form paper surface 40a (S10).

If the recognition of all the characters on the form paper 40a has not been completed, the character extracting section 32 and the character recognizing section 38 perform the operations of S7 to S7 in accordance with the operation control of the control section 17.
Step 9 is repeated. When the recognition is completed for all the characters on the form paper 40a, the reading of characters for one form is completed, and the character recognition result obtained for one form is output to the subsequent device (end).

(Extraction of Ruled Line Pattern) Next, the ruled line extracting unit 18
The extraction of the ruled line pattern performed by is described below. The ruled line extracting unit 18 scans the form image data over the entire form 40 and extracts a horizontal ruled line pattern and a vertical ruled line pattern as ruled line patterns representing a form format.

When extracting the horizontal ruled line pattern, the form image data is scanned horizontally, and the line drawing elements of the form image data that are continuous on the horizontal scanning line by a length Lh equal to or longer than the horizontal ruled line threshold TH (Lh) are extracted as horizontal ruled line patterns. Is extracted as a line drawing element of. The continuous length Lh is equal to the horizontal ruled line threshold TH (L
h) The line drawing elements (including one line drawing element which is not continuous on the horizontal scanning line and exists in isolation) of the form image data less than h) are extracted as the background pixels of the horizontal ruled line pattern.
Background pixels of the form image data are also extracted as background pixels of the horizontal ruled line pattern. The horizontal ruled line pattern is a pattern composed of line drawing elements and background pixels extracted from the form image data in this manner.

Similarly, when extracting the vertical ruled line pattern,
The form image data is vertically scanned, and line drawing elements of the form image data that are continuous on the vertical scanning line by a length Lv equal to or longer than the vertical ruled line threshold TH (Lv) are extracted as line drawing elements of the vertical ruled line pattern. The continuous length Lv is equal to the vertical ruled line threshold T
Line drawing elements (including one line drawing element that is not continuous on a vertical scanning line and is isolated) of the form image data that is less than H (Lv) are extracted as background pixels of the vertical ruled line pattern. Background pixels of the form image data are also extracted as background pixels of the vertical ruled line pattern. The vertical ruled line pattern is a pattern composed of line drawing elements and background pixels extracted from the form image data in this manner.

A storage area common to the extracted horizontal ruled line pattern and vertical ruled line pattern (hereinafter, ruled line common storage area) is provided in the ruled line pattern memory 20, and the horizontal ruled line pattern and the vertical ruled line pattern are superimposed and stored in the ruled line common storage area. Alternatively, an individual storage area for each of the extracted horizontal ruled line pattern and vertical ruled line pattern (hereinafter referred to as a ruled line individual storage area)
May be provided in the ruled line pattern memory 20, and the horizontal ruled line pattern and the vertical ruled line pattern may be stored in separate ruled line individual storage areas.

When the image data is stored in the ruled line common storage area, the background pixels are stored in the entire ruled line common storage area (initialization of the ruled line common storage area). The line drawing elements of the extracted vertical ruled line pattern are stored in the common storage area.

When storing in the ruled line individual storage area, background pixels are stored in the entire ruled line individual storage area provided for the horizontal ruled line pattern (initialization of the ruled line individual storage area), and thereafter, the horizontal ruled line pattern is stored. The line drawing elements of the extracted horizontal ruled line pattern are stored in the ruled line individual storage area provided for. In addition, background pixels are stored in the entire ruled line individual area provided for the vertical ruled line pattern (initialization of the ruled line individual storage area).
The extracted line drawing element of the vertical ruled line pattern is stored in a ruled line individual storage area provided for the vertical ruled line pattern.

FIG. 4 is a diagram for explaining the operation of the ruled line extraction unit according to this embodiment, and shows a specific example of the operation flow focusing on the operation of extracting the line drawing element of the ruled line pattern.

First, a case where the horizontal ruled line pattern and the vertical ruled line pattern are superimposed and stored in the ruled line common storage area of the ruled line pattern memory 20 will be described. In this case, a corresponding xy coordinate system is set on the form image data storage area of the form image memory 54 and the ruled line common storage area of the ruled line pattern memory 20 (for example, the horizontal x-axis). The direction and the vertical direction are defined as the y-axis direction.), The pixel data is read from the storage area of the pixel position represented by this coordinate system, or the pixel data is stored in the storage area of the pixel position represented by this coordinate system. Can be written. Furthermore, the left side of the form 40 is x
The form 40 is set on the scanner 52 such that the y axis of the y coordinate system and the upper side of the form 40 overlap the x axis of the xy coordinate system, and the form image data is obtained by the scanner 52. -Form 40 on the x and y axes of the y coordinate system
The form image data and the ruled line pattern positioned so that the upper side and the left side thereof are placed are stored.

The ruled line extraction unit 1 started by the control unit 17
Reference numeral 8 stores a background pixel, here a white bit, over the entire ruled line common storage area of the ruled line pattern memory 20 (initialization of the ruled line common storage area).

Thereafter, the ruled line extracting unit 18 starts the process of extracting a horizontal ruled line pattern with the scanning direction being the horizontal direction (start). In this case, the horizontal ruled line threshold TH is used as the threshold TH.
(Lh) is used, and the length Lh of a continuous line drawing element on a horizontal scanning line is obtained as the continuous length L.

Next, the ruled line extraction unit 18 initializes the continuous length L to zero (S1), and thereafter, the form image memory 54
Is scanned horizontally to read out pixel data of the form image data (S2). The pixel data represents data for one pixel.

Next, the ruled line extracting unit 18 determines whether or not the pixel data of the read form image data is a line drawing element, here, a black bit (S3).

If it is determined in step S3 that the pixel data is a line drawing element, the continuous length L is determined, and the pixel drawing data is set as a line drawing element candidate position (hereinafter referred to as a horizontal ruled line candidate position) for the horizontal ruled line pattern. The pixel position of the data is stored (S4), and thereafter, it is determined whether or not scanning of the current scanning line for the form image data has been completed (S5).
Here, when the determination result that the pixel data is a line drawing element is obtained in S3, the continuous length L is counted up by one, and thus the number of continuous line drawing elements is counted. Find L.

If it is determined in S5 that the scanning of one line of the current scanning line has not been completed, the process returns to S2 to read the next pixel data on the current scanning line.

If it is determined in step S5 that the scanning of one line of the current scanning line has been completed, the continuous length L is compared with a threshold value TH (S6). Here, since the horizontal ruled line pattern is extracted, the determined continuous length L is the continuous length Lh on the horizontal scanning line, and the horizontal ruled line threshold TH (Lh) is used as the threshold TH.

If it is determined in S6 that the continuous length L is greater than or equal to the threshold value TH, the ruled line extraction unit 18 stores the continuous line drawing elements having the length L in the ruled line pattern memory 20 (S7). . Here, the line drawing element is stored in the stored ruled line common storage area at the horizontal ruled line candidate position. S7
Next, the continuous length L is initialized, and the stored horizontal ruled line candidate position is deleted (S8).
It is determined whether scanning of the form image data has been completed over the entire surface (S9). If it is determined in S6 that the continuous length L is less than the threshold value TH, S8 to S9 are performed without performing S7.

If it is determined in S9 that the scan of the form image data has not been completed over the entire form 40, the process returns to S2 to read out pixel data on the next scan line to the current scan line. If it is determined in S9 that the scanning of the form image data over the entire form has been completed, the process of extracting the horizontal ruled line pattern from the form 40 ends (end).

Further, when it is determined in step S3 that the pixel data read out is not a line drawing element, the continuous length L is compared with a threshold TH (S10).

If it is determined in S10 that the continuous length L is greater than or equal to the threshold value TH, the ruled line extraction unit 18 stores the continuous line drawing elements of the length L in the ruled line pattern memory 20 (S11). . Next, the continuous length L is initialized to zero, and the stored horizontal ruled line candidate position is erased (S12). Thereafter, it is determined whether or not scanning of one current scanning line has been completed (S12). S13). If the scanning of one line of the current scanning line has not been completed (S13), the process returns to S2 to read the next pixel data on the current scanning line. When the scanning of the current scanning line is completed (S13), S9 is performed. If it is determined in S10 that the continuous length L is less than the threshold value TH, S12 to S13 are performed without performing S11.

Next, the ruled line extraction unit 18 starts processing for extracting a vertical ruled line pattern with the scanning direction being the vertical direction (start). In this case, as the threshold TH, the vertical ruled line threshold TH (L
v), and the length Lv of the line drawing elements that are continuous on the vertical scanning line is determined as the continuous length L.

Next, the ruled line extracting unit 18 initializes the length L of the continuation to zero (S1), and thereafter, the form image memory 54
Is vertically scanned, and pixel data of the form image data is read (S2).

Next, the ruled line extracting section 18 determines whether or not the pixel data of the read form image data is a line drawing element, here, a black bit (S3).

If it is determined in step S3 that the pixel data is a line drawing element, the continuous length L is obtained and the pixel drawing candidate position (hereinafter referred to as a vertical ruled line candidate position) for the vertical ruled line pattern is determined. The pixel position of the data is stored (S4), and thereafter, it is determined whether or not scanning of the current scanning line for the form image data has been completed (S5).

If it is determined in S5 that the scanning of one line of the current scanning line has not been completed, the process returns to S2 to read out the next pixel data on the current scanning line.

If it is determined in S5 that the scanning of one current scanning line has been completed, the length L of the continuation is compared with a threshold value TH (S6). Here, since the vertical ruled line pattern is extracted, the determined continuous length L is the continuous length Lv on the vertical scanning line, and the vertical ruled line threshold TH (Lv) is used as the threshold TH.

If it is determined in S6 that the continuous length L is greater than or equal to the threshold value TH, the ruled line extraction unit 18 stores the continuous line drawing elements having the length L in the ruled line pattern memory 20 (S7). . Here, the line drawing element is stored in the stored ruled line common storage area at the vertical ruled line candidate position. S7
Next, the continuous length L is initialized, and the stored vertical ruled line candidate position is deleted (S8).
It is determined whether scanning of the form image data has been completed over the entire surface (S9). If it is determined in S6 that the continuous length L is less than the threshold value TH, S8 to S9 are performed without performing S7.

If it is determined in S9 that the scanning of the form image data has not been completed over the entire form 40, the process returns to S2 in order to read the pixel data on the next scanning line after the current scanning line. If it is determined in step S9 that the scanning of the form image data has been completed over the entire form, the process of extracting the vertical ruled line pattern from the form 40 ends (end).

Further, if it is determined in step S3 that the pixel data read out is not a line drawing element, the continuous length L is compared with a threshold value TH (S10).

When the determination result that the continuous length L is equal to or larger than the threshold value TH is obtained in S10, the ruled line extraction unit 18 stores the continuous line drawing elements of the length L in the ruled line pattern memory 20 (S11). . Next, the continuous length L is initialized to zero, and the stored vertical ruled line candidate position is erased (S12), and thereafter, it is determined whether or not scanning of one current scanning line has been completed (S12). S13). If the scanning of one line of the current scanning line has not been completed (S13), the process returns to S2 to read the next pixel data on the current scanning line. When the scanning of the current scanning line is completed (S13), S9 is performed. If it is determined in S10 that the continuous length L is less than the threshold value TH, S12 to S13 are performed without performing S11.

As described above, an example in which the line drawing elements of the horizontal and vertical ruled line patterns are extracted from the form 40 shown in FIG. 2B, and the line drawing elements of these patterns are superimposed and stored in the ruled line common storage area is shown in FIG. As shown in FIG. In the figure, reference numeral 20a denotes a ruled line common storage area of the ruled line pattern memory 20, reference numeral 20b denotes an area corresponding to the form paper surface 40a in the ruled line common storage area 20a, and reference numeral 44a denotes an overlapping pattern of a horizontal ruled line pattern and a vertical ruled line pattern. The overlapping pattern 44a is composed of a line drawing element of a horizontal ruled line pattern, a line drawing element of a vertical ruled line pattern, and a pixel that is a background pixel of the horizontal ruled line pattern and a background pixel of the vertical ruled line pattern.

Next, the case where the horizontal ruled line pattern and the vertical ruled line pattern are individually stored in the ruled line individual storage area of the ruled line pattern memory 20 will be described. In this case, the form image data storage area of the form image memory 54 and the individual ruled line storage area of the ruled line pattern memory 20 (the ruled line individual storage area provided for the horizontal ruled line pattern and the ruled line provided for the vertical ruled line pattern) (On the individual storage area), a corresponding xy coordinate system is set (for example, the horizontal x-axis direction and the vertical direction are defined as the y-axis direction), and represented by this coordinate system. It is assumed that the pixel data can be read from the storage area of the pixel position, or the pixel data can be written to the storage area of the pixel position represented by this coordinate system. Further, the left side of the form 40 is the xy
The form 40 is set on the scanner 52 such that the y-axis of the coordinate system and the upper side of the form 40 overlap the x-axis of the xy coordinate system, and form image data is obtained by the scanner 52.
Therefore, the form image data and the ruled line pattern positioned so that the top and left sides of the form 40 are placed on the x and y axes of the xy coordinate system are stored.

The ruled line extraction unit 1 started by the control unit 17
Numeral 8 stores a background pixel, here a white bit, over the entire ruled line individual storage area provided for the horizontal ruled line pattern (initialization of the ruled line individual storage area provided for the horizontal ruled line pattern).

Thereafter, the ruled line extraction unit 18 starts processing for extracting a horizontal ruled line pattern with the scanning direction being the horizontal direction (start). In this case, the horizontal ruled line threshold TH is used as the threshold TH.
(Lh) is used, and the length Lh of a continuous line drawing element on a horizontal scanning line is obtained as the continuous length L.

Next, the ruled line extraction unit 18 initializes the length L of the continuation to zero (S1), and thereafter, the form image memory 54
Is scanned horizontally to read out pixel data of the form image data (S2).

Next, the ruled line extracting unit 18 determines whether or not the pixel data of the read form image data is a line drawing element, here, a black bit (S3).

When the result of the determination that the pixel data is a line drawing element is obtained in S3, the continuous length L is obtained and the pixel position of the pixel data is stored as a horizontal ruled line candidate position (S4). Thereafter, it is determined whether or not scanning of one current scanning line has been completed for the form image data (S5).

If it is determined in S5 that the scanning of one line of the current scanning line has not been completed, the process returns to S2 to read the next pixel data on the current scanning line.

If it is determined in step S5 that the scanning of one line of the current scanning line has been completed, the continuous length L is compared with a threshold TH (S6). Here, since the horizontal ruled line pattern is extracted, the determined continuous length L is the continuous length Lh on the horizontal scanning line, and the horizontal ruled line threshold TH (Lh) is used as the threshold TH.

When the determination result that the continuous length L is equal to or larger than the threshold value TH is obtained in S6, the ruled line extracting unit 18 determines a continuous line drawing element of the length L by using a ruled line pattern provided for the horizontal ruled line pattern. It is stored in the storage area (S7). Here, the line drawing element is stored in the stored ruled line individual storage area at the horizontal ruled line candidate position. After S7, the continuous length L is initialized, and the stored horizontal ruled line candidate position is deleted (S7).
8) Then, it is determined whether the scanning of the form image data over the entire form 40 has been completed (S9). If it is determined in S6 that the continuous length L is less than the threshold value TH, S8 to S9 are performed without performing S7.

If it is determined in S9 that the scanning of the form image data has not been completed over the entire form 40, the process returns to S2 in order to read out the pixel data on the next scanning line after the current scanning line. If it is determined in S9 that the scanning of the form image data over the entire form has been completed, the process of extracting the horizontal ruled line pattern from the form 40 ends (end).

Further, if it is determined in step S3 that the pixel data read out is not a line drawing element, the continuous length L is compared with a threshold value TH (S10).

If it is determined in S10 that the continuous length L is greater than or equal to the threshold value TH, the ruled line extraction unit 18 stores the continuous line drawing elements having the length L in the ruled line pattern memory 20 (S11). . Next, the continuous length L is initialized to zero, and the stored horizontal ruled line candidate position is erased (S12). Thereafter, it is determined whether or not scanning of one current scanning line has been completed (S12). S13). If the scanning of one line of the current scanning line has not been completed (S13), the process returns to S2 to read the next pixel data on the current scanning line. When the scanning of the current scanning line is completed (S13), S9 is performed. If it is determined in S10 that the continuous length L is less than the threshold value TH, S12 to S13 are performed without performing S11.

Next, the ruled line extraction unit 18 stores the background pixel, ie, the white bit, over the entire ruled line individual storage area provided for the vertical ruled line pattern (initialization of the ruled line individual storage region provided for the vertical ruled line pattern). ).

Thereafter, the ruled line extraction unit 18 starts processing for extracting a vertical ruled line pattern with the scanning direction being the vertical direction (start). In this case, the vertical ruled line threshold TH is used as the threshold TH.
(Lv) is used, and the length Lv of the continuous line drawing element on the vertical scanning line is determined as the continuous length L.

Next, the ruled line extraction unit 18 initializes the length L of the continuation to zero (S1), and thereafter, the form image memory 54
Is vertically scanned, and pixel data of the form image data is read (S2).

Next, the ruled line extraction unit 18 determines whether or not the pixel data of the read form image data is a line drawing element, here, a black bit (S3).

If the result of the determination in S3 is that the pixel data is a line drawing element, the continuous length L is obtained, and the pixel position of the pixel data is stored as a vertical ruled line candidate position (S4). Thereafter, it is determined whether or not scanning of one current scanning line has been completed for the form image data (S5).

If it is determined in S5 that the scanning of one line of the current scanning line has not been completed, the process returns to S2 to read the next pixel data on the current scanning line.

If it is determined in step S5 that the scanning of one line of the current scanning line has been completed, the continuous length L is compared with the threshold TH (S6). Here, since the vertical ruled line pattern is extracted, the determined continuous length L is the continuous length Lv on the vertical scanning line, and the vertical ruled line threshold TH (Lv) is used as the threshold TH.

When the determination result that the continuous length L is equal to or larger than the threshold value TH is obtained in S6, the ruled line extracting unit 18 determines the continuous line drawing element of the length L by using a ruled line pattern provided for the vertical ruled line pattern. It is stored in the storage area (S7). Here, the line drawing element is stored in the stored ruled line individual storage area at the vertical ruled line candidate position. Subsequent to S7, the continuous length L is initialized, and the stored vertical ruled line candidate positions are deleted (S7).
8) Then, it is determined whether the scanning of the form image data over the entire form 40 has been completed (S9). If it is determined in S6 that the continuous length L is less than the threshold value TH, S8 to S9 are performed without performing S7.

If it is determined in S9 that the scanning of the form image data has not been completed over the entire form 40, the process returns to S2 in order to read the pixel data on the next scanning line after the current scanning line. If it is determined in step S9 that the scanning of the form image data has been completed over the entire form, the process of extracting the vertical ruled line pattern from the form 40 ends (end).

Further, if it is determined in S3 that the pixel data read out is not a line drawing element, the length L of the continuation is compared with a threshold value TH (S10).

If it is determined in S10 that the continuous length L is greater than or equal to the threshold value TH, the ruled line extraction unit 18 stores the continuous line drawing elements having the length L in the ruled line pattern memory 20 (S11). . Next, the continuous length L is initialized to zero, and the stored vertical ruled line candidate position is erased (S12), and thereafter, it is determined whether or not scanning of one current scanning line has been completed (S12). S13). If the scanning of one line of the current scanning line has not been completed (S13), the process returns to S2 to read the next pixel data on the current scanning line. When the scanning of the current scanning line is completed (S13), S9 is performed. If it is determined in S10 that the continuous length L is less than the threshold value TH, S12 to S13 are performed without performing S11.

As described above, the line drawing elements of the horizontal and vertical ruled line patterns are extracted from the form 40 shown in FIG. 2B, and the line drawing elements of these patterns are stored in separate ruled line individual storage areas. As shown in FIG. In FIG. 6A,
Reference numeral 20c denotes a ruled line individual storage area provided for the horizontal ruled line pattern, 20d denotes an area corresponding to the form paper surface 40a in the ruled line individual storage area 20c, and 44b denotes a horizontal ruled line pattern. In FIG. 6B, reference numeral 20e denotes a ruled line individual storage area provided for the vertical ruled line pattern, 20f denotes an area corresponding to the form paper surface 40a in the ruled line individual storage area 20e, and 44c denotes a vertical ruled line pattern.

(Recognition of Form Format) Next, the recognition of the form format performed by the format recognition unit 24 will be described. Here, the format recognition dictionary 22 holds the features of the form standard format previously extracted from the form image data as dictionary data, and the format recognition unit 24 scans the extracted ruled line patterns and displays them in the form of ruled line patterns. The feature of the form to be extracted is extracted, and the extracted feature is compared with the feature of the form standard format to obtain the certainty of the recognition, thereby performing the collation. For example, distance or certainty can be used as the certainty of the recognition.

In creating dictionary data, a plurality of forms having a form standard format (standard form format) are prepared, and for each form, the ruled line is extracted from the form image data in the same manner as the ruled line extracting unit 18. Extract the pattern,
The extracted ruled line pattern is scanned to extract features. Since the extracted features are extracted from the form image data having the form standard format, they are features of the form standard format. The features of the standard form are stored in the format recognition dictionary 22 as dictionary data. The characteristic of the form standard format and the type of the form standard format are stored in association with each other for each type of the form standard format.

In recognizing the form format, form image data of an unknown form format is scanned, and a ruled line pattern is extracted by the ruled line extracting unit 18. Then, the extracted ruled line pattern is scanned to extract features, and the extracted features are collated with the features of the form standard format for each type of the form standard format. For example, the matching is performed using the distance between the feature of the ruled line pattern extracted from the form of unknown form format and the feature of the form standard format as the certainty of recognition. Then, one or more types are selected from the types of the form standard formats stored in the format recognition dictionary 22 based on the certainty of the recognition obtained for each type, and the selected type is used as the recognition result of the form format. Output as For example, the types of the form standard formats are arranged in the order from the one with the highest probability of recognition to the one with the lowest probability of recognition, and n = 1, 2,..., And the probability of the nth recognition and the probability of the (n + 1) th recognition are determined. Investigate the difference, and when the difference is greater than or equal to the threshold,
The type of the form standard format corresponding to the certainty of the recognition up to the recognition is selected as the recognition result.

Alternatively, the format recognition dictionary 22 holds, as dictionary data, ruled line standard patterns representing a form standard format previously extracted from the form image data, and the format recognition section 24 stores the extracted ruled line patterns. The matching may be performed by determining the likelihood of recognition by comparing with a ruled line standard pattern. As the certainty of the recognition, for example, the degree of coincidence or the certainty can be used.

In preparing dictionary data in this case, a plurality of forms having a form standard format are prepared, and for each form, a ruled line pattern is extracted from the form image data in the same manner as the ruled line extracting unit 18. Since this ruled line pattern is extracted from image data of a form having a form standard format, it is a ruled line standard pattern. The ruled line standard pattern is stored in the format recognition dictionary 22 as dictionary data. The ruled line standard pattern and the type of the form standard format are stored in association with each other for each type of the form standard format.

In recognizing the form format, the form image data whose form is unknown is scanned, and a ruled line pattern is extracted by the ruled line extracting unit 18. Then, the extracted ruled line pattern is collated with the ruled line standard pattern for each type of the form standard format. For example, the matching is performed using the degree of matching between a ruled line pattern extracted from a form of unknown form format and a ruled line standard pattern as the certainty of recognition. Then, one or more types are selected from the types of the form standard formats stored in the format recognition dictionary 22 based on the certainty of the recognition obtained for each type, and the selected type is used as the recognition result of the form format. Output as For example, the types of the form standard formats are arranged in the order from the one with the highest probability of recognition to the one with the lowest probability of recognition, and n = 1, 2,..., And the probability of the nth recognition and the probability of the (n + 1) th recognition are determined. Examine the difference,
The type of the form standard format corresponding to the likelihood of the first to n-th recognition when the difference is equal to or larger than the threshold is selected as the recognition result.

(Display of Reference Data) Next, the display performed by the display unit 28 will be described. FIG. 7 is a diagram for explaining the display on the display unit, and shows an example of display performed by the display unit 28 to assist the operator in confirming and determining the recognition result after the recognition result of the form format is obtained. .

In the example of FIG. 7, the display unit 28 displays the form image data 52 of unknown form format read by the control unit 17 from the form image data memory 54 and the reference data 54 corresponding to the recognition result of the image data 52. And the same display screen 2 of the display unit 28
8a are simultaneously displayed. Therefore, since the operator can compare the form image data 52 in the form format with the reference data 54 corresponding to the image data 52, the operator can accurately perform the operation of judging and determining the most likely recognition result.

As the input device 30, a pointing device such as a mouse or a trackball or a keyboard is used.
By operating 0, a signal indicating a recognition result determined to be most probable is input to the control unit 17.

Further, in the example of FIG. 7, the display unit 28
The reference data 54 corresponding to a plurality of recognition results in the form format are displayed in the order of high recognition probability. In this case, the control unit 17 inputs the recognition result of the form format and the probability of recognition of the recognition result from the format recognition unit 28, and sorts the recognition results in descending order of the probability of recognition based on the probability of recognition. Then, the reference data 54 is displayed on the display unit 28 in accordance with the order. The operator can look at the reference data displayed in the order of the probability of recognition in order and compare it with the form image data 52. Therefore, the operator can accurately and quickly determine and determine the most likely recognition result. I can do it.

Further, in the example of FIG. 7, the display unit 28
The read control data is displayed as the reference data 54. Therefore, the read control data memory 14 is used as the reference data memory 26, and the format recognition device 52 shown in FIG. 1 (this device 52 is an embodiment of the format recognition device of claim 1) It includes a format recognition system 12, a display unit 28, an input device 30, a reference data memory 26 (14), and a control unit 17 for controlling the format recognition system 12 and the display unit 28.
The read control data is prepared separately for each type of form format, and the read control data and the type of form format are individually associated with each type of form format in the read control data memory 14 in association with each other. Remember.

As the reference data to be displayed on the display unit 28, for example, read control data (hereinafter, also referred to as first reference data) relating to extraction of a character pattern is used. The read control data related to the extraction of the character pattern includes, for example, form width, form height, number of lines in the form, line position in the form, number of fields in the form, field position in the form,
The number of characters in the line or the field, and the character pitch in the line or the field, and the read control data related to the cutout of these character patterns are distinguished by graphics, symbols, characters, colors, brightness, or combinations thereof. Express and display.

In the illustrated example, a frame representing the outline of the form surrounds the reference data for one form, and the width and height of the form indicate the form width and form height. Lines, fields, rectangles representing characters, the position and number of lines, the position and number of fields, and the number of characters in lines and fields, and furthermore, by the arrangement pitch of the rectangle representing characters,
Represents the character pitch. In addition, an area corresponding to one line, an area corresponding to one field, and an area corresponding to one character are represented by being surrounded by a line having a different line type such as a dotted line, a one-dot chain line, represented by different colors, or represented by luminance. May be represented differently.
Or, one line area, one field area, character 1
The individual area may be represented by being surrounded by a frame having a different outline shape (for example, a line is rectangular, a field is a long and thin ellipse, and a character is a triangle). Alternatively, the number and pitch of characters may be represented by characters and displayed. For example, the number of characters is represented as 5 or the pitch of the characters is 10 mm.

Further, as the reference data to be displayed on the display section 28, the first reference data and the read control data (hereinafter also referred to as second reference data) used for character pattern recognition may be used. good. The second reference data is, for example, a character type or a font of a character described in a form, and the first and second reference data are represented by a graphic,
Symbols, characters, colors, brightness or a combination thereof are displayed and displayed separately, and the second reference data is placed at a position near the display position of the first reference data or at a position overlapping with the display position of the first reference data. indicate. For example, the character type and the font may be represented by a symbol, a character, and a graphic, and a symbol representing the character type and the font may be displayed for each area having a different character type and font. For example, lines and fields in a form
It is represented by a figure such as a rectangular frame and displayed, and the character type and font of the characters described in the lines and fields in the form are represented by colors, and the color of the area surrounded by the lines and fields is represented by the corresponding character type. , And display in a color representing the font. Alternatively, the character types and fonts of the characters described in the lines and fields are represented by colors, and the outlines of the figures representing the lines and fields are displayed as lines of the corresponding character types and fonts. May be. Alternatively, the character type and font of the characters described in the lines and fields are represented by line types, and the outlines of the figures representing the lines and fields are displayed as lines of the corresponding character types and font types. You may do it. Alternatively, the lines and fields in the form are represented by a graphic such as a rectangular frame and displayed.
The character type of the characters described in the lines and fields in the form and the name of the font are displayed in characters and displayed, and in the upper, lower, left or right neighboring positions of the figures representing the lines and fields,
Characters representing character types and font names may be displayed.

Further, the numerical value representing the certainty of the recognition used by the format recognition unit 24 to obtain the recognition result of the form format is associated with the reference data 54 and displayed on the same display screen 28a as the reference data 54. You may do it. As described above, the numerical value representing the certainty of the recognition of the recognition result in the form format and the reference data 54 of the recognition result.
Are displayed simultaneously on the same display screen 28a in association with each other, so that the operator can easily perform the operation of judging and determining the most likely recognition result.

In the illustrated example, the form image data 5
2, a line area, a field area, a description area for one character or a character enlargement / reduction rate, and a figure or reference data representing a line area, a field area, or a description area for one character included in the reference data 54. Although these data 52 and 54 are displayed with different enlargement / reduction ratios of the characters included in 54, the enlargement / reduction ratios may be equalized and displayed in parallel. By displaying these enlargement / reduction rates at the same value, the operator can easily perform the operation of determining and determining the most likely recognition result.

Further, a line area, a field area included in the form image data 52, a description area for one character or a character enlargement / reduction ratio, and a line area, a field area included in the reference data 54, and a description for one character are included. The enlargement / reduction ratio of the figure or character included in the reference data 54 representing the area is made equal, and the data 5 having the same enlargement / reduction ratio is set.
2, 54 may be superimposed and displayed. For example, the left side and the top side of the form from which the form image data 52 is obtained and the left side and the top side of the form represented by the reference data 54 are positioned so as to overlap, and these data 52 and 54 are displayed. By superimposing and displaying in this way,
This makes it easier for the operator to judge and determine the most likely recognition result.

(Character Pattern Recognition) Next, the character recognition unit 38
The character pattern recognition performed by the user will be described. Here, the character recognition dictionary 36 holds the characteristics of the character standard pattern as dictionary data, and the character recognition unit 38 scans the extracted character pattern to extract the characteristics of the extracted character pattern, and extracts the extracted characteristics. The matching is performed by determining the certainty of the recognition by comparing with the features of the character standard pattern. For example, distance or certainty can be used as the certainty of the recognition.

In preparing the dictionary data, a plurality of character standard patterns obtained by optically scanning standard characters are prepared, and the character standard patterns are scanned for each standard character pattern. Is extracted. Then, the feature of the extracted character standard pattern is stored in the character recognition dictionary 36 as dictionary data. The feature of the character standard pattern and the character name are stored individually and in association with each other for each character standard pattern.

In recognizing the character pattern, a character pattern is cut out from the form image data to be read, and the cut character pattern is scanned to extract the characteristics of the cut character pattern. This extracted feature is collated with the feature of the character standard pattern for each character standard pattern. For example, the matching is performed using the distance between the feature of the extracted character pattern and the feature of the character standard pattern as the certainty of recognition. Then, one or a plurality of character names are selected from the character names stored in the character recognition dictionary 36 based on the certainty of the recognition obtained for each character standard pattern, and the selected character names are recognized as character patterns. Output as result.

Alternatively, the character recognition dictionary 36 holds the character standard pattern as dictionary data, and the character recognizing unit 38 compares the cut-out character pattern with the character standard pattern to obtain the certainty of the recognition. You may make it collate.

In creating dictionary data in this case, standard characters are optically scanned to obtain a character standard pattern, and the character standard pattern is stored in the character recognition dictionary 36 as dictionary data. A plurality of character standard patterns are prepared, and the character standard patterns and the character names are stored individually and in association with each other for each character standard pattern.

In recognizing a character pattern, a character pattern is cut out from form image data to be read, and the cut out character pattern is collated with the character standard pattern for each character standard pattern. For example, the matching is performed using the degree of matching between the extracted character pattern and the character standard pattern as the certainty of recognition. Then, one or a plurality of character names are selected from the character names stored in the character recognition dictionary 36 based on the certainty of the recognition obtained for each character standard pattern, and the selected character names are recognized as character patterns. Output as result.

According to this embodiment, even if a form is not described with an identification number indicating the type of the form format (see the form in FIG. 2B), the read control data corresponding to the type of the form format is transmitted. Utilizing it, a character pattern can be cut out and recognized. By using the read control data, processing for extracting and recognizing a character pattern can be performed at high speed. Also, by using the read control data, the processing for extracting and recognizing a character pattern can be simplified, so that the hardware scale or software scale of the apparatus can be reduced.

Since the form image data 52 whose form format is unknown and the reference data 54 corresponding to the recognition result of the data 52 are displayed on the same display screen 28a at the same time, the operator can obtain the most reliable recognition result. Work can be performed accurately.

FIG. 8 is a functional block diagram schematically showing the configuration of the character reading device. The character reading device shown in the figure is an embodiment of the character reading device of claim 9 and includes an embodiment of the format recognition device of claim 1. In the following description, an embodiment of the format recognition apparatus of claim 1 will be described together with an embodiment of the character reading apparatus of claim 9. Hereinafter, points different from the embodiment of FIG. 1 will be described, and detailed description of the same points as the embodiment of FIG. 1 will be omitted.

In this embodiment, the reference data memory 26
The read control data memory 14 is not used as the reference data memory 26. Therefore, the format recognition device 52 includes the format recognition system 12, the display unit 28, the input device 30, the control unit 17, and the format image memory 56 (26).

The format image memory 56 stores, as reference data, image data of a form used for obtaining dictionary data in a form standard format (reference image data) or a form used for obtaining read control data. The image data (reference image data) is held, and the reference data and the form format are individually stored in the format image memory 56 in association with each of the form formats. Let me.

FIG. 9 is a diagram for explaining the display on the display unit. After the recognition result of the form format is obtained, the display unit 28 displays the display to assist the operator in confirming and determining the recognition result. An example is shown. As shown in the figure, instead of the read control data, image data of a form used for obtaining dictionary data in a form standard format or read control data is displayed as the reference data 54.

When the control unit 17 receives the form format recognition result from the format recognition unit 24, the control unit 17 reads out the reference image data corresponding to the input recognition result from the format image memory 56 (26), and reads the display image data.
To be displayed.

Next, the overall operation flow of this embodiment will be described with reference to FIG. S1 to S3 are the same as those in the embodiment of FIG.

Next, the control section 17 reads form image data of a known form format corresponding to the input form format recognition result from the reference data memory 26 (56) as reference data, and displays the read reference data on the display section 28. And the form image data of the unknown form format obtained from the recognition result is read out from the form image memory 54 and displayed on the display unit 28 (S
4) After that, it waits for the input of the format determination signal by the operator (S5).

The operator compares and refers to the reference data and the form image data whose form format is unknown, determines and determines the most probable recognition result, and operates the input device 30 to generate a format determination signal corresponding to the determined result. input.

When the control unit 17 confirms the input of the format determination signal by the operator (S5), it transfers the read control data based on the format determination signal (S6). This transfer is performed between the control unit 17, the read control data memory 14, and the character recognition system 16.

Here, the read control data memory 14 stores read control data relating to character pattern extraction and read control data relating to character pattern recognition, and the control unit 17 is determined by a format determination signal. The read control data corresponding to the recognized result is read out from the read control data memory 14, and the read control data relating to the character pattern cutout is read out by the character cutout unit 32.
And read control data relating to the recognition of the character pattern to the character recognition unit 38. S7 to S10 after S6 are the same as those in the embodiment of FIG.

Even in this embodiment, even if the form does not have the identification number indicating the form format (see the form in FIG. 2B), the read control data corresponding to the form format is used. Thus, character patterns can be cut out and recognized. By using the read control data, processing for extracting and recognizing a character pattern can be performed at high speed. Also, by using the read control data, the processing for extracting and recognizing a character pattern can be simplified, so that the hardware scale or software scale of the apparatus can be reduced.

Further, since the form image data 52 whose form format is unknown and the reference data 54 corresponding to the recognition result of the data 52 are simultaneously displayed on the same display screen 28a, the operator can obtain the most reliable recognition result. Work can be performed accurately.

FIG. 10 is a functional block diagram schematically showing the configuration of the character reading device. The character reading device shown in the figure is an embodiment of the character reading device of claim 9 and includes an embodiment of the format recognition device of claim 1. In the following description, an embodiment of the format recognition apparatus of claim 1 will be described together with an embodiment of the character reading apparatus of claim 9. Hereinafter, points different from the embodiment of FIG. 1 will be described, and detailed description of the same points as the embodiment of FIG. 1 will be omitted.

In this embodiment, the reference data memory 26
The read image data memory 14 and the format image memory 56 are both used as the reference data memory 26. Therefore, the format recognition device 52 includes the format recognition system 12,
It comprises a display unit 28, an input device 30 and a control unit 17, a read control data memory 14 (26) and a format image memory 56 (26).

The format image memory 56 holds, as reference data, image data of a form used for obtaining dictionary data in a form standard format or image data of a form used for obtaining read control data. The reference data and the form format are stored in the format image memory 56 in association with each other for each form format.

The display unit 28 displays, as reference data 54, image data (reference image data) of a form used to obtain dictionary data in the form standard format or read control data in addition to the read control data. The line area, the field area, the description area for one character or the character enlargement / reduction ratio included in the reference image data displayed as the reference data 54, and the reference data 5
A line area included in the read control data displayed as 4;
A field area, a figure representing a description area for one character, or the enlargement / reduction ratio of characters included in the read control data displayed as the reference data 54 are equalized, and the reference image data and the read control as these reference data 54 are set. Display the data superimposed. For example, positioning is performed such that the left side and the upper side of the form from which the reference image data 52 to be displayed as the reference data are obtained and the left side and the upper side of the form represented by the read control data displayed as the reference data 54 overlap. Display image data and read control data. By superimposing and displaying in this way, it is possible to make it easier for the operator to judge and determine the most reliable recognition result. It should be noted that reading control data relating to the extraction of a character pattern is superimposed and displayed as reference data on the reference image data as the reference data 54, or the reference data 5.
It is possible to superimpose read control data relating to character pattern extraction and recognition as reference data on the reference image data as No. 4, and display it.

When the control unit 17 inputs the recognition result of the form format from the format recognition unit 24, the control unit 17 reads out the reference image data corresponding to the input recognition result from the format image memory 56 (26), and reads out the display image data.
The read control data corresponding to the input recognition result is read out from the read control data memory 14 (26) and displayed on the display unit 28.

Next, the overall operation flow of this embodiment will be described with reference to FIG. S1 to S3 are the same as those in the embodiment of FIG.

Next, the control unit 17 reads out the reference image data corresponding to the input form format recognition result from the reference data memory 26 (56) as reference data, and further reads the read image format corresponding to the input form format recognition result. The data is read from the reference data memory 26 (14) as reference data, and the read reference data is superimposed and displayed on the display unit 28. At the same time, the form image data of an unknown form format obtained from the recognition result is recorded on the form. It is read from the image data and displayed on the display unit 28 in parallel with a position different from the reference data (S4). Steps S5 to S10 after S4 are the same as those in the embodiment of FIG.

Even in this embodiment, even if a form does not have an identification number indicating the form format type (see the form in FIG. 2B), read control data corresponding to the form format type is used. Thus, character patterns can be cut out and recognized. By using the read control data, processing for extracting and recognizing a character pattern can be performed at high speed. Also, by using the read control data, the processing for extracting and recognizing a character pattern can be simplified, so that the hardware scale or software scale of the apparatus can be reduced.

Further, since the form image data 52 whose form format is unknown and the reference data 54 corresponding to the recognition result of the data 52 are displayed simultaneously on the same display screen 28a, the operator can recognize the most probable recognition result. Work can be performed accurately.

Next, a modification of the embodiment shown in FIG. 1 will be described. FIG. 11 is a diagram showing the flow of the overall operation of the character reading device of this modification. This modified example has the same configuration as the embodiment of FIG. 1 except for the operation, and therefore, please refer to FIG. 1 as appropriate.

First, form image data is obtained by the scanner 52. The scanner 52 optically scans the paper surface 40a of the form 40, generates form image data composed of quantized electric signals, for example, black and white binary electric signals, and stores the data in the form image memory 54. Here, a line drawing element is represented by a black bit, and a background pixel is represented by a white bit. still,
The line drawing element is a pixel representing a line in the paper surface 40a, and the background pixel is a pixel representing a ground portion (a portion serving as a line background) of the paper surface 40a.

When the form image data is stored in the form image memory 54, the control unit 17 activates the ruled line extraction unit 18 (start).

The activated ruled line extracting unit 18 scans the form image data stored in the form image memory 54, extracts ruled line patterns, and stores the extracted ruled line patterns in the ruled line pattern memory 20 (S1). .

When the ruled line extraction unit 18 finishes extracting the ruled line pattern, the control unit 17 activates the format recognition unit 24.

The activated format recognition unit 24 compares the ruled line pattern stored in the ruled line pattern memory 20 with the form data dictionary data stored in the format recognition dictionary 22 (S2). Based on this, the form format represented by the ruled line pattern is recognized, and this recognition result is output to the control unit 17 (S
3).

The control unit 17 converts the read control data corresponding to the input form format recognition result into reference data memory 26 as reference data of a known form format.
Reading from (14) (S4), after that, the control unit 17
Determines whether or not the recognition result of the input form format is one (S5).

In the case where the result of the form format recognition input in S5 is determined to be plural, the control unit 17
Displays the read control data read as the reference data on the display unit 28, reads the form image data of the unknown form format obtained from the recognition result from the form image memory 54, and displays the read form image data on the display unit 28 (S
6) After that, it waits for the input of the format determination signal by the operator (S7).

The operator compares and refers to the reference data and the form image data of an unknown form format, determines and determines the most probable recognition result, and operates the input device 30 to generate a format determination signal corresponding to the determined result. input.

When the control unit 17 confirms the input of the format determination signal by the operator (S7), it transfers the read control data based on the format determination signal (S8). This transfer is performed between the control unit 17 and the character recognition system 16.

Here, the read control data memory 14 (2
6) stores read control data related to character pattern extraction and read control data related to character pattern recognition, and the control unit 17 controls the read control corresponding to the recognition result determined by the format determination signal. Data is selected from the read control data that has already been read, read control data relating to character pattern cutting out of the selected read control data is sent to the character cutout unit 32, and character pattern is recognized among the selected read control data. The associated read control data is output to the character recognition unit 38.

Next, the control unit 17 activates the character extracting unit 32 and the character recognizing unit 38. Then, the character extraction unit 32
A character pattern is cut out from the form image data in units of one character, and the cut out character pattern is stored in a character pattern memory 34.
(S9). The character recognition unit 38 checks the extracted character pattern against the dictionary data of the character recognition dictionary 36 (S10), recognizes the character pattern based on the comparison result, and outputs the recognition result to the control unit 17 (S11). ).
The control unit 17 inputs a character pattern recognition result for each character, and determines whether or not recognition has been completed for all characters on the form paper surface 40a (S12).

If the recognition of all the characters on the form paper 40a has not been completed, the character extracting unit 32 and the character recognizing unit 38 execute S9 to S9 in accordance with the operation control of the control unit 17.
Step 12 is repeated. When the recognition is completed for all the characters on the form paper 40a, the reading of characters for one form is completed, and the character recognition result obtained for one form is output to the subsequent device (end).

If the result of the determination in S5 is that the recognition result of the form format input is one, the control unit 17 reads the read control data corresponding to the recognition result, which has already been read. The read control data is selected from the control data memory, and the read control data relating to the character pattern cut out of the selected read control data is read by the character cutout unit 3.
2 and the read control data relating to the recognition of the character pattern among the selected read control data is output to the character recognition unit 38 (S13). Thereafter, the control unit 17 activates the character cutout unit 32 and the character recognition unit 38. In this case, S6 ~
S8 is not performed, so that the most probable recognition result is not determined by the operator, and S9 to S1 are not performed.
2 will be performed.

Even in this modification, even if the form does not have an identification number indicating the form format type (see the form in FIG. 2B), the read control data corresponding to the form format type is used. Thus, character patterns can be cut out and recognized. By using the read control data, processing for extracting and recognizing a character pattern can be performed at high speed. Also, by using the read control data, the processing for extracting and recognizing a character pattern can be simplified, so that the hardware scale or software scale of the apparatus can be reduced.

Further, since the form image data 52 whose form format is unknown and the reference data 54 corresponding to the recognition result of the data 52 are displayed simultaneously on the same display screen 28a, the operator can recognize the most probable recognition result. Work can be performed accurately.

When the recognition result of the form format is one, the operator does not make a decision regarding the most probable recognition result, so that the work of the operator can be reduced and the processing time can be shortened. .

Next, a modification of the embodiment of FIG. 8 will be described. FIG. 12 is a diagram showing the overall operation flow of the character reading device of this modification. This modified example has the same configuration as that of the embodiment of FIG. 8 except for the operation, and therefore, please refer to FIG. 8 as appropriate.

First, form image data is obtained by the scanner 52. The scanner 52 optically scans the paper surface 40a of the form 40, generates form image data composed of quantized electric signals, for example, black and white binary electric signals, and stores the data in the form image memory 54. Here, a line drawing element is represented by a black bit, and a background pixel is represented by a white bit. still,
The line drawing element is a pixel representing a line in the paper surface 40a, and the background pixel is a pixel representing a ground portion (a portion serving as a line background) of the paper surface 40a.

When the form image data is stored in the form image memory 54, the control section 17 activates the ruled line extraction section 18 (start).

The activated ruled line extracting unit 18 scans the form image data stored in the form image memory 54, extracts ruled line patterns, and stores the extracted ruled line patterns in the ruled line pattern memory 20 (S1). .

When the ruled line extraction unit 18 finishes extracting the ruled line pattern, the control unit 17 activates the format recognition unit 24.

The activated format recognizing unit 24 checks the ruled line pattern stored in the ruled line pattern memory 20 against the form data dictionary data stored in the format recognition dictionary 22 (S2). Based on this, the form format represented by the ruled line pattern is recognized, and this recognition result is output to the control unit 17 (S
3).

Next, the control unit 17 determines whether or not the recognition result of the input form format is one (S
4).

If the result of the determination in S4 is that the recognition result of the input form format is plural, the control unit 17 determines the image format of the known form format corresponding to the input recognition result of the form format. The data (reference image data) is read from the reference data memory 26 (56) as reference data, the read reference data is displayed on the display unit 28, and the form image data of an unknown form format obtained from the recognition result is converted to the form image. The data is read out from the memory 54 and displayed on the display unit 28 (S5), and thereafter, an input of a format determination signal by the operator is waited (S6).

The operator compares and refers to the reference data and the form image data of an unknown form format, determines and determines the most probable recognition result, operates the input device 30, and generates a format determination signal corresponding to the determined result. input.

When the control unit 17 confirms the input of the format determination signal by the operator (S6), it transfers the read control data based on the format determination signal (S7). This transfer is performed between the control unit 17, the read control data memory 14, and the character recognition system 16.

Here, the read control data memory 14 stores read control data related to character pattern extraction and read control data related to character pattern recognition, and the control unit 17 is determined by a format determination signal. The read control data corresponding to the recognition result is read out from the read control data memory 14, and read control data relating to the character pattern cutting out of the read control data is read to the character cutout unit 32, and read control data is read out of the read control data. The read control data relating to the recognition of the character pattern is output to the character recognition unit 38.

Next, the control unit 17 activates the character extracting unit 32 and the character recognizing unit 38. Then, the character extraction unit 32
A character pattern is cut out from the form image data in units of one character, and the cut out character pattern is stored in a character pattern memory 34.
(S8). The character recognition unit 38 checks the extracted character pattern against the dictionary data of the character recognition dictionary 36 (S9), recognizes the character pattern based on the comparison result, and outputs the recognition result to the control unit 17 (S10). ).
The control unit 17 inputs a character pattern recognition result for each character, and determines whether or not the recognition has been completed for all characters on the form paper surface 40a (S11).

If the recognition of all the characters on the form paper 40a has not been completed, the character extracting unit 32 and the character recognizing unit 38 execute S8 to S8 in accordance with the operation control of the control unit 17.
Step 11 is repeated. When the recognition is completed for all the characters on the form paper 40a, the reading of characters for one form is completed, and the character recognition result obtained for one form is output to the subsequent device (end).

If the result of the determination in S4 is that the recognition result of the form format input is one, the control unit 17 reads the read control data corresponding to the recognition result and reads the read control data memory 14 From the read control data read out to the character cutout unit 32, and read control data related to character pattern recognition among the readout read control data to the character recognition unit 38. Yes (S1
2). Thereafter, the control unit 17 activates the character cutout unit 32 and the character recognition unit 38. In this case, S5 to S7 are not performed, and thus the determination of the most probable recognition result is not performed by the operator, and S8 to S11 are performed.

Even in this modification, even if the form does not have an identification number indicating the form type (see the form in FIG. 2B), the read control data corresponding to the form format is used. Thus, character patterns can be cut out and recognized. By using the read control data, processing for extracting and recognizing a character pattern can be performed at high speed. Also, by using the read control data, the processing for extracting and recognizing a character pattern can be simplified, so that the hardware scale or software scale of the apparatus can be reduced.

Further, since the form image data 52 whose form format is unknown and the reference data 54 corresponding to the recognition result of the data 52 are displayed on the same display screen 28a at the same time, the operator can obtain the most reliable recognition result. Work can be performed accurately.

If the recognition result of the form format is one, the operator does not judge and determine the most probable recognition result, so that the operator's work can be reduced and the processing time can be shortened. .

Next, a modification of the embodiment of FIG. 10 will be described. This modified example has the same configuration as that of the embodiment of FIG. 10 except for the operation, and therefore, please refer to FIG. 10 as appropriate. Hereinafter, the overall operation flow of the character reading device of this modification will be described with reference to FIG.

First, form image data is obtained by the scanner 52. The scanner 52 optically scans the paper surface 40a of the form 40, generates form image data composed of quantized electric signals, for example, black and white binary electric signals, and stores the data in the form image memory 54. Here, a line drawing element is represented by a black bit, and a background pixel is represented by a white bit. still,
The line drawing element is a pixel representing a line in the paper surface 40a, and the background pixel is a pixel representing a ground portion (a portion serving as a line background) of the paper surface 40a.

When the form image data is stored in the form image memory 54, the control unit 17 activates the ruled line extraction unit 18 (start).

The activated ruled line extracting unit 18 scans the form image data stored in the form image memory 54, extracts ruled line patterns, and stores the extracted ruled line patterns in the ruled line pattern memory 20 (S1). .

When the ruled line extraction unit 18 finishes extracting the ruled line pattern, the control unit 17 activates the format recognition unit 24.

The activated format recognizing unit 24 checks the ruled line pattern stored in the ruled line pattern memory 20 against the dictionary data of the form format stored in the format recognition dictionary 22 (S2). Based on this, the form format represented by the ruled line pattern is recognized, and this recognition result is output to the control unit 17 (S
3).

Next, the control unit 17 reads form image data (reference image data) of a known form format corresponding to the input form format recognition result from the reference data memory 26 (56) as reference data, and further inputs the read form image data. Reference data memory 2 using read control data corresponding to the recognition result of the form format as reference data
6 (14) (S4), and thereafter, the control unit 17
Determines whether the recognition result of the input form format is one (S5).

If the determination result that the form format recognition result input in S5 is plural is obtained, the control unit 17
Displays the read control data read as reference data and the form image data in a known form format on the display unit 28, and reads out the form image data in an unknown form format obtained from the recognition result from the form image memory 54. It is displayed on the display unit 28 (S6),
Thereafter, it waits for the input of the format determination signal by the operator (S7).

The operator compares and refers to the reference data and the form image data of an unknown form format, determines and determines the most probable recognition result, and operates the input device 30 to generate a format determination signal corresponding to the determined result. input.

Upon confirming the input of the format determination signal by the operator (S7), the control unit 17 transfers the read control data based on the format determination signal (S8). This transfer is performed between the control unit 17 and the character recognition system 16.

Here, the read control data memory 14 stores read control data relating to character pattern extraction and read control data relating to character pattern recognition, and the control unit 17 is determined by a format determination signal. The read control data corresponding to the recognition result is selected from the read read control data, and the read control data relating to the character pattern cutout among the selected read control data is sent to the character cutout unit 32 and the selected read control data is read out. The read control data relating to the recognition of the character pattern among the data is output to the character recognition unit 38.

Next, the control unit 17 activates the character extracting unit 32 and the character recognizing unit 38. Then, the character extraction unit 32
A character pattern is cut out from the form image data in units of one character, and the cut out character pattern is stored in a character pattern memory 34.
(S9). The character recognition unit 38 checks the extracted character pattern against the dictionary data of the character recognition dictionary 36 (S10), recognizes the character pattern based on the comparison result, and outputs the recognition result to the control unit 17 (S11). ).
The control unit 17 inputs a character pattern recognition result for each character, and determines whether or not recognition has been completed for all characters on the form paper surface 40a (S12).

If the recognition has not been completed for all the characters on the form paper surface 40a, the character cutout unit 32 and the character recognition unit 38 execute S9 to S9 in accordance with the operation control of the control unit 17.
Step 12 is repeated. When the recognition is completed for all the characters on the form paper 40a, the reading of characters for one form is completed, and the character recognition result obtained for one form is output to the subsequent device (end).

If the result of the determination in S5 is that the recognition result of the form format input is one, the control unit 17 reads the read control data corresponding to the recognition result, which has already been read. The read control data is selected from the control data memory, and the read control data relating to the character pattern cut out of the selected read control data is read by the character cutout unit 3.
2 and the read control data relating to the recognition of the character pattern among the selected read control data is output to the character recognition unit 38 (S13). Thereafter, the control unit 17 activates the character cutout unit 32 and the character recognition unit 38. In this case, S6 ~
S8 is not performed, so that the most probable recognition result is not determined by the operator, and S9 to S1 are not performed.
2 will be performed.

Even in this modification, even if the form does not include an identification number indicating the form format (see the form in FIG. 2B), the read control data corresponding to the form format is used. Thus, character patterns can be cut out and recognized. By using the read control data, processing for extracting and recognizing a character pattern can be performed at high speed. Also, by using the read control data, the processing for extracting and recognizing a character pattern can be simplified, so that the hardware scale or software scale of the apparatus can be reduced.

Further, since the form image data 52 whose form format is unknown and the reference data 54 corresponding to the recognition result of the data 52 are simultaneously displayed on the same display screen 28a, the operator can recognize the most probable recognition result. Work can be performed accurately.

When the recognition result of the form format is one, no judgment is made by the operator on the most probable recognition result, so that the operator's work can be reduced and the processing time can be shortened. .

In the above-described embodiment, when the reference data is displayed on the display unit 28, the operator inputs a format determination signal for selecting and instructing a recognition result corresponding to the reference data, and reads the data corresponding to the format determination signal. The character pattern is cut out and recognized based on the control data. However, when the reference data is displayed on the display unit 28, the operator cannot find a satisfactory recognition result among the recognition results corresponding to the reference data. In this case, the operator inputs the form format instructing appropriate read control data to the control unit 17 via the input device 30 as a format decision signal, and outputs a character based on the form format input as the format decision signal. Pattern extraction and recognition may be performed.

Also, in any of the above-described embodiments and modifications, the pressing surface for pressing the form set on the scanner 52 is set to a color converted into a line drawing element, for example, black in the same manner as the line existing in the form, and the form image is formed. Data may be obtained, and a region corresponding to the form paper surface may be detected in the form image data by a well-known image technique related to region detection. The form image data in the area corresponding to the form paper is scanned to detect a ruled line pattern, and the form image data in the area corresponding to the form paper is read from the form image memory 54 and displayed on the display unit 28. It can be displayed on the screen.

[0204]

As is clear from the above description, according to the format recognition apparatus of the first aspect, a ruled line pattern is extracted from form image data, and the extracted ruled line pattern is collated with dictionary data in a form format. Since the form format is recognized, even if the type number indicating the type of the form format is not printed on the form, the form format can be recognized and the type of the form format can be known based on the recognition result.

Further, the display unit displays reference data representing the characteristics of the known form format corresponding to the recognition result of the form format, so that the operator refers to the reference data to determine and determine the most probable recognition result. ,
I can do it accurately.

According to the character reading device of the fourth aspect,
The ruled line pattern is extracted from the form image data, and the extracted ruled line pattern is compared with the dictionary data of the form format to recognize the form format. Therefore, when the type number indicating the type of the form format is not printed on the form. However, the form format can be recognized, the type of the form format can be known based on the recognition result, and the character pattern can be cut out and recognized using the read control data corresponding to the type.

Furthermore, the display unit displays reference data representing the characteristics of the known form format corresponding to the form format recognition result, so that the operator refers to the reference data and determines and determines the most probable recognition result. ,
I can do it accurately.

[Brief description of the drawings]

FIG. 1 is a functional block diagram for explaining a configuration of an embodiment of a character reading device and a format recognition device.

FIGS. 2A and 2B are diagrams for explaining a form.

FIG. 3 is a diagram for describing an operation flow of the embodiment of the character reading device and the format recognition device.

FIG. 4 is a diagram showing a flow of operation of a ruled line extraction unit.

FIG. 5 is a diagram showing an example in which a horizontal ruled line pattern and a vertical ruled line pattern are stored in an overlapping manner.

FIGS. 6A and 6B are diagrams illustrating examples of individually stored horizontal ruled line patterns and vertical ruled line patterns.

FIG. 7 is a diagram provided for explanation of a display on a display unit.

FIG. 8 is a diagram provided for describing a configuration of an embodiment of a character reading device and a format recognition device.

FIG. 9 is a diagram provided for explanation of a display on a display unit.

FIG. 10 is a diagram provided for describing a configuration of an embodiment of a character reading device and a format recognition device.

FIG. 11 is a diagram for describing an operation flow of a modification of the embodiment of the character reading device and the format recognition device.

FIG. 12 is a diagram for describing an operation flow of a modification of the embodiment of the character reading device and the format recognition device.

[Explanation of symbols]

 10: Character reading device 12: Format recognition system 14: Read control data memory 16: Character recognition system 17: Control unit 18: Ruled line extraction unit 20: Ruled line pattern memory 22: Format recognition dictionary 24: Format recognition unit 26: Reference data memory 28: display unit 30: input device 32: character extraction unit 34: character pattern memory 36: character recognition dictionary 38: character recognition unit

────────────────────────────────────────────────── ─── Continuation of the front page (56) References JP-A-6-89365 (JP, A) JP-A-7-254044 (JP, A) JP-A-7-146913 (JP, A) (58) Field (Int.Cl. ⁷ , DB name) G06K 9/00-9/82

Claims (9)

(57) [Claims] 1. A ruled line extraction unit for extracting a ruled line pattern representing a form format from form image data of an unknown form format, a ruled line pattern memory for storing the extracted ruled line pattern, and a format for holding dictionary data in the form format A recognition dictionary, a format recognition unit that checks the extracted ruled line pattern against dictionary data in a form format, and outputs one or a plurality of recognition results for a form format represented by the ruled line pattern based on the matching result; A reference data memory for holding reference data representing characteristics of the form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. When deciding the recognition result of the form format And an input device that outputs a format determination signal corresponding to an input operation of a determination result by an operator, wherein a different type of reference data is used when a figure, a symbol, a character, a color, a luminance, or a combination thereof is different. A format recognizing apparatus characterized in that the format is distinguished and displayed. 2. A ruled line extraction unit for extracting a ruled line pattern representing a form format from form image data of an unknown form format, a ruled line pattern memory for storing the extracted ruled line pattern, and a format for holding dictionary data in the form format A recognition dictionary, a format recognition unit that checks the extracted ruled line pattern against dictionary data in a form format, and outputs one or a plurality of recognition results for a form format represented by the ruled line pattern based on the matching result; A reference data memory for holding reference data representing characteristics of the form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. When deciding the recognition result of the form format A format recognition device comprising: an input device that outputs a format determination signal corresponding to an input operation of a determination result by an operator, wherein a form, a line, and a field represented by a graphic are displayed as reference data. Recognition device. 3. A ruled line extracting unit for extracting a ruled line pattern representing a form format from form image data of an unknown form format, a ruled line pattern memory for storing the extracted ruled line pattern, and a format for holding dictionary data in the form format A recognition dictionary, a format recognition unit that checks the extracted ruled line pattern against dictionary data in a form format, and outputs one or a plurality of recognition results for a form format represented by the ruled line pattern based on the matching result; A reference data memory for holding reference data representing characteristics of the form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. When deciding the recognition result of the form format And an input device for outputting a format determination signal corresponding to an input operation of a determination result by an operator, wherein the reference data is a form width, a form height, the number of lines in the form, a line position in the form. , The number of fields in the form, the field position in the form, the number of characters in the line or field, the character pitch in the line or field, the font of the characters in the line or field, and the characters in the line or field A format recognition device, wherein one or a plurality of reference data selected from character types is used. 4. A ruled line extracting unit for extracting a ruled line pattern representing a form format from form image data of an unknown form format, a ruled line pattern memory for storing the extracted ruled line pattern, and a format for holding dictionary data in the form format A recognition dictionary, a format recognition unit that checks the extracted ruled line pattern against dictionary data in a form format, and outputs one or a plurality of recognition results for a form format represented by the ruled line pattern based on the matching result; A reference data memory for holding reference data representing characteristics of the form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. When deciding the recognition result of the form format And an input device that outputs a format determination signal corresponding to an input operation of a determination result by an operator, wherein the first reference data is the number of lines in the form, the line position in the form,
One or more reference data selected from the number of fields in the form and the field positions in the form, and the second reference data is determined from the font of the characters in the form and the character type of the characters in the form A format characterized by one or more selected reference data, and displaying the second reference data at a position near the display position of the first reference data or at a position overlapping with the display position of the first reference data. Recognition device. 5. A ruled line extraction unit for extracting a ruled line pattern representing a form format from form image data of an unknown form format, a ruled line pattern memory for storing the extracted ruled line pattern, and a format for holding dictionary data in the form format A recognition dictionary, a format recognition unit that checks the extracted ruled line pattern against dictionary data in a form format, and outputs one or a plurality of recognition results for a form format represented by the ruled line pattern based on the matching result; A reference data memory for holding reference data representing characteristics of the form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. When deciding the recognition result of the form format And an input device for outputting a format determination signal corresponding to an input operation of a determination result by an operator, wherein a line represented by a graphic is displayed as first reference data, and a character type of a character in the line is displayed. Alternatively, the font is displayed as second reference data, and the second reference data is displayed at a position near the display position of the first reference data or at a position overlapping with the display position of the first reference data. Format recognition device. 6. A ruled line extraction unit for extracting a ruled line pattern representing a form format from form image data of an unknown form format, a ruled line pattern memory for storing the extracted ruled line pattern, and a format for holding dictionary data in the form format A recognition dictionary, a format recognition unit that checks the extracted ruled line pattern against dictionary data in a form format, and outputs one or a plurality of recognition results for a form format represented by the ruled line pattern based on the matching result; A reference data memory for holding reference data representing characteristics of the form format, a display unit for displaying reference data of a known form format corresponding to the recognition result of the form format, and an operator based on the displayed reference data. When deciding the recognition result of the form format And an input device for outputting a format determination signal corresponding to an input operation of a determination result by an operator, wherein a field represented by a graphic is displayed as first reference data, and a character of a character in the field is displayed. Displaying the type or font as the second reference data, and displaying the second reference data at a position near the display position of the first reference data or at a position overlapping with the display position of the first reference data. Characteristic format recognition device. 7. The form image data of an unknown form format and the reference data corresponding to the image data are displayed in a superimposed manner.
7. The format recognition device according to any one of claims 1 to 6. 8. The format recognition apparatus according to claim 3, wherein reference image data previously obtained from a form with a known form format and the reference data are displayed in a superimposed manner. apparatus. 9. A format recognition system for recognizing a form format, a control data memory for holding read control data, and a character recognition system for recognizing characters in accordance with read control data corresponding to a recognition result of the form format. The character recognition system includes a character extraction unit that extracts a character pattern from the form image data, a character pattern memory that stores the extracted character pattern, a character recognition dictionary that holds dictionary data of the character, and a extracted character. A character recognition unit that matches the pattern with the character dictionary data and recognizes the character pattern based on the result of the matching. A format recognition system is provided for converting a ruled line pattern representing a form format from form image data of an unknown form format. Ruled line extraction unit to be extracted, and a ruled line pattern memory for storing the extracted ruled line pattern A format recognition dictionary holding dictionary data in a form format, and comparing the extracted ruled line pattern with dictionary data in a form format, and performing one or more recognitions on a form format represented by the ruled line pattern based on the matching result. A reference data memory configured to include a format recognizing unit that outputs a result and holding reference data representing characteristics of a known form format; and a display that displays reference data of a known form format corresponding to the recognition result of the form format. And an input device that outputs a format determination signal corresponding to the input operation of the determination result by the operator in the operation of determining the recognition result of the form format based on the displayed reference data by the operator. , Read corresponding to format decision signal A character reading device for performing a character recognition process in accordance with control data, wherein the reference data memory is a control data memory, and the display unit displays reading control data as reference data. apparatus.