JP2011227542A - Form - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a form processing apparatus capable of quickly and accurately specifying a mentioned position of each item in an input image to perform processing in each item even when a form image is input with an image input device such as a camera of which a form photographing state is unstable, and to provide a recording medium.SOLUTION: About a form in which a processing target area is held between a start symbol and an end symbol which express an existing direction and a height of the processing target area surrounded by a fixed unmentioned area, an area symbol detection part detects the start symbol and the end symbol from the input image, an area extraction part extracts the processing target area by using the positions, heights and directions of the start symbol and the end symbol, and a processing part extracts the start symbol and the end symbol of each item from the input image of the form and specifies the mentioned position of each item in the input image by processing contents mentioned in the processing target area in accordance with the sorts of the start symbol and the end symbol to perform processing in each item.

Description

  The present invention relates to a form that indicates the type of information item and the entry position of the contents, and a form processing apparatus and form processing method for processing images after inputting the contents.

  Conventional form processing devices such as OCR, OMR, and various form readers that read characters and symbols written on recording media, detect photos, etc., use timing marks and ruled line information pre-written on forms. Thus, the inclination and scale of the entire form image are detected, and the description position in the input image of each item is specified using layout information registered in advance. FIG. 10A shows an example of a conventional form format.

Japanese Patent Laid-Open No. 5-159099

  However, since the conventional form processing apparatus assumes that the deformation of the input image is within a certain range, such as scanner input, when a form is photographed and input by a camera or the like, as shown in FIG. In addition, the image may be distorted due to a significant rotation of the input image or a shooting depression angle, and the extraction of timing marks and ruled lines may fail to extract item areas.

  Further, when entering the content, if the input character touches the ruled line, it is difficult to distinguish the ruled line from the entered content in the input image, and the ruled line extraction may fail.

  Further, when the entry position in each item is shown, it is difficult to distinguish between the notation indicating the entry position and the entry content in the input image, and the entry content processing may fail.

  The present invention solves the above-mentioned conventional problems, and even when a form image is input by an image input device such as a camera whose image capturing state is unstable, the position of each item in the input image is accurately described at high speed. It is an object of the present invention to provide a form processing apparatus and a recording medium that can identify each item and perform processing for each item.

  In order to solve the above-described conventional problems, the form of the present invention is a form that is handwritten or read by a computer, and the form indicates the height and direction of the reading area and the start position when the form is read by the computer. A symbol and an end symbol indicating the end position of the reading area when read by the computer, the start symbol indicating the direction of the reading area relative to the starting symbol and the height of the reading area.

  Thus, with this configuration, the computer that has read this form extracts the start symbol and end symbol of the item from the read input image, specifies the description position in the input image of each item, and performs the processing for each item. Can be done.

  In the form of the present invention, the processing target area is surrounded by a start symbol, an end symbol, a ruled line, or a non-recording area.

As a result, the computer that has read this form extracts the start symbol, end symbol, and ruled line of the item from the read input image, specifies the description position in the input image of each item, and performs processing for each item. I can do it.

Further, the form of the present invention is composed of an entry sheet and a copy sheet, and the copy sheet is read by a computer, and the start symbol or end symbol of the copy sheet is smaller than the start symbol or end symbol of the entry sheet. .
Thus, when filling in the entry sheet, the start symbol is large, so that it is easy to enter characters and the like. When the copy sheet is read by a computer, the start symbol and the character are separated from each other.

Further, the form of the present invention is composed of an entry sheet and a copy sheet, and the copy sheet is read by a computer, and the entry sheet has the start symbol or the end symbol.
Thereby, it can fill in according to the position of the start symbol or end symbol of an entry sheet.

  Furthermore, the form processing apparatus of the present invention includes an image input unit that inputs an image including a processing target region, and a region that detects a start symbol, an end symbol, and a ruled line as necessary from the input image input by the image input unit. A symbol detection unit, a region extraction unit that extracts a processing target region using the position, height, direction, and type of the start symbol and end symbol detected by the region symbol detection unit, and the processing target region extracted by the region extraction unit Is configured with a processing unit that processes the contents described in the above according to the type of the start symbol and the end symbol, and an output unit that outputs the result of processing by the processing unit.

  With this configuration, it is possible to extract the start symbol and end symbol of an item from the read input image, specify the description position in the input image of each item, and perform processing for each item.

  Further, the form processing method of the present invention includes an image input step for inputting an image including a processing target region, and a region for detecting a start symbol and an end symbol and, if necessary, a ruled line from the input image input in the image input step. A symbol detection step, a region extraction step for extracting a processing target region using the position, height, direction, and type of the start symbol and end symbol detected in the region symbol detection step, and the processing target region extracted in the region extraction step Are processed in accordance with the type of start symbol and end symbol, and an output step for outputting the result processed in the processing step.

  With this configuration, it is possible to extract the start symbol and end symbol of an item from the read input image, specify the description position in the input image of each item, and perform processing for each item.

  Further, the form processing program of the present invention includes an image input step for inputting an image including a processing target region, and a region for detecting a start symbol and an end symbol and, if necessary, a ruled line from the input image input in the image input step. A symbol detection step, a region extraction step for extracting a processing target region using the position, height, direction, and type of the start symbol and end symbol detected in the region symbol detection step, and the processing target region extracted in the region extraction step Are processed in accordance with the type of start symbol and end symbol, and an output step for outputting the result processed in the processing step.

  With this configuration, the computer can extract the start symbol and end symbol of the item from the read input image, specify the description position in the input image of each item, and perform processing for each item.

  Furthermore, the form processing medium of the present invention includes an image input step for inputting an image including a processing target region, and a region for detecting a start symbol and an end symbol and, if necessary, a ruled line from the input image input in the image input step. A symbol detection step, a region extraction step for extracting a processing target region using the position, height, direction, and type of the start symbol and end symbol detected in the region symbol detection step, and the processing target region extracted in the region extraction step Is recorded in accordance with the type of start symbol and end symbol, and a program comprising an output step for outputting the result of processing in the processing step is recorded.

  With this configuration, it is possible to record a program that causes the computer to extract the start symbol and end symbol of an item from the read input image, identify the description position in the input image of each item, and perform processing for each item. I can do it.

  According to the form processing apparatus and the recording medium of the present invention, it is possible to specify an item area simply by extracting a start symbol and an end symbol of an item, and it is possible to cope with fluctuations in an input image at high speed and with high accuracy.

Configuration diagram of a form processing apparatus according to Embodiment 1 of the present invention Control schematic diagram of form processing apparatus in Embodiment 1 of the present invention Configuration diagram of a form according to the first embodiment of the present invention Explanatory drawing of the input form image in Embodiment 1 of this invention Explanatory drawing of the area | region symbol detection part in Embodiment 1 of this invention Explanatory drawing of the area | region extraction part in Embodiment 1 of this invention Explanatory drawing of the area | region extraction part in Embodiment 1 of this invention Explanatory drawing which shows the slip in Embodiment 1 of this invention. Explanatory drawing which shows the slip in Embodiment 1 of this invention. Explanatory drawing of conventional form processing apparatus and recording medium

  Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1)
FIG. 1 is a configuration diagram of a form processing apparatus according to Embodiment 1 of the present invention.

In FIG. 1, an image input unit 101 inputs an image including a processing target area.
An area symbol detection unit 102 detects a start symbol, an end symbol, and a ruled line as necessary from the input image input by the image input unit 101.

  Reference numeral 103 denotes a region extraction unit that extracts a processing target region using the position, height, direction, and type of the start symbol and end symbol detected by the region symbol detection unit 102. A processing unit 104 processes the contents described in the processing target area extracted by the area extracting unit 103 according to the type of start symbol and end symbol. Reference numeral 105 denotes an output unit that outputs a result processed by the processing unit 104.

  Note that the functional blocks such as the image input unit, the region symbol detection unit, the region extraction unit, and the processing unit may be typically realized as an LSI that is an integrated circuit. The method of circuit integration is not limited to LSI. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them.

FIG. 2 is a control schematic diagram of the form processing apparatus according to Embodiment 1 of the present invention. In an image input step S101, an image including a processing target area is input, and the process proceeds to S102. In area symbol detection step S102, a start symbol, an end symbol, and a ruled line are detected from the input image, and the position, height, direction, and type of the start symbol and end symbol are detected, and the process proceeds to S103.

  In region symbol verification step S103, the shape, combination, and positional relationship of the start symbol, the end symbol, and the ruled line are verified. If not, the process proceeds to S101, and if possible, the process proceeds to S104. In the region image extraction step S104, the processing target region image is extracted. If the processing target region image has been deformed, the process proceeds to S105, and if not, the process proceeds to S106, S107, S108 depending on the item.

  In the region image correction step S105, the processing target region image is corrected, and the process proceeds to S106, S107, and S108 depending on the item.

  In the character recognition step S106, a character recognition process is performed on the processing target area image, and the process proceeds to S109. In the symbol recognition step S107, a symbol recognition process is performed on the processing target region image, and the process proceeds to S109.

In the image storage step S108, the processing target area image is converted into image data, and the process proceeds to S109. In the output step S109, the results processed in the character recognition step S106, the symbol recognition step S107, and the image storage step S108 are output.
Each step may be described by a program that can be executed by a computer.

FIG. 3 is a configuration diagram of the form in the first embodiment of the present invention. It consists of an entry sheet (FIG. 3 (a)) and a copy sheet (FIG. 3 (b)) and satisfies the following conditions.
The processing target area is surrounded by a start symbol, an end symbol, and a ruled line.
-The start symbol and the end symbol are surrounded by a certain undescribed region (white or background color).
The start symbol and the end symbol express the existence direction and height of the processing target area.
-The shape of the start symbol and end symbol differs depending on the processing content in the item column.
-The entry sheet shows the entry position in the processing target area and is not described on the copy sheet.
-Provide a certain unrecorded area between the start symbol, end symbol, entry position, and ruled line.
-The copy sheet start and end symbols are smaller than the corresponding entry sheet start and end symbols.

  For packaged items with slips, the entry sheet is kept at the client, and the contents are read at the collection / delivery place with only the copy sheet attached. Hereinafter, the details of the operation will be described by taking the input image of the copy sheet C of the form A shown in FIG. 4 as an example. When the copy sheet C is photographed by the camera in the image input unit 101, the image is input with the inclination θ degree and the resolution Ddpi as shown in FIG.

  The region symbol detection unit 102 extracts a connected closed region of the input image, performs shape matching with the start symbol and end symbol registered in advance as shown in FIG. Detect the position, height, direction, and type of symbols and end symbols. The detection result is shown in FIG.

  The start symbols LS1, LS2, and LS3 and the end symbols LE1, LE2, and LE3 were detected. In the copy sheet, since the start symbol and the end symbol are written smaller than the entry sheet, it is easy to detect as a connected closed region.

  In the area extraction unit 103, as shown in FIG. 6A, the form layout of the copy sheet C is registered in advance.

In the form layout, for each item, the processing content, the shape of the start / end symbol, the size of the processing area,
The entry position in the processing area is registered. With respect to the start symbol extracted by the region symbol extraction unit 102, an end symbol that is paired with the direction of the start symbol is specified. If it cannot be specified, the process returns to the processing of the image input unit 102.

  It is verified that LS1 and LE1, LS2 and LE2, LS3 and LE3 are a pair, and if the pair of start symbol and end symbol is known, the position of the processing target area is determined from the position, height and direction of the start symbol and end symbol. And cut out. FIG. 6B shows the result of specifying the position of the processing target area L1 of the start / end symbol pair LS1 and LE1.

Next, an angle correction method when the copy sheet C is read obliquely will be described. The inclination θ and the resolution D of the processing target area image can be obtained by the expressions shown in FIGS. 8 cm in FIG. 7B is the horizontal width of the postal area size stored in the form layout in FIG. Even if the start / end symbol of the pair can be detected, if the resolution is too low or too high, it is impossible to return to the processing of the image input unit 102. When the slope θ has a value, the processing target area image is rotationally corrected. FIG. 7C shows the processing target area image extracted.

The processing unit 104 performs processing corresponding to the item indicated by the start symbol for each extracted processing target region image. Since the processing target region image L1 shown in FIG. 7C is a zip code item from the form layout shown in FIG. 6A, the character image is used by using the information on the character description position in the registered item. To recognize characters.

Further, in the case of a selected symbol item, the selected symbol is identified using information on the symbol description position in the registered item. The output unit 105 outputs the processing results of these processing units 104.

  According to such a configuration, the start symbol and the end symbol are described in the processing target area of the form, and the start symbol and the end symbol of the item are extracted from the input image of the form by providing the area processing unit in the form processing apparatus. Since the position of each item in the input image is specified and processing is performed for each item, even when a form image is input with an image input device such as a camera where the form photographing state is unstable, each item is accurately processed at high speed. Processing for each item can be performed.

  Further, the effect of changing the size of the start symbol or the like between the entry sheet and the copy sheet will be described with reference to FIG. FIG. 8A shows an entry sheet on which an entry frame (solid line) is printed together with a start symbol and the like.

  FIG. 8B shows a copy sheet. Since the copy sheet (b) is directly below the entry sheet, the entry frame (solid line) of the entry sheet is at the position of the dotted line on the copy sheet. Actually, the dotted line is not printed.

  When “a” is entered so as to cover the character entry frame (solid line) of the entry sheet (a), “a” is copied to the position of FIG. 8B on the copy sheet.

  At this time, in the copy sheet, the start symbol is smaller than the start symbol of the entry sheet and is printed away from the entry frame, so that the entered character does not cover the start symbol. For this reason, character recognition can be performed easily.

  Furthermore, the case where the character in the start symbol of an entry sheet and a copy sheet is printed is described with reference to FIG. In FIG. 9, as shown in the entry sheet (a), the start symbol has a postal mark, but is not printed on the copy sheet (b).

  For this reason, when printing on an entry sheet, the user can grasp the contents of entry, and when reading a copy sheet with a computer, since there is no symbol, it is easy to detect the start symbol by image processing. .

  In the present embodiment, the copy sheet is the processing target, but the entry sheet may be the target. When the entry sheet is a processing target and the entry sheet is input as an image, a process of deleting the image at the entry position indicated by using the entry position information in the item may be added.

The start / end symbols, ruled lines, and notation indicating the entry position may be printed in different colors.
The shape of the start / end symbol is not limited to this. A plurality of start / end symbols may be arranged at the outer peripheral position of the processing target region in order to cope with a case where the processing target region has a complicated shape.

The form, form processing apparatus, and form processing method according to the present invention are:
It has a high-speed and high-performance image processing function and is useful as an image processing method.
In addition, it has a rapid information data conversion function, and is useful as a method for creating an information database.

DESCRIPTION OF SYMBOLS 101 Image input part 102 Area | region symbol detection part 103 Area | region extraction part 104 Processing part 105 Output part

Form of the present invention is constituted by entry sheet and the copy sheet, a form in which a copy sheet is read by the computer, the entry sheet and the copy sheet, the height and direction of the reading area when read in calculation machine has a terminator indicating the end position of the reading area when read start symbol and computer indicating a start position, the start symbol is indicates the height direction and the reading region of the reading area with respect to the start symbol, The copy sheet start symbol or end symbol is smaller than the entry sheet start symbol or end symbol .

Claims (8)

A form that is handwritten or read by a computer,
The form is
Having a start symbol indicating the height and direction of the reading area when read by a computer and a start position and an end symbol indicating the end position of the reading area when read by a computer;
The form wherein the start symbol indicates a direction of the reading area with respect to the start symbol and a height of the reading area. The form according to claim 1, wherein the processing target area is surrounded by a start symbol, an end symbol, a ruled line, or an undescribed region. A form composed of an entry sheet and a copy sheet, the copy sheet being read by a computer,
2. The form according to claim 1, wherein a start symbol or an end symbol of the copy sheet is smaller than a start symbol or an end symbol of the entry sheet. A form composed of an entry sheet and a copy sheet, the copy sheet being read by a computer,
The form according to claim 1, wherein the entry sheet has the start symbol or the end symbol. An image input unit for inputting an image including the processing target area;
From the input image input in the image input unit, a region symbol detection unit that detects a start symbol and an end symbol and a ruled line as necessary,
A region extraction unit that extracts a processing target region using the position, height, direction, and type of the start symbol and end symbol detected by the region symbol detection unit;
A processing unit that processes the contents described in the processing target region extracted by the region extraction unit according to the type of start symbol and end symbol;
An output unit for outputting a result processed by the processing unit;
A form processing apparatus. An image input step for inputting an image including the processing target area;
From the input image input in the image input step, a region symbol detection step of detecting a start symbol and an end symbol and a ruled line as necessary,
A region extraction step for extracting a processing target region using the position, height, direction, and type of the start symbol and end symbol detected in the region symbol detection step;
A processing step of processing the contents described in the processing target region extracted in the region extraction step according to the type of start symbol and end symbol;
An output step for outputting a result processed in the processing step;
A form processing method comprising:   A program in which the form processing method according to claim 6 is described so as to be executable by a computer.   A recording medium on which a program in which the form processing method according to claim 6 is described so as to be executable by a computer is recorded.

Images