WO2011129113A1 - Form processing device, form processing method, and recording medium - Google Patents

Form processing device, form processing method, and recording medium Download PDF

Info

Publication number
WO2011129113A1
WO2011129113A1 PCT/JP2011/002194 JP2011002194W WO2011129113A1 WO 2011129113 A1 WO2011129113 A1 WO 2011129113A1 JP 2011002194 W JP2011002194 W JP 2011002194W WO 2011129113 A1 WO2011129113 A1 WO 2011129113A1
Authority
WO
WIPO (PCT)
Prior art keywords
processing
unit
barcode
image
region
Prior art date
Application number
PCT/JP2011/002194
Other languages
French (fr)
Japanese (ja)
Inventor
磨理子 竹之内
穂 高倉
Original Assignee
パナソニック株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニック株式会社 filed Critical パナソニック株式会社
Priority to CN2011800168219A priority Critical patent/CN102834836A/en
Publication of WO2011129113A1 publication Critical patent/WO2011129113A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • G06V10/225—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on a marking or identifier characterising the area

Definitions

  • the present invention relates to a form processing apparatus, a form processing method, and a recording medium for inputting and processing a form filled with images.
  • the conventional form processing apparatus assumes that the deformation of the input image is within a certain range, such as scanner input, when the form is photographed and input by a camera or the like, as shown in FIG. In some cases, the image area was not able to be extracted due to the failure to extract timing marks or ruled lines due to image rotation caused by image rotation or shooting depression.
  • each item such as OCR has a certain processing time, and it took time to conclude whether or not the processing such as OCR was successful.
  • the present invention solves the above-mentioned conventional problems, and even when a form image is input by an image input device such as a camera whose image capturing state is unstable, the position of each item in the input image is accurately described at high speed. It is an object of the present invention to provide a form processing apparatus and a form processing method that can identify each item and perform processing for each item.
  • the form processing apparatus of the present invention includes an image input unit that inputs an image including a barcode region and a processing target region, and a barcode region from the input image input by the image input unit.
  • a barcode recognition unit that extracts and decodes, a verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit, and extracts a processing target region from the input image input by the image input unit.
  • the quality of the processing target area is verified from the processing result of the barcode recognition unit, and when the quality is poor, the process of re-reading is performed.
  • the description position in the input image of each item can be specified, and processing for each item with a barcode can be performed.
  • the form processing apparatus of the present invention includes an image input unit that inputs an image including a barcode region and a processing target region, and barcode recognition that extracts and decodes the barcode region from the input image input by the image input unit.
  • a barcode that is extracted by the barcode recognition unit, the verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit, and the relative positional relationship between the barcode region and the processing target region A processing region extraction unit that identifies a position of the processing target region from the position of the region and extracts a processing target region image, a processing unit that processes the processing region image extracted by the processing region extraction unit, and a barcode recognition unit A recognition result; a verification result of the verification unit; an extraction result of the processing region extraction unit; and an output unit that outputs the processing result of the processing unit.
  • the position of the processing area is specified from the position of the barcode area, and if it is outside the input image, the image can be input again without performing the processing of the processing section.
  • the form processing system of the present invention includes an image input unit that inputs an image including a barcode region and a processing target region, and barcode recognition that extracts and decodes the barcode region from the input image input by the image input unit.
  • a processing region extraction unit that identifies the position of the processing target region from the region position and extracts the processing target region image, the recognition result of the barcode recognition unit, and the processing target region image extracted by the processing region extraction unit are output
  • a, and form the item processing apparatus having a, a processing unit for processing the processing target area image input.
  • the output unit includes a display unit, and when the verification result of the verification unit is an error, when the position specifying result of the processing region extraction unit is an error, an error is displayed on the display unit. The information is displayed, and the process automatically proceeds to the image input unit.
  • This configuration enables the operator to grasp the problem of the shooting operation and to immediately correct the shooting method.
  • the output unit includes a display unit, and when the verification result of the verification unit is an error, when the position specifying result of the processing region extraction unit is an error, an error is displayed on the display unit. Information is displayed, and the process proceeds to the image input unit upon activation of the operator.
  • This configuration enables the operator to grasp the problem of the shooting operation and to immediately correct the shooting method.
  • the form processing method of the present invention includes an image input step for inputting an image including a barcode region and a processing target region, and barcode recognition for extracting and decoding the barcode region from the input image input in the image input step.
  • a verification step for verifying the quality of the processing target region image based on the processing result of the barcode recognition step, a relative positional relationship between the barcode region and the processing target region, and the barcode extracted in the barcode recognition step
  • a processing region extraction step for extracting a processing target region image by specifying a position of the processing target region from the region position, a processing step for processing the processing region image extracted in the processing region extraction step, and the barcode recognition step.
  • a recognition result, a verification result of the verification step, an extraction result of the processing region extraction step, and the It has an output step of outputting the processing result of the physical step.
  • the form processing program of the present invention includes an image input step for inputting an image including a barcode region and a processing target region, and barcode recognition for extracting and decoding the barcode region from the input image input in the image input step.
  • a verification step for verifying the quality of the processing target region image based on the processing result of the barcode recognition step, a relative positional relationship between the barcode region and the processing target region, and the barcode extracted in the barcode recognition step
  • a processing region extraction step for extracting a processing target region image by specifying a position of the processing target region from the region position, a processing step for processing the processing region image extracted in the processing region extraction step, and the barcode recognition step.
  • the computer can determine the image quality of the processing target area from the processing result of the barcode recognition step, and if it is not possible, the computer can input the image again without performing the processing of the processing step.
  • the position of the processing area is specified from the position of the code area, and if it is outside the input image, the image can be input again without performing the processing step.
  • the form processing medium of the present invention includes an image input step for inputting an image including a barcode region and a processing target region, and barcode recognition for extracting and decoding the barcode region from the input image input in the image input step.
  • a verification step for verifying the quality of the processing target region image based on the processing result of the barcode recognition step, a relative positional relationship between the barcode region and the processing target region, and the barcode extracted in the barcode recognition step
  • a processing region extraction step for extracting a processing target region image by specifying a position of the processing target region from the region position, a processing step for processing the processing region image extracted in the processing region extraction step, and the barcode recognition step.
  • the computer can determine the image quality of the processing target area from the processing result of the barcode recognition step, and if it is not possible, the computer can input the image again without performing the processing of the processing step. It is possible to record a program for specifying the position of the processing area from the position of the code area and, if it is outside the input image, causing the image to be input again without performing the processing step.
  • This configuration identifies the position of each item in the input image from the position of the barcode area and performs processing.
  • the quality of each item image is verified from the processing result of the barcode recognition unit, and if it is not possible, the processing of each item is not performed and the process returns to the image input processing.
  • the position of each item in the input image can be specified from the position of the barcode area, and the quality of each item image is verified from the processing result of the barcode recognition unit. It can respond to fluctuations in the input image at high speed and with high accuracy.
  • FIG. 1 is a configuration diagram of a form processing apparatus according to Embodiment 1 of the present invention.
  • an image input unit 101 inputs an image including a barcode area and a processing target area.
  • a processing area extraction unit 104 stores the relative positional relationship between the barcode area and the processing target area, specifies the position of the processing target area from the position of the barcode area extracted by the barcode recognition unit 102, and processes the processing target area. Extract images.
  • a processing unit 105 processes the processing region image extracted by the processing region extraction unit 104.
  • An output unit 106 outputs the recognition result of the barcode recognition unit 102, the verification result of the verification unit 103, the extraction result of the processing region extraction unit 104, and the processing result of the processing unit 105.
  • each functional block such as an image input unit, a barcode recognition unit, a verification unit, a processing region extraction unit, and a processing unit may be realized as an LSI that is typically an integrated circuit.
  • the method of circuit integration is not limited to LSI. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them.
  • FIG. 2 is a control schematic diagram of the form processing apparatus according to Embodiment 1 of the present invention.
  • an image input step S101 an image including a barcode area and a processing target area is input, and the process proceeds to S102.
  • bar code recognition step S102 a bar code area is extracted from the input image input in image input step S101 and decoded, and the process proceeds to S103.
  • verification step S103 the quality of the processing target area image is verified by the processing result of the barcode recognition step S102. If it is not possible, the process proceeds to S101, and if it is possible, the process proceeds to S104.
  • the position of the processing target area is specified from the position of the barcode area extracted in the barcode recognition step S102 using the relative positional relationship between the barcode area and the processing target area stored in advance. Whether the position of the processing target area is specified outside the input image is verified. If it is not possible, the process proceeds to S101, and if it is possible, the process proceeds to S105.
  • the processing target region image is extracted from the input image using the position of the processing target region specified in the processing region specifying step S104, and the scale or deformation of the extracted processing target region image or the image quality is verified. If necessary, the process target area image is corrected in area image correction step S106 and the process proceeds to S107. If not necessary, the process proceeds to S107 without correction.
  • the character recognition processing is performed on the processing target region image extracted in the region image extraction step S105 or the processing target region correction image corrected in the region image correction step S106, and the process proceeds to S108.
  • the result output step S108 outputs the barcode recognition result of the barcode recognition step S102 and the character recognition result of the character recognition step S107.
  • each step may be described by a program executable by a computer.
  • the barcode recognition unit 102 extracts a barcode area by a known method and performs barcode recognition.
  • FIG. 4A shows the barcode extraction result.
  • One-dimensional barcode B1 and two-dimensional barcode B2 could be extracted.
  • the recognition result of the barcode B1 was “a12345567890a”.
  • the four corner positions of the barcode B1 were points (XB1ST, YB1ST) (XB1ET, YB1ET) (XB1EB, YB1EB) (XB1SB, YB1SB).
  • the verification unit 103 verifies the quality of the processing target area image based on the processing result of the barcode recognition unit 102. If the recognition result of the barcode B1 is not obtained, it is determined that the processing of the processing target area is difficult.
  • the rotation angle ⁇ and the resolution D of the barcode area are obtained from the four positions of the barcode B1, and the resolution D is too large or too small than a certain value.
  • the resolution D is too large or too small than a certain value.
  • the rotation angle ⁇ is too large, the image may be disturbed by the rotation, so that the process target area cannot be deformed.
  • the shape of the one-dimensional barcode B1 or the two-dimensional barcode B2 is not a rectangle or a square, the image input unit 101 is not directed in a straight direction with respect to the form A, but is considered to be inclined. Therefore, it is impossible to deform the processing target area.
  • 6 cm is an actual measurement value of the lateral width of the barcode B1 area registered in advance.
  • the degree of deformation of the barcode area may be determined from the degree of rectangle of the four corner position coordinates of the barcode B1, and the deformation of the processing target area may be determined. It is also possible to determine the quality of the processing target region image by examining the contrast of the image of the barcode B1.
  • the verification unit 103 verifies the quality of the processing target region image with respect to the above verification items.
  • the processing area extraction unit 104 stores the relative positional relationship between the barcode area and the processing target area in advance, and calculates the four corner positions of the barcode area extracted by the barcode recognition unit 102.
  • the position of the processing target region is specified by the equations (1) and (2) shown in FIG.
  • FIG. 8A shows the image extraction result of the processing target area L1. Since the processing target area L1 is inclined by ⁇ degrees, the image shown in FIG.
  • the processing unit 105 performs processing corresponding to the item content of the processing target area registered in advance in FIG.
  • the processing target area L1 is “item: mail”, and character recognition is performed by a known method.
  • the processing target area L1 is “123-4567”.
  • the output unit 106 outputs the barcode B1 recognition result “a12345567890a” and the character recognition result “123-4567” of the processing target area L1.
  • the image quality of the processing target region is determined from the processing result of the barcode recognition unit.
  • the image can be input again without performing the operation.
  • the position of the processing area is specified from the position of the barcode area, and if it is outside the input image, the image can be input again without performing the processing of the processing section.
  • FIG. 9 is a configuration diagram of the form processing system according to the second embodiment of the present invention. 9, the same reference numerals are used for the same components as in FIG.
  • an image input unit 101 inputs an image including a barcode area and a processing target area.
  • Reference numeral 102 denotes a barcode recognition unit that extracts and decodes a barcode region from an input image input by the image input unit 101.
  • Reference numeral 103 denotes a verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit 102.
  • a processing area extraction unit 104 stores the relative positional relationship between the barcode area and the processing target area, specifies the position of the processing target area from the position of the barcode area extracted by the barcode recognition unit 102, and processes the processing target area. Extract images.
  • An item information output unit 107 outputs the recognition result of the barcode recognition unit 102 and the processing target region image extracted by the processing region extraction unit 104.
  • a form processing apparatus 1001 includes an image input unit 101, a barcode recognition unit 102, a verification unit 103, a processing area extraction unit 104, and an item information output unit 107.
  • An item information input unit 108 inputs the item information output by the item information output unit 107.
  • Reference numeral 105 denotes a processing unit that processes the processing target region image of the item information input by the item information input unit 108.
  • Reference numeral 106 denotes an output unit that outputs the barcode recognition result of the item information input by the item information input unit 108 and the processing result of the processing unit 105.
  • a form item processing apparatus 1002 includes an item information input unit 108, a processing unit 105, and an output unit 106.
  • a form processing system 1000 includes a form item processing apparatus 1002 and a form processing apparatus 1001.
  • the item information output unit has a display means.
  • the verification result of the verification section is an error
  • the position specifying result of the processing region extraction section is an error
  • the error information is displayed on the display means and image input is automatically performed. May proceed to the processing of the part.
  • the item information output unit has a display means, and when the verification result of the verification section is an error, when the position specifying result of the processing region extraction section is an error, the error information is displayed on the display means, and the operator starts You may progress to the process of an image input part.
  • the processing target area image is output from the item information output unit of the form processing apparatus
  • the item information output unit outputs the input image and the position of the processing target area in the input image
  • the processing unit of the form item processing apparatus may be extracted from the input image and processed.
  • a storage unit may be provided in the form processing apparatus to store the processing target area image, and the processing target area image stored in the form item processing apparatus may be input via the communication means or the storage medium.
  • the form processing apparatus and form processing method according to the present invention have a high-speed and high-performance image processing function and are useful as an image processing method. In addition, it has a rapid information data conversion function, and is useful as a method for creating an information database.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Character Input (AREA)
  • Character Discrimination (AREA)

Abstract

Disclosed is a form processing device and a form processing method that can process each item precisely and at high speed, even when form images have been input using an image input device such as a camera whereby the form image capture conditions are unstable. A barcode recognition unit extracts and decodes a barcode region from an input image; a verification unit verifies the quality of the target region image for processing, by using the processing results from the barcode recognition unit; and a processing region extraction unit identifies the position of the target processing region from the position of the barcode region and extracts the target region image for processing; thereby verifying the quality of each item image, identifying the position where each item is written within the input image, and processing each item precisely and at high speed.

Description

帳票処理装置及び帳票処理方法及び記録媒体Form processing apparatus, form processing method, and recording medium
　本発明は、内容が記入された帳票を画像入力して処理する帳票処理装置及び帳票処理方法及び記録媒体に関するものである。 The present invention relates to a form processing apparatus, a form processing method, and a recording medium for inputting and processing a form filled with images.
　従来の帳票処理装置である、記録媒体に記載されている文字や記号の読取、写真検出等を行うＯＣＲやＯＭＲ、各種帳票リーダーでは、帳票に予め記載されているタイミングマークや罫線情報を利用して帳票画像全体の傾きや縮尺を検出し、予め登録されているレイアウト情報を用いて、各項目の入力画像内の記載位置を特定していた。 Conventional form processing devices such as OCR, OMR, and various form readers that read characters and symbols written on recording media, detect photos, etc., use timing marks and ruled line information previously written on the form. Thus, the inclination and scale of the entire form image are detected, and the description position in the input image of each item is specified using layout information registered in advance.
日本国特開平５－１５９０９９号公報Japanese Patent Laid-Open No. 5-159099
　しかしながら、従来の帳票処理装置は、スキャナ入力等、入力画像の変形が一定の範囲に収まるものを想定していたため、カメラ等で帳票を撮影して画像入力すると、図１０に示すように、入力画像の大幅な回転や撮影俯角による画像の歪みが発生し、タイミングマークや罫線の抽出に失敗して項目領域を抽出できない場合があった。 However, since the conventional form processing apparatus assumes that the deformation of the input image is within a certain range, such as scanner input, when the form is photographed and input by a camera or the like, as shown in FIG. In some cases, the image area was not able to be extracted due to the failure to extract timing marks or ruled lines due to image rotation caused by image rotation or shooting depression.
　また、各項目のＯＣＲ等の処理には一定の処理時間を有し、ＯＣＲ等の処理が成功したか否かの結論を得るのに時間がかかった。 Also, the processing of each item such as OCR has a certain processing time, and it took time to conclude whether or not the processing such as OCR was successful.
　本発明は、前記従来の課題を解決するもので、カメラ等の帳票撮影状態が不安定な画像入力装置で帳票画像を入力した場合でも、高速に精度良く、各項目の入力画像内の記載位置を特定し、各項目毎の処理を行うことができる帳票処理装置及び帳票処理方法を提供することを目的とする。 The present invention solves the above-mentioned conventional problems, and even when a form image is input by an image input device such as a camera whose image capturing state is unstable, the position of each item in the input image is accurately described at high speed. It is an object of the present invention to provide a form processing apparatus and a form processing method that can identify each item and perform processing for each item.
　前記従来の課題を解決するために、本発明の帳票処理装置は、バーコード領域と処理対象領域を含む画像を入力する画像入力部と、前記画像入力部で入力した入力画像からバーコード領域を抽出してデコードするバーコード認識部と、前記バーコード認識部の処理結果で処理対象領域画像の品質を検証する検証部と、前記画像入力部で入力した入力画像から処理対象領域を抽出して処理する処理部と、前記バーコード認識部の認識結果と、前記検証部の検証結果と、前記処理部の処理結果を出力する出力部と、を有している。 In order to solve the conventional problem, the form processing apparatus of the present invention includes an image input unit that inputs an image including a barcode region and a processing target region, and a barcode region from the input image input by the image input unit. A barcode recognition unit that extracts and decodes, a verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit, and extracts a processing target region from the input image input by the image input unit. A processing unit for processing; a recognition result of the barcode recognition unit; a verification result of the verification unit; and an output unit for outputting the processing result of the processing unit.
　この構成により、バーコード認識部の処理結果から、処理対象領域の品質を検証して、品質が悪いとき、再度読み込む処理を行うので、１枚の入力画像から、高速に精度良く、バーコード及び各項目の入力画像内の記載位置を特定し、バーコードと各項目毎の処理を行うことができる。 With this configuration, the quality of the processing target area is verified from the processing result of the barcode recognition unit, and when the quality is poor, the process of re-reading is performed. The description position in the input image of each item can be specified, and processing for each item with a barcode can be performed.
　さらに、本発明の帳票処理装置は、バーコード領域と処理対象領域を含む画像を入力する画像入力部と、前記画像入力部で入力した入力画像からバーコード領域を抽出してデコードするバーコード認識部と、前記バーコード認識部の処理結果で処理対象領域画像の品質を検証する検証部と、バーコード領域と処理対象領域の相対位置関係を記憶し、前記バーコード認識部で抽出したバーコード領域の位置から処理対象領域の位置を特定して処理
対象領域画像を抽出する処理領域抽出部と、前記処理領域抽出部で抽出した処理領域画像を処理する処理部と、前記バーコード認識部の認識結果と、前記検証部の検証結果と、前記処理領域抽出部の抽出結果と、前記処理部の処理結果を出力する出力部と、を有している。 Further, the form processing apparatus of the present invention includes an image input unit that inputs an image including a barcode region and a processing target region, and barcode recognition that extracts and decodes the barcode region from the input image input by the image input unit. A barcode that is extracted by the barcode recognition unit, the verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit, and the relative positional relationship between the barcode region and the processing target region A processing region extraction unit that identifies a position of the processing target region from the position of the region and extracts a processing target region image, a processing unit that processes the processing region image extracted by the processing region extraction unit, and a barcode recognition unit A recognition result; a verification result of the verification unit; an extraction result of the processing region extraction unit; and an output unit that outputs the processing result of the processing unit.
　この構成により、バーコード認識部の処理結果から処理対象領域の画像品質を判断し、不可の場合は、処理部の処理を行うことなく、再度画像入力を行うことができる。 With this configuration, it is possible to determine the image quality of the processing target region from the processing result of the barcode recognition unit, and when it is not possible, the image can be input again without performing the processing of the processing unit.
　また、バーコード領域の位置から処理領域の位置を特定し、入力画像外の場合は、処理部の処理を行うことなく、再度画像入力を行うことができる。 Also, the position of the processing area is specified from the position of the barcode area, and if it is outside the input image, the image can be input again without performing the processing of the processing section.
　さらに、本発明の帳票処理システムは、バーコード領域と処理対象領域を含む画像を入力する画像入力部と、前記画像入力部で入力した入力画像からバーコード領域を抽出してデコードするバーコード認識部と、前記バーコード認識部の処理結果で処理対象領域画像の品質を検証する検証部と、バーコード領域と処理対象領域の相対位置関係を記憶し、前記バーコード認識部で抽出したバーコード領域の位置から処理対象領域の位置を特定して処理対象領域画像を抽出する処理領域抽出部と、前記バーコード認識部の認識結果と、前記処理領域抽出部で抽出した処理対象領域画像を出力する出力部と、を有する帳票処理装置、及び、前記帳票処理装置から出力されたバーコード認識結果と処理対象領域画像を入力する入力部と、前記入力部で入力した処理対象領域画像を処理する処理部と、を有する帳票項目処理装置と、を有している。 Further, the form processing system of the present invention includes an image input unit that inputs an image including a barcode region and a processing target region, and barcode recognition that extracts and decodes the barcode region from the input image input by the image input unit. A barcode that is extracted by the barcode recognition unit, the verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit, and the relative positional relationship between the barcode region and the processing target region A processing region extraction unit that identifies the position of the processing target region from the region position and extracts the processing target region image, the recognition result of the barcode recognition unit, and the processing target region image extracted by the processing region extraction unit are output A form processing device, an input unit for inputting a barcode recognition result and a processing target region image output from the form processing device, and the input unit. And a, and form the item processing apparatus having a, a processing unit for processing the processing target area image input.
　この構成により、帳票処理装置で画像入力操作を連続で実施し、帳票項目処理装置で項目処理をまとめて実施することができる。 With this configuration, it is possible to perform image input operations continuously with the form processing apparatus and perform item processing collectively with the form item processing apparatus.
　さらに、本発明の帳票処理システムは、前記出力部は表示手段を有し、前記検証部の検証結果がエラーの場合、前記処理領域抽出部の位置特定結果がエラーの場合、前記表示手段にエラー情報を表示し、自動的に前記画像入力部の処理に進む。 Further, in the form processing system of the present invention, the output unit includes a display unit, and when the verification result of the verification unit is an error, when the position specifying result of the processing region extraction unit is an error, an error is displayed on the display unit. The information is displayed, and the process automatically proceeds to the image input unit.
　この構成により、操作者は撮影操作の問題点を把握し、即座に撮影方法の修正が可能になる。 This configuration enables the operator to grasp the problem of the shooting operation and to immediately correct the shooting method.
　さらに、本発明の帳票処理システムは、前記出力部は表示手段を有し、前記検証部の検証結果がエラーの場合、前記処理領域抽出部の位置特定結果がエラーの場合、前記表示手段にエラー情報を表示し、操作者の起動により前記画像入力部の処理に進む。 Further, in the form processing system of the present invention, the output unit includes a display unit, and when the verification result of the verification unit is an error, when the position specifying result of the processing region extraction unit is an error, an error is displayed on the display unit. Information is displayed, and the process proceeds to the image input unit upon activation of the operator.
　この構成により、操作者は撮影操作の問題点を把握し、即座に撮影方法の修正が可能になる。 This configuration enables the operator to grasp the problem of the shooting operation and to immediately correct the shooting method.
　さらに、本発明の帳票処理方法は、バーコード領域と処理対象領域を含む画像を入力する画像入力ステップと、前記画像入力ステップで入力した入力画像からバーコード領域を抽出してデコードするバーコード認識ステップと、前記バーコード認識ステップの処理結果で処理対象領域画像の品質を検証する検証ステップと、バーコード領域と処理対象領域の相対位置関係を記憶し、前記バーコード認識ステップで抽出したバーコード領域の位置から処理対象領域の位置を特定して処理対象領域画像を抽出する処理領域抽出ステップと、前記処理領域抽出ステップで抽出した処理領域画像を処理する処理ステップと、前記バーコード認識ステップの認識結果と、前記検証ステップの検証結果と、前記処理領域抽出ステップの抽出結果と、前記処理ステップの処理結果を出力する出力ステップと、を有している。 Further, the form processing method of the present invention includes an image input step for inputting an image including a barcode region and a processing target region, and barcode recognition for extracting and decoding the barcode region from the input image input in the image input step. A verification step for verifying the quality of the processing target region image based on the processing result of the barcode recognition step, a relative positional relationship between the barcode region and the processing target region, and the barcode extracted in the barcode recognition step A processing region extraction step for extracting a processing target region image by specifying a position of the processing target region from the region position, a processing step for processing the processing region image extracted in the processing region extraction step, and the barcode recognition step. A recognition result, a verification result of the verification step, an extraction result of the processing region extraction step, and the It has an output step of outputting the processing result of the physical step.
　この構成により、バーコード認識ステップの処理結果から処理対象領域の画像品質を判断し、不可の場合は、処理ステップの処理を行うことなく、再度画像入力を行うことができる。 With this configuration, it is possible to determine the image quality of the processing target area from the processing result of the barcode recognition step, and when it is not possible, input the image again without performing the processing of the processing step.
　また、バーコード領域の位置から処理領域の位置を特定し、入力画像外の場合は、処理ステップの処理を行うことなく、再度画像入力を行うことができる。 Also, the position of the processing area is specified from the position of the barcode area, and if it is outside the input image, the image can be input again without performing the processing step.
　さらに、本発明の帳票処理プログラムは、バーコード領域と処理対象領域を含む画像を入力する画像入力ステップと、前記画像入力ステップで入力した入力画像からバーコード領域を抽出してデコードするバーコード認識ステップと、前記バーコード認識ステップの処理結果で処理対象領域画像の品質を検証する検証ステップと、バーコード領域と処理対象領域の相対位置関係を記憶し、前記バーコード認識ステップで抽出したバーコード領域の位置から処理対象領域の位置を特定して処理対象領域画像を抽出する処理領域抽出ステップと、前記処理領域抽出ステップで抽出した処理領域画像を処理する処理ステップと、前記バーコード認識ステップの認識結果と、前記検証ステップの検証結果と、前記処理領域抽出ステップの抽出結果と、前記処理ステップの処理結果を出力する出力ステップと、を有している。 Further, the form processing program of the present invention includes an image input step for inputting an image including a barcode region and a processing target region, and barcode recognition for extracting and decoding the barcode region from the input image input in the image input step. A verification step for verifying the quality of the processing target region image based on the processing result of the barcode recognition step, a relative positional relationship between the barcode region and the processing target region, and the barcode extracted in the barcode recognition step A processing region extraction step for extracting a processing target region image by specifying a position of the processing target region from the region position, a processing step for processing the processing region image extracted in the processing region extraction step, and the barcode recognition step. A recognition result, a verification result of the verification step, an extraction result of the processing region extraction step, and And a, and outputting the processing result of said processing step.
　この構成により、計算機に、バーコード認識ステップの処理結果から処理対象領域の画像品質を判断させ、不可の場合は、処理ステップの処理を行わせることなく、再度画像入力を行わせ、また、バーコード領域の位置から処理領域の位置を特定させ、入力画像外の場合は、処理ステップの処理を行わせることなく、再度画像入力を行わせることができる。 With this configuration, the computer can determine the image quality of the processing target area from the processing result of the barcode recognition step, and if it is not possible, the computer can input the image again without performing the processing of the processing step. The position of the processing area is specified from the position of the code area, and if it is outside the input image, the image can be input again without performing the processing step.
　さらに、本発明の帳票処理媒体は、バーコード領域と処理対象領域を含む画像を入力する画像入力ステップと、前記画像入力ステップで入力した入力画像からバーコード領域を抽出してデコードするバーコード認識ステップと、前記バーコード認識ステップの処理結果で処理対象領域画像の品質を検証する検証ステップと、バーコード領域と処理対象領域の相対位置関係を記憶し、前記バーコード認識ステップで抽出したバーコード領域の位置から処理対象領域の位置を特定して処理対象領域画像を抽出する処理領域抽出ステップと、前記処理領域抽出ステップで抽出した処理領域画像を処理する処理ステップと、前記バーコード認識ステップの認識結果と、前記検証ステップの検証結果と、前記処理領域抽出ステップの抽出結果と、前記処理ステップの処理結果を出力する出力ステップと、から構成されるプログラムを記録する構成を有している。 Furthermore, the form processing medium of the present invention includes an image input step for inputting an image including a barcode region and a processing target region, and barcode recognition for extracting and decoding the barcode region from the input image input in the image input step. A verification step for verifying the quality of the processing target region image based on the processing result of the barcode recognition step, a relative positional relationship between the barcode region and the processing target region, and the barcode extracted in the barcode recognition step A processing region extraction step for extracting a processing target region image by specifying a position of the processing target region from the region position, a processing step for processing the processing region image extracted in the processing region extraction step, and the barcode recognition step. A recognition result, a verification result of the verification step, an extraction result of the processing region extraction step, and the And outputting the processing result of the physical steps, and has a structure for recording the program consisting of.
　この構成により、計算機に、バーコード認識ステップの処理結果から処理対象領域の画像品質を判断させ、不可の場合は、処理ステップの処理を行わせることなく、再度画像入力を行わせ、また、バーコード領域の位置から処理領域の位置を特定させ、入力画像外の場合は、処理ステップの処理を行わせることなく、再度画像入力を行わせる、プログラムを記録することが出来る。 With this configuration, the computer can determine the image quality of the processing target area from the processing result of the barcode recognition step, and if it is not possible, the computer can input the image again without performing the processing of the processing step. It is possible to record a program for specifying the position of the processing area from the position of the code area and, if it is outside the input image, causing the image to be input again without performing the processing step.
　本構成によって、バーコード領域の位置から各項目の入力画像内の位置を特定し、処理を行う。 This configuration identifies the position of each item in the input image from the position of the barcode area and performs processing.
　また、バーコード認識部の処理結果から各項目画像の品質を検証し、不可の場合は、各項目の処理を行わず、画像入力処理に戻る。 Also, the quality of each item image is verified from the processing result of the barcode recognition unit, and if it is not possible, the processing of each item is not performed and the process returns to the image input processing.
　本発明の帳票処理装置及び帳票処理方法及び記録媒体によれば、バーコード領域の位置から各項目の入力画像内の位置を特定でき、バーコード認識部の処理結果から各項目画像の品質を検証でき、入力画像の変動に、高速に精度良く対応できる。 According to the form processing apparatus, form processing method, and recording medium of the present invention, the position of each item in the input image can be specified from the position of the barcode area, and the quality of each item image is verified from the processing result of the barcode recognition unit. It can respond to fluctuations in the input image at high speed and with high accuracy.
本発明の実施の形態１における帳票処理装置の構成図Configuration diagram of a form processing apparatus according to Embodiment 1 of the present invention 本発明の実施の形態１における帳票処理装置の制御概略図Control schematic diagram of form processing apparatus in Embodiment 1 of the present invention （ａ）本発明の実施の形態１における入力帳票画像の説明図(A) Explanatory drawing of the input form image in Embodiment 1 of this invention （ａ）本発明の実施の形態１におけるバーコード認識部の説明図(A) Explanatory drawing of the barcode recognition part in Embodiment 1 of this invention （ａ），（ｂ）本発明の実施の形態１における検証部の説明図(A), (b) Explanatory drawing of the verification part in Embodiment 1 of this invention （ａ）本発明の実施の形態１における処理領域抽出部の説明図(A) Explanatory drawing of the process area extraction part in Embodiment 1 of this invention （ａ）本発明の実施の形態１における処理領域抽出部の説明図(A) Explanatory drawing of the process area extraction part in Embodiment 1 of this invention （ａ），（ｂ）本発明の実施の形態１における処理領域抽出部の説明図(A), (b) Explanatory drawing of the process area extraction part in Embodiment 1 of this invention 本発明の実施の形態２における帳票処理システムの構成図Configuration diagram of a form processing system in Embodiment 2 of the present invention 従来の帳票処理装置の説明図Illustration of a conventional form processing device
　以下本発明の実施の形態について、図面を参照しながら説明する。
　（実施の形態１）
　図１は、本発明の実施の形態１における帳票処理装置の構成図である。
　図１において、１０１は画像入力部であり、バーコード領域と処理対象領域を含む画像を入力する。 Embodiments of the present invention will be described below with reference to the drawings.
(Embodiment 1)
FIG. 1 is a configuration diagram of a form processing apparatus according to Embodiment 1 of the present invention.
In FIG. 1, an image input unit 101 inputs an image including a barcode area and a processing target area.
　１０２はバーコード認識部であり、画像入力部１０１で入力した入力画像からバーコード領域を抽出してデコードする。１０３は検証部であり、バーコード認識部１０２の処理結果で処理対象領域画像の品質を検証する。１０４は処理領域抽出部であり、バーコード領域と処理対象領域の相対位置関係を記憶し、バーコード認識部１０２で抽出したバーコード領域の位置から処理対象領域の位置を特定して処理対象領域画像を抽出する。１０５は処理部であり、処理領域抽出部１０４で抽出した処理領域画像を処理する。１０６は出力部であり、バーコード認識部１０２の認識結果と、検証部１０３の検証結果と、処理領域抽出部１０４の抽出結果と、処理部１０５の処理結果を出力する。 102 is a barcode recognition unit that extracts and decodes a barcode region from the input image input by the image input unit 101. Reference numeral 103 denotes a verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit 102. A processing area extraction unit 104 stores the relative positional relationship between the barcode area and the processing target area, specifies the position of the processing target area from the position of the barcode area extracted by the barcode recognition unit 102, and processes the processing target area. Extract images. A processing unit 105 processes the processing region image extracted by the processing region extraction unit 104. An output unit 106 outputs the recognition result of the barcode recognition unit 102, the verification result of the verification unit 103, the extraction result of the processing region extraction unit 104, and the processing result of the processing unit 105.
　なお、画像入力部、バーコード認識部、検証部、処理領域抽出部、処理部等の各機能ブロックは、典型的には集積回路であるＬＳＩとして実現されてもよい。集積回路化の手法は、ＬＳＩに限るものではない。これらは、個別に１チップ化されてもよいし、一部又は全部を含むように１チップ化されてもよい。 Note that each functional block such as an image input unit, a barcode recognition unit, a verification unit, a processing region extraction unit, and a processing unit may be realized as an LSI that is typically an integrated circuit. The method of circuit integration is not limited to LSI. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them.
　図２は、本発明の実施の形態１における帳票処理装置の制御概略図である。
　画像入力ステップＳ１０１で、バーコード領域と処理対象領域を含む画像を入力し、Ｓ１０２に進む。 FIG. 2 is a control schematic diagram of the form processing apparatus according to Embodiment 1 of the present invention.
In an image input step S101, an image including a barcode area and a processing target area is input, and the process proceeds to S102.
　バーコード認識ステップＳ１０２で、画像入力ステップＳ１０１で入力した入力画像からバーコード領域を抽出してデコードし、Ｓ１０３に進む。検証ステップＳ１０３で、バーコード認識ステップＳ１０２の処理結果で処理対象領域画像の品質を検証し、不可であればＳ１０１に進み、可であればＳ１０４に進む。 In bar code recognition step S102, a bar code area is extracted from the input image input in image input step S101 and decoded, and the process proceeds to S103. In the verification step S103, the quality of the processing target area image is verified by the processing result of the barcode recognition step S102. If it is not possible, the process proceeds to S101, and if it is possible, the process proceeds to S104.
　処理領域特定ステップＳ１０４で、予め記憶していたバーコード領域と処理対象領域の相対位置関係を用いて、バーコード認識ステップＳ１０２で抽出したバーコード領域の位置から処理対象領域の位置を特定し、処理対象領域の位置が入力画像外に特定されていないか検証し、不可であればＳ１０１に進み、可であればＳ１０５に進む。 In the processing area specifying step S104, the position of the processing target area is specified from the position of the barcode area extracted in the barcode recognition step S102 using the relative positional relationship between the barcode area and the processing target area stored in advance. Whether the position of the processing target area is specified outside the input image is verified. If it is not possible, the process proceeds to S101, and if it is possible, the process proceeds to S105.
　領域画像抽出ステップＳ１０５で、処理領域特定ステップＳ１０４で特定した処理対象領域の位置を用いて、入力画像から処理対象領域画像を抽出し、抽出した処理対象領域画像の縮尺あるいは変形あるいは画像品質を検証し、必要であれば、領域画像補正ステップＳ１０６で処理対象領域画像を補正してＳ１０７に進み、不要であれば、補正しないでＳ１０７に進む。 In the region image extraction step S105, the processing target region image is extracted from the input image using the position of the processing target region specified in the processing region specifying step S104, and the scale or deformation of the extracted processing target region image or the image quality is verified. If necessary, the process target area image is corrected in area image correction step S106 and the process proceeds to S107. If not necessary, the process proceeds to S107 without correction.
　文字認識ステップＳ１０７で、領域画像抽出ステップＳ１０５で抽出した処理対象領域画像、あるいは、領域画像補正ステップＳ１０６で補正した処理対象領域補正画像を文字認識処理し、Ｓ１０８に進む。結果出力ステップＳ１０８は、バーコード認識ステップＳ１０２のバーコード認識結果と文字認識ステップＳ１０７の文字認識結果を出力する。 In the character recognition step S107, the character recognition processing is performed on the processing target region image extracted in the region image extraction step S105 or the processing target region correction image corrected in the region image correction step S106, and the process proceeds to S108. The result output step S108 outputs the barcode recognition result of the barcode recognition step S102 and the character recognition result of the character recognition step S107.
　なお、各ステップは、コンピュータで実行可能なプログラムで記述されてもよい。 Note that each step may be described by a program executable by a computer.
　以下、図３（ａ）に示す、バーコードと項目内容が記入済みの帳票Ａの入力画像を例に、動作の詳細を説明する。画像入力部１０１で、帳票Ａをカメラで撮影すると、図３（ａ）に示すように傾きθ度、解像度Ｄｄｐｉで画像入力された。 Hereinafter, the details of the operation will be described by taking as an example the input image of the form A in which the bar code and the item contents have been entered as shown in FIG. When the form A is photographed by the camera in the image input unit 101, the image is input with the inclination θ degree and the resolution Ddpi as shown in FIG.
　バーコード認識部１０２では、公知の方法でバーコード領域を抽出し、バーコード認識を行う。図４（ａ）にバーコード抽出結果を示す。１次元バーコードＢ１と２次元バーコードＢ２が抽出できた。 The barcode recognition unit 102 extracts a barcode area by a known method and performs barcode recognition. FIG. 4A shows the barcode extraction result. One-dimensional barcode B1 and two-dimensional barcode B2 could be extracted.
　バーコードＢ１の認識結果は、「ａ１２３４５６７８９０ａ」であった。
　バーコードＢ１の４角の位置は、点（ＸＢ１ＳＴ，ＹＢ１ＳＴ）（ＸＢ１ＥＴ，ＹＢ１ＥＴ）（ＸＢ１ＥＢ，ＹＢ１ＥＢ）（ＸＢ１ＳＢ，ＹＢ１ＳＢ）であった。 The recognition result of the barcode B1 was “a12345567890a”.
The four corner positions of the barcode B1 were points (XB1ST, YB1ST) (XB1ET, YB1ET) (XB1EB, YB1EB) (XB1SB, YB1SB).
　検証部１０３では、バーコード認識部１０２の処理結果で処理対象領域画像の品質を検証する。バーコードＢ１の認識結果が得られなかった場合は、処理対象領域の処理も難しいと判断する。 The verification unit 103 verifies the quality of the processing target area image based on the processing result of the barcode recognition unit 102. If the recognition result of the barcode B1 is not obtained, it is determined that the processing of the processing target area is difficult.
　図５（ａ）（ｂ）に示す式で、バーコードＢ１の４角の位置から、バーコード領域の回転角度θと解像度Ｄを求め、解像度Ｄが一定の値より大きすぎたり小さすぎたりする場合は、画像入力部１０１と帳票Ａとの距離が近すぎたり遠すぎたりするときなので、処理対象領域の縮尺を不可とする。回転角度θが大きすぎる場合は、回転によって画像が乱れる恐れがあるため処理対象領域の変形を不可とする。
　さらに、１次元バーコードＢ１あるいは２次元バーコードＢ２の形が長方形あるいは正方形でない場合は、画像入力部１０１が帳票Ａに対してまっすぐな方向に向けられておらず、斜めになっていると考えられるので、処理対象領域の変形を不可とする。 In the equations shown in FIGS. 5A and 5B, the rotation angle θ and the resolution D of the barcode area are obtained from the four positions of the barcode B1, and the resolution D is too large or too small than a certain value. In this case, since the distance between the image input unit 101 and the form A is too close or too far, the scale of the processing target area is not allowed. If the rotation angle θ is too large, the image may be disturbed by the rotation, so that the process target area cannot be deformed.
Further, when the shape of the one-dimensional barcode B1 or the two-dimensional barcode B2 is not a rectangle or a square, the image input unit 101 is not directed in a straight direction with respect to the form A, but is considered to be inclined. Therefore, it is impossible to deform the processing target area.
　図５（ｂ）式中の６ｃｍは、予め登録されているバーコードＢ１領域の横幅の実測値である。また、バーコードＢ１の４角の位置座標の長方形度合いからバーコード領域の変形度合いを判断し、処理対象領域の変形を判断しても良い。
　バーコードＢ１の画像のコントラストを調べ、処理対象領域画像の品質を判断することもできる。
　検証部１０３で、以上の検証項目について処理対象領域画像の品質を検証し、不可であれば画像入力部１０１の処理に戻る。 In FIG. 5B, 6 cm is an actual measurement value of the lateral width of the barcode B1 area registered in advance. Alternatively, the degree of deformation of the barcode area may be determined from the degree of rectangle of the four corner position coordinates of the barcode B1, and the deformation of the processing target area may be determined.
It is also possible to determine the quality of the processing target region image by examining the contrast of the image of the barcode B1.
The verification unit 103 verifies the quality of the processing target region image with respect to the above verification items.
　処理領域抽出部１０４では、図６（ａ）に示すように、予めバーコード領域と処理対象領域の相対位置関係を記憶し、バーコード認識部１０２で抽出したバーコード領域の４角の位置から、検証部１０３で算出したバーコード領域の回転角度θと解像度Ｄを用いて、図７（ａ）に示す式（１）式（２）により、処理対象領域の位置を特定する。 As shown in FIG. 6A, the processing area extraction unit 104 stores the relative positional relationship between the barcode area and the processing target area in advance, and calculates the four corner positions of the barcode area extracted by the barcode recognition unit 102. Using the barcode region rotation angle θ and resolution D calculated by the verification unit 103, the position of the processing target region is specified by the equations (1) and (2) shown in FIG.
　更に、処理対象領域の位置が入力画像外に特定されていないか検証する。図中の（ＸＡ，ＹＡ）は、入力画像のサイズを示す。処理対象領域Ｌ１，Ｌ２，Ｌ３は、入力画像内であるが、Ｌ４は入力画像外であることが分かる。検証結果から、Ｌ４について処理をする場合は、画像入力部１０１の処理に戻る。Ｌ１について処理をする場合は、入力画像内であるので、画像を抽出する。 Furthermore, it is verified whether the position of the processing target area is specified outside the input image. (XA, YA) in the figure indicates the size of the input image. It can be seen that the processing target areas L1, L2, and L3 are inside the input image, but L4 is outside the input image. From the verification result, when processing for L4, the processing returns to the processing of the image input unit 101. When processing about L1, since it is in an input image, an image is extracted.
　図８（ａ）に処理対象領域Ｌ１の画像抽出結果を示す。処理対象領域Ｌ１は、θ度傾いているので、回転補正すると図８（ｂ）に示す画像になる。 FIG. 8A shows the image extraction result of the processing target area L1. Since the processing target area L1 is inclined by θ degrees, the image shown in FIG.
　処理部１０５では、図６（ａ）予め登録されている処理対象領域の項目内容に対応した処理を行う。処理対象領域Ｌ１は、「項目：郵便」で、公知の方法で文字認識する。処理対象領域Ｌ１は、「１２３－４５６７」であった。 The processing unit 105 performs processing corresponding to the item content of the processing target area registered in advance in FIG. The processing target area L1 is “item: mail”, and character recognition is performed by a known method. The processing target area L1 is “123-4567”.
　出力部１０６は、バーコードＢ１の認識結果「ａ１２３４５６７８９０ａ」と処理対象領域Ｌ１の文字認識結果「１２３－４５６７」を出力する。 The output unit 106 outputs the barcode B1 recognition result “a12345567890a” and the character recognition result “123-4567” of the processing target area L1.
　かかる構成によれば、バーコード認識部と検証部と処理領域抽出部を設けることにより、バーコード認識部の処理結果から処理対象領域の画像品質を判断し、不可の場合は、処理部の処理を行うことなく、再度画像入力を行うことができる。 According to this configuration, by providing the barcode recognition unit, the verification unit, and the processing region extraction unit, the image quality of the processing target region is determined from the processing result of the barcode recognition unit. The image can be input again without performing the operation.
　また、バーコード領域の位置から処理領域の位置を特定し、入力画像外の場合は、処理部の処理を行うことなく、再度画像入力を行うことができる。 Also, the position of the processing area is specified from the position of the barcode area, and if it is outside the input image, the image can be input again without performing the processing of the processing section.
　（実施の形態２） 
　図９は、本発明の実施の形態２における帳票処理システムの構成図である。
　図９において、図１と同じ構成要素については同じ符号を用いる。
　図９において、１０１は画像入力部であり、バーコード領域と処理対象領域を含む画像を入力する。１０２はバーコード認識部であり、画像入力部１０１で入力した入力画像からバーコード領域を抽出してデコードする。１０３は検証部であり、バーコード認識部１０２の処理結果で処理対象領域画像の品質を検証する。１０４は処理領域抽出部であり、バーコード領域と処理対象領域の相対位置関係を記憶し、バーコード認識部１０２で抽出したバーコード領域の位置から処理対象領域の位置を特定して処理対象領域画像を抽出する。１０７は項目情報出力部であり、バーコード認識部１０２の認識結果と処理領域抽出部１０４で抽出した処理対象領域画像を出力する。 (Embodiment 2)
FIG. 9 is a configuration diagram of the form processing system according to the second embodiment of the present invention.
9, the same reference numerals are used for the same components as in FIG.
In FIG. 9, an image input unit 101 inputs an image including a barcode area and a processing target area. Reference numeral 102 denotes a barcode recognition unit that extracts and decodes a barcode region from an input image input by the image input unit 101. Reference numeral 103 denotes a verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit 102. A processing area extraction unit 104 stores the relative positional relationship between the barcode area and the processing target area, specifies the position of the processing target area from the position of the barcode area extracted by the barcode recognition unit 102, and processes the processing target area. Extract images. An item information output unit 107 outputs the recognition result of the barcode recognition unit 102 and the processing target region image extracted by the processing region extraction unit 104.
　１００１は帳票処理装置であり、画像入力部１０１とバーコード認識部１０２と検証部１０３と処理領域抽出部１０４と項目情報出力部１０７とを有する。
　１０８は項目情報入力部であり、項目情報出力部１０７で出力した項目情報を入力する。 A form processing apparatus 1001 includes an image input unit 101, a barcode recognition unit 102, a verification unit 103, a processing area extraction unit 104, and an item information output unit 107.
An item information input unit 108 inputs the item information output by the item information output unit 107.
　１０５は処理部であり、項目情報入力部１０８で入力した項目情報の処理対象領域画像を処理する。１０６は出力部であり、項目情報入力部１０８で入力した項目情報のバーコード認識結果と、処理部１０５の処理結果を出力する。
　１００２は帳票項目処理装置であり、項目情報入力部１０８と処理部１０５と出力部１０６とを有する。１０００は帳票処理システムで、帳票処理装置１００１とは帳票項目処理装置１００２を有する。 Reference numeral 105 denotes a processing unit that processes the processing target region image of the item information input by the item information input unit 108. Reference numeral 106 denotes an output unit that outputs the barcode recognition result of the item information input by the item information input unit 108 and the processing result of the processing unit 105.
A form item processing apparatus 1002 includes an item information input unit 108, a processing unit 105, and an output unit 106. A form processing system 1000 includes a form item processing apparatus 1002 and a form processing apparatus 1001.
　なお、項目情報出力部は表示手段を有し、検証部の検証結果がエラーの場合、処理領域抽出部の位置特定結果がエラーの場合、表示手段にエラー情報を表示し、自動的に画像入力部の処理に進んでもよい。 The item information output unit has a display means. When the verification result of the verification section is an error, when the position specifying result of the processing region extraction section is an error, the error information is displayed on the display means and image input is automatically performed. May proceed to the processing of the part.
　また、項目情報出力部は表示手段を有し、検証部の検証結果がエラーの場合、処理領域抽出部の位置特定結果がエラーの場合、表示手段にエラー情報を表示し、操作者の起動により画像入力部の処理に進んでもよい。 In addition, the item information output unit has a display means, and when the verification result of the verification section is an error, when the position specifying result of the processing region extraction section is an error, the error information is displayed on the display means, and the operator starts You may progress to the process of an image input part.
　なお、帳票処理装置の項目情報出力部から処理対象領域画像を出力するとしたが、項目情報出力部で入力画像及び入力画像内の処理対象領域の位置を出力し、帳票項目処理装置の処理部で入力画像から処理対象領域画像を抽出して処理してもかまわない。 Although the processing target area image is output from the item information output unit of the form processing apparatus, the item information output unit outputs the input image and the position of the processing target area in the input image, and the processing unit of the form item processing apparatus. The processing target area image may be extracted from the input image and processed.
　また、帳票処理装置に蓄積部を設け処理対象領域画像を蓄積し、通信手段や記憶媒体を介して、帳票項目処理装置に蓄積した処理対象領域画像を入力してもかまわない。 Also, a storage unit may be provided in the form processing apparatus to store the processing target area image, and the processing target area image stored in the form item processing apparatus may be input via the communication means or the storage medium.
　かかる構成によれば、帳票処理装置と帳票項目処理装置を別に設けることにより、帳票処理装置で画像入力操作を連続で実施し、帳票項目処理装置で項目処理をまとめて実施することができる。 According to such a configuration, by providing the form processing apparatus and the form item processing apparatus separately, it is possible to continuously perform image input operations on the form processing apparatus and collectively perform item processing on the form item processing apparatus.
　本発明を詳細にまた特定の実施態様を参照して説明したが、本発明の精神と範囲を逸脱することなく様々な変更や修正を加えることができることは当業者にとって明らかである。 Although the present invention has been described in detail and with reference to specific embodiments, it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the invention.
　本出願は、２０１０年４月１５日出願の日本特許出願（特願２０１０－０９３８２６）に基づくものであり、その内容はここに参照として取り込まれる。 This application is based on a Japanese patent application filed on April 15, 2010 (Japanese Patent Application No. 2010-093826), the contents of which are incorporated herein by reference.
　本発明にかかる帳票処理装置、帳票処理方法は、高速で高性能な画像処理機能を有し、画像処理手法等として有用である。また、迅速な情報のデータ化機能を有し、情報のデータベース化手法等として有用である。 The form processing apparatus and form processing method according to the present invention have a high-speed and high-performance image processing function and are useful as an image processing method. In addition, it has a rapid information data conversion function, and is useful as a method for creating an information database.
　１０１　画像入力部
　１０２　バーコード認識部
　１０３　検証部
　１０４　処理領域抽出部
　１０５　処理部
　１０６　出力部 DESCRIPTION OF SYMBOLS 101 Image input part 102 Barcode recognition part 103 Verification part 104 Processing area extraction part 105 Processing part 106 Output part

Claims (8)

  1. 　バーコード領域と処理対象領域を含む画像を入力する画像入力部と、
    　前記画像入力部で入力した入力画像からバーコード領域を抽出してデコードするバーコード認識部と、
    　前記バーコード認識部の処理結果で処理対象領域画像の品質を検証する検証部と、
    　前記画像入力部で入力した入力画像から処理対象領域を抽出して処理する処理部と、
    　前記バーコード認識部の認識結果と、前記検証部の検証結果と、前記処理部の処理結果を出力する出力部と、
    　を有することを特徴とする帳票処理装置。     An image input unit for inputting an image including a barcode area and a processing target area;
    A barcode recognition unit that extracts and decodes a barcode region from the input image input by the image input unit;
    A verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit;
    A processing unit that extracts and processes a processing target region from the input image input by the image input unit;
    A recognition result of the barcode recognition unit; a verification result of the verification unit; and an output unit that outputs a processing result of the processing unit;
    A form processing apparatus characterized by comprising:
  2. 　バーコード領域と処理対象領域を含む画像を入力する画像入力部と、
    　前記画像入力部で入力した入力画像からバーコード領域を抽出してデコードするバーコード認識部と、
    　前記バーコード認識部の処理結果で処理対象領域画像の品質を検証する検証部と、
    　バーコード領域と処理対象領域の相対位置関係を記憶し、前記バーコード認識部で抽出したバーコード領域の位置から処理対象領域の位置を特定して処理対象領域画像を抽出する処理領域抽出部と、
    　前記処理領域抽出部で抽出した処理領域画像を処理する処理部と、
    　前記バーコード認識部の認識結果と、前記検証部の検証結果と、前記処理領域抽出部の
    抽出結果と、前記処理部の処理結果を出力する出力部と、
    　を有することを特徴とする帳票処理装置。     An image input unit for inputting an image including a barcode area and a processing target area;
    A barcode recognition unit that extracts and decodes a barcode region from the input image input by the image input unit;
    A verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit;
    A processing region extraction unit that stores a relative positional relationship between the barcode region and the processing target region, specifies a position of the processing target region from the position of the barcode region extracted by the barcode recognition unit, and extracts a processing target region image; ,
    A processing unit that processes the processing region image extracted by the processing region extraction unit;
    A recognition result of the barcode recognition unit; a verification result of the verification unit; an extraction result of the processing region extraction unit; and an output unit that outputs a processing result of the processing unit;
    A form processing apparatus characterized by comprising:
  3. 　バーコード領域と処理対象領域を含む画像を入力する画像入力部と、
    　前記画像入力部で入力した入力画像からバーコード領域を抽出してデコードするバーコード認識部と、
    　前記バーコード認識部の処理結果で処理対象領域画像の品質を検証する検証部と、
    　バーコード領域と処理対象領域の相対位置関係を記憶し、前記バーコード認識部で抽出したバーコード領域の位置から処理対象領域の位置を特定して処理対象領域画像を抽出する処理領域抽出部と、
    　前記バーコード認識部の認識結果と、前記処理領域抽出部で抽出した処理対象領域画像を出力する出力部と、
    　を有する帳票処理装置と、
    　前記帳票処理装置から出力されたバーコード認識結果と処理対象領域画像を入力する入力部と、
    　前記入力部で入力した処理対象領域画像を処理する処理部と、
    　を有する帳票項目処理装置と、
    　を有する帳票処理システム。     An image input unit for inputting an image including a barcode area and a processing target area;
    A barcode recognition unit that extracts and decodes a barcode region from the input image input by the image input unit;
    A verification unit that verifies the quality of the processing target region image based on the processing result of the barcode recognition unit;
    A processing region extraction unit that stores a relative positional relationship between the barcode region and the processing target region, and extracts a processing target region image by specifying the position of the processing target region from the position of the barcode region extracted by the barcode recognition unit; ,
    An output unit that outputs a recognition result of the barcode recognition unit, and a processing target region image extracted by the processing region extraction unit;
    A form processing apparatus having
    An input unit for inputting a barcode recognition result and a processing target area image output from the form processing apparatus;
    A processing unit that processes the processing target region image input by the input unit;
    A form item processing apparatus having
    A form processing system.
  4. 　前記出力部は表示手段を有し、前記検証部の検証結果がエラーの場合、前記処理領域抽出部の位置特定結果がエラーの場合、
    　前記表示手段にエラー情報を表示し、自動的に前記画像入力部の処理に進むことを特徴とする請求項３記載の帳票処理システム。     The output unit includes a display unit, and when the verification result of the verification unit is an error, when the position specifying result of the processing region extraction unit is an error,
    4. The form processing system according to claim 3, wherein error information is displayed on the display means, and the process automatically proceeds to the processing of the image input unit.
  5. 　前記出力部は表示手段を有し、前記検証部の検証結果がエラーの場合、前記処理領域抽出部の位置特定結果がエラーの場合、
    　前記表示手段にエラー情報を表示し、操作者の起動により前記画像入力部の処理に進むことを特徴とする請求項３記載の帳票処理システム。     The output unit includes a display unit, and when the verification result of the verification unit is an error, when the position specifying result of the processing region extraction unit is an error,
    4. The form processing system according to claim 3, wherein error information is displayed on the display means, and the processing of the image input unit is advanced by an operator activation.
  6. 　バーコード領域と処理対象領域を含む画像を入力する画像入力ステップと、
    　前記画像入力ステップで入力した入力画像からバーコード領域を抽出してデコードするバーコード認識ステップと、
    　前記バーコード認識ステップの処理結果で処理対象領域画像の品質を検証する検証ステップと、
    　バーコード領域と処理対象領域の相対位置関係を記憶し、前記バーコード認識ステップで抽出したバーコード領域の位置から処理対象領域の位置を特定して処理対象領域画像を抽出する処理領域抽出ステップと、
    　前記処理領域抽出ステップで抽出した処理領域画像を処理する処理ステップと、
    　前記バーコード認識ステップの認識結果と、前記検証ステップの検証結果と、前記処理領域抽出ステップの抽出結果と、前記処理ステップの処理結果を出力する出力ステップと、
    　を有する帳票処理方法。     An image input step for inputting an image including a barcode area and a processing target area;
    A barcode recognition step of extracting and decoding a barcode region from the input image input in the image input step;
    A verification step of verifying the quality of the processing target region image with the processing result of the barcode recognition step;
    A processing region extraction step for storing a relative positional relationship between the barcode region and the processing target region, and extracting a processing target region image by specifying the position of the processing target region from the position of the barcode region extracted in the barcode recognition step; ,
    A processing step of processing the processing region image extracted in the processing region extraction step;
    A recognition result of the barcode recognition step, a verification result of the verification step, an extraction result of the processing region extraction step, and an output step of outputting the processing result of the processing step;
    A form processing method comprising:
  7. 　請求項６記載の帳票処理方法をコンピュータで実行可能に記述したことを特徴とするプログラム。 A program in which the form processing method according to claim 6 is described so as to be executable by a computer.
  8. 　請求項６記載の帳票処理方法をコンピュータで実行可能に記述したプログラムを記録したことを特徴とする記録媒体。 A recording medium in which a program in which the form processing method according to claim 6 is described so as to be executable by a computer is recorded.
PCT/JP2011/002194 2010-04-15 2011-04-13 Form processing device, form processing method, and recording medium WO2011129113A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011800168219A CN102834836A (en) 2010-04-15 2011-04-13 Form processing device, form processing method, and recording medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010093826A JP2011227543A (en) 2010-04-15 2010-04-15 Form processing device and method and recording medium
JP2010-093826 2010-04-15

Publications (1)

Publication Number Publication Date
WO2011129113A1 true WO2011129113A1 (en) 2011-10-20

Family

ID=44798495

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/002194 WO2011129113A1 (en) 2010-04-15 2011-04-13 Form processing device, form processing method, and recording medium

Country Status (3)

Country Link
JP (1) JP2011227543A (en)
CN (1) CN102834836A (en)
WO (1) WO2011129113A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102567764A (en) * 2012-01-13 2012-07-11 中国工商银行股份有限公司 Bill certificate and system for improving electronic image recognition efficiency
EP2823451A1 (en) * 2012-03-08 2015-01-14 Essilor International (Compagnie Générale D'Optique) Method for ordering a spectacle lens and associated system
WO2017109998A1 (en) * 2015-12-25 2017-06-29 株式会社Pfu Mobile terminal, image-processing method, and program

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6160363B2 (en) * 2013-08-23 2017-07-12 株式会社ダイフク Article information recognition device
CN109539333B (en) * 2015-03-10 2020-06-19 松下知识产权经营株式会社 Heating cooker
CN105046553A (en) * 2015-07-09 2015-11-11 胡昭 Cloud intelligent invoice recognition inspection system and method based on mobile phone
CN106485586A (en) * 2016-09-19 2017-03-08 泰康保险集团股份有限公司 The management method of insurance policy and device
US10430628B2 (en) * 2016-09-20 2019-10-01 Casio Computer Co., Ltd. Slip processing device, slip processing method, and recording medium
JP6885832B2 (en) * 2017-09-13 2021-06-16 カシオ計算機株式会社 Bar code reader, image acquisition method, and program
JP6761603B2 (en) * 2018-08-23 2020-09-30 カシオ計算機株式会社 Mobile terminal devices, information recording methods, and programs
CN110956739A (en) * 2019-05-09 2020-04-03 杭州睿琪软件有限公司 Bill identification method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002304597A (en) * 2001-04-04 2002-10-18 Sakana Ryutsu Net:Kk System for recognizing handwritten numeric information entered in container box
JP2006180476A (en) * 2003-02-07 2006-07-06 Sharp Corp Portable terminal device and focused state display method
WO2006070476A1 (en) * 2004-12-28 2006-07-06 Fujitsu Limited Image processing device for detecting position of processing object in image
WO2009119489A1 (en) * 2008-03-24 2009-10-01 シャープ株式会社 Information display device and information reading device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0512959U (en) * 1991-07-30 1993-02-19 日本電気エンジニアリング株式会社 Optical character reader
CN1204918A (en) * 1997-06-27 1999-01-13 长野日本无线株式会社 Processing method of electronic mail system
US6201901B1 (en) * 1998-06-01 2001-03-13 Matsushita Electronic Industrial Co., Ltd. Border-less clock free two-dimensional barcode and method for printing and reading the same
JP4989590B2 (en) * 2008-08-29 2012-08-01 富士通フロンテック株式会社 Image processing apparatus, image processing method, and image processing program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002304597A (en) * 2001-04-04 2002-10-18 Sakana Ryutsu Net:Kk System for recognizing handwritten numeric information entered in container box
JP2006180476A (en) * 2003-02-07 2006-07-06 Sharp Corp Portable terminal device and focused state display method
WO2006070476A1 (en) * 2004-12-28 2006-07-06 Fujitsu Limited Image processing device for detecting position of processing object in image
WO2009119489A1 (en) * 2008-03-24 2009-10-01 シャープ株式会社 Information display device and information reading device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102567764A (en) * 2012-01-13 2012-07-11 中国工商银行股份有限公司 Bill certificate and system for improving electronic image recognition efficiency
CN102567764B (en) * 2012-01-13 2016-03-02 中国工商银行股份有限公司 A kind of bill evidence and system improving electron image recognition efficiency
EP2823451A1 (en) * 2012-03-08 2015-01-14 Essilor International (Compagnie Générale D'Optique) Method for ordering a spectacle lens and associated system
EP2823451B1 (en) * 2012-03-08 2024-02-07 Essilor International Method for ordering a spectacle lens and associated system
WO2017109998A1 (en) * 2015-12-25 2017-06-29 株式会社Pfu Mobile terminal, image-processing method, and program
JPWO2017109998A1 (en) * 2015-12-25 2018-05-24 株式会社Pfu Mobile terminal, image processing method, and program
US10628713B2 (en) 2015-12-25 2020-04-21 Pfu Limited Mobile terminal, image processing method, and computer-readable recording medium

Also Published As

Publication number Publication date
JP2011227543A (en) 2011-11-10
CN102834836A (en) 2012-12-19

Similar Documents

Publication Publication Date Title
WO2011129113A1 (en) Form processing device, form processing method, and recording medium
US10331929B2 (en) Imaging terminal, imaging sensor to determine document orientation based on bar code orientation and methods for operating the same
US7999657B2 (en) Image registration method for image comparison and document authentication
US9420205B2 (en) Image acquisition method of object on supporting surface
WO2019174133A1 (en) Electronic device, physical seal identification method, and computer readable storage medium
JP2012510235A (en) Image processing for curve correction
JP4594952B2 (en) Character recognition device and character recognition method
JP7427684B2 (en) Drug verification system, drug management method and program
JP6574921B1 (en) Image processing system, image processing method, and program
WO2020008628A1 (en) Image processing system, image processing method, and program
US9659226B2 (en) Image processing apparatus, image processing method, and computer-readable recording medium storing image processing program
JP5877335B2 (en) Form
CN116563876A (en) Invoice identification method
JP2006330872A (en) Fingerprint collation device, method and program
JP2017199288A (en) Image processing device, image processing method and program
WO2011129114A1 (en) Form, form processing device, form processing method, and recording medium
JP4314148B2 (en) Two-dimensional code reader
JP6225096B2 (en) Form reading program, form reading method, and information processing apparatus
JP2006330873A (en) Fingerprint collation device, method and program
JP4188344B2 (en) Fingerprint verification apparatus, method and program
JP6743401B2 (en) Form design/read setting support device, form design/read setting support method, and optical character recognition system
JP2011028611A (en) Character information reading device and character information reading method
JP2005056252A (en) Image collation device, method and program
WO2001026041A1 (en) Imaged character recognition device and method
JP2021022285A (en) Medium identification device, medium identification system, and medium identification method

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201180016821.9

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11768635

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11768635

Country of ref document: EP

Kind code of ref document: A1