JP2012133569A - Information processing device, control method and program thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve accuracy of data recognition processing.SOLUTION: An information processing device performs following steps: detecting a position of an area which is printed in a print sheet and to which data recognition processing is performed, by analyzing image data obtained by reading the print sheet in which position information showing the position of the area to which the data recognition processing is performed is printed; acquiring the position of the area which is shown by the position information and to which the data recognition processing is performed, by reading the position information included in the image data; correcting the acquired position according to the detected position and the acquired position; and performing the data recognition processing to the area of the image data shown by the corrected position.

Description

  The present invention relates to an information processing apparatus, a control method therefor, and a program, and more particularly to a technique for improving the accuracy of data recognition.

  Conventionally, a form or the like is created by overlaying data such as variables (data not fixed to a template such as characters and numerical values) on a certain format (template). In addition, software for creating template data used to create a form or the like in this way has been developed.

  The template data (template data) is specifically form data (form data) such as a form having a certain format. Using this software, form forms can be created, output areas that output data such as variables in some areas of the forms, and print areas that allow users to input (describe) characters, etc. Template data is created by setting. The template data created in this way is overlaid with the variables and the like, and the target form is output.

  In addition, conventionally, after a form is output in this way, OCR processing (character recognition) is performed on the form in order to read variables output to the form output area or characters written in the print area by the user. Process). In order to efficiently perform OCR processing, an OCR template that is defined as an OCR processing area is generated for a part of the form (such as an output area or a printing area) in accordance with a user instruction, and OCR template is generated according to the OCR template. Processing is being executed.

  For example, Patent Document 1 discloses that an image of a form read from a scanner is displayed, and field item attribute information of an area designated by a user is created from the displayed image.

  Further, Patent Document 2 discloses a deviation amount from an image obtained by reading with a scanner from two feature part coordinates near a left end part and a right end part of a form, and feature part coordinates stored in advance. It is described that it is judged.

Japanese Patent Laid-Open No. 2005-044256 JP 2004-326672 A

  However, in the above-mentioned Patent Document 1, when creating template data of a form, an object such as a form output area is set, and a character font (a typeface such as Gothic or Mincho) or a font is applied to the object. The target area for OCR processing when setting the font size, the attribute / character attribute indicating whether the output data is characters or numbers, the number of digits such as the output characters or numbers, and then performing OCR processing In addition, attribute information (OCR definition information) such as a dictionary used in OCR processing must be set in the target area. That is, the user has to set attribute information when creating template data and performing OCR processing, which is complicated.

  In addition, in order to read the printing paper on which the form form data is printed and perform the character recognition processing on the field area, the OCR definition information must be prepared in advance on the character recognition device side. There is a problem that a character recognition device that does not have a character cannot efficiently perform character recognition processing.

  Also, when printing form form data, printing misalignment may occur for each printer, and the target specified based on the appropriate OCR definition information for such misprinted form paper Even if the OCR process is performed on the area, the OCR process may not be performed properly.

  In Patent Document 2, the characteristic part coordinates must be set in advance and stored in the apparatus, and there is a problem that a character recognition process cannot be performed with high accuracy in an apparatus for which such information is not prepared.

  An object of the present invention is to obtain the data printed on the printing paper obtained by analyzing the image data obtained by reading the printing paper on which the position information indicating the position of the area where the data recognition process is performed is printed. The accuracy of the data recognition process is improved by correcting the position of the area where the data recognition process is performed according to the position of the area where the recognition process is performed and the position indicated by the position information included in the image data.

  The present invention is an information processing apparatus including a storage unit that stores image data obtained by reading a print sheet on which position information indicating a position of an area for performing data recognition processing is printed. Analyzing the stored image data to detect the position of an area printed on the printing paper for performing the data recognition process; and the image data included in the image data stored in the storage unit By reading the position information, the acquisition means for acquiring the position of the area for performing the data recognition processing indicated by the position information, the position detected by the detection means, and the position acquired by the acquisition means According to the correction means for correcting the position acquired by the acquisition means, and stored in the storage means indicated by the position obtained by correction by the correction means Characterized in that it comprises a data recognition means for performing data recognition processing, the relative area of the image data.

  The present invention also relates to a method for controlling an information processing apparatus including a storage unit that stores image data obtained by reading a print sheet on which position information indicating a position of an area for performing data recognition processing is printed. A detection step of detecting a position of an area on which the data recognition process is performed, which is printed on the printing paper, by analyzing the image data stored in the storage unit; The acquisition unit of the information processing apparatus acquires the position of the area for performing the data recognition process indicated by the position information by reading the position information included in the image data stored in the storage unit. The acquisition step and the correction means of the information processing apparatus are acquired in the acquisition step according to the position detected in the detection step and the position acquired in the acquisition step. A correction step for correcting the position, and data for the area of the image data stored in the storage means indicated by the position obtained by the data recognition means of the information processing device being corrected in the correction step. And a data recognition step for performing recognition processing.

  The present invention also provides a program that can be executed by an information processing apparatus including a storage unit that stores image data obtained by reading a print sheet on which position information indicating the position of an area for performing data recognition processing is printed. The information processing apparatus analyzes the image data stored in the storage unit, thereby detecting the position of the area printed on the printing paper and performing the data recognition process, and the storage By reading the position information included in the image data stored in the means, the acquisition means for acquiring the position of the area to be subjected to the data recognition process indicated by the position information, and detected by the detection means In accordance with the position and the position acquired by the acquisition means, a correction means for correcting the position acquired by the acquisition means, and correction by the correction means Indicated by the position obtained Ri, characterized in that to function as a data recognition means for performing data recognition processing to a region of the image data stored in the storage means.

  According to the present invention, the data printed on the printing paper obtained by analyzing the image data obtained by reading the printing paper on which the position information indicating the position of the area where the data recognition process is performed is printed. The accuracy of the data recognition process can be improved by correcting the position of the area where the data recognition process is performed according to the position of the area where the recognition process is performed and the position indicated by the position information included in the image data.

FIG. 1 is a diagram illustrating a configuration example of a system according to the present embodiment. FIG. 2 is a block diagram showing a hardware configuration of the information processing apparatuses 101 and 102 shown in FIG. FIG. 3 is a block diagram illustrating an example of a software configuration of the information processing apparatus illustrated in FIG. FIG. 4 is an example of the form editor screen 400. FIG. 5 is an example of a form form property screen 500 for inputting form attribute information. FIG. 6 is an example of a property screen for inputting object attributes (definitions). FIG. 7 is an example of a form definition table in which data for defining a form is stored. FIG. 8 is an example of an object definition table that stores data for defining (attributes) objects. FIG. 9 is a diagram illustrating an example of an OCR definition table of a form. FIG. 10 is a diagram illustrating an example of an OCR definition table of objects. FIG. 11 is a diagram illustrating an example of output data. FIG. 12 is a diagram showing an example of a display screen showing a region to be subjected to OCR processing of a form (template). FIG. 13 is a diagram illustrating an example of a display screen that indicates an OCR processing target area of a form described by a user, which is read by the multi-function peripheral 103. FIG. 14 is a flowchart showing an example of a first control processing procedure in the system of the present invention. FIG. 15 is a flowchart illustrating an example of detailed processing in step S1404 illustrated in FIG. FIG. 16 is a flowchart showing an example of detailed processing in step S1508 shown in FIG. FIG. 17 is an example of a dictionary table. FIG. 18 is a flowchart showing an example of detailed processing of step S1602 in FIG. 16, step S1902 in FIG. 19, step S2002 in FIG. 20, and step S2102 in FIG. FIG. 19 is a flowchart showing an example of detailed processing of step S1509 in FIG. FIG. 20 is a flowchart illustrating an example of detailed processing of step S1510 of FIG. FIG. 21 is a flowchart showing an example of detailed processing of the processing in step S1511 of FIG. FIG. 21 is a flowchart showing an example of a second control processing procedure in the system of the present invention. FIG. 23 is a conceptual diagram for explaining the relationship among an object placement area 2301, an OCR process area (OCR process target area 2302), and a clear area 2303. FIG. 24 is a screen diagram illustrating an example of a form print setting screen displayed when a form form data print instruction is issued. FIG. 25 is a flowchart showing an example of a form print processing procedure in the information processing apparatus of the present invention. FIG. 26 is a flowchart showing an example of a data recognition processing procedure in the information processing apparatus of the present invention. FIG. 27 is a flowchart showing a detailed process of a printer printing position deviation correction process shown in step S2607 shown in FIG. 26. FIG. 7 is a flowchart illustrating printer print position adjustment processing executed by the printer management server 104; 6 is a diagram illustrating an example of a printer management table. FIG.

Hereinafter, the present invention will be described in detail according to preferred embodiments with reference to the accompanying drawings.
<Description of FIG. 1>

  FIG. 1 is a diagram illustrating a configuration example of a system according to the present embodiment. As illustrated in FIG. 1, the information processing apparatus 101, the information processing apparatus 102, the printer management server 104, and the multifunction peripheral (image processing apparatus) 103 are connected to each other via a network 105 so that they can communicate with each other.

  The multifunction machine 103 is an image processing apparatus such as a so-called MFP (Multifunction Peripheral) having a scanner function, a printing function, and the like, and executes print processing in response to a request from the information processing apparatus, and forms (paper). It is possible to transmit digitized data (electronic data) generated by reading (scanning) or the like to the information processing apparatus.

  The information processing apparatus can make a print request such as a form to the multi-function peripheral 103 via the network 105. In addition, the information processing apparatus has a function for creating and editing a template (form form data) such as a form, and form attribute information (form that is data in the form definition table (FIG. 7)) that is input when creating the template. A function for generating OCR definition information (data in FIG. 10) to be set for OCR from definition information) and object attribute information (object definition information which is data in the object definition table (FIG. 8)) ing.

  The information processing apparatus also has a function of displaying electronic data of a form described by a user transmitted from the multifunction machine. FIG. 13 is a diagram illustrating an example of a display screen that indicates an OCR processing target area of a form described by a user, which is read by the multi-function peripheral 103. As illustrated in FIG. 13, areas 1302, 1303, 1304, 1305, 1306, 1307, and 1308 indicate areas that are subject to OCR processing.

  The printer management server 104 has a function of transmitting a command for correcting the printing position to the multifunction device 103 in accordance with data received from the information processing apparatus, and a function of transmitting mail to a terminal operated by the multifunction device administrator. ing.

In the present embodiment, a description is given using a suitable character recognition process (OCR process) as an example of the data recognition process. However, the present invention is not limited to this, and can also be applied to a symbol recognition process (OMR process). is there.
<Description of FIG. 2>

  Hereinafter, the hardware configuration of the information processing apparatuses 101, 102, and 104 illustrated in FIG. 1 will be described with reference to FIG.

  FIG. 2 is a block diagram illustrating a hardware configuration of the information processing apparatuses 101, 102, and 104 illustrated in FIG.

  In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls devices and controllers connected to the system bus 204. The ROM 202 or the external memory 211 has a BIOS (Basic Input / Output) that is a control program of the CPU 201.

  (System), an operating system program (hereinafter referred to as OS), and various programs (to be described later) necessary for realizing functions executed by each server or each PC (information processing apparatus) are stored.

  A RAM 203 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program or the like necessary for execution of processing from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

  An input controller 205 controls input from a keyboard (KB) 209 or a pointing device such as a mouse (not shown). A video controller 206 controls display on a display (display unit) such as a CRT display (CRT) 210. In FIG. 2, although described as CRT 210, the display device is not limited to the CRT, but may be another display device such as a liquid crystal display. These are used by the administrator as needed.

  A memory controller 207 is provided in an external storage device (hard disk (HD)), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 211 such as a compact flash (registered trademark) memory connected via an adapter.

  A communication I / F controller 208 is connected to and communicates with an external device via the network 105, and executes communication control processing on the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the CRT 210 by executing outline font rasterization processing on a display information area in the RAM 203, for example. In addition, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the CRT 210.

Various programs to be described later for realizing the present invention are recorded in the external memory 211 and executed by the CPU 201 by being loaded into the RAM 203 as necessary. Further, files and various tables used when executing the program are also stored in the external memory 211.
<Description of FIG. 3>

  FIG. 3 is a block diagram illustrating an example of a software configuration of the information processing apparatus illustrated in FIG.

  In the external memory 211, the form editor software 301, the OCR software program 318, the form definition table (FIG. 7), the object definition table (FIG. 8), the draft image data 312 and the OCR of the entire form form data are stored. A definition table (FIG. 9), an OCR definition table (FIG. 10) of objects written in the field area in the form form data, a dictionary table (FIG. 17), various dictionaries (316) used for OCR processing, An output result 317 obtained by outputting the recognition processing result by the OCR engine and output data (FIG. 11) are stored.

  Form editor software 301 (hereinafter also referred to as form editor software) is software used to create or edit a form template such as a form.

  The form editor software 301 is arranged in the template with a form data / attribute input unit 302 (FIG. 5) for inputting form template data such as a form and various attribute information of the template in accordance with an instruction from the user. OCR definition information (FIG. 10) is generated using the object data input / attribute input unit 303 (FIG. 6) for inputting various object data and various attribute information of the object (FIG. 6), and the data input in 302 and 303. Set the OCR definition information generated by the OCR definition information generation unit 304, the image data generation unit 305 that generates image data (data to be overlaid with the template) as the template draft, and the OCR definition information generated by the OCR definition information generation unit 304 in the OCR engine Where the OCR software reads to And OCR definition information setting unit 306 for storing the OCR definition information in a storage area of, and the output unit 307 for outputting OCR processing (character recognition processing) a result of executing the (recognition result), and a. Note that the image data generated by the image data generation unit 305 is stored in the storage unit 308.

  Here, the data of the template (form) input in 302 and various attribute information of the template are stored in the form definition table (FIG. 7) 310, and the data of various objects input in 303 and the various attributes of the object. The information is stored in an object definition table (FIG. 8) 311. The data in the form definition table 310 and the object definition table 311 is data 309 for configuring (defining) a form (style) serving as a template.

  The OCR definition information generation unit 304 generates OCR definition information from the data in the form definition table (FIG. 7) and the object definition table (FIG. 8) stored in the storage unit 308 as described above.

  Then, the OCR definition information setting unit 306 stores the generated OCR definition information in the object OCR definition table 315 stored in the storage unit 308.

  These form OCR definition table 314 and object OCR definition table 315 are data 313 used to execute OCR processing (character recognition processing).

  The storage unit 308 is a storage unit such as the external memory 211 and stores various dictionaries 316 used in OCR processing.

  The OCR software program 318 (also referred to as OCR software) is read by the reading unit 319 and the reading unit 319 for reading the OCR definition table 314 of the form stored in the storage unit 308 and the OCR definition information in the object OCR definition table 315. A character recognition processing unit 320 (OCR engine) that performs character recognition processing using data (OCR definition information), and an output unit 321 that outputs a result recognized by the character recognition processing unit 320 to be stored in the storage unit 308. I have.

Here, the output unit 321 can output the result of recognition by the character recognition processing unit 320 for display on a display unit such as the CRT 210 or can output the result of printing on the multi-function peripheral 103. .
<Description of FIG. 14>

  Next, processing executed by the form editor software 301 will be described with reference to the flowchart of FIG.

  FIG. 14 is a flowchart showing an example of a first control processing procedure in the system of the present invention, and corresponds to the processing by the form editor software 301 shown in FIG. That is, it is realized by the CPU 201 of the information processing apparatus 101 executing a program read from the ROM 202 or the external memory 211 to the RAM 203. In the figure, S1401 to S1406 indicate each step.

  First, when executing the form editor software program, the CPU 201 of the information processing apparatus 101 displays a form editor screen 400 shown in FIG. 4 on the CRT 210 (display unit).

  FIG. 4 is an example of the form editor screen 400.

  Next, the CPU 201 of the information processing apparatus 101 receives an input of a form such as a form from the user. Specifically, when the CPU 201 of the information processing apparatus 101 detects that the setting button 415 has been pressed by the user, the form form property screen shown in FIG. 5 is displayed.

  FIG. 5 is an example of a form form property screen 500 for inputting form attribute information.

  A form form property screen 500 shown in FIG. 5 includes a unit 501 for inputting a form name (name) of a form, a unit 503 for inputting the size (size) of output paper, and a unit 507 for inputting a printing direction. A grid interval unit 509, a margin input unit 512, a layout unit input unit 517, and an OCR process input unit 518. Each information input in each part of the form form property screen 500 will be described as attribute information of the form (template).

  Here, the form form property screen 500 will be described in detail.

  Reference numeral 502 denotes a text box that accepts input of the form name (name) of the form by the user.

  Reference numeral 504 denotes a pull-down menu capable of selecting a paper size (A4 or the like), reference numeral 505 denotes a text box in which a paper width can be input, and reference numeral 506 denotes a paper height. It is a text box that can. Reference numeral 508 denotes a pull-down menu in which the print direction (vertical or horizontal) can be input.

  Reference numeral 510 denotes a grid box (height), and reference numeral 511 denotes a text box in which the grid gap (horizontal) can be entered. Reference numerals 513, 514, 515, and 516 denote text boxes for inputting the margins of the template, and the upper, lower, left, and right margins of the template can be input, respectively.

  Reference numeral 517 denotes a pull-down for inputting a layout unit. For example, millimeters (mm) can be input.

  Reference numeral 519 denotes a check box that can input a setting for executing the OCR process for the form displayed in FIG. 4. If the check box is checked here, a setting for executing the OCR process is input. The Rukoto. Reference numeral 520 denotes a check box capable of inputting a setting for not executing the OCR processing for the form displayed in FIG. When this is checked, a setting for not executing the OCR process is input.

  The attribute information input to each part of the form form property screen 500 described here is data for defining the form, such as grid intervals and margins.

  When the user inputs attribute information in each part of the form form property screen 500 and presses the OK button 521, the CPU 201 of the information processing apparatus 101 stores the input attribute information in the form definition table (FIG. 7). (Step S1401). When the cancel 522 button is pressed, the form form property screen 500 is closed.

  FIG. 7 is an example of a form definition table in which data for defining a form is stored.

  Next, the CPU 201 of the information processing apparatus 101 arranges and displays objects on a template 401 (referred to as a form or form form data) displayed on the form editor screen 400 in accordance with a user instruction.

  That is, a field area indicating an area in which data is written is set in the form form data (field setting means).

  Specifically, when the display button 416 is pressed by the user, the field list screen 417 is displayed.

  On this screen, objects for arranging objects such as a fixed field 418 and a variable field 419 are displayed.

  Here, the fixed field is an area for outputting fixed (no change) data, and the variable field is an area for outputting variable data. When the user drags and drops the fixed field 418 and arranges it on the template 401, an output area such as 413 can be set on the template. Similarly to the fixed field, the variable field can be set on the template by dragging and dropping the variable field 419 and placing it on the template 401.

  The OLE field 420 of the field list screen 417 is an object that can set the output of a two-dimensional code such as a QR code. Like the variable field, the OLE field 420 is arranged on the template 401 by dragging and dropping the OLE field 420. The For example, an output area such as 414 can be set on the template. Here, reference numeral 414 denotes an example set as an area for outputting a QR code.

  In addition, the user can directly input a character on the template 401 by pressing the object 421 and inputting the character from the KB 209. For example, characters 403, 404, 406, 407, 408, 409, 410, and 411 are input in this way.

  Reference numeral 405 denotes an input of a check box object. In step 405, when the user presses the object 422 and designates the template 401, the CPU 201 of the information processing apparatus 101 inputs 405 on the template 401. The “ladder frame” object shown at 412 can be input in the same manner.

  Next, the CPU 201 of the information processing apparatus 101 selects the input object according to a user instruction, and displays a property screen 600 (FIG. 6) of the selected object according to the user instruction. For example, when the user selects an object and right-clicks in the selected state and selects “Property” (not shown), the property screen 600 (FIG. 6) of the selected object is displayed. Is done.

  Then, from the displayed property screen 600 (FIG. 6), data indicating the definition of the object can be input to the object in accordance with a user instruction.

  That is, the attribute information of the data written in the field area (object) to be set is set (attribute setting means).

  FIG. 6 is an example of a property screen for inputting object attributes (definitions).

  The object property screen 600 shown in FIG. 6 includes a unit 601 for inputting the name of the object and its type, a unit 604 for inputting whether to perform OCR processing, and a unit for inputting the arrangement position and size of the object. 607, 619, a line attribute input unit 610, a character attribute input unit 614, and an output definition for inputting whether a character (column) is combined horizontally or vertically, and whether a character is full-width or half-width A section 620 and a section 623 for inputting the number of lines and the number of digits of the character frame when a character frame is set.

  Here, the object property screen 600 will be described in detail.

  Reference numeral 602 denotes a text box for inputting a field graphic name (name), and reference numeral 603 denotes a pull-down for selecting and inputting the type. Here, as the type, for example, a figure (square), a character, a figure (check box), a character (circle), a figure (ladder frame), an output area (character), an output area (QR code), or the like is selected. be able to.

  The figure (square) is an object in which a template is surrounded by a square figure (line) as shown by 402 in FIG. The character is, for example, a character object input in 403, 404, 406, 408, 410, 411 in FIG. The figure (check box) is an object used as a check box, for example, as indicated by reference numeral 405 in FIG. The character (circled) is an object circled by the user, for example, as indicated by reference numerals 407 and 409 in FIG. The figure (ladder frame) is an object in which characters or the like are input (filled in) by the user, for example, as shown at 412 in FIG.

  The output area (character) is an object to which a character is output, for example, as indicated by 413 in FIG. The characters output to this object are stored in advance as output data (FIG. 11), for example, in accordance with a user instruction.

  FIG. 11 is a diagram illustrating an example of output data. In FIG. 11, as data to be output to the area 413 (character area) in FIG. 4, the text data “* Please access the electronic coupon from here” and the area 414 in FIG. 4 (to output the QR code) QR code data “ABC... Jpee3dw” is shown as data to be output to the area (1).

  When the template of FIG. 4 is printed, the data of the output data (FIG. 11) is output to the areas 413 and 414 for printing. The printed result is shown in FIG.

  FIG. 12 is an example of a display screen of the OCR area of the template. Returning to the description of the object property screen 600. The output area (QR code) is an object for outputting a two-dimensional code as indicated by 414 in FIG. 4, for example.

  Reference numeral 605 denotes a check box in which a setting for executing an OCR process on a selected object can be input. When this box is checked, a setting for executing an OCR process on a selected object is set. Will be entered. Reference numeral 606 denotes a check box capable of inputting a setting for not executing the OCR process on the selected object. When this is checked, a setting for not executing the OCR process on the selected object is input.

  Reference numeral 608 denotes a text box that can input a distance from the leftmost side of the template as a reference position of the arrangement position of the object. Reference numeral 609 denotes a text box that can input a distance from the uppermost side of the template.

  Reference numeral 611 denotes a pull-down menu that can select a line type such as a solid line or a dotted line of the object. Reference numeral 612 denotes a pull-down menu for selecting and inputting the line width of the object. Reference numeral 613 denotes a pull-down menu that can select and input the line color of the object.

  Reference numeral 615 denotes a pull-down menu that can input a font of an object character (such as Gothic or Mincho). Reference numeral 616 denotes a pull-down menu that can input the character style of the object (thin characters, standard characters, bold characters, etc.). Reference numeral 617 denotes a pull-down menu in which the character size (points) of the object can be input. Reference numeral 618 denotes a pull-down menu capable of inputting the character color of the object.

  Reference numeral 619 denotes a text box in which an object size (size) can be input. Here, it is possible to input the width and height of the object.

  Reference numeral 621 denotes a pull-down menu that can selectively input the direction of the character set of the object. Reference numeral 622 denotes a pull-down menu that can selectively input the output size (full-width, half-width, etc.) of the character of the object. Reference numerals 624 and 625 are pull-downs for selecting and inputting the number of lines and the number of digits of the character frame, respectively.

  When data indicating the definition of the object is input via the property screen 600 (FIG. 6) and the OK button is pressed by the user, the CPU 201 of the information processing apparatus 101 stores the data indicating the definition of the input object. This is stored in the object definition table shown in FIG. The user performs this operation on each object.

  As described above, in step S1402, the CPU 201 of the information processing apparatus 101 inputs data indicating the definition of an object for each object from the displayed property screen 600 (FIG. 6) according to a user instruction. Accept. Then, the input data is stored in the object definition table (FIG. 8). FIG. 8 is an example of an object definition table in which data for defining (attributes) (field attribute information) of objects (fields) is stored.

  The object definition table shown in FIG. 8 includes “object number”, “type”, “sequential number within type”, “name”, “OCR usage classification”, “left”, “top”, “width”, “height”. ”,“ Number of lines ”,“ Number of digits ”,“ Line type ”,“ Line width ”,“ Line color ”,“ Font ”,“ Style ”,“ Size ”,“ Color ”,“ Composition direction ”,“ Text ” It consists of the item “Output Size”.

  “Object number” is a number for identifying an object, and corresponds to the number indicated in parentheses in the reference numerals of FIG. That is, the object number <1> indicates a frame 402 in FIG. “Type” is information indicating the type (type) of the object. The “in-type serial number” is a consecutive number assigned to identify objects of the same type. “Name” is the name of the object. The “OCR usage classification” stores information indicating whether or not to use OCR. In the case of an object that performs OCR, “Yes” is stored, and in the case of an object that does not perform OCR, “No” is stored. Further, “left” stores information indicating the reference position of the object arrangement position and indicating the position from the leftmost side of the template. Further, “upper” stores information indicating the position from the top of the template that specifies the reference position of the object arrangement position. Further, the “width” stores the width of the object. In “height”, the height of the object is stored. The “number of lines” is the number of lines in a character input area such as a ladder frame. “Number of digits” is the number of digits in a character input area such as a ladder frame. The “line type” is information such as a solid line or a dotted line. The “line width” is a line width. The “line color” is a line color. The “font” is a font of characters. The “style” is a character style. “Size” is the size of a character. The “color” is the color of the character. The “set direction” is a set direction of characters (rows). The “character output size” is a character output size such as full-width or half-width.

  Next, the CPU 201 of the information processing apparatus 101 determines whether or not “use OCR” in the form definition table (FIG. 7) input and stored in step S1401 is “Yes” (step S1403).

  That is, it is determined whether or not 519 of the form property screen 500 is checked. If 519 is checked (when “Use OCR” in the form definition table (FIG. 7) is “Yes”) (step S1403: YES), the object definition table stored in the storage unit is used to execute the OCR process. OCR definition information is generated (step S1404).

  That is, from the attribute information of each object (field area), data recognition information (OCR definition information) used in the OCR process (data recognition process) of each field area of the printing paper of the form form data is generated (data recognition information generation) means).

On the other hand, when 519 is not checked and 520 is checked (when “Use OCR” in the form definition table (FIG. 7) is “No”) (step S1403: NO), OCR definition information is not generated. End the process.

  Detailed processing in step S1404 will be described later with reference to FIG.

  Next, when generating the OCR definition information in step S1404, the CPU 201 of the information processing apparatus 101 acquires the scanning resolution (dpi), the printing orientation, and the like of the form OCR definition table (FIG. 9) stored in advance. For example, using the following formula, the size of the image data (upper left X coordinate: 0, upper left Y coordinate: 0, lower right X coordinate: value calculated by the following formula, lower right Y coordinate: The image data to be a draft of the template is generated (step S1405). By using the image data generated here as a draft of the OCR definition information, it is possible to specify which area in the template is to be the OCR process area.

  FIG. 12 is a diagram showing an example of the display screen 1200 showing the OCR processing target area of the form (template) specified as described above. FIG. 12 is a screen in which an OCR processing target area is displayed on a form in which output data (FIG. 11) is output to the output area. In FIG. 12, 1202, 1203, 1204, 1205, 1206, 1207, and 1208 are defined as OCR processing target areas. Note that the size of the OCR processing target area can be corrected according to a user instruction.

  (Expression)-Lower right X coordinate = Size (width) (mm) x Scanning resolution (dpi) ÷ 25.4 (mm)-Lower right Y coordinate = Size (height) (mm) x Scanning Resolution (dpi) ÷ 25.4 (mm)

  For example, if the printing resolution is 300 dpi when scanning a vertical A4 sheet (width 210 mm and height 297 mm), and substituting these values into the above equation, the lower right X coordinate is 210 (mm) × 300 (dpi) ÷ 25.4 (mm) = 24800.349... And a value of about 2480. Also, if the lower right Y coordinate is substituted in the same manner, 297 (mm) × 300 (dpi) /25.4 (mm) = 3507.87..., Which is about 3507.

  In this way, the size of the image data generated here is determined, and image data (image) of that size is generated (step S1405).

  Next, the CPU 201 of the information processing apparatus 101 sets the OCR definition information in the OCR software by storing the OCR definition information generated in step S1404 in a storage unit read by the OCR software (step S1406).

  Here, FIG. 9 will be described. FIG. 9 is a diagram showing an example of an OCR definition table for the entire form data.

  The form OCR definition table includes “form form name”, “OCR use”, “printing resolution”, “scanning resolution”, “image file name”, and “clear area initial value”.

  The “form form name” is data corresponding to the “form form name” in the form definition table (FIG. 7), and is stored (generated) by being copied by the OCR definition information generating unit 304.

  “OCR use” is data corresponding to “OCR use” in the form definition table (FIG. 7), and is stored (generated) by being copied by the OCR definition information generating unit 304.

  “Resolution at printing” is a value stored in advance in response to a user instruction, and defines a resolution at which printing is performed at the time of printing. Accordingly, the form data generated by the form editor software 301 is instructed to be printed at the resolution set here.

  The “scanning resolution” is a value stored in advance according to a user instruction, and defines which resolution is read at the time of scanning. Therefore, the form data generated by the form editor software 301 is read at the resolution set here.

  “Image file name” is the file name of the image data generated in step S1405, and is generated by copying the form name of the form definition table (FIG. 7) when the image data is generated.

  The “clear area initial value” is a value stored in advance according to a user instruction. As shown in FIG. 23, the “clear area initial value” is a width 2303 from the object arrangement area 2301 to the target area 2302 where the OCR processing is performed. is there.

FIG. 23 is a conceptual diagram for explaining the relationship among an object placement area 2301, an OCR process area (OCR process target area 2302), and a clear area 2303.
<Description of FIG. 15>

  Next, processing executed by the form editor software 301 will be described with reference to the flowchart of FIG.

  FIG. 15 is a flowchart showing an example of detailed processing in step S1404 shown in FIG. 14, and corresponds to the processing by the form editor software 301 shown in FIG. That is, it is realized by the CPU 201 of the information processing apparatus 101 executing a program read from the ROM 202 or the external memory 211 to the RAM 203. In the figure, S1501 to S1511 indicate steps.

  The CPU 201 of the information processing apparatus 101 repeatedly executes processing from step S1502 to step S1511 described later for all object definition information stored in the object definition table (FIG. 8). Here, the object definition information (form field attribute information) indicates the record information shown in FIG.

  First, the CPU 201 of the information processing apparatus 101 reads the object definition information in the object definition table (FIG. 8) (step S1502). For example, here, object definition information whose object number is <1> is read.

  Then, the CPU 201 of the information processing apparatus 101 determines whether or not the “OCR usage classification” is defined as “Yes” (step S1503). That is, it is determined whether 605 in the object property screen (FIG. 6) is checked or 606 is checked.

  Here, in the object definition table (FIG. 8), when 605 is checked, “OCR usage category” is stored as “Yes”, and when 606 is checked, “OCR usage category” is set as “No”. It is remembered.

  If the CPU 201 of the information processing apparatus 101 determines in step S1503 that the “OCR usage classification” is defined as “Yes” (step S1503: YES), the process proceeds to step S1504. If it is determined that “classification” is defined as “no” (step S1503: NO), the processing target is set to the next record in the object definition table, and the process returns to step S1502. At this time, the process is executed for all the object definition information, and the process ends when there is no processing target.

  Next, when the CPU 201 of the information processing apparatus 101 determines that the “OCR usage classification” is defined as “Yes” (step S1503: YES), the type of the object included in the object definition information is “character”. ”Or“ graphic (ladder frame) ”or“ output area (character) ”(step S1504).

  If the CPU 201 of the information processing apparatus 101 determines that the object type is “character”, “figure (ladder frame)”, or “output area (character)” (step S1504: YES), step S1508 is performed. The process is shifted to and the character recognition setting process (FIG. 16) is executed. On the other hand, when it is determined that the object type is not “character”, “graphic (ladder frame)”, or “output area (character)” (step S1504: NO), the object type is “graphic (check box)”. Is determined (step S1505).

  If the CPU 201 of the information processing apparatus 101 determines that the object type is “figure (check box)” (step S1505: YES), the process proceeds to step S1509 and the check box recognition setting process (FIG. 19) is executed. On the other hand, if it is determined that the object type is not “figure (check box)” (step S1505: NO), it is determined whether the object type is “character (circled)” (step S1506). ).

  If the CPU 201 of the information processing apparatus 101 determines that the object type is “character (circled)” (step S1506: YES), the process proceeds to step S1510, and the circled number recognition setting process is performed. (FIG. 20) is executed. On the other hand, if it is determined that the object type is not “character (circled)” (step S1506: NO), it is determined whether the object type is “output area (QR code)” (step S1507). ).

  If the CPU 201 of the information processing apparatus 101 determines that the object type is “output area (QR code)” (step S1507: YES), the process proceeds to step S1511 and the QR code recognition setting process ( 21) is executed.

  When the CPU 201 of the information processing apparatus 101 determines in step S1507 that the object type is not “output area (QR code)”, and after executing the processing of step S1508, step S1509, step S1510, and step S1511, As in the case where NO is determined in step S1503, the processing target is set to the next record in the object definition table, and the process returns to step S1502. At this time, the process is executed for all the object definition information, and the process ends when there is no processing target.

In this way, the processing from step S1502 to step S1511 is executed for all object definition information stored in the object definition table.
<Description of FIG. 16>

  Next, processing executed by the form editor software 301 will be described with reference to the flowchart of FIG.

  FIG. 16 is a flowchart showing an example of detailed processing in step S1508 shown in FIG. 15, and corresponds to the processing by the form editor software 301 shown in FIG. That is, it is realized by the CPU 201 of the information processing apparatus 101 executing a program read from the ROM 202 or the external memory 211 to the RAM 203. In the figure, S1601 to S1615 indicate the respective steps.

  First, the CPU 201 of the information processing apparatus 101 generates data (here, “OCR”) indicating that a character recognition process for recognizing a character is executed as a type (type) to be recognized (step S1601). The data generated here is stored in the OCR definition table (OCR template) of the object shown in FIG. Here, the OCR template is a set of OCR definition information of each object shown in FIG.

  FIG. 10 is a diagram showing an example of an OCR definition table of objects written in the field area in the form form data. Various data used for OCR is stored in the OCR definition table.

  The object OCR definition table shown in FIG. 10 stores “No”, “area name (name)”, “object number”, “recognition type”, and the X coordinate of the upper left coordinate of the object placement area (recognition area). “X”, “Y” in which the Y coordinate of the upper left coordinate of the object arrangement area (recognition area) is stored, “X” in which the X coordinate of the lower right coordinate of the object arrangement area (recognition area) is stored, "Y", "Use dictionary", "Composition direction", "Character frame", "Number of digits", "Number of lines", "Character" where the Y coordinate of the lower right coordinates of the object placement area (recognition area) "Output size" etc.

  “No” is a number for identifying a record, and part or all of the information in this record is referred to as OCR definition information. The “area name (name)” is the name (area name) of an object (OCR target object) to be subjected to OCR. The “object number” is a number corresponding to the object number in the object definition table of FIG. The “recognition type” is a type (type) of recognition processing performed by the OCR software program 318. “Use dictionary” indicates a dictionary used in the recognition process performed by the OCR software program 318. The “set direction” indicates whether the character (row) is in the vertical direction or the horizontal direction. “Character frame” indicates what kind of frame a character frame such as a ladder frame is. “Number of digits” indicates the number of digits in the character frame. “Number of lines” indicates the number of lines in the character frame. “Character output size” indicates half-width or full-width.

  Next, the CPU 201 of the information processing apparatus 101 executes common information generation processing (step S1602), and from the object definition information, the OCR target object (such as the object area name) in the object OCR definition information table and the recognition area. (Pixel) (object placement position (coordinates)) is generated. The generated OCR target object (object area name, etc.) and recognition area (Pixel) (object placement position (coordinates)) are stored in the object OCR definition table. Detailed processing in step S1602 will be described later with reference to FIG.

  Next, after executing the common information generation process, the CPU 201 of the information processing apparatus 101 determines whether the font name is stored in “font” of the object definition information (step S1603). If it is determined that the font name is stored (step S1603: YES), a dictionary corresponding to the font is searched from the dictionary table (FIG. 17) (step S1604).

  FIG. 17 is an example of a dictionary table. FIG. 17 shows that a dictionary suitable for OCR is stored for character fonts. The dictionary table is stored in the storage unit.

  Next, the CPU 201 of the information processing apparatus 101 determines whether or not a dictionary corresponding to the font has been searched in step S1604 (step S1605). If it is determined that a dictionary corresponding to the font has been searched (step S1605: YES), “use dictionary” in the OCR definition table (FIG. 10) of the object is used to set the dictionary to use the searched dictionary. ”Is stored (generated). On the other hand, if it is determined that the dictionary corresponding to the font has not been searched (step S1605: NO), the object's OCR definition table (FIG. The dictionary name of the default dictionary is stored (generated) in the “use dictionary” of 10) (step S1607).

  If it is determined in step S1603 that no font name is stored in the “font” of the object definition information, that is, if there is no font information, the process of step S1607 is executed. That is, the dictionary name of the default dictionary is stored (generated) in the “use dictionary” of the object OCR definition table (FIG. 10).

  Next, after executing the processing of step S1607 or step S1606, the CPU 201 of the information processing apparatus 101 indicates “set direction” of one record (object definition information) of the object definition table (FIG. 8) that is currently processed. “Character output size” is stored (generated) in “Composition direction” and “Character output size” of the OCR definition table (FIG. 10) of the object.

  Then, the CPU 201 of the information processing apparatus 101 determines whether or not it is a character frame object by determining whether or not a numerical value is currently set in the “frame” of the object definition information to be processed ( Step S1609). If it is determined that the object is a character frame object (step S1609: YES), the CPU 201 of the information processing apparatus 101 determines whether the character frame is divided into a plurality of pieces (step S1610). That is, by determining whether or not the value (at least one of the number of lines and the number of digits) set in the “frame” of the object definition information to be processed is a numerical value of 2 or more, "Or" field frame "is determined (step S1610).

  Then, when it is determined that the frame is a “ladder frame” (when it is determined that at least one of the number of lines and the number of digits set in the “frame” is a numerical value of 2 or more) (step S1610). : YES), “ladder” is stored (generated) as data indicating a ladder frame in the “character frame” of the object OCR definition table (FIG. 10) (step S1611). On the other hand, when it is determined that it is a “field frame” (when it is determined that both the number of lines and the number of digits set in the “frame” are numerical values of 1) (step S1610: NO), “Field” is stored (generated) in the “character frame” of the object OCR definition table (FIG. 10) as data indicating a field frame (step S1613).

  If it is determined in step S1609 that a numerical value is not currently set in the “frame” of the object definition information to be processed (determined that the object is not a character frame object) (step S1609: NO), the object OCR “-” Is stored (generated) as data indicating that there is no frame in the “character frame” of the definition table (FIG. 10) (step S1604).

  Next, the CPU 201 of the information processing apparatus 101 sets the values of “number of lines” and “number of digits” of the “frame” in the object definition table (FIG. 8) as the maximum number of characters to be recognized as the object. Are stored (generated) in “number of rows” and “number of digits” in the OCR definition table (FIG. 10) (step S1612).

  Further, after executing the processing of step S1604 or step S1613, the CPU 201 of the information processing apparatus 101 sets “0 (zero)” as setting information that causes the OCR software to automatically recognize the number of characters to be recognized. Then, it is stored (generated) in “number of rows” and “number of digits” in the OCR definition table of the object (FIG. 10) (step S1615).

As described above, when the process of step S1615 or step S1612 is executed, the character recognition setting process shown in step S1508 ends, and the definition information of the next object to be processed is read in step S1502.
<Description of FIG. 18>

  Next, processing executed by the form editor software 301 will be described with reference to the flowchart of FIG.

  FIG. 18 is a flowchart showing an example of detailed processing of step S1602 in FIG. 16, step S1902 in FIG. 19, step S2002 in FIG. 20, and step S2102 in FIG. 18 corresponds to the processing by the form editor software 301 shown in FIG.

  That is, it is realized by the CPU 201 of the information processing apparatus 101 executing a program read from the ROM 202 or the external memory 211 to the RAM 203. In the figure, S1801 to S1804 indicate each step.

  The CPU 201 of the information processing apparatus 101 generates a name (area name) of the OCR target object (step S1801).

  Specifically, when the name of an object is input in “Name” of the object definition table (FIG. 8), the name is used as the name of the OCR target object (area name) (FIG. 10). ) In (area name (name)). If the name of the object is not entered in “Name” of the object definition table (FIG. 8), the name (area name) of the OCR target object is generated from the “type” of the object and the “sequential number within type”. Then, it is stored (generated) in “area name (name)” of the object OCR definition table (FIG. 10).

  For example, since the object with the object number <4> is a check box, the area name (name) is connected to “CHK” indicating a check box and “001” of “in-type serial number”, and is an OCR target “CHK001”. An object name (area name) is generated and stored in “area name (name)” of the object OCR definition table (FIG. 10).

  Next, the CPU 201 of the information processing apparatus 101 calculates the recognition area coordinates from the “placement” information in the object definition table (FIG. 8), and calculates the result in the “recognition area (pixel)” in the object OCR definition table. Is stored (generated) (step S1802). Specifically, for example, the upper left coordinates and the lower right coordinates of the recognition area can be calculated using the following equations.

  (Expression) • “X coordinate at upper left of recognition area” = (reference position (left) −initial value of clear area) × scanning resolution (dpi) ÷ 25.4 (mm) • “Y coordinate at upper left of recognition area “= (Reference position (upper) −initial value of clear area) × scanning resolution (dpi) ÷ 25.4 (mm) ·“ lower right X coordinate of recognition area ”= (reference position (left) + size ( (Width) + Clear area initial value) x Scanning resolution (dpi) ÷ 25.4 (mm) · "Y coordinate at the bottom right of the recognition area" = (Reference position (Up) + Size (Height) + Clear area Initial value) x scanning resolution (dpi) ÷ 25.4 (mm)

  Here, as shown in FIG. 23, the clear area is the length 2303 of the width from the object arrangement area 2301 to the target area 2302 to be subjected to the OCR processing, and is set in advance by a user instruction and stored in the storage unit. ing. Here, the value of the clear area set in advance by the user's instruction is described as the initial value of the clear area.

  The scan resolution is set in advance by a user instruction and stored in the OCR definition table (FIG. 9) in the form of the storage unit. The reference position (left), reference position (top), size (width), and size (height) are the items “left”, “top”, “width”, “size” of the object definition table (FIG. 8), respectively. This is the value stored in “Height”.

  In step S1802, the coordinates of the recognition area can be calculated by acquiring these pieces of information and substituting them into the above-described formula.

  Next, the CPU 201 of the information processing apparatus 101 determines whether or not the recognition area determined by the coordinates calculated in step S1802 falls within the area of the template (form) (step S1803).

  Specifically, it is determined whether the coordinates of the recognition area obtained by calculation in step S1802 exceed the coordinates of the size of the image data determined when generating the image data in step S1405.

  Then, the recognition area falls within the template area (the coordinates of the recognition area obtained by calculation in step S1802 do not exceed the coordinates of the size of the image data determined when generating the image data in step S1405). 18 is finished, the process shown in FIG. 18 is terminated, while the image does not fit (the recognition area coordinates obtained by calculation in step S1802 are determined when the image data is generated in step S1405). If it is determined that it exceeds the coordinates of the size of the image data), each coordinate of the recognition area is corrected so as to be within the area of the template (step S1804).

Specifically, the coordinates of the recognition area determined by calculating in step S1802 that is determined to be exceeded are set to the coordinates of the size of the image data determined when generating the image data in step S1405. This can be corrected.
<Description of FIG. 19>

  Next, processing executed by the form editor software 301 will be described with reference to the flowchart of FIG.

  FIG. 19 is a flowchart showing an example of detailed processing of step S1509 in FIG. FIG. 19 corresponds to the processing by the form editor software 301 shown in FIG.

  That is, it is realized by the CPU 201 of the information processing apparatus 101 executing a program read from the ROM 202 or the external memory 211 to the RAM 203. In the figure, S1901 to S1902 indicate each step.

  First, the CPU 201 of the information processing apparatus 101 generates data (here, “check box”) indicating that a character recognition process for recognizing a check box is executed as the type to be recognized (type) (step S1901). The data generated here is stored in the OCR definition table of the object shown in FIG.

Next, the CPU 201 of the information processing apparatus 101 executes the common information generation process shown in FIG. 18 (step S1902), and ends the process of step S1509.
<Description of FIG. 20>

  Next, processing executed by the form editor software 301 will be described with reference to the flowchart of FIG.

  FIG. 20 is a flowchart illustrating an example of detailed processing of step S1510 of FIG. 20 corresponds to the processing by the form editor software 301 shown in FIG.

  That is, it is realized by the CPU 201 of the information processing apparatus 101 executing a program read from the ROM 202 or the external memory 211 to the RAM 203. In the figure, S2001 to S2002 indicate each step.

First, the CPU 201 of the information processing apparatus 101 generates data (here, “circle”) indicating that a character recognition process for recognizing a circled character is executed as a type to be recognized (step S2001). The data generated here is stored in the OCR definition table of the object shown in FIG. Next, the CPU 201 of the information processing apparatus 101 executes the common information generation process shown in FIG. 18 (step S2002), and ends the process of step S1510.
<Description of FIG. 21>

  Next, processing executed by the form editor software 301 will be described with reference to the flowchart of FIG.

  FIG. 21 is a flowchart showing an example of detailed processing of the processing in step S1511 of FIG. FIG. 21 corresponds to the processing by the form editor software 301 shown in FIG.

  That is, it is realized by the CPU 201 of the information processing apparatus 101 executing a program read from the ROM 202 or the external memory 211 to the RAM 203. In the figure, S2101 to S2102 indicate each step.

First, the CPU 201 of the information processing apparatus 101 generates data (here, “QR code”) indicating that a character recognition process for recognizing a two-dimensional code is executed as a type to be recognized (type) (step S2101). The data generated here is stored in the OCR definition table of the object shown in FIG. Next, the CPU 201 of the information processing apparatus 101 executes the common information generation process shown in FIG. 18 (step S2102), and ends the process of step S1511.
<Description of FIG. 22>

  Next, processing executed by the OCR software will be described with reference to the flowchart of FIG.

  FIG. 21 is a flowchart showing an example of a second control processing procedure in the system of the present invention, and corresponds to the processing by the OCR software shown in FIG. That is, it is realized by the CPU 201 of the information processing apparatus 101 executing a program read from the ROM 202 or the external memory 211 to the RAM 203. In the figure, S2201 to S2204 indicate steps.

  The CPU 201 of the information processing apparatus 101 reads the form OCR definition table (FIG. 9) and the object OCR definition table (FIG. 10) from the storage unit 308 (step S2201), and reads the form OCR definition table (FIG. 9). And the data in the object OCR definition table (FIG. 10) are set for OCR (step S2202).

  Then, OCR is executed using the data set in step S2202 (step S2203), the recognition result is output to be stored in the storage unit (step S2204), and the process is terminated. The form editor software reads and outputs (displays, prints, etc.) the stored recognition result.

  As described above, according to the present embodiment, the attribute information by the user is generated by generating the attribute information for the target area for executing the OCR process according to the attribute information of the object input to create the template data. Information input work can be reduced.

  <Description of FIG. 24>

  Next, a mechanism for adding data recognition information (OCR definition information) with a two-dimensional barcode (QR code) to a print sheet of form form data when printing a form will be described with reference to FIG.

  FIG. 24 is a screen diagram illustrating an example of a form print setting screen displayed when a form form data print instruction is issued. This form print setting screen is an example of a print setting screen displayed on the display unit by the form form data application program (form editor software 301) when printing the form form data.

  In this form print setting screen, when the “print with OCR definition added” check box 2401 is checked, the OCR definition information, which is data recognition information, is printed on the form form data print sheet as a QR code that is a two-dimensional barcode. It can be instructed to add and print as a code. Also, by checking the “OCR definition: print on back side” check box 2402, it is possible to instruct to print the QR code of the OCR definition information, which is data recognition information, on the back side of the printing paper of the form form data. Without this check, the QR code of the OCR definition information is arranged and printed at a predetermined position (for example, the lower right position) on the surface of the printing paper of the form form data.

  Note that the “OCR definition: print on back side” check box 2402 is not an essential item, and the QR code may be fixedly printed on the back side without having this item.

  The OCR definition information, which is data recognition information, includes information on the OCR definition table of the form in FIG. 9 and information on the OCR definition table of the object in FIG. In this embodiment, a QR code of a two-dimensional barcode is used as a target for embedding restoration information. However, the present invention is not limited to this, and an RF-ID tag is attached to printing paper, and its writing function If the printer is equipped with a printer, restoration information may be recorded on the RF-ID tag, or other information addition function may be used. Hereinafter, in this embodiment, an example using a QR code will be described.

  <Description of FIG. 25>

  Next, print data generation processing in the information processing apparatus when a form print instruction is issued will be described with reference to FIG.

  FIG. 25 is a flowchart showing an example of a form print processing procedure in the information processing apparatus of the present invention.

  Each step shown in FIG. 25 is realized by the CPU 201 of the information processing apparatus 101 loading a program stored in a memory such as the external memory 211 into the RAM 203 and executing the program.

  First, in step S2501, the form editor software 301 generates print data of form form data using form form data (frame line, form definition table 310, object definition table 311) generated by a user operation. Specifically, when the user receives selection of an output destination printer, print data in PDL format or image data format that can be printed by the output destination printer is generated according to the form data generated by the user operation. .

  In step S2502, it is determined whether or not printing is performed by adding OCR definition information to the generated print data. That is, whether or not it is specified to generate print data by adding OCR definition information that is data recognition information according to a user instruction (check box 2401 is already checked) via the print setting screen (FIG. 24). judge. If it is determined that print data is generated by adding OCR definition information (YES), the process proceeds to step S2503, and if it is determined that print data is generated without adding OCR definition information (NO). Then, the process proceeds to step S2505.

  In step S2503, the storage unit 308 stores information on the OCR definition table of the form in FIG. 9 and information on the OCR definition table of the object in FIG. 10 corresponding to the form form data selected by the user and requested to be printed. A QR code that is a two-dimensional barcode including these information and printer individual identification information (printer individual identification information) (also referred to as printer identification information) for identifying the printer selected as the output destination by the user. Generate. Since the print data generation process is a control procedure of the form editor software 301, the OCR definition table (FIGS. 9 and 10) corresponding to the form data requested to be printed is specified by the form editor software 301 itself. To do.

  Here, the generated QR code includes a recognition area (coordinates) in the information of the object OCR definition table. Among these recognition areas (coordinates), a recognition area (coordinates) whose area name of the OCR target object in the OCR definition table of the object is a QR code is included in the QR code as standard print position coordinates. In addition, a range (error range) that allows an error between the print position coordinates of the QR code of the actually printed form and the standard print position coordinates is set in the information processing apparatus in advance. Stored in memory. Here, a QR code including this error range is generated.

  In step S2504, the OCR definition information (QR code) of the two-dimensional barcode generated in step S2503 is added to the print data of the form form data. Here, the QR code is added to the area where the object type of the object definition table (FIG. 8) is set to “placement” of “output area (QR code)” (the object OCR definition table of FIG. 10). The area name of the OCR target object is arranged in the recognition area for “QR code”.

  In this way, the OCR definition information (QR code) of the two-dimensional barcode is converted into a predetermined position on the surface of the print data of the form form data (the object definition table (FIG. 8) or the QR code defined in the object OCR definition table). To be placed).

  In step S2505, the print data to which the QR code is added in step S2504 is output for printing by the printer. The output destination may be directly transmitted to the multifunction peripheral 103 (printer), or may be output to the print server and transferred from the print server to the printer for printing. Then, the multifunction machine 103 (printer) prints the print data received from the information processing apparatus, and outputs form-printed printing paper.

  In the print data transmitted in step S2505, identification information for identifying the form form data is printed on the surface on which the form form data is printed.

  That is, when print data is generated in step S2501, identification information for identifying form form data is included in the print data.

  By reading and recognizing the identification information for identifying the form data by the scanner unit, it is possible to identify the form form data printed on the printing paper, and the corresponding OCR definition information is represented by the OCR in FIGS. It can be specified from the definition table.

  As described above, the print data obtained by adding the QR code including the OCR definition information (data recognition information) generated in step S1404 to the position indicated in the QR code recognition area in the OCR definition information by the process of FIG. Is generated.

  <Description of FIG. 26>

  Next, a data recognition process in the information processing apparatus in which the printing paper on which the form is printed is read by the image reading unit (scanner) and the read data is input will be described with reference to FIG.

  FIG. 26 is a flowchart showing an example of a data recognition processing procedure in the information processing apparatus of the present invention.

  Each step shown in FIG. 26 is realized by the CPU 201 of the information processing apparatus 101 loading a program stored in a memory such as the external memory 211 into the RAM 203 and executing it.

  In step S2601, an image, which is a result of reading a form printing paper (form paper) with a scanner device (image reading unit (scanner)) (not shown), is input and stored in the storage unit. That is, the image data obtained by reading the printing paper on which the position information indicating the position of the area for performing the data recognition process is printed is stored. The scanner device may be directly connected to the information processing device via an I / F, or may receive an image read by a scanner unit of a multifunction peripheral that can communicate via a network via network communication.

  Next, in step S2602, all the data in the QR code included in the image input in step S2601 and stored in the storage unit is read and acquired. That is, here, from the QR code, the position of the area where the data recognition process is performed and the position where the QR code is arranged are acquired together with the position of the area where the data recognition process is performed.

  In step S2603, the data read from the QR code is analyzed, and it is determined whether or not the OCR definition information is included in the data. If it is determined that the OCR definition information is included (YES), the process proceeds to step S2604. If it is determined that the OCR definition information is not included (NO), the process proceeds to step S2606. Proceed.

  In step S2604, the image input in step S2601 is analyzed to detect the position where the QR code is printed on the form paper (printing paper) (the position of the area where the data recognition process is performed), and the coordinates of the position ( Get the print position coordinates).

  Here, the print position coordinates are the coordinates (X, Y) of the upper left vertex and the coordinates (X, Y) of the lower right vertex of the QR code printed on the form paper.

  In step S2605, the difference between the print position coordinates acquired in step S2604 and the standard print position coordinates acquired from the QR code in step S2602 is calculated, and the difference is the error range (from the QR code in step S2602) ( It is determined whether it is within a predetermined range.

  If it is determined in step S2605 that the difference is within the error range (YES), the process proceeds to step S2609. On the other hand, if it is determined in step S2605 that the difference exceeds the error range (NO), a correction amount for correcting the coordinates of the region where the OCR processing is performed is calculated according to the difference (step S2607). Detailed processing in step S2605 will be described later with reference to FIG. Then, the recognition area of the OCR definition information read from the QR code in step S2602 is corrected by the correction amount calculated in step S2607 (step S2608), and the process proceeds to step S2609.

  That is, in step S2608, the data recognition process (OCR process) acquired in step S2602 is performed according to the position where the QR code detected in step S2604 is arranged and the position of the QR code acquired in step S2602. The position of the area (OCR definition information) is corrected (correction means).

  In step S2609, if it is determined in step S2605 that it is within the error range (YES), the image input in step S2601 using the data (OCR definition information) of FIGS. 9 and 10 read in step S2602 is used. OCR processing (data recognition processing) is executed. That is, OCR processing (data recognition processing) is performed on the image data area indicated in the OCR definition information.

  In step S2609, if it is determined in step S2605 that the error range has been exceeded (NO), data including the OCR definition information corrected in step S2608 (data in FIGS. 9 and 10) is used. OCR processing (data recognition processing) of the image input in step S2601 is executed.

  The OCR definition information includes the coordinates of the recognition area, and the OCR process is performed on the area indicated by the coordinates. By correcting the coordinates of the recognition area in step S2608 according to the deviation of the printing position of the form paper by the printer, it is possible to execute the data recognition process with high accuracy.

  Then, the information processing apparatus outputs the result of the OCR process in step S2609 to the display unit and ends.

  If it is determined in step S2603 that the data read from the QR code does not include OCR definition information (NO), the process proceeds to step S2606, and the process of the flowchart illustrated in FIG. 22 is performed. Execute and finish the process.

  If the OCR definition additional information is not given, in the flowchart shown in FIG. 22, in step S2201, the form form data is converted using the form identification information printed on the form form data print form (form form). The OCR definition table shown in FIGS. 9 and 10 corresponding to the identified form data is read from the storage unit 308.

  In step S2202, the data in the read form OCR definition table (FIG. 9) and the object OCR definition table (FIG. 10) are set for OCR. Then, OCR is executed using the data set in step S2202 (step S2203), the recognition result is output to be stored in the storage unit (step S2204), and the process is terminated.

Further, in step S2601, the case where the input image (data) is enlarged or reduced can be considered. Therefore, after executing the process of step S2604, it is determined whether or not the input image has been enlarged or reduced. If it is determined that the input image has not been enlarged or reduced, the process proceeds to step S2605 to enlarge the image. Alternatively, when it is determined that the image has been reduced, the standard print position coordinates acquired in step S2602, the error range, and the print position coordinates acquired in step S2604 are corrected based on the enlargement / reduction ratio (%). The process may be shifted to step S2605. By adding such processing, even when the input image (data) is enlarged or reduced, it is possible to appropriately correct the deviation and improve the accuracy of the recognition processing.
<Description of FIG. 27>

  Next, with reference to FIG. 27, detailed processing of the printer printing position deviation correction processing shown in step S2607 shown in FIG. 26 will be described.

  Each step shown in FIG. 27 is realized by the CPU 201 of the information processing apparatus 101 loading a program stored in a memory such as the external memory 211 into the RAM 203 and executing it.

  FIG. 27 is a flowchart showing detailed processing of the printer printing position deviation correction processing shown in step S2607 shown in FIG.

  Each step shown in FIG. 27 is realized by the CPU 201 of the information processing apparatus 101 loading a program stored in a memory such as the external memory 211 into the RAM 203 and executing it.

  The information processing apparatus calculates a correction amount for correcting the coordinates of the recognition area of the OCR definition information acquired from the QR code in step S2602 from the difference between the standard print position coordinates acquired from the QR code in step S2602 and the print position coordinates. (Step 2701). In step S2608, the coordinates of the recognition area of the OCR definition information are corrected according to the correction amount calculated here. Here, further, the correction amount may be calculated in consideration of the clear area, the size of the image data, and the like so that the recognition area falls within the image data area.

In step S2702, the information processing apparatus determines whether to notify the printer management server 104 in accordance with a user operation instruction (step S2702). That is, when an instruction to notify the printer management server 104 is received by a user operation (S2702: YES), the printer individual identification information is acquired from the QR code (step S2703), the printer individual identification information, The difference between the standard print position coordinates and the print position coordinates is transmitted to the printer management server 104 (step S2704). Then, the process returns to step S2608.
<Description of FIG. 28>

  Next, a printer print position adjustment process executed by the printer management server 104 will be described with reference to FIG.

  FIG. 28 is a flowchart illustrating printer print position adjustment processing executed by the printer management server 104.

  Each step shown in FIG. 28 is realized by the CPU 201 of the printer management server 104 loading a program stored in a memory such as the external memory 211 into the RAM 203 and executing it.

  When receiving the printer individual identification information and the difference between the standard print position coordinates and the print position coordinates from the information processing apparatus 101 (step S2801), the printer management server 104 corresponds to the printer individual identification information (the printer individual identification Printer management information (including information) is acquired from the printer management table (FIG. 29) (step S2802). Here, the printer management information is information on a record in the printer management table (FIG. 29).

  The printer management table (FIG. 29) is stored in the external memory of the printer management server 104.

  FIG. 29 is a diagram illustrating an example of a printer management table.

  The printer management table includes “No”, “Individual identification information”, “Manufacturer”, “Model”, “Type”, “Installation location”, “IP address”, “Remote print adjustment”, “Maintenance startable time”, It consists of items such as “notification destination” and “administrator”.

“No” is identification information for identifying printer management information (record). “Individual identification information” is an item in which printer individual identification information for identifying a printer is stored. “Manufacturer” is an item in which the name of the manufacturer that manufactures the printer is stored. “Model” is an item in which the model name of the printer is stored. “Type” is an item in which a name indicating the type of the printer (multifunction machine, monochrome LBP (monochrome laser printer), color LBP (color laser printer), etc.) is stored. “Installation location” is an item in which information indicating a location where the printer is installed is stored. “IP address” is an item in which the IP address of the printer is stored. “Remote printing adjustment” is an item in which information (whether or not) indicating whether or not the printer can perform remote printing position adjustment is stored. The “maintenance startable time” is an item in which the print position adjustment execution startable time is stored. The “notification destination” is an item in which an e-mail address that is a notification destination to be notified to the administrator (user performing maintenance) of the printer is stored. That is, the “notification destination” stores a mail address to be transmitted to the administrator terminal operated by the administrator who manages the printer. “Administrator” is an item in which the name of the administrator (user performing maintenance) of the printer is stored.

  When the printer management server 104 acquires the corresponding printer management information from the printer management table (FIG. 29) in step S2802, whether the item “remote print adjustment” included in the printer management information is “permitted”. “No” is determined (step S2803). That is, it is determined whether or not the printer can perform remote print position adjustment.

  If it is determined in step S2803 that the item “remote printing adjustment” is “possible” (determined as a printer capable of performing remote printing position adjustment) (YES), the printer management server 104 performs processing. If the “remote print adjustment” item is determined as “No” (determined as a printer that cannot perform remote print position adjustment) (NO), the process proceeds to step S2806.

  In step S 2804, the printer management server 104 is identified by the printer individual identification information received in step S 2801 after the print position adjustment execution start time indicated by “maintenance start possible time” included in the acquired printer management information. Generate and register a command (remote print position adjustment command) for adjusting the print position of the printer. The command generated here is a command that is received in step S2801, and that corrects the printing position by the difference between the standard printing position coordinates and the printing position coordinates.

  The printer management server 104 then identifies the generated command (remote print position adjustment command) after the print position adjustment execution start time indicated in the “maintenance start possible time” by the printer individual identification information. Is registered in the schedule so as to be transmitted, and the schedule is started (step S2805). When the scheduled time (maintenance startable time) is reached, the printer management server 104 transmits the generated command to the printer, and the printer that has received the command corrects the print position according to the command. Execute.

  That is, a command including a difference between the standard print position coordinates and the print position coordinates is identified by the printer identification information in order to instruct correction of the print position in the printer identified by the printer individual identification information (printer identification information). (Sending means).

  In step S <b> 2806, the printer management server 104 includes an e-mail address that is a notification destination to be notified to the printer administrator (user who is performing maintenance) in the “notification destination” included in the printer management information acquired in step S <b> 2802. Is determined (registered), and if it is determined that the e-mail address is included (YES), an e-mail indicating an adjustment request is transmitted to the e-mail address (step S2807). ). The e-mail transmitted in step S2807 includes the printer management information acquired in step S2802 and the difference between the standard print position coordinates and the print position coordinates received in step S2801.

  On the other hand, in step S2806, if the “notification destination” included in the printer management information acquired in step S2802 does not include a mail address that is a notification destination to be notified to the printer administrator (user who is performing maintenance). If it is determined (NO), in step S2704, the fact is returned to the information processing apparatus that has transmitted the printer identification information and the difference between the standard print position coordinates and the print position coordinates, and the process is terminated.

  In the present embodiment, the process of each step shown in FIG. 28 has been described as being executed by the printer management server. However, the process of each step shown in FIG. 28 may be executed by the information processing apparatus 101. . In this case, in step S2704, the printer individual identification information and the difference between the standard print position coordinates and the print position coordinates are not transmitted to the printer management server 104, but are transmitted to the information processing apparatus 101 of their own. That's fine.

  As described above, according to the present invention, printed on the printing paper obtained by analyzing the image data obtained by reading the printing paper on which the position information indicating the position of the area where the data recognition process is performed is printed. The accuracy of the data recognition process can be improved by correcting the position of the area where the data recognition process is performed according to the position of the area where the data recognition process is performed and the position indicated by the position information included in the image data. it can.

  In addition, according to the present embodiment, the OCR definition information for the field area to be subjected to OCR processing is generated using the setting contents set when the form form data is generated, and the generated OCR definition information is converted into a QR code. The data recognition information is prepared in advance in the information processing device that performs the data recognition information input process of the field area by the user and the data recognition processing. This can reduce the burden on the administrator.

  That is, the data recognition information (OCR definition information) is automatically generated using the attribute information (character type, character size, etc.) of the data written in the field area set when the form form data is generated, and the generated data recognition information Is added to the form form data to generate print data of the form form data. Thereby, since the data recognition information is added to the printing paper of the form form data, the data recognition information can be acquired only by reading the printing paper, and the accuracy of the data recognition processing (OCR processing) is increased.

  Although one embodiment of the present invention has been described in detail above, the present invention can take an embodiment as, for example, a system, an apparatus, a method, a program, or a storage medium. You may apply to the system comprised from an apparatus, and may apply to the apparatus which consists of one apparatus.

  Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the storage medium. Needless to say, this can also be achieved by reading and executing the program code stored in.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code itself and the storage medium storing the program code constitute the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (basic system or operating system) running on the computer based on the instruction of the program code. Needless to say, a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion board or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  In addition, each process realized by the above-described software can be realized as firmware or hardware configuration, and each process can be realized as each means. The technical scope of the present invention is realized by such firmware or hardware configuration. Is also included.

101 Information processing apparatus 102 Information processing apparatus 103 MFP

104 Printer management server 105 Network

Claims (8)

An information processing apparatus comprising storage means for storing image data obtained by reading a print sheet on which position information indicating the position of an area for performing data recognition processing is printed,
Detecting means for analyzing the image data stored in the storage means to detect the position of the area printed on the printing paper and performing the data recognition process;
An acquisition means for acquiring the position of the area for performing the data recognition processing indicated by the position information by reading the position information included in the image data stored in the storage means;
Correction means for correcting the position acquired by the acquisition means according to the position detected by the detection means and the position acquired by the acquisition means;
Data recognition means for performing data recognition processing on an area of image data stored in the storage means, which is indicated by a position obtained by correction by the correction means;
An information processing apparatus comprising: The storage means stores image data obtained by reading the print sheet printed at the position of the print sheet indicated by the position information, the position information indicating the position of the area where the data recognition process is performed,
The detection means detects the position of the position information printed on the printing paper by analyzing the image data stored in the storage means,
2. The information processing according to claim 1, wherein the acquisition unit acquires the position indicated by the position information by reading the position information included in the image data stored in the storage unit. apparatus. Determining means for determining whether a difference between the position detected by the detecting means and the position acquired by the acquiring means exceeds a predetermined range;
The correction means is the detection means when the determination means determines that the difference between the position detected by the detection means and the position acquired by the acquisition means exceeds a predetermined range. The information processing apparatus according to claim 1, wherein the position acquired by the acquisition unit is corrected according to the detected position and the position acquired by the acquisition unit. The storage means stores image data obtained by reading a print sheet on which position information indicating a position of a region where data recognition processing is performed and printer identification information for identifying a printer to be printed are printed;
The acquisition unit acquires printer identification information for identifying a printer on which the printing paper is printed by reading image data stored in the storage unit;
Information indicating a difference between the position detected by the detection unit and the position acquired by the acquisition unit in order to instruct correction of the print position in the printer identified by the printer identification information acquired by the acquisition unit. A transmission means for transmitting;
The information processing apparatus according to claim 1, further comprising:   The transmission unit detects the printer identification information acquired by the acquisition unit and the detection unit on an administrator terminal operated by an administrator who manages the printer identified by the printer identification information acquired by the acquisition unit. The information processing apparatus according to claim 4, wherein the information processing apparatus transmits information indicating a difference between the position and the position acquired by the acquisition unit. Field setting means for setting a field area indicating an area in which data is written in the form form data;
Attribute setting means for setting attribute information of data written in the field area set by the field setting means;
Data recognition information generating means for generating data recognition information used in data recognition processing of the field area of the printing paper of the form form data from the attribute information of the field area set by the attribute setting means;
Print data generating means for generating print data by adding the data recognition information generated by the data recognition information generating means;
Output means for outputting the print data generated by the print data generation means for printing;
Further comprising
The data recognition information generating means generates data recognition information including position information indicating the position of the area where data recognition processing is performed, from the attribute information of the field area set by the attribute setting means,
6. The print data generation unit generates the print data by adding the data recognition information generated by the data recognition information generation unit to the position indicated by the position information. The information processing apparatus according to claim 1. A method for controlling an information processing apparatus including a storage unit that stores image data obtained by reading a print sheet on which position information indicating a position of an area for performing data recognition processing is printed,
A detecting step of detecting a position of an area on which the data recognition processing is performed, which is printed on the printing paper, by analyzing the image data stored in the storage unit, and a detecting unit of the information processing apparatus;
The acquisition unit of the information processing apparatus acquires the position of the area for performing the data recognition process indicated by the position information by reading the position information included in the image data stored in the storage unit. Acquisition process;
A correction step in which the correction means of the information processing apparatus corrects the position acquired in the acquisition step according to the position detected in the detection step and the position acquired in the acquisition step;
A data recognition step of performing a data recognition process on an area of image data stored in the storage unit, which is indicated by a position obtained by the data recognition unit of the information processing device being corrected in the correction step;
An information processing apparatus control method comprising: A program that can be executed by an information processing apparatus including a storage unit that stores image data obtained by reading a print sheet on which position information indicating a position of an area for performing data recognition processing is printed.
The information processing apparatus;
Detecting means for analyzing the image data stored in the storage means to detect the position of the area printed on the printing paper and performing the data recognition process;
An acquisition means for acquiring the position of the area for performing the data recognition processing indicated by the position information by reading the position information included in the image data stored in the storage means;
Correction means for correcting the position acquired by the acquisition means according to the position detected by the detection means and the position acquired by the acquisition means;
A program that functions as a data recognition unit that performs a data recognition process on an area of image data stored in the storage unit that is indicated by a position obtained by correction by the correction unit.

Images