JP2011061358A - Apparatus and program for processing information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processing apparatus which prevents a problem that it is not possible to discriminate whether an information image and a pixel block fit in an image. <P>SOLUTION: An image read means of the information processing apparatus reads the image, an extraction means extracts information from the information image embedded in the image read by the image read means, a first inspection means inspects whether the information extracted by the extraction means and the pixel block in a predetermined position relation with a region with the information image fit. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information processing apparatus and an information processing program.

  Patent Document 1 aims to provide a form totaling apparatus that does not cause an increase in the amount of programs. The form totaling apparatus is an item composed of a detailed item composed of an arbitrary number of items and a total item of the detailed items. A group is associated with a code, and the total item is stored with a unique code, and a storage unit that stores the aggregate value of the detail item, and a detail associated with the code to be newly aggregated If each item value is read and each code of the item group is referred to and the code is a unique code, the total value of the item is stored in the storage means as a total value, and the code must be a unique code For example, it is necessary to change the basic program every time a form to be processed is different. Whilst the increase in program amount, it is disclosed that it is possible to perform rapid aggregation process while eliminating the increase in development steps.

  Further, it is an object of Patent Document 2 to provide a falsification detection apparatus and a falsification detection method for a print document that can reliably and easily detect a falsification position in a print document and can also correct the falsification. A tamper detection device for a print document in which at least a part of the description is embedded as a digital watermark in the background, the read unit for reading the print document and generating an image of the print document, and a digital watermark embedded in the print document A watermark detection unit for detecting the description content, a first display frame relating to the image of the print document, and a second display frame relating to the description content in an incomparable state, Since the user can visually compare the contents of the document information and the image of the printed document, and can know the information before the tampering, data by tampering It discloses that it is possible to prevent loss.

Japanese Patent Laid-Open No. 07-098736 JP 2004-343523 A

  An object of the present invention is to provide an information processing apparatus and an information processing program that prevent the problem that it is impossible to determine whether or not an information image in an image matches a pixel block.

The gist of the present invention for achieving the object lies in the inventions of the following items.
The invention of claim 1 is an image reading means for reading an image, an extracting means for extracting information from an information image embedded in an image read by the image reading means, information extracted by the extracting means, An information processing apparatus comprising: a first inspection unit that inspects whether or not a region where the information image exists and a pixel block having a predetermined positional relationship are matched.

  The invention of claim 2 is characterized in that the extraction means includes item information that is information related to an item from the information image embedded in the image read by the image reading means, and series information that is a series of information arranged systematically. , Extracting the relationship information indicating the relationship between the item information and the sequence information, and when the inspection result of the first inspection means is suitable, based on the relationship information, the item information and the sequence information The information processing apparatus according to claim 1, further comprising a second inspection unit that inspects the relationship.

  According to a third aspect of the present invention, when the item information includes a calculation formula, the second checking means applies the series information to the calculation formula based on the relation information and performs an inspection using the calculation formula. The information processing apparatus according to claim 2.

  The invention of claim 4 further comprises third inspection means for inspecting whether or not the image has been modified based on a pixel block around an area where the information image embedded in the image exists. When the second inspection unit is suitable as the inspection result of the first inspection unit and is not modified as the inspection result of the third inspection unit, the item information and the 4. The information processing apparatus according to claim 2, wherein the relationship of the series information is inspected.

  According to a fifth aspect of the present invention, there is provided a computer, an image reading means for reading an image, an extracting means for extracting information from an information image embedded in an image read by the image reading means, and the extraction means An information processing program that causes information to function as a first inspection unit that inspects whether or not a region in which the information image is present matches a pixel block having a predetermined positional relationship.

  According to the information processing apparatus of the first aspect, it is possible to determine whether or not the information image in the image matches the pixel block.

  According to the information processing apparatus of the second aspect, the relationship between the item information and the sequence information can be inspected.

  According to the information processing apparatus of the third aspect, even when the item information includes a calculation formula, it is possible to perform inspection by applying the corresponding series information.

  According to the information processing apparatus of the fourth aspect, it is possible to inspect the alteration caused by the pixel block around the information image.

  According to the information processing program of the fifth aspect, it is possible to determine whether or not the information image in the image matches the pixel block.

It is a conceptual module block diagram about the structural example of this Embodiment (document output device). It is a flowchart which shows the process example of a document output device. It is explanatory drawing which shows the example of a document. It is explanatory drawing which shows the example of the table | surface with an embedded information image in a document. It is explanatory drawing which shows the example of the type | formula with an embedded information image in a document. It is a conceptual module block diagram about the structural example of this Embodiment (document inspection apparatus). It is a flowchart which shows the process example of a document inspection apparatus. It is a block diagram which shows the hardware structural example of the computer which implement | achieves this Embodiment.

Hereinafter, an example of a preferred embodiment for realizing the present invention will be described with reference to the drawings.
The present embodiment is divided into a document output device and a document inspection device. FIG. 1 is a conceptual module configuration diagram of an exemplary configuration of the present embodiment (document output apparatus).
The module generally refers to components such as software (computer program) and hardware that can be logically separated. Therefore, the module in the present embodiment indicates not only a module in a computer program but also a module in a hardware configuration. Therefore, the present embodiment also serves as an explanation of a computer program, a system, and a method. However, for the sake of explanation, the words “store”, “store”, “hold”, and the equivalent are used. However, these words are stored in the storage device when the embodiment is a computer program. It is the control to be stored or stored in the storage device. In addition, the modules correspond almost one-to-one with the functions. However, in mounting, one module may be composed of one program, or a plurality of modules may be composed of one program. A plurality of programs may be used. The plurality of modules may be executed by one computer, or one module may be executed by a plurality of computers in a distributed or parallel environment. Note that one module may include other modules. Hereinafter, “connection” is used not only for physical connection but also for logical connection (data exchange, instruction, reference relationship between data, etc.).
In addition, the system or device is configured by connecting a plurality of computers, hardware, devices, and the like by communication means such as a network (including one-to-one correspondence communication connection), etc., and one computer, hardware, device. The case where it implement | achieves by etc. is included. “Apparatus” and “system” are used as synonymous terms. “Predetermined” means that the process is determined before the target process, and not only before the process according to this embodiment starts but also after the process according to this embodiment starts. In addition, if it is before the target processing, it is used in accordance with the situation / state at that time or with the intention to be decided according to the situation / state up to that point.

  The document output apparatus according to the present embodiment outputs a document in which an information image is embedded. As shown in the example of FIG. 1, a reception module 102, an item definition module 104, a series information definition module 106, a dependency It has a relationship definition module 108, a temporary storage module 110, a display module 112, a molding module 114, an area information calculation module 116, an embedded information generation module 118, an output module 120, and an output device 122.

The information image refers to an image code that is systematically created to represent electronic data in a machine-readable manner, and specifically includes a one-dimensional bar code, a two-dimensional code, and the like. For example, there are glyph codes (for example, JP-A-6-103390 and JP-A-6-75795) that express data with oblique lines having different angles. The information image may be an invisible or an invisible information image. An information image that is invisible or equivalent to invisible is an information image that cannot be identified with the naked eye, or an information image that corresponds to the information image. That is, it is an information image that is not easily recognized by humans. For example, printing with toner that can be read only with light of a certain wavelength (for example, infrared rays).
In the present embodiment, item information, series information, and dependency relationship information, which will be described later, are represented by an information image.

  The receiving module 102 is connected to the temporary storage module 110 and receives document data and transmits it to the temporary storage module 110. Here, the document data includes at least text data, and in some cases includes electronic data such as images, moving images, and audio, or a combination thereof, and is subject to storage, editing, search, etc., between systems or users. Those that can be exchanged as individual units, including those similar to these. In the case of an image, text recognition processing is performed to generate text data.

The item definition module 104 is connected to the temporary storage module 110, receives designation of an item that requires confirmation of numerical values and texts, an item that is referred to by a dependency relationship, and transmits the designation to the temporary storage module 110.
The series information definition module 106 is connected to the temporary storage module 110, receives designation of a series of numerical strings and symbol strings such as columns and rows in the table, and transmits them to the temporary storage module 110.
The dependency relationship definition module 108 is connected to the temporary storage module 110, presents a predetermined dependency relationship type, accepts a user's selection, and determines which items and series information according to the selected dependency relationship type. Is received, and is transmitted to the temporary storage module 110 together with dependency type information.

The temporary storage module 110 is connected to the reception module 102, the item definition module 104, the series information definition module 106, the dependency relationship definition module 108, the display module 112, the molding module 114, and the area information calculation module 116. Document data, item information, sequence information, and dependency relationship information are received from the reception module 102, the item definition module 104, the sequence information definition module 106, and the dependency relationship definition module 108, and temporarily stored. Then, the document data, item information, series information, and dependency relationship information held are transmitted to the display module 112, the forming module 114, and the area information calculation module 116 as necessary.
The display module 112 is connected to the temporary storage module 110 and displays document data, item information, sequence information, and dependency relationship information held in the temporary storage module 110 on a display device such as a display.

  The molding module 114 is connected to the temporary storage module 110, the area information calculation module 116, and the output module 120. The document data held in the temporary storage module 110 is subjected to calculation for shaping for printing or display, for example, by allocating pages for printing, and shaping is performed. Specifically, for example, PDF (Portable Document Format) and print data are generated. Then, the print document data is transmitted to the area information calculation module 116 and the output module 120.

  The area information calculation module 116 is connected to the temporary storage module 110, the molding module 114, and the embedded information generation module 118. The item information, the series information, and the dependency relationship information are read from the temporary storage module 110, and the information (specifically, for example, page, Information of coordinates and range) is acquired and transmitted to the embedded information generation module 118.

  The embedded information generation module 118 is connected to the area information calculation module 116 and the output module 120. Based on the information transmitted from the area information calculation module 116, a calculation regarding a predetermined information embedding position is performed, and each embedding information and their arrangement information are created and transmitted to the output module 120.

The output module 120 is connected to the molding module 114, the embedded information generation module 118, and the output device 122. Information is received from the molding module 114 and the embedding information generation module 118, information to be output is created and transmitted to the output device 122.
The output device 122 is connected to the output module 120, receives output information from the output module 120, and prints it from a printing device such as a printer.

FIG. 2 is a flowchart illustrating a processing example of the document output apparatus.
In step S202, when the receiving module 102 receives document data, the item definition module 104 next selects an item for which automation of inspection is to be defined using a user interface (not shown). This selection is performed according to the user's operation. Item information that is information related to the item is generated from the selected information.

As the received document data, the document 300 shown in FIG. 3 will be described as an example. The document 300 includes a text area 310, a table 320, a table 330, a formula 340, and a table 350.
When, for example, the expression 340 shown in FIG. 3 is selected by the user's operation, the item definition module 104 changes the content of the selected expression 340 according to the type of received document data, for example, the corresponding part in the document data. For example, when the corresponding portion is image data, the information is acquired by performing extraction processing such as character recognition processing.

In the case of this formula 340, the item definition module 104 extracts character string information “formula 1” and calculation formula information “point = monthly sales / 100,000 × 1.2 + adjustment points”. In addition, the item type “Type: Point” for “Point” in the formula information, the item type “Type: Monthly Sales” and “Type: Sales” for “Monthly Sales”, and the item type for “Adjustment Point” Item type attributes of “type: adjustment point” and “type: point” are assigned respectively. The item type attribute may be instructed by the user using a user interface (not shown), or may be given according to a predetermined association rule.
In the case where the original data of the corresponding item is image data, the position information (coordinate information of which area of which page) and the calculation formula information are converted into the corresponding image data (item 1). For example, there is a method of extracting original image data, a method of generating print data according to calculation formula information, and the like. This selection may be made, for example, by comparing and evaluating the result of applying and applying a number of calculation method information conversion method options. Difference information from the original image in the method selected at this time is also stored in the temporary storage module 110.

  In step S204, the sequence information definition module 106 selects the sequence information for which inspection automation is to be defined using a user interface (not shown). This selection is performed according to the user's operation. Sequence information, which is a series of information arranged systematically from the selected information, is generated. Here, the series information refers to a series of information arranged in a system, and specifically, for example, information constituting a table. In step S204, for example, a table row or column in the document is designated.

  For example, the column of the table 330 shown in FIG. 3 (the table with the title “Table 2 Sales in D district”) is designated. Taking the column labeled “Store A” as an example, the sequence information definition module 106 has three items in the column information “Table 2 Store A” in the table information “Table 2” arranged in the vertical direction. “A1k yen”, “A2k yen”, “A3k yen”, and “January”, “February”, “3” as attributes for each item (“Monthly” column at the left end of the table) Extract that each month is given. The extraction of the information may be realized by combining table recognition techniques or the like, or may be specified by the user through a user interface (not shown). Further, the column information “Table 2 A store” extracts the item types “type: D district sales”, “type: sales”, and “type: A store”. The item type may be realized by applying a predetermined type correspondence rule to the extracted information, or may be given by the user through a user interface (not shown). For example, it may be simply realized by a method of dividing character string information from extracted information by morphological analysis and synthesizing a combination of morphemes according to a predetermined rule. At this time, the information of “Table 2” as the identification name and “Sales in D district” as the label are also given to the set of column information in Table 2.

In addition, the columns 320 and 350 shown in FIG. 3 are also extracted in the same manner as the table 330.
Further, regarding the table 320, the classification information (the column on the left side of Table 1) is interpreted so that “<100,000 × 1000 yen”, “<100,000 × 1000 yen”, “100,000 to 1,000,000”. An expression that can determine a numerical value such as “(≧ 100,000 × 1000) AND (<1,000,000 × 1000) yen” may be extracted for “000 k yen”. At this time, a conversion method for re-converting the extracted expression into the original character string is also selected from predetermined rules and held. This rule is realized by, for example, preparing a set of correspondences such that “{X} to {Y}” and “(≧ {X}) AND (<{Y})” correspond to each other. Also good. In the column information set of Table 320, “Table 1” as the identification name, “Adjustment Point” as the label, “Table 3” as the identification name in the column information set of Table 350, and “Point of each D district store” as the label Is given.
If the received document data is an image such as an image whose appearance and arrangement of components are fixed, area information including the position coordinates where each series information appears is extracted and held in the temporary storage module 110.

  In step S206, the dependency relationship definition module 108 selects dependency relationship information for which inspection automation is to be defined, using a user interface (not shown). This selection is performed according to the user's operation. Relation information indicating the relation between the item information and the series information is generated from the selected information.

  A part describing the relationship between item information and series information is specified from a character string in document data. For example, the explanatory text 315 shown in FIG. 5 (“Table 2 shows the sales of D district and Table 3 shows the points of each store in D district (the points are calculated by the formula 1 and the adjustment points of Table 1)”) is specified. Then, {A. Label} is indicated in {A. Distinguished Name} and {B. Label} is indicated in {B. Distinguished Name} from among the dependency templates prepared in advance in this part ({B. Item Type } Is selected from {C. Distinguished name} and {D. Distinguished name} based on {D. Item type}. This selection may be made by selecting the template description by examining the description of the template using the pattern matching method for sentences, paragraphs, labels, etc. that contain character strings such as tables and expressions, or by performing similarity calculations on character strings. The candidate may be selected and allowed to be selected by the user, or may be realized by the user selecting from a user interface (not shown).

Templates A, B, C, and D may be searched and selected from the defined item information and series information, or may be selected by the user via a user interface (not shown). In the example shown in FIG. 3, the correspondence is as follows.
A ... Series information: "Table 2: Store A", "Table 2: Store B", "Table 2: Store C"
B ... Series information: "Table 3: Store A", "Table 3: Store B", "Table 3: Store C"
C ... Item information: "Formula 1"
D: Series information: “Table 1: Adjustment”

In step S208, the area information calculation module 116 calculates area information. In accordance with the rasterization process of the code information performed at the time of the printing process, information on which page and in which area is drawn for each of the item information and the series information held in the temporary storage module 110 is displayed. Calculated. For example, the arrangement information may be realized by a method of calculating a circumscribed rectangle of an area in which the content of the item information is printed. For series information, a circumscribed rectangle for each item included in the series information and corresponding attribute information is also calculated and held.
For the dependency relationship information, a circumscribed rectangle or circumscribed polygon of an area where a character string representing the content is printed is obtained. When straddling a page or when an area is divided and arranged, each circumscribed rectangle or circumscribed polygon is obtained. In addition, for each series information or item information for which the above correspondence is detected, the calculated area information (page, position, range information) is acquired and associated and stored in the temporary storage module 110.

  In step S210, the embedded information generation module 118 performs an embedded information generation process. In addition to the information (identification name, label, value, attribute information, item type, conversion method information to print data, etc.) held by each item information, series information, and dependency relationship information, region information by the region information calculation module 116 An embedded information image corresponding to the area information calculated by the calculation process is generated.

In step S212, the output module 120 synthesizes the output information. The print information of the received document data is combined with the embedded information image generated by the embedded information generation module 118 to generate print data, which is transmitted to the output device 122. For example, the synthesis can be realized by a method of overwriting an embedded information image (or logical sum synthesis or the like) on print information of received document data. The placement position of the embedded information image may be a predetermined area such as a margin of the page, or may be a position where each item information, series information, dependency information is drawn or its peripheral position. Further, an embedded information image may be drawn so as to surround item information, series information, and dependency relationship information.
Then, the output device 122 prints the print data generated by the output module 120 on a medium such as paper. This printed document is a target to be inspected and confirmed later.

A document on which an information image is printed will be described. The table illustrated in FIG. 4A is an explanatory diagram illustrating an example of the embedded information image-added table 400 in the document. This is an information image overwritten on the table 320 of the document 300 illustrated in FIG. The section information 410 is overwritten with the embedded information images 411, 412, and 413, and the adjustment section 420 has embedded information images 421, 422, and 423.
The formula illustrated in FIG. 5A is an explanatory diagram illustrating an example of a formula 500 with an embedded information image in a printed document. This is an information image overwritten on the expression 340 of the document 300 illustrated in FIG. In this way, the embedded information image 501 is overwritten so as to surround the entire expression.

  A case where the printed document has been tampered with will be described. In the table illustrated in FIG. 4B, a change to add the falsified characters 422 b and 423 b in the adjustment column 420 is added. In addition, the expression illustrated in FIG. 5B is changed to add the falsified character 501b.

FIG. 6 is a conceptual module configuration diagram of an exemplary configuration of the present embodiment (document inspection apparatus).
The document inspection apparatus according to the present embodiment reads and inspects and confirms a document printed by the document output apparatus described above. As shown in the example of FIG. 6, a reading module 602, a holding module 604, an embedded information interpretation module 606, a dependency structure processing module 608, a read image processing module 610, an embedded information area processing module 612, a correspondence processing module 614, and a presentation module 616.

The reading module 602 is connected to the holding module 604 and the embedded information interpretation module 606. Read the image with a scanner. Moreover, you may perform a character recognition process accompanying the reading. Then, the image and character recognition result is transmitted to the holding module 604, the presence of the embedded information image is detected, and the image information is transmitted to the embedded information interpretation module 606.
The holding module 604 is connected to the reading module 602, the reading image processing module 610, and the presentation module 616. The image information transmitted from the reading module 602 is held and transmitted to the reading image processing module 610 and the presentation module 616 as necessary.

  The embedded information interpretation module 606 is connected to the reading module 602, the dependency relationship structure processing module 608, the read image processing module 610, the embedded information area processing module 612, and the correspondence relationship processing module 614. An embedded information image is read from the reading module 602, interpreted, and the interpretation results (item information, series information, dependency information extracted from the embedded information image) are temporarily stored, and a dependency structure processing module 608, as necessary. The read image processing module 610, the embedded information area processing module 612, and the correspondence relationship processing module 614 are transmitted.

  The read image processing module 610 is connected to a holding module 604, an embedded information interpretation module 606, an embedded information area processing module 612, and a correspondence processing module 614. In accordance with the instruction of the embedded information interpretation module 606, the instructed partial information is extracted from the image information read in the holding module 604 and the result of the character recognition process. An instruction of the embedded information interpretation module 606 includes taking out an image of an area where the embedded image information has been drawn. The extracted partial information is transmitted to the embedded information area processing module 612 and the correspondence processing module 614.

The embedded information area processing module 612 is connected to the embedded information interpretation module 606, the read image processing module 610, and the presentation module 616. It is checked whether the item information and the series information received from the embedded information interpretation module 606 match the area where the embedded information image exists and the pixel block having a predetermined positional relationship. Note that the pixel block includes at least a pixel area that is continuous in four or eight connections, and includes a set of these pixel areas. The set of these pixel areas means that there are a plurality of continuous pixel areas such as 4-connected, and the plurality of pixel areas are in the vicinity. Here, what is in the vicinity is, for example, an image area in which the pixel areas are close to each other in distance, an image area that is projected vertically or horizontally so as to cut out one character at a time from a line as a sentence, and cut out at a blank spot Or an image region cut out at a predetermined interval. This pixel block generally becomes a character image. The above-described processing may be employed to distinguish the image from noise.
More specifically, for example, the item information portion and the sequence information portion in the embedded information image with respect to the item information portion and the sequence information portion in the embedded information image received from the embedded information interpretation module 606. It is checked whether the image information received from 610 matches.
Further, the embedded information area processing module 612 may check whether the image of the document has been altered based on a pixel block around the area where the embedded information image exists in the image of the document. Good.
Then, the inspection result is transmitted to the presentation module 616.

  The dependency relationship structure processing module 608 is connected to the embedded information interpretation module 606 and the presentation module 616. Based on the dependency information received from the embedded information interpretation module 606, structure information that links the dependency relationships in the document is created, and information (including the inspection results) indicating the dependency structure in the document is created for the user. To do. Information indicating the dependency structure is transmitted to the presentation module 616.

The correspondence processing module 614 is connected to the embedded information interpretation module 606, the read image processing module 610, and the presentation module 616. When the inspection result of the embedded information region processing module 612 is appropriate, the relationship between the item information and the series information is inspected based on the dependency relationship information. In addition, when the item information includes a calculation formula, the series information may be applied to the calculation formula based on the dependency relationship information, and the examination based on the calculation formula may be performed. Further, the inspection result of the information and the image represented by the embedded information image by the embedded information region processing module 612 is compatible, and the inspection result regarding the surrounding pixel block by the embedded information region processing module 612 is “not modified”. In this case, the relationship between the item information and the series information may be inspected.
Specifically, for example, based on the dependency relationship information in the embedded image information received from the embedded information interpretation module 606, the read image processing module 610 performs processing according to the type and calculation formula of the dependency for each appearance of each relationship. The image information of the printed document is inspected. The inspection result is transmitted to the presentation module 616.

  The presentation module 616 is connected to the holding module 604, the dependency structure processing module 608, the embedded information area processing module 612, and the correspondence processing module 614. The image information of the document is received from the holding module 604, and the examination results from the dependency structure processing module 608, the embedded information area processing module 612, and the correspondence processing module 614 are displayed on a display device such as a display in association with the image information.

FIG. 7 is a flowchart illustrating a processing example of the document inspection apparatus.
In step S702, the reading module 602 reads a document printed on a medium through a scanner or the like.
In step S704, the embedded information interpretation module 606 performs an embedded image information interpretation process. When embedded image information is detected in the document image, the embedded image information is interpreted, and processing for extracting item information, series information, and dependency relationship information is performed. This process is a process of decoding embedded information, and is performed according to the employed information image embedding technique.

In step S706, the embedded information area processing module 612 performs area inspection processing. The embedded information area processing module 612 reads from the read image processing module 610 an image of the inspection relevant area in the document image (item information, a specified area in the series information, for example, an image of an area where the embedded information image was drawn). Receive. For each item information and series information extracted in step S704, information such as graphics and characters drawn in the area indicated by the read area information, and each item information and series information should be displayed. Check if the information is relevant. For example, for each item information and series information, print data is created according to a conversion method to print data that is predetermined or specified in the item information and series information. Then, the inspection is performed by comparing the created print data with the image in the corresponding area in the received document image. For comparison, for example, a difference is obtained by exclusive OR of both images, and a determination is made based on whether or not the difference is equal to or less than a predetermined threshold (if it is equal to or less than the threshold, it is suitable and greater than the threshold) In some cases, there is a possibility of falsification). The inspection result is transmitted to the presentation module 616. The information on the conversion method to print data may include parameters such as font size and type, character replacement rules, distance between characters, and distance between lines.
In addition to converting item information and series information to print data and comparing the print data with the image in the corresponding area in the document image, character recognition is performed on the image in the corresponding area in the document image. The character recognition result may be compared with item information and series information.

  In step S708, the embedded information area processing module 612 performs an inspection on the periphery of the area. In this inspection process, the surroundings of a predetermined range are examined for each inspection relevant region, and an inspection is made that no characters or symbols are arranged. For example, in the range of the area information shown in the embedded information images 422 and 423, like the second-stage falsified character 422b and the third-stage falsified character 423b in the adjustment column 420 illustrated in FIG. 4B. Even if the print data and the numerical value of the item match, this is a process for preventing the user from putting a mechanism that makes the information look like another value. For example, whether or not a rectangular or polygonal area specified by the area information is expanded by a predetermined distance vertically or horizontally, and whether or not pixel blocks such as symbols and numbers are arranged in the expanded area Perform the inspection process. Then, the inspection result is transmitted to the presentation module 616.

In step S710, the correspondence processing module 614 checks the correspondence. That is, the correspondence between the item information and the series information is inspected based on the dependency relationship information.
In the document 300 illustrated in FIG. 3, it is embedded in the explanation 315 that the sequence information of the table 320, the sequence information of the table 330, the sequence information of the table 350, and the item information of the expression 340 are associated as dependency relationship information. Described in the image information.
Among these, by calculating the matching type of attribute type information, attribute information, etc., for example, each item of the affiliate information of the store A in the table 350 is each of the affiliate information of the store A in the table 330. It is detected that each item is associated with the expression 340 and the series information in the adjustment column of the table 320.
The detected relationship is calculated according to the formula 340 and the table 320, the relational expression is confirmed (checking whether the calculation result and the sequence information in the table 350 are compatible), and according to the dependency information. Inspect whether the relation of the relational expression is confirmed. The inspection result is transmitted to the presentation module 616.

In step S712, the presentation module 616 outputs the examination result. For example, in addition to displaying information on a region where an abnormality has been detected by inspection on a display and showing it to the user, information on a region confirmed by inspection may be displayed and displayed on the user.
In particular, the dependency information created by the dependency structure processing module 608 is used to indicate the region confirmed by the inspection or the inspection of the dependency included in the text description in the document. It may be possible to indicate an area where no is performed. This is because the user can concentrate the attention on the area other than the area inspected by the present embodiment (document inspection apparatus).

  With reference to FIG. 8, a hardware configuration example of the document output apparatus and the document inspection apparatus according to the present embodiment will be described. The configuration shown in FIG. 8 is configured by a personal computer (PC), for example, and shows a hardware configuration example including a data reading unit 817 such as a scanner and a data output unit 818 such as a printer.

  A CPU (Central Processing Unit) 801 includes various modules described in the above-described embodiments, that is, a region information calculation module 116, a molding module 114, an embedded information generation module 118, an embedded information interpretation module 606, and a dependency structure processing module. Reference numeral 608 denotes a control unit that executes processing according to a computer program describing an execution sequence of each module such as a read image processing module 610, an embedded information region processing module 612, a correspondence processing module 614, and the like.

  A ROM (Read Only Memory) 802 stores programs used by the CPU 801, operation parameters, and the like. A RAM (Random Access Memory) 803 stores programs used in the execution of the CPU 801, parameters that change as appropriate during the execution, and the like. These are connected to each other via a host bus 804 including a CPU bus.

  The host bus 804 is connected to an external bus 806 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 805.

  A keyboard 808 and a pointing device 809 such as a mouse are input devices operated by an operator. The display 810 includes a liquid crystal display device or a CRT (Cathode Ray Tube), and displays various types of information as text or image information.

  An HDD (Hard Disk Drive) 811 includes a hard disk, drives the hard disk, and records or reproduces a program executed by the CPU 801 and information. The hard disk stores received document information, item information, series information, dependency information, an image of the read document, and the like. Further, various computer programs such as various other data processing programs are stored.

  The drive 812 reads out data or a program recorded in a removable recording medium 813 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and reads the data or program as an interface 807 or an external bus 806. , And supplied to the RAM 803 connected via the bridge 805 and the host bus 804. The removable recording medium 813 can also be used as a data recording area similar to a hard disk.

  The connection port 814 is a port for connecting the external connection device 815, and has a connection unit such as USB or IEEE1394. The connection port 814 is connected to the CPU 801 and the like via the interface 807, the external bus 806, the bridge 805, the host bus 804, and the like. The communication unit 816 is connected to a network and executes data communication processing with the outside. The data reading unit 817 is a scanner, for example, and executes document reading processing. The data output unit 818 is, for example, a printer, and executes document data output processing.

  Note that the hardware configuration of the document output device and the document inspection device shown in FIG. 8 shows one configuration example, and the present embodiment is not limited to the configuration shown in FIG. 8 and will be described in the present embodiment. Any configuration can be used as long as the module can be executed. For example, some modules may be configured with dedicated hardware (for example, Application Specific Integrated Circuit (ASIC), etc.), and some modules are in an external system and connected via a communication line In addition, a plurality of systems shown in FIG. 8 may be connected to each other via communication lines so as to cooperate with each other. Further, it may be incorporated in a copying machine, a fax machine, a scanner, a printer, a multifunction machine (an image processing apparatus having any two or more functions of a scanner, a printer, a copying machine, a fax machine, etc.).

  The dependency information template may be created by a user operation. For example, a frequently used expression pattern may be extracted and used by a method disclosed in Japanese Unexamined Patent Application Publication No. 2009-093402. It may be. Using the method disclosed in Japanese Patent Laid-Open No. 2009-093402, a plurality of actual data may be received, pattern extraction may be performed, and matching character strings may be extracted to the details of the expression. In other words, a module that divides each sentence to be processed into word strings and words included in the word strings obtained by the division are (1) independently of the word strings to be output. An independent element candidate word as an element candidate, (2) a postfix word as an element candidate of an output target word string together with an independent element candidate word in the same phrase, and (3) a concatenation to an independent element candidate word in the same phrase A pre-word as an element of the word string to be output, a module for extracting at least one of the independent element candidate words as an element candidate from the word string, and the extracted independent A module for extracting a word as an element candidate from a suffix word belonging to the same phrase as the element candidate word, a module for determining an output target word string including the extracted element candidate, and the determined output target word string A document processing module including It may be used as the location. The module for extracting at least one of the independent element candidate words as an element candidate is based on the number of times each of the independent element candidate words included in the word string appears in the sentence to be processed. At least one of the element candidate words may be extracted as an element candidate. Of the word string that concatenates the antecedent word and the independent element candidate word in the same phrase as the antecedent word, the number of times that appears in the sentence that is the processing target of the word string exceeds a predetermined number of times May be further included as a component candidate.

  In the present embodiment, table data is used as sequence information for simplicity of explanation, but sequence information expressed as a graph may be used. In the table, the position where each individual value in the series is arranged changes in a one-dimensional direction, and the print data of the value becomes a print image of characters and numbers, whereas in the graph, the placement position of each item is two-dimensional. Therefore, information in a two-dimensional position is held corresponding to each item. Also, the corresponding print data is not limited to numbers and characters, but may differ from the print data. In this embodiment, the print method information may be held in each data. You may make it respond | correspond as a variation of a system.

In this embodiment, the embedded image information is synthesized and output, and the document read later is described as a document printed on a medium such as paper. However, the document is an electronic print image such as PDF. May be.
The document output device and the document inspection device described above may be combined, and the technology described in the background art may be adopted as the processing content of each module.

The program described above may be provided by being stored in a recording medium, or the program may be provided by communication means. In that case, for example, the above-described program may be regarded as an invention of a “computer-readable recording medium recording the program”.
The “computer-readable recording medium on which a program is recorded” refers to a computer-readable recording medium on which a program is recorded, which is used for program installation, execution, program distribution, and the like.
The recording medium is, for example, a digital versatile disc (DVD), which is a standard established by the DVD Forum, such as “DVD-R, DVD-RW, DVD-RAM,” and DVD + RW. Standard “DVD + R, DVD + RW, etc.”, compact disc (CD), read-only memory (CD-ROM), CD recordable (CD-R), CD rewritable (CD-RW), Blu-ray disc ( Blu-ray Disc (registered trademark), magneto-optical disk (MO), flexible disk (FD), magnetic tape, hard disk, read-only memory (ROM), electrically erasable and rewritable read-only memory (EEPROM), flash Includes memory, random access memory (RAM), etc. .
The program or a part of the program may be recorded on the recording medium for storage or distribution. Also, by communication, for example, a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a wired network used for the Internet, an intranet, an extranet, etc., or wireless communication It may be transmitted using a transmission medium such as a network or a combination of these, or may be carried on a carrier wave.
Furthermore, the program may be a part of another program, or may be recorded on a recording medium together with a separate program. Moreover, it may be divided and recorded on a plurality of recording media. Further, it may be recorded in any manner as long as it can be restored, such as compression or encryption.

DESCRIPTION OF SYMBOLS 102 ... Reception module 104 ... Item definition module 106 ... Series information definition module 108 ... Dependency definition module 110 ... Temporary storage module 112 ... Display module 114 ... Molding module 116 ... Area information calculation module 118 ... Embedded information generation module 120 ... Output module DESCRIPTION OF SYMBOLS 122 ... Output device 602 ... Reading module 604 ... Holding module 606 ... Embedded information interpretation module 608 ... Dependency structure processing module 610 ... Reading image processing module 612 ... Embedded information area processing module 614 ... Corresponding relationship processing module 616 ... Presentation module

Claims (5)

Image reading means for reading an image;
Extracting means for extracting information from an information image embedded in the image read by the image reading means;
1st inspection means which inspects whether information extracted by the extraction means and a pixel block having a predetermined positional relationship with a region where the information image exists are matched. Information processing apparatus. The extraction means includes, from the information image embedded in the image read by the image reading means, item information that is information about items, series information that is a series of information arranged in a systematic manner, the item information and the series Extract relationship information that shows the relationship with the information,
2. The apparatus according to claim 1, further comprising: a second inspection unit that inspects a relationship between the item information and the sequence information based on the relationship information when the inspection result of the first inspection unit is suitable. Item 4. The information processing apparatus according to Item 1. The said 2nd test | inspection means applies the said series information to this calculation formula based on the said relationship information, and performs the test | inspection by this calculation formula, when the said item information contains a calculation formula. The information processing apparatus described. A third inspection unit for inspecting whether or not the image has been modified based on a pixel block around a region where the information image embedded in the image exists;
When the second inspection means is suitable as the inspection result of the first inspection means and is not modified as the inspection result of the third inspection means, the item information and the series information The information processing apparatus according to claim 2, wherein the information processing apparatus is inspected. Computer
Image reading means for reading an image;
Extracting means for extracting information from an information image embedded in the image read by the image reading means;
It is made to function as a first inspection means for inspecting whether or not the information extracted by the extraction means and a region where the information image is present match a pixel block having a predetermined positional relationship. Information processing program.

Images