JP2011171786A - Image processing apparatus and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus for more efficiently generating identification information than an apparatus not having this configuration, when information image including the identification information and coordinate information is composed into image information. <P>SOLUTION: A receiving means of the image processing apparatus receives image information and information about an output medium in the case where the image information is outputted. An identification information generating means generates identification information for identifying the image information for each kind of information about the output medium which has been received by the receiving means. An information image generating means generates an information image including the identification information generated by the identification information generating means and coordinate information of the information image to be composed into the image information. A composing means composes the image information, and the information image generated by the information image generating means. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and an image processing program.

A process of combining an information image with image information is performed.
As a technology related to this, for example, Patent Document 1 has an object to provide an image processing apparatus or the like that can quickly detect print medium information and has high use efficiency of a code image. A dot array generation unit that generates a dot array from an image, a block detection unit that detects a block on the dot array and generates a code array, a synchronization code detection unit that detects a synchronization code on the code array, and a code array An identification code detection unit that detects an identification code from the code array, and an X coordinate code detection unit and a Y coordinate code detection unit that detect a coordinate code from the code array. It is disclosed to detect print medium information from information.

  Further, for example, Patent Document 2 discloses a portable printer for printing a second interface on a second surface in response to first display data received from a sensor having a stylus shape. Display data is sensed by the stylus from the first coded data, the first interface is placed on the first surface and includes the first coded data, the printer includes an input module and a print module, and the input module includes: The first display data is configured to receive the first display data from the stylus, the first display data indicates response data at least in part, and the input module generates the second display data based on the first display data, and the second display data The data is at least partially indicative of response data, the second display data is transmitted to the computer system, and the printing module is A printing mechanism configured to receive response data from the system, wherein the second interface is based at least in part on the response data, and then the printing module uses the printing mechanism to connect the second interface to the second surface. Is disclosed.

  Further, for example, Patent Document 3 discloses a customer service using a code, which can provide various services to the customer and provides a service that is highly convenient for the customer. Distribute to the customer a sheet with a code including at least two pieces of information, the coordinate information indicating the coordinates on the sheet, and the media identification information indicating the type of the sheet. The information input device with a communication function that can perform the operation, reads the code, and transmits to the communication destination included in the communication destination information included in the code transmits the read information to the server. A customer service that receives the coordinate information and / or the media identification information included in the received information and performs a predetermined process corresponding to the received coordinate information and / or the media identification information. Bis method is disclosed.

  Further, for example, Patent Document 4 describes a document management system, a document management method, and an information reading device that facilitate management and correction of an electronic document. The identified identification information and coordinate information are read and stored in the document management database corresponding to the document, and the history information relating to printing and updating of the document is stored in a record related to the corresponding record in the document management database. Store. When a document is updated, the update history number in the history management database is incremented by 1, the updated document is registered in a new record, and update information is presented to the user based on the identification information read at the time of writing. It is disclosed.

  In addition, for example, Patent Document 5 provides a technique that can associate information that has been written and added to information before writing on a medium in real time without using a tablet. The pen-type coordinate input device detects the position of the tip on the medium, that is, the image reading device is formed on the medium and is on the medium. The code symbol indicating the coordinates is optically read, the microcomputer decodes the read code symbol, the detection means detects the position, orientation and distortion amount of the code symbol in the image read by the image reading device, and The coordinates of the position of the tip on the medium are detected based on the information decoded by the microcomputer and the position, orientation and distortion amount of the code symbol detected by the detecting means. It is disclosed that.

  For example, Patent Document 6 discloses a two-dimensional code reading device, a printing device, a writing information input device, and a writing information management device that can easily extract writing information and manage it in association with the original electronic document. A two-dimensional code reader for reading at least one or more two-dimensional codes recorded on a reversible recording medium, an image acquisition means for acquiring the two-dimensional codes as an image, and image acquisition A decoding unit that decodes the two-dimensional code acquired by the unit, a coordinate information acquisition unit that acquires coordinate information on the reversible recording medium, and a document identification information acquisition unit that acquires document identification information related to the document. Is disclosed to solve the above problems.

  Also, for example, Patent Document 7 discloses an information processing apparatus that can reflect a handwritten pattern on a paper document in an electronic document, and can control the display form of the handwritten pattern according to the characteristics of the writing. A writing information processing system for obtaining a handwritten pattern added to a paper document and displaying it on a display device, the object of which is to provide a system, a writing information processing method, and a writing information processing program. Written information extracting means for extracting handwritten information data acquired based on the document identification information and handwritten pattern of the electronic document that is the output source of the paper document, and a feature amount of the handwritten pattern is extracted based on the extracted handwritten information data Feature amount extraction means, priority determination means for determining the priority of strokes constituting a handwritten pattern from the feature quantities, and document identification information. It is characterized by having a writing processing unit for displaying the synthesized and display the handwritten pattern according to the priority in the electronic document identified, is disclosed.

JP 2009-181363 A Special table 2003-500250 gazette JP 2002-215768 A JP 2003-067363 A JP 2004-295905 A Japanese Patent Laying-Open No. 2005-078508 JP 2007-079506 A

  The present invention relates to an image process in which identification information is generated more efficiently in the case where an information image including identification information and coordinate information is combined with image information, as compared with a case where this configuration is not provided. It is an object to provide an apparatus and an image processing program.

The gist of the present invention for achieving the object lies in the inventions of the following items.
The invention according to claim 1 identifies the image information for each type of information relating to the output medium received by the receiving means, receiving means for receiving the image information and information relating to the output medium when the image information is output. Identification information generating means for generating identification information for generating information information generating means for generating an information image including the identification information generated by the identification information generating means and the coordinate information of the information image combined with the image information; An image processing apparatus comprising: a combining unit that combines image information and an information image generated by the information image generating unit.

  The invention according to claim 2 is the image processing apparatus according to claim 1, wherein the coordinate information of the information image is coordinate information in a coordinate space divided for each type of information relating to the output medium. .

  According to a third aspect of the present invention, receiving means for receiving coordinate information of an area in the image information for combining the image information and the information image, and identifying the image information for each coordinate information of the area received by the receiving means. Identification information generating means for generating identification information for generating information information generating means for generating an information image including the identification information generated by the identification information generating means and the coordinate information of the information image combined with the image information; An image processing apparatus comprising: a combining unit that combines the information image generated by the information image generating unit with the region in the image information.

  According to a fourth aspect of the present invention, the receiving means also receives coordinate information of an area in the image information for synthesizing the information image, and the identification information generating means is for receiving information on an output medium received by the receiving means. For each region where the type and the information image are pasted on the image information, identification information for identifying the image information is generated, and the synthesizing unit adds the information image generation unit to the region in the image information. The image processing apparatus according to claim 1, wherein the generated information image is synthesized.

  According to a fifth aspect of the present invention, there is provided a receiving means for receiving information relating to image information and an output medium when the image information is output, and the image information for each type of information relating to the output medium received by the receiving means. Information generating means for generating identification information for identifying the information, and information image generating means for generating an information image including the identification information generated by the identification information generating means and the coordinate information of the information image combined with the image information And an image processing program for causing the image information and the information image generated by the information image generating means to function as a combining means.

  According to a sixth aspect of the present invention, there is provided a computer for receiving the coordinate information of the area in the image information for synthesizing the image information and the information image, and for each coordinate information of the area received by the receiving means, the image information. Information generating means for generating identification information for identifying the information, and information image generating means for generating an information image including the identification information generated by the identification information generating means and the coordinate information of the information image combined with the image information And an image processing program for causing the region in the image information to function as a combining unit that combines the information image generated by the information image generating unit.

  According to the image processing apparatus of the first aspect, when the information image including the identification information and the coordinate information is combined with the image information, the identification information can be generated for each type of information regarding the output medium.

  According to the image processing apparatus of the second aspect, it is possible to specify the type of information relating to the output medium from the coordinate information.

  According to the image processing apparatus of the third aspect, when the information image including the identification information and the coordinate information is combined with the region in the image information, the identification information can be generated for each coordinate information of the region.

  According to the image processing device of claim 4, when an information image including identification information and coordinate information is combined with an area in the image information, the identification information is provided for each type of information about the output medium and the coordinate information of the area. Can be generated.

  According to the image processing program of the fifth aspect, when the information image including the identification information and the coordinate information is combined with the image information, the identification information can be generated for each type of information regarding the output medium.

  According to the image processing program of the sixth aspect, when the information image including the identification information and the coordinate information is combined with the area in the image information, the identification information can be generated for each area of the coordinate information.

It is a conceptual module block diagram about the structural example of this Embodiment. It is explanatory drawing which shows the example of the basic layout of a code block. It is explanatory drawing which shows the example of a layout at the time of outputting a code block. It is explanatory drawing which shows the example that the coordinate space is divided | segmented into the some area | region corresponding to the size of an output medium. It is explanatory drawing which shows the example that the coordinate space is divided | segmented into the some area | region corresponding to the usage information of an output medium. It is explanatory drawing which shows the example that the coordinate space is divided | segmented into the several area | region corresponding to the security setting information of an output medium. It is explanatory drawing which shows the example that the coordinate space is divided | segmented into the some area | region corresponding to the apparatus information which provided the identification information. It is explanatory drawing which shows the example that the coordinate space is divided | segmented into the several area | region corresponding to multiple types of output medium information. 6 is an explanatory diagram illustrating an example of a data structure of a paper size / identification information correspondence table. FIG. It is a flowchart which shows the process example by 1st Embodiment. It is explanatory drawing which shows the example regarding the position which synthesize | combines an information image. It is explanatory drawing which shows the example of a data structure of an information image sticking position and identification information corresponding table. It is a flowchart which shows the process example by 2nd Embodiment. It is explanatory drawing which shows the example of a data structure of a paper size / information image sticking position / identification information correspondence table. It is a flowchart which shows the process example by 3rd Embodiment. It is a block diagram which shows the structural example of a pen-type image reading apparatus. It is a block diagram which shows the hardware structural example of the computer which implement | achieves this Embodiment.

Hereinafter, examples of various preferred embodiments for realizing the present invention will be described with reference to the drawings.
<First Embodiment>
FIG. 1 is a conceptual module configuration diagram of a configuration example according to the first embodiment.
The module generally refers to components such as software (computer program) and hardware that can be logically separated. Therefore, the module in the present embodiment indicates not only a module in a computer program but also a module in a hardware configuration. Therefore, the present embodiment also serves as an explanation of a computer program, a system, and a method. However, for the sake of explanation, the words “store”, “store”, and equivalents thereof are used. However, when the embodiment is a computer program, these words are stored in a storage device or stored in memory. It is the control to be stored in the device. Modules may correspond to functions one-to-one, but in mounting, one module may be configured by one program, or a plurality of modules may be configured by one program, and conversely, one module May be composed of a plurality of programs. The plurality of modules may be executed by one computer, or one module may be executed by a plurality of computers in a distributed or parallel environment. Note that one module may include other modules. Hereinafter, “connection” is used not only for physical connection but also for logical connection (data exchange, instruction, reference relationship between data, etc.).
In addition, the system or device is configured by connecting a plurality of computers, hardware, devices, and the like by communication means such as a network (including one-to-one correspondence communication connection), etc. The case where it implement | achieves by etc. is also included. “Apparatus” and “system” are used as synonymous terms. Of course, the “system” does not include a social “mechanism” (social system) that is an artificial arrangement.
In addition, when performing a plurality of processes in each module or in each module, the target information is read from the storage device for each process, and the processing result is written to the storage device after performing the processing. is there. Therefore, description of reading from the storage device before processing and writing to the storage device after processing may be omitted. Here, the storage device may include a hard disk, a RAM (Random Access Memory), an external storage medium, a storage device via a communication line, a register in a CPU (Central Processing Unit), and the like.

The image processing apparatus according to the present embodiment synthesizes an information image including identification information and coordinate information into image information. As shown in the example of FIG. 1, the receiving module 110, the identification information generation module 120, It has an identification information correspondence storage module 130, an information image generation module 140, a synthesis module 150, and an output module 160.
Here, the information image refers to an image code that is systematically created to represent electronic data in a machine-readable manner, and will be specifically described later with reference to the examples of FIGS.

The receiving module 110 is connected to the identification information generating module 120 and receives image information and information related to an output medium when the image information is output. Then, the received image information and information regarding the output medium are passed to the identification information generation module 120. Further, the image information may be passed to the synthesis module 150.
Receiving image information includes, for example, reading an image with a scanner, a camera, etc., receiving image information from an external device via a communication line with a fax machine, etc., a hard disk (in addition to what is built in a computer, a network For example, reading out image information stored in an image storage device etc.). The image information may be a binary image or a multi-value image (including a color image). One image may be received or a plurality of images may be received. Further, the contents of the image may be a document used for business, a pamphlet for advertisement, or the like.
In addition, receiving information related to the output medium may be extracted, for example, when it is included in the image information as reference information (property) of the image information, or depending on the operation of the user You may make it receive, and you may make it analyze and extract image information.

  Here, as an output medium when image information is output, there is mainly a paper medium, and the output in this case is a form of printing. In addition to paper media, printing on media such as plastic, cloth, metal, etc., or output on so-called electronic paper, etc., is performed so that image information can be visually confirmed. To do. Further, the output medium may be a medium on which the user can write. In particular, the area to be written may be an area where an information image is output.

Information on the output medium includes the size of the output medium (also referred to as paper size, specific examples include A0, A1, A2, B0, B1, B2, letter size, etc.), and output medium usage information (plain paper, inkjet Sheet, etc.), security setting information of the output medium, device information with identification information added to the output medium, and the like, and a combination thereof. Hereinafter, as a specific example of the information regarding the output medium, the paper size is mainly exemplified, but it is needless to say that it may be application information of the output medium.
Note that the size of the image information does not necessarily match the size of the output medium that outputs the image information. Therefore, although the size of the image information does not necessarily become the size of the output medium, there are many cases where they match, so the size of the image information may be adopted as the size of the output medium. Therefore, analyzing the image information and extracting the size of the output medium mainly means extracting the size of the image information.

  The identification information generation module 120 is connected to the reception module 110, the identification information correspondence storage module 130, and the information image generation module 140, and identifies image information for each type of information related to the output medium received by the reception module 110. Identification information is generated. Then, the generated identification information is passed to the information image generation module 140. The identification information here is not information for simply identifying image information, but is information for identifying image information for each type of information regarding the output medium. Therefore, the same identification information is not generated if the information type regarding the output medium is the same, but the same identification information may be generated if the information type regarding the output medium is different.

The type of information related to the output medium refers to the classification indicated by the information related to the output medium. For example, when the information related to the output medium is the size of the output medium, it is A0, A1, or the like. Therefore, in the case of this example, each type of information related to the output medium is, for example, every A0, every A1, or the like.
As a method for generating the identification information, the identification information managed for each type stored in the identification information correspondence storage module 130 is used.

  The identification information correspondence storage module 130 is accessed from the identification information generation module 120 and stores identification information managed for each type of information related to the output medium. For example, the paper size / identification information correspondence table 900 shown in FIG. 9 is stored. FIG. 9 is an explanatory diagram showing an example of the data structure of the paper size / identification information correspondence table 900. The paper size / identification information correspondence table 900 has a paper size column 910 and an identification information column 920. The paper size is information regarding the output medium, and A0, A1, A2, A3, A4 is the type of information regarding the output medium. The case where etc. are used is shown. The paper size column 910 stores A0, A1, etc. as paper sizes. The identification information column 920 stores identification information generated for each paper size.

For example, assuming that the identification information is an integer and the identification information generation module 120 generates the identification information in the order, only the most recently generated identification information is stored in the identification information column 920, and the next identification information (that is, (The value obtained by adding 1) may be generated by the identification information generation module 120. When generating identification information by other methods, identification information generated in the past may be stored in the identification information column 920, and the identification information generation module 120 may generate identification information that does not overlap with the identification information. Further, identification information may be generated using a hash function or the like using image information as a key. In this case, the identification information correspondence storage module 130 becomes unnecessary.
The paper size / identification information correspondence table 900 manages identification information for each paper size, but for each output medium usage information, for each output medium security setting information, device information in which identification information is given to the output medium. For example, the identification information may be managed for each combination.

The information image generation module 140 is connected to the identification information generation module 120 and the synthesis module 150, and generates an information image including the identification information generated by the identification information generation module 120 and the coordinate information of the information image to be combined with the image information. To do. Then, the generated information image is transferred to the synthesis module 150.
The coordinate information of the information image here is coordinate information in a coordinate space divided for each type of information relating to the output medium. The coordinate information of the information image will be described later using the examples shown in FIGS.

The synthesizing module 150 is connected to the information image generating module 140 and the output module 160, and synthesizes the image information received by the receiving module 110 and the information image generated by the information image generating module 140. Then, the synthesized image is passed to the output module 160.
The output module 160 is connected to the synthesis module 150 and outputs an image synthesized by the synthesis module 150. To output an image is mainly to print on a paper medium with a printing device such as a printer or to output to electronic paper or the like. In addition to this, display on a display device such as a display, fax, etc. The image may be transmitted by an image transmission device, written in an image storage device such as an image database, stored in a storage medium such as a memory card, or transferred to another information processing device. However, even when the output is to other than the output medium, the output to the output medium is finally accompanied.

An information image as a specific example will be described. Here, an information image (referred to as “code image” in Patent Document 1) used in Patent Document 1 is used.
A code pattern constituting an information image will be described. In the present embodiment, mCn (= m) by a pattern image (hereinafter referred to as “unit code pattern”) in which unit images are arranged at n (1 ≦ n <m) locations selected from m (m ≧ 3) locations. ! / {(Mn)! × n!}) Expresses the information as shown. That is, instead of associating one unit image with information, a plurality of unit images are associated with information. Hereinafter, such an encoding method is referred to as an mCn method.
Here, a unit image having any shape may be used. In the present embodiment, a dot image (hereinafter, also simply referred to as “dot”) is used as an example of the unit image, but an image having another shape such as a hatched pattern may be used.

  By the way, a dot (for example, a black region) is a dot for information expression to the last, and does not necessarily match a dot that is a minimum unit constituting an image. In this embodiment, when “dot” refers to the former dot and the latter dot is referred to as “pixel”, the dot has a size of 2 pixels × 2 pixels at 600 dpi. . Since the size of one pixel at 600 dpi is 0.0423 mm, one side of the dot is 84.6 μm (= 0.0423 mm × 2). The larger the dot, the more likely it will be noticeable, so it is preferable to make it as small as possible. However, if it is too small, printing with a printer becomes impossible. Therefore, the above value is adopted as the dot size, which is larger than 50 μm and smaller than 100 μm. However, the above value 84.6 μm is a numerical value to the last, and is about 100 μm in the actually printed toner image.

A method for expressing identification information and coordinate information by arranging code patterns will be described.
First, a code block composed of the above-described unit code pattern will be described.
FIG. 2 is an explanatory diagram showing an example of a basic layout of the code block 200. Here, it is assumed that a unit code pattern in the 9C2 system is used. That is, 36 types of unit code patterns are divided into, for example, 4 patterns used as synchronization patterns and 32 patterns used as information patterns, and each pattern is arranged according to a layout.
FIG. 2 employs a layout in which 25 (5 × 5) areas in which 3 dots × 3 dots can be arranged (hereinafter referred to as “blocks”) are arranged. Of these 25 blocks, a synchronization pattern is arranged in the upper left block (one block of “S” in FIG. 2). In addition, an information pattern representing X coordinate information that specifies coordinates in the X direction on the paper surface is arranged in the four blocks to the right of the synchronization pattern (four blocks “X1” to “X4” in FIG. 2). An information pattern representing Y coordinate information for specifying coordinates in the Y direction on the paper surface is arranged in the lower four blocks (four blocks “Y1” to “Y4” in FIG. 2). Further, information patterns representing the identification information of the document printed on the paper surface or the paper surface are arranged in the 16 blocks surrounded by the information patterns representing the coordinate information (in FIG. 2, 16 blocks “I11” to “I44”). )is doing.

Next, a layout for expressing identification information and coordinate information in the present embodiment will be described.
FIG. 3 is an explanatory diagram illustrating an example of a layout when a code block is output. In this layout, the code block 200 illustrated in FIG. 2 is used as a basic unit, and the code block 200 is periodically arranged on a paper surface. In FIG. 3, the synchronization pattern is represented by “S”. Also, the coordinate information is expressed in M series over the vertical and horizontal sides of the page. A pattern representing the X coordinate is represented by “X1”, “X2”,..., And a pattern representing the Y coordinate is represented by “Y1”, “Y2”,.
Note that the same pattern is repeatedly arranged in the Y-axis direction for the X coordinate, and the same pattern is repeatedly arranged in the X-axis direction for the Y coordinate. Further, the identification codes are periodically arranged in the X-axis direction and the Y-axis direction.
Furthermore, although some methods are used for encoding the identification information, RS encoding is suitable in this embodiment. The RS code is a multi-level coding method. In this case, it is preferable that the block representation corresponds to the multi-value of the RS code. A pattern representing the identification information is represented by “IXY” (X = 1 to 4, Y = 1 to 4).

Here, the M series used for expressing the coordinate information will be described.
The M sequence is a sequence whose partial sequence does not match other partial sequences. For example, the eleventh order M-sequence is a bit string of 2047 bits. The same sequence as the partial sequence of 11 bits or more extracted from the 2047-bit bit string does not exist in the 2047-bit bit string other than itself. In this embodiment, 16 unit code patterns are associated with 4 bits. That is, a bit string of 2047 bits is expressed in decimal notation for every 4 bits, a unit code pattern is determined, and expressed as a coordinate code across the horizontal and vertical sides of the paper. Therefore, at the time of decoding, the position on the bit string is specified by specifying three consecutive unit code patterns.

A case where information on the output medium is included in addition to the identification information and coordinate information will be described. First, a case where a paper size is used as information about the output medium will be described.
FIG. 4 is an explanatory diagram illustrating an example in which the coordinate space is divided into a plurality of regions corresponding to the size of the output medium.
In the example of FIG. 4A, an example of a coordinate space used when forming an information image to be used is conceptually illustrated.
Here, the coordinate space is divided into a plurality of regions, the coordinate space of one of the regions is used for each paper size that is the type of information about the output medium, and the other regions are not used. . Then, the size information can be detected depending on which region of the coordinate space is used to form the information image. The coordinates in this coordinate space are expressed by “X1” to “X4” and “Y1” to “Y4” in the code block 200 illustrated in FIG. Therefore, the paper size is determined depending on which region of the coordinate space 400 illustrated in FIG. 4 the coordinates represented by “X1” to “X4” and “Y1” to “Y4” are.

  Also, identification information is generated for each paper size. Although duplicate identification information is not generated for each paper size, duplicate identification information can be generated for different paper sizes. However, since the coordinate information is used only in the coordinate space indicating the paper size, the document image can be uniquely identified by combining the used coordinate space (paper size) and the identification information.

More specifically, for example, it is assumed that the image forming the information image is A0 size paper. In this case, the information image is formed using the area of the coordinate space indicated by “A0” in the example of FIG. 4A, and the coordinate space of the other area is not used. By doing so, when the information image is read, it can be seen from the coordinate information that the region is indicated by “A0” in the example of FIG. 4A, so the size of the paper used is A0. It can be detected.
The method for dividing the coordinate space is not particularly limited, and may be set in any region of the coordinate space. For example, as shown in the example of FIG. 4B, each paper size may be divided into regions having the same size.
As described above, the case where the paper size information is acquired has been described. However, the area may be further increased and, for example, the paper size information may be divided into areas related to the vertical and horizontal directions of the paper.

Size information can be obtained from information images. For example, when copying with a copier, which is an image processing device, when size information differs from the paper size detected by the copier, processing is stopped and used. For example, an error notification may be given to a person.
In addition, since size information can be acquired from an information image, for example, a pen-type image reading device 1600 (to be described later) reads an information image, and a virtual screen having the same size as paper on a computer screen on which an application operated by a user operates. A service that displays typical paper may be provided.

FIG. 5 is an explanatory diagram illustrating an example in which the coordinate space is divided into a plurality of areas corresponding to the usage information of the output medium. FIG. 2 conceptually illustrates an example of a coordinate space used when forming an information image to be used.
In the example of FIG. 5 as well, as in the case of the example of FIG. 4, the coordinate space is divided into a plurality of areas, and one of the information is used for each type of paper that is the type of information about the output medium. The coordinate space of the area is used, and other areas are not used. In the case of the example in FIG. 5, it is possible to detect the usage information of the paper to be used depending on which coordinate space is used to form the information image.

In the case shown in the example of FIG. 5, a specific description will be made. A predetermined area in the coordinate space is defined as a coordinate area used when the paper is for preprinted paper, laser printer printing paper (black Coordinate region used for toner), Coordinate region used for laser printer printing paper (transparent toner), Coordinate region used for inkjet printer printing paper, Plastic media printing The above-described use information of the paper can be detected by allocating each of the coordinate areas to be used in each case, and by using which area of these coordinate spaces is used.
Since the sheet usage information can be acquired from the information image, for example, a service (computer program) corresponding to the acquired sheet usage information may be activated.

FIG. 6 is an explanatory diagram illustrating an example in which the coordinate space is divided into a plurality of areas corresponding to the security setting information of the output medium. FIG. 2 conceptually illustrates an example of a coordinate space used when forming an information image to be used.
In the example of FIG. 6 as well, as in the case of the example of FIG. 4, the coordinate space is divided into a plurality of areas, and each security setting information of the output medium that is each type of information about the output medium The coordinate space of one area is used and the other areas are not used. In the case of the example in FIG. 6, the security setting information of the medium can be detected depending on which coordinate space is used to form the information image.
In the case shown in the example of FIG. 6, a specific description will be given. A predetermined area in the coordinate space is defined as a coordinate area used for an output medium without security setting, a copy / scan / fax. Coordinate area used in the case of prohibited output media, coordinate area used in the case of output media with restricted copy / scan / fax access, coordinate area used in the case of output media prohibited from writing with a pen, The above-described security setting information of the output medium can be detected by allocating each coordinate area to be used in the case of an output medium with limited writing access by the pen and by using which area in these coordinate spaces.

FIG. 7 is an explanatory diagram illustrating an example in which the coordinate space is divided into a plurality of regions corresponding to the device information to which the identification information is added. FIG. 2 conceptually illustrates an example of a coordinate space used when forming an information image to be used.
In the case shown in the example of FIG. 7, the coordinate space is divided into a plurality of areas, and the coordinates of one of the areas for each piece of device information provided with document identification information for each type of information relating to the output medium. Space is used, and other areas are not used. In the case of the example in FIG. 7, the device information to which the document identification information is added can be detected depending on which region of the coordinate space is used to form the information image.
In the case of the example of FIG. 7, the coordinate area used when the print medium is generated by the image forming apparatus A (for example, a client device such as a personal computer), the image forming apparatus B (for example, a printer driver). Coordinate area used when the print medium is generated, coordinate area used when the print medium is generated by the image forming apparatus C (for example, a server), image formation apparatus D (for example, a printer / multifunction machine) The device information to which the above-described document identification information is added can be detected according to which region of the coordinate space is allocated to each of coordinate regions to be used in the case of the print medium generated in (1).

Further, a plurality of pieces of print medium information may be given in combination.
FIG. 8 is an explanatory diagram illustrating an example in which the coordinate space is divided into a plurality of regions corresponding to a plurality of types of output medium information. FIG. 2 conceptually illustrates an example of a coordinate space used when forming an information image to be used.
The coordinate space shown in the example of FIG. 8 is divided into a plurality of regions in the vertical direction and the horizontal direction. That is, size information is given to each rectangular area divided in the vertical direction, and security setting information of the output medium is given to each rectangular area divided in the horizontal direction. The coordinate space of any one of the regions where the divided rectangular regions intersect with the rectangular regions divided in the horizontal direction is used, and the other regions are not used. In the case of the example of FIG. 8, the print medium information of both the size information and the security setting information of the output medium can be detected depending on which coordinate area is used to form the information image.

FIG. 10 is a flowchart illustrating a processing example according to the first exemplary embodiment. This processing example is for generating identification information for each paper size.
In step S1002, the receiving module 110 receives an identification information request. For example, it is a request according to a user operation on the image processing apparatus. Of course, it may be an information image generation request. In this case, since the identification information is included in the information image, the identification information request is included in the information image generation request.
In step S1004, the receiving module 110 receives a document image. For example, a document image is received by reading a document set in a scanner.
In step S1006, the receiving module 110 receives the paper size. For example, the paper size may be received in accordance with a user operation on the image processing apparatus, or the paper size may be received by analyzing the size of the document image.

In step S1008, the identification information generation module 120 generates identification information. For example, identification information is generated using a paper size / identification information correspondence table 900 in the identification information correspondence storage module 130. That is, the latest identification information is extracted for each paper size, and 1 is added to it to generate identification information. Then, the old identification information in the paper size / identification information correspondence table 900 is rewritten with the generated identification information.
In step S1010, the information image generation module 140 generates an information image. An information image is generated based on the identification information and position information in the coordinate space that matches the paper size (coordinates where the information image is pasted in the document image).
In step S1012, the synthesis module 150 synthesizes the document image received in step S1004 and the information image generated in step S1010.
In step S1014, the output module 160 outputs the synthesized image.

<Second Embodiment>
The module configuration of the second embodiment is equivalent to the module configuration of the first embodiment illustrated in FIG. In addition, the same code | symbol is attached | subjected to the site | part of the same kind as 1st Embodiment, and the overlapping description is abbreviate | omitted.

However, the receiving module 110 receives the coordinate information of the area in the image information for combining the image information and the information image. The region in the image information is not a whole image information but a partial region in the image information.
Further, the identification information generation module 120 generates identification information for identifying image information for each coordinate information of the area received by the receiving module 110.

Further, the identification information correspondence storage module 130 stores, for example, an information image pasting position / identification information correspondence table 1200 shown in FIG. FIG. 12 is an explanatory diagram showing an example of the data structure of the information image pasting position / identification information correspondence table 1200. The information image pasting position / identification information correspondence table 1200 includes an information image pasting position column 1210 and an identification information column 1220. The coordinate information of the area is information regarding the position where the information image is pasted, and is a rectangular area to be pasted. The case of using the upper left and lower right coordinates is shown. The information image pasting position field 1210 stores area coordinate information. The identification information column 1220 stores identification information generated for each coordinate information (region) of the region.
Further, the synthesis module 150 synthesizes the information image generated by the information image generation module 140 with an area in the image information.

In some cases, it is not necessary to synthesize an information image over the entire document image. For example, FIG. 11 is an explanatory diagram illustrating an example regarding a position where information images are combined.
As shown in the example of FIG. 11, the document 1100 has an explanation area 1101, an information image pasting area 1102, an explanation area 1103, an information image pasting area 1104, and an explanation area 1105, and the document 1110 is an information image pasting area. 1111, an explanation area 1112, an information image pasting area 1113, and an explanation area 1114. That is, in the document 1100 and the document 1110, the information image pasting areas 1102 and 1104 and the information image pasting areas 1111 and 1113 do not overlap. Therefore, as in the first embodiment, if the coordinate information does not overlap, identification information may be generated for each coordinate of the non-overlapping area. The information image pasting areas 1102, 1104, 1111, and 1113 are areas where writing is performed by the user, and the writing is performed by a pen-type image reading device 1600 described later, and the writing trajectory is read. Become.

FIG. 13 is a flowchart illustrating a processing example according to the second exemplary embodiment.
In step S1302, the receiving module 110 receives the identification information request.
In step S1304, the receiving module 110 receives a document image. Step S1302 and step S1304 are equivalent to step S1002 and step S1004 of the first embodiment.
In step S1306, the receiving module 110 receives information image pasting position information. For example, information image pasting position information corresponding to a user's operation for specifying a rectangular area for the image processing apparatus is received.

  In step S1308, the identification information generation module 120 determines whether or not the pasting positions are duplicated. If they are duplicated, the process proceeds to step S1312. Otherwise, the process proceeds to step S1310. For example, there is an overlapping portion between the information image pasting position information received in step S1306 and the value of the information image pasting position column 1210 in the information image pasting position / identification information correspondence table 1200 (region where identification information has been generated in the past). In the case (when one includes the whole of the other, the parts overlap), it is determined that they overlap. However, when there are a plurality of areas in which an information image is pasted in one document image, it is determined that there is an overlap if even one area overlaps.

  In step S1310, the identification information generation module 120 generates new identification information. Since the area is used for the first time, new identification information is generated for the area. That is, the identification information may be used in other areas. Then, a new line is generated in the information image pasting position / identification information correspondence table 1200, and the information image pasting position information received in step S1306 is associated with the generated identification information and stored.

  In step S1312, the identification information generation module 120 extracts the already-identified information from the identification information column 1220 of the overlapping area in the information image pasting position / identification information correspondence table 1200, and adds 1 to the identification information. Generate. Then, the old identification information in the information image pasting position / identification information correspondence table 1200 is rewritten with the generated identification information. Further, the position information of the overlapping area is added to the corresponding information image pasting position column 1210. If the areas match, it is not necessary to add the area.

In step S1314, the information image generation module 140 generates an information image. An information image is generated based on the identification information and position information (coordinates where the information image is pasted in the document image).
In step S1316, the composition module 150 synthesizes the information image generated in step S1314 and the information image pasting position received in step S1306 with the document image received in step S1304.
In step S1318, the output module 160 outputs the synthesized image.

<Third Embodiment>
The module configuration of the third embodiment is equivalent to the module configuration of the first embodiment illustrated in FIG. 1, and is a combination of the first embodiment and the second embodiment described above. is there. In addition, the same code | symbol is attached | subjected to the site | part of the same kind as 1st Embodiment, and the overlapping description is abbreviate | omitted.
However, the receiving module 110 also receives the coordinate information of the area in the image information to be combined with the information image. Therefore, the receiving module 110 receives the image information, the information about the output medium when the image information is output, and the coordinate information of the area in the image information for synthesizing the information image.
Further, the identification information generation module 120 generates identification information for identifying image information for each type of information regarding the output medium received by the receiving module 110 and for each region where the information image is pasted on the image information.

Further, the identification information correspondence storage module 130 stores, for example, a paper size / information image pasting position / identification information correspondence table 1400 shown in FIG. FIG. 14 is an explanatory diagram showing an example of the data structure of the paper size / information image pasting position / identification information correspondence table 1400. The paper size / information image pasting position / identification information correspondence table 1400 includes a paper size column 1410, an information image pasting position column 1420, and an identification information column 1430. The coordinate information of the area relates to the position where the information image is pasted. This is information, and shows the case of using the upper left and lower right coordinates of the rectangular area to be pasted. The paper size column 1410 stores the size of the output medium. The information image pasting position column 1420 stores area coordinate information. The identification information column 1430 stores identification information generated for each sheet size and coordinate information (area) of the area.
Further, the synthesis module 150 synthesizes the information image generated by the information image generation module 140 with an area in the image information.

FIG. 15 is a flowchart illustrating a processing example according to the third exemplary embodiment.
In step S1502, the receiving module 110 receives an identification information request.
In step S1504, the receiving module 110 receives a document image.
In step S1506, the receiving module 110 receives the paper size.
In step S1508, the receiving module 110 receives information image pasting position information. Step S1502, step S1504, and step S1506 are equivalent to step S1002, step S1004, and step S1006 of the first embodiment, and step S1508 is equivalent to step S1306 of the second embodiment.

  In step S1510, the identification information generation module 120 determines whether or not the pasting positions are duplicated with the same paper size. If they are duplicated, the process proceeds to step S1514. Otherwise, the process proceeds to step S1512.

  In step S1512, the identification information generation module 120 generates new identification information. Since the paper size and the area are used for the first time, new identification information is generated for the paper size area. That is, the identification information may be information used in other paper sizes or other areas. Then, a new line is generated in the paper size / information image pasting position / identification information correspondence table 1400, and the paper size received in step S1506, the information image pasting position information received in step S1508, and the generated identification information are displayed. Correspond and memorize.

  In step S1514, the identification information generation module 120 extracts the already-identified information from the identification information column 1430 of the overlapping area in the same paper size in the paper size / information image pasting position / identification information correspondence table 1400, Add 1 to generate identification information. Then, the old identification information in the sheet size / information image pasting position / identification information correspondence table 1400 is rewritten with the generated identification information. Further, the position information of the overlapping area is added to the corresponding information image pasting position column 1420. If the areas for the paper size match, it is not necessary to add the areas.

In step S1516, the information image generation module 140 generates an information image. An information image is generated based on the identification information and position information (coordinates where the information image is pasted in the document image).
In step S1518, the composition module 150 synthesizes the information image generated in step S1516 and the information image pasting position received in step S1508 with the document image received in step S1504.
In step S1520, the output module 160 outputs the synthesized image.

Next, the user uses the pen-type image reading device 1600 for the document 1699 that is the output medium output in the first embodiment, the second embodiment, and the third embodiment. A case where writing is performed will be described.
FIG. 16 is a block diagram illustrating a configuration example of the pen-type image reading apparatus 1600.
The pen-type image reading apparatus 1600 includes a control circuit 1601, a pressure sensor 1602, an infrared LED 1603, an infrared CMOS 1604, an information memory 1605, a communication circuit 1606, a battery 1607, a pen ID memory 1608, and a pen chip 1609.

The control circuit 1601 includes an image processing module 1601a that processes an information image detected from the read image, and a data processing module 1601b that extracts identification information and coordinate information from the processing result.
The control circuit 1601 is connected to a pressure sensor 1602 that detects a writing operation by the pen-type image reading device 1600 by a pressure applied to the pen tip 1609. An infrared LED 1603 that irradiates infrared light on the document 1699 and an infrared CMOS 1604 (Complementary Metal Oxide Semiconductor) that reads an image are also connected. Further, an information memory 1605 for storing identification information and coordinate information, a communication circuit 1606 for communicating with an external device, a battery 1607 for driving the pen-type image reading device 1600, and a pen-type image reading device. A pen ID memory 1608 for storing 1600 identification information (pen ID) is also connected.

The infrared CMOS 1604 reads an information image printed on the document 1699.
The image processing module 1601a detects dots from the read information image, and generates a dot array with reference to the dot positions. Note that, as preprocessing for dot detection from the information image, processing for removing noise included in the read image is also performed. Here, the noise includes, for example, variations in image sensor sensitivity and noise generated by an electronic circuit. The type of noise removal processing should match the characteristics of the imaging system, but sharpening processing such as blurring processing and unsharp masking may be applied. In addition, dot detection is performed as follows. That is, first, a dot image portion and other background image portions are separated by binarization processing, and a dot position is detected from each binarized image position. At that time, since there are cases where a lot of noise components are included in the binarized image, it is necessary to combine filter processing for determining dots based on the area and shape of the binarized image. Thereafter, the dot array is generated by replacing the dot detected as an image with digital data on the two-dimensional array, for example, “1” for the position where the dot is and “0” for the position where there is no dot. Do.

The data processing module 1601b detects a block corresponding to the unit code pattern in the code block on the dot array. In other words, a rectangular block delimiter with the same size as the unit code pattern is moved on the dot array, the position where the number of dots in the block is equal is the correct block delimiter position, and the code array that stores the pattern value in each block Is generated.
The data processing module 1601b detects the synchronization code with reference to the type of each unit code pattern detected from the dot array.
Next, the data processing module 1601b determines image rotation based on the detected synchronization code. For example, when a square unit code pattern is used, it may be rotated by 90 degrees. Therefore, the direction is detected depending on which of the four types of synchronization patterns the detected synchronization code corresponds to. Further, when a rectangular unit code pattern is used, it may be rotated by 180 degrees. Therefore, the direction is detected depending on which of the two types of synchronization patterns the detected synchronization code corresponds to.
Then, the data processing module 1601b rotates the code array by the detected rotation angle and sets the code array in the correct orientation.

Next, the data processing module 1601b detects an identification code from the code array whose angle is corrected with reference to the position of the synchronization code. At this time, a process of rearranging the identification codes in the correct code order is also performed.
Then, the data processing module 1601b decodes the identification code using the same parameters (such as the number of blocks) used in the RS code encoding process, and outputs the identification information.
Next, the data processing module 1601b detects an error in the decoded identification code, and corrects the error when the detected error is a correctable error.

Then, the data processing module 1601b detects the X coordinate code from the code array whose angle has been corrected with reference to the position of the synchronization code. At this time, a process of removing the synchronization code from the X coordinate code is also performed.
Next, the data processing module 1601b extracts an M-sequence partial sequence from the detected X coordinate code, refers to the position of this partial sequence in the M-sequence used for image generation, and determines this position as a code block shift amount. The corrected value is output as X coordinate information.
Then, the data processing module 1601b detects an error of the decoded X coordinate code, and corrects the error when the detected error is a correctable error.

Then, the data processing module 1601b detects the Y coordinate code from the code array whose angle is corrected with reference to the position of the synchronization code. At this time, a process of removing the synchronization code from the Y coordinate code is also performed.
Next, the data processing module 1601b extracts an M-sequence partial sequence from the detected Y coordinate code, refers to the position of this partial sequence in the M-sequence used for image generation, and determines this position as a code block shift amount. The corrected value is output as Y coordinate information.
The data processing module 1601b detects an error in the decoded Y coordinate code, and corrects the error when the detected error is a correctable error.
Next, the data processing module 1601b outputs the acquired identification information, X coordinate information, and Y coordinate information to the external device via the communication circuit 1606. Further, information about the output medium may be extracted using the X coordinate information and the Y coordinate information.

  A hardware configuration example of the image processing apparatus according to the present embodiment will be described with reference to FIG. The configuration shown in FIG. 17 is configured by a personal computer (PC), for example, and shows a hardware configuration example including a data reading unit 1717 such as a scanner and a data output unit 1718 such as a printer.

  A CPU (Central Processing Unit) 1701 is a computer that describes the execution sequence of each module such as the identification information generation module 120, the information image generation module 140, and the synthesis module 150 described in the above embodiment. It is a control part which performs the process according to a program.

  A ROM (Read Only Memory) 1702 stores programs used by the CPU 1701, calculation parameters, and the like. A RAM (Random Access Memory) 1703 stores programs used in the execution of the CPU 1701, parameters that change as appropriate in the execution, and the like. These are connected to each other by a host bus 1704 including a CPU bus.

  The host bus 1704 is connected to an external bus 1706 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 1705.

  A keyboard 1708 and a pointing device 1709 such as a mouse are input devices operated by an operator. The display 1710 includes a liquid crystal display device or a CRT (Cathode Ray Tube), and displays various types of information as text or image information.

  An HDD (Hard Disk Drive) 1711 has a built-in hard disk, drives the hard disk, and records or reproduces a program executed by the CPU 1701 and information. On the hard disk, received image information, information on the output medium, generated information image, output image, paper size / identification information correspondence table 900, information image pasting position / identification information correspondence table 1200, paper size / information image pasting position An identification information correspondence table 1400 and the like are stored. Further, various computer programs such as various other data processing programs are stored.

  The drive 1712 reads out data or a program recorded on a removable recording medium 1713 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and the data or program is read out as an interface 1707 and an external bus 1706. , The bridge 1705, and the RAM 1703 connected via the host bus 1704. The removable recording medium 1713 can also be used as a data recording area similar to the hard disk.

  The connection port 1714 is a port for connecting the external connection device 1715 and has a connection unit such as USB or IEEE1394. The connection port 1714 is connected to the CPU 1701 and the like via an interface 1707, an external bus 1706, a bridge 1705, a host bus 1704, and the like. A communication unit 1716 is connected to the network and executes data communication processing with the outside. The data reading unit 1717 is a scanner, for example, and executes document reading processing. The data output unit 1718 is a printer, for example, and executes document data output processing.

Note that the hardware configuration of the image processing apparatus illustrated in FIG. 17 illustrates one configuration example, and the present embodiment is not limited to the configuration illustrated in FIG. 17, and the modules described in the present embodiment are executed. Any configuration is possible. For example, some modules may be configured with dedicated hardware (for example, Application Specific Integrated Circuit (ASIC), etc.), and some modules are in an external system and connected via a communication line Alternatively, a plurality of the systems shown in FIG. 17 may be connected to each other via communication lines so as to cooperate with each other. Further, it may be incorporated in a copying machine, a fax machine, a scanner, a printer, a multifunction machine (an image processing apparatus having any two or more functions of a scanner, a printer, a copying machine, a fax machine, etc.).
Note that the technology described in the background art may be adopted as the processing contents of the information image and each module.

The program described above may be provided by being stored in a recording medium, or the program may be provided by communication means. In that case, for example, the above-described program may be regarded as an invention of a “computer-readable recording medium recording the program”.
The “computer-readable recording medium on which a program is recorded” refers to a computer-readable recording medium on which a program is recorded, which is used for program installation, execution, program distribution, and the like.
The recording medium is, for example, a digital versatile disc (DVD), which is a standard established by the DVD Forum, such as “DVD-R, DVD-RW, DVD-RAM,” and DVD + RW. Standard “DVD + R, DVD + RW, etc.”, compact disc (CD), read-only memory (CD-ROM), CD recordable (CD-R), CD rewritable (CD-RW), Blu-ray disc ( Blu-ray Disc (registered trademark), magneto-optical disk (MO), flexible disk (FD), magnetic tape, hard disk, read-only memory (ROM), electrically erasable and rewritable read-only memory (EEPROM), flash Includes memory, random access memory (RAM), etc. .
The program or a part of the program may be recorded on the recording medium for storage or distribution. Also, by communication, for example, a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a wired network used for the Internet, an intranet, an extranet, etc., or wireless communication It may be transmitted using a transmission medium such as a network or a combination of these, or may be carried on a carrier wave.
Furthermore, the program may be a part of another program, or may be recorded on a recording medium together with a separate program. Moreover, it may be divided and recorded on a plurality of recording media. Further, it may be recorded in any manner as long as it can be restored, such as compression or encryption.

DESCRIPTION OF SYMBOLS 110 ... Receiving module 120 ... Identification information generation module 130 ... Identification information correspondence storage module 140 ... Information image generation module 150 ... Composition module 160 ... Output module 1600 ... Pen type image reading device 1601 ... Control circuit 1601a ... Image processing module 1601b ... Data Processing module 1602 ... Pressure sensor 1603 ... Infrared LED
1604: Infrared CMOS
1605 ... Information memory 1606 ... Communication circuit 1607 ... Battery 1608 ... Pen ID memory 1609 ... Pen tip 1699 ... Document

Claims (6)

Receiving means for receiving image information and information relating to the output medium when the image information is output;
Identification information generating means for generating identification information for identifying the image information for each type of information relating to the output medium received by the receiving means;
Information image generating means for generating an information image including identification information generated by the identification information generating means and coordinate information of an information image to be combined with the image information;
An image processing apparatus comprising: a combining unit that combines the image information and the information image generated by the information image generating unit. The image processing apparatus according to claim 1, wherein the coordinate information of the information image is coordinate information in a coordinate space divided for each type of information regarding the output medium. Receiving means for receiving coordinate information of an area in the image information for combining the image information and the information image;
Identification information generating means for generating identification information for identifying the image information for each coordinate information of the area received by the receiving means;
Information image generating means for generating an information image including identification information generated by the identification information generating means and coordinate information of an information image to be combined with the image information;
An image processing apparatus comprising: a combining unit that combines the information image generated by the information image generating unit with the region in the image information. The receiving means also receives coordinate information of a region in the image information to synthesize the information image,
The identification information generating means generates identification information for identifying the image information for each type of information relating to the output medium received by the receiving means and the area where the information image is pasted on the image information,
The image processing apparatus according to claim 1, wherein the synthesizing unit synthesizes the information image generated by the information image generating unit with the region in the image information. Computer
Receiving means for receiving image information and information relating to the output medium when the image information is output;
Identification information generating means for generating identification information for identifying the image information for each type of information relating to the output medium received by the receiving means;
Information image generating means for generating an information image including identification information generated by the identification information generating means and coordinate information of an information image to be combined with the image information;
An image processing program for causing the image information and an information image generated by the information image generating means to function as a combining means. Computer
Receiving means for receiving coordinate information of an area in the image information for combining the image information and the information image;
Identification information generating means for generating identification information for identifying the image information for each coordinate information of the area received by the receiving means;
Information image generating means for generating an information image including identification information generated by the identification information generating means and coordinate information of an information image to be combined with the image information;
The image processing program for functioning as a synthetic | combination means which synthesize | combines the information image produced | generated by the said information image production | generation means to the said area | region in the said image information.

Images