JP2009181363A - Image-processing device, image-generating device, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image-processing device which quickly detects printing medium information and efficiently uses code images. <P>SOLUTION: The image-processing device is provided with: an image-reading part 21 which reads out images; a dot sequence-generating part 22 which generates a dot sequence from the images; a block-detecting part 23 which detects blocks on the dot sequence to generate a code sequence; a synchronous code-detecting part 24 which detects synchronous codes on the code sequence; an identification code-detecting part 30 which detects identification codes from the code sequence; and an X-coordinate code detecting part 40 and a Y-coordinate code detecting part 45 which detect coordinates codes from the code sequence. An X-coordinate code decoding part 42 and a Y-coordinate code decoding part 47 detect printing medium information from the coordinates information. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing device, an image generation device, and a program.

  In recent years, characters and pictures are drawn on special paper on which fine dots are printed, and the data written on the paper by the user is transferred to a personal computer or mobile phone. The technology that makes it possible is drawing attention.

  For example, in Patent Document 1, a machine-readable fragment of a code pattern parameterized in an N-dimensional space (N is 2 or more) is attached to a two-dimensional or three-dimensional physical object, and the machine-readable address of the attached fragment A method for identifying and distinguishing physical objects that allows objects to be uniquely identified by a spatial address is disclosed.

  Patent Document 2 is based on the use of a position coding pattern that defines a virtual surface, and the virtual surface is composed of all positions whose absolute coordinates can only be encoded by the position coding pattern. , At least two unique regions, each dedicated to a predetermined handling of information, are defined on the virtual surface, so that the handling of information represented by the absolute coordinates of at least one position on the virtual surface A global information handling system is disclosed that is executed based on region attributes of at least one location.

  Furthermore, in Patent Document 3, a user fills in a predetermined printed matter, receives information entered by the user as data, creates an electronic document based on the received entry information, and further identifies the created electronic document. The identification information that uniquely identifies the code and the created electronic document is attached or pasted as authentication information to the printed material, and after the prescribed operation, the authentication information attached or pasted to the printed material Based on this, an authentication system that can detect whether a printed matter or an electronic document has been tampered with is disclosed.

JP-A-10-187911 Special table 2003-519423 gazette JP 2004-045494 A

Here, there is a case where it is desired to acquire medium information such as the size when decoding the code information. However, in the conventional technique, it is necessary to make an inquiry to the server, and in this case, the reliability is likely to be lowered due to the influence of the network.
An object of the present invention is to provide an image processing apparatus and the like that can acquire information on a medium by a simple technique and perform predetermined processing.

  The invention according to claim 1 is an acquisition unit that acquires the image read from the medium on which an image representing coordinate information indicating a position on the medium is printed, and the image acquired by the acquisition unit. Coordinate information detection means for detecting coordinate information, print medium information detection means for detecting print medium information from the coordinate information acquired by the coordinate information detection means, and the coordinate information detected by the coordinate information detection means An image processing apparatus comprising: a determination unit that determines a processing content for the coordinate information according to a comparison result with the print medium information detected by the print medium information detection unit.

The invention according to claim 2 is characterized in that the print medium information detecting means detects the print medium information from a position in a coordinate space corresponding to the coordinate information acquired by the coordinate information detecting means. The image processing apparatus according to Item 1.
According to a third aspect of the present invention, the coordinate space is divided into a plurality of areas corresponding to predetermined print medium information, and the print medium information detecting means is configured to determine a position of the coordinate information in the coordinate space. The image processing apparatus according to claim 2, wherein the print medium information is detected based on whether the area corresponds to the area.
The invention according to claim 4 is the image processing apparatus according to claim 1, wherein the print medium information is size information of the medium.
The invention described in claim 5 is characterized in that the print medium information is usage information of the medium, and the processing content determined by the determining means is a change of a decoding parameter. This is an image processing apparatus.

  The invention according to claim 6 is coordinate information acquisition means for acquiring coordinate information indicating a position on a medium according to a predetermined coordinate system, and print medium information acquisition for acquiring print medium information which is predetermined information about the medium. Means, conversion coordinate calculation means for converting the coordinate information into coordinate information corresponding to the print medium information, and generation means for generating an image representing the coordinate information calculated by the conversion coordinate calculation means. Is an image generation apparatus characterized by the above.

  A seventh aspect of the present invention is the image generating apparatus according to the sixth aspect, wherein there are a plurality of pieces of print medium information corresponding to the coordinate information.

  According to an eighth aspect of the present invention, there is provided a computer having a function of acquiring the image read from the medium on which an image representing coordinate information indicating a position on the medium is printed, and the coordinate information from the acquired image. , A function of detecting print medium information from the acquired coordinate information, and a processing content for the coordinate information is determined according to a comparison result between the detected coordinate information and the print medium information. Is a program for realizing the functions.

  The invention according to claim 9 provides a computer with a function of acquiring coordinate information indicating a position on a medium according to a predetermined coordinate system, a function of acquiring print medium information which is predetermined information about the medium, It is a program for realizing a function of converting coordinate information into coordinate information corresponding to the print medium information and a function of generating an image representing the converted coordinate information.

Since the print medium information can be detected from the coordinate information, the print medium information can be detected quickly and the use efficiency of the code image is good.
The invention of claim 2 has an effect that the calculation for detecting the print medium information from the coordinate information becomes easier than in the case where the present configuration is not provided.
The invention of claim 3 has the effect that the coordinate space can be used more efficiently than in the case where the present configuration is not provided.
Since the size information can be detected from the coordinate information, the invention according to the fourth aspect has an effect that a service corresponding to the size information can be quickly provided.
The invention of claim 5 has an effect that the decoding accuracy is improved as compared with the case where the present configuration is not provided.
The invention of claim 6 has the effect that the print medium information can be more easily given to the coordinate information and the use efficiency of the code image is better than when the present configuration is not provided.
The invention of claim 7 has the effect that the coordinate space can be used more efficiently than in the case where the present configuration is not provided.
The invention of claim 8 has the effect that the calculation for detecting the print medium information from the coordinate information becomes easier than in the case where the present configuration is not provided.
The invention according to claim 9 has an effect that the print medium information can be added to the coordinate information more easily than the case where the present configuration is not provided.

Embodiments of the present invention will be described below with reference to the accompanying drawings.
First, a code pattern constituting a code image to be read will be described.
In the present embodiment, mCn (= m) by a pattern image (hereinafter referred to as “unit code pattern”) in which unit images are arranged at n (1 ≦ n <m) locations selected from m (m ≧ 3) locations. ! / {(Mn)! × n!}) Expresses the information as shown. That is, instead of associating one unit image with information, a plurality of unit images are associated with information. Assuming that one unit image is associated with information, there is a drawback in that erroneous information is expressed when the unit image is lost or noise is added. On the other hand, for example, if two unit images are associated with information, it can be easily understood that there is an error when the number of unit images is one or three. Furthermore, in the method of expressing 1 bit or at most 2 bits in one unit image, it is not possible to express a synchronous pattern that controls reading of the information pattern with a pattern visually similar to the pattern that represents information. . For this reason, the present embodiment employs the above encoding method. Hereinafter, such an encoding method is referred to as an mCn method.
Here, a unit image having any shape may be used. In the present embodiment, a dot image (hereinafter simply referred to as “dot”) is used as an example of a unit image, but an image having another shape such as a hatched pattern may be used.

FIG. 1 shows an example of a unit code pattern in the mCn system.
In the figure, a black area and a hatched area are areas where dots can be arranged, and a white area between them is an area where dots cannot be arranged. Of the areas where dots can be arranged, dots are arranged in black areas and dots are not arranged in hatched areas. That is, FIG. 1 shows an example in which an area where a total of 9 dots of 3 dots in the vertical direction and 3 dots in the horizontal direction can be arranged is provided. FIG. FIG. 6B shows a unit code pattern, and FIG. 5B shows a unit code pattern in the 9C3 method in which 3 dots are arranged in an area where dots can be arranged.

  By the way, the dots (black areas) arranged in FIG. 1 are only for information representation, and do not necessarily match the dots (minimum squares in FIG. 1) which are the minimum units constituting the image. In this embodiment, when “dot” refers to the former dot and the latter dot is referred to as “pixel”, the dot has a size of 2 pixels × 2 pixels at 600 dpi. . Since the size of one pixel at 600 dpi is 0.0423 mm, one side of the dot is 84.6 μm (= 0.0423 mm × 2). The larger the dot, the more likely it will be noticeable, so it is preferable to make it as small as possible. However, if it is too small, printing with a printer becomes impossible. Therefore, the above value is adopted as the dot size, which is larger than 50 μm and smaller than 100 μm. However, the above value 84.6 μm is a numerical value to the last, and is about 100 μm in the actually printed toner image.

FIG. 2 shows another example of the unit code pattern. In this figure, spaces between dots are omitted.
FIG. 2A shows all unit code patterns in the 9C2 system shown in FIG. In the 9C2 system, 36 (= ₉ C ₂ ) types of information are expressed using these unit code patterns. FIG. 2B shows all unit code patterns in the 9C3 system shown in FIG. In the 9C3 system, 84 (= ₉ C ₃ ) types of information are expressed using these unit code patterns.

The unit code pattern is not limited to m = 9. For example, a value such as 4, 16 may be adopted as the value of m. Also, any value may be adopted as long as n satisfies 1 ≦ n <m.
Further, as the value of m, not only a square number (the square of an integer) but also a product of two different integers may be adopted. That is, the area in which dots can be arranged is not limited to a square area as in the case of arranging 3 dots × 3 dots, but may be a rectangular area as in the case of arranging 3 dots × 4 dots. In this specification, the rectangle means a rectangle in which the lengths of two adjacent sides are not equal.

By the way, all unit code patterns in the mCn system are assigned pattern values that are numbers for identifying each unit code pattern.
FIG. 3 shows the correspondence between unit code patterns and pattern values in the 9C2 system. Since there are 36 unit code patterns in the 9C2 system, 0 to 35 are used as pattern values. However, the correspondence shown in FIG. 3 is merely an example, and any pattern value may be assigned to any unit code pattern. In addition, although not shown in the figure for the 9C3 system, each unit code pattern is assigned a pattern value of 0 to 83.

  In this way, mCn types of unit code patterns are prepared by selecting n locations from m locations. In this embodiment, a specific pattern is used as an information pattern among these unit code patterns. The rest is used as a synchronization pattern. Here, the information pattern is a pattern representing information to be embedded in the medium. The synchronization pattern is a pattern used for taking out an information pattern printed on a medium. For example, it is used for specifying the position of the information pattern or detecting the rotation of the image. Any medium may be used as long as an image can be printed. Since paper is a representative example, the medium will be described as paper below, but metal, plastic, fiber, or the like may be used.

Here, the synchronization pattern will be described.
FIG. 4 is an example of a synchronization pattern in the 9C2 system. Thus, when m in the mCn system is a square number, it is necessary to prepare four types of unit code patterns as synchronization patterns in order to detect image rotation. Here, the unit code pattern of the pattern value 32 is an upright synchronization pattern. In addition, the unit code pattern of the pattern value 33 is rotated 90 degrees to the right, the synchronization pattern of the pattern value 34 is rotated 180 degrees to the right, and the unit code pattern of the pattern value 35 is rotated 270 degrees to the right. The synchronization pattern is used. In this case, 5-bit information may be expressed by using the remainder obtained by removing these four types of synchronization patterns from 36 types of unit code patterns as an information pattern. However, the method of assigning 36 types of unit code patterns to information patterns and synchronization patterns is not limited to this. For example, five sets of synchronization patterns that constitute one set of four types may be prepared, and the remaining 16 types of information patterns may represent 4-bit information.

  Although not shown, when m in mCn is a product of two different integers, two types of unit code patterns may be prepared as synchronization patterns in order to detect image rotation. For example, if an area where 3 dots vertical by 4 dots horizontal should be detected but an area where 4 dots vertical by 3 dots horizontal can be arranged, the image is 90 degrees or 270 degrees at that time. It is because it turns out that it is rotating.

Next, a method for expressing identification information and coordinate information by arranging such code patterns will be described.
First, a code block composed of the above-described unit code pattern will be described.
FIG. 5 shows an example of a code block. In the figure, it is also shown that a unit code pattern in the 9C2 system is used. That is, 36 types of unit code patterns are divided into, for example, 4 patterns used as synchronization patterns and 32 patterns used as information patterns, and each pattern is arranged according to a layout.
In the figure, a layout in which 3 areas × 3 dots area (hereinafter referred to as “block”) 25 × 5 × 5 are arranged is used. Of the 25 blocks, a synchronization pattern is arranged in the upper left block. In addition, an information pattern representing X coordinate information that specifies coordinates in the X direction on the paper surface is arranged in the four blocks to the right of the synchronization pattern, and the Y direction coordinates on the paper surface are specified in the four blocks below the synchronization pattern. An information pattern representing coordinate information is arranged. Further, an information pattern representing the identification information of the document printed on the paper surface or the paper surface is arranged in 16 blocks surrounded by the information pattern representing the coordinate information.
The unit code pattern in the 9C2 system is merely an example, and the unit code pattern in the 9C3 system may be used as shown in the lower left of the figure.

Next, a layout for expressing identification information and coordinate information in this embodiment will be described.
FIG. 6 shows a part of such a layout.
In this layout, the code block shown in FIG. 5 is used as a basic unit, and this code block is periodically arranged on the entire sheet. In the figure, the synchronization pattern is represented by “S”. Also, the coordinate information is expressed in M series over the vertical and horizontal sides of the page. In the figure, patterns representing the X coordinate are represented by “X1”, “X2”,..., And patterns representing the Y coordinate are represented by “Y1”, “Y2”,. Furthermore, although some methods can be used for encoding the identification information, RS encoding is suitable in this embodiment. This is because the RS code is a multi-level coding method, and in this case, the block representation should correspond to the multi-value of the RS code. In the figure, the pattern representing the identification information is represented by “IXY” (X = 1 to 4, Y = 1 to 4).

Here, the M series used for expressing the coordinate information will be described.
The M sequence is a sequence whose partial sequence does not match other partial sequences. For example, the eleventh order M-sequence is a bit string of 2047 bits. The same sequence as the partial sequence of 11 bits or more extracted from the 2047-bit bit string does not exist in the 2047-bit bit string other than itself. In this embodiment, 16 unit code patterns are associated with 4 bits. That is, a bit string of 2047 bits is expressed in decimal notation for every 4 bits, a unit code pattern is determined according to the correspondence of FIG. 3, and is expressed as a coordinate code across the paper in the horizontal and vertical directions. Therefore, at the time of decoding, the position on the bit string is specified by specifying three consecutive unit code patterns.

FIG. 7 shows an example of encoding coordinate information using an M sequence.
(A) shows a bit string “0111000101011010000110010...” As an example of the 11th order M-sequence. In the present embodiment, this is divided into 4 bits, and the first partial sequence “0111” is a unit code pattern of pattern value 7 and the second partial sequence “0001” is a unit code pattern of pattern value 1. As a result, the third partial sequence “0101” is arranged as a unit code pattern with a pattern value of 5, and the fourth partial sequence “1010” is arranged as a unit code pattern of a pattern value of 10, respectively.

  In addition, if the unit code pattern is divided by 4 bits and assigned to the unit code pattern in this way, as shown in FIG. That is, since the 11th order M-sequence is 2047 bits, if this sequence is cut out every 4 bits and expressed by a unit code pattern, 3 bits are added at the end. The first 1 bit of the M sequence is added to these 3 bits to form 4 bits, which are represented by a unit code pattern. Further, the unit code pattern is cut out every 4 bits from the second bit of the M sequence. Then, the next cycle starts from the third bit of the M sequence, and the next cycle starts from the fourth bit of the M sequence. Furthermore, the fifth cycle starts from the fifth bit, which coincides with the first cycle. Therefore, if four cycles of the M sequence are cut out every 4 bits, it is possible to use all 2047 unit code patterns. Since the M sequence is 11th order, the three consecutive unit code patterns do not match the continuous code pattern at any other position. Therefore, decoding can be performed by reading three unit code patterns at the time of reading. However, in the present embodiment, coordinate information is expressed by four unit code patterns in consideration of the occurrence of errors.

  By the way, when such encoding is performed, the M sequence of 4 periods is divided into 2047 blocks and stored. In the layout as shown in FIG. 6, since the blocks where the synchronization pattern is arranged are sandwiched between them, the length of 2558 (≈2047 × 5/4) blocks is covered with the M sequence of 4 cycles. become. Since the length of one side of one block is 0.508 mm (12 pixels at 600 dpi), the length of 2558 blocks is 1299.5 mm. That is, a length of 1299.5 mm is encoded. Since the long side of the A0 size is 1188.0 mm, in this embodiment, the coordinates on the A0 size paper are encoded.

Thus, in the present embodiment, a coordinate having a predetermined length is encoded. However, the paper size specified in actual printing is various. Accordingly, not all the coordinates on the A0 size paper are used, but a portion necessary for the actually specified paper size is cut out from the coordinates. In such a case, if there is an error in the read image, the following situation occurs. For example, when A4 size paper is used, if the coordinates obtained by decoding are within the A4 size, it can be assumed that the coordinates are correct, but the coordinates obtained by decoding are out of the A4 size. When it is within the A0 size, it becomes impossible to detect that it is an error.
FIG. 8 shows the situation at this time.
In the figure, a portion necessary for the A4 size is cut out from the coordinates on the A0 size paper and used. Here, it is assumed that the point P on the A4 size paper is designated by the pen device. However, it is erroneously recognized that the point Q outside the A4 size sheet is instructed.

Therefore, it is necessary to acquire information on the size of the paper (medium) (hereinafter referred to as “size information”) as a robust method that enables decoding even if there is an error in the read image.
As one method for that purpose, for example, a method is conceivable in which the image generation apparatus 10 described later in detail stores size information and inquires of the image generation apparatus 10 using communication means as appropriate. However, this method is susceptible to the influence of a communication network or the like used as a communication means, and there is a problem that reliability is lowered.

  Another example is a method of embedding size information as an information pattern together with document identification information and coordinate information. However, this method also requires a separate area for embedding size information, and it is necessary to reduce document identification information, coordinate information, or redundant information for detecting and correcting these errors. There is a problem of causing a decrease in

  In addition, the size information is not limited to the convenience that can be obtained as information about paper. For example, when the usage information of a paper such as a paper for a laser printer or an ink jet paper can be acquired, a decoding parameter that is a detection condition according to the paper in the decoding of code information to be described later Therefore, the decoding accuracy can be further improved. More specifically, specular reflection detection parameters are made strict because regular reflection is likely to occur on a sheet with high surface gloss. In addition, since preprinted paper can make dots to be printed smaller and have a higher resolution, the dot detection parameter at the time of decoding is changed accordingly.

In addition, if information related to paper security settings, device information with document identification information, and the like are acquired, processing corresponding to the information can be performed and convenience is improved.
In the present embodiment, information on paper (medium) such as size information, paper usage information, paper security setting information, and device information to which document identification information is added is collectively referred to as “printing medium information”. I will say.

Here, in the present embodiment, print medium information is detected from the coordinate information.
FIGS. 9A to 9B are diagrams illustrating a specific example in the case where size information is detected from coordinate information. FIG. 9A conceptually shows a coordinate space used when forming a code image to be used.
Here, a coordinate space having a certain region is divided into a plurality of regions, and the coordinate space of one of the regions is used for each size, and other regions are not used. Then, the size information is detected according to which region of the coordinate space is used to form the code image.

More specifically, it is assumed that, for example, the image forming the code image is A0 size paper. In this case, the code image is formed using the area of the coordinate space indicated by “A0” in FIG. 9A, and the coordinate space of the other area is not used. By doing so, when the code image is read, the coordinate information indicates that the area is indicated by “A0” in FIG. 9A, and the size of the used paper is A0. Can be detected.
The method for dividing the coordinate space is not particularly limited, and any region in the coordinate space can be arbitrarily selected. For example, as shown in FIG. 9B, all of the paper sizes may be divided into regions having the same size.
Although the case where the paper size information is acquired has been described above, it is conceivable that the area is further increased, and for example, information on the vertical and horizontal orientations of the paper is also detected.

Since size information can be quickly acquired by such a simple method, for example, when copying is performed by a multifunction device, processing is performed when the size information and the size of the paper detected by the multifunction device are different. Processing such as stopping or notifying the user of an error can be performed more quickly.
In addition, since the size information can be acquired quickly, for example, the pen device 60 as the image processing apparatus 20 described later touches the paper, and the same size as the paper on the screen of the computer on which the application operated by the user operates. It is also possible to provide a service that displays a virtual sheet having

FIG. 10 is a diagram for explaining a specific example in a case where the usage information of the paper is detected from the coordinate information. The coordinate space used when forming the code image used is conceptually illustrated.
Also in FIG. 10, as in the case described with reference to FIGS. 9A to 9B, a coordinate space having a certain area is divided into a plurality of areas, and the coordinate space of one of the areas is divided for each use of the paper. And other areas are not used. In the case of FIG. 10, the application information of the paper to be used is detected according to which coordinate space is used to form the code image.

Specifically, in the case shown in FIG. 10, a predetermined portion of the coordinate space is a coordinate area used when the paper is for preprinted paper, and is for laser printer printing paper (black toner). The coordinate area used when printing on laser printer paper (transparent toner), the coordinate area used when printing on inkjet printer paper, the coordinate area used when printing on plastic media In addition, the above-described use information of the paper can be detected depending on which area of each coordinate space is used.
Since paper usage information can be quickly acquired by such a simple method, for example, it is possible to shorten the service activation time corresponding to the acquired paper usage information.

FIG. 11 is a diagram illustrating a specific example in the case of detecting the security setting information of the printed medium from the coordinate information.
Also in FIG. 11, as described above, a coordinate space having a certain area is divided into a plurality of areas, and the coordinate space of one of the areas is used for each security setting information of the printed medium, and other areas are used. Will not be used. In the case of FIG. 11, the security setting information of the medium is detected according to which coordinate space is used to form the code image.
In the case shown in FIG. 11, a predetermined area in the coordinate space is defined as a coordinate area used when there is no security setting, a coordinate area used when copy / scan / fax is prohibited, and a copy / scan / fax. A coordinate area used when access is restricted, a coordinate area used when writing with a pen is prohibited, and a coordinate area used when writing access with a pen is restricted are allocated to each of these coordinate spaces. Depending on whether the area is used, the security setting information of the medium described above can be detected.

FIG. 12 is a diagram illustrating a specific example in the case of detecting device information to which document identification information is added from coordinate information.
In the case shown in FIG. 12, a coordinate space having a certain region is divided into a plurality of regions, and the coordinate space of any one of the regions is used for each piece of device information to which the document identification information is added. The area will not be used. In the case of FIG. 12, device information to which document identification information is added is detected depending on which coordinate space is used to form the code image.
In the case shown in FIG. 12, the coordinate area to be used when the print medium is generated by the client, the coordinate area to be used when the print medium is generated by the printer driver, and the print medium generated by the server Is assigned to the coordinate area to be used in the case of print media, and to the coordinate area to be used in the case of print media generated by a printer / multi-function peripheral, and the above document identification is made depending on which area of these coordinate spaces is used. The device information to which the information is added can be detected.

It is also possible to add a plurality of print medium information in a composite manner.
FIG. 13 is a diagram for explaining an example in which two types of print medium information are provided in combination in a coordinate space having a certain area.
The coordinate space shown in FIG. 13 is divided into a plurality of regions in the vertical and horizontal directions in FIG. Each rectangular area divided in the vertical direction is given size information, and each rectangular area divided in the horizontal direction is given security setting information of the printed medium. Then, use the coordinate space of one of the areas where the rectangular area divided in the vertical direction intersects with the rectangular area divided in the horizontal direction, and do not use the other areas To do. By doing so, it is possible to detect both the print medium information of the size information and the security setting information of the medium depending on which coordinate area is used to form the code image.

Next, the image generation apparatus 10 that generates such an image will be described.
FIG. 14 is a block diagram illustrating a configuration example of the image generation apparatus 10.
As illustrated, the image generation apparatus 10 includes an information acquisition unit 11, a converted coordinate calculation unit 12, a coordinate space storage unit 12a, an identification code generation unit 13, an X coordinate code generation unit 14, and a Y coordinate code generation. Unit 15, code array generation unit 16, pattern image storage unit 17, and code image generation unit 18.

The information acquisition unit 11 acquires the identification information of the document to be printed on the paper or the paper, the coordinate information on the paper, and the print medium information. Then, the document identification information is output to the identification code generation unit 13, and the coordinate information and the print medium information are output to the converted coordinate calculation unit 12. In the present embodiment, the information acquisition unit 11 is provided as an example of coordinate information acquisition means for acquiring coordinate information and as an example of print medium information acquisition means for acquiring print medium information.
The conversion coordinate calculation unit 12 converts coordinate information on the paper into coordinates corresponding to the print medium information, and among the converted coordinates, the X coordinate information is converted to the X coordinate code generation unit 14 and the Y coordinate information is converted to the Y coordinate code. Output to the generation unit 15. In the present embodiment, the conversion coordinate calculation unit 12 is provided as an example of the conversion coordinate calculation means.
The coordinate space storage unit 12a stores information on the coordinate space referred to by the converted coordinate calculation unit 12. Specifically, the coordinate area in the coordinate space corresponding to each print medium information described in FIGS. 9 to 13 is stored.

The identification code generation unit 13 encodes the identification information acquired from the information acquisition unit 11 and outputs an identification code that is encoded identification information to the code array generation unit 16. The coding of the identification information includes block division and RS coding processing.
Among these, the block division is a process of dividing the bit string constituting the identification information into a plurality of blocks in order to perform RS encoding. For example, when an information pattern capable of expressing 5-bit information in the 9C2 system is used, the 60-bit identification information is divided into 12 blocks having a block length of 5 bits.
RS encoding is a process of performing RS encoding on the divided blocks and adding redundant blocks for error correction. If an RS code capable of correcting an error of 2 blocks is adopted in the previous example, the code length is 16 blocks.

The X coordinate code generation unit 14 encodes the X coordinate information. The Y coordinate code generation unit 15 encodes the Y coordinate information. And these output the coordinate code | cord | chord which is the encoded coordinate information to the code arrangement | sequence production | generation part 16. FIG. The encoding of the coordinate information includes M-sequence encoding and block division processing.
Among these, the M sequence encoding is a process of encoding coordinate information using the M sequence. For example, a necessary M-sequence order is obtained from the length of coordinate information to be encoded, and a coordinate code is generated by dynamically generating the M-sequence. However, when the length of the coordinate information to be encoded is known in advance, the M series may be stored in the memory or the like of the image generation apparatus 10 and read out when generating the image.
Block division is processing for dividing an M sequence into a plurality of blocks. For example, if 16 types of unit code patterns are selected as the information pattern, 4-bit information is stored in each block in the code block. Therefore, 16 bits of X coordinate information are stored for a code block having a layout as shown in FIG. Then, the coordinate information is represented by the unit code pattern by the method described with reference to FIG.

The code array generation unit 16 reads the identification code generated by the identification code generation unit 13, the coordinate code generated by the X coordinate code generation unit 14 and the Y coordinate code generation unit 15, and the identification code and the coordinate code. Are arranged on a two-dimensional plane to generate a two-dimensional code array. Here, the synchronization code is a code corresponding to the synchronization pattern.
The pattern image storage unit 17 stores, for example, a unit code pattern in the mCn system shown in FIG. Here, the pattern value is attached to the unit code pattern as described above, and each unit code pattern can be read using the pattern value as a key. In the present embodiment, the pattern image storage unit 17 only needs to store at least unit code patterns in the mCn method corresponding to predetermined m and n.
The code image generation unit 18 refers to the two-dimensional code array generated by the code array generation unit 16 and selects a unit code pattern corresponding to each code value to generate a code image. In the present embodiment, a code image generation unit 18 is provided as an example of a generation unit that generates an image representing coordinate information and range information.

  The code image is transferred to an image forming unit (not shown), and the image forming unit forms a code image on the sheet. At this time, a superimposed image obtained by superimposing the document image of the electronic document and the code image may be formed on the paper surface. When forming a superimposed image in this way, manage the correspondence between the position on the electronic document and the position on the paper so that the writing data from the pen device on the paper is reflected at an appropriate position on the electronic document. Is desirable.

The image forming unit forms the code image with K toner (infrared light absorbing toner containing carbon) or special toner, for example, using an electrophotographic system.
Here, as the special toner, an invisible toner having a maximum absorption rate of 7% or less in the visible light region (400 nm to 700 nm) and an absorption rate of 30% or more in the near infrared region (800 nm to 1000 nm) is exemplified. . Here, “visible” and “invisible” are not related to whether they can be recognized visually. “Visible” and “invisible” are distinguished depending on whether or not an image formed on a printed medium can be recognized by the presence or absence of color development due to absorption of a specific wavelength in the visible light region. Further, “invisible” includes those that have some color developability due to absorption of a specific wavelength in the visible light region but are difficult to recognize with human eyes.

  These functions are realized by cooperation between software and hardware resources. Specifically, the CPU 91 (see FIG. 19) of the image generation apparatus 10 includes an information acquisition unit 11, a conversion coordinate calculation unit 12, an identification code generation unit 13, an X coordinate code generation unit 14, a Y coordinate code generation unit 15, and a code. For example, the program for realizing the array generation unit 16 and the code image generation unit 18 is realized by reading the program from the magnetic disk device 93 (see FIG. 19) into the main memory 92 (see FIG. 19) and executing it. The coordinate space storage unit 12a and the pattern image storage unit 17 may be realized by using, for example, a magnetic disk device 93 (see FIG. 19). Furthermore, the program and data stored in the magnetic disk device 93 (see FIG. 19) may be loaded from a recording medium such as a CD, or may be downloaded via communication means such as the Internet.

Next, the operation of the image generation apparatus 10 will be described.
FIG. 15 is a flowchart illustrating an operation example of the image generation apparatus 10.

  When there is a print instruction, in the image generation apparatus 10, the information acquisition unit 11 acquires document identification information, coordinate information on the paper, and print medium information included in the print instruction (step 101).

  Next, the information acquisition unit 11 outputs the document identification information to the identification code generation unit 13, and outputs the coordinate information and the print medium information to the converted coordinate calculation unit 12 (step 102).

  Next, the conversion coordinate calculation unit 12 refers to the coordinate space storage unit 12a, converts the coordinate information on the paper into coordinates according to the print medium information, and converts the X coordinate information among the converted coordinates to the X coordinate. The Y coordinate information is output to the code generator 14 to the Y coordinate code generator 15 (step 103).

  Next, the identification code generation unit 13 encodes the identification information acquired from the information acquisition unit 11, and outputs the identification code that is the encoded identification information to the code array generation unit 16 (step 104).

Further, the X coordinate code generation unit 14 encodes the X coordinate information, and outputs an identification code that is the encoded identification information to the code array generation unit 16 (step 105).
The Y coordinate code generation unit 15 encodes the Y coordinate information and outputs an identification code that is the encoded identification information to the code array generation unit 16 (step 106).

  Next, the code array generation unit 16 includes an identification code generated by the identification code generation unit 13, a coordinate code generated by the X coordinate code generation unit 14 and the Y coordinate code generation unit 15, an identification code and a coordinate. A two-dimensional code array is generated by arranging synchronous codes for controlling the reading of codes on a two-dimensional plane (step 107).

  Next, the code image generation unit 18 refers to the two-dimensional code array generated by the code array generation unit 16 and selects a unit code pattern corresponding to each code value from the pattern image storage unit 17 to generate a code image. (Step 108).

Next, the image processing apparatus 20 that reads and processes the code image formed on the paper surface will be described.
FIG. 16 is a block diagram illustrating a configuration example of the image processing apparatus 20.
As illustrated, the image processing apparatus 20 includes an image reading unit 21, a dot array generation unit 22, a block detection unit 23, a synchronization code detection unit 24, a rotation determination unit 25, and a code array rotation unit 26. Prepare. In addition, an identification code detection unit 30, an identification code decoding unit 32, an identification code error detection unit 33, and an identification code error correction unit 34 are provided. Furthermore, an X coordinate code detection unit 40, an X coordinate code decoding unit 42, an X coordinate code error detection unit 43, an X coordinate code error correction unit 44, a Y coordinate code detection unit 45, and a Y coordinate code decoding unit 47. A Y coordinate code error detection unit 48, a Y coordinate code error correction unit 49, and an information output unit 50.

The image reading unit 21 reads a code image printed on a paper surface using an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS).
The dot array generation unit 22 detects dots from the read code image, and generates a dot array with reference to the dot positions. Note that, as preprocessing for dot detection from the code image, processing for removing noise included in the read image is also performed. Here, the noise includes, for example, variations in image sensor sensitivity and noise generated by an electronic circuit. The type of noise removal processing should match the characteristics of the imaging system, but sharpening processing such as blurring processing and unsharp masking may be applied. In addition, dot detection is performed as follows. That is, first, a dot image portion and other background image portions are separated by binarization processing, and a dot position is detected from each binarized image position. At that time, since there are cases where a lot of noise components are included in the binarized image, it is necessary to combine filter processing for determining dots based on the area and shape of the binarized image. Thereafter, the dot array is generated by replacing the dot detected as an image with digital data on the two-dimensional array, for example, “1” for the position where the dot is and “0” for the position where there is no dot. Do. In the present embodiment, a dot array generation unit 22 is provided as an example of an acquisition unit that acquires a read image.

  The block detection unit 23 detects a block corresponding to the unit code pattern in the code block on the dot array. In other words, a rectangular block delimiter having the same size as the unit code pattern is appropriately moved on the dot array, the position where the number of dots in the block is equal is the correct block delimiter position, and the code that stores the pattern value in each block Create an array.

The synchronization code detector 24 refers to the type of each unit code pattern detected from the dot array and detects the synchronization code.
The rotation determination unit 25 determines image rotation based on the detected synchronization code. For example, when a square unit code pattern is used, there is a possibility of rotating in units of 90 degrees. Therefore, the direction is detected depending on which of the four types of synchronization patterns the detected synchronization code corresponds to. Further, when a rectangular unit code pattern is used, there is a possibility that the unit code pattern is rotated by 180 degrees. Therefore, the direction is detected depending on which of the two types of synchronization patterns the detected synchronization code corresponds to.
The code array rotation unit 26 rotates the code array by the rotation angle detected by the rotation determination unit 25 and sets the code array in the correct direction.

The identification code detection unit 30 detects the identification code from the code array whose angle is corrected with reference to the position of the synchronization code. At this time, a process of rearranging the identification codes in the correct code order is also performed.
The identification code decoding unit 32 decodes the identification code using the same parameters (such as the number of blocks) used in the RS code encoding process described with reference to FIG. 10, and outputs identification information.
The identification code error detection unit 33 detects an error of the decoded identification code, and the identification code error correction unit 34 corrects the error when the detected error is a correctable error.

The X coordinate code detection unit 40 detects the X coordinate code from the code array whose angle is corrected with reference to the position of the synchronization code. At this time, a process of removing the synchronization code from the X coordinate code is also performed.
The X coordinate code decoding unit 42 extracts the M series partial sequence from the detected X coordinate code, refers to the position of this partial sequence in the M sequence used for image generation, and corrects this position with the shift amount of the code block The obtained value is output as X coordinate information.
The X coordinate code error detection unit 43 detects an error in the decoded X coordinate code, and the X coordinate code error correction unit 44 corrects the error when the detected error is a correctable error.

The Y coordinate code detection unit 45 detects the Y coordinate code from the code array whose angle is corrected with reference to the position of the synchronization code. At this time, a process of removing the synchronization code from the Y coordinate code is also performed.
The Y coordinate code decoding unit 47 extracts the M series partial sequence from the detected Y coordinate code, refers to the position of this partial sequence in the M sequence used for image generation, and corrects this position with the shift amount of the code block. The obtained value is output as Y coordinate information.
The Y coordinate code error detection unit 48 detects an error of the decoded Y coordinate code, and the Y coordinate code error correction unit 49 corrects the error when the detected error is a correctable error.

  In the present embodiment, an X coordinate code detection unit 40 and a Y coordinate code detection unit 45 are provided as an example of detection means for detecting coordinate information. In addition, an X coordinate code decoding unit 42 and a Y coordinate code decoding unit 47 are provided as an example of a print medium information detection unit that detects print medium information from coordinate information and a determination unit that determines processing content for the coordinate information.

  The information output unit 50 outputs the identification information, the X coordinate information, and the Y coordinate information acquired from the identification code decoding unit 32, the X coordinate code decoding unit 42, and the Y coordinate code decoding unit 47, respectively.

  These functions are realized by cooperation between software and hardware resources. Specifically, the CPU 91 (see FIG. 19) of the image processing apparatus 20 performs the dot array generation unit 22, the block detection unit 23, the synchronization code detection unit 24, the rotation determination unit 25, the code array rotation unit 26, and the identification code detection unit. 30, identification code decoding unit 32, identification code error detection unit 33, identification code error correction unit 34, X coordinate code detection unit 40, X coordinate code decoding unit 42, X coordinate code error detection unit 43, X coordinate code error correction unit 44, a Y-coordinate code detection unit 45, a Y-coordinate code decoding unit 47, a Y-coordinate code error detection unit 48, a Y-coordinate code error correction unit 49, and an information output unit 50, for example, a magnetic disk device 93 (FIG. 19) to the main memory 92 (see FIG. 19) and executed. Further, the program and data stored in the magnetic disk device 93 (see FIG. 19) may be loaded from a recording medium such as a CD, or may be downloaded via communication means such as the Internet.

Next, an outline of the operation of the image processing apparatus 20 will be described.
First, the image reading unit 21 reads a code image of an area having a predetermined size from the medium on which the code image is printed.
Next, the dot array generation unit 22 generates a dot array in which “1” is set at a position where a dot is detected and “0” is set at a position where a dot is not detected.
Thereafter, the block detection unit 23 detects block boundaries by superimposing block delimiters on this dot array. Here, as described with reference to FIG. 5, the block is a minimum unit necessary for decoding the embedded information. In the present embodiment, a code block of 5 blocks × 5 blocks is assumed. Therefore, the block size is 5 blocks × 5 blocks.

FIG. 17 is a diagram specifically illustrating processing when a block is detected by moving a block break. Here, it is known that encoding has been performed by the 9C2 system, and a case of decoding by the 9C2 system is shown.
First, the block detection unit 23 acquires a dot array from the dot array generation unit 22. The size of the dot array acquired here is set in advance and is (number of blocks necessary for decoding × number of dots on one side of block + number of dots on one side of block−1) ² . However, since this dot arrangement corresponds to an arbitrarily selected area of the image, the position of the block delimiter is unknown. Therefore, first, block division is performed with reference to the end of the dot array. In this example, since m = 9, block delimiters composed of blocks each having a size of 3 dots × 3 dots are overlapped. Next, the dots in each block are counted. In this example, since n = 2, the position of the block delimiter when there are two dots in each block is the correct delimiter position, but it can be seen that the number of dots varies at this position and is not correct. Therefore, the number of dots in the block is counted by shifting the block delimiter. That is, the same operation is performed for the start position in the right direction, the position moved by one dot, and the position moved by two dots. In addition, the same operation is performed for each of these positions with respect to the start position in the downward direction, the position moved by 1 dot, and the position moved by 2 dots. As a result, the number of dots in all the blocks is “2” at a position where the dot has moved one dot to the right and moved two dots downward. Therefore, this position is set as a correct separation position.

  Thereafter, the synchronization code detection unit 24, the identification code detection unit 30, the X coordinate code detection unit 40, the Y coordinate code detection unit 45, and the like refer to the dot arrangement in each block, so that the synchronization code, the identification code, the X coordinate The code and the Y coordinate code are detected.

Next, specific hardware configurations of the image generation apparatus 10 and the image processing apparatus 20 in the present embodiment will be described.
First, the pen device 60 that implements the image processing apparatus 20 will be described.
FIG. 18 is a view showing the mechanism of the pen device 60.
As illustrated, the pen device 60 includes a control circuit 61 that controls the operation of the entire pen. The control circuit 61 includes an image processing unit 61a that processes a code image detected from an input image, and a data processing unit 61b that extracts identification information and coordinate information from the processing result.
The control circuit 61 is connected to a pressure sensor 62 that detects the writing operation by the pen device 60 by the pressure applied to the pen tip 69. Further, an infrared LED 63 that irradiates infrared light onto the medium and an infrared CMOS 64 that inputs an image are also connected. Further, an information memory 65 for storing identification information and coordinate information, a communication circuit 66 for communicating with an external device, a battery 67 for driving a pen, and pen identification information (pen ID) are stored. A pen ID memory 68 is also connected.

  The image reading unit 21 shown in FIG. 16 is realized by, for example, the infrared CMOS 64 shown in FIG. The dot array generation unit 22 is realized by, for example, the image processing unit 61a in FIG. Further, the block detection unit 23, the synchronization code detection unit 24, the rotation determination unit 25, the code array rotation unit 26, the identification code detection unit 30, the identification code decoding unit 32, the identification code error detection unit 33, the identification code illustrated in FIG. Error correction unit 34, X coordinate code detection unit 40, X coordinate code decoding unit 42, X coordinate code error detection unit 43, X coordinate code error correction unit 44, Y coordinate code detection unit 45, Y coordinate code decoding unit 47, Y The coordinate code error detection unit 48, the Y coordinate code error correction unit 49, and the information output unit 50 are realized by, for example, the data processing unit 61b in FIG.

  Further, the process realized by the image generation apparatus 10 and the process realized by the image processing unit 61a or the data processing unit 61b in FIG. 18 may be realized by a general-purpose computer, for example. Accordingly, assuming that such processing is realized by the computer 90, the hardware configuration of the computer 90 will be described.

FIG. 19 is a diagram illustrating a hardware configuration of the computer 90.
As shown in the figure, the computer 90 includes a CPU (Central Processing Unit) 91 as a calculation means, a main memory 92 as a storage means, and a magnetic disk device (HDD: Hard Disk Drive) 93. Here, the CPU 91 executes various types of software such as an OS (Operating System) and applications to realize the above-described functions. The main memory 92 is a storage area for storing various software and data used for execution thereof, and the magnetic disk device 93 is a storage area for storing input data for various software, output data from various software, and the like. .
Further, the computer 90 includes a communication I / F 94 for performing communication with the outside, a display mechanism 95 including a video memory and a display, and an input device 96 such as a keyboard and a mouse.

  The program for realizing the present embodiment can be provided not only by communication means but also by storing it in a recording medium such as a CD-ROM.

It is the figure which showed an example of the unit code pattern in 9Cn system. It is the figure which showed the other example of the unit code pattern in 9Cn system. It is the figure which showed the correspondence of the unit code pattern and pattern value in 9C2 system. It is the figure which showed the example of the synchronous pattern in 9C2 system. It is the figure which showed the example of the basic layout of a code block. It is the figure which showed the example of the layout on the paper surface of a code block. It is a figure for demonstrating the expression of the coordinate by M series. It is a figure for demonstrating the case where the coordinate instruct | indicated with the pen device and the acquired coordinate differ. It is a figure explaining the specific example in the case of detecting size information from coordinate information. It is a figure explaining the specific example in the case of detecting the usage information of a sheet | seat from coordinate information. It is a figure explaining the specific example in the case of detecting the security setting information of the printed medium from coordinate information. It is a figure explaining the specific example in the case of detecting the apparatus information which provided the identification information of the document from coordinate information. It is a figure explaining an example in the case of giving two types of printing medium information to the coordinate space which has a fixed area | region in composite. It is the block diagram which showed the structural example of the image generation apparatus. It is the flowchart which showed the operation example of the image generation apparatus. It is the block diagram which showed the structural example of the image processing apparatus. It is the figure which showed concretely the process at the time of moving a block break and detecting a block. It is the figure which showed the mechanism of the pen device which can implement | achieve the image processing apparatus in this Embodiment. It is a hardware block diagram of the computer which can apply this Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Image generation apparatus, 20 ... Image processing apparatus, 21 ... Image reading part, 22 ... Dot array generation part, 23 ... Block detection part, 24 ... Synchronous code detection part, 25 ... Rotation determination part, 26 ... Code arrangement rotation part , 30 ... identification code detection unit, 32 ... identification code decoding unit, 33 ... identification code error detection unit, 34 ... identification code error correction unit, 40 ... X coordinate code detection unit, 42 ... X coordinate code decoding unit, 43 ... X Coordinate code error detection unit 44... X coordinate code error correction unit 45. Y coordinate code detection unit 47. Y coordinate code decoding unit 48. Y coordinate code error detection unit 49 49 Y coordinate code error correction unit 50 ... Information output section

Claims (9)

Acquisition means for acquiring the image read from the medium on which an image representing coordinate information indicating a position on the medium is printed;
Coordinate information detection means for detecting the coordinate information from the image acquired by the acquisition means;
Print medium information detecting means for detecting print medium information from the coordinate information acquired by the coordinate information detecting means;
A determination unit that determines a processing content for the coordinate information according to a comparison result between the coordinate information detected by the coordinate information detection unit and the print medium information detected by the print medium information detection unit;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the print medium information detection unit detects the print medium information based on a position in a coordinate space corresponding to the coordinate information acquired by the coordinate information detection unit. The coordinate space is divided into a plurality of areas corresponding to predetermined print medium information,
3. The image according to claim 2, wherein the print medium information detecting unit detects the print medium information based on whether or not a position of the coordinate information in the coordinate space corresponds to any one of the regions. Processing equipment.   The image processing apparatus according to claim 1, wherein the print medium information is size information of the medium. The print medium information is usage information of the medium,
The image processing apparatus according to claim 1, wherein the processing content determined by the determination unit is a change of a decoding parameter. Coordinate information acquisition means for acquiring coordinate information indicating a position on the medium according to a predetermined coordinate system;
Print medium information acquisition means for acquiring print medium information which is predetermined information about the medium;
Conversion coordinate calculation means for converting the coordinate information into coordinate information corresponding to the print medium information;
Generating means for generating an image representing the coordinate information calculated by the converted coordinate calculating means;
An image generation apparatus comprising:   The image generating apparatus according to claim 6, wherein there are a plurality of pieces of print medium information corresponding to the coordinate information. On the computer,
A function of acquiring the image read from the medium on which the image representing the coordinate information indicating the position on the medium is printed;
A function of detecting the coordinate information from the acquired image;
A function of detecting print medium information from the acquired coordinate information;
A function for determining processing contents for the coordinate information according to a comparison result between the detected coordinate information and the print medium information;
A program to realize On the computer,
A function of acquiring coordinate information indicating a position on the medium according to a predetermined coordinate system;
A function of acquiring print medium information which is predetermined information about the medium;
A function of converting the coordinate information into coordinate information corresponding to the print medium information;
A function of generating an image representing the converted coordinate information;
A program to realize

Images