JP2008301120A - Image processor, image generating apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To change contents of processing on coordinates, according to a result of comparison between coordinates on a medium and the range of the coordinates. <P>SOLUTION: The image processor is equipped with an image read section 21 which reads an image, a dot array generating section 22 which generates a dot array from the image, a block detecting section 23 which detects a block in the dot array and generates a code array, a synchronous code detecting section 24 which detects synchronous code in the code array, an identification code detecting section 30 which detects identification code from the code array, and an X coordinate code detecting section 40 and a Y coordinate code detecting section 45 which detect a coordinate code from the code array. Furthermore, an identification code decoding section 32 extracts range information, representing the range of codes from the identification code, and an X coordinate code decoding section 42 and a Y coordinate code decoding section 47 compare the coordinate information extracted from a coordinate code, with the range information acquired by the identification code decoding section 32 and determine the contents of processing with respect to the coordinates. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing device, an image generation device, and a program.

  A method for providing a position code for encoding a plurality of positions on a surface is known (see, for example, Patent Document 1). In this patent document 1, a cyclic numeral sequence is printed a plurality of times along the surface. At that time, using different rotations of the cyclic numeral sequences so that a predetermined deviation occurs between the adjacent numeric strings, a plurality of code windows divided on the surface include at least three cyclic numeral sequences and adjacent codes. It has one numeric string that overlaps one numeric string of the window, and the position of the code window is encoded by a shift between the cyclic numeric strings belonging to the code window.

  There is also known a technique that enables spatially asynchronous reading of encoding from a recording medium that records machine-readable encoding of digital quantum that is logically ranked (see, for example, Patent Document 2). In this document, multiple copies of an encoding that are essentially identical can be formed, and a machine-recognizable spatial synchronization index can be combined with the print position in each of the encoding copies to synchronize the encoding spatially. A large number of cases are provided, and these cases are written in a spatially periodic center grid in the recording medium according to the layout rules.

  Systems and methods for determining the position of captured images from larger images are also known (see, for example, Patent Document 3). In this Patent Document 3, a non-repetitive sequence is folded into a non-repetitive sequence unique to each sub-window of a predetermined size, and the captured position is determined for each sub-window in the non-repetitive sequence. Thus, the position of the captured image is determined from the image of the larger subwindow.

  A technique that enables long-time recording and repeated reproduction of multimedia information that is optically readable is also known (see, for example, Patent Document 4). In this patent document 4, a recording apparatus uses a printer system or a printing plate making system as a dot code that can optically read so-called multimedia information including audio information, video information, digital code data, etc. And record on a medium such as paper. The pen-type information reproducing device sequentially captures the dot code according to the manual scanning of the dot code, and the original audio information is output by the audio output device, the original video information is displayed by the display device, and the original digital code data Is output by a page printer or the like.

  There is also known a technique that enables precise detection of coordinates on a medium without using a tablet (see, for example, Patent Document 5). In this patent document 5, a pen-type coordinate input device optically reads a code symbol formed on a medium and indicating the coordinates on the medium, decodes the read code symbol, and reads the code symbol in the read image. The position, orientation, and amount of distortion are detected. Then, the coordinates of the position of the tip on the medium are detected based on the decoded information and the position, orientation, and distortion amount of the code symbol.

JP-T-2003-511762 JP-A-9-185669 JP 2004-152273 A JP-A-6-231466 JP 2000-293303 A

Here, conventionally, a mechanism for performing processing using coordinates on a medium and a range of the coordinates has not been proposed.
An object of the present invention is to enable processing using coordinates on a medium and a range of the coordinates.

The invention according to claim 1 is an acquisition unit that acquires the image read from the medium on which the image representing the coordinate information indicating the position on the medium and the range information indicating the range of the coordinate information is printed; By coordinate information detection means for detecting the coordinate information from the image acquired by the acquisition means, range information detection means for detecting the range information from the image acquired by the acquisition means, and by the coordinate information detection means Image processing comprising: a determining unit that determines a processing content for the coordinate information according to a comparison result between the detected coordinate information and the range information detected by the range information detecting unit Device.
According to a second aspect of the present invention, the coordinate information indicates a position on the medium by a vertical and horizontal displacement of the position from a predetermined reference point on the medium. The image processing apparatus according to claim 1, wherein the information indicates a range of the coordinate information by information for specifying a length in a vertical direction and a horizontal direction of the medium.
According to a third aspect of the present invention, in the coordinate information, the position on the medium is a vertical direction of the position from a predetermined reference point that is on a specific area including the medium and not on the medium. And the range information includes information for specifying the position of the coordinate information in the coordinate information indicating the position of the coordinate information on the specific area. The image processing apparatus according to claim 1, wherein the image processing apparatus is indicated by information for specifying a length in a vertical direction and a horizontal direction of the medium.
The invention according to claim 4 is a coordinate information acquisition unit that acquires coordinate information indicating a position on a medium according to a predetermined coordinate system, a range information acquisition unit that acquires range information indicating a range of the coordinate information, An image generation apparatus comprising: generation means for generating an image representing the coordinate information acquired by the coordinate information acquisition means and the range information acquired by the range information acquisition means.
According to a fifth aspect of the present invention, the coordinate information acquisition unit acquires, as the coordinate information, a vertical and horizontal displacement of a position on the medium from a predetermined reference point on the medium, and the range. The image generation apparatus according to claim 4, wherein the information acquisition unit acquires information for specifying a length in a vertical direction and a horizontal direction of the medium as the range information.
The invention according to claim 6 further includes storage means for storing extended coordinate information indicating a position on a specific area including the medium according to the predetermined coordinate system, wherein the coordinate information acquisition means is the specific information The displacement in the vertical direction and the horizontal direction of the position on the medium from a predetermined reference point not on the medium is acquired as the coordinate information, and the range information acquisition unit is configured to acquire the coordinate information. The information for specifying the position in the extended coordinate information and the information for specifying the vertical and horizontal lengths of the medium are acquired as the range information. 4. The image generating device according to 4.
According to a seventh aspect of the present invention, the storage means stores a plurality of the extended coordinate information in association with each identification information, and the coordinate information acquisition means stores the coordinate information in the storage means. Obtained from specific extended coordinate information of the plurality of extended coordinate information and the identification information associated with the specific extended coordinate information, the generating means is obtained by the coordinate information obtaining means The image generation apparatus according to claim 6, wherein the image further expressing the identification information is generated.
The invention according to claim 8 is a function for acquiring the image read from the medium on which the image representing the coordinate information indicating the position on the medium and the range information indicating the range of the coordinate information is printed on the computer. And a function of detecting the coordinate information from the acquired image, a function of detecting the range information from the acquired image, a comparison result of the detected coordinate information and the detected range information Is a program for realizing the function of determining the processing content for the coordinate information.
The invention according to claim 9 is obtained by the computer having a function of acquiring coordinate information indicating a position on the medium according to a predetermined coordinate system, a function of acquiring range information indicating a range of the coordinate information, and A program for realizing a function of generating an image representing the coordinate information and the acquired range information.

According to the first aspect of the present invention, there is an effect that it is possible to change the contents of processing for coordinates according to a comparison result between coordinates on the medium and the range of the coordinates.
The invention of claim 2 has an effect that the calculation for comparing the coordinates on the medium with the range of the coordinates becomes easier than in the case where the present configuration is not provided.
The invention of claim 3 has an effect that the coordinates on the medium can be expressed using any part of the coordinates on the area including the medium.
The invention of claim 4 has an effect that an image capable of acquiring the coordinates on the medium and the range of the coordinates can be generated.
The invention of claim 5 has an effect that the calculation for comparing the coordinates on the medium with the range of the coordinates becomes easier than in the case where the present configuration is not provided.
The invention of claim 6 has the effect that the coordinates on the medium can be expressed using any part of the coordinates on the area including the medium.
According to the seventh aspect of the present invention, when the coordinates on the medium are expressed using the coordinates on the area including the medium, it is easier to determine the identification information of the medium than in the case where the present configuration is not provided. Has an effect.
The invention of claim 8 has the effect that the contents of the processing for the coordinates can be changed according to the comparison result between the coordinates on the medium and the range of the coordinates.
The invention of claim 9 has an effect that an image capable of acquiring the coordinates on the medium and the range of the coordinates can be generated.

The best mode for carrying out the present invention (hereinafter referred to as “embodiment”) will be described in detail below with reference to the accompanying drawings.
First, a code pattern constituting a code image to be read will be described.
In the present embodiment, mCn (= m) by a pattern image (hereinafter referred to as “unit code pattern”) in which unit images are arranged at n (1 ≦ n <m) locations selected from m (m ≧ 3) locations. ! / {(Mn)! × n!}) Expresses the information as shown. That is, instead of associating one unit image with information, a plurality of unit images are associated with information. Assuming that one unit image is associated with information, there is a drawback in that erroneous information is expressed when the unit image is lost or noise is added. On the other hand, for example, if two unit images are associated with information, it can be easily understood that there is an error when the number of unit images is one or three. Furthermore, in the method of expressing 1 bit or at most 2 bits in one unit image, it is not possible to express a synchronous pattern that controls reading of the information pattern with a pattern visually similar to the pattern that represents information. . For this reason, the present embodiment employs the above encoding method. Hereinafter, such an encoding method is referred to as an mCn method.
Here, a unit image having any shape may be used. In the present embodiment, a dot image (hereinafter simply referred to as “dot”) is used as an example of a unit image, but an image having another shape such as a hatched pattern may be used.

FIG. 1 shows an example of a unit code pattern in the mCn system.
In the figure, a black area and a hatched area are areas where dots can be arranged, and a white area between them is an area where dots cannot be arranged. Of the areas where dots can be arranged, dots are arranged in black areas and dots are not arranged in hatched areas. That is, FIG. 1 shows an example in which an area where a total of 9 dots of 3 dots in the vertical direction and 3 dots in the horizontal direction can be arranged is provided. FIG. FIG. 6B shows a unit code pattern, and FIG. 5B shows a unit code pattern in the 9C3 method in which 3 dots are arranged in an area where dots can be arranged.

  By the way, the dots (black areas) arranged in FIG. 1 are only for information representation, and do not necessarily match the dots (minimum squares in FIG. 1) which are the minimum units constituting the image. In this embodiment, when “dot” refers to the former dot and the latter dot is referred to as “pixel”, the dot has a size of 2 pixels × 2 pixels at 600 dpi. . Since the size of one pixel at 600 dpi is 0.0423 mm, one side of the dot is 84.6 μm (= 0.0423 mm × 2). The larger the dot, the more likely it will be noticeable, so it is preferable to make it as small as possible. However, if it is too small, printing with a printer becomes impossible. Therefore, the above value is adopted as the dot size, which is larger than 50 μm and smaller than 100 μm. However, the above value 84.6 μm is a numerical value to the last, and is about 100 μm in the actually printed toner image.

FIG. 2 shows another example of the unit code pattern. In this figure, spaces between dots are omitted.
FIG. 2A shows all unit code patterns in the 9C2 system shown in FIG. In the 9C2 system, 36 (= ₉ C ₂ ) types of information are expressed using these unit code patterns. FIG. 2B shows all unit code patterns in the 9C3 system shown in FIG. In the 9C3 system, 84 (= ₉ C ₃ ) types of information are expressed using these unit code patterns.

The unit code pattern is not limited to m = 9. For example, a value such as 4, 16 may be adopted as the value of m. Also, any value may be adopted as long as n satisfies 1 ≦ n <m.
Further, as the value of m, not only a square number (the square of an integer) but also a product of two different integers may be adopted. That is, the area in which dots can be arranged is not limited to a square area as in the case of arranging 3 dots × 3 dots, but may be a rectangular area as in the case of arranging 3 dots × 4 dots. In this specification, the rectangle means a rectangle in which the lengths of two adjacent sides are not equal.

By the way, all unit code patterns in the mCn system are assigned pattern values that are numbers for identifying each unit code pattern.
FIG. 3 shows the correspondence between unit code patterns and pattern values in the 9C2 system. Since there are 36 unit code patterns in the 9C2 system, 0 to 35 are used as pattern values. However, the correspondence shown in FIG. 3 is merely an example, and any pattern value may be assigned to any unit code pattern. In addition, although not shown in the figure for the 9C3 system, each unit code pattern is assigned a pattern value of 0 to 83.

  In this way, mCn types of unit code patterns are prepared by selecting n locations from m locations. In this embodiment, a specific pattern is used as an information pattern among these unit code patterns. The rest is used as a synchronization pattern. Here, the information pattern is a pattern representing information to be embedded in the medium. The synchronization pattern is a pattern used for taking out an information pattern printed on a medium. For example, it is used for specifying the position of the information pattern or detecting the rotation of the image. Any medium may be used as long as an image can be printed. Since paper is a representative example, the medium will be described as paper below, but metal, plastic, fiber, or the like may be used.

Here, the synchronization pattern will be described.
FIG. 4 is an example of a synchronization pattern in the 9C2 system. Thus, when m in the mCn system is a square number, it is necessary to prepare four types of unit code patterns as synchronization patterns in order to detect image rotation. Here, the unit code pattern of the pattern value 32 is an upright synchronization pattern. In addition, the unit code pattern of pattern value 33 is rotated 90 degrees to the right, the synchronization pattern of unit value pattern 34 is rotated 180 degrees to the right, and the unit code pattern of pattern value 35 is rotated 270 degrees to the right. The synchronization pattern is used. In this case, 5 bits of information may be expressed by using the remainder obtained by removing these four types of synchronization patterns from the 36 types of unit code patterns as an information pattern. However, the method of assigning 36 types of unit code patterns to information patterns and synchronization patterns is not limited to this. For example, five sets of synchronization patterns that constitute one set of four types may be prepared, and the remaining 16 types of information patterns may represent 4-bit information.

  Although not shown, when m in mCn is a product of two different integers, two types of unit code patterns may be prepared as synchronization patterns in order to detect image rotation. For example, when an area in which 3 dots in the vertical direction and 4 dots in the horizontal direction should be detected but an area in which the 4 dots in the vertical direction and 3 dots in the horizontal direction can be arranged is detected, the image is 90 degrees or 270 degrees at that time. It is because it turns out that it is rotating.

Next, a method for expressing identification information and coordinate information by arranging such code patterns will be described.
First, a code block composed of the above-described unit code pattern will be described.
FIG. 5 shows an example of a code block. In the figure, it is also shown that a unit code pattern in the 9C2 system is used. That is, 36 types of unit code patterns are divided into, for example, 4 patterns used as synchronization patterns and 32 patterns used as information patterns, and each pattern is arranged according to a layout.
In the figure, a layout in which 3 areas × 3 dots area (hereinafter referred to as “block”) 25 × 5 × 5 are arranged is used. Of the 25 blocks, a synchronization pattern is arranged in the upper left block. In addition, an information pattern representing X coordinate information that specifies coordinates in the X direction on the paper surface is arranged in the four blocks to the right of the synchronization pattern, and the Y direction coordinates on the paper surface are specified in the four blocks below the synchronization pattern. An information pattern representing coordinate information is arranged. Further, an information pattern representing the identification information of the document printed on the paper surface or the paper surface is arranged in 16 blocks surrounded by the information pattern representing the coordinate information.
The unit code pattern in the 9C2 system is merely an example, and the unit code pattern in the 9C3 system may be used as shown in the lower left of the figure.

Next, a layout for expressing identification information and coordinate information in this embodiment will be described.
FIG. 6 shows a part of such a layout.
In this layout, the code block shown in FIG. 5 is used as a basic unit, and this code block is periodically arranged on the entire sheet. In the figure, the synchronization pattern is represented by “S”. Also, the coordinate information is expressed in M series over the vertical and horizontal sides of the page. In the figure, patterns representing the X coordinate are represented by “X1”, “X2”,..., And patterns representing the Y coordinate are represented by “Y1”, “Y2”,. Furthermore, although some methods can be used for encoding the identification information, RS encoding is suitable in this embodiment. This is because the RS code is a multi-level coding method, and in this case, the block representation should correspond to the multi-value of the RS code. In the figure, the pattern representing the identification information is represented by “IXY” (X = 1 to 4, Y = 1 to 4).

Here, the M series used for expressing the coordinate information will be described.
The M sequence is a sequence whose partial sequence does not match other partial sequences. For example, the eleventh order M-sequence is a bit string of 2047 bits. The same sequence as the partial sequence of 11 bits or more extracted from the 2047-bit bit string does not exist in the 2047-bit bit string other than itself. In this embodiment, 16 unit code patterns are associated with 4 bits. That is, a bit string of 2047 bits is expressed in decimal notation for every 4 bits, a unit code pattern is determined according to the correspondence of FIG. 3, and is expressed as a coordinate code across the paper in the horizontal and vertical directions. Therefore, at the time of decoding, the position on the bit string is specified by specifying three consecutive unit code patterns.

FIG. 7 shows an example of encoding coordinate information using an M sequence.
(A) shows a bit string “0111000101011010000110010...” As an example of the 11th order M-sequence. In the present embodiment, this is divided into 4 bits, and the first partial sequence “0111” is a unit code pattern of pattern value 7 and the second partial sequence “0001” is a unit code pattern of pattern value 1. As a result, the third partial sequence “0101” is arranged as a unit code pattern with a pattern value of 5, and the fourth partial sequence “1010” is arranged as a unit code pattern of a pattern value of 10, respectively.

  In addition, if the unit code pattern is divided by 4 bits and assigned to the unit code pattern in this way, as shown in (b), all pattern strings can be expressed in 4 cycles. That is, since the 11th order M-sequence is 2047 bits, if this sequence is cut out every 4 bits and expressed by a unit code pattern, 3 bits are added at the end. The first 1 bit of the M sequence is added to these 3 bits to form 4 bits, which are represented by a unit code pattern. Further, the unit code pattern is cut out every 4 bits from the second bit of the M sequence. Then, the next cycle starts from the third bit of the M sequence, and the next cycle starts from the fourth bit of the M sequence. Furthermore, the fifth cycle starts from the fifth bit, which coincides with the first cycle. Therefore, if four cycles of the M sequence are cut out every 4 bits, it is possible to use all 2047 unit code patterns. Since the M sequence is 11th order, the three consecutive unit code patterns do not match the continuous code pattern at any other position. Therefore, decoding can be performed by reading three unit code patterns at the time of reading. However, in the present embodiment, coordinate information is expressed by four unit code patterns in consideration of the occurrence of errors.

  By the way, when such encoding is performed, the M sequence of 4 periods is divided into 2047 blocks and stored. In the layout as shown in FIG. 6, since the blocks where the synchronization pattern is arranged are sandwiched between them, the length of 2558 (≈2047 × 5/4) blocks is covered with the M sequence of 4 cycles. become. Since the length of one side of one block is 0.508 mm (12 pixels at 600 dpi), the length of 2558 blocks is 1299.5 mm. That is, a length of 1299.5 mm is encoded. Since the long side of the A0 size is 1188.0 mm, in this embodiment, the coordinates on the A0 size paper are encoded.

Thus, in the present embodiment, a coordinate having a predetermined length is encoded. However, the paper size specified in actual printing is various. Accordingly, not all the coordinates on the A0 size paper are used, but a portion necessary for the actually specified paper size is cut out from the coordinates. In such a case, if there is an error in the read image, the following situation occurs. For example, when A4 size paper is used, if the coordinates obtained by decoding are within the A4 size, it can be assumed that the coordinates are correct, but the coordinates obtained by decoding are out of the A4 size. If it is within the A0 size, it will not be possible to detect an error.
FIG. 8 shows the situation at this time.
In the figure, a portion necessary for the A4 size is cut out from the coordinates on the A0 size paper and used. Here, it is assumed that the point P on the A4 size paper is designated by the pen device. However, it is erroneously recognized that the point Q outside the A4 size sheet is designated.

  Therefore, in the present embodiment, information on the paper size (hereinafter referred to as “size information”) is used as a highly robust method that enables decoding even if there is an error in the read image. That is, it is possible to determine whether the coordinates are correct by embedding the size information together with the identification information and the coordinate information.

Next, this size information will be described in detail.
FIG. 9 shows a coordinate space composed of coordinates on the A0 size paper. Among these, (a) is a coordinate space (hereinafter referred to as “A-sequence abscissa space”) composed of coordinates on an A0 size paper placed sideways, and (b) is placed vertically. This is a coordinate space (hereinafter referred to as “A series ordinate space”) composed of coordinates on A0 size paper. As already described, in the present embodiment, coordinates within a square range in which the length of the long side of A0 size is the length of one side are encoded, so that such a coordinate space can be prepared. . In both (a) and (b), the X axis is taken in the horizontal direction in the figure, the right direction is the positive direction of the X axis, the Y axis is taken in the vertical direction in the figure, and the lower direction is the Y axis. Positive direction. Further, the upper left point of the coordinate space is adopted as an example of the origin (reference point) to represent the coordinates. In this embodiment, one bit is used to specify whether the coordinates are cut out from the horizontal coordinate space or from the vertical coordinate space.

  As will be described later, depending on the paper size, some are cut out from the A series abscissa space in the horizontal direction, and some are cut out from the A series ordinate space in the vertical direction. Some are cut out from the A series ordinate space in the horizontal direction. That is, for example, even if the A-series abscissa space is designated, it does not mean the landscape orientation for all paper sizes. However, since the vertical coordinate space is cut out from one coordinate space and the horizontal coordinate space is cut out from the other coordinate space, the paper orientation (vertical or horizontal) is specified by this specification. It will be done.

  In the figure, only the coordinate space of A0 size, which is the maximum size in which the coordinates can be encoded in the A series, is shown, but apart from this, the coordinate space of B1 size, which is the maximum size in which the coordinates can be encoded in the B series. May be prepared. As this coordinate space, a B1 size coordinate space (hereinafter referred to as “B series abscissa space”) placed horizontally as shown in (a) and a B1 size placed vertically as shown in (b). Coordinate space (hereinafter referred to as “B-sequence ordinate space”). In the present embodiment, it is designated by 1 bit whether the coordinates are cut out from the A series coordinate space or the B series coordinate space.

  Here, as shown in (a), when the A-sequence abscissa space is divided into two, coordinates in the vertical direction A1 size are obtained. Similarly, when the image is divided into two, the coordinates of the horizontal A2 size, the vertical A3 size, the horizontal A4 size, the vertical A5 size, the horizontal A6 size, and the vertical A7 size are obtained. Further, as shown in (b), when the A-sequence ordinate space is divided into two, a horizontal A1 size coordinate is obtained. Similarly, when the image is divided into two, the coordinates of the vertical A2 size, the horizontal A3 size, the vertical A4 size, the horizontal A5 size, the vertical A6 size, and the horizontal A7 size are obtained. Therefore, any one of 8 steps from A0 to A7 is designated by 3 bits. Similarly, in the B series, there are 8 stages of B1, B2, B3, B4, B5, B6, B7, and B8 (abbreviated business card size), and any of these is designated by 3 bits.

To summarize the above, 1 bit is used for designating the paper series (A series or B series), and the paper size (0 to 7 for the A series, 1 to 8 for the B series). 3 bits are required for designating and 1 bit is required for designating the paper orientation (portrait or landscape). That is, 5-bit information is embedded as size information.
In the present embodiment, size information is used as an example of information for specifying the horizontal length and the vertical length of the medium.

In the present embodiment, only the coordinate space used for one sheet may be cut out from the A0 size coordinate space, but the coordinate space used for a plurality of sheets may be cut out. In that case, it is necessary to embed not only the size information but also information related to the cutout position (hereinafter referred to as “cutout position information”). Since the minimum unit of cutout is A7 size, in the case of (a), there are 8 cutout positions in the vertical direction and 16 cutouts in the horizontal direction. In other words, the vertical cutout position is designated by 3 bits, and the horizontal cutout position is designated by 4 bits. In the case of (b), there are 16 cutout positions in the vertical direction and 8 cutout positions in the horizontal direction. That is, the vertical cutout position is designated by 4 bits, and the horizontal cutout position is designated by 3 bits.
In any case, when the A0 size is divided and used, 7 bits are required to specify the cutout position, and 12-bit information is embedded as cutout position information and size information.

  As described above, the information to be embedded may be only the size information. Hereinafter, a case where both the size information and the cutout position information are embedded will be described. That is, in this embodiment, size information and cutout position information are used as an example of range information indicating the range of coordinate information.

Next, the image generation apparatus 10 that generates such an image will be described.
FIG. 10 is a block diagram illustrating a configuration example of the image generation apparatus 10.
As illustrated, the image generation apparatus 10 includes an information acquisition unit 11, a coordinate space storage unit 11a, an identification code generation unit 12, an X coordinate code generation unit 13, a Y coordinate code generation unit 14, and a code array generation. Unit 15, pattern image storage unit 16, and code image generation unit 17.

The information acquisition unit 11 acquires the identification information of the paper or the document printed on the paper and the coordinate information on the paper. Then, the former is output to the identification code generation unit 12, and among the latter, the X coordinate information is output to the X coordinate code generation unit 13 and the Y coordinate information is output to the Y coordinate code generation unit 14. Also, size information and cutout position information are acquired in accordance with the print instruction, and these are output to the identification code generation unit 12. In the present embodiment, the information acquisition unit 11 is provided as an example of coordinate information acquisition means for acquiring coordinate information and as an example of range information acquisition means for acquiring range information.
The coordinate space storage unit 11 a stores information on the coordinate space referred to by the information acquisition unit 11. Specifically, the A series abscissa space and A series ordinate space shown in FIG. 9 and the B series abscissa space and B series ordinate space (not shown) are stored. A plurality of coordinate spaces of the same type are stored, and each coordinate space is identified by a coordinate space ID.

The identification code generation unit 12 encodes the identification information acquired from the information acquisition unit 11 and outputs the identification code that is the encoded identification information to the code array generation unit 15. The coding of the identification information includes block division and RS coding processing.
Among these, the block division is a process of dividing the bit string constituting the identification information into a plurality of blocks in order to perform RS encoding. For example, when an information pattern capable of expressing 5-bit information in the 9C2 system is used, the 60-bit identification information is divided into 12 blocks having a block length of 5 bits.
RS encoding is a process of performing RS encoding on the divided blocks and adding redundant blocks for error correction. If an RS code capable of correcting an error of 2 blocks is adopted in the previous example, the code length is 16 blocks.

The X coordinate code generation unit 13 encodes X coordinate information. The Y coordinate code generation unit 14 encodes the Y coordinate information. And these output the coordinate code | cord | chord which is the encoded coordinate information to the code arrangement | sequence production | generation part 15. FIG. The encoding of the coordinate information includes M-sequence encoding and block division processing.
Among these, the M sequence encoding is a process of encoding coordinate information using the M sequence. For example, a necessary M-sequence order is obtained from the length of coordinate information to be encoded, and a coordinate code is generated by dynamically generating the M-sequence. However, when the length of the coordinate information to be encoded is known in advance, the M series may be stored in the memory or the like of the image generation apparatus 10 and read out when generating the image.
Block division is processing for dividing an M sequence into a plurality of blocks. For example, if 16 types of unit code patterns are selected as the information pattern, 4-bit information is stored in each block in the code block. Therefore, 16 bits of X coordinate information are stored for a code block having a layout as shown in FIG. Then, the coordinate information is represented by the unit code pattern by the method described with reference to FIG.

The code array generation unit 15 reads the identification code generated by the identification code generation unit 12, the coordinate code generated by the X coordinate code generation unit 13 and the Y coordinate code generation unit 14, and the identification code and the coordinate code. Are arranged on a two-dimensional plane to generate a two-dimensional code array. Here, the synchronization code is a code corresponding to the synchronization pattern.
The pattern image storage unit 16 stores, for example, a unit code pattern in the mCn system shown in FIG. Here, the pattern value is attached to the unit code pattern as described above, and each unit code pattern can be read using the pattern value as a key. In the present embodiment, the pattern image storage unit 16 may store at least unit code patterns in the mCn system corresponding to predetermined m and n.
The code image generation unit 17 refers to the two-dimensional code array generated by the code array generation unit 15 and selects a unit code pattern corresponding to each code value to generate a code image. In the present embodiment, the code image generation unit 17 is provided as an example of a generation unit that generates an image representing coordinate information and range information.

  The code image is transferred to an image forming unit (not shown), and the image forming unit forms a code image on the sheet. At this time, the image forming unit may form a superimposed image in which the document image of the electronic document and the code image are superimposed on the paper surface. In addition, when a superimposed image is formed in this way, the correspondence between the position on the electronic document and the position on the paper is managed so that the writing data by the pen device on the paper is reflected at an appropriate position on the electronic document. It is desirable to do.

The image forming unit forms the code image with K toner (infrared light absorbing toner containing carbon) or special toner, for example, using an electrophotographic system.
Here, as the special toner, an invisible toner having a maximum absorption rate of 7% or less in the visible light region (400 nm to 700 nm) and an absorption rate of 30% or more in the near infrared region (800 nm to 1000 nm) is exemplified. . Here, “visible” and “invisible” are not related to whether they can be recognized visually. “Visible” and “invisible” are distinguished depending on whether or not an image formed on a printed medium can be recognized by the presence or absence of color development due to absorption of a specific wavelength in the visible light region. Further, “invisible” includes those that have some color developability due to absorption of a specific wavelength in the visible light region but are difficult to recognize with human eyes.

  These functions are realized by cooperation between software and hardware resources. Specifically, the CPU 91 (see FIG. 19) of the image generation apparatus 10 includes the information acquisition unit 11, the identification code generation unit 12, the X coordinate code generation unit 13, the Y coordinate code generation unit 14, the code array generation unit 15, and the code. For example, the program for realizing the image generation unit 17 is realized by reading the program from the magnetic disk device 93 (see FIG. 19) into the main memory 92 (see FIG. 19) and executing it. The coordinate space storage unit 11a and the pattern image storage unit 16 may be realized by using, for example, a magnetic disk device 93 (see FIG. 19). Furthermore, the program and data stored in the magnetic disk device 93 (see FIG. 19) may be loaded from a recording medium such as a CD, or may be downloaded via communication means such as the Internet.

Next, the operation of the image generation apparatus 10 will be described.
FIG. 11 is a flowchart illustrating an operation example of the image generation apparatus 10.
When there is a print instruction, in the image generation apparatus 10, the information acquisition unit 11 acquires size information included in the print instruction (step 101).
Next, the information acquisition unit 11 acquired in step 101 from the A series abscissa space, the A series ordinate space, the B series abscissa space, and the B series ordinate space stored in the coordinate space storage unit 11a. A coordinate space used to extract a coordinate space for the size information is selected (step 102). For example, if the A3 size vertical orientation is specified as the size information, the A series abscissa space is selected, and if the A4 size vertical orientation is specified, the A series ordinate space is selected.
Thereafter, the information acquisition unit 11 assigns “1” to the counter Z for counting the coordinate space selected in Step 102 (Step 103). Then, in the Zth coordinate space, a search is made for a free area sufficient to extract the necessary coordinates based on the size information acquired in step 101 (step 104), and it is determined whether there is a free area (step 105).

If there is no free area, “1” is added to Z (step 106), and the processes of steps 104 and 105 are repeated until a free area is found.
On the other hand, if there is an empty area, information to be encoded is output to the identification code generation unit 12 (step 107). Specifically, first, the size information acquired in step 101 is output. Secondly, the coordinate space ID associated with the coordinate space determined to have a free area in step 105 is output as identification information. Thirdly, cutout position information for specifying the position where the coordinates used this time are cut out from the coordinate space is output. Further, the information acquisition unit 11 outputs X coordinate information to the X coordinate code generation unit 13 and Y coordinate information to the Y coordinate code generation unit 14 among the cut out coordinate information (step 108).

Next, the image processing apparatus 20 that reads and processes the code image formed on the paper surface will be described.
FIG. 12 is a block diagram illustrating a configuration example of the image processing apparatus 20.
As illustrated, the image processing apparatus 20 includes an image reading unit 21, a dot array generation unit 22, a block detection unit 23, a synchronization code detection unit 24, a rotation determination unit 25, and a code array rotation unit 26. Prepare. In addition, an identification code detection unit 30, an identification code decoding unit 32, an identification code error detection unit 33, and an identification code error correction unit 34 are provided. Furthermore, an X coordinate code detection unit 40, an X coordinate code decoding unit 42, an X coordinate code error detection unit 43, an X coordinate code error correction unit 44, a Y coordinate code detection unit 45, and a Y coordinate code decoding unit 47. A Y coordinate code error detection unit 48, a Y coordinate code error correction unit 49, and an information output unit 50.

The image reading unit 21 reads a code image printed on a paper surface using an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS).
The dot array generation unit 22 detects dots from the read code image, and generates a dot array with reference to the dot positions. Note that, as preprocessing for dot detection from the code image, processing for removing noise included in the read image is also performed. Here, the noise includes, for example, variations in image sensor sensitivity and noise generated by an electronic circuit. The type of noise removal processing should match the characteristics of the imaging system, but sharpening processing such as blurring processing and unsharp masking may be applied. In addition, dot detection is performed as follows. That is, first, a dot image portion and other background image portions are separated by binarization processing, and a dot position is detected from each binarized image position. At that time, since there are cases where a lot of noise components are included in the binarized image, it is necessary to combine filter processing for determining dots based on the area and shape of the binarized image. Thereafter, the dot array is generated by replacing the dot detected as an image with digital data on the two-dimensional array, for example, “1” for the position where the dot is and “0” for the position where there is no dot. Do. In the present embodiment, a dot array generation unit 22 is provided as an example of an acquisition unit that acquires a read image.

  The block detection unit 23 detects a block corresponding to the unit code pattern in the code block on the dot array. In other words, a rectangular block delimiter having the same size as the unit code pattern is appropriately moved on the dot array, the position where the number of dots in the block is equal is the correct block delimiter position, and the code that stores the pattern value in each block Create an array.

The synchronization code detector 24 refers to the type of each unit code pattern detected from the dot array and detects the synchronization code.
The rotation determination unit 25 determines image rotation based on the detected synchronization code. For example, when a square unit code pattern is used, there is a possibility of rotating in units of 90 degrees. Therefore, the direction is detected depending on which of the four types of synchronization patterns the detected synchronization code corresponds to. Further, when a rectangular unit code pattern is used, there is a possibility that the unit code pattern is rotated by 180 degrees. Therefore, the direction is detected depending on which of the two types of synchronization patterns the detected synchronization code corresponds to.
The code array rotation unit 26 rotates the code array by the rotation angle detected by the rotation determination unit 25 and sets the code array in the correct direction.

The identification code detection unit 30 detects the identification code from the code array whose angle is corrected with reference to the position of the synchronization code. At this time, a process of rearranging the identification codes in the correct code order is also performed.
The identification code decoding unit 32 decodes the identification code using the same parameters (such as the number of blocks) used in the RS code encoding process described with reference to FIG. 10, and outputs identification information. In the present embodiment, an identification code decoding unit 32 is provided as an example of range information detection means for detecting range information.
The identification code error detection unit 33 detects an error of the decoded identification code, and the identification code error correction unit 34 corrects the error when the detected error is a correctable error.

The X coordinate code detection unit 40 detects the X coordinate code from the code array whose angle is corrected with reference to the position of the synchronization code. At this time, a process of removing the synchronization code from the X coordinate code is also performed.
The X coordinate code decoding unit 42 extracts the M series partial sequence from the detected X coordinate code, refers to the position of this partial sequence in the M sequence used for image generation, and corrects this position with the shift amount of the code block The obtained value is output as X coordinate information.
The X coordinate code error detection unit 43 detects an error in the decoded X coordinate code, and the X coordinate code error correction unit 44 corrects the error when the detected error is a correctable error.

The Y coordinate code detection unit 45 detects the Y coordinate code from the code array whose angle is corrected with reference to the position of the synchronization code. At this time, a process of removing the synchronization code from the Y coordinate code is also performed.
The Y coordinate code decoding unit 47 extracts the M series partial sequence from the detected Y coordinate code, refers to the position of this partial sequence in the M sequence used for image generation, and corrects this position with the shift amount of the code block. The obtained value is output as Y coordinate information.
The Y coordinate code error detection unit 48 detects an error of the decoded Y coordinate code, and the Y coordinate code error correction unit 49 corrects the error when the detected error is a correctable error.

  In this embodiment, an X coordinate code detection unit 40 and a Y coordinate code detection unit 45 are provided as an example of detection means for detecting coordinate information. In addition, an X coordinate code decoding unit 42 and a Y coordinate code decoding unit 47 are provided as an example of a determination unit that determines the processing content for the coordinate information.

  The information output unit 50 outputs the identification information, the X coordinate information, and the Y coordinate information acquired from the identification code decoding unit 32, the X coordinate code decoding unit 42, and the Y coordinate code decoding unit 47, respectively.

  These functions are realized by cooperation between software and hardware resources. Specifically, the CPU 91 (see FIG. 19) of the image processing apparatus 20 performs the dot array generation unit 22, the block detection unit 23, the synchronization code detection unit 24, the rotation determination unit 25, the code array rotation unit 26, and the identification code detection unit. 30, identification code decoding unit 32, identification code error detection unit 33, identification code error correction unit 34, X coordinate code detection unit 40, X coordinate code decoding unit 42, X coordinate code error detection unit 43, X coordinate code error correction unit 44, a Y-coordinate code detection unit 45, a Y-coordinate code decoding unit 47, a Y-coordinate code error detection unit 48, a Y-coordinate code error correction unit 49, and an information output unit 50, for example, a magnetic disk device 93 (see FIG. 19) to the main memory 92 (see FIG. 19) and executed. Further, the program and data stored in the magnetic disk device 93 (see FIG. 19) may be loaded from a recording medium such as a CD, or may be downloaded via communication means such as the Internet.

Next, an outline of the operation of the image processing apparatus 20 will be described.
First, the image reading unit 21 reads a code image of an area having a predetermined size from the medium on which the code image is printed.
Next, the dot array generation unit 22 generates a dot array in which “1” is set at a position where a dot is detected and “0” is set at a position where a dot is not detected.
Thereafter, the block detection unit 23 detects block boundaries by superimposing block delimiters on this dot array. Here, as described with reference to FIG. 5, the block is a minimum unit necessary for decoding the embedded information. In the present embodiment, a code block of 5 blocks × 5 blocks is assumed. Therefore, the block size is 5 blocks × 5 blocks.

FIG. 13 is a diagram specifically showing processing when detecting a block by moving a block break. Here, it is known that encoding has been performed by the 9C2 system, and a case of decoding by the 9C2 system is shown.
First, the block detection unit 23 acquires a dot array from the dot array generation unit 22. The size of the dot arrangement acquired here is preset, and is (number of blocks necessary for decoding × number of dots on one side of block + number of dots on one side of block−1) ² . However, since this dot arrangement corresponds to an arbitrarily selected area of the image, the position of the block delimiter is unknown. Therefore, first, block division is performed with reference to the end of the dot array. In this example, since m = 9, block delimiters composed of blocks each having a size of 3 dots × 3 dots are overlapped. Next, the dots in each block are counted. In this example, since n = 2, the position of the block delimiter when there are two dots in each block is the correct delimiter position, but it can be seen that the number of dots varies at this position and is not correct. Therefore, the number of dots in the block is counted by shifting the block delimiter. That is, the same operation is performed for the start position in the right direction, the position moved by one dot, and the position moved by two dots. In addition, the same operation is performed for each of these positions with respect to the start position in the downward direction, the position moved by 1 dot, and the position moved by 2 dots. As a result, the number of dots in all the blocks is “2” at a position where the dot has moved one dot to the right and moved two dots downward. Therefore, this position is set as a correct separation position.

  Thereafter, the synchronization code detection unit 24, the identification code detection unit 30, the X coordinate code detection unit 40, the Y coordinate code detection unit 45, and the like refer to the dot arrangement in each block, so that the synchronization code, the identification code, the X coordinate The code and the Y coordinate code are detected.

Next, the operation of the image processing apparatus 20 will be described in more detail. In the description of this operation, it is assumed that the unit code pattern of the 9C2 system is arranged in the layout shown in FIG.
First, the operation of the block detector 23 will be described.
FIG. 14 is a flowchart illustrating an operation example of the block detection unit 23.
First, the block detector 23 acquires a dot array from the dot array generator 22 (step 201). The size of this dot array is (number of blocks necessary for decoding × number of dots on one side of block + number of dots on one side of block−1) ² as described above. In this embodiment, the number of blocks necessary for decoding is 5 × 5, and the number of dots on one side of the block is 3, so a 17 × 17 dot array is acquired.

Next, a block break is superimposed on the acquired dot array (step 202). In this embodiment, a 5 × 5 block delimiter is used. Then, “0” is substituted into the counters I and J, and “0” is substituted into MaxBN (step 203).
Here, I and J count the number of steps in which the block break is moved from the initial position. The block break is moved for each line of the image, and the number of lines moved at that time is counted by counters I and J. MaxBN records the maximum count value when counting the number of blocks in which the number of dots detected in the block is “2” while moving the block delimiter.

  Next, the block detector 23 moves the block delimiter I in the X direction and J in the Y direction (step 204). Since I and J are “0” in the initial state, the block break does not move. Then, the number of dots included in each block of the block delimiter is counted, and the number of blocks whose dot number is “2” is counted. The counted number of blocks is stored in IB [I, J] (step 205). In I and J of IB [I, J], values of I and J indicating the movement amount of the block break are recorded, respectively.

  Next, the block detection unit 23 compares IB [I, J] with MaxBN (step 206). Since MaxBN has an initial value “0”, in the first comparison, IB [I, J] is larger than MaxBN. In this case, the value of IB [I, J] is substituted for MaxBN, the value of MX is substituted for I, and the value of MY is substituted for J (step 207). When IB [I, J] is MaxBN or less, the values of MaxBN, MX, and MY are left as they are.

Thereafter, the block detection unit 23 determines whether I = 2 (step 208).
If I = 2 is not satisfied, “1” is added to I (step 209). Then, the processing in steps 204 and 205 is repeated to compare IB [I, J] with MaxBN (step 206).
If IB [I, J] is greater than MaxBN, which is the maximum value of IB [I, J] up to the previous time, the value of IB [I, J] is assigned to MaxBN, and the value of I at that time is set to MX. , J is substituted for MY (step 207). If MaxBN is larger than IB [I, J], it is determined whether I = 2 (step 208). When I = 2, it is next determined whether J = 2 or not (step 210). If J = 2 is not satisfied, “0” is substituted for I, and “1” is added to J (step 211). Such a procedure is repeated to detect a case where (I, J) is (0, 0) to (2, 2) and IB [I, J] is maximum.

When the processing up to I = 2 and J = 2 is completed, the block detection unit 23 compares the stored MaxBN with the threshold value TB (step 212). The threshold value TB is a threshold value for determining whether the number of blocks having a dot number of “2” is such that decoding is possible.
Here, when MaxBN is larger than the threshold value TB, the block break is fixed at the positions MX and MY, and the pattern value of each block is detected at that position. Then, the detected pattern value is recorded in the memory as a code array PA [X, Y] together with variables X and Y for identifying each block (step 213). At this time, if the pattern value cannot be converted, “99” which is not used as a pattern value is recorded. Then, the block detection unit 23 outputs MX and MY and the code array PA [X, Y] to the synchronous code detection unit 24 (step 214).
On the other hand, if MaxBN is equal to or less than the threshold value TB, it is determined that decoding is impossible due to large noise in the image, and decoding is impossible (step 215).

Next, the operation of the synchronization code detection unit 24 will be described.
FIG. 15 is a flowchart showing an operation example of the synchronization code detection unit 24.
First, the synchronization code detection unit 24 acquires MX and MY and the code array PA [X, Y] from the block detection unit 23 (step 251).
Next, the synchronous code detection unit 24 substitutes “1” for K and L (step 252). K is a counter indicating the number of blocks in the X direction, and L is a counter indicating the number of blocks in the Y direction.

Next, the synchronization code detection unit 24 determines whether the pattern value of PA [K, L] is 32 (step 253).
If the pattern value of PA [K, L] is 32, it is determined that the rotation of the code array PA [X, Y] is not necessary, and K is substituted for the X coordinate SX of the block having the synchronization code, and the Y coordinate SY Substitute L for. Further, MX is substituted for the movement amount ShiftX in the X direction of the block delimiter, and MY is substituted for the movement amount ShiftY in the Y direction (step 254).

Next, the synchronization code detection unit 24 determines whether the pattern value of PA [K, L] is 33 (step 255).
If the pattern value of PA [K, L] is 33, the code array PA [X, Y] is rotated 90 degrees to the left (step 256). As shown in FIG. 4, the unit code pattern of the pattern value 33 is an image obtained by rotating the unit code pattern of the pattern value 32 by 90 degrees in the right direction, so that the image is erected by rotating 90 degrees in the reverse direction. Yes. At this time, all pattern values in the code array PA [X, Y] are converted into pattern values when rotated 90 degrees to the left.
In accordance with this rotation, L is substituted for the X coordinate SX of the block having the synchronization code, and 6-K is substituted for the Y coordinate SY. Also, MY is substituted for the movement amount ShiftX in the X direction of the block delimiter, and 2-MX is substituted for the movement amount ShiftY in the Y direction (step 257).

Next, the synchronization code detection unit 24 determines whether or not the pattern value of PA [K, L] is 34 (step 258).
If the pattern value of PA [K, L] is 34, the code array PA [X, Y] is rotated 180 degrees to the left (step 259). As shown in FIG. 4, since the unit code pattern of the pattern value 34 is an image obtained by rotating the unit code pattern of the pattern value 32 by 180 degrees, the unit code pattern of the pattern value 34 is rotated 180 degrees and the image is erected. I am letting. At this time, all the pattern values in the code array PA [X, Y] are converted into pattern values when rotated 180 degrees.
In accordance with this rotation, 6-K is substituted for the X coordinate SX of the block having the synchronization code, and 6-L is substituted for the Y coordinate SY. Further, 2-MX is substituted for the movement amount ShiftX in the X direction of the block delimiter, and 2-MY is substituted for the movement amount ShiftY in the Y direction (step 260).

Next, the synchronization code detection unit 24 determines whether or not the pattern value of PA [K, L] is 35 (step 261).
If the pattern value of PA [K, L] is 35, the code array PA [X, Y] is rotated 270 degrees to the left (step 262). As shown in FIG. 4, since the unit code pattern of the pattern value 35 is an image obtained by rotating the unit code pattern of the pattern value 32 to the right by 270 degrees, it is rotated 270 degrees in the reverse direction to erect the image. . At this time, all the pattern values in the code array PA [X, Y] are converted into pattern values when rotated 270 degrees in the left direction.
In accordance with this rotation, 6-L is substituted for the X coordinate SX of the block having the synchronization code, and K is substituted for the Y coordinate SY. Further, 2-MY is substituted for the movement amount ShiftX in the X direction of the block delimiter, and MX is substituted for the movement amount ShiftY in the Y direction (step 263).

When values are assigned to SX, SY, ShiftX, and ShiftY in steps 254, 257, 260, and 263, the synchronization code detection unit 24 converts PA [X, Y] and these values into the identification code detection unit 30. The X coordinate code detection unit 40 and the Y coordinate code detection unit 45 are output (step 264).
If PA [K, L] is not any of the pattern values 32-35, the synchronization code detector 24 determines whether K = 5 (step 265). If K = 5 is not satisfied, “1” is added to K (step 266), and the process returns to step 253. If K = 5, it is determined whether L = 5 (step 267). If L = 5 is not satisfied, “1” is substituted for K, “1” is added to L (step 268), and the process returns to step 253. That is, the processing of steps 253 to 264 is repeated while changing the values of K and L until a block having pattern values of 32 to 35 is detected. If a block having pattern values of 32 to 35 cannot be detected even when K = 5 and L = 5, an undecodable determination signal is output (step 269).

  Note that the processing of steps 253, 255, 258, and 261 may be performed by the rotation determination unit 25 under the control of the synchronization code detection unit 24. Further, the processing of steps 254, 256, 257, 259, 260, 262, and 263 may be performed by the code array rotation unit 26 under the control of the synchronization code detection unit 24.

Next, operations of the identification code detection unit 30 and the identification code decoding unit 32 will be described.
FIG. 16 is a flowchart showing an operation example of the identification code detection unit 30 and the identification code decoding unit 32.
First, the identification code detection unit 30 acquires the code arrays PA [X, Y], SX, and SY from the synchronization code detection unit 24 (step 301).
Next, the identification code detection unit 30 initializes all elements of the identification code array IA [X, Y] with “99” (step 302). The “99” is a number that is not used as a pattern value. Then, “1” is substituted into counters IX and IY for identifying each block in the code block (step 303). Here, IX is a counter indicating the number of blocks in the X direction, and IY is a counter indicating the number of blocks in the Y direction.

The identification code detection unit 30 determines whether IY-SY is divisible by “5” (step 304). That is, it is determined whether or not the synchronization code is arranged in the block specified by IY.
Here, when IY-SY is divisible by “5”, that is, when a synchronous code is arranged in this block, since the identification code is not extracted, “1” is added to IY (step 305). ), Go to step 304.
On the other hand, if IY-SY is not divisible by “5”, that is, if no synchronization code is arranged in this block, it is determined whether IX-SX is divisible by “5” (step 306). That is, it is determined whether or not the synchronization code is arranged in the block specified by IX.

Here, when IX-SX is divisible by “5”, that is, when a synchronization code is arranged in this block, since the identification code is not extracted, “1” is added to IX (step 307). ), Go to Step 306.
On the other hand, when IX-SX is not divisible by “5”, that is, when no synchronization code is arranged in this block, the identification code detection unit 30 performs IA [(IX-SX) mod5, (IY-SY) mod [5] is substituted for PA [IX, IY] (step 308).

Then, it is determined whether or not IX = 5 (step 309).
If IX = 5 is not satisfied, “1” is added to IX (step 307), and the processing of steps 306 to 308 is repeated until IX = 5. When IX = 5, it is next determined whether IY = 5 (step 310). If IY = 5 is not satisfied, “1” is substituted for IX (step 311), “1” is added to IY (step 305), and the processing of steps 304 to 309 is repeated until IY = 5. . When IY = 5, the process proceeds to the identification code decoding unit 32.

That is, the identification code decoding unit 32 decodes identification information, size information, and cutout position information from IA [X, Y], and substitutes the identification information into DI and the size information and cutout position information into DS (step 312). .
Further, the minimum value W1 and maximum value W2 in the X direction of coordinates on the paper and the minimum value H1 and maximum value H2 in the Y direction are calculated from the DS (step 313). Specifically, first, the horizontal length W and the vertical length H specified by the paper size and the paper orientation are acquired from the DS. For example, if the paper size is A4 and the paper orientation is vertical, W = 210 mm and H = 297 mm. Next, the cut-out position (CX, CY) from the coordinate space is acquired from the DS. Here, the cutout position is represented by the coordinates of the upper left point of the cutout coordinate space. For example, if the paper size is A4 and the paper orientation is vertical, it can be seen that the coordinate space of FIG. 9B is used. Therefore, if the cut out coordinate space is the BX section in the horizontal direction and the BY section in the vertical direction, the length in the horizontal direction of the A7 size, which is the minimum clipping unit, is 105 mm, and the length in the vertical direction. Is 74 mm, CX = (BX−1) × 105 and CY = (BY−1) × 74. Finally, W1, W2, H1, and H2 are obtained by W1 = CX, W2 = CX + W, H1 = CY, and H2 = CY + H.
Thereafter, W 1, W 2, H 1, and H 2 obtained here are output to the X coordinate code decoding unit 42 and the Y coordinate code decoding unit 47.

Next, operations of the X coordinate code detection unit 40 and the X coordinate code decoding unit 42 will be described.
FIG. 17 is a flowchart showing an operation example of the X coordinate code detection unit 40 and the X coordinate code decoding unit 42.
First, the X coordinate code detection unit 40 acquires the code arrays PA [X, Y], SX, and SY from the synchronization code detection unit 24 (step 401).
Next, the X coordinate code detection unit 40 initializes all elements of the X coordinate code array XA [X] with “99” (step 402). The “99” is a number that is not used as a pattern value. Then, “1” is substituted into counters IX and IY for identifying each block in the code block. Here, IX is a counter indicating the number of blocks in the X direction, and IY is a counter indicating the number of blocks in the Y direction. Furthermore, the X coordinate code detection unit 40 substitutes “1” into a counter KX for identifying each element in the X coordinate code array (step 403).

Further, the X coordinate code detection unit 40 determines whether IY-SY is divisible by “5” (step 404). That is, it is determined whether or not the synchronization code is arranged in the block specified by IY.
Here, if IY-SY is not divisible by “5”, that is, if no synchronization code is arranged in this block, the X coordinate code is not extracted, so “1” is added to IY ( Step 405), the process proceeds to Step 404.
On the other hand, when IY-SY is divisible by “5”, that is, when a synchronization code is arranged in this block, the X coordinate code detection unit 40 determines whether IX-SX is divisible by “5”. (Step 406). That is, it is determined whether or not the synchronization code is arranged in the block specified by IX.

Here, when IX-SX is divisible by “5”, that is, when a synchronous code is arranged in this block, since the X coordinate code is not extracted, “1” is added to IX (Step 1 407), go to step 406.
On the other hand, when IX-SX is not divisible by “5”, that is, when no synchronization code is arranged in this block, the X coordinate code detection unit 40 substitutes PA [IX, IY] for XA [KX]. (Step 408).

Then, it is determined whether or not IX = 5 (step 409).
If IX = 5 is not satisfied, “1” is added to KX (step 410), “1” is added to IX (step 407), and the processing of steps 406 to 408 becomes IX = 5. Repeat until When IX = 5, it is next determined whether IY = 5 (step 411). If IY = 5 is not satisfied, “1” is substituted into IX and KX (step 412), “1” is added to IY (step 405), and the processing of steps 404 to 410 is performed until IY = 5. Repeat. When IY = 5, the process proceeds to the X coordinate code decoding unit 42.

In other words, the X coordinate code decoding unit 42 determines whether or not XA [X] can be decoded (step 413).
If it is determined that XA [X] can be decoded, the X coordinate code decoding unit 42 decodes the X coordinate information from XA [X] and ShiftX and substitutes it into DX (step 414). Then, it is determined whether DX is between W1 and W2 acquired from the identification code decoding unit 32 (step 415). If DX is between W1 and W2, DX is directly used as a decoding result.
On the other hand, if it is determined that XA [X] cannot be decoded, or if it is determined that DX is not between W1 and W2, N / A is substituted for DX (step 416).

  Although only the operations of the X coordinate code detection unit 40 and the X coordinate code decoding unit 42 have been described here, the Y coordinate code detection unit 45 and the Y coordinate code decoding unit 47 perform the same operation. In particular, the Y coordinate code decoding unit 47 decodes the Y coordinate code from the Y coordinate code array YA [Y] and ShiftY and substitutes it into DY, and this is between H1 and H2 acquired from the identification code decoding unit 32. Determine whether or not. As a result, if it is determined that DY is not between H1 and H2, N / A is substituted into DY.

Thereafter, the information output unit 50 that has acquired DX and DY may treat the coordinates (DX, DY) as not being correctly decoded if N / A is assigned to either DX or DY. Here, when either DX or DY is not within the determined range, the coordinates are determined to be incorrect, but other processing may be performed.
Thus, the detailed operation description of the image processing apparatus 20 in the present embodiment is finished.

In the present embodiment, a method of embedding size information and cutout position information as part of an identification code is employed. However, the method of embedding the size information and the cutout position information is not limited to this, and any other method may be adopted as long as it can be embedded together with the identification code and the coordinate code.
Examples of such other methods are as follows.
In the present embodiment, the coordinate information is expressed using 16 types of unit code patterns. Therefore, when a coding method capable of expressing information using a unit code pattern that is twice or more of that is employed, size information and cut-out position information are embedded in unused redundant bits.

First, a specific example will be shown assuming that only size information is embedded. When only the size information is embedded, it is sufficient that 5-bit information can be additionally embedded.
For example, in the 9C2 system, 32 types of unit code patterns can be used to express information. However, only 16 types of unit code patterns are used for the coordinate information. Therefore, the 32 types of unit code patterns are divided into 16 groups of 2 groups (A group and B group). For example, the A group is assigned to bit “0” and the B group is assigned to bit “1”. By doing so, the unit code patterns of the A group and the B group can be selectively used for the eight blocks representing the coordinate information, and information of up to 8 bits can be embedded. Therefore, size information can be embedded.

Next, a specific example will be shown as embedding size information and cutout position information. When embedding size information and cutout position information, it is necessary to additionally embed 12-bit information.
For example, in the 9C3 system, 64 types of unit code patterns can be used to express information. However, only 16 types of unit code patterns are used for the coordinate information. Therefore, 64 types of unit code patterns are divided into 16 groups of 4 groups (A group, B group, C group, D group), for example, A group is set to bit “0”, and B group is set to bit “1”. , C group is assigned to bit “2”, and D group is assigned to bit “3”. By doing so, the unit code patterns of the A group to the D group can be selectively used for the eight blocks representing the coordinate information, and information of up to 16 bits can be embedded. Therefore, size information and cutout position information can be embedded.

  Further, in the present embodiment, as shown in FIG. 5, a layout having a block in which identification information is arranged is assumed. However, a layout having no block in which identification information is arranged may be assumed.

Next, specific hardware configurations of the image generation apparatus 10 and the image processing apparatus 20 in the present embodiment will be described.
First, the pen device 60 that implements the image processing apparatus 20 will be described.
FIG. 18 is a view showing the mechanism of the pen device 60.
As illustrated, the pen device 60 includes a control circuit 61 that controls the operation of the entire pen. The control circuit 61 includes an image processing unit 61a that processes a code image detected from an input image, and a data processing unit 61b that extracts identification information and coordinate information from the processing result.
The control circuit 61 is connected to a pressure sensor 62 that detects the writing operation by the pen device 60 by the pressure applied to the pen tip 69. Further, an infrared LED 63 that irradiates infrared light onto the medium and an infrared CMOS 64 that inputs an image are also connected. Further, an information memory 65 for storing identification information and coordinate information, a communication circuit 66 for communicating with an external device, a battery 67 for driving a pen, and pen identification information (pen ID) are stored. A pen ID memory 68 is also connected.

  The image reading unit 21 shown in FIG. 12 is realized by, for example, the infrared CMOS 64 in FIG. The dot array generation unit 22 is realized by, for example, the image processing unit 61a in FIG. Further, the block detection unit 23, the synchronization code detection unit 24, the rotation determination unit 25, the code array rotation unit 26, the identification code detection unit 30, the identification code decoding unit 32, the identification code error detection unit 33, and the identification code illustrated in FIG. Error correction unit 34, X coordinate code detection unit 40, X coordinate code decoding unit 42, X coordinate code error detection unit 43, X coordinate code error correction unit 44, Y coordinate code detection unit 45, Y coordinate code decoding unit 47, Y The coordinate code error detection unit 48, the Y coordinate code error correction unit 49, and the information output unit 50 are realized by, for example, the data processing unit 61b in FIG.

Further, the process realized by the image generation apparatus 10 and the process realized by the image processing unit 61a or the data processing unit 61b in FIG. 18 may be realized by a general-purpose computer, for example. Accordingly, assuming that such processing is realized by the computer 90, the hardware configuration of the computer 90 will be described.
FIG. 19 is a diagram illustrating a hardware configuration of the computer 90.
As shown in the figure, the computer 90 includes a CPU (Central Processing Unit) 91 as a calculation means, a main memory 92 as a storage means, and a magnetic disk device (HDD: Hard Disk Drive) 93. Here, the CPU 91 executes various types of software such as an OS (Operating System) and applications to realize the above-described functions. The main memory 92 is a storage area for storing various software and data used for execution thereof, and the magnetic disk device 93 is a storage area for storing input data for various software, output data from various software, and the like. .
Further, the computer 90 includes a communication I / F 94 for performing communication with the outside, a display mechanism 95 including a video memory and a display, and an input device 96 such as a keyboard and a mouse.

  The program for realizing the present embodiment can be provided not only by communication means but also by storing it in a recording medium such as a CD-ROM.

It is the figure which showed an example of the unit code pattern in 9Cn system. It is the figure which showed the other example of the unit code pattern in 9Cn system. It is the figure which showed the correspondence of the unit code pattern and pattern value in 9C2 system. It is the figure which showed the example of the synchronous pattern in 9C2 system. It is the figure which showed the example of the basic layout of a code block. It is the figure which showed the example of the layout on the paper surface of a code block. It is a figure for demonstrating the expression of the coordinate by M series. It is a figure for demonstrating the case where the coordinate instruct | indicated with the pen device and the acquired coordinate differ. It is the figure shown about the coordinate space of A0 size. It is the block diagram which showed the function structure of the image generation apparatus in this Embodiment. It is the flowchart which showed the operation example of the information acquisition part in this Embodiment. It is the block diagram which showed the function structure of the image processing apparatus in this Embodiment. It is a figure for demonstrating the process at the time of detecting a block on a dot arrangement | sequence. It is the flowchart which showed the operation example of the block detection part in this Embodiment. It is the flowchart which showed the operation example of the synchronous code detection part in this Embodiment. It is the flowchart which showed the operation example of the identification code detection part and identification code decoding part in this Embodiment. It is the flowchart which showed the operation example of the X coordinate code detection part and X coordinate code decoding part in this Embodiment. It is the figure which showed the mechanism of the pen device which can implement | achieve the image processing apparatus in this Embodiment. It is a hardware block diagram of the computer which can apply this Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Image generation apparatus, 20 ... Image processing apparatus, 21 ... Image reading part, 22 ... Dot array generation part, 23 ... Block detection part, 24 ... Synchronous code detection part, 25 ... Rotation determination part, 26 ... Code arrangement rotation part , 30 ... identification code detection unit, 32 ... identification code decoding unit, 33 ... identification code error detection unit, 34 ... identification code error correction unit, 40 ... X coordinate code detection unit, 42 ... X coordinate code decoding unit, 43 ... X Coordinate code error detection unit 44... X coordinate code error correction unit 45. Y coordinate code detection unit 47. Y coordinate code decoding unit 48. Y coordinate code error detection unit 49 49 Y coordinate code error correction unit 50 ... Information output section

Claims (9)

Acquisition means for acquiring the image read from the medium on which an image representing coordinate information indicating a position on the medium and range information indicating a range of the coordinate information is printed;
Coordinate information detection means for detecting the coordinate information from the image acquired by the acquisition means;
Range information detection means for detecting the range information from the image acquired by the acquisition means;
Determining means for determining processing contents for the coordinate information according to a comparison result between the coordinate information detected by the coordinate information detecting means and the range information detected by the range information detecting means; An image processing apparatus. The coordinate information indicates a position on the medium by a vertical and horizontal displacement of the position from a predetermined reference point on the medium,
The image processing apparatus according to claim 1, wherein the range information indicates a range of the coordinate information by information for specifying a length in a vertical direction and a horizontal direction of the medium. The coordinate information indicates a position on the medium by a vertical and horizontal displacement of the position from a predetermined reference point that is on a specific area including the medium and not on the medium. And
The range information includes information for specifying the position of the coordinate information in the coordinate information indicating the position of the coordinate information on the specific area, and lengths in the vertical and horizontal directions of the medium. The image processing apparatus according to claim 1, wherein the image processing apparatus is indicated by information for identifying the image. Coordinate information acquisition means for acquiring coordinate information indicating a position on the medium according to a predetermined coordinate system;
Range information acquisition means for acquiring range information indicating the range of the coordinate information;
An image generation apparatus comprising: a generation unit configured to generate an image representing the coordinate information acquired by the coordinate information acquisition unit and the range information acquired by the range information acquisition unit. The coordinate information acquisition means acquires, as the coordinate information, a vertical and horizontal displacement of a position on the medium from a predetermined reference point on the medium,
The image generation apparatus according to claim 4, wherein the range information acquisition unit acquires information for specifying a length in a vertical direction and a horizontal direction of the medium as the range information. Storage means for storing extended coordinate information indicating a position on a specific area including the medium according to the predetermined coordinate system;
The coordinate information acquisition unit acquires, as the coordinate information, a vertical and horizontal displacement of a position on the medium from a predetermined reference point that is on the specific area and not on the medium,
The range information acquisition means includes information for specifying the position of the coordinate information in the extended coordinate information and information for specifying the length in the vertical direction and the horizontal direction of the medium. The image generation apparatus according to claim 4, wherein the image generation apparatus is acquired as: The storage means stores a plurality of the extended coordinate information in association with each identification information,
The coordinate information acquisition unit acquires the coordinate information from specific extended coordinate information of the plurality of extended coordinate information stored in the storage unit, and is associated with the specific extended coordinate information. Get identification information,
The image generation apparatus according to claim 6, wherein the generation unit generates the image that further represents the identification information acquired by the coordinate information acquisition unit. On the computer,
A function of acquiring the image read from the medium on which the image representing the coordinate information indicating the position on the medium and the range information indicating the range of the coordinate information is printed;
A function of detecting the coordinate information from the acquired image;
A function of detecting the range information from the acquired image;
The program for implement | achieving the function which determines the processing content with respect to the said coordinate information according to the comparison result of the detected said coordinate information and the detected said range information. On the computer,
A function of acquiring coordinate information indicating a position on the medium according to a predetermined coordinate system;
A function of acquiring range information indicating a range of the coordinate information;
The program for implement | achieving the function which produces | generates the image showing the acquired said coordinate information and the acquired said range information.

Images