JP6403085B1 - Composite code pattern, generating device, reading device, method and program - Google Patents

Abstract

In a one-dimensional or two-dimensional image in which cells identified as light colors and cells identified as dark colors are arranged in a matrix, the amount of information is further reduced while reducing the difficulty in reading from information representation. Increase.
A composite code pattern includes: a second code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array shape; and one or more specified ones of the arranged cells It is a composite code pattern including a second code in which one or more marks that can be distinguished from the color of each specific cell are arranged in the cell. The second code includes specific information corresponding to at least a part of the first code.
[Selection] Figure 5

Description

  The present invention relates to a composite code pattern, a generation device, a reading device, a method, and a program.

  Conventionally, various information representations using images such as a one-dimensional code such as a barcode and a two-dimensional code such as a QR code (registered trademark) have been proposed. These information representations use, for example, a one-dimensional or two-dimensional image in which cells and spaces identified as light colors and cells and bars identified as dark colors are arranged in a matrix.

  Also, for example, it has been proposed that at least some of the QR code (registered trademark) cells use extended cells that are subdivided into a matrix by finer subcells.

Japanese Patent No. 6061075 Japanese Patent No. 2938338

  By the way, in these information expressions, code information is expressed by arranging two or more types of cells that can be identified by color elements such as brightness. In the current information representation, there are many cases where the amount of information is small. Originally, in these information representations, the cell dimensions are set small in order to improve the amount of information per unit area (hereinafter referred to as information density) on the medium surface on which the image is formed. For information representation in which the cell dimensions are set small, a high-resolution code reader is required. Furthermore, when cells are subdivided, there is a greater possibility that it will be difficult to distinguish the subdivided cells.

  Therefore, in the conventional technique, in a one-dimensional or two-dimensional code image in which a space or cell identified as light color and a bar or cell identified as dark color are arranged in an array, the cell or space / In the information expression in which the size of the bar is set to be small, no consideration is given to difficulty in reading from the information expression when the amount of information is further increased. Accordingly, one aspect of the present invention aims to further increase the amount of information in a one-dimensional or two-dimensional image while reducing the difficulty in reading from code information representation.

  In one aspect, the present invention can be exemplified as a composite code pattern. Hereinafter, it is assumed that light cells include spaces and dark cells include bars. The composite code pattern includes a second code in which a plurality of cells each having one of two or more colors that can be identified are arranged in an array shape, and one or more specific cells in the arranged cells. And a second code in which one or more marks that can be distinguished from the color of each specific cell are arranged. An arrangement in which at least one or more of the marks is in contact with a mark or cell of the same color is excluded.

  With this composite code pattern, it is possible to further increase the amount of information in a one-dimensional or two-dimensional code image while reducing the difficulty of reading from information representation.

It is a figure which illustrates the structure of QR Code. It is a figure which illustrates the structure of QR Code containing the subcell which further subdivided some information cells. It is a figure which illustrates the pattern which expresses a 2nd code | cord with a dot smaller than a subcell. It is a figure which shows the example of a 2nd code | cord | chord. It is a figure which shows the example of a 2nd code | cord | chord. It is a figure which shows the example of a 2nd code | cord | chord. It is a figure explaining the arrangement position of the 2nd code in the 1st code. It is a figure explaining the arrangement position of the 2nd code in the 1st code. It is a figure explaining the arrangement position of the 2nd code in the 1st code. It is a figure which arrange | positions the 2nd code | cord | chord to the dark cell in a 1st code | cord | chord. It is a figure explaining the arrangement position of the 2nd code in the 1st code. It is a figure explaining the arrangement position of the 2nd code in the 1st code. It is a figure explaining the arrangement position of the 2nd code in the 1st code. It is a figure explaining arrangement | positioning of the pattern in the cell which forms a 2nd code | cord | chord. It is a figure explaining arrangement | positioning of the pattern in the cell which forms a 2nd code | cord | chord. It is a figure explaining arrangement | positioning of the pattern in the cell which forms a 2nd code | cord | chord. It is a figure explaining arrangement | positioning of the pattern in the cell which forms a 2nd code | cord | chord. It is a figure explaining arrangement | positioning of the pattern in the cell which forms a 2nd code | cord | chord. It is a figure explaining arrangement | positioning of the pattern in the cell which forms a 2nd code | cord | chord. It is an example of the 2nd code by the line segment in which the tip of a line segment becomes a virtual point. It is an example of the 2nd code by the line segment in which the center of a line segment becomes a virtual point. It is an example of the 2nd code | cord | chord in which the length of the line segment was changed into the several step. It is an example of the 2nd code | cord | chord by the line segment by which the position which divides a line segment by a predetermined ratio becomes a virtual point. It is a figure which shows the structural example (1) of the composite code which has arrange | positioned the dot pattern in the cell of QR Code. It is a figure which shows the structural example (2) of the composite code which has arrange | positioned the dot pattern in the cell of QR Code. It is a figure which shows the structural example (3) of the composite code which has arrange | positioned the dot pattern in the cell of QR Code. It is a figure which shows the structural example (4) of the composite code which has arrange | positioned the dot pattern in the cell of QR Code. It is a figure which shows the structural example (5) of the composite code which has arrange | positioned the dot pattern in the cell of QR Code. It is a figure which shows the structural example (6) of the composite code which has arrange | positioned the dot pattern in the cell of QR Code. It is a figure which shows the structural example (7) of the composite code which has arrange | positioned the dot pattern in the cell of QR Code. It is a figure which shows the structural example (8) of the composite code which has arrange | positioned the dot pattern in the cell of QR Code. It is a figure which illustrates the structure of the information system which provides the service by the composite code which concerns on Embodiment 1. FIG. It is a figure which illustrates the hardware constitutions of information processing apparatus. It is a flowchart which illustrates the composite code production | generation process A by a content server. It is a flowchart which illustrates the composite code reading process A by a user apparatus. It is a flowchart which illustrates the detail of the analysis process of the 2nd code | symbol in a cell. It is a figure which illustrates the structure of the information system which concerns on Embodiment 2. FIG. 5 is a flowchart illustrating a composite code generation process B. 5 is a flowchart illustrating a composite code reading process B. 10 is a flowchart illustrating a composite code reading process according to the third embodiment. It is a figure which illustrates the relationship between the printed dark cell and a pixel. This is an example in which light dots are formed in dark cells. This is an example in which dark dots are formed in light cells. It is a figure which illustrates the determination method of the position of the dot by a bounding box. This is an example in which a dot code is formed in a cell printed at 5 × 5 pixels. This is an example in which dot codes are formed in cells printed with 7 × 7 pixels. It is a figure which illustrates the composite code production | generation process for the authenticity determination of the process example 1. FIG. 10 is a flowchart illustrating a complex QR code reading / authentication process of Process Example 1. It is a figure which illustrates the composite code production | generation process for the authenticity determination of the example 2 of a process. 12 is a flowchart illustrating an example of a composite QR code reading / authentication process in Processing Example 2; It is a figure which illustrates the composite code production | generation process for the authenticity determination of the process example 3. FIG. 10 is a flowchart illustrating a composite QR code reading / authentication process of Processing Example 3; It is a figure which illustrates the composite code production | generation process for the authenticity determination of the process example 4. FIG. 10 is a flowchart illustrating an example of a composite QR code reading / authentication process in Process Example 4; It is a figure which illustrates the composite code production | generation process for the authenticity determination of the process example 5. FIG. 10 is a flowchart illustrating a composite QR code reading / authentication process of a processing example 5; It is a figure which illustrates the composite code production | generation process for the authenticity determination of the process example 6. FIG. 14 is a flowchart illustrating a composite QR code reading / authentication process of a processing example 6; It is a figure which illustrates the composite code production | generation process for the authenticity determination of the process example 7. FIG. 14 is a flowchart illustrating a composite QR code reading / authentication process of a processing example 7; This is an embodiment in which eight information dot placement candidate positions are arranged in a cell. It is a figure which illustrates eight arrangement | positioning arrangement positions of the dot in one cell. This is an example of an image in which the coordinate position of the center of the cell obtained according to the QR code specification is shifted from the original center of the cell. FIG. 10 is a diagram illustrating a direction of a second code and a bounding box. It is an example of the bright cell in which the dot code was formed. It is an example of the image which imaged the cell. It is an example of the image which imaged the cell. This is an example in which an image obtained by imaging a cell is binarized. This is an example in which an image obtained by imaging a cell is binarized. It is an example of a process which binarizes an image. It is a figure which illustrates that the center coordinate value of an information dot is contained in the bounding box. It is a figure which illustrates that the center coordinate value of an information dot is contained in the bounding box. This is an example of a composite code in which a dot code is formed by arranging reference dots only in dark cells. It is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. It is the Example which showed a part of compound code. This is an embodiment in which an information dot arrangement candidate position in a cell is set and a reference dot is arranged in the center. It is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. FIG. 10 is a diagram illustrating a direction of a second code and a bounding box. It is the Example which showed a part of compound code. It is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. It is the Example which showed a part of compound code. This is an embodiment in which the bright cell is divided into four parts in the vertical and horizontal directions, and the candidate positions of the information division cells and the reference dots are arranged. It is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. FIG. 10 is a diagram illustrating a direction of a second code and a bounding box. It is the Example which showed a part of compound code. This is an embodiment in which a light color cell is divided into 5 parts vertically and horizontally to arrange the candidate positions of information division cells and reference division cells. It is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. FIG. 10 is a diagram illustrating a direction of a second code and a bounding box. It is the Example which showed a part of compound code. This is an embodiment in which a light color cell is divided into 5 parts vertically and horizontally to arrange information division cell placement candidates. It is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. FIG. 10 is a diagram illustrating a direction of a second code and a bounding box. This is an embodiment in which 12 information division cell arrangement candidate positions are arranged so as not to be adjacent to each other vertically and horizontally. It is a figure shown about a bounding box. It is a figure (1) which shows the state which moved the bounding box. It is a figure (2) which shows the state which moved the bounding box. It is a figure (3) which shows the state where the bounding box was moved. It is a figure (4) which shows the state which moved the bounding box. It is a figure (5) which shows the state which moved the bounding box. It is a figure (6) which shows the state which moved the bounding box. It is a figure (7) which shows the state which moved the bounding box. It is a figure (8) which shows the state which moved the bounding box. It is an Example of the composite code | cord | chord which has a reference | standard pattern. This is an example of a composite code in which a reference pattern is divided into two cells. It is an Example of the composite code | cord | chord which has a reference | standard pattern. This is an example of a composite code in which a plurality of reference patterns are arranged at predetermined intervals of light and / or dark cells. It is an Example of the composite code which has arrange | positioned the reference pattern by a reference | standard dot and a reference | standard division | segmentation cell. This is an example of a composite code in which reference divided cells are arranged in two cells to form a reference pattern. This is an example of a composite code in which direction dots are added and the direction of the second code is set. This is an example of a composite code in which the orientation of the second code is set by changing the arrangement of the reference dots constituting the reference pattern.

Hereinafter, an information processing apparatus according to an embodiment will be described with reference to the drawings. The configuration of the following embodiment is an exemplification, and the information processing apparatus is not limited to the configuration of the embodiment.
[Comparative example]

  FIG. 1 illustrates the structure of a QR code. The QR code includes a position detection pattern (finder pattern), an alignment pattern, a timing pattern, format information, data, and an error correction code. The finder pattern is used to detect data cutout / tilt. The alignment pattern is used when correcting the positional deviation of each cell caused by distortion. In the timing pattern, white cells and black cells are alternately arranged and used to determine module coordinates in the symbol. The format information stores information on the error correction rate and mask pattern used. Data and error correction codes are arranged in the area other than the area where the pattern or information described above is arranged, and in the area indicated by hatching in FIG.

  FIG. 2 illustrates the structure of a QR code including a subcell obtained by further subdividing a part of the information cell. As shown in the figure, the subcells that have been subdivided have a structure in which the cell is divided into four parts in the horizontal and vertical directions, and one cell is divided into 16 parts. And, by assigning dark color to the remaining 8 subcells (illustrated in gray in FIG. 2) except for the cell at the four corners and the four cells at the center, among the subcell areas divided into 16 cells. The information of the original 2 bits of light and dark is increased to 8 pieces of information in a total of 8 locations.

  However, in the configuration of FIG. 2, like the subcells SC1 and SC2, two adjacent subcells may be integrated into one region of the same color. Further, as in the subcells SC1 and SC3, two dark areas may come into contact with each other at one of the four corners. Also, all of the subcells SC1 to SC8 are in contact with adjacent cells. Therefore, when the same color as an adjacent cell is designated in any one of the subcells SC1 to SC8 (for example, the subcell SCk), the subcell SCk and the adjacent cell are integrated into a continuous region of the same color. Can occur.

  As described above, when a plurality of dark areas are connected, it may be difficult to distinguish between a single subcell and a group of a plurality of subcells at the limit of reading resolution. On the other hand, in the case of information representation using a combination of dark subcells arranged with at least one light color region sandwiched between subcells SC4 to SC8 with respect to subcell SC1, each single dark color subcell has It is divided by the light color area, and the outline of the dark color area can be easily identified. Therefore, it can be said that the combination of a plurality of dark subcells arranged with at least one light color region sandwiched there is little difficulty in reading even at the limit of reading resolution. However, by adding the limitation in this way, the number of bits that can be expressed is reduced.

For example, in the case where a dark color area and a light color area are arranged in 16 sub-cells, in order to distinguish the original dark-colored cells other than the sub-cells (such as a black cell of QR code), in Patent Document 1, the dark Only 25% of subcells can be arranged in one cell. Therefore, a maximum of 4 subcells among the 16 subcells can be dark cells, and the combinations of subcell layouts that can be defined are ₁₆ C ₄ + ₁₆ C ₃ + ₁₆ C ₂ + ₁₆ C ₁ = 1,820 + 560 + 120 + 16 = 2,516. Further, considering the case where there are no divided subcells, one case where the background is white (that is, no black divided cells), and the case where the background is black (that is, all white subcells). (If there is no) is added.

With this addition, there are theoretically 2,517 combinations of subcell arrangements. Accordingly, the information amount of the subcells of Figure 2, a 11-bit _{<16 C 4 + 16 C 3} + 16 C 2 + 16 C 1 +2 <12 bits. However, in the above-mentioned patent document 1, subcells (variable parts) in which information can be set are limited to eight locations SC1 to SC8 in FIG. In the above-mentioned Patent Document 1, due to such a limitation, the color of the extended cell can be reliably identified by the QR code reader.
[Embodiment]
In this embodiment, an information expression that improves the problem of the comparative example is proposed.
<Composite code>
In the present embodiment, information is expressed by a composite code defined by a first code exemplified by a QR code and a second code exemplified by a dot pattern in the first code. In the present embodiment, a QR code is exemplified as the first code, but the first code is not limited to the QR code. The first code may be, for example, a one-dimensional barcode or a code expressed by a character string. In the present embodiment, a code expressed by a dot pattern is exemplified as the second code, but the second code is not limited to a code by a dot pattern (also referred to as a dot code).
<Configuration example of second code>

  FIG. 3 illustrates a pattern in which the second code is expressed by dots smaller than the subcell. Hereinafter, the cell in which the second code is set is referred to as a specific cell. In the example of FIG. 3, a dot having a smaller area than the subcell is arranged at the center of the 16 subcells. That is, in the example of FIG. 3, the center of 16 subcells is a virtual point. Information is expressed by whether or not dots are arranged at virtual points. A dot is an example of a mark. In FIG. 3, the dot is arranged at the center of the subcell, but the position of the dot is not limited to the center of the subcell. Therefore, in FIG. 3, it can be said that one or more virtual points are arbitrarily set at positions having coordinate information in a specific cell. Further, in FIG. 3, since information is expressed by whether or not dots are arranged at virtual points, it can be said that numerical data is defined by arranging marks based on virtual points.

  For example, if the cell size is 0.25 mm × 0.25 mm, the size of the 16 sub-cells is 0.0625 mm × 0.0625. On the other hand, the minimum size that can be printed by a printer with a resolution of 600 dpi is 25.4 mm / 600 = 0.042 mm × 0.042 mm, and even if the displacement of the contour due to ink oozing out during printing is taken into consideration, it is 0. It is empirically known that it is less than 0.05 mm × 0.05 mm. (Of course, if the printing accuracy is high, it goes without saying that it approaches 0.042 mm × 0.042 mm. Note that the resolution is higher.) For example, when printing with a printer having a resolution of 1200 dpi, finer printing is possible.

In the example of FIG. 3, the cell area is 0.25 × 0.25 = 0.0625 square mm, and the area of up to eight dots is 0.0249 × 0.0249 × 3.14 × 8 = 0.156. Square mm. In this case, when dots are printed by a normal high-precision printing machine, even if the case is not good, the ratio of the dot area to the cell area is 24.96%, which is 25% of the above-mentioned Patent Document 1. It is almost the same value. Thus, the dot pattern of FIG. _{3, 16 C 4 + 16 C} 3 + 16 C 2 + 16 selects the _C 1 + 2 = 2,517 types of patterns is possible. The dot pattern in FIG. 3 can be said to be a mark that does not interfere with reading the first code.

  A feature of the dot of FIG. 3 compared to the subcell of FIG. 2 is that a light-colored region exists between the dots. That is, as in the comparative example, in the case of the subcell of FIG. 2, the same color is set between two adjacent subcells or between the subcell and the adjacent cell. Continuous or united. Then, at the limit of reading resolution, it may be difficult to distinguish between a single subcell and a group of a plurality of subcells. On the other hand, in the configuration of FIG. 3, the dark dots are clearly divided in the light color region, and the dark dots can be easily identified even at the limit of the reading resolution. The dot pattern in FIG. 3 can be said to be an example of a pattern in which the arrangement in which the marks are in contact is excluded. Further, in the dot pattern of FIG. 3, it can be said that the arrangement in which the mark contacts the boundary between the specific cell and the cell adjacent to the specific cell is excluded. In addition, although black can be illustrated as an example of a dark color and white can be illustrated as an example of a light color, the color used for a code | cord | chord, a pattern, or a mark in this embodiment is not necessarily limited to black and white. For example, a dark cell is not limited to a black cell, and a light cell is not limited to a white cell.

  FIG. 4 shows another example of the second code. FIG. 4 shows an example in which dots are arranged in 3 rows and 3 columns in the center of an area obtained by dividing a cell into nine. That is, also in the example of FIG. 4, the center of nine subcells is a virtual point. Information is expressed by whether or not dots are arranged at virtual points.

Now, as in FIG. 3, when the cell size is 0.25 mm × 0.25 mm and the dot diameter is 0.5 mm, the boundary between the dots is 0.25 / 3−0.05. = 0.03 mm, which further increases the distance between the dots as compared with the case of FIG. 3, and makes it easy to identify the dots. Also in the case of FIG. 4, when a maximum of 8 dots are arranged, the ratio of the dot area to the cell area is 25.12%, which is a value substantially close to the condition of Patent Document 1. Further, dots can express information of FIG. _{4, (9 C 1 + 9 C} 2 + 9 C 3 + 9 C 4) * 2 = (9 + 36 + 84 + 126) * 2 = become 510 kinds, generally closer to 9 bits. The dot pattern in FIG. 4 can be said to be an example of a pattern in which the arrangement where the marks are in contact with each other is excluded. Further, in the dot pattern of FIG. 4, it can be said that the arrangement in which the mark contacts the boundary between the specific cell and the cell adjacent to the specific cell is excluded. Therefore, the dot pattern of FIG. 4 can also be said to be a mark that does not interfere with the reading of the first code.

  FIG. 5 is a modification of FIG. 4, in which the dot arrangement is three rows, and three dots are arranged in the first row, two dots are arranged in the second row, and three dots are arranged in the third row. The dots are arranged so that the position in the row direction of the dots in the second column is between the first and second rows and between the second and third rows. That is, also in the example of FIG. 5, the center of 3 subcells in the first column, the center of 3 subcells in the 3rd column, the boundary line L1 in the 1st row and the 2nd row in the 2nd column, and its boundary line An intersection with a vertical line (illustrated by an alternate long and short dash line) that passes through the center of the cell orthogonal to, and an intersection between the second row and third row boundary line L2 in the second column and the vertical line are respectively virtual points. It has become. Information is expressed by whether or not dots are arranged at virtual points.

Therefore, in the case of FIG. 5, the distance between the dots is further increased than in FIG. 4, and the identification between the dots becomes easier. Also in the case of FIG. 4, when a maximum of 8 dots are arranged, the ratio of the dot area to the cell area is 25.12%, which is a value substantially close to the condition of Patent Document 1. Further, it dots amount of information that can be represented in Figure _{4, (8 C 1 + 8 C} 2 + 8 C 3 + 8 C 4) * 2 = (8 + 28 + 56 + 70) * 2 = become 324 kinds, less than 8 bits 7 bits or more It becomes. The dot pattern in FIG. 5 can be said to be an example of a pattern in which an arrangement in which marks contact each other is excluded. Further, in the dot pattern of FIG. 5, it can be said that the arrangement in which the mark contacts the boundary between the specific cell and the cell adjacent to the specific cell is excluded. Therefore, it can be said that the dot pattern of FIG.

  FIG. 6 shows still another example of the second code. In the example of FIG. 6, virtual points (X1, Y1) are set in one cell. The virtual point (X1, Y1) is specified by, for example, a coordinate value when the lower left point of the cell is the origin (0, 0). However, a mark indicating a virtual point is not attached to the position of the virtual point. A mark indicating the reference point may be arranged at the position of the virtual point. Then, information can be defined by arranging dots at a predetermined angle θ, for example, at an interval of 45 degrees, on a virtual circumference having a radius d around the virtual point. In this case, assuming that the distance d is fixed, 3-bit information can be defined around one virtual point when the number of dots is limited to one. The amount of information that can be expressed when using a maximum of 8 dots is the same as in FIG. Therefore, in FIG. 6, it can be said that numerical data is defined by arranging marks based on virtual points. The dot pattern in FIG. 6 can be said to be an example of a pattern in which the arrangement where the marks are in contact with each other is excluded. Further, in the dot pattern of FIG. 6, it can be said that the arrangement in which the mark contacts the boundary between the specific cell and the cell adjacent to the specific cell is excluded. Also in FIG. 6, virtual points can be arbitrarily set in a cell. Therefore, it can be said that one or more virtual points are arbitrarily set at a position having coordinate information in a specific cell. 6 can be said to be an example in which a part of numerical data is defined by at least one of a direction and a distance in which a mark is arranged starting from a virtual point.

As described above, in the present embodiment, instead of painting a cell used by the code or a subcell obtained by dividing the cell with a dark color with respect to the one-dimensional barcode of the comparative example or the two-dimensional code such as the QR code. Adopt dots that are surrounded by light colors around dark colors. By arranging such dots in a light cell, for example, the second code can be defined in the cell with a higher density than the code of the comparative example.
Although the reading resolution of the reading device varies, in general, when the total area of dots is around 50% of the area of a specific cell, two or more colors that can be identified (white such as a QR code). When black and black are used, it is not preferable because it is not known whether the cell is determined to be a white cell or a black cell. Generally, if it is 33% or less (1/3), it is determined that the specific cell is the cell. If it is 25% or less, it is more preferable.

3 to 6 exemplify the composite code in which the dots in which the periphery of the dark color is surrounded by the light color are illustrated, but the same applies to the case where the light color dots are disposed in the dark cell. In this case, the light dots are clearly divided in the dark area, and the light dots can be easily identified even at the limit of the reading resolution.
<Arrangement position of second code in first code>

  Hereinafter, with reference to FIGS. 7 to 11, the arrangement position of the second code in the first code will be described using the QR code as the first code. Here, the arrangement position of the second code in the first code is a case where information is expressed by a combination of a dark cell and a light cell, as in the case where the first code is a QR code. It refers to the position of a cell (referred to as a specific cell as described above) in which the second code is defined. Here, using the QR code as the first code is merely an example, and the first code is not limited to the QR code.

  In the QR code of the present embodiment, the upper left is the origin, the horizontal right direction is the x direction, the vertical lower direction is the y direction, and the position information (x, y) uses natural numbers m, n, x = 0, It is expressed as 1,2-m, y = 0,1,2-n. On the other hand, data of the QR code (first code) is arranged starting from the lower right. In this embodiment, data is arranged from right to left with reference to two cells in the X direction.

  FIG. 7 shows an example in which the second code is arranged only in light cells (white cells in the figure) in the data and error correction code arrangement area. In FIG. 7, serial numbers 1 to 178 are assigned to light cells in which the second code is formed. This serial number is a code for identifying the second code based on the arrangement of dots in each cell, and is not a pattern (graphic shape) formed in an actual cell, for the explanation in this embodiment.

  However, this serial number can be referred to as unique identification information given to the cell to which the second code is attached. For example, in the information processing in the generating device that generates the composite code or the reading device that reads the composite code. It can be understood as the number used. Each numbered cell is formed with a second code using dots exemplified in FIGS. 3 to 6. Hereinafter, the shape expressing the second code by the dots in the cell is referred to as a dot pattern. In each of FIGS. 7 to 11, the number assigned to each cell can be referred to as a number for identifying the dot pattern in the cell.

  In FIG. 7, the second code is arranged in the same order as the arrangement order of the first code. That is, among the cells of QR code, two cells in the X direction starting from the lower right are arranged side by side, scanning in the order of the right cell and then the left cell, and in the light cell. A second code with dark dots is set. Examples of the second code include those shown in FIGS. 3 to 6. However, the second code is not limited to that shown in FIGS.

  As described above, the serial number assigned to each cell in FIG. 7 does not specify the type of the dot pattern in the cell, but can be understood as information for identifying the cell to which the dot pattern is attached. Among the light-colored cells in FIG. 5, the cell to which the second code is attached can be said to be an example of what is called a specific cell. Also, the identification information given to the light cell in FIG. 5 is called a specific cell index. The specific cell index is identification information associated one-to-one with the coordinate value of each cell in the above scanning order. It can be said that numerical data ordered by a specific cell index is formed from a plurality of specific cells defined. Further, it can be said that the second code string is formed by a plurality of specific cells that can be distinguished from each other by a specific cell index.

  When generating a composite code, the composite code generation device scans a cell in the same scan order as the cell scan order of the first code, for example, the QR code, and the second code is set based on the dot pattern. In other words, the composite code reader may scan the cells in the same order as the composite code generator and decode the information from the second code based on the dot pattern. Therefore, the first code, for example, a composite code generated in the same scan order as the QR code cell scan order, can be read by the reader alone without obtaining information from the generator. This is because the reading device only needs to associate the specific cell index with the coordinates in the same scanning order as the generation device.

  On the other hand, when generating a composite code, the composite code generator scans cells in a scan order different from the cell scan order of the first code, for example, the QR code, and the second code is set by the dot pattern. In order for the composite code reader to decode information from the composite code, information that associates the specific cell index with the coordinate value is required. In the following embodiments, a processing example in which a composite code reader decodes information from a composite code without information associating a specific cell index with a coordinate value, and information with which the reader associates a specific cell index with a coordinate value An example of processing for decrypting information from a composite code is given.

  As information for associating a specific cell index with a coordinate value, a case where the specific cell index and the coordinate value are directly associated with each other, and adding a reference index to the coordinates of all cells, A case where the specific cell index and the coordinate value are indirectly associated by associating the reference index is exemplified.

  In reading the composite code, a method of executing the reading of the first code and the reading of the second code in parallel, and a method of executing the reading of the first code and the reading of the second code separately in two stages There is. In the method of executing the reading of the first code and the reading of the second code in parallel, after the light color and dark color of one cell forming the first code are determined, the light color and dark color of the next cell are determined. Before the determination is made, the presence or absence of the dot pattern forming the second code is determined for the cell for which the light color and dark color determination has been completed. Then, the dot pattern is decoded into a numerical value for the cell in which the dot pattern exists. Then, the numerical values are integrated in units of numerical values obtained by combining a predetermined number of cells, and the second code is decoded.

  FIG. 8 shows an arrangement example of the composite code in which the second code is also arranged in the white cells around the finder pattern. Also in FIG. 8, as in FIG. 7, the cell rows (the cell rows in the vertical direction with respect to the paper surface) are in pairs. In the first two columns, when scanning from the bottom to the top, among the left and right cells, the light cell is given a serial number with priority on the right cell. For example, in the bottom row of the two rightmost columns, since there is a light cell on the left side, serial number 1 is assigned. In the second line from the bottom, since there are only dark cells, no serial number is assigned. Further, for example, in the eighth line from the bottom, since both the left and right cells are light colors, serial numbers 6 and 7 are assigned with priority on the right cell. The same applies hereinafter. In the third and fourth columns from the right, the cells are scanned from the top to the bottom, and the left and right cells are given priority to the right cell, and serial numbers are assigned to the light-colored cells.

  FIG. 9 shows a case where the second code is arranged in all white cells including the finder pattern and the alignment pattern described in FIG. Therefore, the light cells around the finder pattern described in FIG. 1, the light cells in the timing pattern, and the light cells in the format information are also cells in which the data in FIGS. 7 and 8 are arranged. Similarly, the second code is arranged.

  FIG. 10 is an example of a composite code in which the second code is arranged not only in light cells but also in dark cells. In this case as well, the second code may be arranged not only in the data and error correction code areas but also in cells other than the finder pattern and alignment pattern. Further, the second code may be arranged in all the cells (light color cells and dark color cells) including the finder pattern and the alignment pattern. Here, when the second code is arranged in a dark cell, the dot is light. FIG. 10 illustrates a configuration in which light dots are arranged in dark cells of the specific cell index 27 with the same configuration as that illustrated in FIG.

  FIG. 11 is an example of a composite code arrangement in which the dot pattern for each cell constituting the second code is repeated for a predetermined number of cells. In FIG. 11, specific cell indexes, which are serial numbers of cells with numbers 1 to 16, are repeatedly arranged. In FIG. 11, starting from the lower right, dot patterns corresponding to specific cell indexes 1 to 16 are arranged from the right to the left with reference to two cells in the X direction. In this manner, by repeatedly arranging a predetermined number of second codes (dot patterns), the reading device can perform the second operation from a part of the first code (for example, a predetermined number of cells of the QR code). The code can be read. As illustrated in FIG. 11, a portion of the second code grouped by a predetermined number of special cell indexes (numbers 1 to 16) is called a subcode.

  In the case of the composite code of FIG. 11, a table that associates the number indicating the type of the second code in the cell (for example, a number from 1 to 16) with the position coordinates of each cell (or the serial number of each cell) is decoded. What is necessary is just to make it produce | generate by the code production | generation apparatus side and handing over to the reading apparatus. However, by determining the arrangement rule of the second code in advance, the reading device generates a serial number (specific cell index) in the cell in which the second code is set according to the same rules as the generation device. May be. In accordance with the above rules, the composite code reader may arrange the values read from the second code in each cell in the order of serial numbers and integrate the numerical values.

  As shown in FIG. 11, when a predetermined number of serial numbers (specific cell indexes) are repeatedly set in each cell, the second code in each cell itself also matches the repetition of the serial number (specific cell index). You may be able to confirm that it is. For example, among N (for example, 16) cells to which a specific cell index of 1 to 16 is assigned, a dot pattern indicating the beginning of the second code is assigned to the first cell, and the last cell is assigned to the last cell. A dot pattern indicating the end of the second code may be added.

  FIG. 12 is an example of a composite code arrangement in which dot patterns constituting a predetermined number of second codes are repeatedly arranged in all light cells in a QR code that is an example of the first code. That is, in FIG. 12, the second code is arranged in all the light cells while adopting the rule for assigning the serial number (specific cell index) illustrated in FIG. Accordingly, in FIG. 12, as in FIG. 9, the second code can be arranged in all light cells in the QR code, that is, light cells such as the finder pattern and the alignment pattern.

  In this case, it is not necessary to execute the QR code reading process and the second code reading process in parallel. For example, the second code may be read after the first code is read. Therefore, at the time of generating and reading the second code of the composite code, the cell is scanned downward starting from the origin at the upper left, and an index of 1 to 16 is assigned to the light color cell detected during the scanning. In the embodiment of FIG. 12, the process of moving the coordinates of the cell from the minimum value of the X coordinate to the maximum value, moving from the maximum value of the Y coordinate to the minimum value, and further moving from the minimum value to the maximum value is repeated. .

  Further, in FIG. 12, the specific cell index is assigned in order from the minimum value (1) to the maximum value (16), and then from the maximum value (16) to the minimum value (1). In this case, the composite code generation device sets a dot pattern corresponding to the specific cell index to each cell, and generates a composite code. On the other hand, the composite code reader searches for a specific cell in the same procedure as the generation device, sets a specific cell index according to the same rules as the generation device, determines the order of the cells in the composite code, and The code of 2 may be decoded.

  However, even in the case of arrangement in all white cells in the QR code, the generation device matches the arrangement order of the first code (scanning order of the QR code) as described in FIGS. The second code may be arranged (a specific cell index is set). The reading device may execute the QR code reading process and the second code reading process in parallel.

FIG. 13 is an example of a composite code in which dots are arranged in the margin around the QR code. In addition to all the white cells in the QR code, the second code may be arranged in a quiet zone (a blank portion around the QR code). In the example of FIG. 13, the generation device and the reading device search for a specific cell as the cell moves, and when a specific cell in which the second code is set is found, the minimum value (1 ) To the maximum value (16).
<Disposition of dot pattern in cell>

  The arrangement of the dot pattern in the cell forming the second code will be described with reference to FIGS. FIG. 14 is an arrangement example of dot patterns that define information by distance and direction from a virtual point. The dot pattern that defines information by the distance and direction from the virtual point is the dot pattern illustrated in FIG.

  The second code sets a virtual point in the cell and defines information in at least one of the distance d from the virtual point to the dot and the direction of the straight line from the virtual point to the dot. The position of the virtual point is set with respect to the origin of the cell. The cell origin can be exemplified by the lower left point of the cell, but the definition of the cell origin is not limited. FIG. 14 illustrates the case where the distance d is a fixed value. However, the information may be defined by taking a plurality of values as the distance d. In FIG. 14, dots are arranged around the virtual point (distance d) in units of 45 degrees, and numerical data 000 to 111 are defined.

  Note that the cell direction is determined by a shape portion serving as a reference in the first code, for example, a QR code finder pattern (see FIG. 1). Accordingly, the direction in which the dots are arranged with respect to the virtual dots of the cells is set with reference to the coordinate axis determined by the finder pattern. For example, in each cell in FIG. 14, when the axis in the right direction from the virtual point is used as the reference of the direction, the numerical value 000 corresponds to the direction 90 degrees. Further, the numerical value 001 to the numerical value 111 respectively correspond to directions rotated in units of 45 degrees clockwise from the direction of the numerical value 000 (for example, from 90 degrees in the direction).

  Therefore, a generation device that generates a composite code sets a virtual point in a cell, forms a dot at a position determined by a distance and direction corresponding to numerical data, and performs printing by a printing press, or an electronic medium / broadcast medium / memory. What is necessary is just to output to a screen from a medium and a communication medium. On the other hand, the reading device that reads the composite code sets the virtual point and direction in the cell based on the shape portion that is the reference in the first code, and the distance and direction from the virtual point to the dot detected in the cell And the numerical value may be decoded from the dot pattern.

  FIG. 15 is an example in which information is defined depending on whether or not dots are arranged on virtual points. The dot patterns that define information depending on whether or not dots are arranged on virtual points are, for example, the dot patterns illustrated in FIGS.

  Therefore, a generation device that generates a composite code sets a virtual point in a cell, forms a dot on a virtual point corresponding to numerical data, or forms an image without a dot, and performs printing by a printing press or electronic What is necessary is just to output to a screen from a medium, a broadcast medium, a storage medium, or a communication medium. On the other hand, the reading device that reads the composite code sets a virtual point in the cell based on the shape portion that is the reference in the first code, recognizes the presence or absence of a dot at each virtual point, and calculates a numerical value from the dot pattern. Should be decrypted. Furthermore, the composite code may be stored on a storage medium, and the program may decrypt it. That is, a decryption code can be generated and decrypted in the virtual space.

  FIG. 16 is an example of setting virtual points in the second code illustrated in FIG. In FIG. 16, a virtual point (Xi, Yj) is set at the center of the area obtained by dividing the cell into 3 divisions × 3 divisions = 9 divisions. As already described with reference to FIG. 4, when dark dots are arranged in light cells, dots are arranged at a maximum of eight virtual points out of nine virtual points. It is determined as a light cell and dark dots can be arranged at virtual points.

  FIG. 17 is an example of setting virtual points in the second code illustrated in FIG. In FIG. 17, among the virtual points of 3 rows and 3 columns of FIG. 16, the row positions of the two virtual points in the center column are the row positions of the three virtual points in the first column and the three virtual points in the third column. It is arrange | positioned so that it may become an intermediate position.

  FIG. 18 is a modification of the virtual point position. The virtual point position is not limited to FIGS. 16 and 17, and various virtual points can be used. For example, the virtual point position may be one in the cell, or may be two or more. For example, the virtual point position may be provided at a position on a diagonal line from the center of the cell to the four corners of the cell. Further, when two virtual points are provided in a cell, the virtual points may be provided at a position close to two diagonal corners on one diagonal line from the center of the cell. Furthermore, when three virtual points are provided in a cell, one of the virtual points is located on one side of the line that connects the center of the cell to the center of one of the two sides of the opposite cell. The remaining two virtual points may be provided at close positions, and may be provided at positions close to both ends of the side facing the one side (two corners formed by sides orthogonal to the side facing the opposite side).

  FIG. 19 is an example of a dot pattern in a cell that clearly indicates that information by a dot pattern is not set. For example, when a plurality of virtual points are provided in a cell, it may mean that information is undefined when a dot is arranged at a virtual point at the center of the cell.

  FIG. 20 is an example of a second code by a line segment in which the end of the line segment is located at a virtual point. That is, instead of disposing dots around virtual points as shown in FIG. 14 and defining information by distance and direction, lines are arranged around virtual points as shown in FIG. Information may be defined by direction. A line segment is an example of a mark. Further, the line segment pattern in FIG. 20 can be said to be an example of a pattern in which an arrangement in which marks contact each other is excluded. Further, in the line segment pattern of FIG. 20, it can be said that the arrangement in which the mark contacts the boundary between the specific cell and the cell adjacent to the specific cell is excluded. In FIG. 20, a part of the numerical data can be defined by at least one of the direction and the length of the line segment.

  FIG. 21 is an example of the second code by the line segment in which the center of the line segment is positioned at the virtual point. Also in FIG. 21, a part of the numerical data can be defined by at least one of the direction and the length of the line segment. Furthermore, in FIG. 22, the length of the line segment is changed in a plurality of stages, and the length of the line segment is one element that defines information. Note that when a line segment is arranged as the second code, the position of the virtual point is not limited to the center of the line segment. For example, FIG. 23 shows a second result of a line segment in which the position at which the line segment is internally divided at a predetermined ratio (for example, a position 1/3 from the end of the line segment) is not the center of the line segment but is positioned at the virtual point An example of code. Therefore, also in FIG. 22 or FIG. 23, a part of numerical data can be defined by at least one of the direction and length of a line segment. 20 to 23, it can be said that a part of the numerical data is defined by arranging any position in the line segment on the virtual point.

As described above, in FIGS. 14 to 23, it can be said that one or more virtual points are arbitrarily set at positions having coordinate information in a specific cell. Further, in FIGS. 14 to 23, it can be said that numerical data is defined by arranging marks based on virtual points. In FIG. 14 to FIG. 23, the mark is defined by the light color region and the dark color region. For example, the mark is defined by any two of R (red), G (green), and B (blue). It may be defined. Accordingly, in FIGS. 14 to 23, an example of a composite code in which a part of numerical data is defined by at least one of the mark arrangement method based on the mark shape, color, and virtual point, and the presence or absence of the arrangement. It can be said. In FIGS. 14 to 23, the second code is defined by a dot or a line segment. However, the shape of the mark may be an arbitrary polygon or a substantially circular shape.
<Example where dots are actually arranged in the QR code>

  FIG. 24 is a diagram illustrating a configuration example (1) of a composite code in which a dot pattern is arranged in a QR code cell as an example of the first code. In the configuration example (1), as an example of the second code, a dot pattern that defines information by the distance and direction from the virtual point is illustrated. The dot pattern that defines information by the distance and direction from the virtual point is as described in FIG. In FIG. 24, a dark color region filled with a hatching pattern and a light color region without a hatching pattern are formed in the QR code portion. In addition, a virtual point is illustrated by a plus (“+”) mark approximately in the vicinity of the center in the light-colored region. The mark such as plus (“+”) is described to illustrate the position of the virtual point on the drawing, and the mark such as plus (“+”) is not drawn in the actual composite code. Further, one dot is illustrated in each light-colored region approximately in units of 45 degrees around the virtual point.

  FIG. 25 is a diagram illustrating a configuration example (2) of a composite code in which dot patterns are arranged in a QR code cell as an example of the first code. In the configuration example (2), as an example of the second code, a plurality of virtual points are provided in a light-colored area, and information is defined by whether or not the virtual points are on the virtual points. In FIG. 25, four virtual points are provided in one light color area, but the number of virtual points is not limited to four in this embodiment.

  FIG. 26 is a diagram illustrating a configuration example (3) of a composite code in which dot patterns are arranged in a QR code cell as an example of the first code. In the configuration example (3), as an example of the second code, a plurality of virtual points are provided in a light-colored region, and information is defined depending on whether or not the virtual point is on the virtual point. In FIG. 25, one dot is arranged in each light color area, but in FIG. 26, three dots are provided in one light color area.

  FIG. 27 is a diagram illustrating a configuration example (4) of a composite code in which a dot pattern is arranged in a cell of a QR code as an example of the first code. In the configuration example (4), as an example of the second code, the number of virtual points and the dot arrangement method differ depending on the specific cell in which the dot pattern is defined. That is, according to the position of the specific cell, the number of virtual points, the placement position of the virtual points, and the way of dot placement with respect to the virtual points may be different. For example, as shown in FIG. 24, the dot arrangement with respect to the virtual point is based on the arrangement of the dot pattern defining information by the distance and direction from the virtual point, and on the virtual point as shown in FIG. 25 and FIG. The arrangement of dot patterns that define information depending on whether or not there is is exemplified. Further, the number of dots in one light color region may be one or plural.

  In any case, the second code may be defined in common for each cell position between the generating device that generates the composite code and the reading device that acquires information from the composite code. Further, for example, information for specifying the method of defining the second code may be incorporated in the format information illustrated in FIG.

  FIG. 28 is a diagram illustrating a configuration example (5) of a composite code in which dot patterns are arranged in a QR code cell as an example of the first code. In the configuration example (5), as an example of the second code, information is defined by arranging light dots in a dark region. FIG. 28 illustrates a dot pattern in which the light color and the dark color are interchanged with respect to the dot pattern illustrated in FIG. 26 in which the dark color dots are arranged in the light color region.

  FIG. 29 is a diagram illustrating a configuration example (6) of a composite code in which a dot pattern is arranged in a QR code cell as an example of the first code. In the configuration example (6), as an example of the second code, information is defined by arranging a line segment in a light color area. In the configuration example (6), as in FIG. 20, the line segment is arranged with the tip of the line segment positioned at the virtual point.

  FIG. 30 is a diagram illustrating a configuration example (7) of a composite code in which a line segment pattern is arranged in a QR code cell as an example of the first code. In the configuration example (7), the line segment is arranged in a different arrangement manner depending on the specific cell in which the second code is arranged. For example, a line segment whose tip is a virtual point, a line segment whose center is a virtual point, the length of the line segment is changed in multiple stages, and the length of the line segment defines one information An element, a line segment that is a position virtual point that internally divides the line segment at a predetermined ratio, or the like can be adopted.

    FIG. 31 is a diagram illustrating a configuration example (8) of a composite code in which a line segment pattern is arranged in a QR code cell as an example of the first code. In the configuration example (8), for each specific cell in which the second code is arranged, either a line segment pattern or a dot pattern is selected and arranged as an example of the second code. In addition, the arrangement method of line segments and the arrangement method of dot patterns are defined for each specific cell. Such arrangement of the second code may be made common between the generation device that generates the composite code and the reading device that reads the composite code.

Furthermore, although not shown in FIGS. 23 to 31, a second code (FIG. 23, etc.) defined in a light color area and a second code (FIG. 28) defined in a dark color area. May be combined to form a composite code.
<System configuration>

  FIG. 32 is a diagram illustrating a configuration of an information system that provides a service using a composite code. In this information system, a management server MS1, content servers CS1 and CS2, and a user device UD1 are connected by a network N1. The information system may include a user device UD2 that is not connected to the network N1.

  The management server MS1 has composite code generation means CGM and composite code analysis means CAM. The composite code generation means CGM converts the input digital data into a composite code. For example, the management server MS1 receives digital data from the content server CS1 through the network N1, generates composite code image data by the composite code generation means CGM, and returns the composite code image data to the content server CS1.

  The composite code analysis means CAM analyzes the input composite code and converts it into original digital data. For example, the management server MS1 receives the composite code image from the user device UD1 through the network N1, generates the original digital data by the composite code analysis means CAM, and returns the digital data to the user device UD1.

  The content server CS1 has communication means CMS1 and composite code output means COUT1. The content server CS1 provides various contents or services to the user devices UD1, UD2, and the like. The content provided by the content server CS1 is provided to the user device through, for example, a broadcast system or an electronic information communication system that is a broadcast medium or a communication medium. Examples of content include images (images or still images). The broadcast medium refers to, for example, television broadcasting and the like, and is a medium that distributes content using electromagnetic waves or the like. The communication medium refers to, for example, the Internet and the like, and is a medium that distributes content through a wired or wireless network.

  The content server CS1 can also provide content to the user devices UD1, UD2, etc. via a recording medium such as a CD, DVD, Blu-ray disc, or USB memory. Furthermore, the content server CS1 can also provide content to the user devices UD1, UD2, etc. via a print medium. Examples of the print medium include those capable of forming an image with ink such as paper and the surface of an object.

  The content server CS1 transfers digital data related to the provided content to the management server MS1 through the network N1, and converts it into a composite code. Then, the content server CS1 acquires the composite data converted by the management server MS1 through the network N1, and provides it to the user devices UD1, UD2, etc. together with the content. The digital data related to the content is various character information related to the provided content, URL related to the provided content, identification information related to the provided content, authentication information for access, etc. .

  The content server CS2 includes a composite code generation unit CG2 in addition to the communication unit CMS2 and the composite code output unit COUT2. Therefore, the content server CS2 can convert digital data related to the provided content into a composite code by the composite code generation means CG2. Therefore, the content server CS2 does not need to transfer the digital data to the management server MS1 and convert it into a composite code. The functions of the communication unit CMS2 and the composite code output unit COUT2 are the same as those of the communication unit CMS1 and the composite code output unit COUT1 of the content server CS1 described above. As the content servers CS1 and CS2, for example, an information processing device that cooperates with a broadcasting device of a broadcasting station, a server that provides content on the Internet, a printing device in a printing company or the like, a server that cooperates with a printer, or a built-in printing device The computer etc. which were done can be illustrated.

  The user device UD1 includes a communication unit CMU1 and an image input unit IIN1. The image input means IIN1 is a television screen that is a broadcast medium, a screen that includes a graphics object on web content that is a communication medium, a screen that includes a graphics object output from a recording medium, or a printed material formed on a print medium. Image input means for inputting an image from. The image input means is, for example, a scanner or camera having an imaging device such as a charge coupled device (CCD), a metal-oxide-semiconductor (MOS) image sensor, or a complementary metal-oxide-semiconductor (CMOS) image sensor. Etc.

  The user device UD1 transfers the input image itself or the composite code portion in the input image to the management server MS1 via the network N1, and restores the digital data encoded with the composite code. Then, the user device UD1 executes processing corresponding to the digital data based on the obtained digital data and the content provided from the content servers CS1, CS2, and the like. The processing corresponding to the digital data includes, for example, the validity determination of the content based on the digital data, the determination of whether to access the content, the modification of the method of providing the content to the user, and other related to the content For example, content provision.

  The user device UD2 includes composite code analysis means CA2 in addition to the image input means IIN2. The user device UD2 restores the digital data encoded with the composite code from the input image using the composite code analysis means CA2. Therefore, the user device UD2 does not need to transfer the input image and the composite code portion in the input image to the management server MS1 and restore the digital data. Then, the user device UD2 executes processing corresponding to the digital data based on the obtained digital data and the content provided from the content servers CS1, CS2, and the like. In addition, as user apparatus UD1, UD2, a personal computer, a tablet terminal, a smart phone, etc. can be illustrated.

  FIG. 33 is a diagram illustrating a hardware configuration of the information processing apparatus 10. The information processing apparatus 10 can be applied to the management server MS1, the content servers CS1 and CS2, and the user apparatuses UD1 and UD2 of this embodiment. The information processing apparatus 10 includes a CPU 11, a main storage device 12, and an external device, and executes information processing by a program. The CPU 11 is also called a processor. Examples of external devices include an external storage device 13, a display device 14, an operation unit 15, a communication interface 16, an image input interface 17, and an image output interface 18.

  The CPU 11 executes a computer program that is executed in the main storage device 12 and provides functions of the information processing device 10. The main storage device 12 stores a computer program executed by the CPU 11, data processed by the CPU 11, and the like. The main storage device 12 is a dynamic random access memory (DRAM), a static random access memory (SRAM), a read only memory (ROM), or the like. Furthermore, the external storage device 13 is used as a storage area that assists the main storage device 12, for example, and stores a computer program executed by the CPU 11, data processed by the CPU 11, and the like. The external storage device 13 is a hard disk drive, a solid state disk (SSD), or the like. Further, the information processing apparatus 10 may be provided with a drive device for a removable storage medium. The removable storage medium is, for example, a Blu-ray Disc, Digital Versatile Disk (DVD), Compact Disc (CD), flash memory card, or the like.

  The display device 14 is, for example, a liquid crystal display, an electroluminescence panel, or the like. The operation unit 15 is, for example, a keyboard, a pointing device, or the like. In the present embodiment, a mouse is exemplified as the pointing device. The communication interface 16 exchanges data with other devices on the network N1. For example, the CPU 11 communicates with other devices on the network N1 through the communication interface 16. The communication interface 16 may be connected to a broadcasting device. For example, the broadcasting device converts digital data from a baseband signal to a high frequency signal, and transmits the converted high frequency as a broadcast wave via a high frequency amplifier and an antenna.

  The image input interface 17 is connected to a camera, a scanner, and the like, and acquires image data from various media. Examples of various media include a screen of a television receiver, a computer display, a printed matter such as a book, and a visually recognizable pattern formed on an object surface.

  The image output interface 18 is connected to a printing device, a printer, or the like, and outputs image data to a print medium. Although omitted in FIG. 33, the information processing apparatus 10 may include a camera, a scanner, and the like connected via the image input interface 17. Further, the information processing apparatus 10 may include a printing apparatus, a printer, and the like connected via the image output interface 18.

Further, when the information processing apparatus 10 is applied to the management server MS1, the image input interface 17 and the image output interface 18 may be omitted. In addition, when the information processing apparatus 10 is applied to the content servers CS1 and CS2, the image input interface 17 may not be provided. Furthermore, when the information processing apparatus 10 is applied to a user apparatus, the image output interface 18 may not be provided.
<Processing flow>

  The processing flow in this information system will be described with reference to FIGS. Hereinafter, the content servers CS1 and CS2 are collectively referred to simply as a content server CS. That is, the following processing may be executed by either of the content servers CS1 and CS2. In addition, the user devices UD1 and UD2 are collectively referred to simply as the user device UD. That is, any of the user devices UD1 and UD2 may execute the following processing.

  FIG. 34 is a flowchart illustrating a composite code generation process A by the content server CS. The composite code generation process A is used to distinguish it from the composite code generation process B of FIG. 34 and 38, it can be said that the content server CS executes the process as a composite code generation device. In the process of FIG. 34, the content server CS generates the shape information of the first code (S11). For example, when the first code is a QR code, the content server CS determines the arrangement of light cells and dark cells in the QR code.

  Next, the content server CS inputs digital data to be converted into the second code (S12). The digital data is information related to the content provided by the content server CS, for example. The digital data is input from, for example, a storage device associated with content provided by the content server CS.

  Next, the content server CS performs binary encoding on the digital data (S13). That is, the content server CS converts the digital data into a binary one-dimensional bit string. Then, the content server CS divides the binary-encoded data into data for each cell of the first code (S14). That is, the content server CS delimits the binary encoded data by the maximum number of bits that can be expressed by the dot pattern in each cell. Then, the content server CS assigns the divided data to cells in which the second code can be arranged according to a predetermined rule.

  The cell in which the second code can be arranged is, for example, when the first code is defined by a combination of a light cell and a dark cell, and the second code is defined by a dark dot. Cell. The cell in which the second code can be arranged is, for example, when the first code is defined by a combination of a light color cell and a dark color cell, and the second code is defined by a light color dot. This is a dark cell. The content server CS determines, for example, a cell to which the second code is assigned and the order in which the second code is assigned in accordance with predetermined rules such as those shown in FIGS. As already illustrated in FIG. 11, the content server CS may repeatedly form the plurality of specific cells forming the second code a plurality of times and assign the cells.

  Then, the content server CS generates shape information of the second code (S15). That is, the content server CS converts the binary encoded data divided for each cell into image data encoded based on the virtual point in the cell in the process of S14. The image data encoded on the basis of the virtual point in the cell is, for example, those illustrated in FIGS. 3 to 6. Then, the content server CS outputs image data (S16). The output destination is, for example, a print medium such as a printer, an output to the display device of the user device UD by electronic information distribution via the network N1, a distribution through a broadcast medium, or the like. It can be said that the content server CS that executes the process of S11 and the process of S16 has an example of a first generation unit that generates the first code. Further, it can be said that the content server CS that executes the processes of S12 to S16 has an example of a second generation unit. Therefore, it can be said that the content server CS excludes the arrangement where the marks are in contact when the plurality of marks are arranged in the specific cell as the second generation unit. Further, it can be said that the content server CS excludes the arrangement that contacts the boundary between the specific cell and the cell adjacent to the specific cell as the second generation unit.

  If the content server CS is the content server CS1, the digital data is transferred to the management server MS1, and the processing from S13 to S15 is executed by the management server MS1. The content server CS1 may output the image data generated by the management server MS1 to a printer, a user device UD on the network, a broadcast medium, or the like.

  FIG. 35 is a flowchart illustrating a composite code reading process A by the user device UD. The composite code reading process A is used to distinguish it from the composite code reading process B of FIG. 35 and 39, it can be said that the user apparatus executes the process as a composite code reading apparatus. In the process of FIG. 35, the user apparatus UD inputs an image of a composite code input from a scanner or a camera via the image input interface 17, and recognizes the format and the arrangement of cells of the first code ( S20). For example, the user apparatus UD recognizes the direction of the QR code using the finder pattern, and corrects image distortion using the alignment pattern. Further, the user apparatus UD recognizes the cell arrangement interval based on the timing pattern, and specifies the arrangement position of the QR code data and the error correction code. Thereafter, the user apparatus UD processes the composite code in the arrangement order of the first code for each cell. For example, the user apparatus UD sequentially processes the cells in the rightmost two columns in the upward direction from the cell in the lower right corner of the QR code, and when the processing for two columns is completed, the cells in the third column and the fourth column are Process sequentially from top to bottom. Thereafter, data cells and error correction code cells are similarly processed in two columns. Hereinafter, processing for each cell will be described.

  That is, the user apparatus UD obtains an image of the next cell, analyzes the first code, and determines brightness (S21). Next, the user apparatus UD determines whether or not the second code is defined in the cell being processed (S22). For example, the user device UD recognizes how to arrange the virtual points and how to arrange the dots with respect to the virtual points from the format information acquired in S20, and determines whether there is at least one dot at the corresponding position. judge. If the second code is defined in the cell, the second code in the cell is analyzed (S23). The second code may be defined in a light cell. Further, the second code may be defined in a dark cell as shown in FIG.

  Then, the user apparatus UD determines whether or not the next cell remains unprocessed (S24). When the next cell is unprocessed, the user apparatus UD returns the process to S21. On the other hand, when the processing of all the cells is completed and there is no next cell, the user apparatus UD generates information obtained by integrating the first code for each character from the bit string obtained by the light / dark determination of the first code. (S25). For example, the user apparatus UD separates the bit string obtained from the light / dark determination into characters, and generates digital data (S25). It can be said that the user apparatus UD that executes the processes of S20, S21, and S25 has a first acquisition unit that acquires numerical data from the first code.

  Further, the user apparatus UD restores the digital data based on the bit string obtained from the second code (S26). For example, when the second code is composed of a combination of a predetermined number of cells (for example, 16 cells) as shown in FIG. 11, the bit string based on the dot pattern from the first cell to the predetermined number of cells is integrated. To restore the digital data. It can be said that the user apparatus UD that executes the process of S23 and the process of S26 includes a second acquisition unit that acquires numerical data from the second code. At this time, in S14, the user apparatus UD determines the combination order of the second codes according to the same rule as the rule in which the data separated by the content server CS is assigned to the cell in which the second code can be arranged. . Therefore, it can be said that the user apparatus UD that executes the process of S26 has an example of a unit that generates a specific cell index that orders the specific cells. Therefore, for example, as illustrated in FIG. 11, the user apparatus UD may form a specific cell index by repeatedly ordering a plurality of specific cells forming the second code a plurality of times.

  Then, the user apparatus UD executes information processing corresponding to the digital data restored from the first code and the second code (S27). For example, the user device UD executes processing such as displaying, reproducing, outputting, processing, or adding data related to the content according to the restored digital data. However, in the present embodiment, the information processing executed in the process of S27 is not limited. If the user device UD is the user device UD1, the composite code is transferred from the user device UD1 to the management server MS1, and the processing from S20 to S26 is executed by the management server MS1. The user device UD1 may acquire the result at the management server MS1 and execute the process of S27.

  FIG. 36 is a flowchart illustrating the details of the analysis process of the second code in the cell (S23 in FIG. 35). The following processing will be described as being executed by the user device UD. However, as described above, when the user device UD is the user device UD1, the following processing is executed by the management server MS1. In this process, the user apparatus UD specifies a virtual point with respect to the cell origin (S230). Note that since the process of S230 is repeatedly executed, “next virtual point” is described in FIG.

  Then, the user device UD estimates the next dot position with respect to the virtual point (S231). For example, as illustrated in FIG. 6, when the dot positions are arranged by changing the distance and direction from the virtual point, the respective arrangement positions are sequentially estimated. On the other hand, when the dot is placed on the virtual point as shown in FIGS. 3 to 5, the virtual point is the estimated position as it is.

  Then, the user device UD scans the pixel at the dot position by a predetermined number of pixels, and calculates the pixel value ratio VPn / VP0 (S232). And it is determined whether ratio VPn / VP0 is below a reference value (S233). Here, a pixel means an array element of an image memory when an image acquired by scanning or a camera is stored in the image memory. Here, VP0 is a pixel value at a position estimated as a dot center. VPn is a pixel value at a position n pixels away from the dot center. When VPn / VP0 is equal to or less than the reference value, the ratio of the pixel value at a position separated by n pixels from the dot center to the pixel value at the position estimated as the dot center is sufficiently small. Therefore, when the ratio VPn / VP0 is equal to or less than the reference value, the user apparatus UD determines that the reference value for estimating the presence of dots is satisfied.

  Then, when the ratio satisfies the reference value for estimating the presence of dots, the user apparatus UD records the presence of dots (S234). On the other hand, when the ratio does not satisfy the reference value for estimating the presence of the dot, that is, when the ratio VPn / VP0 does not become the reference value or less, the user device UD records no dot (S235).

  Next, the user device UD determines whether or not the processing of all dot positions for the virtual point has been completed (S236). If the processing of all the dot positions for the virtual point has not been completed, the user apparatus UD returns the processing to S230 and estimates the next dot position for the same virtual point. Note that the determination in S236 is not necessary when dots are arranged on virtual points.

On the other hand, when the process for all the dot positions for the virtual point is completed, the user apparatus UD determines whether or not the process for all the virtual points is completed (S237). If the processing for all virtual points has not been completed, the user apparatus UD returns the processing to S230 and executes the processing for the next virtual point.

When the processing of all virtual points is completed, the user device UD determines the numerical value of the dot pattern in the cell corresponding to the dot position (S238). That is, the user apparatus UD determines a numerical value to be restored from the dot arrangement. Then, the user apparatus UD stores the numerical value of the dot pattern in the cell and the cell identification information (S238). The cell identification information may be a serial number assigned to the cell. The cell identification information may be, for example, cell arrangement coordinates in a QR code. In the example of FIG. 11, the cell identification information may be a specific cell index from 1 to a predetermined number (for example, 16) that is repeatedly set. Further, the user apparatus UD may store a combination of the numerical value of the dot pattern in the cell, the cell identification information, and the specific cell index.
<Effect of Embodiment 1>

  As described above, in the information system of this embodiment, a composite code in which the second code based on the dot pattern is defined in the cell of the first code exemplified by the QR code. For example, the content server CS generates a composite code, assigns the composite code to various media such as a broadcast medium, a communication medium, a storage medium, and a print medium, and distributes the medium.

  In this composite code, dark dots are used in light cells. In such a configuration, dots and dots are separated in a light color area in the cell. Further, the dots in the cell are separated from the adjacent cells by a light color area. Therefore, the user device UD that is a reading device can clearly recognize the second code. As a result, it is possible to increase the amount of information by the first code and perform stable decoding. For example, when the second code is in the format shown in FIG. 5, 324 patterns of information of 7 bits or more and less than 8 bits can be defined in one cell.

  In the above embodiment, the composite code analysis means CA2 of the user device UD2 or the composite code analysis means CAM of the management server MS1 is the position where the presence of dots in the image acquired from the image input means IIN1 and IIN2 is estimated ( For example, whether the ratio between the pixel value VP0 at the position estimated as the dot center) and the pixel value Vpn at a position away from the position estimated as the dot center by a predetermined number of pixels (n pixels) satisfies the predetermined condition. Accordingly, the presence or absence of dots was determined. By using such a ratio of pixel values, the boundary between the light color region and the dark color region can be accurately determined. In the determination based on the above ratio, for example, as an example of the first code, in the determination of the light color and dark color of the QR code, 75% or more of all pixels have dark color cells as dark cells, and 25% of all pixels. The following determination can be made consistent with the case where a dark pixel cell is determined to be a bright cell. Furthermore, even if there is illumination unevenness, the influence of shadows, dirt, or the like in the region where the presence / absence of dots is to be determined, by calculating the pixel value ratio, Even if a background fluctuation occurs in a pixel at a position that is a predetermined number of pixels (n pixels) away from the position estimated as the center of the dot, the boundary between the light color area and the dark color area can be accurately determined.

In the above embodiment, the composite code can be analyzed and the numerical value can be restored from the second code by at least one of the composite code analysis means CA2 of the user device UD2 and the composite code analysis means CAM of the management server MS1. Therefore, unlike the user device UD1, the user device UD1 having the image input unit IIN1 and the communication unit CMU1 can be easily and lightly loaded by the communication with the management server MS1 without providing the analysis unit CA2. Can be provided to the user.
[Embodiment 2]

  In the first embodiment, the reading order of the second code is the reading order of the cells of the first code. However, the reading order of the cells in which the second code is set may be different from the reading order of the cells of the first code. For example, in the information system of FIG. 32, the composite code generation means CGM, CG2 for generating a composite code, in the process of dividing the binary-encoded bit string into data for each cell (S14 in FIG. 34), the second code The reading order of the cells in which is set may be different from that of the first code, and the reading order may be stored. For example, the reading order can be managed by associating the cell reading order number SEQ (k) with the center coordinates (Xi, Yj) of the cell. The composite code generation means CGM of the management server MS1 that generates the composite code or the composite code generation means CG2 of the content server CS2 reads the cell reading order number SEQ (k) in which the second code is set and the center coordinates of the cell (Xi, Yj) may be stored in association with each other and delivered to the user devices UD1 and UD2 that read the composite code.

  Further, for example, a serial number ID (n) serving as a reference is assigned to all cells based on a predetermined standard, and a serial number ID (n) that is identification information assigned to all cells and a second code are set. It can be managed as a relationship with the number SEQ (k) in the cell reading order. The composite code generation means CGM of the management server MS1 that generates the composite code or the composite code generation means CG of the content server CS2 associates the number SEQ (k) in the cell reading order with the serial number ID (n) for each cell. Then, it may be stored and handed over to the user devices UD1 and UD2 that read the composite code. In this case, it is assumed that the relationship between the serial number ID (n) for each cell and the center coordinates (Xi, Yj) of each cell is determined in advance by a rule.

  Hereinafter, the cell reading order number SEQ (k) is also referred to as a specific cell index. Also, the relationship between the reading sequence number SEQ (k) in which the second code is set and the center coordinates (Xi, Yj) of the cell, or the serial number ID (identification information given to all the cells) The relationship between n) and the reading sequence number SEQ (k) of the second code is called cell reading order information.

  FIG. 37 illustrates the configuration of the information system according to the second embodiment. As shown in the figure, in this information system, a management server MS3, a content server CS3, and a user device UD3 are connected by a network network N1. The management server MS3 has composite code generation means CGM and specific cell index setting means CIGM. When generating the composite code, the composite code generation unit CGM generates cell reading order information by the specific cell index setting unit CIGM and stores it in the cell reading order information file CIM.

  In addition, the content server CS3 includes specific cell index setting means CIGS. When the content server CS3 generates the composite code, the specific cell index setting unit CIGS generates cell reading order information and stores it in the cell reading order information file CIS. Although omitted in FIG. 37, the information system may include the content server CS1 of the first embodiment. Instead of generating the composite code itself, the content server CS1 requests the management server MS3 to generate the composite code. Accordingly, the cell reading order information corresponding to the generated composite code is stored in the cell reading order information file CIM of the management server MS3. Note that the communication unit CMS3 and the composite code output unit COUT3 are the same as the communication unit CMS2 and the composite code output unit COUT2 of the first embodiment, and thus description thereof is omitted.

  For example, the user device UD3 acquires and holds cell order read information from the management server MS3 or the content server CS3 via the network N1. The composite code analysis means CA3 of the user device UD3 restores the digital data from the second code by integrating the numerical values based on the dot pattern set in each cell according to the cell order reading information. Note that the image input unit IIN3 and the communication unit CMU3 are the same as the image input units IIN1, IIN2, the communication unit CMU1 and the like of the first embodiment, and thus description thereof is omitted.

  FIG. 38 is a flowchart illustrating the composite code generation process B by the content server CS3 or the management server MS3. This process is different from FIG. 32 in that the content server CS3 stores the cell reading order information in the process of S14A. Since other procedures are the same as those in the first embodiment, the description thereof is omitted. It can be said that the content server CS3 that executes the processing from S12 to S15 has second generation means for generating the second code.

  FIG. 39 is a flowchart illustrating the composite code reading process B by the user device UD. In this process, the user apparatus UD3 is different from FIG. 35 in that the processes of S25A and S26A are executed. That is, the user apparatus UD3 refers to the cell reading order information from the cell reading order information file CIU (S25A). Then, the user device UD3 integrates the numerical values specified by the dot pattern in each cell according to the cell reading order information, and restores the digital data by the second code (S26A). The user apparatus UD3 requests the content server CS3 or the management server MS3 to generate cell reading order information instead of referring to the cell reading order information from the cell reading order information file CIU, and generates the generated cell reading order. Information may be referred to. It can be said that the user device UD that executes the processes of S22, S23, S25A, and S26A has a second acquisition unit. Moreover, it can be said that user apparatus UD3 which performs the process of S25A has a means to acquire a specific cell index from the server which produces | generates the specific cell index which orders a specific cell, or the server which stores a specific cell index. Further, the content server CS3 or the management server MS3 can be said to be an example of a server that generates a specific cell index that orders specific cells or a server that stores a specific cell index.

  Note that the user apparatus UD3 may acquire the cell reading order information from the management server MS3 when executing the process of S26A, or may execute the process from the management server MS3 in advance before executing the composite code reading process of FIG. Cell reading order information may be acquired and stored in the cell reading order information file CIU.

  As described above, in the second embodiment, the content server CS3 or the management server MS3 that generates the composite code uses the cell reading order number SEQ (k) that is the specific cell index and the cell center coordinates (Xi, Yj). ) Or the relationship between the cell reading order number SEQ (k) and the serial number ID (n) for each cell is stored in the cell reading order information files CIS, CIM, and the like. Cell reading order information stored in the cell reading order information file CIS, CIM, etc. is delivered to the user device UD3, is referred to when decoding the composite code, and numerical values for each cell set in the dot pattern format are integrated, The second code is restored to the original digital data. Therefore, according to the information system of the second embodiment, the dot pattern forming the second code can be set in each cell in the reading order independent of the reading order of the first code, for example, the QR code, and can be restored.

Such a reading order may be determined by a rule in advance, for example, information specifying a reading order rule in the format information exemplified in FIG. 1 or the data (text) of the first code. May be embedded. With such a configuration, the second code can be set in various modes.
[Embodiment 3]

  In the first and second embodiments, in parallel with the reading of the first code cell, the presence or absence of a dot pattern in each cell is determined, and the second code is decoded. However, only the decoding of the first code may be performed first, and then each cell may be scanned for the second time to restore the digital data from the second code.

  In the second embodiment, the process when the cell reading order of the first code and the cell reading order of the second code are different is illustrated. However, for example, when the first code is a QR code, the reading order of the data and the error correction code illustrated in FIG. 1 and the reading order of the cell in which the second code is encoded with a dot pattern are assumed. Even in the same case, when the dot pattern (or line segment pattern, etc.) of the second code is set in the format area, the finder pattern, the timing pattern, the quiet zone exemplified in FIG. The reading order of the codes is different from the reading order of the cells of the first code. Therefore, depending on the cell in which the dot pattern (or line segment pattern, etc.) forming the second code is set, the presence or absence of the dot pattern in each cell cannot be determined in parallel with the reading of the first code cell. In some cases.

  Therefore, the third embodiment exemplifies a process of scanning a cell in an image of a composite code again according to the above rule after scanning of a cell for analyzing the first code is completed in the analysis of the composite code. Other configurations and processes of the third embodiment are the same as those of the first embodiment except for the reading order of the cell in which the second code is embedded in the analysis of the composite code.

  Among the constituent elements of the third embodiment, the same constituent elements as those of the first and second embodiments are omitted because the constituent elements of the first and second embodiments are applied to the third embodiment. Further, the constituent elements of the first and second embodiments are cited as necessary.

  In the second embodiment, the reading order of the second code is different from the reading order of the cells of the first code, the cell reading order number SEQ (k) and the cell center coordinates (Xi, Yj). Or the relationship between the cell reading order number SEQ (k) and the serial number ID (n) for each cell is stored in the cell reading order information files CIS, CIM, etc., and can be referred to at the time of decoding. In this embodiment, as in the second embodiment, the cell reading order information may be referred to from the reading-side user device UD3 or the like, and the cell reading order information is not transferred to the reading-side user device UD3 or the like. May be.

  For example, in the information system of FIG. 32, when generating a composite code, the order of the cells to which the divided bit string is allocated in the process of dividing the binary-encoded bit string into data for each cell (S14 in FIG. 32) is specified. It shall be determined according to the rules. Then, when analyzing the decoded code, the cell numerical values set with the dot pattern forming the second code may be integrated according to the same rule. Therefore, even if the reading order of the second code is different from the reading order of the cells of the first code, the cell reading order information is not necessarily required.

  FIG. 40 is a flowchart illustrating the complex code reading process according to the third embodiment. The processing of FIG. 40 is different in S20C and S21C compared to FIG. 39 of the second embodiment. That is, for example, the user apparatus UD3 first analyzes all the cells of the first code (S20C). Hereinafter, the process of FIG. 40 will be described as being executed by the user apparatus UD3, but the management server MS3 to which the composite code is delivered from the user apparatus UD3 may execute the following process.

  The user device UD3 or the like (hereinafter simply referred to as the user device UD) inputs an image of a composite code input from a scanner or a camera or the like via the image input interface 17, and formats and arranges the cells of the first code. recognize. For example, the user apparatus UD recognizes the direction of the QR code using the finder pattern, and corrects image distortion using the alignment pattern. Further, the user apparatus UD recognizes the cell arrangement interval based on the timing pattern, and specifies the arrangement position of the QR code data and the error correction code. And a user apparatus determines the brightness of all the cells according to the reading order of a general QR code, for example.

  Next, the user apparatus UD scans all the cells of the composite code again in a predetermined order. For example, from the lower right cell, the first column is scanned upward, then the second column is scanned downward, and similarly, the odd column is scanned upward, and the even column is scanned. May be scanned downward. However, the scanning order is not limited in the third embodiment. For example, the odd-numbered rows may be scanned rightward and the even-numbered rows may be scanned leftward from the upper left cell. In all the cells, the finder pattern, alignment pattern, timing pattern, format, data, and error correction code are all scanned. Then, the user device UD acquires an image of the next cell (S21C). This processing is the same as in the first and second embodiments except that the processing target includes a finder pattern, an alignment pattern, a timing pattern, a format, and the like.

  Next, the user apparatus UD determines whether or not the second code is defined in the cell being processed (S22). This process is the same as in the first and second embodiments except that the determination target includes a finder pattern, an alignment pattern, a timing pattern, a format, and the like. If the second code is defined in the cell, the second code in the cell is analyzed (S23). This process is also the same as in the first and second embodiments except that the analysis target includes a finder pattern, an alignment pattern, a timing pattern, a format, and the like.

  Then, the user apparatus UD determines whether or not the next cell remains unprocessed (S24). When the next cell is unprocessed, the user apparatus UD returns the process to S21. This process is also the same as in the first and second embodiments except that the determination target includes a finder pattern, an alignment pattern, a timing pattern, a format, and the like.

  When the processing of all the cells is completed and there is no next cell, the user apparatus UD generates information that integrates the first code for each character from the bit string obtained by the light / dark determination of the first code. (S25). This process is the same as in the first and second embodiments. However, the process of S25 may be executed in the process of S20C.

  Then, the user apparatus UD refers to the cell reading order information from the cell reading order information file CIU (S25A). Then, the user apparatus UD integrates the numerical values specified by the dot pattern in each cell according to the cell reading order information, and restores the digital data by the second code (S26A). The processes in S25A and S26A are the same as those in the first and second embodiments except that the processing target includes a finder pattern, an alignment pattern, a timing pattern, a format, and the like. Since the subsequent processing is the same as in the first and second embodiments, the description thereof is omitted. It can be said that the user device UD that executes the processes of S22, S23, S25A, and S26A has a second acquisition unit.

  As described above, the order of the cells to which the bit string divided in the process of dividing the binary coded bit string into data for each cell (S14 in FIG. 34) is determined according to a specific rule. In this case, the process of S25A is not necessary. That is, the user apparatus UD may restore the digital data based on the second code by integrating the numerical values specified by the dot pattern in each cell according to the rule.

As described above, according to the third embodiment, the user device UD3, the management server MS3, and the like have the second code set in the reading order different from the first code, for example, the QR code cell reading order. The dot pattern forming the second code can be read from the cell and the composite code can be decoded. Therefore, even when a dot pattern is formed in a finder pattern, alignment pattern, timing pattern, format, etc., decoding is possible.
[Embodiment 4]

  In the first to third embodiments, the second code is statically arranged with respect to the arrangement of the cells of the first code, and the composite code that does not change with time is exemplified. The fourth embodiment exemplifies a composite code in which the second code is time-varying with respect to the cell arrangement of the first code. Such a composite code can be displayed on a display of an information device, for example. For example, the information device may display a combination of a first code fixed for each frame and a different second code on the display. Different second codes may be output for each frame, or the same code may be output continuously for a plurality of frames. The second code may be any of those exemplified in FIGS.

  In addition, by changing the display period to be displayed with the same second code, information may be defined in the same procedure as pulse width modulation. For example, in the dot pattern in which information is defined by the distance and direction from the virtual point illustrated in FIG. 12, the amount of information defined is 3 bits. However, information of about 60 bits / second can be transmitted in one cell by turning a dot pattern fixed at 3 bits on and off for each frame in the time axis direction. In this case, for example, a predetermined pattern (a finder pattern, an alignment pattern, etc. in FIG. 1) of the first code, for example, a QR code is also turned ON and OFF to form a synchronization pattern for synchronizing frames. May be. The reading device may acquire the dot pattern, which is the second code, for each frame in accordance with the frame synchronization by the first code.

  Furthermore, the section in which one second code is displayed is one to several frames, so that it is difficult to be visually recognized by human eyes. Therefore, the composite code can be acquired from the display of the information device by an image forming apparatus such as a camera or a scanner of another information device while being hardly recognized by human eyes.

  If the light and dark pattern continues for a plurality of frames in the time change of the second code, the image input means (image input means IIN1, IIN2 of the first embodiment, image input means IIN3 of the third embodiment, etc.) By accumulating data for a plurality of frames, the second code can be input without a synchronization pattern. Further, the second code itself has, for example, a light / dark pattern sequence indicating the start of a signal and a light / dark pattern sequence indicating the end of the signal, so that a synchronization pattern is not formed in a predetermined region of the QR code. Also good.

Here, a case where the composite code is displayed on the display of the information device will be described.
Since the QR code, which is an example of the first code, is premised on being visible, it is continuously displayed on the display for an arbitrary time. On the other hand, the second code is displayed only about 1 to 2 frames per 10 to 30 frames at 30 frames / second when the image is displayed on the display, and about 1 to 4 frames per 20 to 60 frames at 60 frames / second. This makes it difficult for the viewer to visually recognize the second code. Furthermore, if you want to make it difficult to see, use a pixel color that makes it difficult for the dots to be visually recognized within the range where the pixel colors of the dots can be recognized with respect to the pixel colors of two or more identifiable cells used in the cell. That's fine.
[Other variations]

In the first to fourth embodiments, the first code and the second code are defined by the light color region, the dark color, and the region. Then, the content servers CS1, CS2, CS32, etc., which are generation devices, output the composite code, and the user devices UD1, UD2, UD3, etc., which are reading devices, restore the digital data from the composite code and execute predetermined processing. Here, the dark color region is, for example, a black region, and the light color region is a white region. However, the composite code is not limited to one formed by a light color region and a dark color. For example, any one of R (red), G (green), B (blue), C (cyan), M (magenta), Y (yellow), B (black), and W (white) is selected as the first color. May be used for the cell colors of the second and second codes. As color code information, any of R (red), G (green), B (blue), C (cyan), M (magenta), Y (yellow), B (black), and W (white) is a cell. And the first code and the second code may be defined. At this time, the cell forming the first code and the mark forming the second code can be identified by a combination of different colors that can be selected. Further, the presence of the second code can be recognized depending on whether or not there is a mark to be formed on the second code. There may be a case where the color of the cell of the first code where the mark is not arranged and the mark of the second code select the same color. Of course, the mark must use a color in a range that can be distinguished from the color of the cell of the second code. Further, the color of the mark can be used as color code information within a range that can be distinguished from the cell color of the second code. When the first code of the composite code is a QR code, the colors of the cells of the first code and the second code are limited to colors that the conventional QR code reader can read the first code. The code mark colors are 8 colors: R (red), G (green), B (blue), C (cyan), M (magenta), Y (yellow), B (black), and W (white) Also good. By using eight types of colors that can be acquired at the mark arrangement position, 3 bits can be defined at one mark arrangement position, and the information amount of the second code can be increased three times. Note that the color of the print medium and the color of any of the cells in which the first or second code marks are formed may be the same. Furthermore, the color of the cell of the first code in which no mark is formed may be the same as the color of any of the aforementioned marks. In this case, the color information of the mark may be 00 in 2 bits for 4 colors and 000 in 3 bits for 8 colors. Needless to say, the number of colors can be increased and the color code information can be increased by the performance of the composite QR code reader. For example, if an encoded modulation technique in image identification is used, an information amount about twice that can be realized, and a six times information amount can be defined by using a color mark.

  In the first to fourth embodiments, the QR code is exemplified as the first code. However, in the first to fourth embodiments, the first code is not limited to the QR code. For example, a two-dimensional code including a color code, DataMatrix, and PDF417 can be used as the first code.

[Embodiment 5]
In the first to third embodiments, the composite code in which the second code is combined with the cell arrangement of the first code is exemplified. In the fourth embodiment, the time-series composite code in which the second code changes with time with respect to the cell arrangement of the first code is exemplified. In the present embodiment, a modification of the second code and a modification of the second code reading method are illustrated. Needless to say, the decryption code described in the fifth embodiment can be applied to the first to fourth embodiments. Needless to say, the method for reading a decoded code described in the fourth embodiment can be applied to the first to fourth embodiments.

(Composite QR code printing characteristics and reading method)
Examples using dots as marks are shown below. Of course, the mark may have any shape such as a substantially circular shape, a rectangular shape, a cross shape, or a polygonal shape. Needless to say, the dots shown below may be replaced with other marks.
FIG. 41 illustrates the relationship between dark cells and pixels printed on a medium such as a paper surface in the fifth embodiment. FIG. 42 shows an example in which light dots are formed in 4 × 4 pixel dark cells. FIG. 43 shows an example in which dark dots are formed in 4 × 4 pixel light cells. The size of the dark cell of the QR code to be printed is usually 0.17 mm to 0.5 mm, and it is recommended that one cell is printed with 4 × 4 pixels or more as shown in FIG. Note that the shape of one pixel may be either rectangular or circular. The minimum 0.17 mm is 4 × 25.4 mm / 600≈0.17 mm when printed at a general printing resolution of 600 dpi. On the other hand, the dot size in the dot code is a pixel size of 600 dpi on the data, that is, 25.4 mm / 600≈0.042 mm. There are many cases where the dot size becomes about 0.05 mm due to swelling due to dot gain, ink expansion, penetration, or the like. On the contrary, there is a case where the ink is poorly fixed and the dot size is about 0.04 mm (but never less than 0.03 mm). When dots are formed in dark cells, the light dots may be about 0.03 mm due to the expansion of the surrounding dark print portion. Here, when a dot code is formed in a dark cell that prints a minimum cell size (for example, 0.17 mm) with a minimum number of pixels (4 × 4), any of the four pixels at the center of the dark cell as shown in FIG. By printing this, four types of dot patterns can be formed. That is, a 2-bit dot code can be defined for one cell. Only the central four are targeted when the cell is adjacent to a cell of the same color as the dot.If the cell outline accuracy is poor, it becomes difficult to recognize the dot. This is because it is desirable to eliminate this.

  There are a plurality of methods for reading the dot code. To read the dot code, the image obtained by capturing the composite code is stored in the frame buffer, the dot is recognized in the frame buffer coordinate system and its center position (coordinate value) is obtained, or the dot is placed at the dot placement candidate position. This is done by recognizing whether or not the information is defined and acquiring information defined by the dot arrangement pattern. There are two typical methods as follows.

(Method 1)
Method 1 is a method for recognizing the center point of a dot. That is, in Method 1, dots are extracted from the captured image, the center coordinate value of the dots is obtained, and the dot arrangement pattern is obtained. In this case, in order to detect dots around the dots from the brightness of the pixels that form the dots when imaged, using the change rate of brightness as a threshold, the dots are in contact with other dots or cells of the same color. It is difficult to recognize. Therefore, it is desirable to dispose the dots at a predetermined distance from the end portions of the adjacent dots so that both dots can be recognized.

By the way, in the captured image, it is desirable to use the above-described change rate of light and dark as a threshold value in order to extract dots because light shines on the QR code from the side or shadows or shadows occur. In order to obtain the rate of change, at least 4 pixels or more are necessary from end to end of adjacent dots, and it is necessary to shoot with a camera having a certain resolution. On the other hand, the brightness of cells of the same color in the QR code may vary greatly depending on the position of the cell, but there is almost no change in each cell. Therefore, in the bright cells, an average value B _LA of the lightness of several pixels from the lighter of pixels of the captured the cell, at the same time, the average value B _DA brightness of several pixels from the side dark pixels Ask. If ΔB _L = B _LA −B _DA is within a predetermined range, it is found that there is no dot in the cell, and if it exceeds the predetermined range, a dot is present. In this case, the threshold for determining the dot is calculated as α × B _DA or less or B _DA + β × ΔB _L or less. In the dark cell, the same processing is performed, and the threshold value for determining the dot is calculated as α × B _LA or more or B _DA + β × ΔB _L or more. Α and β are determined by B _LA , B _DA , ΔB _L , camera performance, captured image characteristics, and the like.

(Method 2)
Method 2 is a method of obtaining an overlapping portion between a dot obtained from an image and a predetermined area (dot arrangement candidate area) or a predetermined position (dot arrangement candidate position) where a dot to be recognized is formed. The method 2 can be simply described as a method of determining whether a dot exists in a predetermined region or a predetermined position. In the case of method 2, it is not necessary to obtain the dot center coordinate value. Whether or not there is a dot is important to be able to accurately recognize the dot arrangement candidate region or the arrangement candidate position. If the printing accuracy is good and the resolution of the composite QR code reader is high, the decoded code reader can accurately recognize the center coordinate value of the cell and the area of the cell. In such a case, whether or not the center position of the dot is included in a predetermined area centered on the candidate dot placement position (XnS1, YnS1) in advance, called a bounding box, or a dot having a certain area in the area The dot arrangement position is determined based on whether or not the predetermined range is included. Alternatively, it may be recognized by whether or not a part of dots having a certain area is superimposed on the dot candidate arrangement positions (XnS1, YnS1). Note that when the medium on which the composite QR code is formed does not form a flat surface, or when the reading device shoots the medium from an oblique direction, the center coordinate value of the cell may shift. In such a case, it is desirable to correct the obtained center coordinate value of the cell to the correct cell center coordinate value by a predetermined method. This method 2 enables recognition with higher accuracy than before even in a composite code in which extended cells subdivided into a matrix by fine subcells form the second code. The maximum condition at this time is that the arrangement position of each cell is such that an image obtained by imaging the composite code is stored in the frame buffer and can be recognized with an accurate coordinate value in the coordinate system. In order to obtain an accurate coordinate value, a reference mark serving as a reference is provided, the reference mark is provided independently without being connected to a subcell, the reference mark is extracted, and a center coordinate value is obtained. As a result, the subcell arrangement position can be recognized based on the relationship between the reference mark and the subcell arrangement position.

  FIG. 44 is a diagram illustrating a dot position determination method using a bounding box. As shown in FIG. 44, the reading device draws a straight line from the cell center position toward the corner of the cell, and extracts pixels of dots that overlap the straight line. Note that the center position (coordinate value) of the cell can be generally obtained by reading the first code, but if it is obtained with a coordinate value of a coordinate system different from the coordinate system of the frame buffer, the captured image Needs to be converted into the coordinate value of the coordinate system of the frame buffer in which is stored. Then, the reading device has a center of an area on a straight line that overlaps with a dot (area consisting of a row of pixels that overlaps with a straight line) within a predetermined area centered on a dot candidate arrangement position (XnS1, YnS1) in advance ( It may be determined whether the coordinate value is included in the bounding box. The bounding box is preferably a circle with a diameter of around 25% (for example, about 20% to 30%) of the cell size, which is about the same as the dot size, but it may be a rectangle or other shapes, and the size may be misidentified. The level may be determined as appropriate based on error correction level, printing accuracy, and imaging resolution. In the case where dots are missing, there are cases where overlapping areas are missing in the middle or ink skipping, and it is desirable to determine them. For example, it is assumed that a region composed of a row of pixels overlapping a straight line is separated into a plurality of regions. In such a case, the reading device may regard the maximum area as a dot area. Further, when the distance between the plurality of separated areas is within a predetermined value, the reading apparatus may integrate the plurality of separated areas as one continuous area.

  The dot coordinate value is calculated using the formula XnS1 = (XnS1-2-XnS1-1) / from the overlap position start point (XnS1-1, YnS1-1) and end point coordinate value (XnS1-2, YnS1-2) 2, YnS1 = (YnS1-2−YnS1-1) / 2 is obtained as (XnS1, YnS1). As a result, in the example of FIG. 44, when dots are detected using two diagonal lines in a cell, the arrangement position of four dots can be set and recognized on one diagonal line. By arranging two diagonal lines, a total of eight dots can be set, and eight patterns, that is, 3 bits can be defined.

These eight ways are cases where only one of the eight dot placement candidate positions is placed, and the threshold for determining whether or not it is a dot is the light / dark change rate described above, etc. _{Alternatively} , α × B _DA or α × B _DLA or B _DA + β × ΔB _L may be used. If the cell position can be recognized with a certain degree of accuracy, the bounding box is set to a size slightly smaller than the size of the cell, and if dots are extracted within the bounding box, the dots are connected and the influence of adjacent cells of the same color Not receive.

  If dot codes are formed in dark and light cells in the QR code data area, the dot recognition method shown in FIG. 44 is used even if an area similar to the QR code is used for dot code error correction. In a dot code that can define 3 bits per cell, data that is three times the QR code can be stored in the composite QR code. Even if a dot code is formed only in a light color cell in the data area, an information amount about 1.5 times can be stored. A dot code can also be formed in a cell for forming a finder pattern (cutout symbol), alignment pattern, quiet zone, timing pattern, and format information, and an information amount about twice that of a QR code can be stored. Furthermore, if dot codes are formed in all bright and dark cells other than the data area, information that is four times as large as the QR code can be stored. It should be noted that the difference in the arrangement of these dots can be recognized without any problem even with current smartphone cameras with low resolution. In this embodiment, it is assumed that the printable area is 4 × 4. However, if the cell size is increased, the dot arrangement pattern can be further increased. However, in that case, it is desirable to capture and analyze with a high-resolution camera. If a dedicated QR code with a high imaging resolution is used, the amount of information that can be easily acquired can be increased.

  FIG. 45 shows an embodiment in which one cell is printed at 5 × 5 pixels at 600 dpi and the cell size is 5 × 25.4 mm / 600≈0.21 mm in order to further increase the information amount of the dot code. The four locations indicated by the nets indicate dot formation positions. Depending on whether or not dots are formed at these four locations, 4 bits can be defined for one cell.

  FIG. 45 shows an example in which one cell is printed at 600 dpi and the cells are printed at 5 × 5 pixels, and FIG. 46 shows an example in which the cells are printed at 7 × 7 pixels. When a cell is printed with 7 × 7 pixels, the cell size is 7 × 25.4 mm / 600≈0.30 mm. The portions indicated by halftone dots (4 locations of 5 × 5 pixels and 9 locations of 7 × 7 pixels) indicate dot formation positions.

When a cell is printed at 7 × 7 pixels, a dot may always be formed in one central pixel, and this may be used as an indicator that a dot code is formed in the cell. In that case, 8 bits are defined in one cell. When any one pixel is formed, there are 8 ways to place the 8 dots (9 including the case where a dot is formed in the center), and 3 bits per cell. Defined. As a method for recognizing the dot code, the reading device sets a bounding box for the area where the dot is arranged based on the center position of the cell, and determines whether or not the dot is arranged in the bounding box. What is necessary is just to recognize the arrangement of dots. In FIG. 45, the size of the bounding box is about 20% (about 15 to 30%) of the cell size, which is about the same as the dot size, and in FIG. 46, about 14% (about 10% to 20%) of the cell size. Preferably, it is a circle or rectangle having a diameter or side. As a specific method for recognizing dots, the reading device has a predetermined ratio of dark or light colors recognized in the bounding box (for example, 50% considering the deviation of the center position of the cell and the printing accuracy). ) May be determined that dots are arranged. Further, the reading device may obtain the center coordinate value of the dot and determine the dot in the bounding box at the position closest to the coordinate value of the dot originally arranged in the cell. Note that the threshold for determining whether or not a dot is used may be the above-described rate of change in brightness or the like, α × B _DA, α × B _LA, or B _DA + β × ΔB _L.

  Needless to say, a similar dot code can be defined for a dark cell by a light dot. In this embodiment, even if dots are arranged in all four pixels in the 5 × 5 pixel cell of FIG. 45, the exclusive area of the dots is only 4 / (5 × 5) = 16%, and the dot size Even if swells, it is about 1.1 times (about 18% increase). In addition, even if dots are arranged in all nine cells in the 7 × 7 pixel cell of FIG. 46, the exclusive area of the dots is only 9 / (7 × 7) = 18%, and even if the dot size expands, it is 1.1 times Is about 20%. Therefore, the presence of the dot code does not affect the recognition of the cells constituting the QR code (can be properly recognized if the mixture of other colors is 1/3 or less). Furthermore, in order to increase the amount of information of the dot code, the number of pixels constituting the cell may be increased to increase the positions where the dots are arranged, and the print resolution may be increased to increase the positions where the dots are arranged. In this case, the dot size may be reduced if the imaging resolution of the composite code reader is sufficiently high. As a result, a large number of dot arrangement positions can be set, and the amount of dot code information can be increased. Note that dot codes can be formed in cells for forming finder patterns (cutout symbols), alignment patterns, quiet zones, timing patterns, and format information, and the amount of information can be further increased.

  As described above, the composite QR code in which the dot code is formed in the QR code cell can increase the amount of information embedded in the same area as the conventional technique, and can suppress the influence on the recognition of the original QR code. is there. The conventional technology increases the amount of information by dividing one cell, and it becomes difficult to recognize when the divided cells are adjacent to each other in the same color, and printing and imaging are performed at an extremely high resolution. Is a prerequisite and lacks versatility. Compared to this conventional technology, this technology makes it easy to recognize dots whose surroundings are opposite colors (dark and light colors) even with a low-resolution camera. It is a great feature that more information can be added to the prior art while securing the above. From the above, although only 1-bit information can be defined in one cell forming a commonly used QR code, a dot code formed in one light cell and / or dark cell is used in a composite QR code. Thus, at least about 2 bits to 8 bits can be defined for one cell. Furthermore, by using a color code described below, a camera mounted on a mobile terminal such as a current smartphone can receive information about 6 to 10 times the QR code using a composite QR code (dot code recorded in the composite QR code). ).

  Due to a significant increase in the amount of information recorded in the dot code, not only text information but also audio information and image information can be stored. In addition, the information recorded in the composite QR code can be acquired by taking a picture with a camera and reading it with a dedicated application without using a communication such as a telephone line, the Internet, or wireless communication. As a result, it is possible to avoid hacking by a third party during the transmission of information, and the recording medium becomes extremely high in security. Therefore, the exchange of information using the composite QR code is more effective for protecting personal information, confidential information, and the like than conventional communication. Furthermore, information exchange using a composite QR code can be provided to a party who wants to pass information without passing the information provider's own e-mail address or personal information of SNS.

(How to read dot code in composite QR code)
With the camera of a portable terminal such as a smartphone most frequently used for QR code reading, the lowest resolution is VGA (640 × 480), but it is very small at present. Since the camera of the mobile terminal becomes higher in resolution year after year, the problem caused by VGA can be ignored. When reading a composite QR code, it is desirable to image one dot with 2 × 2 pixels or more in order to recognize that it is a dot code more reliably from the captured image. Then, it is possible to cope with a shift of 1 pixel in the left, right, top and bottom of the imaged dots. Currently, the resolution of cameras such as smartphones that have become widespread is increasing year by year, and exceeds at least 1920 × 1080 to 2048 × 1536 (3 million pixels). Therefore, in the present embodiment, it is assumed that a relatively low-resolution 1920 × 1080 pixel smartphone is assumed, and that a margin of about 20% is further provided. Under this assumption, since the photographing range is 864 × 864 pixels, the composite QR code of the present embodiment can be read with sufficient accuracy. 42 and 43, if one cell is imaged with 8 pixels, the number of cells that can be read is 864/8 = 108, version 22, 105 × 105 cells, (Kanji 488 at error correction level M) (Up to 1.558KB can be stored for characters, 0.779KB and dot code), and about 1.5 to 2 times the QR code can be stored in the dot code. When printed, 105 x 8 x 25.4 / 600mm ≒ Can read up to 35.56. Furthermore, Japanese text is not compressed in the QR code standard. Currently, Japanese text compression data technology can store 3 times the number of characters of QR code. As a result, 488 characters × 2 (dot code information amount increase) × 3 times (Japanese text compression) = 2,928 characters can be stored. If the reading method as shown in FIG. 44 is implemented, a maximum of 2.337 KB can be stored in the dot code, and about 2 to 3 times the QR code can be stored. Furthermore, 4,392 characters can be stored using Japanese text compression data technology. In the decoded QR code of FIG. 45, if one cell is imaged with 10 × 10 pixels, 864/10 = 86, version 17, 85 × 85 cells (310 characters in error correction level M, 0.504KB, dot code Can store up to 2.016KB), can store about 3-4 times the QR code in the dot code, and when printed, it has a rectangular area of 85 × 10 × 25.4 / 600mm ≒ 35.98mm on one side Can be read. In addition, 3,720 characters can be stored using Japanese text compression data technology. In the decoded QR code of FIG. 46, if one cell is imaged with 14 × 14 pixels, 864 / 14≈61 is obtained, and version 11, 61 × 61 cells (error correction level M at 155 characters, 0.251KB, dot code) Can store up to 2.008KB), and the dot code can store 6 to 8 times the amount of information in the QR code. When printed, 61 × 14 × 25.4 / 600mm ≒ 36.15mm Even a rectangular area can be read. In addition, 3,720 characters can be stored using Japanese text compression data technology. In the above, error correction of QR code is set to level M. However, level M is an error correction level that is generally used. Naturally, if error correction level L is set, more information is represented by dot code. Needless to say, it can be stored in

Currently, the market penetration rate of display display of smartphones (2017) is 375 x 667 pixels 34.93%, 320 x 568 18.85%, 360 x 640 13.07%, about 2/3 in total. It is a low resolution display. Therefore, even if a 10% margin is provided in the display area, it is necessary to display the hybrid QR code in the 288 × 288 area. 1) Similar to the printing of the dot code, in the display of the decoded QR code in FIGS. 42 to 44, one cell is displayed by 4 pixels. Therefore, the number of cells that can be displayed is 288/4 = 72, version 13, 69 × 69 cells (204 characters in error correction level M, 0.331 KB, dot code can store up to 0.662 KB), and QR code Can store about 1.5 to 2 times. Furthermore, 1,224 characters can be stored using Japanese text compression data technology. If the reading method as shown in FIG. 44 is implemented, a maximum of 0.993 KB can be stored in the dot code, and about 2 to 3 times the QR code can be stored. Furthermore, 1,836 characters can be stored using Japanese text compression data technology. In the decoded QR code of FIG. 45, if one cell is displayed at 5 × 5 pixels, it becomes 288 / 5≈57, version 10, 57 × 57 cells (error correction level M is 131 characters, 0.213 KB, dot code) Can store up to 0.852KB), and can store about 3 to 4 times the QR code. In the dot code of FIG. 46, if one cell is displayed at 7 × 7 pixels, it becomes 288 / 7≈41, version 6, 41 × 41 cells (65 Kanji characters at error correction level M, 0.106 KB, dot code It can store up to 0.848KB) and can store about 6 to 8 times the QR code. In addition, 1,560 characters can be stored using Japanese text compression data technology. However, this is not sufficient to store content information such as Japanese text, audio, and photos. However, when displaying a hybrid QR code on a smartphone, a large-capacity hybrid QR code can be easily realized because it can be implemented using a time-series dot code that changes the dot code, which will be described later, or a color dot code that is colored dot display. it can.
On the other hand, it is clear that smartphones capable of displaying 1080 × 1920 which is full high-definition will become widespread, and it will be possible to display a composite QR code that further increases the amount of information of the dot code. Assuming that the area for displaying the composite QR code is 800 × 800 pixels, one cell is displayed with 4 pixels in the display of the decoded QR code in FIGS. 41, 42, and 43. The number of cells that can be displayed is 800/4 = 200, version 40, 177 x 177 cells (error correction level M, 1,435 characters, 2.331 KB, dot code can store up to 4.661 KB), that is, all QR code standards Can be displayed and can store about 1.5 to 2 times the QR code. The Japanese text compression data technology can store 8,610 characters. If a reading method as shown in FIG. 44 is implemented, a maximum of 6993 KB can be stored in the dot code, and about 2 to 3 times the QR code can be stored. Furthermore, 12,915 characters can be stored using Japanese text compression data technology. In the decoded QR code of FIG. 45, if one cell is displayed with 5 × 5 pixels, it becomes 800/5 = 160, version 35, 157 × 157 cells (Kanji 1,113 characters, 1.809KB, dot code with error correction level M) Can store a maximum of 5.427 KB), and can store 3 to 4 times the QR code. Furthermore, 1,836 characters can be stored using Japanese text compression data technology. In the dot code of FIG. 46, if one cell is displayed at 7 × 7 pixels, it becomes 800 / 7≈114, and version 24, 113 × 113 cells (Kanji 561 characters with error correction level M, 0.991KB, dot code It can store up to 7.929KB) and can store about 6 to 8 times the QR code. Furthermore, 13,464 characters can be stored using Japanese text compression data technology. When reading this large-capacity composite QR code, it is desirable to use a dedicated composite QR code reader that can capture and analyze at a high resolution if it is difficult to read at some current smartphone resolutions. In the above, error correction of QR code is set to level M. However, level M is an error correction level that is generally used. Naturally, if error correction level L is set, more information is represented by dot code. Needless to say, it can be stored in
When displaying a composite QR code on a smartphone, a large amount of information can be generated by displaying a plurality of different dot codes for a predetermined time. When reading a blinking dot code with a hybrid QR code reader, it can be processed at high speed by reading the QR code only once and then reading only the dot code. The camera shake at the time of shooting can accurately read the dot code by tracking the change in the imaging position of the timing pattern and alignment pattern and correcting the detected dot position each time. When the hybrid QR code is displayed on the smartphone as in (5), the amount of information that can be stored in the dot code is about 0.85K, but the dot code is changed about 12 times in 1 to 3 seconds. The amount of information about 20KB can be acquired. If this is reproduced with photo data, it can be viewed as a sufficiently high quality image when displayed on a smartphone, and text information exceeding 70,000 characters can be transmitted.

  The error correction code employed in the QR code is a Reed-Solomon code which is a kind of block code, but the error correction code employed in the dot code may be a convolutional code.

  Unlike convolutional codes, convolutional codes have no data delimiters, and one piece of data is distributed around the data, and the information is used for decoding by a statistical method. Therefore, error correction performance is high and constraint length is high. If it is small, it can be processed at high speed.

  However, error correction codes can be decoded using various error correction codes and secondary information (luminance information, time series and surrounding error information, etc.) to estimate errors, depending on the information capacity and error rate of the dot code. Methods (including soft decision decoding) can be applied. Of course, it goes without saying that other error correction codes suitable for dot codes may be used.

[Embodiment 6]
The authenticity determination method, the information processing apparatus for authenticity determination, and the computer program for authenticity determination according to the fifth embodiment will be described below with reference to FIGS. In the first to fourth embodiments, the configuration of the composite code, the generation method, the reading method, the apparatus for executing these methods, and the program for causing the computer to execute these methods have been described. In the present embodiment, a method applied to authenticity determination of digital information (or digital information tampering detection) using a composite code, an apparatus for executing the method, and a program for causing a computer to execute these methods will be described.

<Judgment procedure of offline complex QR code authentication system>
1) Generation of composite QR code for forming encryption information in dot code FIG. 47 illustrates a composite code generation process for authenticity determination.

  (1) In the generation of the composite QR code illustrated in FIG. 47, information stored in the data area of the QR code is encoded. Here, the data area refers to the data itself represented by the QR code excluding the position detection pattern (finder pattern), alignment pattern, timing pattern, format information, and error correction code in the QR code illustrated in FIG. Say. The reason for encoding the information stored in the data area of the QR code is that the QR code read out is the QR code at the time of creation due to missing or dirty information at the time of printing of the printed QR code, the shooting state of the QR code, etc. Is often not exactly the same. Similarly, the QR code displayed on the display may not coincide with the shooting state of the QR code. Therefore, it is meaningless to encode all the QR codes having error correction codes and compare the encoded information with each other. Here, encoding includes obtaining a code string by performing irreversible conversion from data using a hash function. The code string includes plain text (signature target data), and the encoded information encoded using the hash function includes a hash value.

  (2) In addition to at least data (including encryption information), the dot code contains necessary information such as error correction code and format information (type of stored dot code, version, etc.) according to the specified specifications. Needs to be stored.

  (3) The composite QR code is preferably issued by a specific issuing organization that strictly manages the encryption means. As a result, an environment that can be used by any user can be constructed. When a specific user has a unique encryption unit and uses it, the issuer may provide a service to the user. For example, an issue requester who requests issuance of a composite QR code transmits a URL and data (information stored in the data area of the QR code) to the issuing organization. The issuer should be limited to corporations, governments and other organizations or individuals that have been approved in advance by the issuing agency. It is desirable to sequentially authenticate the issuer who issues the composite QR code by a predetermined method. In the public information such as URL, the issued composite QR code and the issuer may be disclosed and evaluated by a third party to improve reliability. The third party may be a general user.

  (4) In order to ensure security, it is necessary to encrypt the encoded information with an encryption means so that a third party other than the issuing organization cannot issue the composite QR code. In order to encrypt the encoded information, a digital signature algorithm, that is, signature generation may be generated with a secret key. The digital signature algorithm includes various methods including SHA256, and is standardized by the National Institute of Standards and Technology (NIST) under the US Department of Commerce. Note that the encrypted information obtained by encrypting the encoded information by the encryption unit includes a digital signature.

  (5) A QR code is generated from information (not limited to a URL) stored in a data area received from a requester for issuing a complex QR code, and encrypted information is formed from a plurality of cells defined by the QR code. It is stored in the dot code data area. The data area may not be physically defined but may be logically defined. Note that the encryption information may be stored in a QR code.

  (6) The completed composite QR code is sent to the requester of issue, and the requester forms the composite QR code on the medium (including any method that can recognize the composite QR code by printing, stamping, display on the display, etc.) And provide it to a third party.

  (7) The composite QR code is a single electronic signature (also referred to as a digital signature) for the data stored in the data area of the first code and the second code, or for each data, respectively. The electronic signature may be generated, and the electronic signature may be stored in either the data area of the first or second code. For example, an electronic signature may be created for the first code and stored in the data area of the second code. An electronic signature may be created for the second code and stored in the data area of the first code. One electronic signature is generated for the first code and the second code, and the electronic signature is added to the adjacent area of the first code or the second code. May be stored.

2) Reading / authentication of composite QR code that forms encrypted information in dot code (1) Composite QR formed on media (including any method that can recognize composite QR code by printing, engraving, display on display etc.) In order to read the code, it is assumed that a dedicated composite QR code reader or an information processing apparatus such as a smartphone or tablet in which a dedicated composite QR code reader application is downloaded and installed is assumed.

  (2) When reading a complex QR code with a dedicated reader or reading application, by reading the finder pattern (cutout symbol), alignment pattern, quiet zone, timing pattern, and format information according to the normal QR code reading procedure, The center coordinate value of each cell, the size of the cell, and the direction of the QR code can be recognized. When a cell is determined only by light and dark, a binarized image is generated from a light and dark of the captured cell using a predetermined threshold, and binarized information of each cell is determined to read a QR code. The dot code binarizes the dot in the same way and reads the dot. However, the dot arrangement may be recognized for each cell determination, or after the reading of each cell in which the information is defined, the dot code is read. The dot code may be recognized by reading the formed dot arrangement. Note that when cells are formed at a light / dark level or color in order to increase the information amount of the QR code, information of 2 bits or more may be defined in the cell step by step based on its brightness, hue, and the like.

  (3) Next, only the information (not limited to the URL) stored in the data area of the read QR code is encoded. The concept of encoding is as shown in 1) (1). Further, the dot code is read with error correction, and data including at least encryption information is obtained. The concept of the encrypted information is as shown in 1) (1). Here, the encrypted information is decrypted into the decrypted information by the decrypting means. The decryption means may include the signature verification by a verification algorithm in the digital signature, and may be the signer's public key.

  (4) Finally, the encoded information (for example, cache value) obtained by encoding the QR code read in (3) by the encoding means (for example, cache function) and the encrypted information stored in the dot code are decrypted. If the decryption information decrypted by the encryption means (for example, the cache value when the QR code is generated in the issuing organization) matches, it is authenticated that the composite QR code is a composite QR code issued by the issuing organization. Is done. The decryption means includes a public key. However, the authentication method is not limited to matching / mismatching between encoded information and decoded information. It is only necessary to confirm that the encoded information and the decoded information are in a predetermined relationship.

<Example of processing of offline QR code authentication system>
(Processing example 1)
FIG. 47 is a flowchart illustrating a composite QR code generation method for authenticity determination. The generation of the composite code is executed by, for example, an information processing apparatus (hereinafter, exemplified by the management server MS1) such as the management server MS1 and the content server CS1 illustrated in FIG.

  In this process, the management server MS1 calculates encoding information (example: hash value) by encoding means (example: hash function) based on the QR code data (T11). Here, the QR code data refers to data included in the data and error correction code portions of the QR code structure illustrated in FIG.

  Next, the management server MS1 encrypts the encoded information calculated in T11 using an encryption unit (T12). Here, encrypting the encoded information is also referred to as calculating the encrypted information. More specifically, at T12, the management server MS1 has, for example, a private key / public key pair. The management server MS1 applies to an electronic certificate authority (CA) (or registration authority (RA)), has a public key registered, and has issued a public key certificate and a private key corresponding to the public key And The management server MS1 encrypts the encoded information using the secret key issued from the electronic certificate authority (CA). As the encryption means, an encryption processing module executed in the management server MS1 is exemplified.

  Next, the management server MS1 performs error correction on the QR code data to generate a QR code. In addition, the management server MS1 generates a dot code in the QR code cell by applying error correction to the dot code data including the encryption information (T13). By the process of T13, the same composite code as in the first to third embodiments is generated.

  Then, the management server MS1 forms a composite QR code on the medium (T14). The formed medium includes a display screen such as a display. That is, as illustrated in FIG. 32, the generated composite QR code is provided to a remote user device or a content server through a broadcast medium or a communication medium. The formed composite QR code is stored in a storage medium. The formed composite QR code is printed on a print medium.

  FIG. 48 is a flowchart illustrating the composite QR code reading / authentication process. Here, the apparatus that executes the composite QR code reading / authentication process is, for example, the user apparatuses UD1, UD2, and the like (hereinafter simply referred to as UD1) illustrated in FIG.

  In this process, first, the user device UD1 reads the composite QR code with the reading device (T21). Here, the reading device is, for example, an imaging device that acquires an image of a composite QR code. Reading the composite QR code means that an image of the composite QR code on the medium is taken, stored in the main storage device 12 (see FIG. 33) or the image memory, and data is acquired from each of the QR code and the dot code. That means. Here, out of the composite QR code, data encoded in the QR code is referred to as QR code data. Of the composite QR code, the data encoded in the dot code is the encryption information encoded in the dot code generated in the process of T13.

  Next, the user apparatus UD1 calculates the encoding information (example: hash value) by the encoding means (example: hash function) for the QR code data acquired from the QR code (T22). Along with the process of T22, the user apparatus UD1 calculates the decryption information by the decryption means for the encrypted information acquired from the dot code (T23).

  Next, the user apparatus UD1 collates the encoded information with the decoded information (T24). If the encoded information and the decoded information match, the user apparatus UD1 determines that the authentication by the composite code has succeeded, and performs a corresponding process. For example, the user device UD1 executes the process specified by the QR code of the composite QR code (T25). Further, for example, the user device UD1 accesses the URL specified by the QR code of the composite QR code. Further, for example, the user apparatus UD1 executes a corresponding process on the assumption that the information specified by the QR code of the composite QR code is correct information. The corresponding processing uses, for example, reproduction of content specified by the QR code in the composite QR code, access to a financial institution account specified by the QR code, a credit card number specified by the QR code, etc. Display of the authenticity determination result of the medium on which the composite QR code is printed.

  On the other hand, when the encoded information and the decoded information do not match, the user apparatus UD1 determines that the authentication by the composite code has failed and notifies the user of the result (T26).

  As described above, according to the processing example 1, various authentication processing, authentication determination processing, falsification detection processing, and the like can be performed by the composite QR code. In the above, the process of embedding the encryption information of QR code data as a dot code is exemplified, but the encryption information may be encoded into a part of the QR code and decrypted.

(Processing example 2)
FIG. 49 is a flowchart exemplifying a composite QR code generation method for authenticating the authenticity by encoding the encryption information of the dot code data into a QR code. In this process, the management server MS1 calculates encoding information (example: hash value) by encoding means (example: hash function) based on the dot code data (T31).

  Next, the management server MS1 calculates encryption information by the encryption means based on the encoded information (T32). Next, the management server MS1 generates a QR code by performing error correction on the QR code data including the encryption information, and generates a dot code in the QR code cell by performing error correction on the dot code data ( T33). That is, here, the management server MS1 incorporates the encryption information into the QR code. Then, a composite QR code is formed on the medium (T34). Here, the medium on which the composite QR code is formed includes a display screen by a display or the like, and includes a broadcast medium, a communication medium, and a storage medium print medium, as in FIG.

  FIG. 50 is a flowchart illustrating the complex QR code reading / authentication process. In this process, the user device UD1 reads the composite QR code with the reading device (T41). Next, the user apparatus UD1 calculates encoding information (example: hash value) with dot encoding data (example: hash function) for the dot code data (T42). Next, the user apparatus UD1 calculates decryption information by decryption means based on the encryption information acquired from the QR code (T43).

  Then, the user apparatus UD1 collates the encoded information with the decoded information (T44). If the encoded information and the decoded information match, the user apparatus UD1 determines that the composite code has been successfully authenticated, and performs the corresponding process (T45). For example, the user device UD1 executes processing designated by the dot code of the composite QR code. Further, for example, the user device UD1 accesses a URL specified by a dot code of a composite QR code. Further, for example, the user device UD1 executes the corresponding process on the assumption that the information specified by the dot code of the composite QR code is correct information. The corresponding processing uses, for example, reproduction of content specified by a dot code in a composite QR code, access to a financial institution account specified by the dot code, a credit card number specified by the dot code, etc. Display of the authenticity determination result of the medium on which the composite QR code is printed.

  On the other hand, when the encoded information and the decoded information do not match, the user apparatus UD1 determines that the authentication by the composite code has failed and notifies the user of the result (T46).

  As described above, according to the processing example 2, various authentication processing, authentication determination processing, falsification detection processing, and the like can be performed using the composite QR code. In the above description, the management server MS1 registers the dot code data encryption information in the QR code to form a composite code. However, instead of such processing, the management server MS1 may register the encryption information of the first dot code data in the second dot code and decrypt it. For example, the second dot code is a dot code of a cell different from the cell in which the first dot code is formed.

(Processing example 3)
FIG. 51 is a flowchart illustrating a method for generating a composite QR code for authenticity determination by encrypting QR code data and encoding it into a dot code, and encrypting and encoding dot code data into a QR code. is there.

  In this process, the management server MS1 calculates encoding information 1 (example: hash value) by encoding means (example: hash function) based on the QR code data (T51). Next, the management server MS1 calculates the encrypted information 1 by the encryption means based on the encoded information 1. That is, the management server MS1 encrypts the encoded information 1 with the secret key (T52).

  Along with the processing of T51 and T52, the management server MS1 calculates the encoded information 2 (example: hash value) by the encoding means (example: hash function) based on the dot code data (T53). Next, the management server MS1 calculates the encrypted information 2 by the encryption means based on the encoded information 2. That is, the management server MS1 encrypts the encoded information 2 with the secret key (T54). Note that the secret key used in T4 may be the same key as the secret key used in T52, or may be a different secret key. In any case, authentication is executed with the public key corresponding to the secret key.

  Next, the management server MS1 performs error correction using the QR code data and the encryption information 2 as data to generate a QR code (T55). Further, the management server MS1 uses the dot code data and the encryption information 1 as data to perform error correction on the QR code cell to form a dot code (T56).

  Then, the management server MS1 forms a composite QR code on the medium (T57). Here, the medium on which the composite QR code is formed includes a display screen by a display or the like, and includes a broadcast medium, a communication medium, and a storage medium print medium, as in FIGS. 47 and 49.

  FIG. 52 is a flowchart illustrating the complex QR code reading / authentication process. In this process, the user apparatus UD1 calculates the encoded information 1 (example: hash value) by the encoding means (example: hash function) based on the QR code data acquired from the QR code (T61). Next, the user apparatus UD1 calculates the decryption information 2 by the decryption means based on the encryption information 2 acquired from the QR code (T62). That is, the user device UD1 decrypts the encrypted information 2 into the decrypted information 2.

  Along with the processing of T61 and T62, the user apparatus UD1 calculates the encoding information 2 (example: hash value) by the encoding means (example: hash function) with the dot code data acquired from the dot code (T63). Next, the user apparatus UD1 calculates the decryption information 1 by decryption means based on the encryption information 1 acquired from the dot code (T64). That is, the user device UD1 decrypts the encrypted information 1 into the decrypted information 1.

  Next, the user apparatus UD1 collates each encoded information with the decoded information (T65). Individually, collation refers to collation between encoded information 1 and decoded information 1 and collation between encoded information 2 and decoded information 2. When both verifications match in T65, the user apparatus UD1 determines that the authentication has succeeded in the composite code, and performs corresponding processing (T66). Since the process of T66 is the same as the process of T25 and T44, its details are omitted.

  On the other hand, when both collations do not match at T65, the user apparatus UD1 determines that the authentication by the composite code has failed and notifies the user of the result (T67).

  As described above, according to the processing example 3, various authentication processing, authentication determination processing, falsification detection processing, and the like can be performed using the composite QR code. In the above description, the management server MS1 encodes the encryption information of the dot code data into a QR code, and encodes the encryption information of the QR code data into a dot code to form a composite code. However, instead of such processing, the management server MS1 encodes the encryption information of the QR code data into the QR code and the encryption information of the dot code data into the dot code, and the user device UD1 decrypts both. You may make it make it.

(Processing example 4)
FIG. 53 is a flowchart exemplifying a composite QR code generation method for authenticating the data by encoding the encryption information of the data string formed by the QR code data and the dot code data into a dot code.

  In this processing, the management server MS1 calculates encoding information (eg, hash value) by an encoding means (eg, hash function) based on a data string formed by QR code data and dot code data. (T71).

  Next, the management server MS1 calculates encryption information by the encryption means based on the encoded information (T72). That is, the management server MS1 encrypts the encoded information into encrypted information. Next, the management server MS1 performs error correction on the QR code data to generate a QR code. Further, the management server MS1 generates a dot code in the QR code cell by performing error correction on the dot code data including the encryption information (T73).

  Then, the management server MS1 forms a composite QR code on the medium (T74). Here, as a medium on which the composite QR code is formed, a display screen such as a display is included, and a broadcast medium, a communication medium, and a storage medium print medium are the same as in FIGS. 47, 49, and 51. .

  FIG. 54 is a flowchart illustrating the complex QR code reading / authentication process. In this process, the user device UD1 reads the composite QR code with the reading device (T81). Next, the user apparatus UD1 calculates encoding information (example: hash value) by encoding means (example: hash function) using QR code data and dot code data as data strings (T82). Along with the process of T82, the user apparatus UD1 calculates the decryption information by the decryption means based on the encryption information acquired from the dot code (T83). That is, the user device UD1 decrypts the encrypted information into the decrypted information.

  Next, the user apparatus UD1 collates the encoded information with the decoded information (T84). If the encoded information and the decoded information match, the user apparatus UD1 determines that the authentication by the composite code has succeeded, and performs a corresponding process (T85). Since the process of T85 is the same as the process of T25, T44, and T66, the details are omitted.

  On the other hand, when both collations do not match at T85, the user apparatus UD1 determines that the authentication by the composite code has failed and notifies the user of the result (T86).

  As described above, according to the processing example 4, various authentication processing, authentication determination processing, falsification detection processing, and the like can be performed by the composite QR code. In the above description, the management server MS1 encodes the encrypted information of the data string formed by the QR code data and the dot code data into a dot code to form a composite code. However, instead of such processing, the management server MS1 encodes the encryption information of the data string formed by the QR code data and the dot code data into a QR code, and the user device UD1 decrypts both. You may make it do.

(Processing example 5)
FIG. 55 is a flowchart exemplifying a composite QR code generation method for encoding encoded information of a data string formed by QR code data and dot code data into a dot code. In this process, the secret key and the public key are not used. In this process, the management server MS1 calculates encoding information (eg, hash value) using a coding means (eg, hash function) for a data string formed by QR code data and dot code data (T91). . Next, the management server MS1 performs error correction on the QR code data to generate a QR code, applies error correction to the dot code data including the encoded information generated in T91, and applies the dot code to the QR code cell. Is generated (T92).

  Then, the management server MS1 forms a composite QR code on the medium (T93). Here, as a medium on which the composite QR code is formed, a display screen such as a display is included, and a broadcast medium, a communication medium, and a storage medium print medium are included in FIGS. 47, 49, 51, and 53. It is the same.

  FIG. 56 is a flowchart illustrating the complex QR code reading / authentication process. In this process, for example, the user device UD1 reads the composite QR code with the reading device from the information acquired from the content server (T101). Next, the user apparatus UD1 calculates encoding information (example: hash value) by encoding means (example: hash function) using QR code data and dot code data as data strings (T102). Next, the user device UD1 acquires encoded information (eg, hash value) from the dot code (T103).

  Next, the user apparatus UD1 collates the calculated encoded information with the acquired encoded information (T104). When the encoded information and the decoded information match, the user apparatus UD1 determines that the authentication by the composite code has succeeded, and performs a corresponding process (T105). Since the process of T105 is the same as the process of T25, T44, T66, and T85, its details are omitted.

  On the other hand, if the encoded information and the decoded information do not match in T105, the user apparatus UD1 determines that the authentication by the composite code has failed and notifies the user of the result (T106).

  Unlike the processing example 1 to the processing example 4, in the processing example 5, it can be confirmed whether the error correction is correct. When the encoding process used in T91 and T102 is a process that can be specified only by the management server MS1 and the user device UD1, various authentication processes and authenticity determination processes are performed in the same manner as in the process examples 1 to 4. Tamper detection processing can be performed.

It is possible to authenticate whether the error correction was correct for all of the electronic authentications described with reference to FIGS. 47 to 54, including the following cases.
・ Encrypted information obtained by encrypting QR code data encoded by the encryption means is stored in the dot code. ・ Encrypted information obtained by encrypting QR Code data encoded by the encryption means is stored in the QR code. The encrypted information obtained by encrypting the encoded information of the dot code data by the encrypting means, and the encrypted information obtained by encrypting the encoded information of the dot code data stored by the encrypting means in the QR code, Stores in dot code-QR code data encoded information encrypted with encryption means dot code Code information encoded with dot code data encrypted with encryption means QR code Encrypted information encrypted by encryption means for storing and QR code data respectively in the code is encrypted in the QR code, and encoded information of the dot code data is encrypted in the code by the encryption means Encrypted information is stored in dot code, respectively. QR code data and encrypted information obtained by encrypting encoded information of a data string formed from dot code data by encryption means are stored in QR code. Encrypted information obtained by encrypting the code data and the encoded information of the data string formed from the dot code data with the encryption means is stored in the dot code.

Similarly, it is possible to authenticate whether the error correction was correct for all of the electronic authentications described with reference to FIGS. 55 and 56, including the following cases.
-Stores encoded information of QR code data in dot code-Stores encoded information of QR code data in QR code-Stores encoded information of dot code data in QR code-Encoded dot code data Information is stored in dot code. QR code data encoding information is stored in dot code, dot code data encoding information is stored in QR code, and QR code data encoding information is stored in QR code. Encoding information of code data is stored in dot code, each of which is stored / QR code data, and encoded information of a data string formed from the data of dot code is stored in QR code. QR code data and dot code The encoding information of the data string formed from the data is stored in the dot code

<Features and Applications of Embodiment 6>
The features and applications (authentication system and content system) of the composite QR code that forms the encryption information in the offline dot code described in the sixth embodiment will be listed below.

(Examples and effects of composite QR code)
The composite QR code can be electronically authenticated without authenticating on the net, leading to prevention of hacking and the like on the net. Furthermore, if a service provider that provides content and various services on the Internet provides the user with a mechanism for downloading and installing even a composite QR code reading application, various content services and electronic authentication using the composite QR code can be provided. There is no need to operate a server that requires cumbersome management and cost. Therefore, the service provider can provide a continuous service to the user at a low cost. In addition, even a small service company can provide various content services using a composite QR code without constructing a server.
(Equipped with translation function, national language data)
Furthermore, when using the content, if the application has an output function such as translation / interpretation, various contents acquired by one hybrid QR code can be used in various countries around the world. On the other hand, texts and images in the required language are stored even if the application does not have a translation / interpretation function. Display and sound can be played. Of course, if a composite QR code is displayed on the display and a time series dot code or color dot code is used, a small-capacity animation is also converted into data for each language and stored in the composite QR code. You can get it.

(How to store data in a composite QR code)
The composite QR code is characterized by being able to read QR codes that store URLs, etc., not only with complex QR code readers but also with popular QR code readers. Furthermore, the conventional QR code reader treats an image such as a dot as noise and ignores it, so that QR code reading is not hindered. Further, data may be stored in a dot code, and an electronic signature may be stored in a QR code data area as shown in FIGS. This is because the dot code can take advantage of the ability to store much more information. Therefore, data such as a URL having a small capacity may be stored in a QR code, and data having a large capacity such as content may be stored in a dot code. Further, format information such as dot code type and version, error correction code version, etc. is also stored in the QR code, and at least the data and error correction code are stored in the dot code. May be read. Thereby, the data format of a dot code can be made variable, and versatility can be improved. That is, the dot code data format can be determined for each application field, and any composite QR code reader can properly read the dot code.

(Use as various tickets)
A composite QR code storing the purchased ticket number etc. is sent from the ticket seller, and when using the ticket, the composite QR code compatible application displays a one-time password that changes with time by transmission from the cloud in dot code, Only the person who has purchased the ticket can read the ticket with the composite QR code reader when confirming the entrance. Further, the resale of the ticket can be prevented by acquiring the ticket purchaser's smartphone ID and transmitting the one-time pass award to the smartphone. If the one-time password is stored in the dot code, it is difficult to visually recognize even if the dot changes, so that the user can be prevented from being aware that the one-time password is being used. On the other hand, if the one-time password is stored in the QR code, the QR code changes, so that the user is informed that copy protection is being implemented, which has a deterrent effect on the forger. The current QR code can be read by anyone, and anyone can generate it. When the ticket is a print medium and the ticket number is embedded in the QR code, it is highly possible that a third party can issue the ticket number by performing reverse engineering based on the information read from the QR code. . If the ticket number issuing procedure is known, different ticket numbers can be easily generated.
Although the composite QR code reading application is generally widely provided, the generation of the composite QR code can be performed only by a specific composite QR code issuer or used as a ticket number only for the composite QR code issuer. It is only necessary to provide a composite QR code generation application that can encode only a specific dot code (a limited unique dot code). This makes it impossible to produce a counterfeit ticket with a ticket number different from the ticket number of the acquired ticket. Note that when a composite QR code issued to the world is a completely unique code, a composite QR code generated by a composite QR code generation application that can be limited to a specific unique dot code and other generation applications What is necessary is not to overlap with a composite QR code that can be generated. The ticket is for acquiring various services such as event participation, facility entrance, transportation use, meal ticket, administrative service use ticket and the like. In this embodiment, a composite QR code generation application that can encode a unique dot code as a ticket number has been described. However, in any use in any field, a specific unique code can be obtained under each contract. A service that provides a composite QR code generation application capable of encoding with limited dot codes is desirable. Of course, a complex QR code issuing organization always issues a unique complex QR code. Needless to say, a composite QR code is a code in which a QR code and a dot code are combined, and even if the dot code is the same and the QR code is unique, a unique composite QR code can be generated.

(Use for biometric authentication)
Enormous personal information (biological information such as face, fingerprint, iris, vein, etc.) is registered in the dot code after error correction. An electronic signature is applied to either the QR code or the dot code so that the personal information is not falsified. The usage method is to display a composite QR code when making a payment, read and acquire the biometric information, and acquire it from the person on the spot (acquisition of face, fingerprint, iris, vein information, etc. by camera or sensor) ) The identity of the biometric information can be confirmed by an unattended person, and financial settlement, entry into an important facility, and operation of an important device can be performed with high security. Registration of personal information such as a smartphone can be easily performed by photographing a face, a fingerprint, and an iris with a built-in camera. The identity information may be raw data obtained by photographing a face, fingerprint, or iris with a smartphone, or feature point data obtained by analyzing the raw data with a dedicated application. In the case of feature point data, it is an advantage that the amount of data is reduced. However, it is presumed that a specific matching system that generates the same feature point as the feature point data is used, and the versatility is poor. In the case of raw data, it is excellent in versatility because any system can be used to collate with biometric information acquired on site. The capacity of the raw data is a large amount of information and cannot be stored by the conventional QR code, but the composite QR code can store the information sufficiently. With the current face authentication technology, it can be realized with a photograph compressed to 2-3 KB.

(Use as a means of payment and remittance)
If financial information such as a credit card, prepaid card, or cash card is stored in a composite QR code with an electronic signature, financial settlement with extremely high security can be performed. Furthermore, if a one-time password or the like is issued simultaneously with a QR code or a dot code, the security is further enhanced. In particular, when displaying passwords with dot codes, passwords with a large amount of information can be issued, and one-time passwords can be displayed several times a second. Since the dots are small, they are stolen by voyeurism such as shoulder hacking. Is very unlikely. In such an embodiment of financial settlement, the store side system may provide the purchaser with a print medium on which the purchased item, unit price, total payment amount, etc. are printed, or display the contents on the display. After the purchaser confirms the displayed contents, when the financial settlement card information is displayed on the purchaser's smartphone, the store side system reads with a complex QR code reader (or a smartphone), and the financial is based on the read financial settlement card information. The purchase product settlement information is transmitted to the settlement server. When the financial settlement server approves the settlement, it immediately notifies the POS on the store side, and the purchase of the product is completed. Furthermore, payment completion information such as purchase item settlement information and purchase store information may be transmitted to the purchaser's smartphone. In addition, when payment is not possible, even when there is a shortage of credit card overuse, prepaid card, or bank account, such information may be displayed on the smartphone.

As an example of financial settlement for credit cards, prepaid cards, bank accounts, etc., in a system using a complex QR code, the purchaser displays financial settlement card information on the smartphone in a complex QR code, and the system on the store side is complex The display content of the smartphone is read with a QR code reader (or a smartphone), and the purchase settlement information is transmitted to the financial settlement server based on the read financial settlement card information. When the financial settlement server approves the settlement, the settlement approval result is immediately notified to the POS on the store side, and the product purchase settlement is completed. In addition, information such as purchased product information and purchased store information is transmitted to the purchaser's smartphone, and icons such as “settlement”, “cancel”, “lump sum payment” and “installment payment” are displayed and selected for settlement. Good. In addition, when payment is not possible, even when there is a shortage of credit card overuse, prepaid card, or bank account, such information may be displayed on the smartphone. The store-side system provides the purchaser with a print medium on which the purchased item, unit price, total payment amount, etc. are printed, or displays the contents on the display and confirms the purchase, and then settles with a credit card, etc. Just do it.
In another embodiment, the store side displays a composite QR code on a POS display (which may be a smartphone), and when the purchaser reads the composite QR code, the item, unit price, and total payment amount of the purchased product are displayed. When an icon such as “Payment”, “Cancel”, “Bump payment”, or “Installment payment” is displayed and selected, the payment information is sent to the financial payment server. The purchase of is completed. If there is not enough balance left on the prepaid card or bank account, the balance or shortage will be displayed. Not passing the card to the other party means that the card information is not easily copied, and spoofing damage can be suppressed.
(Application to remittance processing) Furthermore, when the remittance is input to the smartphone when the remittance is to be transferred between individuals, a composite QR code in which remittance information such as the remittance and the amount is registered is displayed. When the other party reads it with his / her smartphone and taps the “confirm” icon, the sender is notified, and to whom and how much money is sent is displayed. Financial transaction is completed. The other way is to display a composite QR code with remittance destination information registered on the other party's smartphone, read the remittance information on the sender's smartphone, enter the amount into the smartphone, and enter the “settlement” icon Tap to transfer money to the other party and establish a financial transaction between individuals. At this time, if identity information such as a photograph is registered in the composite QR code, the identity of the depositor can be easily confirmed. In either case, in order to enhance security so that a third party other than the principal cannot send money, a password may be input when the “settlement” icon is tapped. Regarding these financial transactions, in addition to the amount and date, “loan”, “gift”, “consideration”, etc. can be classified and recorded.

(Use as a coupon)
When using customers with points, coupons, or stamps, when a customer acquires a privilege, the privilege provider's system forms (prints or displays) a compound QR code that can acquire the privilege anywhere on the customer's smartphone. A privilege can be acquired by reading. In addition, the privilege provider's system reads the composite QR code displayed on the customer's smartphone, grants the privilege to the customer's smartphone using various communication means such as telephone lines, WIFI, Bluetooth, etc. can do. The composite QR code may include a communication destination telephone number or address, a smartphone ID, a membership number, and the like.

(Use as certificate)
When the system verifies the person, such as a license, health insurance card, student ID card, employee ID card, membership card, passport, etc., even if the person does not present the card, the information is stored in the dot code and the person May display the composite QR code on the smartphone. The system reads the dot code with a complex QR code reader, displays the necessary information on the reader, tells the person the date of birth, address, etc., and can confirm the identity. Note that reading of a composite QR code formed on a print medium, a display, or the like can also be performed by a dedicated application installed in a smartphone. In particular, since photos can also be stored in dot codes, it is possible to verify the identity of a conventional photo without a card. Even if the card information is passed to the other party's system for confirmation, it is customary to copy the card at post offices or hospitals, but rather, display and reading a composite QR code with a smartphone (dedicated application), When reading a composite QR code by a dedicated reader, security can be enhanced by displaying only a part of the photograph, date of birth, address, etc. included in the read data and hiding other information. Furthermore, since the read system can trace the history of the read composite QR code together with the time, place, etc., it can be used as big data. Not passing the card to the other party means that the card information is not easily copied, and spoofing damage can be suppressed.

(Use as recording means)
It is obliged to store information on paper media in various fields, such as medical and forensic materials, real estate and financial contracts. If you digitize it with OCR, record it in the cloud, and search it, the system can get text information, but it is cumbersome for people to look at paper media and search for that information. The composite QR code can store text for several pages of paper media (about 4,000 characters, 10,000 characters if color dots can be used), and the system reads the composite QR code printed on the spot, Information can be acquired easily. The compound QR code can be attached i) the system can print it at any position together with the data obtained by OCR reading, or ii) the system can print the composite QR code on a sticker, etc. You may make it stick on. iii) When a predetermined area (near or inside the document) for printing the composite QR code is formed in the original document, the system is obtained by the original document (overlay printing on the original document) or OCR. The composite QR code may be printed in the area of the print document by data.

(Used as an information exchange means)
Even in the exchange of various information, the safety is improved by the composite QR code. For example, a user can easily send and receive photos, voices, texts, etc. by using a composite QR code without telling the other party the email address or contact information on SNS. For example, a photo can store a high-quality photo when viewed on a smartphone, a voice of about 10 minutes, and text of more than tens of thousands of characters. Since the number of characters in the text has been described above, explanation is omitted here, but in speech, it becomes 0.3KBPS by ADPCM (Adaptive Differential Pulse Code Modulation) and data compression technology, but MELP (Mixed Excitation Linear Prediction) Data compression technology makes it possible at 0.1KBPS, and the dot code can store up to 2KB of information, so it can store about 20 seconds of audible audio. In addition, in the image, it is possible to acquire contents such as a photograph of about 2 KB in JPEG (a degree that the person can be identified by human eyes). Furthermore, the latest still image compression technology (BPG, or JPEG XL, which is the next generation JPEG, etc.) can maintain the quality sufficient to withstand facial image recognition. In the case of a complex QR code corresponding to version 40, 177 x 177 cells, which uses a dedicated high-resolution complex QR code reader and has the maximum amount of information in the printed QR code, the information is about 24 KB bytes, which is 8 times larger Can be stored. There are many functions that can exchange information with smartphones, such as infrared and Bluetooth, but these functions cannot be used with all smartphones. However, if a user downloads and installs a composite QR code reading-only application on a smartphone, the display / reading of the composite QR code can be used on almost all smartphones. For example, after taking a group photo, print or display the composite QR code on the display, and if each person reads the composite QR code, the group photo can be acquired on their own smartphones without the need to convey the address etc. Can do. If you print the composite QR code, you can always get memorial photos and messages such as graduation albums forever anytime and anywhere without uploading to the server. Until now, it has been necessary to operate a server environment that allows browsing and downloading of photographic information for many years. In this embodiment, such server management and waste of cost can be omitted. Such an effect of the present invention can be used in various contents fields, and has a great merit that it is possible to escape from the responsibility of server construction and management. You can develop a sold-out business model.
When a smartphone or other system stores high-quality photos, voices of about 10 minutes, texts of more than tens of thousands of characters and displays a composite QR code on the smartphone, for example, the first code (QR code) Is fixed and a plurality of different second codes (dot codes) are displayed for a predetermined time, so that a large amount of information can be generated. When the reading device reads a blinking time-series dot code with a composite QR code reader, it can be processed at high speed by reading the QR code only once and thereafter reading only the dot code. When camera shake occurs during shooting, the dot code can be read accurately if the reading device tracks the change in the imaging position of the timing pattern or alignment pattern and corrects the detected dot position each time. When displaying a composite QR code on a smart phone and a smartphone and reading the composite QR code with another smartphone or other reading device, the amount of information that can be stored in the dot code is about 0.85K, but in 2 to 3 seconds. With the time-series dot code and color dot code that change the dot code about 24 times, the reading device can acquire an information amount of 20 KB or more. If this is reproduced with photographic data, when displayed on a reading smartphone, the user can view it as a sufficiently high-quality image, and the display smartphone can transmit text information exceeding 70,000 characters.
(Dot code colorization)
As described above, the amount of information of the composite QR code can be further increased by colorizing dots. Since the reading device reads the dot color in RGB, any display with a different color display for each model will have at least red (R), green (G), blue (B), yellow (RG color mixture), cyan (GB mixed color), magenta (RB mixed color), black, white (no dot) can be identified, and by that alone, 3 bits per dot can be increased. That is, the information amount per cell is tripled. At present, if the code variable length technique is used, there is a high possibility that the amount of information can be further increased by a factor of two, that is, about six times. As a result, the system can transmit a large amount of information exceeding several hundred times that of the QR code by changing the color dot code with time in combination with the time change of the time series dot code. From this, if the resolution and the number of colors are small and the scale is short, the system can also transmit animation. When the system changes the composite QR code with time, the electronic authentication may be executed only for the content stored in the first composite QR code. Furthermore, there may be cases where the content portion is not electronically authenticated. These processes may be applied not only to animation but also to transfer of a large amount of text and high-resolution images.

(Application to information acquisition and information provision services)
As an example of information acquisition, for example, the user can immediately acquire various information from a composite QR code displayed on a poster print or display as a signage. Usually, a user acquires information using a wireless communication line, a wired communication line, a dedicated line, or a public line such as the Internet. However, the user can obtain information free of charge anywhere without such a communication environment by reading a composite QR code on various media. Furthermore, if the application has an output function such as translation / interpretation, various contents acquired by one composite QR code can be used by people all over the world. On the other hand, the media is stored in a composite QR code formed on the medium so that the text in each language, a small amount of voice data and images can be identified, and the reader reads the composite QR code from the medium, thereby translating and interpreting the application. Even if it is not equipped with a function, it is possible to display text and images in the required language and to play audio. Of course, if you display the composite QR code on the display and use the time-series dot code or color dot code, you can also localize the small-capacity animation to the data for each language and store it in the composite QR code. Thus, the user can acquire the contents of each country without using the Internet or a translation application.

  As an example of photo acquisition, the photograph taken by a photographing box such as a photo booth (registered trademark) or ID photo is stored in a composite QR code, and the composite QR code is displayed on the display of the photographing box. Photo data can be acquired by shooting with a smartphone. There is a service that provides photographs taken on the Internet, but the photographed pictures are personal information and may leak on the Internet, but leakage can be prevented by a composite QR code. In order to provide high quality photos, it is desirable to use color dot codes or time series dot codes.

In the embodiment of voice acquisition, the system on the information provider side is a composite QR in which voice information is stored in various print media such as books, magazines, textbooks, picture books, catalogs, flyers, newspapers, posters, packages, stickers, prescriptions, etc. By printing the code and distributing it, the user can read it with a smartphone and play it back. Note that the audio information may be reproduced in a language set by the smartphone, or the audio information may be reproduced by setting another language. Needless to say, the information providing system stores not only voice but also information such as text and images, and the user can acquire such information. Furthermore, if the application has an output function such as translation / interpretation, various audio contents acquired with one composite QR code can be used in various countries around the world. On the other hand, by storing it in a composite QR code formed on a medium so that voice data in each language can be identified, a system such as a smartphone can use the language desired by the user even if the application does not have a translation / interpretation function. Can play audio. Naturally, if the system displays a composite QR code on the display and uses a time-series dot code or color dot code, it is possible to store even small-capacity animations in the composite QR code as data for each language. Thus, the user can acquire the content of each country by reading the composite QR code with a mobile terminal such as a smartphone. In this embodiment, the composite QR code is a print medium printed on a medium. However, the composite QR code may be generated by imprinting on various media. Furthermore, simple braille may be formed in part of the dot code, and stored information may be expressed in braille.
(Use in games)
In the embodiment of the game, the user can exchange by displaying the composite QR code in which the characters and items are stored on his / her smartphone and reading it with the smartphone of the other party to be provided. As a result, a new sense of game can be developed through face-to-face communication between people. In addition to the characters and items, the information-providing system prints a composite QR code on at least one of the front or back side of a trading card or game card in which athletes, entertainers, etc. are printed on the card surface. Alternatively, information such as images and sounds may be stored so that the user can obtain them. Furthermore, when the sender side system prints the composite QR code on the greeting card, photographs, videos, graphics, a considerable amount of text, etc. taken of the sender can be acquired at the destination. Here, the sender side system may upload information to be sent to the Internet into a composite QR code. On the other hand, if the user can print the composite QR code storing such information, the information from the sender can be obtained at the destination via the paper medium without using the Internet. However, since the amount of information is limited in the printed composite QR code, it can be said that moving images and high-definition photographs are difficult.

(App coding)
Since the reading device can acquire a large amount of information by using a time-series dot code or color dot code that changes with time, the application can be stored in the composite QR code and the application can be easily installed without downloading. In other words, not only can you install apps even in environments where you can't use the Internet, but you can also provide apps continuously and inexpensively through various media (paper media, broadcast media, etc.) without registering and managing them in the cloud or server. it can. You can develop a sold-out business model.
(Composite QR code issuing system)
Forged QR codes, such as fake online shopping and credit card information hacking, have caused great damage.
Therefore, when an official issuing organization for complex QR codes is set up and a complex QR code user (a user who has been approved by the official issuing organization in advance) sends data such as URLs to the official issuing organization, the composite that is digitally signed with the dot code. A QR code is generated and provided to the user. The user uses the composite QR code printed or displayed on a display together with an authorization mark indicating that it is a composite QR code (the authorization mark may be arranged in the center of the QR code). The official issuing agency provides users with a composite QR code reading application free of charge. If there is a certification mark, the user can read the composite QR code with the application and determine the authenticity. The business model can be charged by i) a composite QR code user approval procedure, ii) issuance of a composite QR code, iii) an advertising expense when using a composite QR code reading application, and the like.
When an individual is identified to enjoy electronic authentication and various services, a composite QR code may be issued from an official issuing organization as a personal ID. Basic personal information such as the person's name, date of birth, address and photo is registered in the personal ID composite QR code. Other information such as credit card information, bank accounts, licenses, health insurance cards and other certificates may be registered. The personal ID combined QR code reader should be provided only to corporations approved by the official issuing organization, and the dedicated reader may be managed so that it can be strictly followed up, such as usage records, to ensure security. In personal authentication, the system only needs to confirm the name, date of birth, address, photo, etc., and using a general-purpose composite QR code reader (app), the personal information is immediately deleted after use and the personal information It is only necessary to prevent leakage.

  47 to 54, the encrypted information obtained by encrypting the encoded information of various data is stored in the composite QR code, and the authentication of the data corresponding to the encoded encoded information is performed. . On the other hand, there are many cases where a composite QR code read due to missing information or dirt at the time of printing, a composite QR code shooting state, or the like does not completely match the composite QR code at the time of creation. Similarly, the composite QR code displayed on the display may not be the same depending on the shooting state of the composite QR code. Therefore, the flowcharts of FIGS. 55 to 56 show a method by which it is possible to easily determine whether or not the error correction has been properly performed by using the error correction code, although the authenticity determination cannot be made completely.

<Modification>
47 to 56, the management server MS1 generates a composite QR code and the user device UD1 executes the composite QR code reading / authentication process. It is not limited. That is, the complex QR code reading / authentication process may be performed between the management server MS1 and the content servers CS1, CS2, and the like. Further, the composite QR code reading / authentication process may be performed between the content servers CS1, CS2 and the user devices UD1, UD2. The complex QR code reading / authentication process may be performed between the user device UD1 and the user UD2. That is, the composite QR code reading / authentication process is any process for authenticating the validity of the information presented by the QR code in the composite QR code between the information providing side and the data acquiring side. It is also applicable to.

[Embodiment 7]
Hereinafter, with reference to FIG. 57 to FIG. 60, an authenticity determination system processed online in the seventh embodiment will be described.

<Online online QR code authentication system>
(1) When a composite QR code reading application is downloaded and installed on a smartphone, the smartphone ID can be acquired and sequentially authenticated by an authentication server. In addition, if you link with GPS, you can see where it was read, acquire those logs, and use it for detailed marketing.

(2) In the authentication of the composite QR code by the authentication server, the authentication by the authentication server is indispensable. Therefore, a charging business model can be developed for the composite QR code issuing request company for each authentication.
(3) When the hash value read from the composite QR code and the electronic signature are transmitted to the authentication server, the hash value obtained by decrypting the electronic signature and the received hash value are collated without using the public key. It is possible to determine the authenticity of the QR code.

(Processing Example 6)
Processing example 6 is processing when processing example 4 is applied to online authentication. FIG. 57 is a flowchart exemplifying a composite QR code generation method for determining authenticity by encoding encryption information of a data string formed by QR code data and dot code data into a dot code. In FIG. 57, the processing of T111, T112, T113, and T114 for generating the composite QR code is the same as that of T71 to T74 of FIG. The generated composite code is provided to the user device UD1 via the management server MS1, for example.

  FIG. 58 is a flowchart illustrating the complex QR code reading / authentication process. In this process, the user device UD1 reads the composite QR code with the reading device (T121). Next, the user apparatus UD1 calculates encoded information (eg, hash value) by an encoding means (eg, hash function) using QR code data and dot code data as a data string, and transmits the encoded information to the authentication server ( T122). Here, the authentication server is a server device that can be accessed via a network, such as the management server MS1 and the content server CS1 exemplified in FIG. Next, the user device UD1 transmits the encryption information acquired from the dot code to the authentication server (T123).

  Next, the authentication server collates the encoded information and the decoded information (T124). If the encoded information and the decoded information match, the authentication server determines that the authentication by the composite code has been successful, and performs a corresponding process (T125). Since the process of T125 is the same as the process of T25, T44, T66, and T85, its details are omitted.

  On the other hand, if both verifications do not match at T124, the authentication server determines that the authentication by the composite code has failed and notifies the user of the result (T126).

  As described above, according to the processing example 6, various authentication processing, authentication determination processing, falsification detection processing, and the like can be performed online using the composite QR code. In the above description, the management server MS1 encodes the encrypted information of the data string formed by the QR code data and the dot code data into a dot code to form a composite code. However, instead of such processing, the management server MS1 encodes the encryption information of the data string formed by the QR code data and the dot code data into a QR code, and the user device UD1 decrypts both. You may make it do.

  In the above processing, authentication performed by the authentication server may be performed using a secret key. Further, in the above, as in the processing example 4, the encryption information of the data string formed of the QR code data and the dot code data is used. However, instead of such processing, the processing of processing example 1 to processing example 3 may be applied to online authentication.

  That is, as in Processing Example 1, QR code encryption information may be encoded into a dot code and applied to online authentication by an authentication server. Also, QR code encryption information may be encoded into a QR code and applied to online authentication by an authentication server.

  Further, as in Processing Example 2, the dot code encryption information may be encoded into a QR code and applied to online authentication by an authentication server. Alternatively, the dot code encryption information may be encoded into a dot code and applied to online authentication by an authentication server.

  Furthermore, as in Processing Example 3, QR code encryption information 1 and dot code encryption information 2 may be encoded into a dot code and a QR code, respectively, and applied to online authentication by an authentication server. In this case, the encryption information 1 of the QR code may be encoded into a dot code, and the encryption information 2 of the dot code may be encoded into a QR code. Conversely, QR code encryption information 1 may be encoded into a QR code, and dot code encryption information 2 may be encoded into a dot code. Further, QR code and dot code encryption information may be encoded into a QR code.

(Processing example 7)
FIG. 59 shows an example of processing for encoding the encoding information of the QR code and the dot code into a QR code. In this process, as in Process Example 5, encryption is not performed. In this process, the processes of T131, T132, and T133 for generating the composite QR code are the same as those of T91 to T93 in FIG. The generated composite QR code is provided to the user device UD1 via, for example, the management server MS1.

  FIG. 60 is a flowchart illustrating the complex QR code reading / authentication process. In this process, the user device UD1 reads the composite QR code with the reading device (T141). Next, the user device UD1 sends the encoded information acquired from the dot code (eg, hash value 1) and a data string formed by the read QR code data and the read dot code data to the authentication server. Transmit (T142).

  Next, the authentication server encodes a data string formed by the QR code data and the dot code data read by the user device UD1 among the received data, and encodes information (eg, hash value 2). Create Then, the encoded information (for example, hash value 1) acquired from the dot code in the user device UD1 is collated with the data string (for example, hash value 2) encoded in the authentication server (T143). If the encoded information and the decoded information match, the authentication server determines that the authentication by the composite code has been successful, and performs a corresponding process (T144). Since the process of T144 is the same as the process of T25, T44, T66, T85, and T125, its details are omitted. The corresponding processing may allow the user device UD1 or another server on the network accessed by the user device UD1 to perform the same processing as T25, T44, T66, T85, and T125.

  On the other hand, when the hash value 1 and the hash value 2 do not match at T143, the authentication server determines that the authentication by the composite code has failed and notifies the user of the result (T145). That is, in this case, the authentication server does not allow the process executed at T145 to the user device UD1 or another server on the network accessed by the user device UD1.

  In the present processing example, if the encoded information is created by the secret encoding means and electronic authentication is performed, it is not necessary to encrypt the encoded information at the time of data creation. That is, authentication can be performed only with the hash value.

  The electronic authentication based on the server authentication in the processing example 7 can be applied to all the following cases of the offline electronic authentication described in the processing examples 1 to 3.

  In other words, the encoded information of the QR code may be encoded into a dot code without being encrypted, and a composite code may be created and used for online authentication. Alternatively, QR code encoding information may be encoded into a QR code to create a composite code and used for online authentication. Alternatively, the dot code encoding information may be encoded into a QR code to create a composite code and used for online authentication. Also, the dot code encoding information may be encoded into a dot code to create a composite code and used for online authentication. Alternatively, the encoded information of the QR code and the dot code may be encoded into a dot code and a QR code to create a composite code and used for online authentication. Alternatively, the encoded information of the QR code and the dot code may be encoded into a QR code and a dot code to create a composite code and used for online authentication. Further, the encoded information of the QR code and the dot code may be encoded into a QR code to create a composite code and used for online authentication.

[Eighth embodiment: composite code pattern]
In the first to seventh embodiments, the QR code and the dark color dot code (second color dot code) and the dark color cell (first color cell) formed in the light color cell (first color cell) in the QR code are described. The process using at least one of the bright dot codes (first color dot codes) formed in the two color cells) by the composite QR code is exemplified.

  However, the processes of the first to seventh embodiments can be applied to other than the composite QR code. For example, a bar code may be used instead of the QR code. That is, a composite code may be formed by forming a dot code including a dark dot in a light color portion between a barcode and a dark color pattern of the barcode. Also, a composite code may be formed by forming a barcode and a dot code including light dots in the dark color pattern portion of the barcode.

  Moreover, it is good also as a composite code | cord | chord only using character strings, such as an alphanumeric character, a kanji, a katakana, and a hiragana, instead of QR code and barcode. That is, a composite code may be formed by forming a dot code including a dark dot in a light color portion between dark color patterns of a character string such as alphanumeric characters, kanji, katakana and hiragana. Alternatively, a dot code including light dots may be formed in a dark color pattern of a character string such as alphanumeric characters, kanji characters, katakana characters, hiragana characters, or the like to form a composite code. When an infrared imaging device is used, the dark pattern of character strings such as alphanumeric characters, kanji, katakana, hiragana is formed with ink that does not absorb normal infrared rays, and the dot code is made of infrared rays such as carbon black. You may form with the ink to absorb. The dark color pattern of the character string may be read with visible light, and the dot code may be read with infrared rays.

  Then, the data encoded with the bar code may be digitally signed and encoded with the dot code as in the fourth embodiment. Therefore, the reading device can authenticate the validity of the information presented as a barcode or a character string. When the composite code is formed of a bar code and a dot code, a bar code reading device and a dot code reading device may be used. In the case where the character string and the dot code are used, an OCR (Optical Character Recognition / Reader) device and a dot code reading device for reading the character string may be used.

  Therefore, such a composite code is not necessarily limited to a QR code, and can be defined as follows.

(Compound code definition)
The composite code is a first code patterned with two or more identifiable colors;
A second code in which one or more marks that can be identified from the first color of the pattern are arranged, and a composite code pattern comprising:
The second code is defined as a composite code pattern including specific information corresponding to at least a part of the first code.

  Here, the first code patterned with two or more identifiable colors is, for example, a bar code or a character string such as alphanumeric characters, kanji, katakana, hiragana. The two or more colors are, for example, a bar code or a character string color (one or more colors) such as alphanumeric characters, kanji characters, katakana characters, hiragana characters, and a base color (medium surface color). The second code in which one or more marks are arranged is the dot code exemplified in the first to fifth embodiments. Further, the second code includes specific information corresponding to at least a part of the first code, as in the fourth and fifth embodiments, the second code is a bar code that is the first code, Alternatively, it is exemplified that data represented by a character string such as alphanumeric characters, kanji, katakana, hiragana, etc. is digitally signed.

[Embodiment 9: Modification of Digital Signature]
In the above embodiments 5 to 7, for example, when the encrypted information encrypted with the private key and the public key are decrypted, and the decryption result matches the encoded information (hash value, etc.) before encryption, the authentication is successful. It was determined that However, the process of Embodiments 5-7 is not necessarily limited to such a process. For example, in various authentication processes as described above, authenticity determination process, falsification detection process, etc., it is created from encoded information generated from QR code etc. and encoded information in addition to authentication by private key and public key It may be determined that the authentication is successful by determining that the digital signature has a predetermined relationship. As a procedure for such digital signature, Digital Signature Algorithm
(DSA) Elliptic curve DSA, ElGamal signature, etc. may be used. When these digital signature procedures are used, the authentication subject (user device UD1, authentication server, etc.) instead of determining whether the encoded information and the decoded information match, as shown in T24 of FIG. In addition, it is determined whether or not the encoded information on which the digital signature is based and the digital signature have a predetermined relationship.

[Embodiment 10]
(Issues for improving the reading accuracy of composite codes)
When the first code is a QR code, the area and orientation of the QR code are determined by the position detection pattern (finder pattern), and the XY coordinate value at the center of each cell is calculated by the timing pattern. However, if the optical axis of the camera is not perpendicular to the medium surface on which the QR code is formed (when the camera is tilted with respect to the medium) or the medium is curved, the QR code is deformed. To be imaged. Depending on the degree of deformation, the XY coordinate value at the center of each cell calculated by the timing pattern may deviate beyond an allowable limit, and coordinate values in adjacent cells may be obtained. When such a shift in the XY coordinate value at the center of the cell occurs, the determination of the lightness / darkness of the cell may not be accurately determined. Therefore, the QR code is devised to correct the coordinate value by the alignment pattern to increase the accuracy of the XY coordinate value at the center of each cell. Thereafter, it is determined whether the position of the coordinate value or the area of a predetermined area in the vicinity is bright or dark, and numerical data stored in the QR code is acquired. In this case, the accuracy of the central coordinate value is not limited to the center of the cell as long as it is within the cell where the brightness of the cell can be determined. However, when numerical data is acquired based on the coordinates of the second code mark formed in the cell based on the coordinate value of the center of the cell of the first code, the arrangement of the mark can be properly recognized. A degree of accuracy is desired. Therefore, in order to increase the accuracy, it is desirable to correct the coordinate value of the center of the cell of the first code by a predetermined method or separately obtain it from the shape and arrangement of the mark of the first code.

  Hereinafter, a calculation method of cell center coordinate values and a process of acquiring numerical data when dots are used as marks of the second code will be described. FIG. 61 shows an embodiment in which eight information dot placement candidate positions in a cell are placed as shown in FIG. FIG. 62 is a diagram exemplifying dot arrangement positions within one cell. 8-bit numerical data can be defined by whether or not 8 dots are placed. Dots are arranged on concentric circles at roughly equal intervals (in the figure, every 45 degrees), so to ensure the accuracy of the placement position, print with a high-resolution printer of about 2400 DPI or higher. To. FIG. 62 shows an example of a part of a composite code, in which information dots are arranged only in light cells to form a dot code. Although not shown, information dots may be arranged in dark cells or information dots may be arranged in both. FIG. 63 is an example of an image in which the coordinate position of the center of the cell obtained according to the QR code specification deviates from the original center of the cell. In the example of FIG. 63, the position indicated by a cross is the coordinate position obtained as the center of the cell by the first code (QR code in the figure), but it can be seen that it is shifted from the center of the cell. In the present embodiment, a method for correcting the shifted position to an appropriate center coordinate value of a cell indicated by a cross will be described.

( Calculation of cell center coordinates )
In one cell, a boundary where the brightness of the cell changes in the vertical direction from the cross of P ₁ (X ₁ , Y ₁ ) is searched, and two boundary coordinate values B _1U (X ₁ , Y _1U ) _Find B _1D (X ₁ , Y _1D ). Here, since the difference value Y _1U -Y _1D of the Y coordinate is approximately the same as the cell size acquired by the first code, it can be seen that it is one light cell in the vertical direction, and X _1C = X ₁ , Y _1C = Y _1D + (Y _1U −Y _1D ) / 2, the center position B _1C (X _1C , Y _1C ) between the upper and lower boundaries is obtained. Further, B _1L (X _1L , Y _1C ) and B _1R (X _1R , Y _1C ) are obtained as two boundary coordinate values in the left-right direction starting from B _1C . Here, X _1R -X _1L is approximately the same as the cell size obtained with the first code, so it can be seen that it is one light cell in the left-right direction, and X ' _1C = X _1L + (X _1R -X _1L ) / 2 and Y ' _1C = Y _1C , the center position B' _1C (X ' _1C , Y' _1C ) between the left and right boundaries is obtained, and the center coordinate value P 'of the cell indicated by the x mark ₁ (X ′ _1C , Y ′ _1C ) is obtained.

Next, in other cells, the boundary where the brightness of the cell changes in the vertical direction from the cross of P ₂ (X ₂ , Y ₂ ) is searched, and the two boundary coordinate values in the vertical direction are set as B _2U (X ₂ , Y _2U ) and B _2D (X ₂ , Y _2D ) are obtained. Here, since the difference value Y _2U -Y _2D of the Y coordinate is about the same as the cell size obtained by the first code, it can be seen that there is one light cell in the vertical direction, X _2C = X ₂ , and Y _2C = Y _2D + (Y _2U −Y _2D ) / 2, the center position B _2C (X _2C , Y _2C ) between the upper and lower boundaries is obtained. Further, B _2L (X _2L , Y _2C ) and B _2R (X _2R , Y _2C ) are obtained as two boundary coordinate values in the left-right direction starting from B _2C . Here, X _2R -X _2L is about twice the cell size obtained with the first code, so it turns out that there are two bright cells in the left and right direction, and X ' _2C = X _2L + (X _2R -X _2L ) × 1/4 and Y ' _2C = Y _2C gives the center position B' _2C (X ' _2C , Y' _2C ) between the left and right boundaries The central coordinate value P ′ ₂ (X ′ _2C , Y ′ _2C ) of the selected cell is obtained. Similarly, P ' ₃ (X' _3C , Y _3C ) is obtained by linear interpolation and X ' _3C = X _2L + (X _2R -X _2L ) × 3/4 and Y' _3C = Y ' _2C Also good. Similarly to the _{above, P 3 (X 3, Y} 3) P based on _{'3 (X' 3C, Y} 3C) may be obtained. Further, P ′ ₄ to P ′ ₆ can be obtained by the same method as described above. It is desirable to perform correction by the above calculation after correcting the captured QR code into a rectangle.

(Dot extraction and numerical data acquisition)
A method in which the reading device extracts dots, obtains the center point of the dots, and acquires the numerical data of the dot code will be described with reference to FIGS. In FIG. 64, the direction of the second code (as a rule of the second code, the direction may be the same as the first code) and the corrected distance and direction from the cell center position P0 are set. It is the figure which showed the bounding box centering on the virtual points P1-P8 by the same grade as the size of a dot. This virtual point is an information dot arrangement candidate position according to the rule of the second code. The reading device determines whether or not the center coordinate value of the dot is included in the bounding box and acquires numerical data. Note that the size of the bounding box may be larger than the dot size as long as it does not overlap with the adjacent bounding box. It is possible to recognize even if the accuracy of the center coordinate value of the dot of the captured image is poor due to poor printing accuracy or shooting environment. However, there is a higher possibility of being affected by noise (error printing) due to ink jumping or the like as much as it becomes larger. Of course, when the accuracy of the center coordinate value of the acquired dot is sufficiently ensured, the size of the bounding box may be smaller than the size of the dot.

  FIG. 65 is an example of a light cell in which a dot code in which 01101001 is defined in binary notation with the upper dot arrangement candidate position at the head and with digits shifted clockwise is formed. 66 and 67 are examples of images obtained by capturing the cell using a C-MOS sensor or the like. Imaging refers to an operation of recording or recording a captured image on a storage medium such as a frame buffer. In order to simplify the description, this image is shown in light and dark 65 levels (including light and black). Normally, when imaging with only light and shade, the image is often recorded in 8 bits, that is, 256 levels. In color, images are captured in 16.7 million colors with 8 bits each for R, G, and B. 66 to 69, numerals 1 to 15 attached to the vertical axis are numbers indicating pixel rows (scanning lines) of the image.

  When the reading device extracts dots from the captured image, a gray value that falls below a predetermined absolute threshold (for example, 255 is white, 0 is black, and if the absolute threshold is 60, the gray value is 60 or less. ) May be determined to be dots. In that case, it is desirable to set the absolute threshold value from the average value of the gray values in a predetermined range excluding the dots of the light cell for each light cell. In other words, the threshold value may be made variable when the shading value of the light color region is low, and may be raised when the shading value is high. The absolute threshold is preferably 20% to 40%, for example, of the average value of the light and shade values in a predetermined range excluding the dots of the light cell.

  FIG. 70 shows an example of processing for binarizing an image based on the relationship between the gray value obtained from the image and the absolute threshold value. In the figure, the vertical axis represents, for example, the brightness value (gray scale value) of the pixel corresponding to the fourth pixel row (scanning line 12) from the bottom in the image of FIG. 69, and the horizontal axis represents the horizontal direction. The pixel positions lined up in are illustrated. Also, in FIG. 70, the numbers with numbers in the circles are codes for identifying each pixel. In FIG. 70, if the average value of the light color part is 200 and 60% (dotted line) of 30% is the absolute threshold value, the pixels (4), (10), and (11) are binarized to become dark colors. As a pixel (pixel) in the fourth row from the bottom of 69, it is determined as a dot.

  On the other hand, as shown in FIG. 67, the grayscale value may be acquired in the scanning line direction, and the threshold value may be used as the relative threshold value from the change rate of the grayscale value from the bright color portion to the dot portion. In order to make the rate of change remarkable, it is desirable to compare the pixel with which the gray value of the captured image is compared with the gray value of the next two to three pixels. As for the rate of change, it is desirable to set the relative threshold value so that the gray value of the pixel forming the dot is about 40% to 60% or less with respect to the gray value of the light color pixel.

In FIG. 70, on the scanning line 12, a relative threshold value is set by multiplying the gray value of the pixel in the light color region by the change rate α = 0.5 (50%) with 1 pixel between the pixels to be compared. For pixels with gray values below the relative threshold, (1) (0.5 × 255 = 127.5) and (3) (102), (2) (0.5 × 255 = 127.5) and (4) (0), (7 ) (0.5 × 255 = 127.5) and (5) (102) are compared, and (3), (4), (5) are binarized in black, and (8) (0.5 × 255 = 127.5) and ( 10) (51), (9) (0.5 × 255 = 127.5) and (11) (0) are compared, and (10), (11) are binarized in black. As shown in FIG. Determined. As described above, grayscale pixels are binarized in black. Note that, after pixels that have been binarized in black are generated, pixels in which the gray value is below the change rate continue in the scanning line direction, the pixels are binarized in black. If the gray value of the target pixel is Bi, i) αB _in > B _i and B _i <αB _{i + n} , ii) αB _in > B _i or B _i <αB _{i + n} is there. n indicates that comparison is made with a pixel that is n times away from the target pixel. i) satisfies the relative threshold from both the left and right on the scanning line that the target pixel B _i is a dot, and is determined to be a little narrower dot. On the other hand, ii) satisfies the relative threshold value (change rate) from either the left or right on the scanning line that the target pixel B _i is a dot, and is determined as a dot a little wider. As a result, FIG. 68 shows a result when the threshold value is reduced (when the absolute threshold value is increased or the relative threshold value is decreased). FIG. 69 shows the results when the threshold is strict (when the absolute threshold is lowered and the relative threshold is increased). In any case, as shown in FIGS. 71 and 72, the center coordinate value of the information dot is stored in the bounding box, and the reading device (see Embodiments 1 to 6) is defined by the dot code. Numerical data can be acquired.

The center coordinate value D _C (Xc, Yc) of the dark (or light) dot is calculated from the center of the dot formed from the binarized dark (or light) pixel, and the dark color (or If the coordinate value of n pixels (i = 1 to n) binarized into light colors is D _B (Xi, Yi), Xc = Σ _{i = 1 to n} Xi / n, Yc = Σ _{i = 1 ~ n} Yi / n This calculation may also be used to calculate the dot center coordinate values in other embodiments.

( Calculation of light cell center coordinate value with reference dot placed in dark cell )
A method for calculating the cell center coordinate value directly from the light-colored reference dots arranged in the dark cell without using the cell center coordinate value calculated by the first code will be described with reference to FIGS. 73 and 74. FIG. FIG. 73 shows an example in which information dot arrangement candidate positions in a cell are set as in FIG. Also in FIG. 73, as shown in FIG. 62, information dots are arranged only in bright cells. However, in FIG. 73, dot codes are formed by arranging reference dots only in dark cells. In FIG. 73, although not shown, information dots may be arranged in dark cells and reference dots may be arranged in light cells. In FIG. 73, the light-colored reference dots arranged in the dark-colored cell can be easily searched for the light-colored dots from the continuous dark-colored area around the central coordinate value in the dark-colored cell calculated from the first code. Even if the central coordinate value in the dark cell calculated from the first code is not used, it may be searched whether a light color dot exists in an area where the dark color area is continuous.

  FIG. 74 is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. In FIG. 74, the position indicated by a cross is the coordinate position obtained as the center of the cell by the first code, but it can be seen that it is shifted from the center of the cell. A method for obtaining an appropriate center coordinate value of the cell indicated by the x mark from the shifted position will be described below.

  First, the reading device searches for the position of the reference dot arranged in the dark cell. As a search method, the reading device searches a region having a high density of reference dots using a predetermined threshold value from surrounding dark cells starting from the central coordinate value of the dark cell obtained by the first code. Then, the center position of the area may be obtained and used as the center coordinate value of the reference dot. Next, the center positions of the reference dots are connected to each other by a virtual straight line in the vertical and horizontal directions, and the coordinates of the intersection are used as the central coordinate values of the light cell. What is necessary is just to interpolate or extrapolate to the bright cell which does not have an intersection from the intersection obtained in the other up-down and left-right directions.

(Calculation of cell center coordinate value with reference dot placed in light cell)
A method of calculating a central coordinate value of a cell by arranging a reference dot in the center of a light cell with the second code and searching for the reference dot will be described with reference to FIGS. FIG. 76 shows an embodiment in which the information dot arrangement candidate position in the cell is set and the reference dot is arranged in the center as in FIG. FIG. 75 is an embodiment showing a part of a composite code, and a dot code is formed by arranging reference dots and information dots only in light-colored cells. Although not shown, reference dots and information dots may be arranged in dark cells. By recognizing this reference dot, it is possible to more accurately recognize the arrangement of information dots that are arranged at a distance and a direction from the reference dot to define numerical data.

  FIG. 77 is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. In FIG. 77, the position indicated by a cross is the coordinate position obtained as the center of the cell by the first code, but it can be seen that it is shifted from the center of the cell. A method for obtaining an appropriate center coordinate value of the cell indicated by the x mark from the shifted position will be described below.

  First, the reading device searches for the position of the reference dot arranged in the light color cell. As a search method, the reading device determines whether the dot in the vicinity of the central coordinate value of the light cell obtained by the selected first code is the reference dot or the arrangement with the dot arranged in another light cell. Judgment from the relationship. That is, the reading apparatus may determine whether or not the dots are arranged linearly from the dots at a predetermined interval. If this condition cannot be satisfied, the reading apparatus then repeats the determination of whether the above condition is satisfied with neighboring dots and recognizes the reference dot. On the other hand, the reading device may calculate the cell center coordinate value by the method described with reference to FIG. 63, and may use the dot closest to the coordinate value as the reference dot. In addition, by making the reference dot different from the information dot in size, shape, color, and arrangement pattern (there may be a plurality of reference dots), the correction of the cell center coordinate value as described above is not performed. The reading device can easily recognize the reference dot.

  Note that the reference dot shown above is not necessarily a dot arranged in the center of the cell, but may be arranged anywhere in the cell as long as it can be identified as the reference dot. In FIG. 78, the direction of the second code (as a rule of the second code, the direction may be the same as the first code), and the distance and direction from the center position P0 of the reference dot are set. FIG. 5 is a diagram showing a circular bounding box centered on virtual points P1 to P8 with the same size as the dot size. This virtual point is an information dot arrangement candidate position according to the rule of the second code. Here, the reading device determines whether or not the center coordinate value of the dot is included in the bounding box and acquires numerical data. The specification of the bounding box is the same as in FIG.

(Calculation of cell center coordinate value with reference dots placed in light and dark cells)
A method of calculating a central coordinate value of a cell by arranging a reference dot in the center of a light cell and a dark cell with the second code and searching for the reference dot will be described with reference to FIGS. FIG. 79 shows an example of a part of a composite code. A dot code is formed by arranging reference dots in light cells and dark cells and information dots only in light cells. Although not shown, information dots may be arranged in dark cells or information dots may be arranged on both. With respect to the light-colored reference dots arranged in the dark cell, the reading device can easily search for the light-colored dot from the continuous dark color region around the central coordinate value in the dark cell calculated from the first code. The reading device only has to search for the presence of light dots in the region where the dark color regions are continuous without using the central coordinate value in the dark cell calculated from the first code. By recognizing this reference dot, it is possible to more accurately recognize the arrangement of information dots that are arranged at a distance and direction from the center position of the reference dot and in which numerical data is defined.

  FIG. 80 is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. In FIG. 80, the position indicated by the cross is the coordinate position obtained as the center of the cell by the first code, but it can be seen that it is shifted from the center of the cell. A method for obtaining an appropriate center coordinate value of the cell indicated by the x mark from the shifted position will be described below. The reading device first searches for the position of the reference dot placed in the dark cell. As a search method, the reading device searches a region having a high density of reference dots using a predetermined threshold value from surrounding dark cells starting from the central coordinate value of the dark cell obtained by the first code. Then, the center position of the area may be obtained and used as the center coordinate value of the reference dot. Next, the center positions of the reference dots are connected to each other by a virtual straight line in the vertical and horizontal directions, and the coordinates of the intersection are used as the central coordinate values of the light cell. What is necessary is just to interpolate or extrapolate to the bright cell which does not have an intersection from the intersection obtained in the other up-down and left-right directions. The reading apparatus sets the dot in the vicinity of the central coordinate value of the light cell as a reference dot position arranged in the light cell. Note that the reference dot shown above is not necessarily a dot arranged in the center of the cell, but may be arranged anywhere in the cell as long as it can be identified as the reference dot.

(Calculation of cell center coordinate value with reference dot placed in light cell (in case of information division cell))
81 to 84 will explain another example of a method of calculating a central coordinate value of a cell by searching for the reference dot by arranging the reference dot at the center of the bright cell with the second code. In FIG. 82, a light cell is divided into four parts vertically and horizontally to generate 16 divided cells, and four information cell division candidate positions are arranged except for four central divided cells, and further light cell This is an embodiment in which a reference dot is arranged in the center of the. Here, as shown in FIG. 82, a light cell (or dark cell) is divided and a dark color (dark cell) formed in a divided region (also referred to as a divided cell) that does not touch the reference dot. In this case, the divided dark color region (light color for dark cells) when information is defined by a light color region is referred to as an information division cell.

The number of information division cells that can be arranged when the dark color area included in the light cell is 33% or less is (16/3) -1 (for the reference dot) = 4, and one light cell arrangement can count information dividing cells is four maximum amount of information the numerical data that can be defined, there are _{12 C 4 + 12 C 3 +} 12 C 2 + 12 C 1 + 12 combinations of C ₀ = 2,554 ways. In other words, it is 2 ^11.32 and numerical data of 11 bits or more can be defined. Since the reference dot is arranged in the center, in order to ensure the accuracy of the arrangement position, the reference dot is printed by a high-resolution printing machine of about 1200 DPI or more.

  FIG. 81 shows an example of a part of a composite code, in which a reference dot and an information division cell are arranged only in a light color cell to form a division cell code. Although not shown, the reference dot and the information division cell may be arranged in the dark cell. By recognizing this reference dot, it is possible to accurately recognize the arrangement of the information divided cells that are arranged at a distance and direction from the center position of the reference dot and in which numerical data is defined.

  FIG. 83 is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. In FIG. 83, the position indicated by a cross is the coordinate position obtained as the center of the cell by the first code, but it can be seen that it is shifted from the center of the cell. The method for obtaining an appropriate center coordinate value of the cell indicated by the x mark from the shifted position is as described with reference to FIG.

  FIG. 84 shows a hypothesis set by the direction of the second code (as a rule of the second code, the direction may be the same as the first code), and the distance and direction from the center position P0 of the reference dot. FIG. 5 is a diagram showing a rectangular bounding box centered on points P1 to P8 at about 50% of the size of the information division cell. This virtual point is an arrangement candidate position of the information division cell according to the rule of the second code. Here, the reading apparatus determines whether or not a dark color area of a predetermined ratio indicated by the information division cell is included in the bounding box, and acquires numerical data. The method for determining the dark color region is the same as that described with reference to FIGS. The reading device sets an absolute threshold, and if the number of pixels with gray values that are lower than the absolute threshold exceeds a predetermined ratio with respect to the number of pixels that form the bounding box, the reading device determines that the information division cell. The predetermined ratio is desirably about 50 to 75% or more in consideration of a printing deviation of about 20 to 30% with respect to the size of the reference dot and the information division cell depending on the printing accuracy. Note that the reading apparatus sets the size of the bounding box so that the bounding boxes are separated from each other by a predetermined distance so that one information division cell is not included in the adjacent bounding boxes. In this embodiment, it is set at 50% of the size of the information division cell, but it is desirable to set it in consideration of the resolution of the camera at the time of composite code shooting. If the resolution is high, the reader may change the size of the bounding box at the time of recognition to increase the recognition rate of the information division cell.

(Calculation of cell center coordinate value with reference division cell placed in light cell)
A method of arranging a reference divided cell in the center of a light cell with the second code, searching for the reference divided cell, and calculating the central coordinate value of the cell will be described with reference to FIGS. In FIG. 86, a light cell is divided into 5 vertical and horizontal to generate 25 divided cells, except for 9 central divided cells, 16 information division cell arrangement candidate positions are arranged, and the reference division is further arranged in the center. It is the Example which has arrange | positioned the cell. As shown in FIG. 86, a light cell (or dark cell) is divided into a predetermined number, and a reference is made based on a dark color region (light color for dark cells) formed in one of the divided regions. A divided dark color region (light color for dark cells) defining the reference point when defining a point is referred to as a reference divided cell. Similarly, an area in which cells are divided and information is defined by other areas is referred to as an information division cell.

The number of information division cells that can be arranged when the dark color area included in the light cell is 33% or less is (25/3) -1 (for the reference dot) = 7. The maximum number of information division cells that can be placed is 7, and the amount of information that can be defined is ₁₆ C ₇ + ₁₆ C ₆ + ₁₆ C ₅ + ₁₆ C ₄ + ₁₆ C ₃ + ₁₆ C ₂ + ₁₆ C ₁ + _{There are 16} C ₀ = 26,333 combinations. In other words, 2 is ^14.68 , and numerical data of 14 bits or more can be defined. In addition, the number of information division cells that can be arranged when the dark color area included in the light cell is 20% or less is (25/5) -1 (for the reference dot) = 4, and one light color The maximum number of information division cells that can be placed in a cell is 4, and the amount of numerical data that can be defined is ₁₆ C ₄ + ₁₆ C ₃ + ₁₆ C ₂ + ₁₆ C ₁ + ₁₆ C ₀ = 2,517 combinations. is there. In other words, 2 ^11.30 , and numerical data of 11 bits or more can be defined. As shown in FIG. 45, printing one cell at 5 × 5 pixels can be performed by a 600 DPI printer.

  FIG. 85 shows an example of a part of a composite code, in which a reference cell and an information cell are arranged only in light cells to form a divided cell code. Although not shown, the reference division cell and the information division cell may be arranged in the dark cell. By recognizing the reference divided cell, the reading apparatus can accurately recognize the arrangement of the information divided cells that are arranged with the distance and direction from the center position of the reference divided cell and in which numerical data is defined.

  FIG. 87 is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. In FIG. 87, the position indicated by a cross is the coordinate position obtained as the center of the cell by the first code, but it can be seen that it is shifted from the center of the cell. A method for obtaining an appropriate center coordinate value of the cell indicated by the x mark from this shifted position will be described below. The reading device first searches for the position of the reference divided cell arranged in the light cell. As a search method, the reading device determines whether the divided cell near the central coordinate value of the light cell obtained by the selected first code is a reference divided cell, and is divided into other light cells. It is determined from the arrangement relationship. That is, the reading apparatus may determine whether or not the divided cells are arranged in a straight line from the divided cells at a predetermined interval. If this condition cannot be satisfied, the reading apparatus then repeatedly determines whether the above condition is satisfied in the neighboring divided cells, and recognizes the reference divided cell.

  On the other hand, the cell center coordinate value may be calculated by the method described with reference to FIG. 66, and the cell closest to the coordinate value may be used as the reference divided cell.

  FIG. 88 is set by the direction of the second code (as a rule of the second code, the direction may be the same as the first code), and the distance and direction from the center position P0 of the reference divided cell. FIG. 5 is a diagram showing a rectangular bounding box centered on virtual points P1 to P8 at about 50% of the size of an information division cell. This virtual point is an arrangement candidate position of the information division cell according to the rule of the second code. Here, the reading apparatus determines whether or not a dark color area of a predetermined ratio indicated by the information division cell is included in the bounding box, and acquires numerical data. The dark color region determination method is the same as that described with reference to FIG. The reading device sets an absolute threshold, and if the number of pixels with gray values that are lower than the absolute threshold exceeds a predetermined ratio with respect to the number of pixels that form the bounding box, the reading device determines that the information division cell. The reading device desirably has a predetermined ratio of about 50 to 75% or more in consideration of a printing deviation of about 20 to 30% with respect to the size of the reference dot and the information division cell depending on the printing accuracy. The reading device sets the size of the bounding box so that the bounding boxes are separated by a predetermined distance so that one information division cell is not included in the adjacent bounding boxes. In this embodiment, the reading device is set at 50% of the size of the information division cell, but it is desirable to set it in consideration of the resolution of the camera at the time of composite code shooting. If the image to be acquired has a sufficiently high resolution, the reading device may change the size of the bounding box at the time of recognition to increase the recognition rate of the information division cell.

(Calculation of light cell center coordinate value with reference division cell placed in dark cell)
A method for calculating the cell center coordinate value directly from the light-colored reference divided cells arranged in the dark cell without using the cell center coordinate value calculated by the first code will be described with reference to FIGS. FIG. 90 is an example in which a light cell is divided into 5 vertical and horizontal to generate 25 divided cells, and 24 information division cell arrangement candidates are arranged except for one central division cell. The number of information division cells that can be arranged when the dark color area included in the light cell is 33% or less is 25/3 = 8, and the number of information division cells that can be arranged in one light cell is the maximum. The number of numerical data that can be defined is ₂₄ C ₈ + ₂₄ C ₇ + ₂₄ C ₆ + ₂₄ C ₅ + ₂₄ C ₄ + ₂₄ C ₃ + ₂₄ C ₂ + ₂₄ C ₁ + ₂₄ C ₀ = There are 1,271,626 combinations. In other words, 2 is ^20.28 , and numerical data of 20 bits or more can be defined. In addition, the number of information division cells that can be arranged when the dark color area included in the light cell is 20% or less is 25/5 = 5, and the number of information division cells that can be arranged in one light cell is a maximum of five, the amount of information of the numerical data that can be defined, it is _{24 C 5 + 24 C 4 +} 24 C 3 + 24 C 2 + 24 C 1 + 24 combinations of C ₀ = 55,455 ways. In other words, 2 ^15.76 , and numerical data of 15 bits or more can be defined. Figure? ? As shown in the above, printing is possible with a 600 DPI printer. Needless to say, you can print on a printing machine with a resolution higher than 600 DPI.

  FIG. 89 shows an example showing a part of a composite code, in which an information division cell is arranged only in a light color cell and a reference division cell is arranged only in a dark color cell to form a division cell code. Although not shown, the information division cells may be arranged in dark cells and the reference division cells may be arranged in light cells. The reading device can easily search for the light color divided cells from the continuous dark color area around the central coordinate value in the dark cell calculated from the first code for the light color reference divided cells arranged in the dark cell. The reading device may search for the presence of the light-colored divided cells in the area where the dark color areas are continuous without using the central coordinate value in the dark color cells calculated from the first code.

  FIG. 91 is an example of an image in which the coordinate position obtained as the center of the cell by the first code is shifted from the original center of the cell. In FIG. 91, the position indicated by a cross is the coordinate position obtained as the center of the cell by the first code, but it can be seen that it is deviated from the center of the cell. A method for obtaining an appropriate center coordinate value of the cell indicated by the x mark from the shifted position will be described below. The reading device first searches for the position of the reference divided cell arranged in the dark cell. As a search method, the reading device uses a predetermined threshold value from the surrounding dark cells starting from the central coordinate value of the dark cell obtained by the first code, and uses the predetermined threshold value as a starting point to search for a high-concentration region of the reference divided cell. A center position of the reference divided cell may be obtained by searching and obtaining the center position of the region. Next, the reading apparatus connects the center positions of the reference divided cells with virtual lines in the vertical and horizontal directions, and sets the coordinate value of the intersection as the central coordinate value of the light cell. The reading device may obtain a light cell without an intersection by interpolating or extrapolating from the intersection obtained in other vertical and horizontal directions.

FIG. 92 shows a virtual point P1 set by the direction of the second code (as a rule of the second code, the direction may be the same as the first code), the distance from the cell center position P0, and the direction. FIG. 10 is a diagram showing a rectangular bounding box centered on P24 at about 50% of the size of the information division cell. This virtual point is an arrangement candidate position of the information division cell according to the rule of the second code. The reading apparatus determines whether or not a dark color area of a predetermined rate indicated by the information division cell is included in the bounding box, and acquires numerical data. The dark color region determination method and the bounding box specifications are as described with reference to FIGS. A dark reference division cell may also be arranged at the center of the light cell. The reading apparatus uses the dark divided cell near the central coordinate value of the light cell obtained by the reference divided cell arranged in the dark cell as the position of the reference divided cell arranged in the light cell from the center position of the reference divided cell. Numerical data may be acquired as a rectangular bounding box centered on the virtual points P1 to P24 set by the distance and direction. In this case, the number of information division cells that can be arranged in the light cell is reduced by 1, and the information amount is reduced.
In the present embodiment, a large amount of numerical data can be defined in one cell, but in addition to accurately obtaining the coordinate value at the center of the cell, it is necessary to ensure the imaging resolution and printing accuracy of a predetermined camera. If they are not sufficient, the incidence of false positives is high. To eliminate this, it is necessary to form a large amount of error correction codes, but the amount of information is greatly reduced. FIG. 93 is an embodiment in which the information division cell candidate arrangement positions of FIG. As a result, if an information division cell is recognized at a position that does not originally exist in the bounding box of FIG. 94, an error occurs. If the error can be recognized, the number of error correction codes can be reduced, and the data storage amount can be increased. Furthermore, as shown in FIGS. 95 to 102, if the bounding box is moved and the divided cell is not recognized at a position where the divided cell does not exist, the bounding box is correctly set. Get it. The movement amount of the bounding box obtained here can be used in other cells. Note that the bounding box in FIGS. 95 to 102 may be moved in stages. The information division cell candidate arrangement position in FIG. 90 may be any arrangement as long as the information division cell candidate arrangement positions are not adjacent to each other.

(Composite code generation process)
The composite code generation process in the tenth embodiment is the same as that in the first to ninth embodiments except that a reference point is set in a cell. Therefore, the composite code generation processing according to the tenth embodiment follows the processing illustrated in FIGS. 47, 49, 51, 53, 55, 57, and 59 as it is. However, in these processes, management server MS1 etc. should just set a reference point to a desirable cell (namely, cell which should set a reference point). For example, the management server MS1 or the like may include a reference point in the second code when the second code is generated.

<Setting the bounding box>
When the cell center coordinate value is accurately obtained, it is necessary to accurately set a bounding box for obtaining numerical data. As shown in FIG. 64, the virtual points P1 to P8 that are the center of the bounding box are defined by the geometrical arrangement relationship depending on the distance and direction from the cell center position P0. This geometrical relationship is recorded in software that acquires numerical data from the storage medium of the composite code reader or the second code. On the other hand, in FIG. 103, as shown in the light cell at the upper left of the composite code in FIG. A reference pattern) may be formed and recognized. Thus, the reference pattern can be acquired directly from the image obtained by capturing the composite code with the camera, the bounding box can be set more accurately, and the numerical data can be acquired. Although not shown, the reference pattern may be formed in both dark cells (bright reference dots) or bright and dark colors. When the first code is a QR code, it may be arranged in a predetermined cell where a position detection pattern (finder pattern), timing pattern, alignment pattern, and format information are formed. Here, when the cell size is 0.3 × 0.3 mm and the dot diameter is 0.045 mm, the ratio of the dot in the cell is π × (0.045 / 2) ² × 9 / (0 .3 × 0.3) = 0.159 (15.9%), which is 20% or less, and there is no problem in reading the QR code. However, in the case of 0.169 × 0.169 mm, which is the smallest cell size of the QR code, the proportion of dots in the cell exceeds 33%, which impedes the reading of the QR code. In that case, the reference pattern is divided into virtual points in the vertical direction and virtual points in the oblique direction, and as shown in FIG. 104, there are 5 each in the first and second dark cells in the upper right of the composite code in FIG. Two types of patterns may be formed using the reference dots. As a result, the proportion of dots in the cell is π × (0.045 / 2) ² × 5 / (0.169 × 0.169) = 0.278 (27.8%), which is 33% or less. There is no problem in reading the QR code. These two types of patterns may be combined and used as a reference pattern. Of course, the reference pattern may be decomposed into three or more types to form a pattern in a plurality of cells, or arranged in at least one of a dark color cell (light color reference dot) or a light color cell (dark color reference dot). Also good. These plural different patterns may be used as independent reference patterns, and numerical data may be acquired by setting corresponding bounding boxes for cells in which information dots having different arrangement patterns corresponding to the respective patterns are formed.

  FIG. 105 shows an example in which a reference pattern is formed on the composite code of FIG. 77, but since the dot is not arranged at the center of the light cell in which the information dot is arranged, the reference pattern can be easily recognized. Further, when a reference pattern is formed in a dark cell in which a bright reference dot is arranged at the center, the reference pattern can be easily recognized by the number of reference dots. The reference pattern may be formed in both dark cells (bright color reference dots) or bright and dark colors.

  FIG. 106 is an example in which a plurality of reference patterns are arranged at predetermined intervals of light and / or dark cells of the composite code of FIG. As a result, even if the QR code is deformed and imaged and the degree of deformation changes for each region, the bounding box of the second code formed in the surrounding cells can be set with the plurality of imaged reference patterns. Thus, it is possible to acquire numerical data more accurately. In this embodiment, the information dot defining the numerical data can be easily recognized since the center reference dot is not arranged because the center position P0 of the cell can be obtained accurately. When the reference dots are arranged, they may be formed in cells having a predetermined arrangement. In any of the embodiments of FIGS. 61 to 78 and FIGS. 79 to 92, a plurality of reference patterns may be arranged at predetermined intervals of cells.

  In FIG. 107, in the dark cell (or light cell) surrounded by dark cells (or light cells) in the composite code of FIG. 83, the light color (or dark color) whose center position is P0 in FIG. This is an example in which a reference pattern is formed by the reference dots and the bright (or dark) reference divided cells whose center positions are P2, P5, P8, and P11. By obtaining the central coordinate values of P2, P5, P8, and P11, the center positions of P1, P3, P4, P6, P7, and P12 can be interpolated to set a bounding box centered on virtual points P1 to P12. . Further, instead of the reference dot at the center, the reference divided cell may be formed similarly in the composite code of FIG. Furthermore, the size of the reference dots and / or reference divided cells forming this reference pattern is the same or easily recognizable, and only the interval is multiplied by a predetermined multiple (similar enlargement) to obtain the center coordinate value thereof. After that, by dividing the interval by a predetermined number (similar reduction), a reference pattern with an appropriate arrangement is obtained, and the geometrical point with the virtual point that becomes the center of the bounding box according to the distance and direction from the cell center position The positional relationship can be acquired with high accuracy. Needless to say, any of the embodiments shown in FIGS. 61 to 78 and FIGS. 89 to 92 can have the same configuration.

FIG. 108 is an embodiment in which two types of patterns are formed by five light-colored reference divided cells in the first and second dark cells at the upper right of the decoding pattern of FIG. In the upper right first stage pattern, reference divided cells are formed in the center and in the vertical and horizontal directions, and in the upper right second stage pattern, reference divided cells are formed in the center and diagonal directions. First, as shown in FIG. 70, binarization processing is performed on the center of the upper right first stage pattern and the reference division cell in the vertical direction, and the reference division formed in the horizontal direction is performed. The cells are binarized in the vertical direction to obtain the center coordinate values of the reference divided cells P10, P14, P18, and P22 shown in FIG. 4 directions are obtained by two diagonal lines passing through P0 that bisects two straight lines orthogonal to the center coordinate value of the four reference divided cells in the cross direction. Next, for the reference divided cells formed in the diagonal direction with respect to the center of the upper right second stage pattern, the diagonal 4 obtained by the upper right first stage pattern from the center coordinate value P0 of the central reference divided cell. Binarization processing is performed in the direction, and the central coordinate values of the reference divided cells of P12, P16, P20, and P24 are obtained. Finally, these two patterns are synthesized and interpolated based on P0 and P10, P12, P14, P16, P18, P20, P22, and P24, and P1 to P8, P9, P11, P13, P15, and P17. , P19, P21, and P23 are obtained as a reference pattern, and a bounding box is set to obtain numerical data. Note that any method may be used for the above binarization processing, and the pattern forming the reference pattern is at least one of a dark cell (light color reference divided cell) and a light color cell (dark color reference divided cell). You may arrange in. Here, the ratio of the reference divided cells of the pattern forming the reference pattern in the cell is 0.045 ² when the side length of the divided cell is 0.045 mm when the cell size is 0.212 × 0.212 mm. × 5 / (0.212 × 0.212) = 0.225 (22.5%), which is 33% or less, and there is no problem in reading the QR code.

  As described above, when the optical axis of the camera is not perpendicular to the medium surface on which the QR code is formed (when the camera is tilted with respect to the medium) or when the medium is curved, the QR code is deformed. However, since the accurate coordinate value of the center of the cell cannot be obtained, the numerical value defined for the cell is obtained by obtaining the accurate coordinate value of the center of the cell and the reference pattern formed in the cell. Explained how to acquire data without misunderstanding. Here, in FIG. 74, FIG. 80, FIG. 91, or other methods, a grid line can be drawn by reference dots or reference divided cells. The area surrounded by the grid lines represents the size and shape of the cell in the vicinity of the position, and the deformation state of the cell is expressed by the distance from the center position of the cell and the virtual point that is the center of the bounding box. The arrangement of the bounding box may be corrected by reflecting it in the geometric arrangement relationship and used for recognition of information dots and information division cells in the vicinity of the position. As a result, even if the QR code is deformed and imaged and the degree of deformation changes for each region, the correction is performed by the shape of the lattice for each region, and the composite code reader of the composite code reader does not form a reference pattern on the composite code. What is necessary is just to correct | amend using the geometric arrangement relationship recorded on the software which acquires numerical data from a storage medium or a 2nd code | cord | chord. It should be noted that the correction of the arrangement of the bounding box by the grid lines may be used in combination with other embodiments. Further, as means for generating a grid line, a boundary between bright and dark cells may be detected, and the grid line may be drawn along the boundary. However, if the captured image when the printing accuracy or QR code is photographed is rotated or deformed, the boundary portion of pixels indicating light and dark becomes uneven, so that the grid lines are smoothed or averaged. It is desirable to form.

  Although not shown, numerical data may be defined in the cell in which the mark indicating the reference point is formed by at least one of the shape, size, color, orientation, and arrangement pattern of the mark indicating the reference point.

<Setting the direction of the second code>
In the case of obtaining numerical data of the second code, the embodiment has been shown on the assumption that the direction of the first code is used. However, when the optical axis of the camera is not perpendicular to the medium surface on which the QR code is formed (when the camera is tilted with respect to the medium) or when the medium is curved, the QR code is deformed. There is a possibility that the degree of deformation changes for each area and the direction for each cell also changes. In some cases, only the second code is acquired regardless of the first code. Therefore, an embodiment in which the direction is set by the second code itself will be described.

  FIG. 109 is an embodiment in which direction dots are added above predetermined reference dots of the decoded code of FIG. 74 to set the direction of the second code. The direction dot may be arranged in any direction with respect to the reference dot as long as the correspondence with the direction of the second code is determined in advance. The direction dot and the reference dot can be easily discriminated by determining whether they are at the center of the cell or whether they are located on the grid line formed by connecting the reference dots. Direction dots can be arranged in any way, but by arranging them at predetermined intervals, the direction of the cell is corrected to reflect the degree of deformation of the captured QR code, and accurate numerical data Realize acquisition. In other words, according to the direction of the cell, by rotating the geometrical relationship with the virtual point that is the center of the bounding box according to the distance and direction from the center position of the cell, the placement of the bounding box is corrected, and the information near the position Used to recognize dots and information division cells. Note that the reference dot at the center of the cell in which the direction dot is formed may be deleted. In that case, since the direction dot is positioned above the intersection of the grid lines formed by connecting the reference dots, the direction can be easily recognized. Alternatively, the direction of the second code may be set by forming a direction dot at a predetermined position in the cell. Although not shown, the orientation may be set by arranging three or more dots whose orientation can be recognized. Furthermore, the orientation may be set by using divided cells instead of the direction dots, or by using a mark whose orientation can be set according to the shape of the mark. Further, in the formation of information dots and information division cells, a specific arrangement that can recognize the orientation may be set.

  FIG. 110 is an example in which the orientation of the second code is set by changing the arrangement of the reference dots constituting the reference pattern provided in the decoded code of FIG. That is, the two types of patterns formed with five reference dots in the first and second dark cells in the upper right are both non-rotation symmetric and can be set in orientation. Since these two types of patterns are combined to form a reference pattern, an embodiment in which a direction function is added to the reference pattern is obtained. It is needless to say that the embodiments of FIGS. 109 and 110 can be formed in at least one of light and dark cells, and can be used in combination with other embodiments.

[Computer-readable recording medium]
A program for causing a computer or other machine or device (hereinafter, a computer or the like) to realize any of the above functions can be recorded on a recording medium that can be read by the computer or the like. The function can be provided by causing a computer or the like to read and execute the program of the recording medium.

  Here, a computer-readable recording medium is a recording medium that stores information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read from a computer or the like. Say. Examples of such a recording medium that can be removed from a computer or the like include a flexible disk, a magneto-optical disk, a CD-ROM, a CD-R / W, a DVD, a Blu-ray disk, a DAT, an 8 mm tape, a flash memory, and the like. There are cards. In addition, as a recording medium fixed to a computer or the like, there are a hard disk, a ROM (read only memory), and the like. Further, an SSD (Solid State Drive) can be used as a recording medium removable from a computer or the like, or as a recording medium fixed to the computer or the like.

  According to the composite code of the present invention, it is possible to store a large amount of information in the same code area by storing the second code in the area of the first code, as compared with the case of only the first code. It becomes possible.

  For example, when a composite code in which the first code is a QR code and the second code is a dot code is printed, the composite code is set to 10 times or more compared to the case in which only the QR code is printed. Displayed on the screen, it is possible to store information more than 100 times the QR code by adding color information to the dot code and changing the time.

  Since it can store a large amount of information, it can store thousands of Japanese characters, photos, audio information, etc. without using the Internet, and can be used in a wide range of applications from document management to entertainment, education, and tourism.

  The composite code according to the present invention is suitable for use in various types of authentication. For example, printing a QR code that enables an electronic signature or URL authenticity determination, or displaying a QR code storing its own biometric information on its own smartphone and reading it by the other party (including the device) Etc. can be easily performed.

  Furthermore, since the QR code currently discloses its specifications, anyone can issue it, and a third party can issue the same code. However, in the composite code according to the present invention, the dot code or the like (second code) is formed by a new secret algorithm in addition to the QR code or the like. It is extremely low and it is possible to issue a unique composite code, which is extremely secure. Furthermore, the QR code can be easily copied and imitated, and information stored in the QR code may be acquired by an unintended third party. However, in the composite code pattern, the second code is difficult to see and imitate.

  As described above, the composite code according to the present invention has many advantages that cannot be realized by the conventional one-dimensional and two-dimensional codes.

<Other aspects>
The present embodiment further includes the following aspects.

(Aspect 1)
A first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array shape;
A composite code pattern comprising: a second code in which at least one mark that can be distinguished from a color of each specific cell is arranged in any one or more of the arranged cells. ,
A composite code pattern in which an arrangement in which at least one of the one or more marks contacts a mark or cell of the same color is excluded.

(Aspect 2)
The composite code pattern according to aspect 1, wherein when a plurality of the marks are arranged in the specific cell, an arrangement in which the marks are in contact with each other is excluded.

(Aspect 3)
The composite code pattern according to aspect 1, wherein a mark indicating a reference point is formed in any one or more of the plurality of cells.

(Aspect 4)
The mark indicating the reference point is formed in the center of the cell,
The composite code pattern according to aspect 3.

(Aspect 5)
In any one or more of the plurality of cells, a mark that defines the direction of the second code is further formed.
The composite code pattern according to aspect 3 or aspect 4.

(Aspect 6)
The mark defining the direction of the second code is
Arranged to deviate from the position where the mark indicating the reference point is formed, or
In addition to the mark indicating the reference point, it is arranged at a position shifted from the position where the mark indicating the reference point is formed.
The composite code pattern according to aspect 5.

(Aspect 7)
The direction of the second code is defined by an arrangement pattern of marks indicating two or more reference points in any one or more of the cells in which marks indicating the reference points are formed.
The composite code pattern according to aspect 3 or aspect 4.

(Aspect 8)
The direction of the second code is defined by the shape of the mark indicating the reference point in any one or more of the cells in which the mark indicating the reference point is formed.
The composite code pattern according to aspect 3 or aspect 4.

(Aspect 9)
The numerical data included in the cell in which the mark indicating the reference point is formed is defined by at least one of the shape, size, color, orientation, and arrangement pattern of the mark indicating the reference point. 9. The composite code pattern according to any one of 8.

(Aspect 10)
The composite code pattern according to any one of aspects 3 to 9, wherein the mark indicating the reference point is identified as a mark other than the reference point by a shape, a color, a size, and an arrangement pattern.

(Aspect 11)
The composite code pattern according to aspect 10, wherein the shape is a line segment, a polygon, or a substantially circular shape.

(Aspect 12)
The arrangement according to any one of aspect 1 or aspect 2, wherein all of the one or more marks are excluded from contact with a boundary between the specific cell and a cell of the same color adjacent to the specific cell. Composite code pattern.

(Aspect 13)
The mark is a mark that can be distinguished from the color of the specific cell by a reading device that reads the composite code pattern, and that does not interfere with the reading of the first code. A mode in which numerical data is defined by arbitrarily setting one or more virtual points at positions having coordinate information in each specific cell and arranging the marks based on the virtual points by a predetermined generation method. The composite code pattern according to any one of 1 to 12.

(Aspect 14)
The virtual point is set at the center of the specific cell,
The composite code pattern according to aspect 13.

(Aspect 15)
A mark indicating a reference point is formed on the virtual point.
The composite code pattern according to aspect 13 or aspect 14.

(Aspect 16)
At least one of the specific cells is formed with a reference pattern including a plurality of marks arranged at mark placement candidate positions where the numerical data is defined based on the virtual point.
The composite code pattern according to any one of aspects 13 to 15.

(Aspect 17)
The mark that does not obstruct the reading of the first code is such that the total area of the marks in the specific cell is within a ratio of 33% with respect to the area of the specific cell.
The composite code pattern according to any one of aspects 13 to 16.

(Aspect 18)
The mark that does not obstruct the reading of the first code is such that the total area of the marks in the specific cell is within a ratio of 20% with respect to the area of the specific cell.
The composite code pattern according to any one of aspects 13 to 16.

(Aspect 19)
The composite code pattern according to aspect 13, wherein at least a part of the numerical data is defined by at least one of a direction and a distance in which the mark is arranged starting from the virtual point.

(Aspect 20)
The specific cell includes at least a part of the numerical data of the specific cell according to at least one of a mark shape, a color, an arrangement method of the mark based on the virtual point, and presence / absence of the arrangement. 14. A composite code pattern according to aspect 13, defined.

(Aspect 21)
The composite code pattern according to aspect 13, wherein the color of the mark includes any one of red, green, blue, cyan, magenta, yellow, black, white, and a background color of a region where the specific cell is formed.

(Aspect 22)
The composite code pattern according to any one of aspects 1 to 21, wherein a shape of the mark is a dot.

(Aspect 23)
The composite code pattern according to any one of aspects 1 to 21, wherein a shape of the mark is a line segment, a polygon, or a substantially circular shape.

(Aspect 24)
The composite code pattern according to aspect 23, wherein a part of the numerical data is defined by at least one of a direction and a length of the line segment.

(Aspect 25)
25. The composite code pattern according to aspect 23 or 24, wherein a part of the numerical data is defined by arranging any position in the line segment on the virtual point.

(Aspect 26)
The composite code pattern according to any one of aspects 1 to 25, wherein the first code is a code including any one of a bar code, a QR code, a color code, DataMatrix, and PDF417.

(Aspect 27)
The cells include dark cells and light cells,
27. The composite code pattern according to any one of aspects 1 to 26, wherein a light color mark is arranged in a dark cell or a dark color mark is arranged in a light cell. .

(Aspect 28)
The composite code pattern according to any one of aspects 1 to 27, wherein the composite code pattern is printed or stamped on a medium, or displayed on a display device by output from an electronic medium, a broadcast medium, a storage medium, or a communication medium. Code pattern.

(Aspect 29)
The composite code pattern is displayed on the display device as time-series data in which at least one of the first code and the second code is formed by a plurality of element data for each time.
29. The composite code pattern according to aspects 1 to 28.

(Aspect 30)
Between the element data includes a predetermined non-display time,
The composite code pattern according to either aspect 28 or aspect 29.

(Aspect 31)
A first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array shape;
A composite code pattern comprising: a second code in which at least one mark that can be distinguished from a color of each specific cell is arranged in any one or more of the arranged cells. ,
The specific area provided in at least one of the first code and the second code excludes the specific area of at least one of the first code and the second code. A composite code pattern including specific information corresponding to at least a part of an area.

(Aspect 32)
The composite code pattern according to aspect 23, wherein at least one of the marks according to aspects 1 to 30 is formed.

(Aspect 33)
A first code;
A composite code pattern comprising: a second code on which at least one mark identifiable from the first code is arranged so as to overlap at least a part of a range in which the first code is arranged. And
The specific area provided in at least one of the first code and the second code excludes the specific area of at least one of the first code and the second code. A composite code pattern including specific information corresponding to at least a part.

(Aspect 34)
33. The composite code pattern according to any one of aspects 31 and 32, comprising: the second code superimposed on at least a part of a range where the first code is arranged.

(Aspect 35)
The composite code pattern according to any one of aspects 31 to 34, wherein at least a part of the area excluding the specific area includes information on at least one of text, still images, moving images, and programs.

(Aspect 36)
The composite code pattern according to any one of aspects 31 to 34, wherein at least a part of the area excluding the specific area includes information for specifying an individual.

(Aspect 37)
The composite code pattern according to aspect 36, wherein the information for identifying the individual includes at least information on any of name, sex, date of birth, address, family register, and biometric information.

(Aspect 38)
38. The composite code pattern according to any one of aspects 31 to 37, wherein the specific information is encoded information obtained by encoding at least a part excluding the specific area by an encoding unit.

(Aspect 39)
39. The composite code pattern according to aspect 38, wherein the specific information is encrypted information obtained by encrypting the encoded information by an encryption unit.

(Aspect 40)
40. The composite code pattern according to aspect 39, wherein the encryption information can be decrypted into the encoded information by a decrypting means.

(Aspect 41)
41. The composite code pattern according to aspect 40, wherein a program for causing an information processing apparatus to execute as the decoding unit is included in at least a part excluding the specific area.

(Aspect 42)
The encrypted information is information obtained by encrypting encoded information using a secret key by the encryption means,
The decryption means decrypts the encrypted information using a public key;
The composite code pattern according to any one of aspects 40 and 41.

(Aspect 43)
The encoding means is a hash function;
The encoded information encoded by the hash function is a hash value,
The encryption information encrypted by the encryption means is an encrypted hash value,
The composite code pattern according to any one of aspects 39 to 42, wherein the encrypted hash value can be decrypted into the hash value by the decryption means.

(Aspect 44)
The specific information is information represented by at least a part of the at least one code excluding the specific area or electronic signature information created by an electronic signature unit based on the encoded information, and the electronic signature information Is a composite code pattern according to aspect 38, which can be verified by the verification means to have a predetermined relationship with information represented by at least a part of the at least one code excluding the specific area.

(Aspect 45)
In the composite code pattern, at least one of the mark, graphics, or text for clearly indicating the composite code pattern is formed in a predetermined position in the first code. The composite code pattern according to any one of the above.

(Aspect 46)
A medium on which the decoding code pattern according to any one of aspects 1 to 45 is formed.

(Aspect 47)
At least a portion excluding the specific area is obtained by encoding information corresponding to at least one of a character and an image formed on the medium, and the composite code pattern is formed in the vicinity of or inside the information. 46. A medium according to embodiment 46.

(Aspect 48)
First acquisition means for acquiring the first code included in the composite code pattern according to any one of aspects 1 to 45;
A composite code pattern reading apparatus comprising: a second acquisition unit configured to acquire the second code.

(Aspect 49)
The first acquisition means includes the second acquisition means, and acquires the first code and the second code.
The composite code pattern reading device according to aspect 48.

(Aspect 50)
The second code is acquired based on the mark indicating the reference point according to any one of aspects 3 to 10.
The composite code pattern reading device according to any one of aspects 48 and 49.

(Aspect 51)
The mark indicating the reference point is formed in the center of any one or more of the plurality of cells,
Correcting the center coordinate value of the cell acquired by the first acquisition unit based on the coordinate value of the reference point acquired by the second acquisition unit;
The composite code pattern reading device according to aspect 50.

(Aspect 52)
Using the virtual point according to aspect 16 and the mark forming the reference pattern,
Correcting the mark placement candidate position in which the numerical data is defined;
The composite code pattern reading device according to aspect 50.

(Aspect 53)
At least one of the first code and the second code includes information for identifying an individual,
53. The composite code pattern reading device according to any one of aspects 49 to 52, wherein the information for identifying an individual is information related to at least one of name, sex, date of birth, address, family register, and biological information.

(Aspect 54)
A third acquisition means for acquiring biological information;
45. The composite code pattern reading device according to aspect 44, comprising: biometric information acquired by the third acquisition means; and output means for collating the information for identifying the individual and outputting the correctness.

(Aspect 55)
At least one of the first acquisition unit, the second acquisition unit, the third acquisition unit, and the output unit functions by processing of one or more processors.
56. The composite code pattern reading device according to aspect 53.

(Aspect 56)
A second encoding means capable of performing the same encoding as the encoding means;
The composite code pattern reading device according to any one of aspects 49 to 55, wherein at least a part excluding the specific region is encoded into second encoded information by the second encoding means.

(Aspect 57)
Comprising decryption means,
The composite code pattern reading device according to any one of aspects 49 to 56, wherein the encrypted information is decrypted by the decrypting means into the encoded information before the encryption. .

(Aspect 58)
Have a public key,
The encrypted information is information obtained by encrypting encoded information using a secret key by the encryption means,
The decryption means decrypts the encrypted information using the public key;
58. The composite code pattern reading device according to aspect 57.

(Aspect 59)
Second encoded information encoded by the second encoding means;
The composite code pattern reading device according to any one of aspects 57 to 58, wherein the coding information decoded by the decoding unit is collated to determine whether the specific code is correct or not.

(Aspect 60)
A first generation step in which a computer generates a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array;
A second generation step of generating a second code in which one or more marks that can be distinguished from the color of each specific cell are arranged in any one or more of the arranged cells; and Run,
The composite code pattern generation method which produces | generates the composite code pattern in any one of aspects 1-45.

(Aspect 61)
A computer obtains numerical data from a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array;
Reading of a composite code pattern for obtaining numerical data from a second code in which one or more marks that can be distinguished from the color of each specific cell are arranged in any one or more of the arranged cells A method,
A composite code pattern reading method for reading the composite code pattern according to any one of aspects 1 to 45.

(Aspect 62)
A first generation step of generating, in the computer, a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array shape;
A second generation step of generating a second code in which one or more marks that can be distinguished from the color of each specific cell are arranged in any one or more of the arranged cells; and A composite code pattern generation program to be executed,
A composite code pattern generation program for generating the composite code pattern according to any one of aspects 1 to 45.

(Aspect 63)
A computer obtains numerical data from a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array;
Reading of a composite code pattern for obtaining numerical data from a second code in which one or more marks that can be distinguished from the color of each specific cell are arranged in any one or more of the arranged cells A program,
The composite code pattern reading program which reads the composite code pattern in any one of aspects 1-45.

(Aspect 64)
First generation means for generating a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array shape;
Second generation means for generating a second code in which one or more marks that can be distinguished from the color of each of the specific cells are arranged in any one or more of the arranged cells; A composite code pattern generation device comprising:
The composite code pattern generation apparatus which produces | generates the composite code pattern in any one of aspects 1-45.

10 Information processing apparatus 11 CPU
12 main storage device 13 external storage device 14 display device 15 operation unit 16 communication interface 17 image input interface 18 image output interface CS1, CS2 content server MS1 management server UD1, UD2 user device

Claims (64)

A first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array shape;
A second code formed from numerical data defined by defining one or more marks that can be distinguished from at least the color of each specific cell in one or more specific cells of the plurality of cells; A composite code pattern comprising:
A composite code pattern in which an arrangement in which at least one of the one or more marks contacts a mark or cell of the same color is excluded.
The composite code pattern according to claim 1, wherein when a plurality of the marks are arranged in the specific cell, an arrangement in which the marks are in contact with each other is excluded.
Any The one or more on the mark indicating the reference point is formed, the composite code pattern according to claim 1 of said particular cell.
The mark indicating the reference point is formed in the center of the specific cell,
The composite code pattern according to claim 3.
Wherein the on any one or more of the specific cell, the mark that defines the orientation of the second code is further formed,
The composite code pattern according to claim 3 or 4.
The mark defining the direction of the second code is
Either disposed Te the reference point or Razure, or,
In addition to the mark indicating the reference point is located at a position offset to the reference point or al,
The composite code pattern according to claim 5.
In any one or more of the specific cells in which the mark indicating the reference point is formed, the orientation of the second code is defined by an arrangement pattern of the mark indicating two or more reference points.
The composite code pattern according to claim 3 or 4.
In any one or more of the specific cells in which the mark indicating the reference point is formed, the direction of the second code is defined by the shape of the mark indicating the reference point.
The composite code pattern according to claim 3 or 4.
Shape before KOR over click, size, color, orientation, by at least one of arrangement patterns, before Symbol numerical data is defined, the composite code pattern according to any one of claims 1-8.
Mark indicating the reference point, shape, color, size, the arrangement pattern is identified as the mark other than the reference point, the composite code pattern according to any one of claims 3-8.
The composite code pattern according to claim 10, wherein the shape is a line segment, a polygon, or a substantially circular shape.
Wherein all of the one or more marks, according to any one of claims 1 to 11 for placement in contact with the boundary between the cells is the same color of the mark which is adjacent to the specific cell and the specific cell is excluded Composite code pattern.
The mark is a mark that can be distinguished from the color of the specific cell by a reading device that reads the composite code pattern, and that does not interfere with reading the first code,
Wherein the inside a plurality of specific cells, by the marks arranged one or more virtual points set at a position having a coordinate information in each particular cell based on the numerical data is Ru is defined, according to claim 1 The composite code pattern in any one of -12.
The virtual point is set at the center of the specific cell,
The composite code pattern according to claim 13.
A mark indicating a reference point is formed on the virtual point.
15. The composite code pattern according to claim 13 or claim 14.
At least one of the specific cells is formed with a reference pattern including a plurality of marks arranged at mark placement candidate positions where the numerical data is defined based on the virtual point.
The composite code pattern according to claim 13.
The mark that does not obstruct the reading of the first code is such that the total area of the marks in the specific cell is within a ratio of 33% with respect to the area of the specific cell.
The composite code pattern according to claim 13.
The mark that does not obstruct the reading of the first code is such that the total area of the marks in the specific cell is within a ratio of 20% with respect to the area of the specific cell.
The composite code pattern according to claim 13.
The composite code pattern according to claim 13, wherein at least a part of the numerical data is defined by at least one of a direction and a distance in which the mark is arranged starting from the virtual point.
Wherein the specific cell, the at least one of arrangement method and the presence or absence of the arrangement of the marks of the previous SL virtual point based, at least a portion of the numerical data in which the specific cells have is defined, claims 13. The composite code pattern according to 13.
The color of the mark, red, green, blue, cyan, including magenta, yellow, black, white and any color of the underlying area in which the specific cell is formed, according to any of claims 1 to 20 Composite code pattern.
The composite code pattern according to claim 1, wherein a shape of the mark is a dot.
The composite code pattern according to any one of claims 1 to 21, wherein a shape of the mark is a line segment, a polygon, or a substantially circular shape.
The composite code pattern according to claim 23 , wherein at least a part of the numerical data is defined by at least one of a direction and a length of the line segment.
In the plurality of specific cells, one or more virtual points are set at positions having coordinate information in the specific cells,
The composite code pattern according to claim 23 or 24, wherein a part of the numerical data is defined by arranging any position in the line segment on the virtual point.
The composite code pattern according to any one of claims 1 to 25, wherein the first code is a code including any one of a bar code, a QR code, a color code, DataMatrix, and PDF417.
The cells include dark cells and light cells,
27. The composite code according to claim 1, wherein a light color mark is arranged in a dark cell and a dark color mark is arranged in a light cell. pattern.
The composite code pattern is printed or engraved on a medium, or displayed on a display device by output from an electronic medium, a broadcast medium, a storage medium, or a communication medium. Composite code pattern.
The composite code pattern is displayed on the display device as time-series data in which at least one of the first code and the second code is formed by a plurality of element data for each time.
The composite code pattern according to claim 1.
Between the element data includes a predetermined non-display time,
Composite code pattern according to 請 Motomeko 2 9.
A first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array shape;
A second code formed from numerical data defined by defining one or more marks that can be distinguished from at least the color of each specific cell in one or more specific cells of the plurality of cells; A composite code pattern comprising:
Wherein the first code and the specific region provided on at least one of the second code, except 該特 constant region of the at least one code of said first code and said second code A composite code pattern including specific information corresponding to at least a part of an area.
The composite code pattern according to claim 31 , wherein at least one of the marks according to claims 1 to 30 is formed.
A first code;
A second code formed from numerical data defined by being arranged with one or more marks identifiable from the first code superimposed on at least a part of a range in which the first code is arranged; A composite code pattern comprising:
Wherein the first code and the specific region provided on at least one of the second code, except 該特 constant region of the at least one code of said first code and said second code A composite code pattern including specific information corresponding to at least a part.
The second code, the first code has been example Bei superimposed on at least a portion of the arrangement range, the composite code pattern according to any one of claims 31 or claim 32.
The composite code pattern according to any one of claims 31 to 34, wherein at least a part of the area excluding the specific area includes information on at least one of text, a still image, a moving image, and a program.
The composite code pattern according to any one of claims 31 to 34, wherein information specifying an individual is included in at least a part of the area excluding the specific area.
37. The composite code pattern according to claim 36, wherein the information for specifying the individual includes at least information related to any of name, sex, date of birth, address, family register, and biometric information.
38. The composite code pattern according to claim 31, wherein the specific information is encoded information obtained by encoding at least a part excluding the specific area by an encoding unit.
39. The composite code pattern according to claim 38, wherein the specific information is encrypted information obtained by encrypting the encoded information by an encryption unit.
40. The composite code pattern according to claim 39, wherein the encrypted information can be decrypted into the encoded information by a decrypting means.
41. The composite code pattern according to claim 40, wherein a program for causing an information processing apparatus to execute as the decoding unit is included in at least a part excluding the specific area.
The encrypted information is information obtained by encrypting encoded information using a secret key by the encryption means,
The decryption means decrypts the encrypted information using a public key;
42. The composite code pattern according to claim 40 or claim 41.
The encoding means is a hash function;
The encoded information encoded by the hash function is a hash value,
The encryption information encrypted by the encryption means is an encrypted hash value,
43. The composite code pattern according to claim 39, wherein the encrypted hash value can be decrypted into the hash value by the decrypting means.
The specific information is information represented by at least a part of the at least one code excluding the specific area or electronic signature information created by an electronic signature unit based on the encoded information, and the electronic signature information 39. The composite code pattern according to claim 38, wherein the verification means can verify that the information represented by at least a part of the at least one code excluding the specific area has a predetermined relationship.
45. The composite code pattern has at least one of the mark, graphics, or text for clearly indicating the composite code pattern formed in a predetermined position inside the first code. A composite code pattern according to any one of the above.
A medium on which the decrypted code pattern according to any one of claims 1 to 45 is formed.
At least a portion excluding the specific area is obtained by encoding information corresponding to at least one of a character and an image formed on the medium, and the composite code pattern is formed in the vicinity of or inside the information. 48. The medium of claim 46.
A first acquisition means for acquiring the first code included in the composite code pattern according to any one of claims 1 to 45,
A composite code pattern reading apparatus comprising: a second acquisition unit configured to acquire the second code.
The first acquisition means includes the second acquisition means, and acquires the first code and the second code.
49. The composite code pattern reading device according to claim 48.
The second code is acquired on the basis of the mark indicating the reference point according to any one of claims 3 to 10.
50. The composite code pattern reading device according to claim 48 or 49.
Mark indicating the reference point is formed at the center on any one or more of said specific cells,
Correcting the center coordinate value of the cell acquired by the first acquisition unit based on the coordinate value of the reference point acquired by the second acquisition unit;
The composite code pattern reading device according to claim 50.
Using the virtual point and the mark forming the reference pattern according to claim 16,
Correcting the mark placement candidate position in which the numerical data is defined;
The composite code pattern reading device according to claim 50.
At least one of the first code and the second code includes information for identifying an individual,
53. The composite code pattern reading device according to any one of claims 49 to 52, wherein the information for identifying an individual is information related to at least one of name, sex, date of birth, address, family register, and biometric information.
Third acquisition means for acquiring biological information;
54. The composite code pattern reading device according to claim 53 , further comprising: biometric information acquired by the third acquisition means and output means for collating the information for identifying the individual and outputting the correctness.
At least one of the first acquisition means, the second acquisition means, the third acquisition means, and the output means functions by processing of one or more processors;
55. The composite code pattern reading device according to claim 54 .
A second encoding means capable of performing the same encoding as the encoding means according to claim 38 ;
The at least part except the specific area | region in any one of Claims 31-45 is encoded in 2nd encoding information by the said 2nd encoding means, The any one of Claims 49-55 Complex code pattern reader.
Comprising decryption means,
The composite information according to any one of claims 49 to 56, wherein the encrypted information encrypted by the encryption means according to claim 39 is decrypted into the encoded information according to claim 38 by the decryption means. Code pattern reader.
Have a public key,
The encrypted information is information obtained by encrypting encoded information using a secret key by the encryption means,
The decryption means decrypts the encrypted information using the public key;
58. The composite code pattern reading device according to claim 57.
57. second encoded information encoded by the second encoding means according to claim 56 ;
The composite code pattern reading device according to any one of claims 57 to 58, wherein the coding information decoded by the decoding means is collated to determine whether the specific information according to claim 31 or 33 is correct.
A first generation step in which a computer generates a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array;
A second generation step of generating a second code in which at least one mark that can be distinguished from a color of each specific cell is arranged in one or more specific cells of the plurality of cells; Run,
The composite code pattern generation method which produces | generates the composite code pattern in any one of Claims 1-45.
A computer obtains numerical data from a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array;
Reading a composite code pattern for obtaining numerical data from a second code in which at least one mark distinguishable from the color of each specific cell is arranged in one or more specific cells of the plurality of cells A method,
The composite code pattern reading method which reads the composite code pattern in any one of Claims 1-45.
A first generation step of generating, in the computer, a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array shape;
A second generation step of generating a second code in which at least one mark that can be distinguished from a color of each specific cell is arranged in one or more specific cells of the plurality of cells; A composite code pattern generation program to be executed,
A composite code pattern generation program for generating the composite code pattern according to any one of claims 1 to 45.
A computer obtains numerical data from a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array;
Reading a composite code pattern for obtaining numerical data from a second code in which at least one mark distinguishable from the color of each specific cell is arranged in one or more specific cells of the plurality of cells A program,
The composite code pattern reading program which reads the composite code pattern in any one of Claims 1-45.
First generation means for generating a first code in which a plurality of cells each having one of two or more identifiable colors are arranged in an array shape;
Second generation means for generating a second code in which at least one mark that can be distinguished from the color of each specific cell is arranged in one or more specific cells of the plurality of cells; A composite code pattern generation device comprising:
The composite code pattern generation apparatus which produces | generates the composite code pattern in any one of Claims 1-45.