JP5435814B2 - Method for specifying an area including a code area, program for specifying an area including a code area, and apparatus for specifying an area including a code area - Google Patents

Description

  The present invention relates to a method for specifying a region including a code region for tracking a two-dimensional image code or the like.

  As in Patent Document 1, an apparatus for specifying an object such as a two-dimensional image code and displaying a composite image based on the specified information has been proposed.

JP 2000-82107 A

  However, if a system for identifying the content of the object (code content or the like) is used when specifying the object, the processing speed is slowed down.

  Accordingly, an object of the present invention is to provide a method for specifying an area including a code area without identifying code contents.

  A method for specifying an area including a code area according to the present invention includes a code area including a code area having a code in which a data cell is represented by two colors, a color having a high brightness and a color having a low brightness compared to a color having a high brightness. An imaging process for imaging an object, and a first shape for identifying an outline of a high brightness area that is formed around a code area and has a higher brightness than a color with a lower brightness on an image obtained in the imaging process Any of the search process, the second search process for specifying the outer shape of the code area, the information on the outer shape of the high brightness area specified in the first search process, and the information on the outer shape of the code area specified in the second search process And a specifying step for specifying a code region and a region including a high brightness region or a code region.

  The process of searching for the outer shape of the rectangle outside the code area and the process of specifying the area or code area including the code area and the high brightness area in the specific process do not require the process of identifying the code contents of the code area. There is an advantage that the process of specifying the code area (or the area including the code area and the high brightness area) can be performed faster than the case where such an identification process is required.

  Further, in order to perform the first search process and the second search process, the outer shape of the rectangle outside the code area is specified whether or not the low lightness area is provided around the high lightness area. The code area (or the area including the code area and the high brightness area) can be specified.

  Preferably, the first search step is provided around the high lightness region, and the lightness formed at the boundary between the low lightness region and the high lightness region configured by a color having a lightness lower than that of the color forming the high lightness region. In the second search step, the outer shape of the low-lightness color rectangle formed at the boundary between the code area and the high-lightness area is searched.

  Around the code area, a color area (high brightness area) having a high brightness such as white is usually provided. However, a region with low brightness (low brightness region) such as black may or may not be provided around the high brightness region.

  When the low brightness area is provided around the high brightness area, since the boundary between the high brightness area and the low brightness area is clear, in the first search step, a rectangular area ( The boundary between the high brightness area and the low brightness area) can be specified. However, the low brightness area is not necessarily provided around all the high brightness areas, and the boundary between the high brightness area and the low brightness area is not necessarily rectangular.

  The rectangular straight line formed with the low lightness color at the boundary between the code area and the high lightness area is not only formed with the low lightness color, but also the high lightness color dots are mixed on the low lightness color line. However, the search accuracy may be lower than that of a square line formed with high-lightness colors at the boundary between the high-lightness region and the low-lightness region. In this case, since a high brightness area is provided and there is no limitation on the outer shape of the high brightness area, versatility is high.

  Preferably, the second search step is performed when the outer shape of the high brightness area cannot be specified in the first search step.

  Preferably, at least one of the imaging process, the first search process, and the second search process is repeated at regular intervals.

  By performing at least one of the imaging process, the first search process, and the second search process at regular intervals, the position, size, and degree of deformation of the code area (or the area including the code area and the high brightness area) on the image The direction can be specified, and the code area (or the area including the code area and the high brightness area) can be tracked.

  More preferably, it further includes a superimposing step of superimposing a stereoscopic image on the image obtained in the imaging step based on the information obtained in the specific step.

  If the tracking can be performed, the code area (or the area including the code area and the high brightness area) is related to the position, size, degree of deformation, orientation, etc. In addition, the image processing unit can superimpose a stereoscopic image or the like (superimposition step). In particular, it is possible to superimpose by changing the position, size, degree of deformation, orientation, etc. of the stereoscopic image in accordance with the position of the code area (or the area including the code area and the high brightness area).

  Preferably, the method further includes a code reading step of reading a code in the code region before the imaging step, and the identification of the region including the code region and the high brightness region in the specifying step or the code region is analyzed more than the code reading step. The processing load is small.

  Preferably, the area including the code area and the high brightness area is specified by at least one of the position, size, degree of deformation, and orientation of the area including the code area and the high brightness area on the image obtained in the imaging process. The code area is specified by at least one of the position, size, deformation degree, and orientation of the code area on the image obtained in the imaging process.

  A program for specifying an area including a code area according to the present invention includes a code area including a code area having a code in which a data cell is represented by two colors, a color having a high brightness and a color having a low brightness compared to a color having a high brightness. An imaging process for imaging an object, and a first shape for identifying an outline of a high brightness area that is formed around a code area and has a higher brightness than a color with a lower brightness on an image obtained in the imaging process Any of the search process, the second search process for specifying the outer shape of the code area, the information on the outer shape of the high brightness area specified in the first search process, and the information on the outer shape of the code area specified in the second search process Based on the above, a specifying step for specifying the code region and the region including the high brightness region or the code region is executed.

  An apparatus for specifying an area including a code area according to the present invention includes a code area including a code area having a code in which a data cell is expressed by two colors, a color having a high brightness and a color having a low brightness compared to a color having a high brightness. An image capturing unit that captures an object, and a first shape that specifies an outer shape of a high brightness area that is formed around a code area and has a higher brightness than a color with a lower brightness on an image obtained by the imaging section. Any of the search process, the second search process for specifying the outer shape of the code area, the information on the outer shape of the high brightness area specified in the first search process, and the information on the outer shape of the code area specified in the second search process And an image processing unit that executes a code area and an area including a high brightness area or a specifying step of specifying a code area.

  A method for specifying an area including a code area according to the present invention includes a code area including a code area having a code in which a data cell is expressed by two colors, a color having a high luminance and a color having a low luminance compared to a color having a high luminance. An imaging process for imaging an object, and a first shape for identifying an outer shape of a high-luminance area that is formed around a code area and has a higher luminance than a low-luminance color on the image obtained in the imaging process Any of the search step, the second search step for specifying the outer shape of the code region, the information on the outer shape of the high-luminance region specified in the first search step, and the information on the outer shape of the code region specified in the second search step And a specifying step for specifying a code region and a region including a high brightness region or a code region.

  A program for specifying an area including a code area according to the present invention includes a code area including a code area having a code in which a data cell is expressed by two colors, a color having a higher luminance and a color having a lower luminance than a color having a higher luminance. An imaging process for imaging an object, and a first shape for identifying an outer shape of a high-luminance area that is formed around a code area and has a higher luminance than a low-luminance color on the image obtained in the imaging process Any of the search step, the second search step for specifying the outer shape of the code region, the information on the outer shape of the high-luminance region specified in the first search step, and the information on the outer shape of the code region specified in the second search step Based on the above, a specifying step for specifying the code region and the region including the high brightness region or the code region is executed.

  An apparatus for identifying an area including a code area according to the present invention includes a code area including a code area having a code in which a data cell is expressed by two colors, a color having a higher luminance and a color having a lower luminance than a color having a higher luminance. An imaging unit that captures an object, and a first shape that specifies an outer shape of a high-luminance region that is formed around a code region and has a higher luminance than a low-luminance color on an image obtained by the imaging unit. Any of the search step, the second search step for specifying the outer shape of the code region, the information on the outer shape of the high-luminance region specified in the first search step, and the information on the outer shape of the code region specified in the second search step And an image processing unit that executes a code area and an area including a high brightness area or a specifying step of specifying a code area.

  As described above, according to the present invention, it is possible to provide a code area specifying method for specifying a code area without identifying code contents.

It is a block diagram of a photographic subject in which a high brightness area is provided around a code area and a low brightness area is provided around a high brightness area. FIG. 4 is a configuration diagram of a photographic subject in which a high brightness area is provided around a code area and a low brightness area is not provided around a high brightness area. It is a block diagram of an imaging device. It is a flowchart which shows the operation | movement procedure which tracks a code area | region etc.

  Hereinafter, the configuration of the code tracking system according to the present embodiment will be described with reference to the drawings. The code tracking system according to the present embodiment includes an imaging object 10 and an imaging device 20 (see FIGS. 1 to 3).

  An imaging object 10 is an area indicating a two-dimensional image code in which data cells are represented by two colors of a color with high lightness (for example, white) and a color with low lightness (for example, black), like a QR code (registered trademark). Although it is a printed matter including (code region 10a), it may be a printed matter in which an image including a region (code region 10a) indicating a two-dimensional image code is displayed on a monitor. The two-dimensional image code shown in FIGS. 1 and 2 is used to represent a specific diagram of the two-dimensional image code, but the code content is not related to the present embodiment.

  Around the code area 10a, there is provided a high brightness area 10b having a frame shape, which is composed of a color (for example, white) having a higher brightness than the color having the lower brightness of the two colors constituting the data cell of the code area 10a. In addition, around the high brightness area 10b, a low brightness area 10c composed of a color (for example, black) whose brightness is lower than the color constituting the high brightness area 10b is provided (see FIG. 1).

  The outer shape of the low brightness region 10c is not particularly limited, and may be another shape such as a rectangular shape or a circular shape.

  The color of the high brightness area 10b and the color having high brightness among the two colors constituting the data cell of the code area 10a may be the same color (for example, white) or different colors.

  The color of the low lightness area 10c and the color having low lightness among the two colors constituting the data cell of the code area 10a may be the same color (for example, black) or different colors.

  The imaging object 10 including the code area 10a may be an object (see FIG. 1) where the boundary between the high brightness area 10b and the low brightness area 10c is clear, or the high brightness area 10b may not have a frame shape. A case where the boundary between the high brightness area 10b and the low brightness area 10c is not clear (see FIG. 2) is also conceivable, such as when there is no low brightness area 10c.

  The imaging device (code area specifying device) 20 is, for example, a mobile phone with a camera (see FIG. 3). The operation unit 21 is an input unit such as a numeric keypad. However, the operation unit 21 and the display unit 24 may be integrated like a touch panel. In the recording unit 22, a stereoscopic image to be superimposed on the screen corresponding to the position of the code area 10a or the like is recorded, or a program for specifying an area including a code area that tracks the code area 10a or the like is installed.

  The image processing unit 23 is a device that performs arithmetic processing, such as a DSP, and performs image processing of an image signal obtained by the imaging unit 25 or a code area 10a (or code) on an image based on the image signal obtained by the imaging unit 25. The position (area including the area 10a and the high brightness area 10b) is specified (first search step, second search step, specification step).

  The display unit 24 displays an image based on the image signal obtained by the imaging unit 25, and the image processing unit 23 specifies the code area 10a (or the area including the code area 10a and the high brightness area 10b) on the image. In this case, a stereoscopic image is superimposed on the image and displayed. The imaging unit 25 is a camera that captures an image of the subject 10. The control unit 29 controls each unit such as a CPU.

  The imaging device 20 captures an image of the object 10 and specifies a code area 10a or an area including the code area 10a and the high brightness area 10b on the image obtained by the imaging (the code area 10a or the code area 10a and the high brightness area). The code area 10a or the code area 10a and the high brightness area 10b are included by performing an operation of specifying the position, size, deformation degree, and orientation of the area including 10b every predetermined time (for example, 1/30 second). Track an area.

  The operation procedure for tracking the code area 10a or the area including the code area 10a and the high brightness area 10b will be described with reference to the flowchart of FIG. When the user operates the operation unit 21 of the imaging apparatus 20 and starts an operation of tracking the code area 10a and the like, a program for specifying an area including the code area is activated, and the control unit 29 performs the imaging unit 25 and the like. Each part is controlled, and the operations in steps S11 to S15 are performed at regular time intervals (for example, 1/30 seconds) (an imaging step or the like is performed).

  In step S11, the imaging unit 25 images the imaging target unit 10 (imaging process). The image of the subject 10 obtained in the imaging step is subjected to image processing by the image processing unit 23 and displayed on the display unit 24 (live view display).

  In step 12, the image processing unit 23 determines whether or not the outer shape of the code area 10a has been specified in the second search step of the previous step S15. If the outer shape of the code area 10a can be specified in the second search step of the previous step S15, the process proceeds to step S15 to track the code area 10a. If the outer shape of the code area 10a cannot be specified in the second search step of the previous step S15, the process proceeds to step S13 in order to newly search the outer shape of the high brightness area 10b. When the first search step of the previous step S13 can identify a substantially square frame (outer shape of the high brightness area 10b) configured with high brightness colors, an area including the code area 10a and the high brightness area 10b The process proceeds to step S13.

  In step S <b> 13, the image processing unit 23 determines whether there is a region in which a substantially square (or a substantially rectangular) is formed by a straight line composed of high brightness colors on the image of the photographing object 10 obtained in the imaging process. Judge whether or not. That is, a substantially square frame (outer shape of the high brightness area 10b) configured with high brightness colors is searched (first search step).

  Specifically, in the first search step, a straight line formed with a high lightness color formed at the boundary between the high lightness region 10b and the low lightness region 10c is searched. As shown in FIG. 2, when the high lightness region 10b is not a frame shape or when there is no low lightness region 10c, a straight line formed with a high lightness color cannot be found. The substantially square-shaped frame (the outer shape of the high brightness region 10b) cannot be specified.

  In the first search step, when it is possible to identify an area in which a substantially square (or substantially rectangular) is formed by a straight line composed of high lightness colors, the image processing unit 23 is composed of high lightness colors in step S14. An inner region (a region including the code region 10a and the high brightness region 10b) of the region in which a substantially square (or a substantially rectangular) is formed with a straight line is identified (identification step).

  In the specifying step of step S14 performed after step S13, the position, size, deformation degree, and orientation of the area including the code area 10a and the high brightness area 10b on the image displayed on the display unit 24 are specified, and the imaging apparatus 20 and the positional relationship between the code area 10a of the actual object 10 and the area including the high brightness area 10b. The degree of deformation of the area including the code area 10a and the high lightness area 10b is caused by the positional relationship between the imaging device 20 and the actual photographing object 10, and is the original degree of the area including the code area 10a and the high lightness area 10b. The degree of deformation compared to the shape (square or rectangular) is shown. The orientation of the area including the code area 10a and the high brightness area 10b is specified by the image pattern of the area including the code area 10a and the high brightness area 10b.

  Note that it is not necessary to specify the relative positional relationship between the imaging device 20 and the area including the code area 10a and the high brightness area 10b on the actual object to be photographed 10, and on the image displayed on the display unit 24. It is only necessary to specify the position of the area including the code area 10a and the high brightness area 10b.

  The image pattern does not need to read the code contents described in the code area 10a, and in order to specify the direction of the area including the code area 10a and the high lightness area 10b, an arrangement pattern of colors having high lightness and colors having low lightness Roughly identify For example, the area including the code area 10a and the high brightness area 10b is divided into 16 (other division numbers may be used), and the brightness for each of the 16 divided areas is specified. Alternatively, the image pattern may be specified by other image pattern matching processing. For this reason, the process can be performed faster than the process of reading the code contents described in the code area 10a (code reading process described later) like a barcode reader.

  In the first search step, when it is not possible to specify an area in which a substantially square (or substantially rectangular) is formed by a straight line composed of high brightness colors, the process proceeds to step S15. In step S <b> 15, the image processing unit 23 has a region in which a substantially square (or a substantially rectangular) is formed with a straight line composed of low-lightness colors on the image of the photographing object 10 obtained in the imaging process. Judge whether or not. That is, the outer shape of the two-dimensional image code (code region 10a) in which the data cell is expressed by two colors of a high lightness color and a low lightness color is searched (second search step).

  Specifically, in the second search step, a straight line formed with a low brightness color formed at the boundary between the code area 10a and the high brightness area 10b is searched.

  Since the code area 10a is composed of an array of colors having high brightness and colors having low brightness, the boundary between the code area 10a and the high brightness area 10b is not necessarily composed of only low brightness colors, and low brightness. It is conceivable that the color and the high brightness color are mixed, and the straight line formed only by the low brightness color is not formed. For this reason, in the search for the straight line of the low lightness color, not only the straight line formed only by the low lightness color but also the high lightness color point mixed on the straight line of the low lightness color (the point of the low lightness color is Searches are made as straight lines formed with low lightness colors, including those that are arranged on a straight line).

  In the second search step, when it is possible to identify an area in which a substantially square (or substantially rectangular) is formed by a straight line composed of low lightness colors, the image processing unit 23 is composed of low lightness colors in step S14. An inner region (code region 10a) of a region where a substantially square (or a substantially rectangular) is formed by a straight line is identified (identifying step).

  In the specifying step of step S14 performed after step S15, the position, size, deformation degree, and orientation of the code area 10a on the image displayed on the display unit 24 are specified, and the imaging device 20 and the actual shooting target 10 are identified. The positional relationship with the code area 10a is grasped. The degree of deformation of the code area 10a is caused by the positional relationship between the imaging device 20 and the actual subject 10 and indicates the degree of deformation compared to the original shape (square or rectangular) of the code area 10a on the image. . The direction of the code area 10a is specified by the image pattern of the code area 10a.

  Note that it is not necessary to specify the relative positional relationship between the imaging device 20 and the code area 10a on the actual photographing object 10, and the position of the code area 10a on the image displayed on the display unit 24 is specified. Just do it.

  The image pattern does not need to read the code contents described in the code area 10a, and roughly specifies an arrangement pattern of a color with high brightness and a color with low brightness in order to specify the direction of the code area 10a. For example, the code area 10a is divided into 16 (other division numbers may be used), and the brightness for each of the 16 divided areas is specified. Alternatively, the image pattern may be specified by other image pattern matching processing.

  In the second search step, when it is not possible to identify an area in which a substantially square (or a substantially rectangular) is formed by a straight line composed of low brightness colors, the image processing unit 23 ends the procedure, and after a certain time has elapsed. Then, the process returns to step S11 to perform an imaging process and the like. That is, in one of the first search step and the second search step, a quadrangular area outside the code area 10a is searched, and when such a quadrangular area is found in any search process, the code area 10a is located inside the quadrangular area. If it is determined that there is an image, a specifying step is performed to specify an image pattern or the like of the inner region.

  By performing at least one of the imaging process, the first search process, and the second search process at regular intervals, the position and size of the code area 10a (or the area including the code area 10a and the high brightness area 10b) on the image. It is possible to specify the degree of deformation and the direction and track the code area 10a (or the area including the code area 10a and the high brightness area 10b). In the first search step, when the area including the code area 10a and the high brightness area 10b can be specified, the outline of the high brightness area 10b is continuously searched, and the area including the code area 10a and the high brightness area 10b is tracked. . When the code area 10a can be specified in the second search step, the outer shape of the code area 10a is continuously searched and the code area 10a is tracked.

  If tracking can be performed, the imaging target obtained by imaging and displayed on the display unit 24 in relation to the position, size, degree of deformation, orientation, and the like of the code area 10a (or the area including the code area 10a and the high brightness area 10b) It is also possible for the image processing unit 23 to superimpose a stereoscopic image or the like on the image of the object 10 (superimposition step). In particular, it is possible to superimpose by changing the position, size, degree of deformation, orientation, etc. of the stereoscopic image corresponding to the position of the code area 10a (or the area including the code area 10a and the high brightness area 10b). Become.

  The three-dimensional image may be in a form that uses what is recorded in advance in the recording unit 22 of the imaging device 20, or is captured before performing the imaging process for the first search process or the second search process. The URL information included in the code area 10a may be read using the unit 25 (code reading process), and the content related to the stereoscopic image downloaded from the URL information and recorded in the recording unit 22 may be used. . In the specifying step, it is not necessary to read the contents of the code, and it is only necessary to specify the direction of the code area 10a (or the area including the code area 10a and the high brightness area 10b). For this reason, specifying the image pattern of the code area 10a (or the area including the code area 10a and the high brightness area 10b) has an advantage that the load of the image analysis processing is smaller than that of the code reading process.

  The outer shape of the rectangle outside the code region 10a (the outer shape of the rectangle formed by the high lightness color at the boundary between the high lightness region 10b and the low lightness region 10c in the first search step, or the code region 10a in the second search step) A process of searching for a rectangular outline formed by low-lightness colors at the boundary of the high-lightness area 10b) or a process of specifying the code area 10a and the high-lightness area 10b or the code area 10a in the specific process Since the process of identifying even the code contents of the area 10a is not required, the process of specifying the code area 10a (or the area including the code area 10a and the high brightness area 10b) is faster than the case where the identification process is required. There is a merit that can be done.

  Around the code area 10a, a color area (high brightness area 10b) having a high brightness such as white is usually provided. However, a region with low brightness such as black (low brightness region 10c) may be provided around the high brightness region 10b as shown in FIG. 1, or may not be provided as shown in FIG.

  When the low lightness region 10c is provided around the high lightness region 10b, the boundary between the high lightness region 10b and the low lightness region 10c is clear. Therefore, in the first search step, the code region 10a It becomes possible to specify the outer quadrangular area (the boundary between the high brightness area 10b and the low brightness area 10c). However, the low brightness area 10c is not necessarily provided around all the high brightness areas 10b, and the boundary between the high brightness area 10b and the low brightness area 10c is not necessarily rectangular.

  When the low lightness region 10c is not provided around the high lightness region 10b, the boundary between the high lightness region 10b and the low lightness region 10c is not clear. Therefore, in the first search step, the code region 10a The outer quadrangular area (the boundary between the high brightness area 10b and the low brightness area 10c) cannot be specified.

  Even when the high lightness region 10b is not frame-shaped (the outer shape is not rectangular), the first search step specifies a rectangular region outside the code region 10a (the boundary between the high lightness region 10b and the low lightness region 10c). I can't do that.

  However, in either case, the second search step can specify a rectangular area outside the code area 10a (the boundary between the code area 10a and the high brightness area 10b).

  The square straight line formed with the low lightness color at the boundary between the code region 10a and the high lightness region 10b is not only formed with the low lightness color, but the point of the high lightness color on the straight line of the low lightness color. Since some of them are mixed, the search accuracy may be lower than that of a square straight line formed with a high lightness color at the boundary between the high lightness region 10b and the low lightness region 10c, but the code region 10a. In general, the high brightness region 10b is provided around and the outer shape of the high brightness region 10b is not limited, so that versatility is high.

  Therefore, in the present embodiment in which the first search process and the second search process are performed, the outer side of the code area 10a may be provided regardless of whether the low brightness area 10c is provided around the high brightness area 10b. It is possible to track the code area 10a (or the area including the code area 10a and the high brightness area 10b).

  In this embodiment, the color region is distinguished based on the difference in brightness (maximum value of each RGB channel), but the color region is distinguished based on the difference in luminance (weighted average of RGB values). Also good. In this case, the code area 10a has a code in which the data cell is expressed by two colors, a color having a high luminance and a color having a low luminance compared to the color having the high luminance, and the high brightness area 10b has a high color. In the luminance region 10b, the low brightness region 10c becomes the low luminance region 10c, and the first search step and the second search step are performed based on the luminance signal for each pixel calculated in the normal image processing step.

  After searching for the outer shape of the high brightness area 10b including the code area 10a in the first search step, the code area located on the inner side is further replaced with a mode of specifying the area including the code area 10a and the high brightness area 10b in the specifying process. After searching 10a, the code region 10a may be specified in the specifying step. In this case, one search process is added, but there is an advantage that the same code area 10a can be tracked in both the specific process after the first search process and the specific process after the second search process.

  In addition, after searching for the outer shape of the code area 10a in the second search step, the code area 10a and the high-lightness area 10b in a certain range around the code area 10a are specified in the specification process instead of specifying the code area 10a in the specification process. The form which specifies the area | region to include may be sufficient. In this case as well, there is an advantage that the same region including the code region 10a and the high brightness region 10b can be tracked in the specific step after the first search step and the specific step after the second search step.

10 Object 10a Code area 10b High brightness area (high brightness area)
10c Low brightness area (low brightness area)
DESCRIPTION OF SYMBOLS 20 Imaging device 21 Operation part 22 Recording part 23 Image processing part 24 Display part 25 Imaging part 29 Control part

Claims (12)

An imaging step of imaging a photographing object including a code region having a code in which data cells are expressed in two colors, a color having a high brightness and a color having a low brightness compared to the color having a high brightness;
On the image obtained in the imaging step, a first search step for identifying an outer shape of a high brightness area which is provided around the code area and is configured with a color having a higher brightness than the color having a low brightness,
A second search step for identifying the outer shape of the code region;
The information about the outline of the identified high brightness area has been in the first search step, on the basis of the information about the outline of the said coding region identified in the second search step, an area including the high brightness area and the coding region Or a specific step of specifying the code region ,
The imaging step, the first search step, the second search step, and the specifying step are performed for tracking a region including the code region,
At least, the imaging process, at least one of the first search step and the second search step, for said tracking repeatedly performed method for identifying a region containing the coding region characterized by Rukoto. The first search step is provided around the high lightness region, and is formed at a boundary between the low lightness region and the high lightness region configured by a color having a lightness lower than that of the color forming the high lightness region. Search for the outline of a square with a high brightness,
2. The region including a code region according to claim 1, wherein the second search step searches for an outline of a quadrilateral having a low lightness color formed at a boundary between the code region and the high lightness region. how to.   2. The method for specifying a region including a code region according to claim 1, wherein the second search step is performed when an outline of the high brightness region cannot be specified in the first search step. The code region according to claim 1 , wherein the imaging step, the first search step, the second search step, and the specifying step do not include a code reading step of reading a code of the code region. How to identify the area. At least one of the imaging step, the first search step, and the second search step is repeatedly performed at regular intervals,
The region including the code region according to claim 1 , further comprising a superimposing step of superimposing a stereoscopic image on the image obtained in the imaging step based on the information obtained in the specifying step. How to identify. Before the imaging step, further comprising a code reading step of reading a code of the code area,
2. The code area according to claim 1, wherein specifying the area including the code area and the high brightness area or the code area in the specifying step has a smaller load of image analysis processing than the code reading step. How to identify the area to include. The area including the code area and the high brightness area is specified by at least one of the position, size, degree of deformation, and orientation of the area including the code area and the high brightness area on the image obtained in the imaging step. And
2. The code area according to claim 1, wherein the code area is specified by at least one of a position, a size, a deformation degree, and an orientation of the code area on the image obtained in the imaging step. How to identify the area to include. An imaging step of imaging a photographing object including a code region having a code in which data cells are expressed in two colors, a color having a high brightness and a color having a low brightness compared to the color having a high brightness;
On the image obtained in the imaging step, a first search step for identifying an outer shape of a high brightness area which is provided around the code area and is configured with a color having a higher brightness than the color having a low brightness,
A second search step for identifying the outer shape of the code region;
The information about the outline of the identified high brightness area has been in the first search step, on the basis of the information about the outline of the said coding region identified in the second search step, an area including the high brightness area and the coding region Or a program for specifying an area including a code area for executing the specifying step for specifying the code area,
The imaging step, the first search step, the second search step, and the specifying step are performed for tracking a region including the code region,
At least, the imaging process, at least one of the first search step and the second search step, for said tracking repeatedly performed to Help program and wherein Rukoto. An imaging unit that captures an imaging target including a code area having a code in which data cells are expressed in two colors, a color having a high brightness and a color having a low brightness compared to the color having a high brightness;
On the image obtained by the imaging unit, a first search step for specifying an outer shape of a high brightness area which is provided around the code area and is configured with a color having a higher brightness than the color having a lower brightness, and the basis of the second search step of identifying the outline of the coding region, and the information about the outline of the high intensity regions identified in the first search step, the information about the outline of the said coding region identified in the second search step An image processing unit that executes the code region and a region including the high brightness region or a specifying step of specifying the code region ,
The imaging step, the first search step, the second search step, and the specifying step are performed for tracking a region including the code region,
At least, the imaging process, at least one of the first search step and the second search step, for the tracking, repeatedly conducted apparatus for identifying a region containing the coding region characterized by Rukoto. An imaging step of imaging a photographing object including a code region having a code in which a data cell is represented by two colors of a high luminance color and a low luminance color compared to the high luminance color;
On the image obtained in the imaging step, a first search step for specifying an outer shape of a high-luminance region that is provided around the code region and that is configured with a color that is higher in luminance than the low-luminance color;
A second search step for identifying the outer shape of the code region;
The information about the outline of the identified high-luminance regions in the first search step, on the basis of the information about the outline of the said coding region identified in the second search step, a region including the high luminance region and the coding region Or a specific step of specifying the code region ,
The imaging step, the first search step, the second search step, and the specifying step are performed for tracking a region including the code region,
At least, the imaging process, at least one of the first search step and the second search step, for said tracking repeatedly performed method for identifying a region containing the coding region characterized by Rukoto. An imaging step of imaging a photographing object including a code region having a code in which a data cell is represented by two colors of a high luminance color and a low luminance color compared to the high luminance color;
On the image obtained in the imaging step, a first search step for specifying an outer shape of a high-luminance region that is provided around the code region and that is configured with a color that is higher in luminance than the low-luminance color;
A second search step for identifying the outer shape of the code region;
The information about the outline of the identified high-luminance regions in the first search step, on the basis of the information about the outline of the said coding region identified in the second search step, a region including the high luminance region and the coding region Or a program for specifying an area including a code area for executing the specifying step for specifying the code area,
The imaging step, the first search step, the second search step, and the specifying step are performed for tracking a region including the code region,
At least, the imaging process, at least one of the first search step and the second search step, for said tracking repeatedly performed to Help program and wherein Rukoto. An imaging unit that captures an imaging object including a code region having a code in which a data cell is represented by two colors, a color having a high luminance and a color having a low luminance compared to the color having a high luminance;
A first search step for identifying an outer shape of a high-luminance region, which is provided around the code region on the image obtained by the imaging unit and is configured with a color having a higher luminance than that of the low-luminance color; the basis of the second search step of identifying the outline of the coding region, and the information about the outline of the high luminance region which is specified by the first search step, the information about the outline of the said coding region identified in the second search step And an image processing unit that executes the code region and a region including the high- luminance region or a specifying step of specifying the code region ,
The imaging step, the first search step, the second search step, and the specifying step are performed for tracking a region including the code region,
At least, the imaging process, at least one of the first search step and the second search step, for the tracking, repeatedly conducted apparatus for identifying a region containing the coding region characterized by Rukoto.

Images