JP4477532B2 - Marker information acquisition device - Google Patents

Description

  The present invention relates to a marker information acquisition apparatus that acquires information from a composite marker composed of an optical marker portion having an optical feature that is a symbol obtained by encoding information and a non-contact ID tag.

  A bar code reader is generally well known as an apparatus for reading information from a marker having an optical characteristic, which is a symbol obtained by encoding information.

  The marker (bar code) is capable of recognizing the position of a human being, and can easily obtain information by pointing the reader toward the bar code, and is used in many fields.

  However, the barcode has a problem that it cannot hold so much information, and a contactless ID tag or the like having a larger amount of information is being used. However, it is difficult for humans to recognize the presence of non-contact ID tags.

  In order to solve such a problem, Patent Document 1 discloses a composite barcode in which a non-contact ID tag in which information is recorded is incorporated in the barcode.

Patent Document 2 discloses an apparatus for reading information from the composite barcode (one-dimensional code, two-dimensional code, non-contact ID tag).
JP 2001-5931 A JP 2001-52105 A

  However, in order to read the information of the non-contact ID tag, by transmitting data from the portable terminal to the non-contact ID tag on a carrier wave, the non-contact ID tag generates necessary power by the carrier wave, and wireless communication is performed. Need to do. Therefore, when power is always supplied (transmitted) to read the information of the non-contact ID tag, power consumption is large, and a portable terminal such as a PDA has a problem that the built-in battery is consumed quickly.

  The present invention has been made in view of the above points, and an object thereof is to provide a marker information acquisition apparatus capable of reading information of an optical marker unit and a non-contact ID tag at an appropriate timing. .

One aspect of the marker information acquisition device of the present invention is a marker information acquisition device that acquires information from a marker including an optical marker unit having optical characteristics,
An imaging unit having a predetermined imaging range and imaging an optical marker portion within the imaging range;
Information acquisition means for acquiring information held by the non-contact ID tag from a composite marker including a non-contact ID tag whose relative position is fixed with the optical marker unit together with the optical marker unit;
An information acquisition control means for switching the function of the marker information acquisition device when information indicating that the non-contact ID tag is present is detected by processing an image of the optical marker portion imaged by the imaging means; ,
It is characterized by comprising.

  According to the present invention, the function of the marker information acquisition device can be switched in accordance with detection of information indicating the presence of a non-contact ID tag, so that the optical marker unit and the non-contact ID tag can be switched at an appropriate timing. It is possible to provide a marker information acquisition device capable of reading the information.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

[First Embodiment]
FIG. 1A is a diagram showing a configuration of an information presentation device to which the marker information acquisition device according to the first embodiment of the present invention is applied. 1B is a front view of the front surface of the composite marker according to the first embodiment of the present invention, and FIG. 1C is a front view of the back surface of the composite marker.

  In the present embodiment, as shown in FIGS. 1B and 1C, the composite marker 10 includes an optical marker unit 11 that is a symbol obtained by encoding information and a non-contact ID tag 12 integrated. Is.

  Here, the optical marker portion 11 is arranged on the surface of the composite marker 10, and is composed of a frame portion 11A having a predetermined shape, and a symbol or design 11B including characters written therein. The That is, a camera that has at least three or more optically distinguishable feature points, has a known three-dimensional arrangement of the feature points, and has shot the image from an image shot to include the feature points The relative position and orientation can be specified.

  Further, the non-contact ID tag 12 is provided on the back surface (or inside) of the marker. In this embodiment, the antenna 12A that serves both for power reception and data transmission / reception, the IC chip 12B that incorporates electronic elements, and information are stored. It is provided as an RFID tag configured with a storage unit 12C for storing. Note that the IC chip 12B and the storage unit 12C are configured separately, but may be configured by a one-chip IC. Further, although the IC chip 12B and the storage unit 12C are rectangular and a dipole antenna is disposed as the antenna 12A on the IC chip 12B, the shape thereof can be changed as appropriate.

  The RFID tag as the non-contact ID tag 12 is an IC chip 12B including a transmission / reception circuit, receives external data transmitted on a carrier wave via the antenna 12A, generates necessary power by the carrier wave, Using the power, data is read and written to the storage unit 12C and transmitted via the antenna 12A, and information is transmitted to the outside.

  The storage unit 12C stores in advance information related to the optical marker unit 11 or information related to an article to which the composite marker 10 having the optical marker unit 11 is fixed. In the present invention, the term “fixed” is not limited to being directly fixed to the article, but includes indirect fixing, that is, placing the article without changing the predetermined position and orientation relationship. .

  In addition, the information-encoded symbol has at least three or more optically identifiable feature points as described above, the three-dimensional arrangement of the feature points is known, and the feature points are It is not limited to the optical marker unit 11 that can specify the relative position and orientation with the camera that has captured the image from the image that is captured so as to function as a marker that can specify a three-dimensional position and orientation. Of course, it may be anything as long as it does.

  As shown in FIG. 1A, the information presentation device 20 using such a composite marker 10 includes an image input unit 21, an information acquisition control unit 22, an RFID reading unit 23, and a display unit 24. . The information acquisition control unit 22 includes a marker detection unit 22A, a position / orientation detection unit 22B, a marker information storage unit 22C, a related information generation unit 22D, a related information storage unit 22E, and a superimposed image generation unit 22F. . Here, the information presentation device 20 is provided as a portable terminal such as a camera-equipped PDA or a camera-equipped mobile phone. In this case, all the components may be provided in the portable terminal, but a part may be arranged on a server accessible by communication. However, the portable terminal needs to include at least the image input unit 21, the RFID reading unit 23, and the display unit 24.

  Here, the image input unit 21 functions as a photographing unit that photographs the composite marker 10 directly or indirectly fixed to the object (article) with a camera having a predetermined photographing range. Is input to the marker detection unit 22 </ b> A of the information acquisition control unit 22. The marker detection unit 22A detects the optical marker unit 11 of the composite marker 10 from the image input from the image input unit 21, and confirms whether the RFID tag presence information is included in the information of the optical marker unit 11. When the RFID tag presence information is detected, a read command is supplied to the RFID reader 23. The detection result of the optical marker unit 11 is supplied to the position / orientation detection unit 22B.

  The RFID reading unit 23 functions as an information acquisition unit that receives a detection result of marker detection from the marker detection unit 22A and reads information from the non-contact ID tag 12 that is an RFID tag of the composite marker 10. In order to read information from the non-contact ID tag 12, the data read command is transmitted on the carrier wave and the information read from the non-contact ID tag 12 is supplied to the related information generation unit 22D.

  As described above, in the present embodiment, the optical marker unit 11 is detected, whether there is RFID tag presence information in the information of the optical marker unit 11, and only when the RFID tag presence information is detected, By reading out information by the RFID reading unit 23, battery consumption of the information presentation device 20 is suppressed.

  The position / orientation detection unit 22B uses the marker information from the marker detection unit 22A to identify the corresponding marker from the information stored in the marker information storage unit 22C, and determines the camera position and orientation of the image input unit 21. It detects and supplies the detection result to related information generation part 22D. By the way, the position and orientation of the camera of the image input unit 21 with respect to the optical marker unit is detected using a known technique described in Japanese Patent Application Laid-Open Nos. 2000-227309 and 2001-122601. is there. The marker information storage unit 22C stores information related to markers such as a marker template image, area information to which the marker belongs, and position and orientation information where the marker is arranged.

  The related information generation unit 22D extracts information set in advance from the related information storage unit 22E according to the position and orientation of the camera of the image input unit 21 detected by the position and orientation detection unit 22B, and generates related information. The information read from the non-contact ID tag 12 provided from the RFID reading unit 23 is also combined with the generated related information according to the position and orientation of the camera. Then, the combined related information and information read from the non-contact ID tag 12 are supplied to the superimposed image generation unit 22F. Here, the related information storage unit 22E stores related information such as position / orientation information, shape information, and attribute information of the model arranged in the model space.

  The superimposed image generation unit 22F superimposes the image from the image input unit 21 and the information supplied from the related information generation unit 22D, and supplies the superimposed image to the display unit 24. The display unit 24 displays the superimposed image generated by the superimposed image generation unit 22F.

  FIG. 2 is an operation flowchart of the information presentation apparatus 20 configured as described above.

  First, as shown in FIG. 3 (A), the article 30 on which the composite marker 10 is fixed is photographed by the camera of the image input unit 21, and the optical marker unit 11 is detected by inputting the image to the marker detection unit 22A. (Step S1). In the marker detection unit 22A, first, a predetermined shape of the optical marker unit 11 arranged on the surface of the composite marker 10 from the image, that is, a frame unit 11A which is a rectangular frame in the present embodiment is detected (square frame). Is detected by a known image processing method, and the description thereof is omitted). Next, the coordinates in the four corner images of the detected frame portion 11A (square frame) are detected, the inside of the square frame is extracted, and affine transformation is performed. Then, pattern matching between the image after affine transformation and the template image of the marker registered in advance in the marker information storage unit 22C is performed to identify the optical marker unit 11 (in this case, the symbol or design 11B is “50”). Identify that it is a marker). If the image does not match the template image of the marker, it is not detected as a marker (step S2), and the process returns to step S1.

  When the optical marker unit 11 is detected, the information of the detected optical marker unit 11 is analyzed (step S3). It is determined whether the RFID tag presence information is detected in the information of the optical marker unit 11 (step S4). That is, by using the analysis result obtained by analyzing the image in step S3, whether or not the common symbol given to the composite marker including the RFID tag or “50” as the design 11B is detected is determined in step S4. Determined.

  If the RFID tag presence information is detected as a result of the determination, the information is read from the non-contact ID tag 12 by the RFID reader 23 (step S5). This is performed by the RFID reader 23 transmitting a data read command on a carrier wave. That is, in the non-contact ID tag 12, necessary power is generated by the carrier wave received by the antenna 12A, and the IC chip 12B reads information in the storage unit 12C using the power and transmits the information by the antenna 12A. The RFID reading unit 23 receives information (for example, annotation information (“high temperature caution”)) transmitted from the non-contact ID tag 12 and supplies it to the related information generation unit 22D as RFID tag information.

  Next, the position / orientation detection unit 22B identifies the composite marker 10 photographed by the camera of the image input unit 21 from the marker information detected by the marker detection unit 22A (step S6).

  When the marker is identified in this way, spatial localization information (position and orientation information where the marker is arranged) of the corresponding marker can be obtained from the marker information storage unit 22C. It becomes possible to detect the position and orientation of the camera of the image input unit 21 from the positions of the four corners of the marker unit 11 (step S7). Then, in the related information generation unit 22D, in accordance with the position and orientation of the camera detected by the position and orientation detection unit 22B, information set in advance is extracted from the related information storage unit 22E, and the related information is generated. The information is combined with the RFID tag information read by the reading unit 23 (step S8).

  For example, for the marker “50”, the related information storage unit 22E stores the three-dimensional model 22E1 of the corresponding article 30 as related information as shown in FIG. 3B. Further, annotation information (“high temperature caution”) 23 </ b> A arranged under the composite marker 10 in the model space is RFID tag information read from the non-contact ID tag 12.

  Therefore, the superimposed image generation unit 22F superimposes the image from the image input unit 21 and the RFID tag information and the related information from the related information generation unit 22D, and as shown in FIG. The superimposed image is displayed on the display screen 24A (step S9).

  As described above, when the marker information of the composite marker 10 is detected and the position and orientation of the camera are detected, a superimposed image is displayed on the display screen 24A.

  On the other hand, if the RFID tag presence information cannot be detected as a result of the determination in step S4, the position / orientation detection unit 22B does not read the information and does not read the information. From the marker information detected by the detection unit 22A, the composite marker 10 photographed by the camera of the image input unit 21 is identified (step S10). Thereafter, the position and orientation detection unit 22B detects the position and orientation of the camera of the image input unit 21 (step S11), and the related information generation unit 22D determines from the related information storage unit 22E according to the detected position and orientation of the camera. Preset information is extracted to generate related information (step S12). Then, the superimposed image generation unit 22F superimposes the image from the image input unit 21 and the related information generated by the related information generation unit 22D, and displays the superimposed image on the display screen 24A of the display unit 24 (step S24). S13).

  Therefore, in this case, a superimposed image without annotation information 23A is displayed on the display screen 24A.

[Second Embodiment]
FIG. 4A is a diagram showing a configuration of an information presentation device to which the marker information acquisition device according to the second embodiment of the present invention is applied. FIG. 4B is a front view of the front surface of the composite marker according to the second embodiment of the present invention, and FIG. 4C is a front view of the back surface of the composite marker.

  In the composite marker 10 according to the present embodiment, the optical marker portion 11 arranged on the surface of the marker is constituted by a two-dimensional code 11C, and the non-contact ID tag 12 is provided on the back surface (or inside) of the marker. . As shown in FIG. 4D, RFID tag presence information 11C1 and marker information 11C2 are encoded and stored in the two-dimensional code 11C on the marker surface. The two-dimensional code 11C may be anything as long as it can store information, and may of course be a one-dimensional code. Further, the optical marker unit 11 does not need to store the RFID tag presence information 11C1 and the marker information 11C2 together as one code. That is, two parts, that is, two codes, or one code and a symbol or design 11B as in the first embodiment may be stored separately. Note that the two-dimensional code 11C has at least three or more features that are optically distinguishable and known in mutual arrangement, such as large black circles arranged at four corners.

  As shown in FIG. 4A, the information presentation device 20 using the composite marker 10 including the optical marker unit 11 configured by the two-dimensional code 11C has an image input unit 21 and an information acquisition control unit 22. , The RFID reading unit 23, and the display unit 24. And in this embodiment, the information acquisition control part 22 is comprised from 22 A of marker detection parts, and the control part 22G.

  Here, the image input unit 21 is a photographing unit that photographs the composite marker 10 with a camera having a predetermined photographing range, and inputs the photographed image to the marker detection unit 22 </ b> A of the information acquisition control unit 22. The marker detection unit 22A detects the optical marker unit 11 of the composite marker 10 from the image input from the image input unit 21 (decodes the two-dimensional code 11C), and supplies the detection result to the control unit 22G. It is.

  The control unit 22G receives the marker detection result from the marker detection unit 22A, checks whether there is RFID tag presence information 11C1 in the information of the optical marker unit 11, and detects the RFID tag presence information 11C1. Supplies a read command to the RFID reader 23.

  The RFID reading unit 23 receives a detection result of the RFID tag presence information 11C1 from the control unit 22G and reads data from the non-contact ID tag 12 which is an RFID tag of the composite marker 10 to read data from the carrier wave. The information read from the non-contact ID tag 12 is supplied to the control unit 22G.

  That is, in the present embodiment, information is presented by reading information by the RFID reader 23 only when the RFID tag presence information 11C1 exists in the information of the optical marker 11 (two-dimensional code 11C). The battery of the apparatus 20 is suppressed from being consumed.

  The control unit 22G supplies the marker information 11C2 of the optical marker unit 11 and information (RFID tag information) read from the non-contact ID tag 12 to the display unit 24. The display unit 24 displays information generated by the control unit 22G.

  FIG. 5A is an operation flowchart of the information presentation apparatus 20 configured as described above.

  First, the composite marker 10 is photographed by the camera of the image input unit 21, and the image is input to the marker detection unit 22A to detect the optical marker unit 11 (step S1). In the present embodiment, the marker detection unit 22A first detects from the image whether the combination is a predetermined dot pattern of the optical marker unit 11 arranged on the surface of the composite marker 10 (various two-dimensional codes). Since the information detection is well known, the description thereof is omitted). If the image does not match the predetermined dot pattern combination, the image is not detected as a marker (step S2), and the process returns to step S1.

  When the optical marker unit 11 is detected, the marker detection unit 22A analyzes the information of the detected optical marker unit 11 (step S3). In the present embodiment, the two-dimensional code 11C is decoded. Then, the control unit 22G determines whether or not the RFID tag presence information 11C1 exists in the information of the optical marker unit 11 obtained by the marker detection unit 22A (step S4).

  If the RFID tag presence information 11C1 is detected as a result of this determination, the information is read from the non-contact ID tag 12 by the RFID reader 23 (step S5). This is performed by the RFID reader 23 transmitting a data read command on a carrier wave. That is, in the non-contact ID tag 12, necessary power is generated by the carrier wave received by the antenna 12A, and the IC chip 12B reads information in the storage unit 12C using the power and transmits the information by the antenna 12A. The RFID reading unit 23 receives the information transmitted from the non-contact ID tag 12 and inputs it to the control unit 22G as RFID tag information. Then, the control unit 22G obtains the marker information 11C2 in the information of the optical marker unit 11 obtained by the marker detection unit 22A and the RFID tag information from the non-contact ID tag 12 read by the RFID reading unit 23. It displays on the display part 24 (step S21).

  On the other hand, if the RFID tag presence information 11C1 cannot be detected as a result of the determination in step S4, the control unit 22G includes the information of the optical marker unit 11 obtained by the marker detection unit 22A. Only the marker information 11C2 is displayed on the display unit (step S22).

  5B and 5C show an example of the display screen 24A of the display unit 24 of the present embodiment.

  That is, FIG. 5B is a display example in step S 21 described above. The display 24 A 1 (outline: advertisement) of the marker information 11 C 2 of the optical marker unit 11 and the RFID tag presence information 11 C 1 are displayed on the optical marker unit 11. A display 24A2 ([detailed information is present]) indicating that it has been detected, an RFID tag information display 24A3 read from the non-contact ID tag 12 (part of "detailed information: information on new functions of digital camera"), and Has been made.

  FIG. 5C is a display example in step S22 described above. Display 24A1 (outline: advertisement) of the marker information 11C2 of the optical marker unit 11 and RFID tag presence information 11C1 on the optical marker unit 11 are displayed. A display 24A4 ([no detailed information]) indicating that the information could not be detected is displayed.

  Needless to say, the present embodiment can be similarly applied to an information presentation apparatus that performs superimposing display with an actual image as in the first embodiment.

[Third Embodiment]
FIG. 6 is a diagram showing a configuration of the information presentation device 20 to which the marker information acquisition device according to the third embodiment of the present invention is applied. In this configuration, the input unit 25 is added to the configuration of the second embodiment, and the other configurations are the same, and thus the description thereof is omitted.

  The input unit 25 is an input unit for inputting an instruction from the user. In the present embodiment, the input unit 25 instructs the control unit 22G whether to perform reading operation of RFID tag information from the non-contact ID tag 12 or not. Is.

  That is, in this embodiment, when the RFID tag presence information 11C1 is present in the information of the optical marker unit 11, the user is instructed whether to read information by the RFID reading unit 23, so that the user can The battery of the information presentation device 20 due to reading out unnecessary information is suppressed.

  FIG. 7 is an operation flowchart of the information presentation apparatus 20 configured as described above.

  First, the composite marker 10 is photographed by the camera of the image input unit 21, and the image is input to the marker detection unit 22A to detect the optical marker unit 11 (step S1). In the present embodiment, the marker detection unit 22A first detects from the image whether the combination is a predetermined dot pattern of the optical marker unit 11 arranged on the surface of the composite marker 10 (various two-dimensional codes). Since the information detection is well known, the description thereof is omitted). If the image does not match the predetermined dot pattern combination, the image is not detected as a marker (step S2), and the process returns to step S1.

  When the optical marker unit 11 is detected, the marker detection unit 22A analyzes the information of the detected optical marker unit 11 (step S3). In the present embodiment, the two-dimensional code 11C is decoded. Then, the control unit 22G determines whether or not the RFID tag presence information 11C1 exists in the information of the optical marker unit 11 obtained by the marker detection unit 22A (step S4).

  As a result of this determination, when the RFID tag presence information 11C1 is detected, the control unit 22G displays on the display unit 24 marker information 11C2 in the information of the optical marker unit 11 obtained by the marker detection unit 22A, By displaying the information prompting the user to input whether or not to read the RFID tag information of the non-contact ID tag 12, the user is inquired whether or not to read the RFID tag information (step S31). When a user instruction is input to the input unit 25 in response to the inquiry by the display on the display unit 24 (step S32), it is determined whether the instruction content is an instruction to read RFID tag information (step S33).

  If the result of determination is an instruction to read RFID tag information, the control unit 22G reads information from the non-contact ID tag 12 by the RFID reading unit 23 (step S5). This is performed by the RFID reader 23 transmitting a data read command on a carrier wave. That is, in the non-contact ID tag 12, necessary power is generated by the carrier wave received by the antenna 12A, and the IC chip 12B reads information in the storage unit 12C using the power and transmits the information by the antenna 12A. The RFID reading unit 23 receives the information transmitted from the non-contact ID tag 12 and inputs it to the control unit 22G as RFID tag information. Then, the control unit 22G displays the marker information 11C2 in the information of the optical marker unit 11 obtained by the marker detection unit 22A and the RFID tag information read from the non-contact ID tag 12 on the display unit 24. (Step S21).

  On the other hand, if it is determined as a result of the determination in step S33 that the user has issued an instruction not to read RFID tag information, the control unit 22G uses the optical marker unit obtained by the marker detection unit 22A. The marker information 11C2 in the information 11 and information indicating that the RFID tag information is not read are displayed on the display unit 24 (step S34).

  If the RFID tag presence information 11C1 cannot be detected as a result of the determination in step S4, only the marker information 11C2 in the information of the optical marker unit 11 obtained by the marker detection unit 22A is displayed. It displays on the part 24 (step S22).

  8A to 8D show an example of the display screen 24A of the display unit 24 of the present embodiment.

  That is, FIG. 8A is a display example in step S31 described above. The display 24A1 (outline: advertisement) of the marker information 11C2 of the optical marker unit 11 and the RFID tag presence information 11C1 on the optical marker unit 11 are displayed. A display 24A2 ([detailed information exists]) indicating that it has been detected and an information display 24A5 prompting the user to read whether or not to read the RFID tag information (refer to detailed information? YES / NO) are made. ing.

  FIG. 8B is a display example in step S21 described above. The display 24A1 (outline: advertisement) of the marker information 11C2 of the optical marker unit 11 and the RFID tag presence information 11C1 detected in the optical marker unit 11 are detected. Display 24A2 ([with detailed information]) and RFID tag information display 24A3 read from the non-contact ID tag 12 (detailed information: information on a new function of the digital camera).

  FIG. 8C shows a display example in step S34, in which the display 24A1 (outline: advertisement) of the marker information 11C2 of the optical marker unit 11 and the RFID tag presence information 11C1 are detected in the optical marker unit 11 Display 24A2 ([detailed information exists]) and information display 24A6 (detailed information acquisition has been canceled) indicating that the user has canceled reading of RFID tag information.

  FIG. 8D is a display example in step S22 described above. Display 24A1 (outline: advertisement) of the marker information 11C2 of the optical marker unit 11 and RFID tag presence information 11C1 on the optical marker unit 11 are displayed. A display 24A4 ([no detailed information]) indicating that the information could not be detected is displayed.

  Needless to say, this embodiment can be similarly applied to an information presentation apparatus that performs superimposing display with an actual image as in the first embodiment.

  Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.

  For example, the non-contact ID tag 12 is not limited to an RFID tag, and may be anything as long as it can transmit information in a non-contact manner such as infrared rays.

  Further, the storage unit 12 </ b> C of the non-contact ID tag 12 may store the symbols in the optical marker unit 11 of the composite marker 10 and information on the design 11 </ b> B. For example, if arrangement information that can specify the relative arrangement of the symbol or the design 11B is stored, the optical marker unit 11 can be stored without storing the position / orientation information where the marker is arranged in the marker information storage unit 22C. Can be estimated.

(Appendix)
The invention having the following configuration can be extracted from the specific embodiment.

(1) A marker information acquisition device that acquires information from a marker including an optical marker having optical characteristics,
An imaging unit having a predetermined imaging range and imaging an optical marker portion within the imaging range;
Information acquisition means for acquiring information held by the non-contact ID tag from a composite marker including a non-contact ID tag whose relative position is fixed with the optical marker unit together with the optical marker unit;
An information acquisition control means for switching the function of the marker information acquisition device when information indicating that the non-contact ID tag is present is detected by processing an image of the optical marker portion imaged by the imaging means; ,
A marker information acquisition apparatus comprising:

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment relating to the marker information acquisition device described in (1). In these embodiments, for example, the optical marker unit 11 is the optical marker unit, the composite marker 10 is the marker and the composite marker, the information presentation device 20 is the marker information acquisition device, and the imaging unit is an image. The non-contact ID tag 12 corresponds to the non-contact ID tag, the RFID reading unit 23 corresponds to the information acquisition unit, and the information acquisition control unit 22 corresponds to the information acquisition control unit.

(Function and effect)
According to the marker information acquisition device described in (1), the function of the marker information acquisition device can be switched in response to detection of information indicating the presence of a non-contact ID tag. It is possible to provide a marker information acquisition device capable of reading information of the optical marker unit and the non-contact ID tag.

  (2) When the information acquisition control unit detects information indicating the presence of the non-contact ID tag, the information acquisition unit has a non-contact ID whose relative position is fixed with respect to the optical marker unit. The marker information acquisition device according to (1), wherein the function of the marker information acquisition device is switched so that information acquisition is performed from a tag.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment relating to the marker information acquisition device described in (2).

(Function and effect)
According to the marker information acquisition device described in (2), the marker information acquisition device is not used without operating a function for acquiring information from the non-contact ID tag for a marker that does not have a non-contact ID tag. Can be prevented.

  (3) The marker information acquisition according to (2), further comprising display means for displaying information obtained by processing an image of the optical marker portion photographed by the photographing means. apparatus.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment relating to the marker information acquisition device described in (3). In these embodiments, for example, the display unit 24 corresponds to the display unit.

(Function and effect)
According to the marker information acquisition device described in (3), information based on the image of the optical marker portion can be displayed.

  (4) The marker information acquisition apparatus according to (3), wherein the information displayed on the display means includes information indicating that a non-contact ID tag exists in the marker.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment relating to the marker information acquisition apparatus described in (4). In those embodiments, for example, the display 24A2 indicating that the RFID tag presence information 11C1 has been detected in the optical marker unit 11 corresponds to information indicating that a non-contact ID tag exists in the marker.

(Function and effect)
According to the marker information acquisition apparatus described in (4), the user can know whether or not the photographed marker has a non-contact ID tag.

  (5) The marker information acquisition apparatus according to (3), wherein the display means also displays information held by the non-contact ID tag acquired by the information acquisition means.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment relating to the marker information acquisition device described in (5). In those embodiments, for example, the annotation information 23A or the RFID tag information display 24A3 read from the non-contact ID tag 12 corresponds to the information held by the non-contact ID tag acquired by the information acquisition means. .

(Function and effect)
According to the marker information acquisition device described in (5), more information can be presented to the user.

  (6) The marker information acquisition apparatus according to (5), further comprising an input unit for inputting an operation instruction of the information acquisition control unit.

(Corresponding embodiment)
The embodiment relating to the marker information acquisition device described in (6) corresponds to the third embodiment. In the embodiment, for example, the input unit 25 corresponds to the input unit.

(Function and effect)
According to the marker information acquisition device described in (6), the user can control information acquisition.

  (7) The operation instruction of the information acquisition control means by the input means is an instruction as to whether or not the information acquisition means is to switch the function of the marker information acquisition device when a non-contact ID tag exists in the marker. (6) The marker information acquisition device according to (6).

(Corresponding embodiment)
The third embodiment corresponds to the embodiment relating to the marker information acquisition device described in (7). In the embodiment, for example, an information display 24A5 that prompts the user to input whether or not to read RFID tag information corresponds to an instruction as to whether or not the information acquisition unit is to switch the function of the marker information acquisition device. .

(Function and effect)
According to the marker information acquisition device described in (7), unnecessary information acquisition can be avoided depending on the user.

  (8) The switched function is whether or not to cause the information acquisition means to acquire information from a non-contact ID tag whose relative position is fixed with respect to the optical marker portion ( 7) The marker information acquisition apparatus described in 7).

(Corresponding embodiment)
The embodiment related to the marker information acquisition apparatus described in (8) corresponds to the third embodiment.

(Function and effect)
According to the marker information acquisition apparatus described in (8), it is possible to present only information obtained from the optical marker unit at high speed to a user who does not need to acquire information from the non-contact ID tag.

  (9) In the optical marker portion, information indicating the presence of the non-contact ID tag whose relative position is fixed with respect to the optical marker portion can be optically identified. (1) The marker information acquisition device according to (1),

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment relating to the marker information acquisition device described in (9). In those embodiments, for example, the RFID tag presence information 11C1 is information indicating the presence of the contactless ID tag, and the symbol, design 11B, or two-dimensional code 11C is the optically identifiable character, symbol, symbol, or code. Respectively.

(Function and effect)
According to the marker information acquisition device described in (9), it is possible to detect whether or not a non-contact ID tag exists only by photographing the optical marker portion.

  (10) The optical marker unit has at least three or more optically distinguishable features whose arrangement is known, and the photographing position can be estimated from an image obtained by photographing the feature. The marker information acquisition device according to (1), which is configured as described above.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment relating to the marker information acquisition device described in (10). In those embodiments, for example, large black circles arranged at the four corners of the frame portion 11A or the two-dimensional code 11C correspond to the feature portion.

(Function and effect)
According to the marker information acquisition device described in (10), the photographing position can be estimated by only photographing the optical marker portion.

  (11) The marker information acquisition apparatus according to (1), wherein the optical marker unit and the non-contact ID tag are integrally configured.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment relating to the marker information acquisition device described in (11).

(Function and effect)
According to the marker information acquisition device described in (11), since the optical marker portion and the non-contact ID tag are integrally configured, their relative positional relationship is determined at the time of manufacturing the composite marker. Therefore, it becomes difficult for the variation of the relative position to occur due to a work mistake of an operator who performs the sticking work when sticking to the article. For this reason, since information can be acquired from the non-contact ID tag when the non-contact ID tag is within a range where information can be acquired by the apparatus according to the present invention, more accurate and quick information acquisition can be expected.

FIG. 1A is a diagram showing a configuration of an information presentation device to which the marker information acquisition device according to the first embodiment of the present invention is applied, and FIG. 1B is a composite according to the first embodiment of the present invention. FIG. 1C is a front view of the front surface of the marker, and FIG. 1C is a front view of the back surface of the composite marker. FIG. 2 is a diagram illustrating an operation flowchart of the information presentation device to which the marker information acquisition device according to the first embodiment is applied. FIG. 3 (A) is a diagram showing articles placed in the real space, and FIG. 3 (B) shows related information stored in the related information storage unit and RFID tag information stored in the non-contact ID tag of the composite marker. FIG. 3C is a diagram showing a display example. FIG. 4A is a diagram showing a configuration of an information presentation device to which the marker information acquisition device according to the second embodiment of the present invention is applied, and FIG. 4B is a composite according to the second embodiment of the present invention. FIG. 4C is a front view of the front surface of the marker, FIG. 4C is a front view of the back surface of the composite marker, and FIG. 4D is a diagram showing an information structure of an optical marker portion in the composite marker. FIG. 5A is a diagram showing an operation flowchart of the information presentation device to which the marker information acquisition device according to the second embodiment is applied, and FIG. 5B is a case where the optical marker unit has RFID tag presence information. FIG. 5C is a diagram illustrating a display example when the optical marker unit does not have RFID tag presence information. FIG. 6 is a diagram showing a configuration of an information presentation device to which the marker information acquisition device according to the third embodiment of the present invention is applied. FIG. 7 is a diagram illustrating an operation flowchart of the information presentation device to which the marker information acquisition device according to the third embodiment is applied. FIG. 8A is a diagram showing a display example in the case of an inquiry when the optical marker unit has RFID tag presence information, and FIG. 8B is a diagram in which the optical marker unit has RFID tag presence information and FIG. 8C is a diagram showing a display example when an information reading is instructed by the user. FIG. 8C is a display example when the optical marker unit has RFID tag presence information and the user has not instructed to read the information. FIG. 8D is a diagram illustrating a display example when the optical marker unit does not have RFID tag presence information.

Explanation of symbols

    DESCRIPTION OF SYMBOLS 10 ... Composite marker, 11 ... Optical marker part, 11A ... Frame part, 11B ... Symbol and design, 11C ... Two-dimensional code, 11C1 ... RFID tag presence information, 11C2 ... Marker information, 12 ... Non-contact ID tag, 12A ... Antenna 12B IC chip 12C Storage unit 20 Information presentation device 21 Image input unit 22 Information acquisition control unit 22A Marker detection unit 22B Position and orientation detection unit 22C Marker information storage unit 22D ... related information generation unit, 22E ... related information storage unit, 22F ... superimposed image generation unit, 22E1 ... three-dimensional model, 22G ... control unit, 23 ... RFID reading unit, 23A ... annotation information, 24 ... display unit, 24A ... display screen, 24A1 ... display of marker information of optical marker part, 24A2 ... RFID on optical marker part 24A3 ... Display of RFID tag information read from the non-contact ID tag, 24A4 ... Display indicating that RFID tag presence information could not be detected in the optical marker section, 24A5 ... User Display of information prompting the user to input whether or not to read the RFID tag information, 24A6 ... Display of information indicating that the user canceled reading of the RFID tag information, 25 ... Input section, 30 ... Article.

Claims (11)

A marker information acquisition device that acquires information from a marker including an optical marker unit having optical characteristics,
An imaging unit having a predetermined imaging range and imaging an optical marker portion within the imaging range;
Information acquisition means for acquiring information held by the non-contact ID tag from a composite marker including a non-contact ID tag whose relative position is fixed with the optical marker unit together with the optical marker unit;
An information acquisition control means for switching the function of the marker information acquisition device when information indicating that the non-contact ID tag is present is detected by processing an image of the optical marker portion imaged by the imaging means; ,
A marker information acquisition apparatus comprising:   When the information acquisition control unit detects information indicating the presence of the non-contact ID tag, information from the non-contact ID tag whose relative position with respect to the optical marker unit is fixed to the information acquisition unit. The marker information acquisition apparatus according to claim 1, wherein the function of the marker information acquisition apparatus is switched so that the acquisition is performed.   The marker information acquisition apparatus according to claim 2, further comprising display means for displaying information obtained by processing an image of the optical marker portion photographed by the photographing means.   4. The marker information acquisition apparatus according to claim 3, wherein the information displayed on the display means includes information indicating that a non-contact ID tag exists in the marker.   4. The marker information acquisition apparatus according to claim 3, wherein the display means also displays information held by the non-contact ID tag acquired by the information acquisition means.   2. The marker information acquisition apparatus according to claim 1, further comprising input means for inputting an operation instruction of the information acquisition control means.   The operation instruction of the information acquisition control means by the input means is an instruction as to whether or not the information acquisition means is to switch the function of the marker information acquisition device when a non-contact ID tag exists in the marker. The marker information acquisition apparatus according to claim 6.   The function to be switched is whether or not to cause the information acquisition means to acquire information from a non-contact ID tag whose relative position is fixed with respect to the optical marker portion. The marker information acquisition device described.   For the optical marker unit, information indicating the presence of the non-contact ID tag whose relative position is fixed with respect to the optical marker unit is optically identifiable using characters, symbols, symbols, or symbols. The marker information acquisition apparatus according to claim 1, wherein the marker information acquisition apparatus is held.   The optical marker section has at least three or more optically distinguishable features whose arrangement is known, and is configured so that the photographing position can be estimated from an image obtained by photographing the features. The marker information acquisition apparatus according to claim 1, wherein   The marker information acquisition apparatus according to claim 1, wherein the optical marker unit and the non-contact ID tag are integrally formed.

Images