JP2011192236A - Tag recognition system, tag recognition device, and tag recognition method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a tag recognition system, a tag recognition device, and a tag recognition method which recognize an individual identification tag by optical wireless communication. <P>SOLUTION: A tag reader 130 includes: a detection means 154 which detects an optical marker 112 provided on an outer surface of an identification tag 104 from a frame read from an imaging apparatus; a light emitting element 114 provided on the outer surface of the identification tag 104; an estimation means 156 which estimates a portion corresponding to the light emitting element from the detected optical marker 112 in accordance with the setting of a position relation between the light emitting element and the optical marker on the outer surface in the circumference of the light emitting element; a determination means 158 which determines the light emitting state of the light emitting element of the identification tag from image information in the light emitting portion in the frame; and an identification means 160 which identifies a tag identification value which the identification tag 104 transmits by light emission in accordance with a determination result 168 of the light emitting state. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a tag recognition technique, and more particularly to a tag recognition system, a tag recognition device, and a tag recognition method for recognizing an individual identification tag through optical wireless communication.

  In recent years, various locations such as offices, hospitals, public facilities, etc., such as photocopiers, vending machines, large displays, medical devices, etc., are used to provide information to users and for users to input information. Many information terminals have been installed.

  From the viewpoint of the developer or manager of this information terminal, there is a desire to identify the user of the information terminal and customize the service and operation screen for each individual. In addition, there is a demand for collecting information not only on the information of the person who actually performed the operation, but also on the person who has approached the person who has attempted to operate or who has just passed by.

  As a technique for meeting the above demand, a method using a non-contact IC card has been known. In this method, a non-contact IC card in which an identification number is stored is carried by the user, a non-contact IC card reader is mounted on the information terminal, and a non-contact IC card is required to be presented when the information terminal is used. . However, such a non-contact IC card has a problem that the communication distance is about several tens of centimeters in the popular proximity type, and the user has to hold the IC card over the reader, so that the work is complicated. there were. Furthermore, this method of using a non-contact IC card has been difficult to collect information of a person who has just approached the information terminal or has just passed by.

  In addition, a technique for using an optical marker to meet the above-described demand is also known. In the method using an optical marker, an optical marker such as a bar code or a two-dimensional code indicating a user identification number, or a tag with an optical marker attached is carried, and the optical marker is optically received by a camera mounted on the information terminal. It is to let you read. However, the conventional method has a security problem because a third party can easily track a user using a camera that reads an optical marker.

  In addition, an object recognition system that uses an infrared tag and a tag reader equipped with an infrared camera is known as a technology that can meet the above-mentioned demand and ensure security. In this system, the user wears an infrared tag at a position visible from the infrared camera, the infrared tag stores a unique identification number linked to information about the wearer, and encodes this identification number into flashing infrared rays. To send. On the other hand, the tag reader reads the blink pattern using an infrared camera and decodes the identification number. In this prior art system, the identification number can be securely transmitted by encrypting the identification number to be transmitted in accordance with the information received from the reader.

  In the object recognition system using the above infrared tag, the reader continuously reads images with an infrared camera at a frame rate sufficiently higher than the blinking frequency of the infrared tag, and the position and lighting of the infrared tag from a plurality of read images. It is necessary to determine the state. For this reason, the load of image processing for reading the blinking of the infrared tag is increased, which increases the cost of the reader.

  On the other hand, if the change in the position of the infrared tag during continuous image reading is small, the process for specifying the position of the infrared tag can be simplified. From this viewpoint, Japanese Patent Application Laid-Open No. 2004-208229 (Patent Document 1) proposes a technique for increasing the speed of the blinking pattern of the infrared tag, sufficiently increasing the frame rate of the infrared camera, and reducing the position change of the infrared tag. ing.

  Alternatively, the blinking cycle of the infrared tag and the frame rate of the infrared camera are set low, but the light emitting point is specified following the change in the position of the infrared tag by performing image processing for tracking the position of the infrared tag on the reader side. There is also a proposed method.

  For example, Japanese Patent No. 4322145 (Patent Document 2) is an optical tag system including an optical tag and a video camera, in which a template region is set so as to surround a light spot included in a camera image. A search area is set around, and only the search area is searched for each frame, and information on the area having the template value closest to the template value of the target light spot is held as a light spot locus. An optical tag system for detecting whether an optical tag is turned on or off is disclosed.

  However, the prior art disclosed in Patent Document 1 requires an expensive camera with a high frame rate and a high image processing capability for processing an image image read at high speed with the camera. Further, according to the prior art disclosed in Patent Document 2, it is possible to provide a reader using an inexpensive camera with a low frame rate and an object recognition system using an infrared tag. However, since the image processing for tracking the light emitting point of the infrared tag is complicated, there is a problem that the burden of image processing on the reader side is large if sufficient accuracy is to be obtained.

  That is, in the object recognition system using the conventional infrared tag, security can be ensured. However, if the infrared tag tries to obtain sufficient recognition accuracy in the usage situation where the position of the infrared tag changes, the tag reader performs complicated image processing. There is a problem that it is necessary or the instrumentation cost by the camera is high, and as a result, it is difficult to stably detect the infrared tag.

  The present invention has been made in view of the above-mentioned conventional problems, and the present invention provides simplified image processing for determining the light emission state of an individual identification tag, and thus the identification processing of an individual identification tag. It is an object of the present invention to provide a tag recognition system, a tag recognition device, and a tag recognition method that can be stably realized at low cost.

  In view of the above problems, the present invention provides an identification tag, a tag reader, and a tag recognition system including the identification tag and the tag reader having the following characteristics. In the identification tag of the present invention, a light emitting element and an optical marker around the light emitting element are provided on the outer surface of the identification tag, and the tag identification value is transmitted by light emission by controlling the light emitting element. And According to the tag reader of the present invention, the detection means for detecting the optical marker from the frame read from the imaging device, and the positional relationship between the optical marker and the light emitting element on the outer surface of the identification tag, from the detected optical marker, An estimation unit that estimates a light emitting part corresponding to a light emitting element in a frame, a determination unit that determines a light emitting state of the light emitting element from image information of the light emitting part, and an identification that identifies a tag identification value according to a result of the light emitting state Means.

  Furthermore, the present invention provides a tag recognition method executed by the tag reader. In the tag recognition method of the present invention, a tag reader causes the imaging device to image the identification tag, a step of reading a frame from the imaging device, a step of detecting an optical marker from the read frame, an optical marker and a light emitting element, Performing a step of estimating a light emitting part according to the positional relationship arrangement, a step of determining a light emitting state of the light emitting element from image information of the light emitting part, and a step of identifying a tag identification value according to the light emitting state determination result. Features.

  According to the above configuration, the outer surface of the identification tag is provided with an optical marker around the light emitting element according to a predetermined rule. The tag identification number of the identification tag is not an optical marker, but is emitted by light emission of the light emitting element included in the identification tag. It is transmitted to the tag reader. Therefore, even if a third party can recognize the optical marker, it is difficult to obtain a tag identification number transmitted by infrared communication. Further, on the tag reader side, the light emitting part in the frame of the identification tag can be estimated by a simple image process of detecting the optical marker portion provided on the outer surface of the identification tag in accordance with the above-mentioned predetermined agreement. Therefore, the image processing for this estimation has a small load, avoids the need for high-frequency blinking and imaging at a high frame rate, and thus reduces the overall cost.

The figure which shows the outline (A) of the object recognition system of this embodiment, and the external appearance (B) of an infrared tag. The figure which shows the hardware constitutions of the object recognition system of this embodiment. The functional block diagram implement | achieved by the tag reader side of this embodiment. The figure which shows typically the binary image data (B) at the time of binarizing the flame | frame (A) acquired when the infrared tag is image | photographed with the infrared camera in this embodiment, and the said flame | frame. The figure which shows the data structure of the marker information (A) in this embodiment, light emission site | part information (B), and the determination result (B). The timing chart which shows the outline of the infrared wireless communication between an infrared tag and a tag reader. The flowchart which shows the process which the tag reader of this embodiment performs, and the process which an infrared tag performs. The flowchart which shows the data reception process by the infrared camera which the tag reader of this embodiment performs.

  Hereinafter, although embodiment of this invention is described, embodiment of this invention is not limited to embodiment described below. In the following description, as an example of a tag recognition system including an identification tag and a tag recognition device, an object configured to include an infrared individual identification tag (hereinafter referred to as an infrared tag) and an information terminal on which a tag reader is mounted. The object recognition system will be described.

  FIG. 1A is a diagram illustrating an outline of an object recognition system of the present embodiment. As shown in FIG. 1A, an object recognition system 100 according to this embodiment includes an infrared tag 104 attached to a user 102 to be recognized and an information terminal 106. The infrared tag 104 stores a unique identification number (hereinafter referred to as a tag identification value) associated with information (personal information, history information, etc.) related to the user 102 and responds to a request from the tag reader. The identification number is transmitted.

  The infrared tag 104 according to the present embodiment is a so-called active tag equipped with a battery, and an infrared LED (Light Emitting Diode) is blinked by power supplied from the battery to realize wireless communication using infrared light. . In other embodiments, a passive tag may be configured as long as sufficient power can be captured by radio waves or light. The shape and form of the infrared tag 104 are not particularly limited, but preferably, a clip and a strap can be provided so that the infrared tag 104 can be easily attached to work clothes used in hospitals and factories.

  The information terminal 106 incorporates a tag reader that communicates with the infrared tag 104. The tag reader mounted on the information terminal 106 includes an infrared camera facing the front of the information terminal 106, and the infrared tag 104 is in the field of view of the infrared camera. When entering, a tag identification value transmitted from the infrared tag 104 by infrared light wireless communication is received. For example, the information terminal 106 acquires information about the user associated with the received tag identification value from an external database, and displays information customized using the user information, such as displaying a screen customized for each user. Provision can be made.

  FIG. 1B is a diagram illustrating the appearance of the infrared tag 104 of the present embodiment as an example. The infrared tag 104 shown in FIG. 1B has a card shape, and a light emitting element 114 such as an infrared LED is provided at a substantially central portion of the outer surface. The infrared tag 104 shown in FIG. 1B is further provided with a substantially square frame-shaped optical marker portion 112 so as to surround the light emitting element 114.

  The position, number, and size of the light emitting element 114 in the infrared tag 104 are not particularly limited, and the shape, pattern, position, and size of the optical marker 112 are not particularly limited, but the above The positional relationship between the optical marker unit 112 and the light emitting element 114 follows a predetermined rule. In the example shown in FIG. 1B, it is assumed that the optical marker portion 112 has a substantially square frame shape, and that the light emitting element 114 is arranged at the approximate center of the frame shape. In another embodiment, the optical marker unit may adopt any optical marker shape, pattern, or the like known so far, such as a barcode or a two-dimensional code. However, from the viewpoint of the recognition accuracy and the simplification of the recognition process, it is preferable that the optical marker has a short frame shape such as the substantially square frame shape.

  In a preferred embodiment, the optical marker 112 can be configured as a region coated with a so-called retroreflective material having a property of strongly reflecting infrared light in the light source direction. The retroreflective member is not particularly limited, but preferably a material having transparency in the visible light region can be employed. By adopting a retroreflective member that is transparent or translucent in the visible region, it does not obstruct human eyes, while an optical marker can be suitably detected by a tag reader equipped with an infrared camera. . In other embodiments, the optical marker portion 112 may employ an opaque material such as black instead of a transparent or translucent material.

  FIG. 2 is a diagram illustrating a hardware configuration of the object recognition system 100 according to the present embodiment. The infrared tag 104 of the object recognition system 100 shown in FIG. 2 includes a controller 120, an identification number storage unit 122, an RF (Radio Frequency) reception unit 124, and a light emitting element 114. The tag reader 130 includes a controller 132, an identification number storage unit 134, an RF transmission unit 136, an infrared irradiation unit 138, and an infrared camera 140.

  The identification number storage unit 122 of the infrared tag 104 is configured by a nonvolatile storage medium such as ROM (Read Only Memory) or NV-RAM (Non-volatile RAM), and uniquely identifies the infrared tag 104. Is stored. Similarly, the identification number storage unit 134 of the tag reader 130 is also configured by a ROM, NV-RAM, or the like, and stores an identification number for uniquely identifying the tag reader 130 (hereinafter referred to as a reader identification number).

  In the embodiment to be described, the tag identification number and the reader identification number are assumed to have a bit length of 6 bits, but the bit length of the identification number is not particularly limited. As the identification number, any identification number can be used as long as the tag (or the user carrying the tag) and the tag reader can be uniquely identified within the range of use. The identification number may be a standardized identifier such as an IP (Internet Protocol) address or a MAC (Media Access Control) address, or a serial number that can be determined for each vendor.

  The infrared irradiation unit 138 of the tag reader 130 is configured by one or a plurality of infrared LEDs, and reflects the infrared rays on the optical marker unit 112 of the infrared tag 104 described above to capture an image with an infrared camera, for example, Infrared rays are emitted toward the front of the information terminal 106. The infrared camera 140 of the tag reader 130 includes a CMOS (Complementary Metal Oxide Semiconductor) image sensor, an optical system such as a lens, and an infrared filter. When the infrared irradiation unit 138 emits infrared rays, a predetermined frame is formed. Imaging at a rate is attempted, and imaging of reflected light from the optical marker 112 provided on the outer surface of the infrared tag 104 is attempted.

  In addition, when the optical marker part 112 of the infrared tag 104 is comprised using an opaque material (for example, black), the said infrared irradiation part 138 is not necessarily required, In this case, the optical marker part 112 is used. In order to detect, a camera in the visible light region that captures an image in the visible light region is used.

  The RF transmission unit 136 of the tag reader 130 transmits an RF signal to the infrared tag 104. The RF receiver 124 of the infrared tag 104 receives an RF signal from the tag reader 130 side. In this embodiment, the infrared tag 104 and the tag reader 130 perform packet exchange 108 by RF communication using the RF receiving unit 124 and the RF transmitting unit 136 in order to start infrared communication. The packet exchanged here includes an identification number request packet that is transmitted from the tag reader 130 side to the infrared tag 104 side and requests to transmit the unique tag identification number of the infrared tag 104 by infrared communication.

  The high frequency band used by the RF receiving unit 124 and the RF transmitting unit 136 of the present embodiment can be a 2.5 GHz band in the example, but an LF (Low Frequency) band, an HF (High Frequency) band, UHF Any frequency band used in wireless communication, such as (Ultra High Frequency) band, can be used.

  The controller 120 of the infrared tag 104 is connected to the light emitting element 114, the identification number storage unit 122, and the RF receiving unit 124 described above, and controls these to execute communication with the tag reader 130. The controller 132 of the tag reader 130 is connected to the identification number storage unit 134, the RF transmission unit 136, the infrared irradiation unit 138, and the infrared camera 140 described above, and executes communication with the infrared tag 104 by controlling them.

  The controller 132 of the tag reader 130 periodically or irregularly irradiates infrared light toward the front of the information terminal 106 by the infrared irradiation unit 138, and reflects the reflected light from the optical marker unit 112 from the frame imaged by the infrared camera 140. By trying detection, it is confirmed whether or not the infrared tag 104 exists in the field of view. When the infrared tag 104 exists in the field of view of the infrared camera 140, an identification number request packet is transmitted by the above-described RF communication.

  In order to improve the safety of infrared communication, the identification number request packet can include a tag identification value of the tag reader 130 indicating the legitimacy of the transmission source, an encryption key used for encryption, and the like. As the encryption key, a pseudo random number generated by a pseudo random number generator or a date value can be preferably used.

  When the RF reception unit 124 receives the identification number request packet, the controller 120 of the infrared tag 104 controls the light emitting element 114 to transmit its own tag identification number by infrared communication. At this time, it is possible to transmit the tag identification number only when receiving an identification number request packet including a reader identification number registered in advance as valid. If the request packet includes an encryption key, the tag identification value can be encrypted using the encryption key and transmitted. The reader identification number itself may be used for encryption.

  By introducing a mechanism using the above-mentioned reader identification number, it is possible to send a tag identification number only in response to a request packet from a specific tag reader, and accidentally assign a tag identification number to other illegal tag readers. There is an advantage that it is possible to reduce the possibility of making a call or tracking the identification number by a third party. Further, by introducing an encryption mechanism, the tag identification number can be transmitted with higher security.

  The controller 132 of the tag reader 130 identifies the part of the light emitting element 114 identified by the reflected light of the optical marker unit 112 from the frame imaged by the infrared camera 140, and determines the light emission state, so that the infrared light Get tag identification number encoded as blinking. When the identification number is encrypted, the data acquired by encoding is decrypted to obtain the tag identification number.

  Hereinafter, the infrared communication processing by the tag recognition method of this embodiment will be described with reference to the functional block diagram shown in FIG. FIG. 3 shows functional blocks realized on the tag reader 130 side of the present embodiment. The functional block 150 of the tag reader 130 shown in FIG. 3 includes a frame reading unit 152, a marker detection unit 154, a light emission site estimation unit 156, a state determination unit 158, and an identification number identification unit 160. Each of these functional units 152 to 160 is realized under the control of the controller 132 of the tag reader 130.

  The frame reading unit 152 reads one frame image from the infrared camera 140, stores the frame 162 in the memory area, and passes the processing to the marker detection unit 154. The marker detection unit 154 tries to detect an optical marker having a predetermined shape pattern from the frame 162. In the present embodiment, the image pattern of the optical marker unit 112 of the infrared tag 104 is registered in advance, and the marker detection unit 154 searches the frame 162 for an image region that matches the registered pattern, and detects the marker. To do.

  The marker detection unit 154 can detect the marker using a marker detection algorithm known in the technical field of augmented reality (AR). Here, an example of processing for detecting a marker from the frame 162 will be described with reference to FIG.

  FIG. 4A is a diagram schematically illustrating a frame acquired when the infrared tag 104 is photographed by the infrared camera 140 under the infrared irradiation of the infrared irradiation unit 138 in the present embodiment. In the frame 180 shown in FIG. 4A, the reflected light 182 of the optical marker unit 112 of the infrared tag 104, the light emission 184 observed when the light emitting element 114 is lit, and other ambient light 186a, 186b exists as a bright area. The ambient light 186 is generated by a fluorescent lamp or the like, and these are noises when detecting the optical marker unit 112 of the infrared tag 104.

  The marker detection unit 154 first binarizes the frame 162 read as a gray scale, detects bright closed regions 192, 194, 196a, and 196b and attaches identifiers thereto. FIG. 4B is a diagram schematically showing binary image data when the frame shown in FIG. 4A is binarized. Subsequently, the marker detection unit 154 determines a circumscribed short form of each detected closed area and finds a contact coordinate between the circumscribed short form and the closed area, thereby determining whether or not the outline of the closed area is a quadrangle. To do. At this stage, the closed regions 196a, 196b, 194 corresponding to the ambient light 186a, 186b and the light emission 184 that do not have four vertices are excluded.

  Subsequently, the marker detection unit 154 calculates the similarity of the image inside the rectangular closed region 192 by matching with a marker image prepared in advance, determines whether or not the rectangle is a marker image, and detects it. The marker information 164 describing the information related to the marker is stored in the memory, and is passed to the light emission site estimation unit 156.

  FIG. 5A shows an example of the data structure of marker information output by the marker detection unit 154 of the present embodiment. The marker information 164 shown in FIG. 5A includes the identifier assigned to each marker, the center coordinates of the marker, the coordinates of the four vertices, the coefficient of the function representing a straight line on four sides, and the detected markers. And the calculated reliability value. Here, a plurality of markers can be detected. However, when a plurality of markers are detected, a marker having a higher reliability or a marker having a reliability higher than a predetermined threshold can be targeted. Further, the marker detection unit 154 associates the identification values of the markers between the frames, and attaches the same identification value to the markers detected in the same size at positions close to each other between the frames. Thereby, even if it is a case where a some infrared tag is contained in a captured image, it becomes possible to process each independently.

  Referring again to FIG. 3, the light emission site estimation unit 156 reads the marker information 164 and estimates the light emission site from the predetermined positional relationship between the optical marker unit 112 and the light emitting element 114. In the present embodiment, it is determined that the light emitting element 114 is disposed substantially at the center of the substantially square frame-shaped optical marker unit 112, and the light emitting part estimation unit 156 determines the center coordinates of the marker as the center coordinates of the light emitting part. Further, the size of the light emitting part is determined from the distance between the four vertices of the marker, stored as the light emitting part information 166 in the memory, and the process is passed to the state determining unit 158.

  FIG. 5B shows an example of the data structure of the luminescent site information output by the luminescent site estimation unit 156 of the present embodiment. The light emitting part information 166 shown in FIG. 5B includes the identifier assigned to each marker, the light emitting part coordinates, and the size on the image.

  Referring to FIG. 3 again, the state determination unit 158 reads the light emission part information 166, reads the pixel value of the image area specified as the light emission part in the frame 162, and determines the light emission state. The image region of the light emitting part is specified as, for example, an R × R square pixel region or a pixel region corresponding to a circle with a diameter R centered on the center coordinates (X0, Y0). The determination of the light emission state is performed, for example, by calculating the average of the pixel values of the specified image area, comparing the threshold value given in advance for the state determination with the calculated average value, and exceeding the threshold value (over the threshold value) When the value is bright, it is determined that the light is on (H: High), and when the threshold is not exceeded, the light is off (L: Low). Moreover, the calculation method of an average value is not specifically limited, You may calculate a weighted average according to the distance from a center coordinate.

  When the light emission state is determined for one frame, the determination result 168 is written, and the light emission state determination process is repeated for the required number of frames. FIG. 5C shows an example of the data structure of the determination result 168 output by the state determination unit 158 of this embodiment. The determination result 168 shown in FIG. 5C includes an identifier assigned to each marker and a value indicating the light emission state (H / L) determined in each frame. The number of frames included in the determination result for one communication is set according to the blinking frequency of the infrared tag 104, the frame rate (sampling frequency) of the infrared camera 140, the number of bits of the tag identification number, and the like.

  FIG. 6 is a timing chart showing an outline of infrared wireless communication between the infrared tag and the tag reader. In the example shown in FIG. 6, the infrared tag 104 encodes a tag identification number according to the Manchester encoding method, and expresses values “0” and “1” by blinking of the light emitting element 114. In the example shown in FIG. 6, the data transmitted from the infrared tag by infrared wireless communication is composed of a total of 8 bits including a start bit “0”, a tag identification number “111001”, and a parity bit “0”. The value of each bit is represented by a transition from light-off (L) to lighting (H) (“0”) or a transition from lighting (H) to light-off (L) (“1”). The Manchester encoding method is preferably used, but other encoding methods such as an NRZ (Non Return to Zero) encoding method may be adopted.

  The image reading frequency (frame rate) of the infrared camera 140 on the tag reader 130 side needs to be at least twice the blinking frequency of the light emitting element 114. For example, when the blinking frequency of the infrared tag 104 is 15 Hz, the tag reader 130 The reading frequency can be 30 Hz, which is twice that frequency.

  The start bit transmitted from the infrared tag 104 is a bit for notifying the tag reader 130 of the start of data communication. As described above, the tag reader 130 periodically reads the frame of the infrared camera 140, and the state determination unit 158 determines the light emission state of the infrared tag 104. When the tag reader 130 detects a start bit (that is, a transition from extinguishing (L) to lighting (H)) from the determination result of 2 frames, the total number of bits transmitted by the infrared tag 104 (6 bits in the example shown in FIG. 6). ) Is repeated for the number of frames twice (14 frames in the example shown in FIG. 6). In the determination result 168, as shown in FIG. 5C, a value (H / L) indicating the light emission state for a total of 16 frames from the start bit to the parity bit is recorded. When determination results for a predetermined number of frames including the start bit are obtained, the process is passed to the identification number identification unit 160.

  The identification number identification unit 160 reads the determination result 168, performs bit determination of the bit string corresponding to the identification number from the light emission state of the light emitting part in each frame, and outputs the tag identification number 170. The identification number identification unit 160 performs error detection using parity bits as appropriate, and verifies the correctness of the obtained tag identification number. In the present embodiment, the case of using one start bit and one parity bit has been described. However, in other embodiments, the number of start bits may be increased, and a checksum, Other error detection codes or error correction codes such as block codes, Hamming codes, CRC (Cyclic Redundancy Check) may be used.

  Hereinafter, with reference to FIG. 7 and FIG. 8, the infrared wireless communication performed by the tag recognition method of the present embodiment performed between the infrared tag and the tag reader will be described in more detail. FIG. 7 is a flowchart showing a process executed by the tag reader 130 and a process executed by the infrared tag 104 of the present embodiment. The process shown in FIG. 7 is called from the tag reader 130 regularly or irregularly, and starts from step S100. Note that the processing shown in FIG. 7 may be started periodically at a preset interval, or may be started at the timing when the human body detection sensor detects a human in cooperation with another human body detection sensor (not shown). Good.

  In step S101, the tag reader 130 starts infrared irradiation from the infrared irradiation unit 138, and in step S102, the frame reading unit 152 reads one frame image from the infrared camera 140. In step S103, the tag reader 130 tries to detect a marker by the marker detection unit 154, and in step S104, the tag reader 130 determines whether or not a marker exists in the read frame. Here, for example, it is possible to determine whether or not there is a marker having a reliability exceeding a predetermined threshold among those detected by the marker detection unit 154.

  If it is determined in step S104 that a marker exists (YES), the process proceeds to step S105. In step S105, the tag reader 130 transmits an identification number request packet by using the RF transmission unit 136, and in step S106, the data reception process by the infrared camera 140 is called. This identification number request packet includes the reader identification number and the encryption key described above.

  On the other hand, the processing of the infrared tag 104 is started in response to the reception of the identification number request packet by the RF receiving unit 124 in step S200. In step S201, the infrared tag 104 compares the reader identification number included in the identification number request packet with the reader identification number registered in advance, and determines its validity. If it is determined in step S201 that it is valid, the process proceeds to step S202. In step S202, the infrared tag 104 reads the tag identification number from the identification number storage unit 122, encrypts the tag identification number using the encryption key included in the request packet, encodes it into the blinking of the light emitting element 114, A data packet including the tag identification number is transmitted by infrared wireless communication, and the process ends in step S203. On the other hand, if it is determined in step S201 that it is not valid, the process proceeds to step S203, and the process ends without responding.

  FIG. 8 is a flowchart showing data reception processing by the infrared camera, which is executed by the tag reader 130 of this embodiment. The process shown in FIG. 8 is called in step S106 shown in FIG. 7, and starts from step S300. In the processing loop shown in steps S301 to S307, the light emission state is determined for each frame.

  In step S302, the tag reader 130 reads an image of one frame from the infrared camera 140 by the frame reading unit 152 and stores it in the memory. In step S303, the tag reader 130 attempts to detect a marker from the read frame by using the marker detection unit 154, acquires marker information, and determines in step S304 whether a marker is present in the frame. Here, as in step S104, it is determined whether there is a marker having a reliability exceeding a predetermined threshold. If it is determined in step S304 that a marker exists (YES), the process proceeds to step S305.

  In step S305, the tag reader 130 uses the marker information of the detected marker to the light emitting element 114 according to the positional relationship between the optical marker part 112 and the light emitting element 114 on the outer surface of the infrared tag 104 by the light emitting part estimation unit 156. Estimate the part in the corresponding frame. In this embodiment, an image area in a predetermined size range is estimated from the center coordinates of the detected marker. In step S306, the tag reader 130 uses the state determination unit 158 to determine the light emission state of the light emitting element 114 from the image information of the estimated light emission region in the frame, and writes the determination result.

  When the processes shown in steps S301 to S307 are repeated a predetermined number of times, the process proceeds to step S308. In step S308, the tag reader 130 identifies the tag identification number from the determination result of the light emission state by the identification number identification unit 160, performs an error determination in step S309, ends the processing in step S309, and is shown in FIG. Return control to the process. When the correctness of the transmission data is verified in the determination in step S309, the obtained tag identification number is set as a return value, and when it is determined that the transmission data is incorrect, a value indicating an error. Will be set as the return value.

  On the other hand, if it is determined in step S304 that there is no marker (NO), the process exits the loop, sets an error as a return value in step S311, and ends the process in step S310. This corresponds to the case where the infrared tag 104 is removed from the field of view of the infrared camera 140 during communication. Therefore, when the next regular or irregular process shown in FIG. 7 is started, the process is restarted from the beginning. In addition, when a some marker is detected, the process shown in FIG. 8 will be performed for every detected marker.

  Referring to FIG. 7 again, on the tag reader 130 side, when reception of data by infrared communication is completed in step S106, the return value is acquired, and the process proceeds to step S107. In step S107, it is determined from the return value whether the tag identification number has been successfully acquired. If it is determined in step S107 that the tag identification number has been successfully acquired (YES), the process proceeds to step S108. In step S108, the tag reader 130 passes the tag identification number to the information terminal 106, for example, and screen display or information provision customized for each user is performed according to the tag identification number. In step S109, the infrared irradiation from the infrared irradiation unit 138 is terminated, and in step S110, the process is terminated.

  On the other hand, if it is determined in step S107 that an error has been detected by the error determination or the infrared tag 104 has been lost during communication and it has been determined that acquisition of the tag identification number has failed (NO), the process proceeds to step S109. The irradiation of the infrared rays from the infrared irradiation unit 138 is terminated, and the present process is terminated in step S110. If it is determined in step S104 that there is no marker (NO), the process directly proceeds to step S109, the infrared irradiation from the infrared irradiation unit 138 is terminated, and the process ends in step S110. Let

  In the embodiment described above, the optical marker unit 112 is provided on the outer surface of the infrared tag 104. However, the tag identification number of the infrared tag 104 is not an optical marker, but is a light-emitting element provided in the infrared tag 104 after being encrypted. It is transmitted to the tag reader 130 by blinking 114. Therefore, even if a third party can recognize the optical marker unit 112, it is difficult to obtain a tag identification number transmitted by infrared communication.

  Further, on the tag reader 130 side, the presence of the infrared tag 104 is detected by simple image processing of detecting the optical marker portion 112 provided on the outer surface of the infrared tag 104, and the light emission site is estimated. That is, the optical marker unit 112 is used to estimate the light emitting part, and the image processing for this estimation has a smaller load than the process of directly detecting the light emitting part by pattern matching or the like. Also, as usual, the frame rate of the infrared camera is sufficient to be twice the blinking frequency, and the instrumentation cost on the tag reader 130 side is reduced.

  That is, according to the present embodiment, simplified image processing for determining the light emission state of the individual identification tag is provided, and as a result, tag recognition that can realize the identification processing of the individual identification tag at low cost and stably. A system, a tag recognition device, and a tag recognition method can be provided.

  The above-described functions of the present embodiment can be realized by an apparatus-executable print control program written in an object-oriented programming language such as assembler, C, C ++, C #, Java (registered trademark), etc. It can be stored in a device-readable recording medium such as a hard disk device, CD-ROM, MO, DVD, flexible disk, EEPROM, EPROM and distributed.

  Although the present embodiment has been described so far, the present invention is not limited to the above-described embodiment, and other embodiments, additions, changes, deletions, and the like can be conceived by those skilled in the art. As long as the effects of the present invention are exhibited in any aspect, the present invention is included in the scope of the present invention.

DESCRIPTION OF SYMBOLS 100 ... Object recognition system, 102 ... User, 104 ... Infrared tag, 106 ... Information terminal, 108 ... Packet exchange, 112 ... Optical marker part, 114 ... Light emitting element, 120 ... Controller, 122 ... Identification number storage part, 124 ... RF receiving unit, 130 ... tag reader, 132 ... controller, 134 ... identification number storage unit, 136 ... RF transmission unit, 138 ... infrared irradiation unit, 140 ... infrared camera, 150 ... functional block, 152 ... frame reading unit, 154 ... marker Detection unit, 156... Luminescence site estimation unit, 158... State determination unit, 160 .. identification number identification unit, 162... Frame, 164 ... marker information, 166. ... Reflected light, 184 ... Light emission, 186 ... Ambient light, 192, 194, 196 ... Closed area

JP 2004-208229 A Japanese Patent No. 4322145

Claims (16)

A tag recognition system including a tag reader including an imaging device and an identification tag, wherein the identification tag is
A light emitting element provided on the outer surface of the identification tag;
An optical marker provided on the outer surface around the light emitting element;
Control means for controlling the light emitting element to emit a tag identification value by light emission;
The tag reader comprises:
Detecting means for detecting the optical marker from a frame read from the imaging device;
Inferring means for estimating a portion corresponding to the light emitting element from the detected optical marker according to the arrangement of the positional relationship between the optical marker and the light emitting element on the outer surface of the identification tag;
Determining means for determining a light emitting state of the light emitting element from image information of the part in the frame;
A tag recognition system including identification means for identifying the tag identification value according to the determination result of the light emission state. The tag reader further includes transmitting means for transmitting a request packet for requesting transmission of the tag identification value, including a reader identification value unique to the tag reader.
The identification tag further includes receiving means for receiving the request packet, and the control means receives a request packet that matches the registered reader identification value by checking with a previously registered reader identification value. The tag recognition system according to claim 1, wherein the tag identification value is transmitted to the light emitting element. The control means encrypts the tag identification value using the reader identification value,
The tag recognition system according to claim 2, wherein the identification unit decodes the tag identification value from information obtained from the determination result of the light emission state.   The tag reader further includes number generation means for generating a number for each request packet, the transmission means transmits the generated number included in the request packet, and the control means uses the number. The tag recognition system according to claim 2 or 3, wherein the tag identification value is encrypted.   The tag recognition system according to claim 1, wherein the optical marker has a substantially rectangular shape.   The tag recognition system according to claim 1, wherein the optical marker is a transparent or translucent retroreflective material.   The tag recognition system according to claim 1, wherein the light emitting element emits infrared light, and the imaging device has sensitivity in an infrared region.   The tag recognition system according to any one of claims 1 to 7, wherein the control means encodes the tag identification value into a light emission pattern by a Manchester encoding method.   The tag recognition system according to any one of claims 1 to 8, wherein the control means further uses a start bit and an error correction code when the tag identification value is transmitted. A tag reader comprising an imaging device, detecting means for detecting an optical marker provided on the outer surface of the identification tag from a frame read from the imaging device;
Estimation that estimates a portion corresponding to the light emitting element from the detected optical marker according to a positional relationship between the light emitting element provided on the outer surface of the identification tag and the optical marker on the outer surface around the light emitting element. Means,
Determining means for determining a light emitting state of the light emitting element of the identification tag from image information of the part in the frame;
A tag reader comprising: identification means for identifying a tag identification value transmitted by the identification tag by light emission according to the determination result of the light emission state.   The tag reader according to claim 10, further comprising a transmission unit configured to include a reader identification value unique to the tag reader and to transmit a request packet for requesting the transmission of the tag identification value in order to indicate the validity of the tag reader.   The tag reader according to claim 11, wherein the identification unit uses the reader identification value to decode the tag identification value from information obtained from the determination result of the light emission state.   The number generation means for generating a number, wherein the transmission means transmits the request packet by including the number in order to encrypt the tag identification value using the number. 12. The tag reader according to 12. An identification tag that communicates with the tag reader according to any one of claims 10 to 13, wherein the identification tag is:
A light emitting element provided on the outer surface of the identification tag;
An optical marker provided on the outer surface around the light emitting element;
An identification tag including control means for controlling the light emitting element to emit a tag identification value by light emission. A method performed by a tag reader comprising an imaging device, wherein the tag reader is
A step of causing the imaging device to image an identification tag in which a light emitting element is provided on an outer surface and an optical marker is provided on an outer surface around the light emitting element;
Reading a frame from the imaging device;
Detecting the optical marker from the read frame;
Estimating a portion corresponding to the light emitting element from the detected optical marker according to a positional relationship between the optical marker and the light emitting element on the outer surface of the identification tag;
Determining a light emitting state of the light emitting element from image information of the part in the frame;
And a step of identifying a tag identification value transmitted by the identification tag by light emission according to the determination result of the light emission state.   The tag reader further executes a step of transmitting a request packet for requesting the transmission of the tag identification value, including a reader identification value unique to the tag reader, in order to indicate the validity of the tag reader. The identification tag recognition method according to claim 15.