JP2008171222A - Article monitoring system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem of a conventional system for monitoring theft or the like by attaching a wireless tag to an article in which an operation for conforming information easy for a user to identify the article to a tag ID is complicated. <P>SOLUTION: A portable terminal 12 is equipped with a tag reader part 42 and an imaging part 44 set so that a range 62 for detecting the wireless tag by the tag reader part 42 and an imaging range 68 of the imaging part are in common. The imaging part 44 photographs the image in a state where the tag reader is detecting the wireless tag attached to the article, whereby an image of the article is obtained. The article image can be used as information easy for the user to identify. A control part 40 conforms the tag ID obtained from the article with the image article to create article information, and transmits the information to a monitoring device for registration thereof. The monitoring device monitors the presence of the wireless tag, and presents, when it is not detected, the article image registered in conformation to the wireless tag to the user to notify that event. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an article monitoring system that monitors the presence of an article based on a detection result of a wireless tag attached to the article.

  Japanese Patent Application Laid-Open No. 2004-151867 discloses a system in which RFID (Radio Frequency Identification) tags are attached to individual valuables of a user, and the valuables placed in an absence home are monitored by a tag reader installed in the home.

In this system, the user can write information such as the product name on the RFID tag with the writer of the mobile phone, and identify the valuables based on the information.
JP-A-2005-151200

  It has been a problem for the user to manually input information for identifying articles to be monitored, which is troublesome for the user and easily causes erroneous input.

  The present invention has been made to solve the above-described problems, and an article that makes it possible to associate information that facilitates identification of an article with a wireless tag with the wireless tag with less user load. The purpose is to provide a monitoring system.

  An article monitoring system according to the present invention is a system for monitoring the presence of an article based on a detection result of the RFID tag attached to the article, wherein the identification information of the RFID tag and the RFID tag are attached. A storage unit that stores article information associated with a related image related to an article, and an article information generation unit that generates the article information stored in the storage unit, wherein the article information generation unit includes: An imaging unit that captures an image of an area where the article is present, a tag detection unit that has a detection range corresponding to the imaging range of the imaging unit and detects the wireless tag present in the detection range, and the tag detection A coupling unit that associates a captured image obtained by the imaging unit when the wireless tag is detected by the unit with the identification information of the wireless tag as the related image.

  According to the present invention, the identification information of the wireless tag given regardless of the article is associated with the related image related to the article to which the wireless tag is attached. For example, the system monitors the presence of the wireless tag based on the identification information of the wireless tag, while using a related image that makes it easier to understand the article than the identification information of the wireless tag, Can show. Based on the correspondence between the imaging range of the imaging unit and the detection range of the tag detection unit, the article information generation unit acquires, for example, an image of an article with a wireless tag attached as a related image, and the identification information Associate.

  The tag detection unit may have a directivity corresponding to the angle of view of the imaging unit, and may include an antenna that transmits and receives signals to and from the wireless tag.

  The coupling unit may be configured to determine the sharpness of the captured image and generate the article information when the sharpness is equal to or greater than a predetermined reference value.

  Moreover, the said coupling | bond part can be set as the structure which produces | generates the said article information corresponding to the said wireless tag, when the said tag detection part detects only the said wireless tag.

  Furthermore, the said coupling | bond part excludes the said wireless tag from the production | generation object of the said article information, when the said article information corresponding to the said wireless tag detected by the said tag detection part is already memorize | stored in the said memory | storage part. It can be.

  Moreover, the article monitoring system according to the present invention includes the monitoring device having the storage unit, the article information generation unit, and is communicable with the monitoring device, and the generated article information is stored in the monitoring device. And a portable terminal registered in the storage unit.

  According to the present invention, the article information generation unit performs a basic process of generating article information by associating identification information with a related image, so that a user's load related to generation of the article information is reduced. .

  Hereinafter, embodiments of the present invention (hereinafter referred to as embodiments) will be described with reference to the drawings.

  FIG. 1 is a schematic diagram showing a schematic configuration of an article monitoring system according to an embodiment of the present invention. This system includes a monitoring area 2 and a monitoring center 4. The monitoring area 2 can be set indoors, such as a user's residence or office, or outdoors near the building. In the monitoring area 2, a monitoring device 6 and a tag reader 8 are installed. Further, FIG. 1 shows an article 10 to be monitored and a portable terminal 12 operated by the user in the monitoring area 2. A radio tag 14 is attached to each article 10 to be monitored. Each wireless tag 14 is preliminarily provided with a tag ID which is identification information for identifying each other. The portable terminal 12 has a mobile communication function. The monitoring device 6 and the monitoring center 4 are configured to be communicable via a network 16 such as a public line network. A mobile communication base station 18 is also connected to the network 16 so that the monitoring device 6 and the mobile terminal 12 can communicate with each other via the network 16 and mobile communication.

  Hereinafter, the main components of this system will be described individually.

  The tag reader 8 detects the wireless tag 14 existing in the monitoring area 2. Specifically, the tag reader 8 detects the wireless tag 14 by periodically transmitting an interrogation wave to the surrounding area where it is installed and detecting a response wave from the wireless tag 14 corresponding thereto. The tag readers 8 are arranged so as to enable detection of the wireless tag 14 in the entire monitoring area 2, and a plurality of tag readers 8 are arranged as necessary.

  The interrogation wave is a radio wave having a predetermined carrier frequency used in the RFID system, and the size of an area where one tag reader 8 can detect the wireless tag 14 varies depending on the carrier frequency. In this system, wireless communication between the tag reader 8 and the wireless tag 14 of the article 10 is configured to be performed in a non-contact manner, and the carrier wave frequency is also set to a frequency band adapted to this. Furthermore, from the viewpoint that a relatively large monitoring area 2 is covered with a small number of tag readers 8, it is preferable to use a frequency at which communication is possible even if the distance between the tag reader 8 and the wireless tag 14 is relatively large. , UHF band can be used.

  The tag reader 8 demodulates the response wave and acquires the tag ID of the wireless tag 14 that has transmitted it. The tag reader 8 and the monitoring device 6 are communicably connected via home wiring, wired / wireless LAN, etc., and the tag reader 8 notifies the monitoring device 6 of the detected tag ID of the wireless tag 14. In this system, since it is assumed that there are a plurality of articles 10 within the detection area of one tag reader 8, it is preferable to use the tag reader 8 having an anti-collision function (multiple simultaneous reading function). Thereby, it becomes possible to acquire tag ID from the some radio | wireless tag 14 which exists in a detection area all at once and without leaking.

  Note that the tag reader 8 stores the tag ID detected by itself instead of the configuration in which all the detected tag IDs are transmitted to the monitoring device 6, and is stored when it is newly detected or cannot be detected. When the content changes, only the tag ID related to the change may be transmitted to the monitoring device 6.

  Further, as a countermeasure against the possibility that the detection tag ID may change unnecessarily due to a reading error in the tag reader 8, the detection / non-detection state of any wireless tag 14 is kept constant after a predetermined number of reading attempts. It is possible to adopt a configuration in which the detection state of the wireless tag 14 is determined and the change is determined on the condition that it is drooped.

  FIG. 2 is a block diagram illustrating a schematic configuration of the monitoring device 6. The monitoring device 6 includes a control unit 30, a storage unit 32, and a communication interface 34. Basically, the monitoring device 6 is installed for each monitoring area 2 to be monitored in a unified manner. The communication interface 34 controls communication between the control unit 30, the tag reader 8, the monitoring center 4, and the mobile terminal 12. The storage unit 32 is executed by the control unit 30, for example, in addition to the monitoring target item table for registering the monitoring target item 10 in the monitoring region 2, the detection state of the wireless tag 14 attached to each item 10 by the tag reader 8. Stores processing programs and the like.

  Article information corresponding to each article 10 is stored in the monitored article table. The article information includes a tag ID of the wireless tag 14 attached to the article 10 and information related to the article 10 associated with the tag ID. As one piece of information related to the article 10, the system uses an image of the article 10.

  The control unit 30 operates based on a program stored in the storage unit 32 and controls the operation of each unit of the monitoring device 6 such as the storage unit 32 and the communication interface 34. For example, the control unit 30 performs a registration process for registering article information in the storage unit 32 and a monitoring process for the article 10 described later. In the monitoring process, for example, a process of notifying the monitoring center 4 when the article 10 is lost or the like is also performed.

  The monitoring center 4 holds, for example, a monitoring target article table that is periodically sent from the monitoring device 6 of each user. When the monitoring device 6 reports that the article 10 cannot be detected, the monitoring center 4 is appropriate for the article 10. Take action. For example, when the article 10 is a credit card, it is possible to contact a credit card company based on the article information and request a use suspension measure. It is also possible to take measures such as dispatching security personnel to the location of the monitoring area 2 to confirm the presence or absence of an abnormality and reporting to the police or the like as necessary.

  FIG. 3 is a block diagram illustrating a schematic configuration of the mobile terminal 12. The mobile terminal 12 includes a control unit 40, a tag reader unit 42, an imaging unit 44, an operation unit 46, a display unit 48, and a wireless communication unit 50. At the time of the monitoring operation of the present system, the mobile terminal 12 functions as, for example, a reporting means from the monitoring device 6 to the user or an instruction means from the user to the monitoring device 6. In the present system, a registration process for registering article information in the monitoring device 6 can be performed using the mobile terminal 12.

  The tag reader unit 42 is used for the article information registration process, and transmits a query wave in the same manner as the tag reader 8 and detects the wireless tag 14 by detecting a response wave from the wireless tag 14 corresponding thereto. The tag reader unit 42 has directivity for radio waves to be transmitted and received, and detects the wireless tag 14 in the range 62 corresponding to the directivity. For example, the directivity can be set by configuring the antenna 60 of the tag reader unit 42 with a phased array antenna.

  The imaging unit 44 is also used for the article information registration process, and takes an image of the article 10 as a related image constituting the article information. The imaging unit 44 includes, for example, a camera unit including a solid-state imaging device 64, an optical system 66 such as a lens, and the like, and images a range 68 corresponding to the angle of view of the camera unit.

  Here, the detection range 62 of the wireless tag 14 of the tag reader unit 42 and the imaging range 68 of the imaging unit 44 are basically configured to overlap. As a result, it is possible to capture an image of the article 10 attached with the wireless tag 14 in the image captured by the imaging unit 44 with the tag reader unit 42 detecting the wireless tag 14, and the wireless attached to the article 10. The association between the tag ID of the tag 14 and the image of the article 10 can be automated. Therefore, it is possible to reduce the load on the user regarding the generation of the article information.

  Note that the detection range 62 and the shooting range 68 are defined by the distance that the wireless tag 14 can be detected, that is, the radial distance of the detection range 62 is generally shorter than the distance that can be shot, that is, the radial distance of the shooting range 68. It may not be easy to match. However, in the present system, the article information registration process using the portable terminal 12 is basically performed for the article 10 in the user's hand or in the same room as the user. Therefore, if the coincidence between the photographing range 68 and the detection range 62 is also realized at such a distance, simplification of the article information registration process which is the object of the present invention can be achieved. In addition, since the article information is registered on the article 10 in which the wireless tag 14 has been detected, if the detection direction of the tag reader unit 42 and the imaging direction of the imaging unit 44 substantially match, the imaging range 68 is detected. Expansion beyond the range 62 is not a big problem.

  For example, the portable terminal 12 has the antenna 60 of the tag reader unit 42 and the optical system 66 of the imaging unit 44 arranged close to each other, and the beam spread angle of the radio wave transmitted and received by the tag reader unit 42 and the angle of view of the imaging unit 44 are set. It can comprise so that it may correspond substantially.

  The imaging unit 44 includes a zoom function, and can be configured so that articles 10 of various sizes can be easily accommodated in a captured image. In this case, the tag reader unit 42 can be configured to variably control the beam divergence angle in conjunction with zooming of the imaging unit 44. In this case, the tag reader unit 42 narrows the detection direction as the imaging unit 44 zooms in (telephoto), and widens the detection direction as the zoom out (wide angle).

  The operation unit 46 is an input means for the user to select an operation of the mobile terminal 12 or give an instruction to the control unit 40, and includes, for example, various button switches and a touch panel.

  The display unit 48 is configured by a display device such as a liquid crystal, and is used for displaying a message from the control unit 40 and confirming an image taken by the imaging unit 44.

  The wireless communication unit 50 is a means for performing mobile communication, and is connected to the base station 18 via a wireless line and enables communication with the monitoring device 6 and the monitoring center 4. Moreover, it can also be set as the structure which connects between the portable terminal 12 and the monitoring apparatus 6 by direct wireless communication, and the wireless communication part 50 is comprised so that a wireless LAN communication function may be provided in that case, for example.

  The control unit 40 has a function of controlling the operation of each unit of the mobile terminal 12. For example, the control unit 40 is configured using a microprocessor, and realizes various operations by a program executed by the processor.

  Next, the operation of this system will be described. FIG. 4 is a schematic flowchart illustrating a registration process for generating article information and registering it in the monitoring device 6. The registration process is performed when a new article 10 is to be monitored by this system. The user operates the operation unit 46 of the mobile terminal 12 to start the registration process of the control unit 40 (S70). Thereby, the imaging unit 44 starts moving image shooting, and the display unit 48 displays the moving image. Further, the tag reader unit 42 starts the detection operation of the wireless tag 14.

  The user matches the direction of the mobile terminal 12 with the article 10 to be registered, and determines the article to be registered (S72). Specifically, the user adjusts the orientation of the mobile terminal 12 so that the article 10 to be registered is photographed by the imaging unit 44. The user confirms that the article 10 is within the screen of the display unit 48 and presses a predetermined button switch or the like, for example, to determine the article 10 as a registration target article.

  When confirmed, the control unit 40 instructs the imaging unit 44 to perform a still image shooting operation S74 at that time, and whether or not the wireless tag 14 is detected by the detection process S76 of the tag reader unit 42 performed simultaneously. Is determined (S78). Here, when the wireless tag 14 is not detected, this is notified to the user by a method such as displaying it on the display unit 48 (S80), for example, returning to the confirmation waiting state for the article to be registered (S72). As a case where the wireless tag 14 is not detected, for example, a case where the wireless tag 14 is not actually attached to the article 10 or a case where the article 10 is photographed from outside the detection range 62 of the tag reader unit 42 can be considered. . In the notification process S80, for example, a message that calls attention to these points may be displayed.

  Since the detection range 62 of the tag reader unit 42 is set according to the shooting range 68 of the imaging unit 44 as described above, the wireless tag 14 detected in a state where the registration target article is reflected on the operation unit 46 is It can be expected that the wireless tag 14 is attached to the article to be registered. However, for example, when there is another registered or unregistered article 10 with the wireless tag 14 attached within the detection range 62, or the article 10 selected as a registration target is a registered article due to a user error or the like. In this embodiment, the confirmation process is performed without generating and registering article information unconditionally with respect to the detected wireless tag 14.

  First, when it is determined that the wireless tag 14 is detected in the determination process S78, the control unit 40 uses the detected tag ID of the wireless tag 14 in which the article information is registered in the monitoring target article table of the monitoring device 6. The tag ID is checked (S82).

  The collation process is performed by the control unit 40 of the portable terminal 12 by transferring a list related to the tag IDs already registered in the monitored article table from the monitoring device 6 to the portable terminal 12 in advance at the start of the registration process. Conversely, the tag ID detected by the mobile terminal 12 is transmitted to the monitoring device 6, collation is performed by the monitoring device 6, and the result is returned to the mobile terminal 12. it can.

  As a result of the collation, when all of the detected one or a plurality of wireless tags 14 are already registered (S84), this is notified to the user by a method such as displaying on the display unit 48 (S86). For example, the process returns to the confirmation waiting state for the registration target article (S72).

  On the other hand, when there is an unregistered wireless tag 14 detected (S84), the control unit 40 determines whether there is only one detected wireless tag 14 (S88). ). If the number of detected wireless tags 14 is one, only one unregistered wireless tag 14 is detected. In this case, the still image captured in step S74 includes an article to be registered. It can be expected that this image is reflected in a manner that is unlikely to be confused with other articles to which the wireless tag 14 is attached.

  The control unit 40 inspects the sharpness of the captured image (S90). If the sharpness is equal to or greater than a predetermined threshold (S92), the control unit 40 associates the image with the tag ID of the detected unregistered wireless tag 14. The article information is generated and transmitted to the monitoring device 6 (S94). The monitoring device 6 registers the product information received from the mobile terminal 12 in the monitored product table of the storage unit 32 (S96).

  In the determination process S88, when it is determined that there are a plurality of detected wireless tags 14, the control unit 40 notifies the user to that effect by a method such as displaying on the display unit 48 (S98). An instruction is given to proceed or cancel the registration process (S100). For example, the user can cancel the multiple detection state by changing the position of the article 10 or changing the shooting direction. In such a case, the user selects cancel and confirms the registration target article. It is possible to start again from the process S72.

  As described above, the tag ID of the wireless tag 14 attached to the article 10 and the image of the article 10 are displayed by the tag reader unit 42 and the imaging unit 44 looking at substantially the same range in accordance with the confirmation operation of the registration target article by the user. Since acquisition is basically performed at the same time, it is possible to reliably associate the image of the article 10 with the tag ID.

  On the other hand, the wireless tag 14 of the registered article 10 is detected, for example, such that a registered article 10 that is not a registration target exists behind the registration target article. First, the image may be registered as a related image of the registration target article. In addition, for example, when registering a plurality of articles of the same type, there may be a user's desire to register an image in which they are collectively displayed as a related image. Since the related image to be registered as the article information is intended to assist the user's understanding in view of the fact that the article 10 is difficult to understand simply by the tag ID, if the user consents It is not necessary to exclude registration of images that are displayed at the same time. Therefore, when the user instructs registration (S100), the detected unregistered wireless tag 14 is 1 for the still image captured in the process S74 in a state where a plurality of detected wireless tags 14 exist. The processes S90 to S96 described above for the two cases are performed to generate article information, and the article information is registered in the monitoring device 6. When a plurality of unregistered wireless tags 14 are detected, article information is registered for each unregistered wireless tag 14.

  In the image sharpness determination process S92, if the sharpness calculated by the control unit 40 is less than the threshold value, the control unit 40 notifies the user by displaying the fact on the display unit 48 or the like. The user is notified (S102), and asks the user whether to register the current captured image as it is as the related image of the article information, or to cancel the registration process and start again from the process S72 (S104). The user can make a determination based on the photographed image displayed on the display unit 48. For example, when the user considers that the article to be registered can be understood from the current photographed image, he / she can register it as it is. You can choose. In this case, the article information is registered in the monitoring device 6 through the above-described processes S94 and S96.

  The determination of the image sharpness in the control unit 40 can be performed based on, for example, the amount of high-frequency components of the image signal output from the solid-state imaging device 64, and other aspects such as edge, contrast, focus, etc. The known determination method can be used.

  The registration process described above can be configured to be repeated until an end instruction is issued.

  FIG. 5 is a schematic flowchart for explaining the article monitoring process by the present system. The control unit 30 of the monitoring device 6 that has started the monitoring process basically receives the tag ID detected by the tag reader 8 sent from each tag reader 8, and the item information is registered in the monitored item table. The process of collating with the tag ID of the wireless tag 14 is continued (S120, S122).

  On the other hand, even if the control unit 30 performs collation with the detection results of all the tag readers 8 connected to the monitoring device 6, the tag ID registered in the monitoring target article table remains unverifiable, That is, when there is an undetectable tag among the wireless tags 14 of the monitored article 10 in the monitoring area 2 (S122), first, the mobile terminal 12 held by the user is notified. This notification is performed by transmitting a related image registered in the item information of the undetectable tag together with a message that there is an item to be monitored that is not found in the monitoring region 2 (S124). Thereby, the user can see the image of the undetectable article 10 on the display unit 48 of the mobile terminal 12, easily understands what the undetectable article is, and promptly determine whether or not a countermeasure is necessary. can do.

  The monitoring device 6 returns to the processing S120 for collating the detection result of the tag reader 8 without notifying the monitoring center 4 if there is an instruction from the user that no action is required within a predetermined time (S126). Note that the control unit 30 can set, for example, a flag on the article information corresponding to the undetectable article, and can perform processing that is not treated as undetectable in the subsequent verification processing. By the way, as a case where the user can instruct no action, a case where the undetectable article is an object carried by the user outside the monitoring area 2 can be considered.

  On the other hand, if there is a response request instruction within a predetermined time from the user (S128), the monitoring device 6 immediately notifies the monitoring center 4 (S130). As a result, it is possible to take a prompt action when the detection failure is a theft or the like, and to reduce damage.

  When the mobile terminal 12 cannot receive the notification from the monitoring device 6 or when the user does not carry the mobile terminal 12, no instruction indicating that no action is required or requested may be issued. Conceivable. Therefore, when a predetermined time has elapsed from the notification (S132), the control unit 30 notifies the monitoring center 4 for safety even if there is no user instruction (S130).

  As described above, the monitoring center 4 receives the notification and takes appropriate measures according to the undetectable article. When the monitoring device 6 makes a report to the monitoring center 4, the monitoring device 6 returns to the processing S 120 for collating the detection result of the tag reader 8.

  Note that it is possible to set for each article 10 registered in the monitoring target article table, for example, when the notification to the monitoring center 4 is performed. For example, when there is a user instruction, a notification is made when a predetermined time has passed since the notification, and depending on the article 10, if detection is impossible, a notification is made immediately without requesting the user's instruction. On the contrary, it is possible to set so that notification to the monitoring center 4 is not performed even if a predetermined time elapses while only the notification to the user is performed. Moreover, it can also be configured such that the user makes a response request to the monitoring center 4 from the mobile terminal 12.

1 is a schematic diagram illustrating a schematic configuration of an article monitoring system according to an embodiment of the present invention. It is a block diagram which shows the structure of the outline of a monitoring apparatus. It is a block diagram which shows the schematic structure of a portable terminal. It is a general | schematic flowchart explaining the registration process which produces | generates article information using a portable terminal, and registers with a monitoring apparatus. It is a schematic flowchart explaining the monitoring process of the goods by the goods monitoring system which is embodiment of this invention.

Explanation of symbols

  2 monitoring area, 4 monitoring center, 6 monitoring device, 8 tag reader, 10 article, 12 mobile terminal, 14 wireless tag, 16 network, 18 base station, 30, 40 control unit, 32 storage unit, 34 communication interface, 42 tag reader unit , 44 imaging unit, 46 operation unit, 48 display unit, 50 wireless communication unit, 60 antenna, 62 detection range, 64 solid-state imaging device, 66 optical system, 68 imaging range.

Claims (6)

In the article monitoring system for monitoring the presence of the article based on the detection result of the wireless tag attached to the article,
A storage unit that stores article information in which identification information of the wireless tag is associated with a related image related to the article to which the wireless tag is attached;
An article information generation unit that generates the article information stored in the storage unit;
Have
The article information generation unit
An imaging unit that captures an image of an area in which the article exists;
A tag detection unit having a detection range corresponding to the imaging range of the imaging unit, and detecting the wireless tag present in the detection range;
A coupling unit that associates a captured image obtained by the imaging unit when the wireless tag is detected by the tag detection unit with the identification information of the wireless tag as the related image;
An article monitoring system characterized by comprising: The article monitoring system according to claim 1,
The said tag detection part is equipped with the directivity according to the angle of view of the said imaging part, and is provided with the antenna which transmits / receives the said radio | wireless tag, The article monitoring system characterized by the above-mentioned. In the article monitoring system according to claim 1 or 2,
The article monitoring system, wherein the combining unit determines the sharpness of the captured image, and generates the article information when the sharpness is equal to or greater than a predetermined reference value. In the article surveillance system according to any one of claims 1 to 3,
The said joint part produces | generates the said article information corresponding to the said wireless tag, when the said tag detection part detects only one said wireless tag, The article monitoring system characterized by the above-mentioned. In the article surveillance system according to any one of claims 1 to 4,
The combining unit, when the article information corresponding to the wireless tag detected by the tag detection unit is already stored in the storage unit, to exclude the wireless tag from the generation target of the article information; A characteristic article monitoring system. In the article surveillance system according to any one of claims 1 to 5,
A monitoring device having the storage unit;
A portable terminal that has the article information generation unit and is communicable with the monitoring device, and registers the generated article information in the storage unit of the monitoring device;
An article monitoring system characterized by comprising:

Images