JPWO2018198385A1 - Digital register security system, method and program - Google Patents

Abstract

Provided is a digital register security system, method and program capable of preventing shoplifting even if a tag is removed from goods or when the tag is invalidated. The digital register security system (1000) includes a tag movement determination unit (111) that detects that a product with a tag is taken from a display shelf, and a monitoring camera (11) that captures the face of a customer who has taken out the product. , The storage unit (130) for temporarily storing the photographed face image, the control unit (110) for determining that the product has been cleared, and the face of the customer leaving the store, And a suspicious person determination unit (115) for registering an image of the face of the customer as the face of the suspicious person when the customer leaves the store even though it has not been cleared.

Description

  The present invention relates to a digital register security system, method, and program for capturing an inside of a store with a surveillance camera to perform crime prevention.

  According to Patent Document 1, it is determined whether or not there is a mismatch based on a product present in the store and a product whose sales have been confirmed by the POS server, and when it is determined that the product is inconsistent, It is described that “face information of a store-off person photographed by the store-off camera before the current activation is recorded in the face information recording unit to identify a suspicious person”.

  In Patent Document 2, "when the adjusted imaging data from the adjusting imaging device and the moving imaging data from the commodity shelf imaging device match, the adjusted imaging data and the moving imaging data matched from the recording device are erased". It is stated that.

  According to Patent Document 3, “the image is taken prior to the timing in the monitoring camera using face information acquired by the face detection means from an image taken by the camera near the timing when the gate detects the tag. Search for an image including a face that is determined to be identical to the face represented by the face information.

  According to Patent Document 4, "The product is started by an external command after closing the store, and a shoplifter visual comparison screen is automatically generated. A video taken during business hours is read out from the customer review site video file unit 510. Originally, the customer's video from which the product price was paid out and the video from the shoplifter were included, but at this point the video related to the product from the cashier's account is deleted and only the video corresponding to the shoplifting video is displayed. " It is done.

JP, 2013-134644, A JP, 2012-242912, A JP, 2011-233133, A JP 2008-257487 A

  In such a conventional crime prevention system, a product in a store such as a convenience store is tagged to prevent shoplifting. However, removing the tag from the product or wrapping the tag in an electromagnetic shield sheet can not prevent shoplifting.

  An object of the present invention is to provide a digital register security system, method and program capable of preventing a shoplifting even if the tag is removed from the product or the tag is invalidated.

  In the digital register security system according to the present invention, when the commodity detection unit detects that the commodity has been taken from the display shelf, the commodity detection unit detects that the commodity with the tag is taken from the display shelf. A face photographing means for photographing the face of a customer who has taken out the product; a storage means for temporarily storing an image of the face photographed by the face photographing means; The result of checking the determination means, the image of the customer's face leaving the store and the image stored in the storage means matches, and it is not determined that the goods taken out by the customer have been cleared by the checkout means In the case, a suspicious person registration unit for registering an image of the face of the customer as the face of the suspicious person is provided.

Further, the commodity detection means detects once that the commodity taken from the display shelf has been restored again,
The face stored in the storage means by including control means for deleting the image of the face of the customer stored in the storage means when the goods detection means detects that the goods are returned to the display shelf The number of images can be reduced to reduce the number of images to match at the exit of the store.

  In addition, the control means is provided with a control means for deleting the image of the face of the customer stored in the storage means when the settlement means determines that all the goods taken from the display shelf by the customer have been cleared. Then, the number of face images to be stored in the storage means can be reduced to reduce the number of images to be collated at the outlet of the store.

  Further, the suspicious person registration means does not determine that the item has been cleared by the settlement determination means even if a predetermined time has elapsed since the item detection means detected that the item has been taken from the display shelf In this case, by registering the image of the face of the customer stored in the storage means as the face of the suspicious person, the image of the face of the suspicious person is registered even if the matching / authentication at the exit of the store fails. can do.

Customer movement detection means for detecting a customer moving with the tagged product;
And a tag abnormality determining unit that determines that the item to which the tag is attached stops moving for a predetermined period of time outside a predetermined place and that the tag can not be detected.
The suspicious person registration means registers the image of the face of the customer photographed by the monitoring camera as the face of the suspicious person when the tag abnormality judgment means judges that the tag is stopped moving or can not be detected. Even if the tag is removed from the product or the tag is invalidated, the image of the customer's face can be registered as that of the suspicious person.
Also, tags can be attached to any item. For this reason, it is possible to monitor a number of products at once, and to construct a security system that can be easily adopted even in a store with a large number of sales types and sales numbers.

  In the digital register security method of the present invention, it is detected that an article detection step of detecting that an article to which a tag is attached has been taken from a display shelf, and the commodity detection step is that an article is taken from a display shelf In this case, a face photographing step for photographing the face of the customer who has taken out the product, a storage step for temporarily storing an image of the face photographed in the face photographing step, and determination that the goods have been cleared It is determined that the result of matching the checkout determination step with the image of the customer's face leaving the store and the image stored in the storage step matches, and that the goods taken out by the customer are cleared by the checkout determination step. If not, it is characterized by comprising a suspicious person registration step of registering an image of the face of the customer as the face of the suspicious person.

  Further, according to the present invention, there is provided a product detection means for detecting that a product with a tag has been taken from a display shelf, and the product detection means detects that a product has been taken from the display shelf. A face photographing unit for photographing a face of a customer who has taken out the product; a storage unit for temporarily storing an image of the face photographed by the face photographing unit; and a clearing determination to determine that the product has been cleared When the result of collating the means, the image of the customer's face leaving the store, and the image stored in the storage means matches, and it is not determined that the goods taken out by the customer have been cleared by the settlement judgment means A program for functioning as a digital register security system, comprising: suspicious person registration means for registering an image of the face of the customer as a face of a suspicious person.

  According to the present invention, it is possible to provide a digital register security system, method and program capable of preventing shoplifting even if the tag is removed from the product or the tag is invalidated.

FIG. 1 is a block diagram showing a configuration of a digital register security system according to a first embodiment of the present invention. FIG. 6 is a block diagram of a control unit of the monitoring device of the digital register security system according to the first embodiment of the present invention. It is a flowchart which shows the registration process of the face of the suspicious person of the control part of the monitoring apparatus of the digital register security system which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the crime prevention control processing of the control part of the monitoring instrument of the digital register security system concerning a 1st embodiment of the present invention. It is a figure explaining the example of application of the digital register security system concerning a 1st embodiment of the present invention. It is a flowchart which shows the registration process of the face of the suspicious person of the control part of the monitoring apparatus of the digital register security system which concerns on the 2nd Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.
First Embodiment
FIG. 1 is a block diagram showing the configuration of a digital register security system according to a first embodiment of the present invention.

  This system includes department stores, supermarkets, convenience stores, shopping malls, airports, planes, trains, ships, restaurants, underground malls, specialty stores, precious metal stores, luxury boutiques, complex facilities, offices, theaters, meeting halls, It can be applied to schools, hospitals, factories, financial institutions, government offices, hotels, museums, museums, stadiums, event venues, new product announcement venues, and high-rise buildings.

  As shown in FIG. 1, the digital register security system 1000 includes a plurality of monitoring cameras 11 installed on a ceiling of a product sales floor and an RFID (Radio Frequency IDentification) reader 20 installed on a product shelf of the product sales floor. An authentication tag 21 carried by a clerk (employee) and authenticated by the RFID reader 20, a Wi-Fi (Wireless Fidelity) terminal (hereinafter referred to as Wi-Fi master) 30 installed in a business facility, an i-beacon ( iBeacon) (registered trademark) master unit 40, a portable terminal unit 50 carried by a store clerk (employee), a monitoring unit 100 for controlling the entire system, a point of sale (POS) server 200, a POS unit A cash register 300 and an EOS (Electronic Ordering System: Electronic Ordering System) 400 are provided.

  The digital register security system 1000 monitors a video from the monitoring camera 11 (face photographing means) installed on the product sales floor, and notifies a mobile terminal device 50 carried by a clerk (employee) of information of a suspicious person , A clerk (employee) is a system that prevents shoplifting by a suspicious person.

<Monitoring camera 11>
A part or all of the surveillance camera 11 is a PTZ camera (also an authentication camera for photographing and authenticating the face of a person) having a PTZ (pan, tilt, zoom) function, and is remotely controlled by the surveillance device 100 Ru. The monitoring camera 11 is installed at various places on a commodity sales floor such as in a store, and captures the face of a person. An image captured by the monitoring camera 11 is output to the monitoring device 100. The monitoring camera 11 may capture a still image at regular time intervals (for example, several seconds), even if a moving image is captured at all times.

  A plurality of surveillance cameras 11 are installed in a store or the like, and it is possible to capture a predetermined surveillance area. In addition, there is also one that causes a surveillance camera 11 to track a specific person. Even in the case of a surveillance camera that does not track a specific person, it is possible to capture a person or the like from multiple angles by installing a plurality of surveillance cameras 11.

<RFID Reader 20>
RFID readers 20 are installed at predetermined intervals on the display shelf of the store. The RFID reader 20 detects that the RF tagged product has left the display shelf based on whether or not there is a response to the transmission to the RF tag attached to the product.

  Also, the RFID reader 20 installed in the POS cash register 300 manages settlement of the RF tagged product by detecting whether there is a response to transmission to the RF tag attached to the product. Do. The RFID reader 20 is an RFID tag compatible handy terminal or reader / writer. The communicable distance with the RFID tag is, for example, 3 to 7 m. Moreover, the specification which makes communication possible distance about 400 m is also possible by using the active tag which incorporates a battery. The tag may also be an optically readable optical tag. In particular, optical tags that read in invisible light are suitable.

  The RFID reader 20 can also be installed in a shopping basket. In this case, the I / F unit 180 is connected wirelessly. The RFID reader 20 installed in the shopping cart is detected by the monitoring device 100 and tracked.

  The RF tag is removed or invalidated from the articles which are ready to be taken out of the store, for example, by purchasing.

  Further, in the present embodiment, the RFID reader 20 authenticates the authentication tag 21 possessed by the store clerk (employee). The RFID reader 20 captures the position of the clerk (employee) who carries the authentication tag 21 by authenticating the authentication tag 21 possessed by the clerk (employee).

<Wi-Fi main phone 30>
The Wi-Fi master device 30 exchanges information with the Wi-Fi slave device 51 of the mobile terminal device 50 using Wi-Fi. Also, the Wi-Fi master device 30 can obtain position information acquisition by Wi-Fi positioning, that is, position information acquisition using a Wi-Fi access point and a predetermined position information service.

<I beacon master 40>
iBeacon (iBeacon) is a wireless technology using Bluetooth Low Energy. The i-beacon is a combination of the i-beacon master 40, which is a beacon device on the sending side, and an application of the portable terminal 50 corresponding to radio wave reception from the i-beacon master 40 (corresponding to i beacon slave 52 described later) Configured The i-beacon transmits unique ID information necessary for identification, and reacts only to the application linked to the ID information of the portable terminal device 50. The application of the mobile terminal device 50 registers the same identifier as the i beacon master device 40 in advance. The application of the mobile terminal device 50 (i beacon slave unit 52) stands by in the background by executing the application equipped with the i beacon function, and excites a predetermined action when it approaches the beacon of the i beacon master unit 40. By using the i beacon, the position information and the “direction” of the mobile terminal device 50 can be measured more accurately than Wi-Fi or GPS.

<POS Server 200>
The POS server 200 performs accumulation, analysis, and the like of information on top selling products according to sales information at the point of sale of the POS system.

  The POS server 200 records and holds information at the time of accounting (at the point of sale) of a product registered by the POS cash register 300 as POS data. The POS server 200 has a function (sales management function) that records and manages information (sales information) of product sales results (sales management function), records and manages information (inventory information), etc., although it varies depending on corresponding POS systems and models. Function (inventory management function), and a function (attribute management function) of inputting and recording attribute information (such as gender and age group) of the purchaser by a store clerk.

  The POS server 200 may be an information processing system including a store computer, a network communication device, etc., and is connected and cooperated with an external inventory management system or an electronic money system (for example, a system using an IC card). It may be a system. For example, the point-of-sale information may be recorded as POS data according to the accounting operation and processing by the IC card.

<POS cash register 300>
The POS cash register 300 is a cash register device having a function corresponding to the POS server 200. The POS register 300 is provided with a handy scanner and an input device (not shown), and the handy scanner reads a commodity code attached to an item, that is, a bar code, and transmits it to the POS register 300. Also, key input data is input from this input device. The key input data is data by key button input. A plurality of key input data are similarly input according to sales of a plurality of products.

<EOS400>
EOS inputs the department, type, name, and quantity of goods, sends order data to manufacturers and wholesalers via EDI (Eietric Date Interchhange: electronic data exchange), and places an order. In addition, EDI is a mechanism to unify information on commerce in a standard format and exchange it electronically between companies, and electronically transmit and receive data on ordering, etc. according to a predetermined format through a communication line etc. Do.

  In addition, although the monitoring apparatus 100 is installed in the shop, you may install outside via the network which is not shown in figure. When the monitoring apparatus 100 is installed on a server on a network, a plurality of stores can be targeted for security.

[Mobile terminal device 50]
The portable terminal device 50 is carried by a plurality of clerks (employees) at the store. The portable terminal device 50 is, for example, a smartphone 50a, a tablet 50b, or a laptop computer 50c. The portable terminal device 50 may also be a mobile phone, a PHS (Personal Handy-Phone System), or a PDA (Personal Handy).
Digital Assistants) or dedicated terminals. In the present embodiment, portable terminal device 50 can be used by each clerk (employee) at various places (ie, current positions), and includes e-mails or moving pictures from monitoring device 100 via a telephone line (not shown). It is possible to receive video and the like.

  In the present embodiment, the mobile terminal device 50 assumes the use of the smartphone 50a and the tablet 50b, and each individual can be used at various places (that is, current positions). One of the portable terminal devices 50 is disposed at a head office or a head office (not shown).

  The portable terminal device 50 is a GPS (Global Positioning System) that captures the positions of a Wi-Fi individual identifier (hereinafter referred to as Wi-Fi slave) 51, an i-beacon slave 52, and a clerk (employee) on the product sales floor. And 53).

<Wi-Fi handset 51>
The Wi-Fi handset 51 receives and individually identifies the radio waves of the Wi-Fi master device 30 installed in the business facility. The monitoring apparatus 100 stores the layout information of the Wi-Fi master set 30 installed in the facility as safety related information. When the Wi-Fi slave device 51 approaches the Wi-Fi master device 30, it is possible to determine the ID and the position of the person carrying the portable terminal device 50.

<I beacon handset 52>
The i-beacon child device 52 is an application of the portable terminal device 50 corresponding to the radio wave reception from the i-beacon master device 40. The i beacon master unit 40 transmits a beacon (specific ID information necessary for identification), and the application of the mobile terminal device 50 (i beacon slave unit 52) is predetermined when the i beacon master unit 40 approaches the beacon. Excite the action. As described above, by using the i beacon, the “position”, “direction”, etc. of the mobile terminal device 50 can be transmitted to the monitoring device 100 more accurately than Wi-Fi or GPS.

<GPS53>
The GPS 53 receives radio waves of position information from GPS satellites and the like. The GPS 53 calculates current position information as three parameters of latitude, longitude and altitude from the information received via the GPS antenna, and acquires the position information. The acquired position information is sent to the monitoring device 100 at appropriate times.

  In the present embodiment, an example using GPS satellites has been shown as means for acquiring position information, but a method may be used that uses a positional relationship with a base station other than GPS. For example, when using an Android (registered trademark) smart phone or a high-function mobile phone with a camera as the mobile terminal device 50 which is a mobile terminal, a base station and a mobile phone communication network (not shown) It is also possible to transmit / receive information to / from the mobile phone company server via the &, and obtain the current position information of the own terminal from the approach confirmation.

  Also, position information acquisition by Wi-Fi positioning, that is, position information acquisition using a Wi-Fi access point and a predetermined position information service may be used.

[Monitoring device 100]
The monitoring apparatus 100 is installed, for example, in a management room of a store, and centrally manages a commodity sales floor in the store. The monitoring apparatus 100 may be a general server computer or a personal computer.

  The monitoring apparatus 100 includes a control unit 110 (control unit), an input unit 120, a storage unit 130 (storage unit), a display unit 140, an output unit 150, a face information database (DB) 153, and an image processing unit. 170, an interface (I / F) unit 180, and a communication unit 190, which are connected by a bus 195.

  The monitoring apparatus 100 monitors that a suspicious person performing shoplifting behavior appears at a store.

  When it is detected that a suspicious person has appeared in a store, the monitoring device 100 notifies the head office, the head office or the security company system of the information on the person and the information on the store through the network.

  Hereinafter, in the case where the subject is described as "○○ part is", the control unit 110 reads out each program from the ROM as needed, loads it into the RAM, and executes each function (described later). Each program may be stored in advance in the storage unit 130, or may be taken into the monitoring apparatus 100 as needed via another storage medium or communication medium.

  The control unit 110 is configured by a CPU (Central Processing Unit) or the like, controls the entire monitoring apparatus 100, and executes a control program to function as a digital register security system. The detailed configuration of the control unit 110 will be described later.

  The input unit 120 is an input device such as a keyboard, a mouse, a touch panel provided on the screen of the display unit 140, a microphone, and the like for the user of the monitoring apparatus 100 to input an instruction or the like.

  The storage unit 130 stores a still image or a moving image received from the monitoring camera 11, various data and programs used by the control unit 110, and the like.

  The display unit 140 displays an operation state of the monitoring apparatus 100, an image received from the monitoring camera 11, or a graphical user interface (GUI) for operating the monitoring apparatus 100.

  The output unit 150 is, for example, an audio interface, and outputs an audio signal from the monitoring device 100 to the sound system 158 in the store. As an audio signal output from the monitoring apparatus 100 to the audio system 158, for example, an audio signal input from an audio input device such as a microphone provided in the input unit 120 or music data stored in the storage unit 130 110 may be an audio signal reproduced. The sound system 158 includes an amplifier and a plurality of speakers disposed in the store, and broadcasts an audio signal input from the monitoring device 100 into the store.

  The face information DB 160 stores face images (face information) of a suspicious person, a person concerned with a store, and the like. Basic data such as the face of a person registered in the face information DB 160 is obtained from a head office, a head office, a security company, or the like (not shown) via the I / F unit 180, and the face information DB 160 is constructed. Further, the face information DB can be updated to the latest face image (face information) by exchanging information with a head office, a head office or a security company not shown.

  The image processing unit 170 performs predetermined processing on the received image. The predetermined processing includes contour extraction, image resizing, resolution conversion processing, and the like.

  The I / F unit 180 connects each monitoring camera 11 disposed in the commodity sales floor with the monitoring apparatus 100. In addition, the I / F unit 180 connects each RFID reader 20 disposed in the product sales floor, and monitors the result of the authentication of the authentication tag 21 possessed by the store clerk (employee) in proximity to the RFID reader 20. Send to 100 Further, the I / F unit 180 connects to a head office, a head office, a security company, etc. (not shown) via a network or a dedicated line. The security company is not an essential component of the digital register security system according to the present embodiment.

  The communication unit 190 transmits and receives data to and from the mobile terminal device 50 via the base station. In the present embodiment, communication unit 190 receives position information of each portable terminal device 50 at regular intervals through the base station, and also transmits information about the suspicious person (e-mail transmission, video including moving image) when the suspicious person is recognized. Etc.).

[Control unit 110]
FIG. 2 is a block diagram of the control unit 110 of the monitoring apparatus 100 of the digital register security system according to the first embodiment of the present invention.

  As shown in FIG. 2, the control unit 110 includes a tag movement determination unit 111 (trademark detection unit, customer movement detection unit), a customer position information acquisition unit 112 (customer movement detection unit), and a monitoring target setting unit 113 (customer Movement detection means), monitored object tracking unit 114 (guest movement detection means), suspicious person judgment unit 115 (tag abnormality judgment means, suspicious person registration means), face authentication function unit 116 (face authentication means), position A determination unit 117 (control unit), a suspicious person tracking unit 118 (control unit), and a transmission control unit 119 (control unit) are provided.

The control unit 110 captures the face of the customer when the product to which the tag is attached by the monitoring camera 11 is taken from the display shelf. The control unit 110 temporarily stores in the storage unit 130 (see FIG. 1) an image of the face of the customer captured when the product is taken from the display shelf. The control unit 110 determines whether or not the image of the customer's face leaving the store matches the image of the customer's face stored in the storage unit 130.
The control unit 110 has a function as a settlement determination unit that determines that the product has been settled.
When the product to which the RF tag is attached moves away from the display shelf and the control unit 110 starts moving, the monitoring camera 11 moves the image of the customer's face moving with the product and the image of the customer's scene (still image or moving image) Are temporarily stored in the storage unit 130.

The tag movement determination unit 111 detects whether the product to which the tag (RF tag) is attached has been taken from the display shelf. The tag movement determination unit 111 tracks the tag and detects that a product has been taken from the display shelf. Alternatively, the tag movement determination unit 111 detects that the product has been taken from the display shelf based on the state of the product on the display shelf captured by a plurality of wide-angle lens cameras that capture the entire store. In addition, the tag movement determination unit 111 detects that the product once taken from the display shelf is returned to the original state again.
The tag movement determination unit 111 determines whether the tag (RF tag) attached to the product has moved away from the display shelf and started moving. RFID readers 20 are installed on the display rack at predetermined intervals. The RFID reader 20 detects that the RF tagged product (hereinafter referred to as a product as appropriate) has left the display shelf based on whether or not there is a response to the transmission to the RF tag attached to the product. The RFID reader 20 transmits detection information to the control unit 110 of the monitoring apparatus 100 after a predetermined time (for example, 10 seconds) has elapsed, when it is detected that the product has left the display shelf.

  When the tag movement determination unit 111 detects that the product has left the display shelf, the tag movement determination unit 111 determines whether the product has started moving. The start of the movement of the item is detected by another adjacent RFID reader 20 when the item is removed from the display shelf.

  The customer position information acquisition unit 112 acquires the position information of the customer moving with the product. The customer position information acquisition unit 112, for example, photographs around the display shelf with the monitoring camera 11, and acquires the position information of the customer by superimposing the customer photographed by the monitoring camera 11 with the layout information of the store.

  The monitoring target setting unit 113 sets the monitoring target P by combining the product to which the RF tag is attached and the position information of the customer. When the customer picks up a plurality of products in hand, the monitoring target P is a combination of the customer's position information and the plurality of RF tags. Further, the clerk (employee) is excluded from the customers and does not form the monitoring target P.

  The monitoring target tracking unit 114 tracks the monitoring target P set by the monitoring target setting unit 113.

  As described above, the tag movement determination unit 111, the customer position information acquisition unit 112, the monitoring target setting unit 113, and the monitoring target tracking unit 114 have taken the goods to which the tag is attached from the display shelf as a whole and moved with the customer. The customer movement detection means to detect is comprised. The display rack may be any display case, such as a display case or a product storage box, as long as the product can be displayed or stored.

The suspicious person determination unit 115 determines whether or not a predetermined time (for example, 10 minutes to 6 hours, depending on the category of the store) has passed since the product was taken from the display shelf.
The suspicious person determination unit 115 authenticates the face of the customer leaving the store, and when the customer leaves the store although the product has not been cleared, the image of the face of the customer taken by the face photographing means Register as a suspicious person's face.
The suspicious person determination unit 115 determines whether the monitoring target P has stopped at a place other than the POS register 300 for a predetermined time or more, and whether a tag forming the monitoring target P has become undetectable. When the monitored object P stops for a predetermined time or more at a place other than the POS cash register 300, or when a tag forming the monitored object P becomes undetectable, the suspicious person determination unit 115 detects the image of the customer's face as a suspicious person Register as

  Further, in the present embodiment, even if the monitoring target P is a location of the POS register 300, the suspicious person determination unit 115 does not perform the determination on the monitoring exclusion spot.

  The face authentication function unit 116 performs face authentication that collates the face image of a person photographed by the monitoring camera 11 with the face image of a suspicious person registered in the face information DB 160. The face authentication function unit 116 performs face authentication to determine whether the face of the person included in the image received from the monitoring camera 11 is the face of the suspicious person registered in the face information DB 160. The face authentication can be performed based on the degree of similarity between the face information extracted from the received image and the face information of the suspicious person registered in the face information DB 160.

  The position determination unit 117 determines the position of the mobile terminal device 50 closest to the suspicious person. The position determination unit 117 acquires the position information of the plurality of mobile terminal devices 50 in the commodity sales floor by the GPS position information or the RFID reader 20. Specifically, the position determination unit 117 authenticates the position information of the store clerk (employee) on the product sales floor by the authentication of the authentication tag carried by the store clerk (employee) by the plurality of RFID readers 20 installed on the product sales floor. get. In this case, the position determination unit 117 determines the position of the suspicious person against the installation position of the monitoring camera 11. That is, when the store clerk (employee) approaches each RFID reader 20, the position determination unit 117 corresponds to the store clerk (employee) by the authentication of each RFID reader 20 of the authentication tag 21 possessed by the store clerk (employee). It is determined that the RFID reader 20 is in proximity to the RFID reader 20. Since the installation position of the RFID reader 20 is registered in advance, the position of the store clerk (employee) can be determined.

  Further, the position determination unit 117 acquires position information from the GPS function unit included in the mobile terminal device 50.

  The suspicious person tracking unit 118 tracks the movement of the commodity sales floor of the suspicious person. The suspicious person tracking unit 118 tracks and detects a person who has been identified as a suspicious person by using a plurality of monitoring cameras 11, and confirms the movement history within the commodity sales floor. The suspicious person tracking unit 118 tracks the movement of the commodity sales floor of the suspicious person, and when the suspicious person is separated from the closest position of the portable terminal device 50 by a predetermined distance, the suspicious person with respect to the other portable terminal device 50 Send information about suspicious persons including face images of

  The transmission control unit 119 transmits information (image or moving image of a scene of a suspicious person) about the suspicious person to a clerk (employee) close to the position of the suspicious person. For example, the transmission control unit 119 transmits voice, a moving image, and position information of a suspicious person (for example, information marked with a mark on the sales floor layout) by mail. The transmission control unit 119 determines the position of the mobile terminal device 50 closest to the suspicious person, and transmits information on the suspicious person to the mobile terminal device 50. If there is no answer back signal even after a predetermined time (for example, 5 seconds) elapses from the transmitted store clerk (employee), the transmission control unit 119 selects a second clerk (employee) person and performs re-transmission. . The second clerk (employee) official is a clerk who is the second closest to the suspicious person.

The operation of the digital register security system configured as described above will be described below.
[registration process]
First, the registration processing of the face of a suspicious person in the digital register security system will be described.

  FIG. 3 is a flowchart showing the face registration processing of the suspicious person of the control unit 110 of the monitoring device 100 of the digital register security system. This flow is executed by the control unit 110 (see FIG. 2) of the monitoring device 100.

  In step S1, the tag movement determination unit 111 (product detection means) of the control unit 110 detects whether or not the product to which the tag (RF tag) is attached has been taken from the display shelf. RFID readers 20 are installed on the display rack at predetermined intervals. The RFID reader 20 detects that the RF tagged product (hereinafter referred to as a product as appropriate) has left the display shelf depending on whether or not there is a response to the transmission to the RF tag attached to the product. The tag movement determination unit 111 tracks the tag and detects that a product has been taken from the display shelf. Alternatively, the tag movement determination unit 111 detects that the product has been taken from the display shelf based on the state of the product on the display shelf captured by a plurality of wide-angle lens cameras that capture the entire store.

When the tag is not separated from the display rack (step S1: No), the processing of this flow is ended.
When the item to which the tag is attached is taken from the display shelf (step S1: Yes), the control unit 110 checks the customer when the item to which the tag is attached by the monitoring camera 11 is taken from the display shelf in step S2. Shoot your face. The monitoring camera 11 is, for example, a PTZ camera, and is remotely controlled by the monitoring device 100. Moreover, the monitoring camera 11 is a camera for authentication which image | photographs a person's face. An image captured by the monitoring camera 11 is output to the monitoring device 100.
In step S3, the control unit 110 temporarily stores in the storage unit 130 (see FIG. 1) an image of the customer's face captured when the product is taken from the display shelf. When the tag movement determination unit 111 detects that the product taken from the display shelf has been returned once, the control unit 110 uses the image of the face of the customer stored in the storage unit 130. delete.

In step S4, the control unit 110 determines whether all items have been cleared at the POS register 300.
If all the products have not been cleared at the POS cash register 300 (step S4: No), it is determined that there is a possibility that shopping is continued, and the process proceeds to step S6.
If all items have been cleared at the POS cash register 300 (step S4: Yes), the suspicious person determination unit 115 of the control unit 110 determines the image of the customer's face stored in the storage unit 130 at step S5. delete. That is, the image of the customer's face stored in the storage unit 130 is deleted from the storage unit 130 when all the goods taken by the customer have been cleared. This makes it possible to reduce the number of customer face images to be checked at the outlet of the store.

In step S6, the suspicious person determination unit 115 of the control unit 110 determines whether or not a predetermined time (for example, 10 minutes to 6 hours, depending on the category of the store) has passed since the product was taken from the display shelf.
If the predetermined time has not passed since the product was taken from the display shelf (step S6: No), the process proceeds to step S7, and if the predetermined time has passed since the product was taken from the display shelf (step S6: Yes), the step Go to S8.

In step S7, the control unit 110 collates the image of the customer's face leaving the store at the outlet (or entrance) of the store with the image of the customer's face stored in the storage unit 130 and matches them. Determine if
If the image of the customer's face leaving the store does not match the image of the customer's face stored in the storage unit 130 (step S7: No), the process returns to step S4. If the image of the customer's face leaving the store matches the image of the customer's face stored in the storage unit 130 (step S7: Yes), the process proceeds to step S8.

In step S8, when a predetermined time has elapsed since the product was taken from the display shelf in step S6, or the face of the customer whose image of the customer's face leaving the store in step S7 is stored in storage unit 130 If the image matches the image, the suspicious person determination unit 115 reads the image of the customer's face stored in the storage unit 130, registers it as the face of the suspicious person, and ends this flow. In the case where a predetermined time has passed since the product was taken from the display shelf, it is a case that a customer who takes the product from the display shelf is suspected to be a suspicious person who performs shoplifting, product replacement, damage, and the like. Also, in this case, all items are out of the store even though they have not been cleared at the POS cash register 300. The suspicious person determination unit 115 reads the image of the customer's face stored in the storage unit 130, registers it as the suspicious person's face, and ends the present flow.
As described above, when a predetermined time has elapsed since the product was taken from the display shelf, the face of the suspicious person is registered even if the matching / authentication at the outlet of the store fails by registering the image of the face of the customer. The image of can be registered.
If the image of the customer's face leaving the store in step S8 does not match the image of the customer's face stored in the storage unit 130 (for example, if the customer who was masking removed the mask), By returning to step S4, the processing after the settlement determination of the POS cash register 300 is repeated.
By this flow, the face image of the suspicious person is registered in the face information DB 160.

[Security control of monitoring device 100]
FIG. 4 is a flowchart showing the crime prevention process of the control unit 110 of the monitoring device 100 of the digital register security system. This flow is mainly executed by the control unit 110 (see FIG. 4) of the monitoring device 100.

  First, in step S21, the control unit 110 captures an image of the monitoring camera 11. The surveillance camera 11 can capture an entire store with a plurality of wide-angle lens cameras.

  In step S22, the face authentication function unit 116 of the control unit 110 performs face authentication for matching the face image of the person photographed by the monitoring camera 11 with the face image of the suspicious person registered in the face information DB 160.

  In step S23, it is determined whether or not the face image of the person photographed by the monitoring camera 11 matches the face image of the suspicious person registered in the face information DB 160 by the face authentication. When the customer visits the shop again, the face image of the person photographed by the monitoring camera 11 matches the face image of the suspicious person registered in the face information DB 160. In addition to the case where the visitor visits the store again, for example, if the face image of the suspicious person is registered on a certain floor (registration by the registration process of the suspicious person's face in FIG. 3), the face according to this flow on the other floor. Authentication becomes possible, and face authentication becomes possible even when a customer leaves the store. Thereby, in the case of an unmanned store, the gate of the exit can be closed when a suspicious person tries to leave the store. If the face image of the person photographed by the monitoring camera 11 does not match the face image of the suspicious person registered in the face information DB 160 (step S23: No), the processing of this flow is ended.

  As described above, when the customer visits the shop again, the face image of the person photographed by the monitoring camera 11 matches the face image of the suspicious person registered in the face information DB 160 (step S23: Yes), the position determination unit 117 of the control unit 110 determines the position of the portable terminal device 50 closest to the suspicious person in step S24.

  In step S25, the suspicious person tracking unit 118 of the control unit 110 tracks the movement of the commodity sales floor of the suspicious person.

  In step S26, the transmission control unit 119 of the control unit 110 transmits the information (image or moving image of the scene of the suspicious person) about the suspicious person to the clerk (employee) close to the position of the suspicious person, and the present flow ends. Do. For example, the transmission control unit 119 transmits voice, a moving image, and position information of a suspicious person (for example, information marked with a mark on the sales floor layout) by mail.

  Here, it may not be appropriate for the store clerk (employee) to take the above-mentioned correspondence at the sales floor. It is up to the decision of the store clerk (employee) to decide what kind of response the store clerk (employee) would do for the suspicious person, but it is significant to provide information as a decision material.

  If the face authentication is performed when the customer (suspicious person) leaves the store, information on the suspicious person is transmitted to the clerk (employee) when the customer leaves the shop.

  If the suspicious individual is a addict at a shoplift, information on the addict may be transmitted to the mobile terminal device 50 of the head office, the head office or a security company, in addition to the response to a clerk (employee).

[Example of application]
FIG. 5 is a view for explaining an application example of the digital register security system, and shows a customer and a sales floor layout (merchandise sales floor). FIG. 5 shows a sales floor of a store such as a convenience store.

  In FIG. 5, the RFID reader 20 of FIG. 1 is the electronic tag reader of FIG. 5, and the electronic tag is an RF tag. The Wi-Fi handset 51 of FIG. 1 is connected to the Wi-Fi master device 30 via the Wi-Fi repeater 51A installed for each fixed distance unit or each sales section in FIG. The customer in the store detects location information and an image of the customer's face by electronic tag, i-beacon, Wi-Fi, smart phone, surveillance camera 11, and electronic tag gate terminal.

  When a customer takes an electronic tag product (a product with a tag) in hand and moves with the product, the behavior of the customer is detected by a movement signal of the electronic tag product possessed by the customer. In the example of FIG. 5, the smartphone owned by the customer (the application of the portable terminal device 50) receives the radio wave transmitted by the i-beacon master 40 installed in the upper part of the display case, and responds by an ID. The master acquires location information of the smartphone. A Wi-Fi handset 51 of a smartphone (portable terminal device 50) possessed by a customer visits the Wi-Fi master device 30 of the monitoring device 100 via the Wi-Fi repeater 51A installed in the store. Enter and detect the location and location of the sales corner and display case where the customer is located. The surveillance camera 11 is installed in each area such as the sales department, the sales corner, the aisle, and the cash register, and detects the radio wave transmitted by the electronic tag reader 20, and the installation position (or shooting position) of the surveillance camera 11. Identify the location of the customer in combination with the information. In addition, the radio tag reader 20 detects radio waves transmitted and specifies the year, month, day, hour, and minute of the location. Further, images taken by the monitoring camera 11 installed in the corresponding area can be extracted in time series to detect that the customer is in the sales corner or in the passage in front of the display case.

  If the customer enters the shopping basket and moves the electronic tag product, the electronic tag of the product responds to the radio wave transmitted by the electronic tag reader 20, and the electronic tag reader 20 can receive the responded radio wave. .

  By the way, in the case of high-priced products sold at stores, the electronic tag gate 12 is installed in front of the entrance, and in the case of unpaid bills, an alert is issued and a store clerk rushes. In addition, product single item management, ordering, sales, etc. can be handled daily by product management using the handy scanner 250, the POS register 300, and the EOS 400. As measures against shoplifting and product loss in such sales activities of the store, the surveillance camera 11 and the electronic tag gate 12 are installed, and a guard man or the like is introduced to cope with the situation.

  However, it is the fact that suspicious persons such as shoplifting have not been registered only by surveillance by surveillance camera 11 etc., and even if visitors who are not registered perform shoplifting, they are often not found. In addition, it is very difficult to register as a shoplifter as a shopkeeper, and it is very difficult to register false positives.

  Furthermore, when the electronic tag is removed from the product or the electronic tag is wrapped in an electromagnetic shield sheet, shoplifting can not be prevented.

  For example, when the customer A in FIG. 5 takes out the product from the display case (display shelf), places it in his or her clothes or bag and moves out of the store, in the conventional example, unless cleared by the POS cash register 300. An alarm is generated at the electronic tag gate 12. However, if a suspicious person such as shoplifting removes the electronic tag from the product, or performs an action such as wrapping the electronic tag in an electromagnetic shield sheet, even though the POS register 300 is unpaid, the electronic The tag gate 12 can not detect it and can not prevent shoplifting. Since shoplifting can not be prevented, a suspicious person will repeat shoplifting activities. In particular, the problem is that although the suspicious person is trying to take out the product from the display case (display shelf) and carry it away for shoplifting purposes, the RFID tag 20 is invalidated because the electronic tag has been invalidated. The reason is that detection by the electronic tag gate 12 can not be performed. Therefore, a suspicious person will not be identified no matter how long.

  On the other hand, according to the present embodiment, the digital register security system 1000 (see FIG. 1) detects the removal of the tagged product from the display shelf, and the product movement determination unit 111; The monitoring camera 11 for capturing the face of the customer who took out the image, the storage unit 130 for temporarily storing the captured image of the face, the control unit 110 for determining that the product has been cleared, and A suspicious person determination unit 115 which registers an image of the face of the customer as the face of the suspicious person when the customer leaves the store even though the product has not been cleared by checking the face. In addition, a face authentication function unit 116 for performing face authentication that collates the face image of a person photographed by the monitoring camera 11 with the face image of a suspicious person registered in the face information DB 160; Transmission control unit 119 for transmitting information on the suspicious person to the staff member).

According to this configuration, it is possible to register the image of the customer's face when the tagged product is taken from the display shelf as the suspicious person's. In particular, since the customer's face is photographed when the product is taken from the display shelf, the customer may leave the store unpaid, carry the product for a long time, etc. regardless of the customer's subsequent actions. The face image of can be registered as that of a suspicious person. There is an effect that the opportunity to register a suspicious person is not missed.
When the customer (suspicious person) visits the store again or goes out of the store, or moves from a product area registered for an image to another product area, a clerk (employee) close to the position of the suspicious person Send information about the suspicious person, such as the face image of the suspicious person. A nearby clerk (employee) can rush to the scene in real time.

  In particular, since the image of the face of the suspicious person is registered at the time when the shoplifting action is being formed, the face recognition can be performed after the registration so that the suspicious person can be determined immediately. It is possible to prevent future shoplifting by the suspicious person who has been difficult in the prior art.

In the present embodiment, by deleting the image of the face of the customer when all the items taken by the customer have been cleared, the number of images to be collated at the outlet of the store can be reduced.
In the present embodiment, when the goods are not cleared even after a predetermined time (10 minutes to 6 hours depending on the category of the store) has been taken from the display shelf, the image of the face of the customer is registered. Thus, even if the verification / authentication at the exit fails, the image of the face of the suspicious individual can be registered.

In the present embodiment, the face image to be collated (stored) with the face image of the customer photographed at the exit of the store is only the face image of the customer who takes the product from the display shelf and is not clearing at the cash register . That is, only the number of customers moving from the display shelf to the cash register is considered to be a small number. In this case, most of the face images of the customers who have taken the goods from the display shelf are erased by clearing.
In addition, since the customer generally walks toward the exit at the exit of the store, it is considered easy to capture a face image of the customer from the front. It is particularly favorable if the outlet of the store is an escalator. In addition, even if the customer wears a mask, if the mask is kept while in the store, it can be processed as a face image with the mask.

Second Embodiment
The hardware configuration of the digital register security system according to the second embodiment of the present invention is the same as that shown in FIGS.
The registration process of the face of the suspicious person of the digital register security system will be described.

  FIG. 6 is a flowchart showing the process of registering the face of a suspicious person of the control unit 110 of the monitoring device 100 of the digital register security system according to the second embodiment of the present invention. This flow is executed by the control unit 110 (see FIG. 2) of the monitoring device 100.

  In step S101, the tag movement determination unit 111 of the control unit 110 determines whether the tag (RF tag) attached to the product has moved away from the display shelf and started moving. RFID readers 20 are installed on the display rack at predetermined intervals. The RFID reader 20 detects that the RF tagged product (hereinafter referred to as a product as appropriate) has left the display shelf based on whether or not there is a response to the transmission to the RF tag attached to the product. The RFID reader 20 transmits detection information to the control unit 110 of the monitoring apparatus 100 after a predetermined time (for example, 10 seconds) has elapsed, when it is detected that the product has left the display shelf. When the tag movement determination unit 111 of the control unit 110 detects that the product has left the display shelf, the tag movement determination unit 111 determines whether the product has started moving. The start of the movement of the item is detected by another adjacent RFID reader 20 when the item is removed from the display shelf.

  When the tag is separated from the display shelf but has not started to move (Step S101: No), it is determined that the customer is picking up and looking at the product, and the processing of this flow ends.

  If the product to which the RF tag is attached has moved away from the display shelf (Step S101: Yes), the customer position information acquisition unit 112 of the control unit 110 at Step S102 acquires the position information of the customer moving along with the product. get. The customer position information acquisition unit 112, for example, photographs around the display shelf with the monitoring camera 11, and acquires the position information of the customer by superimposing the customer photographed by the monitoring camera 11 with the layout information of the store. If the customer is a suspicious person, it may be considered a rare case (the shoplifter usually does not notify his location information). However, when a suspicious person posing as a customer does not know the existence of the present digital register security system, it is possible to carry the Wi-Fi handset 51 or the i beacon handset 52. As described above, when the position information from the Wi-Fi handset 51 owned by the customer or the i-beacon handset 52 can be acquired, the location information of the customer may be acquired from the information.

  Also, when the product to which the RF tag is attached has moved away from the display shelf and started moving, in step S103, the control unit 110 displays an image of the face of the customer moving with the product by the monitoring camera 11 and an image of the scene of the customer (Still image or moving image) is temporarily stored in the storage unit 130 (see FIG. 1). The monitoring camera 11 is, for example, a PTZ camera, and is remotely controlled by the monitoring device 100. Moreover, the monitoring camera 11 is a camera for authentication which image | photographs a person's face. An image captured by the monitoring camera 11 is output to the monitoring device 100.

  In step S104, the monitoring target setting unit 113 of the control unit 110 sets the monitoring target P by combining the product to which the RF tag is attached and the position information of the customer. Customers may pick up multiple items in their hands. In this case, the monitoring target P is a combination of the customer's position information and a plurality of RF tags. Further, the clerk (employee) is excluded from the customers and does not form the monitoring target P.

  In step S105, the monitoring target tracking unit 114 of the control unit 110 tracks the monitoring target P set by the monitoring target setting unit 113.

  In step S106, the monitoring target tracking unit 114 determines whether the monitoring target P has moved to the POS register 300, and the monitoring target P has moved to the POS register 300 (step S106: Yes) (the arrow in FIG. 1). a) See, the customer is not a suspicious person, and ends the processing of this flow.

  If the monitoring target P has not moved to the POS register 300 (step S106: No) (see the arrow b in FIG. 1), the process proceeds to step S107. When the customer (the monitoring target P) with the tag attached to the product does not move to the POS cash register 300 for a long time, it is determined that it is a caution or an abnormal state.

  In step S107, the suspicious person determination unit 115 of the control unit 110 determines whether or not the monitoring target P has stopped at a place other than the POS register 300 for a predetermined time (for example, 10 minutes or one hour). If the monitoring target P has not stopped at a place other than the POS register 300 for a predetermined time or more (step S107: No), the process returns to step S5 and the tracking of the monitoring target P is continued.

  If the monitoring target P has stopped at a place other than the cash register for a predetermined time or more (step S107: Yes), the suspicious person determination unit 115 in step S108 a fitting room or tasting corner where the eye of a store clerk (employee) reaches It is determined whether it is a monitoring exclusion spot such as. Being a surveillance exclusion spot is not only required that the surveillance target P has moved to the surveillance exclusion spot, but also has a salesperson (employee) in the surveillance exclusion spot.

  If the monitoring target P is in the monitoring exclusion spot (step S108: Yes), the process returns to step S108.

  When the monitoring target P is not in the monitoring exclusion spot (step S108: No), the process proceeds to step S109.

  In step S9, the suspicious person determination unit 115 determines whether the tag constituting the monitoring target P has become undetectable. When a suspicious person removes the tag from the product or covers the tag with an electromagnetic shield sheet, it becomes impossible to detect a radio wave responding to the tag that has been detected until now. When the response of the tag which has been detected up to now stops even though it is not the location of the POS cash register 300, it is judged as a caution or an abnormal state.

  If the RF tag that forms the monitoring target P is not undetectable (step S109: No), the process returns to step S5, and tracking of the monitoring target P is continued.

  When the RF tag forming the monitoring target P can not be detected (step S109: Yes), the process proceeds to step S110.

  In step S110, the suspicious person determination unit 115 determines that the customer making up the monitoring target P is suspected to be a suspicious person who performs shoplifting, product replacement, damage, etc., and stores it in the storage unit 130. The image of the customer's face is read, registered as the face of the suspicious person, and the flow ends.

Here, when the RF tag is removed, it is determined that the RF tag has stopped moving for a predetermined time or more, and even if an attempt is made to register an image of the face, the customer has already left the place when it is determined. There is. Therefore, when the product to which the RF tag is attached in step S3 is moved away from the display shelf and starts moving, or when the moving is stopped for the predetermined time or more, the image of the face of the customer is stored. If it is determined in step S110 that the user is a suspicious person, the stored image of the customer's face is registered as the image of the suspicious person's face.
By this flow, the face image of the suspicious person is registered in the face information DB 160.

  The crime prevention control of the monitoring apparatus 100 is the same as the crime prevention process flow of FIG. 4, and when the customer visits the shop again, the information on the suspicious person is transmitted to the clerk (employee).

  Thus, according to the present embodiment, when the digital register security system 1000 (see FIG. 1) detects that the product has left the display shelf, it determines whether or not the product has started moving. A monitoring target for which a monitoring target P is set by combining a tag movement determination unit 111, a customer position information acquisition unit 112 for acquiring position information of a customer moving with a product, and a product with an RF tag and the customer position information. The setting unit 113, the monitoring target tracking unit 114 that tracks the monitoring target P set by the monitoring target setting unit 113, and when the monitoring target P stops for a predetermined time or more at a location other than the POS register 300, or the monitoring target P And a suspicious person determination unit 115 for registering an image of the face of the customer as that of the suspicious person when the tag forming the B. becomes undetectable. In addition, a face authentication function unit 116 for performing face authentication that collates the face image of a person photographed by the monitoring camera 11 with the face image of a suspicious person registered in the face information DB 160; Transmission control unit 119 for transmitting information on the suspicious person to the staff member).

  According to this configuration, it is possible to remove the tag from the product or register the image of the customer's face as that of the suspicious person even when the tag is invalidated. When the customer (suspicious person) visits the store again or goes out of the store, or moves from a product area registered for an image to another product area, a clerk (employee) close to the position of the suspicious person Send information about the suspicious person, such as the face image of the suspicious person. A nearby clerk (employee) can rush to the scene in real time.

  As in the first embodiment, at the time when the shoplifting activity is being formed, the image of the face of the suspicious person is registered, so that after the registration, the face recognition is carried out and the suspicious person is judged immediately. it can. It is possible to prevent future shoplifting by the suspicious person who has been difficult in the prior art.

  Further, in the present embodiment, the monitoring target P is set by combining the product to which the RF tag is attached and the position information of the customer. Tags can be attached to any item. For this reason, by setting the monitoring target P, it is possible to monitor a number of products at once, and it is possible to construct a security system that can be easily adopted even in a store having many sales types and sales numbers.

  The above description is an illustration of a preferred embodiment of the present invention, and the scope of the present invention is not limited to this. For example, the face authentication technology of the control unit 110 using the surveillance camera 11 may be any. Also, instead of detecting by the RFID reader 20 that a product has left the display shelf, the monitoring camera 11 can be used. That is, it may be detected that the product has left the display shelf by detecting that the product disappears from the display shelf by the monitoring camera 11. The customer tracking also includes electronic tags, i-beacons, Wi-Fi, etc. in addition to image recognition, and may be a combination of these as in the application example (see FIG. 5). When the customer is carrying the portable terminal device, the portable terminal device carried by the customer carries out the Wi-Fi connection by installing the Wi-Fi facility in the store. Can be identified so that the customer can be identified. Similarly, since the mobile terminal device can be identified by the i beacon facility, it is possible to identify a customer carrying the mobile terminal device. Thus, when a customer is identified by the portable terminal device, the position of the portable terminal device can be detected by the response of radio waves from the portable terminal device, so that the customer who is carrying the portable terminal device can The position can be detected. For this purpose, suspicious behavior of the customer (for example, (1). Repeatedly unreciprocated reciprocation in a specific area, (2). Unnaturally long stop before the checkout counter or display case, (3). It is also possible to mark unfairly fast moving in the store, and (4). In addition, when equipment for detecting the position of the customer by such a portable terminal device is provided, not only the suspicious person but also the position of a general customer (carrying the portable terminal device) should be detected. As a result, the distribution and movement of customers in the store can be grasped along with the shoplifting prevention function. This information can be used to locate the store clerk. In addition, when a robbery enters, customers moving up to that point stop moving at the same time, so it is possible to detect this and use it for reporting the robbery. Furthermore, since the surveillance camera 11 is provided, it is possible to capture a suspicious appearance of the customer (for example, wearing a mask, sunglasses, or an eyelid hat, etc.) and mark it as a watched person. Also, since it is detected by the RFID reader 20 that the product to which the RF tag is attached has been released from the display shelf, when it is detected that the product has unnaturally left the display shelf in a large amount, It is also possible to mark a certain customer as a sensitive person. This function can also be realized by the monitoring camera 11. That is, when it is detected that a large amount of goods has been removed from the display shelf by detecting that the goods have disappeared from the display shelf by the monitoring camera 11, the customer present there is marked as a person who needs attention It can also be done.

  Further, although the names “digital register security system and method” are used in the above embodiments, this is for convenience of explanation, and may be a pre-bent system, a sales system, a security method, or the like.

  The digital register security system and method of the present invention are also realized by a program for causing a computer to function as the present digital register security system or method. This program may be stored in a computer readable recording medium.

  The recording medium recording the program may be the ROM itself of the digital register security system, and a program reader such as a CD-ROM drive is provided as an external storage device, and the recording medium is inserted therein. It may be a readable CD-ROM or the like.

  The recording medium may be a magnetic tape, a flexible disk, a hard disk, an MO / MD / DVD, or the like, or a semiconductor memory.

  INDUSTRIAL APPLICABILITY The digital register security system, method and program according to the present invention are applied to a sales management system capable of effectively reducing shoplifting damage in a commercial facility or the like, and the use effect is large. Installation in various stores is expected.

11 Surveillance camera (face shooting means)
12 electronic tag gate 20 RFID reader 30 Wi-Fi master device 40 i beacon master device 50 portable terminal device (terminal device)
51 Wi-Fi handset 51A Wi-Fi repeater 52 i beacon handset 53 GPS
100 monitoring device 110 control unit (settlement determination means)
111 Tag movement judgment unit (product detection means, customer movement detection means)
112 Customer Position Information Acquisition Unit (Customer Movement Detection Means)
113 Monitoring Target Setting Unit (Customer Movement Detection Unit)
114 Tracking object tracking unit (customer movement detection means)
115 Suspicious person judgment part (tag abnormality judgment means, suspicious person registration means)
116 Face recognition function unit (face recognition means)
117 Position determination unit (control means)
118 Suspicious person tracking part (control means)
119 Transmission control unit (control means)
130 Storage unit (storage means)
160 Face Information DB
200 POS Server 250 Handy Scanner 300 POS Cash Register 400 EOS
1000 Digital Register Security System

In the digital register security system according to the present invention, when the commodity detection unit detects that the commodity has been taken from the display shelf, the commodity detection unit detects that the commodity with the tag is taken from the display shelf. A face photographing means for photographing the face of a customer who has taken out the product; a storage means for temporarily storing an image of the face photographed by the face photographing means; The result of checking the determination means, the image of the customer's face leaving the store and the image stored in the storage means matches, and it is not determined that the goods taken out by the customer have been cleared by the checkout means In this case, the image of the face of the customer is registered as the face of the suspicious person, and the item is cleared even if a predetermined time has elapsed since the item detection unit detects that the item has been taken from the display shelf. Judgment If not determined to be liquidated by stage, characterized by comprising a suspicious person registration means for registering an image of the face of the customer stored in the storage unit as the face of a suspicious person.

In the digital register security method of the present invention, it is detected that an article detection step of detecting that an article to which a tag is attached has been taken from a display shelf, and the commodity detection step is that an article is taken from a display shelf In this case, a face photographing step for photographing the face of the customer who has taken out the product, a storage step for temporarily storing an image of the face photographed in the face photographing step, and determination that the goods have been cleared It is determined that the result of matching the checkout determination step with the image of the customer's face leaving the store and the image stored in the storage step matches, and that the goods taken out by the customer are cleared by the checkout determination step. If not, the image of the face of the customer, and registers as the face of a suspicious person, the commodity detecting step away from detecting that a product is taken from the shelf If the time is the product even after not judged to have been liquidated by the clearing determining step, suspicious person registration step of registering an image of the face of the customer stored by said storing step as the face of a suspicious person And.

Further, according to the present invention, there is provided a product detection means for detecting that a product with a tag has been taken from a display shelf, and the product detection means detects that a product has been taken from the display shelf. A face photographing unit for photographing a face of a customer who has taken out the product; a storage unit for temporarily storing an image of the face photographed by the face photographing unit; and a clearing determination to determine that the product has been cleared When the result of collating the means, the image of the customer's face leaving the store, and the image stored in the storage means matches, and it is not determined that the goods taken out by the customer have been cleared by the settlement judgment means The image of the face of the customer is registered as the face of the suspicious person, and the item is determined to be cleared even if a predetermined time has elapsed since the item detection unit detects that the item has been taken from the display shelf Liquidated by means If not it is determined that a program for functioning as a digital register security system and a suspicious person registration means for registering an image of the face of the customer stored in the storage unit as the face of a suspicious person.

According to the present invention, it is possible to prevent shoplifting even if the tag is removed from the product or the tag is invalidated, and the image of the face of the suspicious person even if the matching / authentication at the exit of the store fails. A digital register security system, method and program can be provided that can register

In addition, the settlement determination means comprises control means for deleting the image of the face of the customer stored in the storage means when it is determined that all the goods taken from the display shelf by the customer have been cleared. Thus, the number of face images to be stored in the storage means can be reduced, and the number of images to be collated at the outlet of the store can be reduced.

Claims (7)

Product detection means for detecting that a product with a tag has been taken from the display shelf;
A face photographing means for photographing a face of a customer who has taken out the item when the item detection means detects that the item has been taken from the display shelf;
Storage means for temporarily storing an image of a face taken by the face taking means;
Settlement determination means for determining that the product has been settled;
If the result of checking the image of the customer's face leaving the store and the image stored in the storage means matches, and it is not determined that the goods taken out by the customer have been cleared by the settlement judgment means, the customer What is claimed is: 1. A digital register security system comprising: suspicious person registration means for registering an image of the face of the person as the face of a suspicious person. The commodity detection means detects once that the commodity taken from the display shelf has been restored again,
The apparatus according to claim 1, further comprising: control means for deleting the image of the face of the customer stored in the storage means when the goods detection means detects that the goods have been returned to the display shelf. Digital register security system.   The liquid crystal display device further comprises control means for deleting the image of the face of the customer stored in the storage means when the liquidation means determines that all the goods taken from the display shelf by the customer have been cleared. A digital register security system according to claim 1, wherein.   The suspicious person registration means does not determine that the goods have been cleared by the settlement judgment means even if a predetermined time has elapsed since the goods detection means detected that the goods were taken from the display shelf. The digital register security system according to claim 1, wherein the image of the face of the customer stored in the storage means is registered as the face of a suspicious person. Customer movement detecting means for detecting a customer moving with the tagged product;
And a tag abnormality determining unit that determines that the item to which the tag is attached stops moving for a predetermined period of time outside a predetermined place and that the tag can not be detected.
The suspicious person registration means registers the face image of the customer photographed by the monitoring camera as the face of the suspicious person when the tag abnormality judgment means judges that the tag is stopped moving or can not be detected. The digital register security system of claim 1 characterized in that: An article detection step of detecting that the article to which the tag is attached is taken from the display shelf;
A face photographing step of photographing a face of a customer who has taken out the goods when the goods detection step detects that the goods are taken from the display shelf;
A storage step of temporarily storing an image of a face captured by the face capturing step;
A settlement determination step of determining that the product has been settled;
If the result of checking the image of the customer's face leaving the store and the image stored in the storage step matches, and it is not determined that the goods taken out by the customer have been cleared in the settlement determination step, the customer And a suspicious person registration step of registering an image of the face of the person as the face of the suspicious person. Computer,
Item detection means for detecting that the item to which the tag is attached has been taken from the display shelf, and a face of a customer who takes out the item when the item detection means detects that the item is taken from the display shelf Face photographing means for taking pictures, storage means for temporarily storing an image of the face taken by the face taking means, settlement judgment means for judging that the goods have been If the result of checking the image of the image and the image stored in the storage means matches, and it is not determined that the goods taken out by the customer have been cleared by the settlement judging means, the image of the face of the customer is A program for functioning as a digital register security system comprising: suspicious person registration means for registering as a suspicious person's face.

Images