WO2018198385A1

WO2018198385A1 - Digital register security system, method, and program

Info

Publication number: WO2018198385A1
Application number: PCT/JP2017/019801
Authority: WO
Inventors: 和夫三輪
Original assignee: 株式会社テクノミライ
Priority date: 2017-04-28
Filing date: 2017-05-26
Publication date: 2018-11-01
Also published as: JP6195331B1; WO2018198376A1; JPWO2018198376A1

Abstract

Provided are a digital register security system, method, and program that can prevent shoplifting even when a tag has been disabled or removed from a product. A digital register security system (1000) that comprises: a tag movement determination unit (111) that detects when a product to which a tag has been affixed has been taken from a display; a surveillance camera (11) that captures an image of the face of a guest who took the product; a storage unit (130) that temporarily saves the captured image of the face; a control unit (110) that determines whether the product has been settled for; and a suspicious person determination unit (115) that checks the faces of guests leaving a store and, if the abovementioned guest leaves the store without the product having been settled for, registers the image of the face of the guest as the face of a suspicious person.

Description

Digital register security system, method and program

The present invention relates to a digital register security system, a method, and a program for performing crime prevention by photographing the inside of a store with a surveillance camera.

Patent Document 1 states that “the presence or absence of a mismatch is determined based on a product existing in a store and a product confirmed to be sold by the POS server, and when it is determined that there is a mismatch, The face information of the store clerk photographed by the store closing camera before the start-up of this time is recorded in the face information recording unit, and the suspicious person is specified.

Japanese Patent Application Laid-Open No. 2004-228867 describes that “when the adjusted imaging data from the adjustment imaging device and the moving imaging data from the commodity shelf imaging device match, the adjusted imaging data and the moving imaging data that are matched from the recording device are deleted.” It is described.

Patent Document 3 states that “the face information acquired by the face detection unit from the image captured by the camera in the vicinity of the timing at which the gate detects the tag is captured before the timing by the monitoring camera. In other words, an image including a face that is determined to be the same as the face represented by the face information is searched.

Patent Document 4 states that “It is activated by an artificial external command after closing a store, and a shoplifter's visual verification screen is automatically generated. The video taken during business hours is read from the customer review site video file unit 510. Originally, the customer video that settled the price of the product and the video of the shoplifter are included, but the video related to the product that was cashed out at this point is deleted and only the video equivalent to the shoplifting site video is displayed. Has been.

JP 2013-134644 A JP 2012-242912 A JP 2011-233133 A JP 2008-257487 A

In such a conventional security system, shoplifting is prevented by attaching a tag to a product in a store such as a convenience store. However, shoplifting cannot be prevented if the tag is removed from the product or the tag is wrapped in an electromagnetic shield sheet.

An object of the present invention is to provide a digital register security system, method, and program capable of preventing shoplifting even when a tag is removed from a product or the tag is invalidated.

The digital register security system according to the present invention has a product detection means for detecting that a product with a tag is taken from a display shelf, and when the product detection means detects that a product is taken from a display shelf. A face photographing means for photographing the face of the customer who has taken out the product, a storage means for temporarily storing a face image photographed by the face photographing means, and a liquidation for determining that the commodity has been liquidated. The result of collation between the judging means and the image of the face of the customer leaving the store and the image stored in the storage means match, and it is not judged that the product taken out by the customer has been settled by the clearing judging means And a suspicious person registration means for registering an image of the customer's face as the suspicious person's face.

In addition, the product detection means detects that the product once taken from the display shelf has been restored again,
When the product detection means detects that the product has been returned to the display shelf, the product detection means includes a control means for deleting an image of the customer's face stored in the storage means. The number of images can be reduced, and the number of images collated at the store exit can be reduced.

In addition, when the clearing means determines that all products taken by the customer from the display shelf have been cleared, the clearing means includes control means for deleting the image of the customer's face stored in the storage means. Thus, the number of facial images stored in the storage means can be reduced, and the number of images to be collated at the store exit can be reduced.

In addition, the suspicious person registering means does not determine that the product has been liquidated by the liquidation determining means even if a predetermined time has elapsed since the merchandise detecting means detected that the merchandise was taken from the display shelf. In this case, by registering the face image of the customer stored in the storage means as the face of the suspicious person, even if the verification / authentication at the store exit fails, the face image of the suspicious person is registered. can do.

In addition, a customer movement detection means for detecting a customer who moves with the tagged product,
Tag abnormality determination means for determining that the product with the tag attached is stopped for a predetermined time at a place other than a predetermined location and that the tag becomes undetectable,
The suspicious person registering means registers the face image of the customer photographed by the surveillance camera as the suspicious person's face when the tag abnormality determining means determines that the tag has stopped moving or cannot be detected. Even if the tag is removed from the product or the tag is invalidated, the image of the customer's face can be registered as that of the suspicious person.
The tag can be attached to any product. For this reason, a number of products can be monitored at once, and a security system that can be easily adopted can be constructed even in stores where the number of products sold and the number of products sold are large.

Further, the digital register security method of the present invention detects a product detection step of detecting that a tagged product is taken from the display shelf, and the product detection step detects that the product is taken from the display shelf. In this case, a face photographing step for photographing the face of the customer who has taken out the product, a storage step for temporarily storing an image of the face photographed by the face photographing step, and determining that the product has been settled The result of collation between the liquidation determination step and the face image of the customer leaving the store and the image stored in the storage step match, and it is determined that the product taken out by the customer has been liquidated in the liquidation determination step. If not, a suspicious person registration step of registering an image of the customer's face as a suspicious person's face is provided.

Further, the present invention provides a product detection means for detecting that a product with a tag is taken from the display shelf, and the product detection means detects that the product is taken from the display shelf. A face photographing means for photographing the face of the customer who has taken out the product, a storage means for temporarily storing a face image photographed by the face photographing means, and a liquidation determination for judging that the commodity has been liquidated When the result of collating the image of the face of the customer leaving the store with the image stored in the storage means is the same, and the product taken out by the customer is not determined to have been liquidated by the liquidation determining means A program for causing a customer to function as a digital register security system including suspicious person registration means for registering an image of the customer's face as a suspicious person's face.

According to the present invention, it is possible to provide a digital register security system, method and program capable of preventing shoplifting even when the tag is removed from the product or the tag is invalidated.

It is a block diagram which shows the structure of the digital register security system which concerns on the 1st Embodiment of this invention. It is a block diagram of the control part of the monitoring apparatus of the digital register security system which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the registration process of the suspicious person's face of the control part of the monitoring apparatus of the digital register security system which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the crime prevention control process of the control part of the monitoring apparatus of the digital register security system which concerns on the 1st Embodiment of this invention. It is a figure explaining the example of application of the digital register security system concerning a 1st embodiment of the present invention. It is a flowchart which shows the registration process of a suspicious person's face of the control part of the monitoring apparatus of the digital register security system which concerns on the 2nd Embodiment of this invention.

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings.
(First embodiment)
FIG. 1 is a block diagram showing a configuration of a digital register security system according to the first embodiment of the present invention.

This system can be used in department stores, supermarkets, convenience stores, shopping malls, airports, airplanes, stations, trains, ships, restaurants, underground malls, specialty stores, precious metal stores, luxury boutiques, complex facilities, offices, theaters, gathering venues, It can be applied to schools, hospitals, factories, financial institutions, government offices, hotels, museums, art galleries, stadiums, event venues, new product announcement venues, and skyscrapers.

As shown in FIG. 1, the digital register security system 1000 includes a plurality of surveillance cameras 11 installed on the ceiling of a product sales floor and an RFID (Radio Frequency Identification) 20 installed on a product shelf on the product sales floor. An authentication tag 21 carried by a store clerk (employee) and authenticated by the RFID reader 20, a Wi-Fi (Wireless Fidelity) terminal (hereinafter referred to as Wi-Fi master) 30 installed in a business facility, an i-beacon ( iBeacon) (registered trademark) base unit 40, a portable terminal device 50 carried by a store clerk (employee), a monitoring device 100 for controlling the entire system, a POS (Point Of Sale) server 200, and a POS A cash register 300 and an EOS (Electronic Ordering System) 400 are provided.

The digital register security system 1000 monitors the video from the monitoring camera 11 (face photographing means) installed on the product sales floor, and notifies the portable terminal device 50 carried by the store clerk (employee) of the suspicious person's information. This system prevents shoplifters (employees) from shoplifting by suspicious individuals.

<Monitoring camera 11>
A part or all of the monitoring camera 11 is a PTZ camera (also an authentication camera for photographing and authenticating a person's face) having a PTZ (pan / tilt / zoom) function, and is remotely operated by the monitoring device 100. The Surveillance cameras 11 are installed at various places on the product sales floor such as in a store and take pictures of a person's face. An image captured by the monitoring camera 11 is output to the monitoring device 100. The surveillance camera 11 may shoot a moving image at all times, or may shoot a still image every certain time (for example, several seconds).

A plurality of surveillance cameras 11 are installed in a store or the like, and a predetermined surveillance area can be photographed. In addition, there is one that causes a specific person to be tracked by the monitoring camera 11. Even if the surveillance camera does not track a specific person, a plurality of surveillance cameras 11 are installed, so that a person or the like can be photographed from various angles.

<RFID reader 20>
RFID readers 20 are installed at predetermined intervals on the display shelf of the store. The RFID reader 20 detects that the product attached with the RF tag has left the display shelf depending on whether or not there is a response to transmission to the RF tag attached to the product.

In addition, the RFID reader 20 installed in the POS cash register 300 detects whether there is a response to the transmission to the RF tag attached to the product, thereby managing the settlement of the product with the RF tag attached. To do. The RFID reader 20 is an RFID tag compatible handy terminal or reader / writer. The communicable distance with the RFID tag is, for example, 3 to 7 m. Moreover, the specification which makes a communicable distance about 400 m is also possible by using the active tag which incorporates a battery. The tag may be an optically readable optical tag. In particular, an optical tag that reads with invisible light is suitable.

The RFID reader 20 can also be installed in a shopping cart. In this case, the I / F unit 180 is connected wirelessly. The position of the RFID reader 20 installed in the shopping cart is detected and tracked by the monitoring device 100.

The RF tag is removed or invalidated from an article that can be properly taken out of the store by purchasing it.

In this embodiment, the RFID reader 20 authenticates the authentication tag 21 possessed by the store clerk (employee). The RFID reader 20 captures the position of the store clerk (employee) carrying the authentication tag 21 by authenticating the authentication tag 21 possessed by the store clerk (employee).

<Wi-Fi master unit 30>
The Wi-Fi master device 30 exchanges information with the Wi-Fi slave device 51 of the mobile terminal device 50 using Wi-Fi. In addition, the Wi-Fi master device 30 can acquire position information acquisition by Wi-Fi positioning, that is, position information acquisition using a Wi-Fi access point and a predetermined position information service.

<I-beacon base unit 40>
iBeacon is a wireless technology that uses Bluetooth Low Energy. An i-beacon is a combination of an i-beacon parent device 40 that is a beacon device on the transmission side and an application (corresponding to an i-beacon child device 52 described later) of the mobile terminal device 50 that supports radio wave reception from the i-beacon parent device 40. Composed. The i-beacon transmits unique ID information necessary for identification, and reacts only to an application associated with the ID information of the mobile terminal device 50. The application of the portable terminal device 50 registers the same identifier as that of the i-beacon parent device 40. The application (i-beacon handset 52) of the mobile terminal device 50 stands by in the background by executing an application equipped with the i-beacon function, and excites a predetermined action when approaching the beacon of the i-beacon base unit 40. By using the i-beacon, it is possible to accurately measure position information such as “position” and “direction” of the mobile terminal device 50 from Wi-Fi or GPS.

<POS server 200>
The POS server 200 collects and analyzes information on the best-selling products based on sales information at the time of sale of the POS system.

The POS server 200 records and holds information such as the accounting time (sales time) of the product registered by the POS cash register 300 as POS data. The POS server 200 varies depending on the corresponding POS system and model, etc., but records and manages functions (sales management function) of product sales performance information (sales information), records and manages merchandise inventory information (stock information), etc. Function (inventory management function), and the function (attribute management function) of inputting and recording the purchaser's attribute information (gender, age group, etc.) by the store clerk.

The POS server 200 may be an information processing system including a store computer, a network communication device, and the like, or is connected and linked to an external inventory management system or an electronic money system (for example, a system using an IC card). It may be a system. For example, point-of-sale information may be recorded as POS data in accordance with accounting operations and processing using an IC card.

<POS cash register 300>
The POS cash register 300 is a cash register device having a function corresponding to the POS server 200. The POS register 300 includes a handy scanner and an input device (not shown). The handy scanner reads a product code attached to a product, that is, a bar code, and transmits it to the POS register 300. Also, key input data is input from this input device. The key input data is data by key button input. Similarly, a plurality of key input data are input according to the sales of a plurality of products.

<EOS400>
The EOS inputs the product category, type, product name, quantity, etc., and sends the order data to the manufacturer and wholesaler via EDI (Eietric Date Interchhange: electronic data exchange) to place an order. EDI is a mechanism that unifies information related to commerce into a standard format and exchanges it electronically between companies. Data related to ordering is digitized according to a predetermined format and sent and received via communication lines, etc. To do.

In addition, although the monitoring apparatus 100 is installed in the store, you may install outside via the network which is not shown in figure. When the monitoring device 100 is installed on a server on a network, a plurality of stores can be set as security targets.

[Portable terminal device 50]
The portable terminal device 50 is carried by each of a plurality of shop assistants (employees) in the store. The mobile terminal device 50 is, for example, a smartphone 50a, a tablet 50b, or a notebook computer 50c. In addition, the mobile terminal device 50 includes a mobile phone, PHS (Personal Handy-Phone System), PDA (Personal
Digital Assistants) or dedicated terminals. In the present embodiment, the mobile terminal device 50 can be used by each store clerk (employee) at various places (that is, the current position), and includes a mail or a video from the monitoring device 100 via a telephone line (not shown). Video and the like can be received.

In the present embodiment, the mobile terminal device 50 is assumed to be used by the smartphone 50a and the tablet 50b, and each individual can use the device at various locations (that is, the current location). One of the portable terminal devices 50 is arranged at a headquarter or a head office (not shown).

The mobile terminal device 50 includes a Wi-Fi individual identification device (hereinafter referred to as Wi-Fi slave device) 51, an i-beacon slave device 52, and a GPS (Global Positioning System) that captures the position of a store clerk (employee) on the product sales floor. 53).

<Wi-Fi handset 51>
The Wi-Fi slave device 51 receives and individually identifies the radio waves of the Wi-Fi master device 30 installed in the business facility. The monitoring device 100 stores arrangement information of the Wi-Fi master device 30 installed in the facility as safety related information. When the Wi-Fi slave device 51 comes close to the Wi-Fi master device 30, it is possible to determine the ID and position of the person who carries the mobile terminal device 50.

<I-beacon handset 52>
The i-beacon slave device 52 is an application of the mobile terminal device 50 that supports reception of radio waves from the i-beacon master device 40. The i-beacon parent device 40 transmits a beacon (unique ID information necessary for identification), and the application of the mobile terminal device 50 (i-beacon child device 52) is predetermined when the beacon of the i-beacon parent device 40 approaches. Excites action. As described above, by using the i-beacon, the “position”, “direction”, and the like of the mobile terminal device 50 can be accurately transmitted to the monitoring device 100 from Wi-Fi or GPS.

<GPS53>
The GPS 53 receives a radio wave of position information from a GPS satellite or the like. The GPS 53 calculates the current position information from the information received via the GPS antenna as three parameters of latitude, longitude, and altitude, and acquires the position information. The acquired position information is transmitted to the monitoring device 100 in a timely manner.

In this embodiment, an example using GPS satellites as means for acquiring position information has been shown, but a system using a positional relationship with a base station other than GPS may be used. For example, when an Android (registered trademark) smartphone or a high-performance mobile phone with a camera is used as the mobile terminal device 50 that is a mobile terminal, a base station and a mobile phone communication network (not shown) are used instead of or in combination with the GPS 53. It is also possible to send / receive information to / from the mobile phone company server via the mobile phone and acquire the current location information of the terminal from the approach confirmation.

Further, position information acquisition by Wi-Fi positioning, that is, position information acquisition using a Wi-Fi access point and a predetermined position information service may be used.

[Monitoring device 100]
The monitoring device 100 is installed, for example, in a store management room, and centrally manages the product sales floor in the store. The monitoring device 100 may be a general server computer or a personal computer.

The monitoring apparatus 100 includes a control unit 110 (control unit), an input unit 120, a storage unit 130 (storage unit), a display unit 140, an output unit 150, a face information database (DB) 153, and an image processing unit. 170, an interface (I / F) unit 180, and a communication unit 190, and each unit is connected by a bus 195.

The monitoring device 100 monitors whether a suspicious person who performs shoplifting acts appears in a store.

When it is detected that the suspicious person has appeared in the store, the monitoring device 100 notifies the headquarters, the head office, or the security company system of the person information and the store information through the network.

Hereinafter, when the subject is described as “XX section”, it is assumed that the control section 110 reads each program from the ROM as necessary, loads it into the RAM, and executes each function (described later). Each program may be stored in the storage unit 130 in advance, or may be taken into the monitoring apparatus 100 when necessary via another storage medium or communication medium.

The control unit 110 is configured by a CPU (Central Processing Unit) or the like, and controls the entire monitoring apparatus 100 and executes a control program to function as a digital register security system. The detailed configuration of the control unit 110 will be described later.

The input unit 120 is an input device for the user of the monitoring apparatus 100 to input instructions and the like, such as a keyboard, a mouse, a touch panel provided on the screen of the display unit 140, and a microphone.

The storage unit 130 stores still images or moving images received from the monitoring camera 11, various data and programs used by the control unit 110, and the like.

The display unit 140 displays an operation status of the monitoring apparatus 100, an image received from the monitoring camera 11, a GUI (Graphical User Interface) for operating the monitoring apparatus 100, and the like.

The output unit 150 is an audio interface, for example, and outputs an audio signal from the monitoring device 100 to the acoustic system 158 in the store. As an audio signal output from the monitoring apparatus 100 to the acoustic system 158, for example, an audio signal input from an audio input device such as a microphone provided in the input unit 120 or music data stored in the storage unit 130 is controlled. 110 may be a reproduced audio signal. The acoustic system 158 includes an amplifier and a plurality of speakers arranged in the store, and broadcasts an audio signal input from the monitoring device 100 into the store.

The face information DB 160 accumulates face images (face information) of suspicious persons and store personnel. Basic data such as a person's face registered in the face information DB 160 is obtained from the headquarters, head office, or security company (not shown) via the I / F unit 180, and the face information DB 160 is constructed. In addition, the face information DB can be updated to the latest face image (face information) by exchanging information with the headquarters, the head office or the security company (not shown).

The image processing unit 170 performs a predetermined process on the received image. Examples of the predetermined processing include contour extraction, image resizing, and resolution conversion processing.

The I / F unit 180 connects each monitoring camera 11 and the monitoring device 100 arranged in the product sales floor. In addition, the I / F unit 180 connects each RFID reader 20 arranged in the product sales floor, and monitors the result of authentication of the authentication tag 21 possessed by a store clerk (employee) close to the RFID reader 20 To 100. The I / F unit 180 is connected to a headquarter, head office, security company, or the like (not shown) via a network or a dedicated line. The security company is not an essential component of the digital register security system according to the present embodiment.

The communication unit 190 transmits / receives data to / from the mobile terminal device 50 via the base station. In the present embodiment, the communication unit 190 receives position information of each portable terminal device 50 at regular intervals via the base station, and information on the suspicious person (e-mail transmission, video including video) when the suspicious person is recognized. Etc.).

[Control unit 110]
FIG. 2 is a block diagram of the control unit 110 of the monitoring apparatus 100 of the digital register security system according to the first embodiment of the present invention.

As shown in FIG. 2, the control unit 110 includes a tag movement determination unit 111 (trademark detection unit, customer movement detection unit), a customer position information acquisition unit 112 (customer movement detection unit), and a monitoring target setting unit 113 (customer Movement detection means), monitoring target tracking section 114 (customer movement detection means), suspicious person determination section 115 (tag abnormality determination means, suspicious person registration means), face authentication function section 116 (face authentication means), position A determination unit 117 (control unit), a suspicious person tracking unit 118 (control unit), and a transmission control unit 119 (control unit) are provided.

The control unit 110 captures the face of the customer when the product to which the tag is attached is taken from the display shelf by the monitoring camera 11. The control unit 110 temporarily stores in the storage unit 130 (see FIG. 1) an image of the customer's face taken when the product is taken from the display shelf. The control unit 110 determines whether the face image of the customer leaving the store matches the customer face image stored in the storage unit 130.
The control unit 110 has a function as a settlement determination unit that determines that a product has been settled.
When the product with the RF tag is moved away from the display shelf and starts to move, the control unit 110 uses the monitoring camera 11 to move the product with the product and the customer's face image and the customer's scene image (still image or moving image). Is temporarily stored in the storage unit 130.

The tag movement determination unit 111 detects whether or not a product with a tag (RF tag) is taken from the display shelf. The tag movement determination unit 111 tracks the tag and detects that the product has been taken from the display shelf. Alternatively, the tag movement determination unit 111 detects that a product has been taken from the display shelf based on the state of the product on the display shelf photographed by a plurality of wide-angle lens cameras that photograph the entire store. In addition, the tag movement determination unit 111 detects that the product once taken from the display shelf has been restored again.
The tag movement determination unit 111 determines whether or not the tag (RF tag) attached to the product has moved away from the display shelf. RFID readers 20 are installed on the display shelf at predetermined intervals. The RFID reader 20 detects that a product to which an RF tag is attached (hereinafter referred to as a product as appropriate) has left the display shelf depending on whether or not there is a response to transmission to an RF tag attached to the product. When the RFID reader 20 detects that the product has left the display shelf, the RFID reader 20 transmits detection information to the control unit 110 of the monitoring apparatus 100 after a predetermined time (for example, 10 seconds) has elapsed.

When the tag movement determination unit 111 detects that the product has left the display shelf, the tag movement determination unit 111 determines whether the product has started moving. The start of the movement of the product is detected by another adjacent RFID reader 20 when the product leaves the display shelf.

The customer location information acquisition unit 112 acquires location information of customers who move with this product. The customer location information acquisition unit 112, for example, captures the surroundings of the corresponding display shelf with the monitoring camera 11, and acquires the customer location information by superimposing the customer captured by the monitoring camera 11 with the store layout information.

The monitoring target setting unit 113 sets the monitoring target P by combining the product with the RF tag and the customer position information. When a customer picks up a plurality of products, the monitoring target P is a combination of customer position information and a plurality of RF tags. Further, the store clerk (employee) is excluded from the customer and does not form the monitoring target P.

The monitoring target tracking unit 114 tracks the monitoring target P set by the monitoring target setting unit 113.

The tag movement determination unit 111, the customer position information acquisition unit 112, the monitoring target setting unit 113, and the monitoring target tracking unit 114, as a whole, take a product with a tag from the display shelf and move with the customer. The customer movement detection means to detect is comprised. The display shelf may be anything such as a display case or a product storage box as long as it displays or stores products.

The suspicious person determination unit 115 determines whether or not a predetermined time (for example, 10 minutes to 6 hours depending on the category of the store) has elapsed since the product was taken from the display shelf.
The suspicious person determination unit 115 authenticates the face of the customer leaving the store, and when the customer leaves the store even though the merchandise is not settled, the image of the customer's face taken by the face photographing means is displayed. Register as a suspicious person's face.
The suspicious person determination unit 115 determines whether or not the monitoring target P has been stopped for a predetermined time or longer in a place other than the POS cash register 300 and whether or not the tag forming the monitoring target P has become undetectable. The suspicious person determination unit 115 displays the image of the customer's face when the monitoring target P stops for a predetermined time or longer in a place other than the POS register 300 or when the tag forming the monitoring target P becomes undetectable. Register as a thing.

Further, in the present embodiment, the suspicious person determination unit 115 does not perform the determination at the monitoring exclusion spot even if the monitoring target P is the location of the POS cash register 300.

The face authentication function unit 116 performs face authentication by comparing a person's face image captured by the monitoring camera 11 with a suspicious person's face image registered in the face information DB 160. The face authentication function unit 116 performs face authentication to determine whether the face of a person included in the image received from the monitoring camera 11 is a suspicious person's face registered in the face information DB 160. Face authentication can be performed based on the similarity between the face information extracted from the received image and the suspicious person's face information registered in the face information DB 160.

The position determination unit 117 determines the position of the mobile terminal device 50 closest to the suspicious person. The position determination unit 117 acquires the position information of the plurality of mobile terminal devices 50 in the product sales floor using the GPS position information and the RFID reader 20. Specifically, the position determination unit 117 obtains the position information of the store clerk (employee) on the product sales floor by authenticating the authentication tag carried by the store clerk (employee) by the plurality of RFID readers 20 installed on the product sales floor. get. In this case, the position determination unit 117 determines the position of the suspicious person against the installation position of the monitoring camera 11. That is, when the store clerk (employee) comes close to each RFID reader 20, the position determination unit 117 corresponds to the store clerk (employee) by authenticating each RFID reader 20 of the authentication tag 21 possessed by the store clerk (employee). It is determined that the RFID reader 20 is in proximity. Since the installation position of the RFID reader 20 is registered in advance, the position of the store clerk (employee) can be determined.

Further, the position determination unit 117 acquires position information from the GPS function unit included in the mobile terminal device 50.

The suspicious person tracking unit 118 tracks the movement of the suspicious person on the product sales floor. The suspicious person tracking unit 118 tracks and detects a person who is recognized as a suspicious person by the plurality of monitoring cameras 11 and confirms the movement history in the product sales floor. The suspicious person tracking unit 118 tracks the movement of the suspicious person on the product sales floor. When the suspicious person moves away from the position of the nearest mobile terminal device 50 by a predetermined distance, the suspicious person tracking unit 118 moves the suspicious person against the other mobile terminal devices 50. The information regarding the suspicious person including the face image is transmitted.

The transmission control unit 119 transmits information related to the suspicious person (an image or a moving image of the suspicious person's scene) to a store clerk (employee) close to the position of the suspicious person. For example, the transmission control unit 119 transmits voice, video, and suspicious person location information (for example, information marked on the sales floor layout) by e-mail. The transmission control unit 119 determines the position of the mobile terminal device 50 closest to the suspicious person, and transmits information related to the suspicious person to the mobile terminal device 50. If there is no answerback signal even after a predetermined time (for example, 5 seconds) has elapsed from the transmitting store clerk (employee), the transmission control unit 119 selects a second store clerk (employee) related person and performs retransmission. . The second clerk (employee) related person is the clerk second closest to the suspicious person.

The operation of the digital register security system configured as described above will be described below.
[registration process]
First, the registration process of the suspicious person's face in the digital register security system will be described.

FIG. 3 is a flowchart showing the suspicious person's face registration process of the control unit 110 of the monitoring apparatus 100 of the digital register security system. This flow is executed by the control unit 110 (see FIG. 2) of the monitoring apparatus 100.

In step S1, the tag movement determination unit 111 (product detection means) of the control unit 110 detects whether or not a product with a tag (RF tag) is taken from the display shelf. RFID readers 20 are installed on the display shelf at predetermined intervals. The RFID reader 20 detects that a product with an RF tag (hereinafter referred to as a product as appropriate) has left the display shelf depending on whether or not there is a response to transmission to an RF tag attached to the product. The tag movement determination unit 111 tracks the tag and detects that the product has been taken from the display shelf. Alternatively, the tag movement determination unit 111 detects that a product has been taken from the display shelf based on the state of the product on the display shelf photographed by a plurality of wide-angle lens cameras that photograph the entire store.

When the tag is not away from the display shelf (step S1: No), the process of this flow is terminated.
When the product with the tag is taken from the display shelf (step S1: Yes), in step S2, the control unit 110 detects the customer when the product to which the tag is attached is taken from the display shelf by the monitoring camera 11. Shoot the face. The monitoring camera 11 is a PTZ camera, for example, and is remotely operated by the monitoring device 100. The surveillance camera 11 is an authentication camera that photographs a person's face. An image captured by the monitoring camera 11 is output to the monitoring device 100.
In step S <b> 3, the control unit 110 temporarily stores in the storage unit 130 (see FIG. 1) an image of the customer's face taken when the product is taken from the display shelf. When the tag movement determination unit 111 once detects that the product taken from the display shelf has been restored again, the control unit 110 displays the image of the customer's face stored in the storage unit 130. delete.

In step S <b> 4, the control unit 110 determines whether all products have been settled at the POS cash register 300.
If all the products have not been settled at the POS register 300 (step S4: No), it is determined that there is a possibility of continuing shopping and the process proceeds to step S6.
When all the products are settled at the POS register 300 (step S4: Yes), the suspicious person determination unit 115 of the control unit 110 displays the image of the customer's face stored in the storage unit 130 in step S5. delete. That is, the customer's face image stored in the storage unit 130 is deleted from the storage unit 130 when all the products taken by the customer are settled. As a result, the number of customer face images to be collated at the store exit can be reduced.

In step S6, the suspicious person determination unit 115 of the control unit 110 determines whether or not a predetermined time (for example, 10 minutes to 6 hours, depending on the store category) has elapsed since the product was removed from the display shelf.
If the predetermined time has not elapsed since the product was removed from the display shelf (step S6: No), the process proceeds to step S7, and if the predetermined time has elapsed since the product was removed from the display shelf (step S6: Yes), step Proceed to S8.

In step S <b> 7, the control unit 110 compares the face image of the customer leaving the store at the store exit (or entrance) with the customer face image stored in the storage unit 130 to determine whether or not they match. Determine whether.
If the face image of the customer leaving the store does not match the face image stored in the storage unit 130 (step S7: No), the process returns to step S4. If the face image of the customer leaving the store matches the customer face image stored in the storage unit 130 (step S7: Yes), the process proceeds to step S8.

In step S8, when a predetermined time has elapsed since the item was taken from the display shelf in step S6, or the customer's face image stored in the storage unit 130 is the image of the customer's face leaving the store in step S7. If the image matches the image, the suspicious person determination unit 115 reads the customer's face image stored in the storage unit 130, registers it as the suspicious person's face, and ends this flow. When a predetermined time has elapsed since the product was taken from the display shelf, it is suspected that the customer who took the product from the display shelf is a suspicious person who performs shoplifting, product replacement, damage, or the like. Moreover, it is a case where all the products are left from the store even though they are not cleared at the POS cash register 300. The suspicious person determination unit 115 reads the customer face image stored in the storage unit 130, registers it as the suspicious person face, and ends this flow.
In this way, by registering the customer's face image after a predetermined time has passed since the product was taken from the display shelf, even if the verification / authentication at the store exit fails, the face of the suspicious person Images can be registered.
If the face image of the customer leaving the store in step S8 does not match the face image of the customer stored in the storage unit 130 (for example, if the customer who was masking removed the mask), By returning to step S4, the processing after the settlement determination of the POS cash register 300 is repeated.
With this flow, the face image of the suspicious person is registered in the face information DB 160.

[Security control of monitoring device 100]
FIG. 4 is a flowchart showing a security process of the control unit 110 of the monitoring apparatus 100 of the digital register security system. This flow is mainly executed by the control unit 110 (see FIG. 4) of the monitoring apparatus 100.

First, in step S21, the control unit 110 captures the video of the monitoring camera 11. The surveillance camera 11 can shoot the entire store with a plurality of wide-angle lens cameras.

In step S22, the face authentication function unit 116 of the control unit 110 performs face authentication by comparing the face image of the person photographed by the monitoring camera 11 with the face image of the suspicious person registered in the face information DB 160.

In step S23, it is determined whether or not the face image of the person photographed by the monitoring camera 11 matches the face image of the suspicious person registered in the face information DB 160 by the face authentication. When the customer visits the store again, the face image of the person photographed by the monitoring camera 11 matches the face image of the suspicious person registered in the face information DB 160. In addition to the case of visiting the store again, for example, if the face image of a suspicious person is registered on a certain floor (registration by the registration process of the suspicious person's face in FIG. 3), Authentication is possible, and face authentication is also possible when a customer leaves the store. Thus, in the case of an unmanned store, the exit gate can be closed when a suspicious person tries to leave the store. When the face image of the person photographed by the monitoring camera 11 does not match the face image of the suspicious person registered in the face information DB 160 (step S23: No), the processing of this flow ends.

As described above, when the customer visits the store again, the face image of the person photographed by the monitoring camera 11 matches the face image of the suspicious person registered in the face information DB 160 (step S23: Yes), in step S24, the position determination unit 117 of the control unit 110 determines the position of the mobile terminal device 50 closest to the suspicious person.

In step S25, the suspicious person tracking unit 118 of the control unit 110 tracks the movement of the product sales floor of the suspicious person.

In step S <b> 26, the transmission control unit 119 of the control unit 110 transmits information about the suspicious person (an image of the suspicious person's scene or a moving image) to the clerk (employee) close to the position of the suspicious person, and ends this flow. To do. For example, the transmission control unit 119 transmits voice, video, and suspicious person location information (for example, information marked on the sales floor layout) by e-mail.

Here, it may not be appropriate for the store clerk (employee) to take the above measures at the sales floor. It is up to the store clerk (employee) to decide what kind of response the clerk (employee) will take to the suspicious person, but it is significant to provide information as a judgment material.

If the face authentication is executed when the customer (suspicious person) leaves the store, information on the suspicious person is transmitted to the store clerk (employee) when the customer leaves the store.

In addition, when the suspicious person is a shoplifting addict, information related to shoplifting addicts may be transmitted to the mobile terminal device 50 of the headquarters, the head office, or a security company in addition to the response to the store clerk (employee).

[Application example]
FIG. 5 is a diagram for explaining an application example of the digital register security system, and is a diagram showing a store visitor and a sales floor layout (commodity sales floor). FIG. 5 shows a sales floor of a store such as a convenience store.

In FIG. 5, the RFID reader 20 of FIG. 1 is the electronic tag reader of FIG. 5, and the electronic tag is an RF tag. The Wi-Fi slave device 51 of FIG. 1 is connected to the Wi-Fi master device 30 via the Wi-Fi repeater 51A installed for each fixed distance unit or sales department in FIG. For customers in the store, position information and customer face images are detected by an electronic tag, i-beacon, Wi-Fi, smartphone, surveillance camera 11, electronic tag gate terminal, and the like.

When a customer picks up an electronic tag product (a product with a tag) and moves with the product, the behavior of the customer is detected by the movement signal of the electronic tag product possessed by the customer. In the example of FIG. 5, the smartphone (i.e., the application of the portable terminal device 50) possessed by the customer receives the radio wave transmitted by the i-beacon parent device 40 installed in the upper part of the display case, and responds with the ID, whereby the i-beacon. The parent device acquires the location information of the smartphone. The Wi-Fi handset 51 of the smartphone (mobile terminal device 50) possessed by the customer is transferred to the Wi-Fi master 30 of the monitoring device 100 via the Wi-Fi repeater 51A installed in the store. It is input, and the sales location corner or display case where the visitor is located is detected. A surveillance camera 11 is installed in each area such as a sales department, a sales corner, a passage, and a cash register, detects radio waves transmitted by the electronic tag reader 20, and installs (or shoots) the surveillance camera 11. In combination with information, the customer's location is identified. Further, the radio wave transmitted by the electronic tag reader 20 is detected to identify the year, month, day, hour, and minute of the location. Furthermore, images taken by the monitoring camera 11 installed in the corresponding area can be extracted in chronological order, and it can be detected that the customer is in the hall in front of the sales corner or the display case.

When the customer enters the shopping basket and moves the electronic tag product, the electronic tag of the product responds to the radio wave transmitted by the electronic tag reader 20, and the electronic tag reader 20 can receive the responded radio wave. .

By the way, in the case of high-priced products sold at stores, an electronic tag gate 12 is installed before the entrance, and when it is not settled, a warning is issued and the store clerk rushes. Further, single item management, ordering, sales, etc. of the product can be handled daily by product management by the handy scanner 250, the POS cash register 300, and the EOS 400. As measures against shoplifting and merchandise loss in such store sales activities, a surveillance camera 11 and an electronic tag gate 12 are installed, and a human guardman is introduced.

However, the actual situation is that suspicious persons such as shoplifting acts are not registered only by monitoring with the surveillance camera 11 or the like, and even if a shopkeeper who is not registered carries out shoplifting actions, it is often not detected. In addition, it is a current situation that it is still not sufficient for a store-related person to register as a suspicious person such as a shoplifting act because it requires a lot of labor and there is a risk of misidentification.

Furthermore, there is a problem that shoplifting cannot be prevented if the electronic tag is removed from the product or the electronic tag is wrapped in an electromagnetic shield sheet.

For example, if the customer A in FIG. 5 takes out a product from a display case (display shelf), puts it in his / her clothes or bag, and moves out of the store, in the case of the conventional example, unless it is cleared at the POS cash register 300 An alarm is generated at the electronic tag gate 12. However, if a suspicious person such as a shoplifting act removes the electronic tag from the product or wraps the electronic tag in an electromagnetic shield sheet, the electronic charge is not settled at the POS cash register 300. The tag gate 12 cannot detect it and cannot prevent shoplifting. Since shoplifting cannot be prevented, the suspicious person repeats shoplifting. In particular, the problem is that the suspicious person has taken out the electronic tag from the display case (display shelf) for the purpose of shoplifting and has taken it away. This is because the electronic tag gate 12 cannot be detected. Therefore, a suspicious person will not be identified indefinitely.

On the other hand, according to the present embodiment, the digital register security system 1000 (see FIG. 1) includes a tag movement determination unit 111 that detects that a product with a tag is taken from the display shelf, Surveillance camera 11 that captures the face of the customer who has taken out the image, storage unit 130 that temporarily stores the captured face image, control unit 110 that determines that the product has been liquidated, and A suspicious person determination unit 115 that registers an image of the customer's face as the suspicious person's face when the customer leaves the store even though the product is not settled by matching the face. In addition, a face authentication function unit 116 that performs face authentication for comparing a face image of a person photographed by the monitoring camera 11 with a face image of a suspicious person registered in the face information DB 160, and a salesclerk (employee) close to the position of the suspicious person A transmission control unit 119 for transmitting information on the suspicious person.

With this configuration, it is possible to register the image of the customer's face when the item with the tag is taken from the display shelf as that of the suspicious person. In particular, since the customer's face is photographed when the product is taken from the display shelf, regardless of the customer's subsequent actions, if the customer leaves the store unpaid or carries the product for a long time, the customer Can be registered as that of a suspicious person. This has the effect of not missing the opportunity to register suspicious individuals.
When the customer (suspicious person) visits the store again, leaves the store, or moves from the product area registered in the image to another product area, the clerk (employee) close to the position of the suspicious person Information on the suspicious person such as the suspicious person's face image is transmitted. A nearby store clerk (employee) can rush to the site in real time.

Especially, since the video of the suspicious person's face is registered at the time when the shoplifting action is being formed, it is possible to immediately check the suspicious person by performing face recognition after registration. Future shoplifting by the suspicious person, which was difficult with the prior art, can be prevented.

In this embodiment, the number of images to be collated at the store exit can be reduced by deleting the image of the customer's face when all the products taken by the customer are settled.
In the present embodiment, when the product is not cleared after a predetermined time (10 minutes to 6 hours depending on the store category) after the product is taken from the display shelf, an image of the customer's face is registered. As a result, even if the verification / authentication at the exit fails, the image of the suspicious person's face can be registered.

In this embodiment, the face image that is collated (stored) with the customer's face image taken at the store exit is only the face image of the customer who has taken the product from the display shelf and has not settled at the cash register. . That is, it is only the number of customers moving between the display shelf and the cash register, and it is considered that the number is small. In this case, most of the face images of the customers who took the goods from the display shelf are erased by liquidation.
Moreover, since the customer is generally walking in the exit direction at the exit of the store, it is considered easy to capture the customer's face image from the front. This is particularly favorable when the store exit is an escalator. Further, even if the customer is masked, if the mask is kept masked while in the store, it can be processed as a masked face image.

(Second Embodiment)
The hardware configuration of the digital register security system according to the second embodiment of the present invention is the same as that shown in FIGS.
The suspicious person's face registration process of the digital register security system will be described.

FIG. 6 is a flowchart showing the suspicious person's face registration process of the control unit 110 of the monitoring apparatus 100 of the digital register security system according to the second embodiment of the present invention. This flow is executed by the control unit 110 (see FIG. 2) of the monitoring apparatus 100.

In step S101, the tag movement determination unit 111 of the control unit 110 determines whether or not the tag (RF tag) attached to the product has started to move away from the display shelf. RFID readers 20 are installed on the display shelf at predetermined intervals. The RFID reader 20 detects that a product to which an RF tag is attached (hereinafter referred to as a product as appropriate) has left the display shelf depending on whether or not there is a response to transmission to an RF tag attached to the product. When the RFID reader 20 detects that the product has left the display shelf, the RFID reader 20 transmits detection information to the control unit 110 of the monitoring apparatus 100 after a predetermined time (for example, 10 seconds) has elapsed. When the tag movement determination unit 111 of the control unit 110 detects that the product has left the display shelf, the tag movement determination unit 111 determines whether the product has started to move. The start of the movement of the product is detected by another adjacent RFID reader 20 when the product leaves the display shelf.

If the tag has moved away from the display shelf but has not started moving (step S101: No), it is determined that the customer is picking up and viewing the product, and the processing of this flow is terminated.

When the product with the RF tag is moved away from the display shelf and starts moving (step S101: Yes), in step S102, the customer location information acquisition unit 112 of the control unit 110 displays the location information of the customer who moves with the product. get. The customer location information acquisition unit 112, for example, captures the surroundings of the corresponding display shelf with the monitoring camera 11, and acquires the customer location information by superimposing the customer captured by the monitoring camera 11 with the store layout information. If the customer is a suspicious person, it is considered a rare case (the shoplifter does not usually notify his / her location information). However, if the suspicious person pretending to be a customer does not know the existence of the digital register security system, the Wi-Fi slave device 51 and the i-beacon slave device 52 may be carried. As described above, when position information from the Wi-Fi handset 51 or i-beacon handset 52 possessed by the customer can be acquired, the position information of the customer may be acquired from these pieces of information.

When the product with the RF tag starts moving away from the display shelf, in step S103, the control unit 110 uses the surveillance camera 11 to move the product with the product and the customer's face image and the customer's scene image. (Still image or moving image) is temporarily stored in the storage unit 130 (see FIG. 1). The monitoring camera 11 is a PTZ camera, for example, and is remotely operated by the monitoring device 100. The surveillance camera 11 is an authentication camera that photographs a person's face. An image captured by the monitoring camera 11 is output to the monitoring device 100.

In step S104, the monitoring target setting unit 113 of the control unit 110 sets the monitoring target P by combining the product with the RF tag and the customer position information. A customer may pick up multiple items. In this case, the monitoring target P is a combination of customer location information and a plurality of RF tags. Further, the store clerk (employee) is excluded from the customer and does not form the monitoring target P.

In step S105, the monitoring target tracking unit 114 of the control unit 110 tracks the monitoring target P set by the monitoring target setting unit 113.

In step S106, the monitoring target tracking unit 114 determines whether or not the monitoring target P has moved to the POS cash register 300. If the monitoring target P has moved to the POS cash register 300 (step S106: Yes) (the arrow in FIG. 1) a), it is determined that the customer is not a suspicious person, and the processing of this flow is terminated.

When the monitoring target P has not moved to the POS register 300 (step S106: No) (see arrow b in FIG. 1), the process proceeds to step S107. If a customer (monitoring target P) having a tag attached to a product does not move to the POS register 300 for a long time, it is determined as a caution or abnormal state.

In step S107, the suspicious person determination unit 115 of the control unit 110 determines whether or not the monitoring target P has been stopped at a place other than the POS register 300 for a predetermined time (for example, 10 minutes or 1 hour). When the monitoring target P has not been stopped for a predetermined time or longer in a place other than the POS register 300 (step S107: No), the process returns to step S5 to continue tracking the monitoring target P.

When the monitoring target P stops at a place other than the cash register for a predetermined time or longer (step S107: Yes), the suspicious person determination unit 115 in step S108 determines that the place is a fitting room or a tasting corner where a store clerk (employee) can reach It is determined whether the spot is a spot excluded from monitoring. Being a monitoring exclusion spot is not limited to the fact that the monitoring target P has moved to the monitoring exclusion spot, but is a condition that there is a store clerk (employee) at the monitoring exclusion spot.

When the monitoring target P is in the monitoring exclusion spot (step S108: Yes), the process returns to step S108.

If the monitoring target P is not in the monitoring exclusion spot (step S108: No), the process proceeds to step S109.

In step S9, the suspicious person determination unit 115 determines whether or not the tag constituting the monitoring target P has become undetectable. When a suspicious person removes a tag from a product or covers the tag with an electromagnetic shield sheet, radio waves responding to the tag that has been detected until now cannot be detected. If it is not the location of the POS register 300 but the response of the tag that has been detected so far stops, it is determined as a caution or abnormal state.

If the RF tag forming the monitoring target P is not undetectable (step S109: No), the process returns to step S5 and the tracking of the monitoring target P is continued.

If the RF tag forming the monitoring target P is undetectable (step S109: Yes), the process proceeds to step S110.

In step S110, the suspicious person determination unit 115 determines that the customer constituting the monitoring target P is suspected to be a shoplifter, product replacement, damage, and the like, and stores it in the storage unit 130. The customer's face image is read out and registered as a suspicious person's face, and this flow ends.

Here, when the RF tag is removed, even if it is determined that the RF tag has stopped moving for a predetermined time or more and an attempt is made to register a face image, the customer has already left the place when the determination is made. Yes. Therefore, when the product tagged with the RF tag starts moving away from the display shelf in the above step S3, or when the movement is stopped for the predetermined time or longer, the image of the customer's face is stored. If it is determined in step S110 that the person is a suspicious person, the stored customer face image is registered as a suspicious person face image.
With this flow, the face image of the suspicious person is registered in the face information DB 160.

The crime prevention control of the monitoring device 100 is the same as the crime prevention process flow of FIG. 4, and when the customer visits the store again, information on the suspicious person is transmitted to the clerk (employee).

As described above, according to the present embodiment, when the digital register security system 1000 (see FIG. 1) detects that the product has left the display shelf, the digital register security system 1000 determines whether the product has started moving. Tag movement determination unit 111, customer position information acquisition unit 112 that acquires position information of a customer who moves with the product, and monitoring target that sets the monitoring target P by combining the product with the RF tag and the customer's position information The setting unit 113, the monitoring target tracking unit 114 that tracks the monitoring target P set by the monitoring target setting unit 113, and when the monitoring target P stops at a place other than the POS cash register 300 for a predetermined time or more, or And a suspicious person determination unit 115 that registers an image of the customer's face as that of a suspicious person when the tag forming the mark becomes undetectable. In addition, a face authentication function unit 116 that performs face authentication for comparing a face image of a person photographed by the monitoring camera 11 with a face image of a suspicious person registered in the face information DB 160, and a salesclerk (employee) close to the position of the suspicious person A transmission control unit 119 for transmitting information on the suspicious person.

This configuration allows the customer's face image to be registered as a suspicious person even when the tag is removed from the product or the tag is invalidated. When the customer (suspicious person) visits the store again, leaves the store, or moves from the product area registered in the image to another product area, the clerk (employee) close to the position of the suspicious person Information on the suspicious person such as the suspicious person's face image is transmitted. A nearby store clerk (employee) can rush to the site in real time.

As in the first embodiment, since the shoplifting action is being formed, the video of the suspicious person's face is registered. Therefore, after registration, the suspicious person can be immediately determined by face recognition. it can. Future shoplifting by the suspicious person, which was difficult with the prior art, can be prevented.

In this embodiment, the monitoring target P is set by combining the product with the RF tag and the location information of the customer. Tags can be attached to any product. For this reason, by setting the monitoring target P, it is possible to monitor a number of products at once, and it is possible to construct a security system that can be easily adopted even in stores with a large number of sales varieties or sales numbers.

The above description is an illustration of a preferred embodiment of the present invention, and the scope of the present invention is not limited to this. For example, any face authentication technique of the control unit 110 using the monitoring camera 11 may be used. Moreover, it can replace with detecting with the RFID reader | leader 20 that the goods left | separated from the display shelf, and the monitoring camera 11 can also be used. That is, it may be detected that the product has left the display shelf by detecting that the product disappears from the display shelf by the monitoring camera 11. In addition to image recognition, customer tracking includes electronic tags, i-beacons, Wi-Fi, etc., and these may be combined as in the application example (see FIG. 5). When a customer carries a mobile terminal device, the mobile terminal device is installed by installing Wi-Fi equipment in the store, and the mobile terminal device carried by the customer makes a Wi-Fi connection. The customer can be identified. Similarly, since the mobile terminal device can be identified by the equipment of the i-beacon, the customer carrying the mobile terminal device can be identified. In this way, when a customer is identified by the mobile terminal device, the position of the mobile terminal device can be detected by the response of the radio wave from the mobile terminal device, so that the customer carrying the mobile terminal device The position can be detected. To this end, suspicious behavior of customers (e.g. (1) .repetitively reciprocating round trips in specific areas, (2) .pausing unnaturally long before a cashier or display case (3). It can also be marked as a person to watch out for, such as moving at an unnatural speed in the store and (4). In addition, in the case where the facility for detecting the position of the customer by such a portable terminal device is provided, not only the suspicious person but also the position of a general customer (who carries the portable terminal device) is detected. Therefore, it is possible to grasp the distribution and movement of customers in the store accompanying the shoplifting prevention function. This information can be used for store clerk placement. Also, if a burglar comes in, the customers who have moved up to that point will stop moving all at once, so this can be detected and used for reporting a burglary. Furthermore, since the surveillance camera 11 is provided, it is possible to capture a suspicious appearance of a customer (for example, wearing a mask, sunglasses, or a lookout hat) and mark it as a person requiring attention. Further, since it is detected by the RFID reader 20 that the product to which the RF tag is attached has left the display shelf, if it is detected that the product has unnaturally separated from the display shelf in large quantities, A customer can be marked as a sensitive person. This function can also be realized by the monitoring camera 11. That is, if it is detected by the monitoring camera 11 that the product has disappeared from the display shelf, and it is detected that the product has unnaturally left a large amount, the customer who is present is marked as a person requiring attention. You can also.

In the above embodiments, the names digital register security system and method are used. However, this is for convenience of explanation, and may be a prevent system, a sales system, a security method, or the like.

The digital register security system and method of the present invention can also be realized by a program for causing a computer to function as the digital register security system or method. This program may be stored in a computer-readable recording medium.

The recording medium on which this program is recorded may be the ROM itself of the digital register security system, or a program reading device such as a CD-ROM drive is provided as an external storage device, and the recording medium is inserted therein. It may be a readable CD-ROM or the like.

Further, the recording medium may be a magnetic tape, a flexible disk, a hard disk, an MO / MD / DVD, or a semiconductor memory.

The digital register security system, method and program according to the present invention have a great effect when applied to a sales management system capable of effectively reducing shoplifting damage in commercial facilities. Installation in various stores is expected.

11 Surveillance camera (face photographing means)
12 RFID tag gate 30 RFID reader 30 Wi-Fi master device 40 i-beacon master device 50 Mobile terminal device (terminal device)
51 Wi-Fi handset 51A Wi-Fi repeater 52 i-beacon handset 53 GPS
100 monitoring device 110 control unit (clearing determination means)
111 tag movement determination unit (product detection means, customer movement detection means)
112 Customer location information acquisition unit (customer movement detection means)
113 Monitoring object setting unit (customer movement detection means)
114 Monitoring target tracking unit (customer movement detection means)
115 Suspicious person judging section (tag abnormality judging means, suspicious person registering means)
116 Face authentication function unit (face authentication means)
117 Position determination unit (control means)
118 Suspicious person tracking part (control means)
119 Transmission control unit (control means)
130 storage unit (storage means)
160 face information DB
200 POS server 250 Handy scanner 300 POS register 400 EOS
1000 Digital register security system

Claims

Product detection means for detecting that the tagged product has been removed from the display shelf;
A face photographing means for photographing the face of the customer who has taken out the commodity when the commodity detecting means detects that the commodity has been taken from the display shelf;
Storage means for temporarily storing an image of the face photographed by the face photographing means;
Clearing determination means for determining that the product has been liquidated;
If the result of collating the face image of the customer leaving the store with the image stored in the storage means matches, and it is not determined that the product taken out by the customer has been liquidated by the liquidation determining means, the customer A digital register security system comprising: a suspicious person registration means for registering a face image of a person as a suspicious person's face.
The product detection means detects once that the product taken from the display shelf has been restored again,
2. The control means for deleting an image of the customer's face stored in the storage means when the product detection means detects that the goods have been returned to the display shelf. Digital register security system.
When the clearing means determines that all the products taken by the customer from the display shelf have been cleared, the clearing means comprises control means for deleting the image of the customer's face stored in the storage means. The digital register security system according to claim 1.
The suspicious person registering means is in the case where it is not determined that the commodity has been liquidated by the liquidation determining means even after a predetermined time has elapsed since the commodity detecting means has detected that the commodity has been removed from the display shelf. 2. The digital register security system according to claim 1, wherein an image of the customer's face stored in the storage means is registered as a suspicious person's face.
Customer movement detection means for detecting a customer moving with the tagged product,
Tag abnormality determination means for determining that the product with the tag attached is stopped for a predetermined time at a place other than a predetermined location and that the tag becomes undetectable,
The suspicious person registration means registers the image of the customer's face imaged by the surveillance camera as the suspicious person's face when the tag abnormality determining means determines that the tag has stopped moving or cannot be detected. The digital register security system according to claim 1, wherein:
A product detection step for detecting that the tagged product has been removed from the display shelf;
When the product detection step detects that the product has been removed from the display shelf, a face photographing step for photographing the face of the customer who has taken out the product;
A storage step for temporarily storing an image of the face photographed in the face photographing step;
Clearing determination step for determining that the product has been liquidated;
If the result of collating the face image of the customer leaving the store with the image stored in the storage step is the same, and it is not determined that the product taken out by the customer has been liquidated by the liquidation determination step, the customer A digital register security method comprising: a suspicious person registration step of registering a face image of a person as a suspicious person's face.
Computer
Product detection means for detecting that the product with the tag is taken from the display shelf, and the face of the customer who has taken out the product when the product detection means detects that the product has been taken from the display shelf A face photographing means for photographing the image, a storage means for temporarily storing an image of the face photographed by the face photographing means, a liquidation judging means for judging that the product has been liquidated, and a face of the customer leaving the store If the result of matching the image of the image and the image stored in the storage means matches and it is not determined that the product taken out by the customer has been cleared by the clearing determination unit, the image of the customer's face is The program for functioning as a digital register security system provided with a suspicious person registration means registered as a suspicious person's face.