WO2018198250A1

WO2018198250A1 - Digital smart earnings/security system, method, and program

Info

Publication number: WO2018198250A1
Application number: PCT/JP2017/016621
Authority: WO
Inventors: 和夫三輪
Original assignee: 株式会社テクノミライ
Priority date: 2017-04-26
Filing date: 2017-04-26
Publication date: 2018-11-01

Abstract

Provided are a digital smart earnings/security system, method, and program that can have a powerful effect on both earnings-based sales improvement and security-based crime prevention. A digital smart earnings/security system (1000) that comprises: a customer category table 200 that stores guest profiles or attributes as customer categories 210; a customer category—attendant correspondence table (300) that associates and stores the customer categories (210) and appropriate attendants; and a control unit (110) that comprises a specific person recognition unit (112) that references the customer category table 200 and recognizes VIPs, regular customers, frequent complainers, and habitual shoplifters, an attendance unit (113) that references the customer category—attendant correspondence table (300) and has an appropriate attendant attend to a recognized guest, and a transmission control unit (117) that transmits information on the guest to a portable terminal device (30) for the selected attendant.

Description

Digital smart-earning security system, method and program

The present invention relates to a digital smart earning / security system, method, and program for improving sales by earning and preventing security by security for customers who visit the store.

According to Patent Document 1, “A sales promotion message is displayed on the display device of the mobile device based on the customer profile...” (Claim 27), “The merchant is suitable or specialized for a specific customer. “Propose, advertise or promote on mobile device” (paragraph 0078).

Patent Document 2 states that, “when the collation result by the face authentication collating unit matches, based on the position information acquired from the position information acquiring unit, the closest match to the shoplifting addict or the behavior suspicious person who the collation result matches. The position of the mobile terminal device is determined, and information relating to the shoplifting addict or the suspicious person for behavior is transmitted to the mobile terminal device ”(claim 1).

In Patent Document 3, “Detecting image data obtained from a CCD camera and using an image recognition result of the image data” (paragraph 0009) and “robot device whose behavior is controlled” (paragraph 0001) Is described.

JP 2013-529326 A Japanese Patent No. 5780569 JP 2004-160630 A

However, in such a conventional transaction management system, the point of transmitting information to a portable device possessed by an attender suitable for a customer is not disclosed in any document.

An object of the present invention is to provide a digital smart earning / security system, method, and program that can be used for both sales improvement by earning and crime prevention by security.

The digital smart earning security system according to the present invention includes a profile storage means for storing a customer profile for each customer, an authentication means for authenticating a customer who visits the store, and the profile of the customer authenticated by the authentication means. Control means for determining an attendant suitable for the customer based on the profile stored in the storage means and transmitting information relating to the customer to a mobile terminal device carried by the determined attendant.

In addition, the profile includes two or more of VIP, customer, Kramer, and shoplifter, so that appropriate attendance is provided to VIP, customer, Kramer, or shoplifter. Can do.

The above-mentioned profile includes the language spoken by the customer, so that the store clerk who is fluent in the language spoken by the customer can be attended.

In addition, the apparatus includes position information acquisition means for acquiring position information of the mobile terminal device carried by the attendant in the store, and the control means selects an attendant suitable for the customer based on a distance between the customer and the mobile terminal device. By making a determination, it is possible to respond quickly to the customer and further enhance the effect.

The digital smart earning security method of the present invention includes a profile storage step for storing a customer profile for each customer, an authentication step for authenticating a customer who visits the store, and the customer authenticated by the authentication step. And a control step of determining an attendant suitable for the customer based on the profile stored in the profile storing step and transmitting information about the customer to a portable terminal device carried by the determined attendant. .

Further, the present invention stores a computer in profile storage means for storing a customer profile for each customer, authentication means for authenticating a customer who visits the store, and the profile storage means of the customer authenticated by the authentication means. Based on the profile that has been determined, an attendant suitable for the customer is determined, and a control means for transmitting information about the customer to a portable terminal device carried by the determined attendant is caused to function as a digital smart earning security system It is a program for.

According to the present invention, it is possible to provide a digital smart earning / security system, method, and program that can be used for both sales improvement by earning and crime prevention by security.

It is a block diagram which shows the structure of the digital smart earning security system which concerns on embodiment of this invention. It is a block diagram of the control part of the monitoring apparatus of the digital smart earning security system which concerns on embodiment of this invention. It is a figure which shows an example of the customer category table of the digital smart earning security system which concerns on embodiment of this invention. It is a figure which shows an example of the customer category / attender correspondence table of the digital smart earning security system which concerns on embodiment of this invention. It is a flowchart which shows the registration process of the person of the control part of the monitoring apparatus of the digital smart earthing security system which concerns on embodiment of this invention. It is a flowchart which shows the registration update process of the table of the control part of the monitoring apparatus of the digital smart earning security system which concerns on embodiment of this invention. It is a flowchart which shows the registration process of the sales floor layout of the control part of the monitoring apparatus of the digital smart earthing security system which concerns on embodiment of this invention. It is a flowchart which shows the attend control process of the monitoring apparatus of the digital smart earning security system which concerns on embodiment of this invention. It is a figure which shows VIP or a customer's information and sales floor layout (goods sales floor) transmitted to the attender in the earthing of the digital smart earning / security system concerning an embodiment of the invention. It is a figure which shows the information and the sales floor layout (product sales floor) of the claimer transmitted to the attendant in the security of the digital smart earning security system which concerns on embodiment of this invention. It is a figure which shows the shoplifting addict information and sales floor layout (product sales floor) transmitted to the attendant in the security of the digital smart earning security system which concerns on embodiment of this invention.

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings.
(Embodiment)
FIG. 1 is a block diagram showing a configuration of a digital smart earning / security system according to an embodiment of the present invention. In this specification, “earning” refers to sales improvement, and “security” refers to crime prevention. In addition, an attender (attender / atenda) refers to a customer clerk, and an attendant refers to a person who takes care of a person or an attendant.

This system can be used in department stores, supermarkets, convenience stores, shopping malls, airports, airplanes, stations, trains, ships, restaurants, underground malls, specialty stores, precious metal stores, luxury boutiques, complex facilities, offices, theaters, gathering venues, It can be applied to schools, hospitals, factories, financial institutions, government offices, hotels, museums, art galleries, stadiums, event venues, new product announcement venues, and skyscrapers.

As shown in FIG. 1, the digital smart earthing / security system 1000 is installed on a plurality of surveillance cameras (including an authentication camera) 11 installed on the ceiling of a product sales floor and a product shelf on the product sales floor. RFID (Radio Frequency IDentification) reader 20, an authentication tag 21 carried by an attender (customer staff) and authenticated by the RFID reader 20, a portable terminal device 30 carried by the attendant, and the position of the attender on the product sales floor GPS (Global Positioning System) 40 and a control device 100 that controls the entire system.

The digital smart-earning / security system 1000 monitors video from the surveillance camera 11 installed on the product sales floor, and information on VIP (Very Important Importer Person), Kramer, or shoplifting addicts is stored in the mobile terminal device 30 carried by the attendant. This is a system that prevents the shoplifting by shoplifting addicts from responding to VIPs and responding to claimers.

<Monitoring camera 11>
A plurality of surveillance cameras 11 are installed in a store or the like, and a predetermined surveillance area can be photographed. In addition, there is one that causes a specific person to be tracked by the monitoring camera 11. Even if the surveillance camera does not track a specific person, a plurality of surveillance cameras 11 are installed, so that a person or the like can be photographed from various angles.

The surveillance camera 11 is an authentication camera that photographs a person's face. Surveillance cameras 11 are installed at various places on the product sales floor such as in a store and take pictures of a person's face. An image captured by the monitoring camera 11 is output to the control device 100. The surveillance camera 11 may shoot a moving image at all times, or may shoot a still image every certain time (for example, several seconds).

<RFID reader 20>
The RFID reader 20 manages settlement of products with an RF tag by detecting whether there is a response to transmission to an RF tag attached to the product. Note that the RF tag is removed or invalidated from an article that can be properly taken out of the store, for example, by purchase.

In the present embodiment, the RFID reader 20 authenticates the authentication tag 21 possessed by a store clerk (attender). The RFID reader 20 captures the position of the attendant carrying the authentication tag 21 by authenticating the authentication tag 21 possessed by the store clerk (attender).

<Mobile terminal device 30>
The mobile terminal device 30 is carried by each of a plurality of salesclerks (attenders) in the store. The mobile terminal device 30 is, for example, a smartphone 30a, a tablet 30b, or a notebook computer 30c. In addition, the mobile terminal device 30 is a mobile phone, PHS (Personal Handy-Phone System), PDA (Personal Digital Assistants), or a dedicated terminal. In the present embodiment, the mobile terminal device 30 can use each attendant at various locations (that is, the current location), and receives a video or the like including a mail or a video from the control device 100 via a telephone line (not shown). Is possible.

In the present embodiment, the mobile terminal device 30 is assumed to be used by the smartphone 30a or the tablet 30b, and each individual can use the device at various locations (that is, the current location). One of the portable terminal devices 30 is disposed at a headquarter or a head office (not shown).

The mobile terminal device 30 may include a GPS 40 that captures the position of a store clerk (attender).

<GPS40>
The GPS 40 receives a position information radio wave from a GPS satellite or the like. The GPS 40 calculates the current position information from the information received via the GPS antenna as three parameters of latitude, longitude and altitude, and acquires the position information. The acquired position information is transmitted to the control device 100 in a timely manner.

In this embodiment, an example using GPS satellites as means for acquiring position information has been shown, but a system using a positional relationship with a base station other than GPS may be used. For example, when an Android (registered trademark) smartphone or a high-performance mobile phone with a camera is used as the mobile terminal device 30 that is a mobile terminal, a base station and a mobile phone communication network (not shown) are used instead of or in combination with the GPS 40. It is also possible to send / receive information to / from the mobile phone company server via the mobile phone and acquire the current location information of the terminal from the approach confirmation.

Further, position information acquisition by Wi-Fi positioning, that is, position information acquisition using a Wi-Fi access point and a predetermined position information service may be used.

[Control device 100]
The control device 100 is installed, for example, in a store management room, and centrally manages the product sales floor in the store. The control device 100 may be a general server computer, personal computer, or the like.

The control device 100 includes a control unit 110 (control unit), an input unit 120, a storage unit 130 (profile storage unit), a display unit 140, an output unit 150, a face information database (DB) 160, and image processing. Unit 170, interface (I / F) unit 180, and communication unit 190, and each unit is connected by a bus 195.

The control device 100 monitors whether a VIP, a customer with a large accumulated purchase price (hereinafter referred to as a customer), a Kramer (a customer who has experienced many problems in the past), or a person who is a shoplifting addict appears in the store. To do.

When it is detected that a person who is a shoplifting addict appears in the store, the control device 100 notifies the headquarters, the head office, or the security company system of the person information and the store information through the network.

Hereinafter, when the subject is described as “XX section”, it is assumed that the control section 110 reads each program from the ROM as necessary, loads it into the RAM, and executes each function (described later). Each program may be stored in the storage unit 130 in advance, or may be taken into the control device 100 when necessary via another storage medium or communication medium.

The control unit 110 is configured by a CPU (Central Processing Unit) or the like, and controls the entire control device 100 and executes a control program to function as a digital smart earning / security system. The detailed configuration of the control unit 110 will be described later.

The input unit 120 is an input device for the user of the control device 100 to input instructions and the like, such as a keyboard, a mouse, a touch panel provided on the screen of the display unit 140, or a microphone.

The storage unit 130 stores still images or moving images received from the monitoring camera 11, various data used by the control unit 110, programs, and the like.

The storage unit 130 stores a customer category table 200 (see FIG. 2) (profile storage unit) that stores a customer profile or attribute as a customer category 210 and a customer category / attender correspondence that stores an attendant corresponding to the customer category 210 in association with each other. A table 300 (see FIG. 3) (a part of the control means).

The display unit 140 displays an operation status of the control device 100, an image received from the monitoring camera 11, a GUI (Graphical User Interface) for operating the control device 100, and the like.

The output unit 150 is an audio interface, for example, and outputs an audio signal from the control device 100 to the acoustic system 158 in the store. As an audio signal output from the control device 100 to the acoustic system 158, for example, an audio signal input from an audio input device such as a microphone provided in the input unit 120, or music data stored in the storage unit 130 is used as the control unit 110. May be a reproduced audio signal. The acoustic system 158 includes an amplifier and a plurality of speakers arranged in the store, and broadcasts an audio signal input from the control device 100 into the store.

The face information DB 160 stores face images (face information) of VIPs, customers, kramers, shoplifters, shop staff, and the like.

The image processing unit 170 performs a predetermined process on the received image. Predetermined processing includes contour extraction, image resizing, and resolution conversion processing.

In addition, you may use artificial intelligence (Artificial Intelligence; AI) together as shown in the below-mentioned modification.

The I / F unit 180 connects each monitoring camera 11 and the control device 100 arranged on the product sales floor. Further, the I / F unit 180 connects each RFID reader 20 arranged on the product sales floor, and sends the authentication result of the authentication tag 21 possessed by the attendant in the vicinity of the RFID reader 20 to the control device 100. . The I / F unit 180 is connected to a headquarter, head office, security company, or the like (not shown) via a network or a dedicated line. Basic data such as a person's face registered in the face information DB 160 is obtained from the headquarters, head office, or security company (not shown) via the I / F unit 180, and the face information DB 160 is constructed. In addition, the face information DB can be updated to the latest face image (face information) by exchanging information with the headquarters, the head office or the security company (not shown). The security company is not an essential component of the digital smart earning / security system according to the present embodiment.

The communication unit 190 transmits and receives data to and from the mobile terminal device 30 via the base station. In the present embodiment, the communication unit 190 receives the position information of each mobile terminal device 30 for each fixed period to the mobile terminal device 30 via the base station, and at the time of recognition of VIP, Kramer or shoplifting addict, Send information about Kramer or shoplifting addicts (emails, videos including videos, etc.).

FIG. 2 is a diagram illustrating an example of the customer category table 200.

As shown in FIG. 2, the customer category table 200 stores the profile (or attribute) of the authenticated customer as a customer category 210. The customer category 210 further stores the language spoken by the customer, purchase history, and evaluation by the store clerk. Languages include English, Chinese, and Arabic. The purchase history includes a product name, a purchase price, a purchase date, a cumulative purchase price, and the like. The evaluation by the store clerk is an evaluation of the customer as seen from the store clerk, which is the highest, high, or normal evaluation for the Earning, and the response history (the date of occurrence and the content of the response) for the security.

The customer category 210 is divided into a VIP 211 for earning and a customer 212 (both are excellent customers), a Kramer 213 for security, and a shoplifting addict 214. The VIP 211 and the customer 212 can be registered in duplicate.

FIG. 3 is a diagram showing an example of the customer category / attender correspondence table 300.

The customer category / attender correspondence table 300 is set for each store, floor, and sales floor layout.

3 indicates the correspondence between the customer category 210 and the attender 310. Note that the customer category / attender correspondence table 300 in FIG. 3 schematically shows the correspondence, and in fact, the frequency is set for each customer language in the circles (◎, ○) in FIG. The Languages are abbreviations such as English, Chinese, and Arabic. The frequency is an indicator that the attendee is suitable for the customer. A high power indicates that the customer is a better attendant.

When there are multiple customer categories and attendees, the language is given priority first, followed by the highest frequency.

For example, the circle mark (◎) in FIG. 3 is the frequency 60 (maximum frequency), and the circle mark (◯) in FIG. 3 is the frequency 55 to 59. In the case of FIG. 3, in the English-speaking VIP, attender A is the most suitable attendant, followed by attender B and attender E. If the power of the attender B is 55 and the power of the attender E is 56, the attendees suitable for the customer after the attendant A are the attender E and the attender B, and are attended in this order.

As shown in FIG. 3, the customer category / attender correspondence table 300 stores a corresponding attender 310 for each customer category 210.

The attending person 310 in Erning is an attendant appropriate for the VIP 211 and the customer 212 (see FIG. 2) who are excellent customers. As the attendant 310 in the Erning, in addition to the floor length, the area length, and the department head of the corresponding floor, an attender (sales clerk) suitable for the customer who is particularly excellent in customer service on the corresponding floor or a specific product can be cited. In addition, this attendant may differ for every floor or specific goods. In addition, a plurality of attendants 310 may be set for the customer, but as described above, a more preferable attendant is set to a higher frequency. For example, for VIP, the highest grade attendant A (see ◎ in FIG. 3) who has been trained appropriately for wording, clothes, and dressing is attended. For the VIP, it is preferable to set an attender A (set the frequency high) that can satisfactorily respond to the selfish request of the VIP.

Also, if the customer speaks English, Chinese, Arabic, etc., the store clerk who is fluent in that language is attended.

The attendant 310 in security is an attendant who is good at dealing with Kramer or shoplifting addicts. These attenders (attendants) are attendants B and E (refer to ◎ in FIG. 3) trained appropriately for wording, clothes, and dressing for Kramer or shoplifting addicts. The attendant 310 in security may be attended by a general store clerk, a floor length of the corresponding floor, an area length, or a department head. In this case, the floor length, area length, or department head is the attender.

[Control unit 110]
FIG. 4 is a block diagram of the control unit 110 of the control device 100 of the digital smart earning / security system according to the embodiment of the present invention.

As shown in FIG. 4, the control unit 110 refers to the face authentication function unit 111 and a specific person certifying unit that certifies a VIP, a customer, a claimer, or a shoplifter with reference to the customer category table 200 (see FIG. 2). 112, an attendant 113 (control means) that causes an attendant (salesperson) appropriate for a customer who has been identified with reference to the customer category / attender correspondence table 300 (see FIG. 3), and a position determination for determining the position of the customer and the attendant Unit 114 (position information acquisition means), a layout information storage unit 115 that stores layout information of the product sales floor, an authorized person tracking unit 116 that tracks authorized persons, and VIP, O based on the acquired position information VIP, preferential customer, Kramer or shoplifting preferential to the mobile terminal device 30 closest to the customer, Kramer or shoplifter It comprises a transmission control unit 117 to send the information about the.

The control unit 110 performs face matching based on the face image (face information) stored in the face information DB 160 (see FIG. 1) to authenticate the customer, and looks up the customer category 210 of the authenticated customer from the customer category table 200. Up.

When the collation result by the face authentication function unit 111 is matched, the control unit 110 is based on the position information acquired from the position determination unit 114, and the mobile phone close to the VIP, the customer, the Kramer, or the shoplifter who matched the collation result. The position of the terminal device 30 is determined, and information on the VIP, the customer, the claimer, or the shoplifter is transmitted to the mobile terminal device 30.

The control unit 110 transmits information to the mobile terminal device 30 of the attendant most suitable for VIP, customer, Kramer or shoplifter.

Here, the information on VIP, customer, Kramer or shoplifter includes information obtained by overlapping the position of VIP, customer, Kramer or shoplifter and the position of the attender on the product sales floor. Moreover, the information regarding VIP, a customer, a Kramer, or a shoplifter includes a face image of a VIP, a customer, a Kramer, or a shoplifter on the product sales floor.

<Face authentication function unit 111>
The face authentication function unit 111 performs face authentication to determine whether the face of a person included in the image received from the monitoring camera 11 is a face of a person registered in the face information DB 160. Face authentication can be performed based on the similarity between the face information extracted from the received image and the face information registered in the face information DB 160. Specifically, when the face information includes a template image, the correlation degree between the template images can be obtained.

Also, the face authentication function unit 111 acquires information (face information) representing the characteristics of a human face for use in face authentication from the face area, and associates it with each image in the face information database (DB) 160. sign up. Further, the face authentication function unit 111 receives an image of a person transmitted from a headquarter (not shown) and registers it in the face information DB 160.

In the present embodiment, the face authentication function unit 111 registers the following face information and related information.
・ Registration of VIP ・ Registration of customers with a large amount of purchase amount ・ Registration of Kramer ・ Registration of shoplifter addicts ・ Registration of store-related persons, etc. The face authentication function unit 111 is the face of a person photographed by the surveillance camera 11 The image is collated with the face image of the VIP, the customer, the Kramer, or the shoplifting addict stored in the face information DB 160, and if registered, the person is specified.

<Identified Person Identification Department 112>
The specific person certification unit 112 looks up the customer category 210 of the customer authenticated by the face authentication function unit 111 from the customer category table 200 (see FIG. 2), and authorizes the VIP, the customer, the claimer, or the shoplifter. .

It is also possible to certify suspicious persons who are similar to shoplifters. For example, the following method is used to identify an action suspicious person.
・ Eye contact memory authentication ・ Camera eye check count memory authentication ・ Time action count memory authentication As described above, when a person included in the received image checks the eye of the surveillance camera 11 many times Can be determined to be a suspicious person.

<Attend part 113>
The attendant 113 refers to the customer category / attender correspondence table 300 (see FIG. 3), and causes the attendant (store clerk) appropriate to the customer profile or attribute to attend.

For example, the attendant unit 113 refers to the customer category / attender correspondence table 300 (see FIG. 3), and causes the attendant who is trained appropriately to speak, dress, and dress the VIP. In addition, the attendant 113 causes an attender who has been trained appropriately to speak, dress, and dress for a Kramer or shoplifter.

In addition, if the customer speaks English, Chinese, Arabic, or the like, the attendant 113 causes a store clerk who is fluent in the language to attend.

<Position determination unit 114>
The position determination unit 114 acquires the position information of the plurality of mobile terminal devices 30 in the product sales floor using the GPS position information or the RFID reader 20. Specifically, the position determination unit 114 acquires the position information of the attendant on the product sales floor by authenticating the authentication tag carried by the attendant by the plurality of RFID readers 20 installed on the product sales floor. In this case, the position determination unit 114 determines the position of a person who is recognized as a VIP, a customer, a Kramer, or a shoplifting addict with the installation position of the monitoring camera 11. That is, when the attendant comes close to each RFID reader 20, the position determination unit 114 determines that the attendant is close to the corresponding RFID reader 20 by authentication of each RFID reader 20 of the authentication tag 21 possessed by the attendant. Since the installation position of the RFID reader 20 is registered in advance in the layout information storage unit 115, the position of the attendant can be determined.

Further, the position determination unit 114 acquires position information from the GPS function unit included in the mobile terminal device 30.

<Layout information storage unit 115>
The layout information storage unit 115 registers monitoring layout information in advance from the position of the monitoring camera 11, the installation position of the RFID reader 20, the area name, and the like.

<Authorized person tracking unit 116>
The authorized person tracking unit 116 tracks and detects a person who is recognized as a VIP, a customer, a Kramer, or a shoplifting addict with a plurality of surveillance cameras 11, and confirms a movement history in the product sales floor. The authorized person tracking unit 116 tracks the movement of the product sales floor of the VIP, the customer, the claimant, or the shoplifter, and the VIP, the customer, the claimer, or the shoplifter is moved from the position of the nearest mobile terminal device 30. When it is a predetermined distance away, information on VIP, customer, Kramer or shoplifter is transmitted to the other mobile terminal device 30.

<Transmission control unit 117>
When the collation result by the face authentication function unit 111 is matched, the transmission control unit 117 is based on the position information acquired from the position determination unit 114, and the VIP, the customer, the Kramer, or the shoplifter who matched the collation result is the most. The position of the nearby mobile terminal device 30 is determined, and information on the VIP, the customer, the claimer, or the shoplifter is transmitted to the mobile terminal device 30.

Although details will be described later, the transmission control unit 117 sends the voice, video, and suspicious person's location information (marked on the layout) to the attendant closest to the location of the VIP, customer, Kramer or shoplifter. Etc.) is sent. In the case of a facility with multiple floors, the proximity is determined for each floor. Further, shoplifting addicts are transmitted separately from, for example, red display, and behavior suspicious persons are transmitted from, for example, yellow display.

The transmission control unit 117 selects a second attendant-related person and performs re-transmission when there is no answerback signal even after a predetermined time (for example, 5 seconds) has passed since the transmitted attender. The second attendant is: (1) the second closest attendant, such as VIP, customer, Kramer or shoplifter, (2) security guard, store manager, store manager representative, (3) headquarters or head office is there.

The operation of the digital smart earning / security system configured as described above will be described below.
[registration process]
First, the registration process of various information of the digital smart earning / security system will be described.

FIG. 5 is a flowchart showing a person registration process of the control unit 110 of the control device 100 of the digital smart earning / security system. This flow is executed by the control unit 110 (see FIG. 4) of the control device 100.

In step S1, the face authentication function unit 111 of the control unit 110 registers the faces of VIPs, customers, claimers and shoplifters.

As mentioned above, VIPs are department stores, supermarkets, convenience stores, shopping malls, airports, airplanes, stations, trains, ships, restaurants, underground malls, specialty stores, precious metal dealers, luxury boutiques, complex facilities, offices, theaters. , Halls, schools, hospitals, factories, financial institutions, government offices, hotels, museums, art galleries, stadiums, event venues, new product launch venues, etc. Is a big customer. On the other hand, Kramer is a customer who has experienced many problems in the past. In addition, shoplift addicts also seem to have a large factor due to economic and human traps, even from past cases. Therefore, a person who has shoplifting cases at a company store in the past is registered in advance in the face information DB 160 as a shoplifting addict.

Specifically, the face authentication function unit 111 acquires information (face information) representing the characteristics of a human face to be used for face authentication from the face area, and associates the information with each image with a face information database (DB). ) 160 is registered. In addition, the face authentication function unit 111 receives a person image transmitted from the headquarters (not shown) and registers it in the face information DB 160.

In step S2, the face authentication function unit 111 of the control unit 110 registers a suspicious person. For example, the suspicious behavior is registered using the number of eye contacts and the camera line of sight.

* Those who do shoplifting first see if there is a surveillance camera in an unseen location. A person who is going to shoplift will move his face, eyes, or line of sight more than necessary to check if there is a surveillance camera. Also, before executing shoplifting, check where the target product is, the layout of the sales floor, the situation, where the store clerk (attender), and the security guard are located. For this purpose, a suspicious person is registered as an action suspicious person, such as moving the sales floor more than necessary compared to the shopper, looking around for shoplifting, or not moving for a while.

In step S3, the face authentication function unit 111 of the control unit 110 registers a person who can be known on the control device 100 side (for example, a face of a person concerned such as a store clerk and a guard, and ID tag information).

Next, a description will be given of the table registration update processing of the digital smart earning security system.

FIG. 6 is a flowchart showing a table registration update process of the control unit 110 of the control device 100 of the digital smart earning / security system. This flow is executed by the control unit 110 (see FIG. 4) of the control device 100.

In step S11, the control unit 110 determines whether or not there is a registration update request for the customer category table 200 (for example, when an event occurs or every predetermined period), and if there is a registration update request for the customer category table 200, In step S12, the VIP of the customer category table 200, the customer, the Kramer, and the shoplifter are updated. Thereby, the customer category table 200 in the storage unit 130 is updated to the latest customer category 210.

In step S13, the control unit 110 determines whether or not there is a registration update request for the customer category / attender correspondence table 300 (see FIG. 3) (for example, registration is performed when the floor is designed, update is performed when the attendee is rearranged). If there is a registration update request for the customer category / attender correspondence table 300, the correspondence relationship between the customer category 210 and the attender 310 in the customer category / attender correspondence table 300 is updated in step S14. Thereby, the customer category / attender correspondence table 300 in the storage unit 130 is updated to the latest attender 310.

Next, the registration process of the monitoring area layout of the digital smart earning / security system will be described.

FIG. 7 is a flowchart showing the registration process of the sales floor layout (product sales floor) of the control unit 110 of the control device 100 of the digital smart earning / security system. This flow is executed by the control unit 110 (see FIG. 4) of the control device 100.

In step S21, the layout information storage unit 115 of the control unit 110 registers the arrangement position and sales floor layout (product sales floor) of each monitoring camera.

In step S22, the layout information storage unit 115 of the control unit 110 registers the installation position of each RFID reader 20 and the sales floor layout (product sales floor).

In step S23, the layout information storage unit 115 of the control unit 110 registers main layout information. The main layout information includes, for example, a sales floor entrance, a floor sales floor, and a floor tenant name.

[Attend control of control device 100]
FIG. 8 is a flowchart showing an attend control process of the control device 100 of the digital smart earning / security system. This flow is mainly executed by the control unit 110 (see FIG. 4) of the control device 100.

First, in step S31, the control unit 110 captures the video of the monitoring camera 11.

In step S32, the face authentication function unit 111 of the control unit 110 captures the face image of the person photographed by the monitoring camera 11, the face image of the VIP, the customer, the Kramer, and the shoplifting addict stored in the face information DB 160. Perform face authentication to match.

In step S33, the face authentication function unit 111 of the control unit 110, based on the result of the face authentication in step S32, allows the customer to be one of the VIP, the customer, the claimer, or the shoplifting addict stored in the face information DB 160. If it is a person, specify that person.

In step S34, the specific person certification unit 112 of the control unit 110 looks up the customer category 210 of the customer authenticated by the face authentication function unit 111 from the customer category table 200 (see FIG. 2) and authorizes it.

In step S35, the attending unit 113 of the control unit 110 refers to the customer category / attender correspondence table 300 (see FIG. 3) and causes the attending person to correspond to the customer profile or attribute.

For example, the attendant unit 113 refers to the customer category / attender correspondence table 300 (see FIG. 3), and attender A (see FIG. 3 ◎) trained appropriately for wording, clothes, and dressing for the VIP. ). Also, for Kramer or shoplifter addicts (which may include suspicious behaviours), the attendees B and E (refer to the asterisk in FIG. 3) who are trained appropriately should use words, clothes, and dress.

In step S36, the control unit 110 acquires the position information of the attendant (or the nearby attender) close to the VIP, the customer, the claimer, or the shoplifter from the position determination unit 114.

In step S37, the control unit 110 determines the position of the mobile terminal device 30 closest to the VIP, the customer, the claimer, or the shoplifter based on the acquired position information.

In step S38, the authorized person tracking unit 116 of the control unit 110 tracks the movement of the product sales floor of the VIP, the customer, the claimer, or the shoplifter.

In step S39, the transmission control unit 117 of the control unit 110 closes the position of the VIP, the customer, the Kramer or the shoplifter, and is most suitable for the customer (when there are a plurality of customer categories and attendants corresponding to the customer). Preferentially to the attendant of the combination with high frequency), the information regarding the VIP, the customer, the claimer or the shoplifter is transmitted, and this flow is finished. For example, the transmission control unit 117 transmits voice, a moving image, and customer location information (for example, information marked on the sales floor layout) by e-mail.

Here, even if the attendant (second attendant) next to the attendant most suitable for the customer (second attendant) is closer to the customer than the first attendant, the first attendant is allowed to attend. Send information to one attender. This is because it is important for VIPs to grasp the demands of the wealthy, that the first attendees who are trained appropriately in terms of language, clothes, and grooming are attending. In addition, the first attendant can cope with the selfish request of the VIP well. The same applies to customers.

However, when the first attendant is more than a predetermined distance away from the second attendant (when the first attendee is more than a predetermined distance from the customer), information is sent to cause the second attendant to attend. To do. This is to avoid delays in attendance. In addition, for the Kramer or shoplifter, information on the Kramer or shoplifter is transmitted with priority to the attendant closest to the position of the Kramer or shoplifter rather than selecting an appropriate attendant. In particular, for shoplifters, information about shoplifters is sent to the attendee closest to the position of the shoplifter. This is because shoplifting requires emergency response. In addition, in the case of a shoplifting addict, information related to shoplifting addicts may be transmitted to the mobile terminal device 30 of the headquarters, the head office, or a security company in addition to the response that the attendant attends.

[Application Example 1]
FIG. 9 is a diagram showing VIP or customer information and sales floor layout 400 (commodity sales floor) transmitted to an attender in the Earning. FIG. 9 is a boutique of a department store and a jewelry sales floor, and symbols aaa to mmm in FIG. 9 indicate stores such as women's clothing and jewelry.

(VIP attendant)
As shown in FIG. 9, VIP or customer (in this case VIP) “★ (black star)” and VIP “★ (black star)” and the closest attendant A “◎ (double circle) ) ”(See FIG. 3 ◎) and the attendant B“ ○ (white circle) ”(see FIG. 3 ○) suitable for the customer overlaid on the sales floor layout 400 (product sales floor). It is.

Suppose that the language of VIP “★ (black star)” is English. The attendant A “◎ (double circle)” and the attender B “◯ (white circle)” who are fluent in the language (English) of the VIP “★ (black star)” are the candidate candidates. In other words, the appropriate attendant varies depending on the customer's language.

In the case of FIG. 9, the attendant B “◯ (white circle)” is closer to the VIP “★ (black star)” than the attender A “◎ (double circle)”, but the difference (distance) is less than the predetermined distance. . In this case, the control unit 110 causes the VIP “★ (black star)” to attend to the attender A “◎ (double circle)” most suitable for the customer. Information transmitted to the attender A “「 (double circle) ”includes the history of the VIP, the epoch, the episode, the purchase record, and the like. Attendant A “◎ (double circle)” trained appropriately for wording, clothes, and dressing for VIP (refer to the broken line in FIG. 9) can cope with the selfish demand of VIP. , Can seize the demand of the wealthy.

(Customer attendant)
As shown in FIG. 9, when the customer who visits the store by face recognition recognizes that the customer is “☆ (white star)”, referring to the customer category table 200 (see FIG. 2), the customer “ You can see that the language of “☆ (Hakusei)” is Japanese. From the purchase history of the customer “☆ (white star)”, the attendant C “○ (white circle)” most suitable for the customer “☆ (white star)” is attended (see the chain line in FIG. 9). For the customer “☆ (Hakusei)”, the attendant C “○ (Hakumaru)”, who was trained appropriately in terms of language, clothes, and personality, attended the customer “☆ (Hakusei)”. Can be even more motivated to purchase.

[Application Example 2]
FIG. 10 is a diagram showing information on a Kramer or shoplifter and a sales floor layout 500 (product sales floor) transmitted to an attendant in security. FIG. 10 shows a mall floor. Reference numerals nnn to zzz and aaa to hhhh in FIG. 10 indicate the mall stores.

(Kramer attend)
As shown in FIG. 10A, the crafter “◇ (white square)” and the attender B “◎ (double circle)” (Fig. 3 ◎) that are close to the Kramer “◇ (white square)” and best suited to the customer. Reference) and an attender A “◯ (white circle)” (see FIG. 3 ○) suitable for the claimer is information plotted on the sales floor layout 500 (product sales floor). In the case of FIG. 10A, the attendant A “○ (white circle)” is closer to the Kramer “◇ (white square)” than the attender B “◎ (double circle)”, but the difference (distance) is less than the predetermined distance. is there. In this case, the control unit 110 causes the claimer “◇ (white square)” to attend to the attender B “◎ (double circle)” most suitable for the claim (see the broken line in FIG. 10A). The information transmitted to the attender B “◎ (double circle)” is a case that occurred in the past of the Kramer, a corresponding example, and the like. Attendant A “○ (Shiramaru)” trained appropriately for wording, dressing, and dressing for Kramer can respond to Kramer's demands and calm the situation. .

[Application Example 3]
(Shoplifting addict attend)
As shown in FIG. 10B, the attendant B “◎ (double circle)”, which is close to the shoplifting addict “◆ (black square)” and the shoplifting addict “◆ (black square)” and is most suitable for the customer. 3) and the attendant A “○ (white circle)” (see FIG. 3 ○) suitable for the claimer are information plotted on the sales floor layout 500 (product sales floor). In the case of FIG. 10B, as in the case of FIG. 10A, the attender A “◯ (white circle)” is closer to the shoplifter “♦ (black square)” than the attender B “◎ (double circle)”. In this case, the control unit 110 causes the shoplift addict “♦ (black square)” to attend to the attender A “◯ (white circle)” closest to the shoplift addict. The attendant A “○ (white circle)” closest to the shoplifter “◆ (black square)” can promptly take appropriate measures in advance to prevent shoplifting damage.

Here, the information transmitted to the attendant A “○ (white circle)” is information on shoplifting addicts (position information, captured images, face images, cases that occurred in the past, and corresponding examples). Moreover, you may transmit the audio | voice and moving image regarding a shoplifting addict. By transmitting audio and moving images together with images, it is possible to know information that cannot be expressed only by images, and the attendee can take more appropriate actions. The attendant A “○ (white circle)” who trained the shoplifting addict “◆ (black square)” with words, clothes, and dressing appropriately attends the crime prevention effect.

The control device 100 transmits the shoplifter's information to the closest attendee in real time together with the mail, video, and sales floor layout, and then, as necessary, not only the attendant but also the nearby entrance and sales floor corner. The same number of floors or guards may be simultaneously transmitted to the store manager.

Further, the control device 100 may transmit more detailed information to the nearest attendant. More detailed information includes, for example, information on the floor name, sales floor name, and corner name layout map, where the position information of shoplifters and attendants is superimposed, and information that expands the “face” of shoplifters. . This has the effect of preventing omission of monitoring and misidentification.

A building that can receive GPS radio waves uses the GPS function to obtain the position information of the attendant. In a building or sales floor where GPS radio waves cannot be received, the position information of the attendant is obtained by the RFID reader 20.

It is preferable to install a plurality of surveillance cameras 11 in the aisle or the like where the sales floor entrance / exit, shoplifting damage location, and employee perspective are weak.

The control device 100 stores in advance the position information by the monitoring camera 11 and the range in which the monitoring camera 11 can authenticate the corresponding floor number, sales floor, floor, doorway, search target recognizer, shoplifter. For example, the control device 100 stores a floor name, a sales floor name, a corner name, and a sales floor layout. The attendant may rush to the location of the VIP, customer, Kramer or shoplifter.

The Digital Smart Earning / Security System 1000 is a large-scale commercial facility with 3 to 4 floors, an area of about 50m x 200m per floor, a convenience store, a commercial facility by each mall, a store with a terminal, a complex building hospital, etc. It can also be used for hotels, cultural facilities, etc.

As described above in detail, according to the present embodiment, the digital smart earning security system 1000 (see FIG. 1) stores the customer category table that stores the profile or attribute of the customer who visits the store as the customer category 210. 200 and a storage unit 130 that stores a customer category / attender correspondence table 300 that stores an associate suitable for the customer category 210 in association with each other. The control unit 110 refers to a customer category table 200 (see FIG. 2), a specific person certification unit 112 that authorizes a VIP, a customer, a claimer, or a shoplifter, and a customer category / attender correspondence table 300 (see FIG. 3). ), An attendant 113 corresponding to an attendant suitable for the customer who has been certified with reference to the customer, a position determination unit 114 that acquires position information of a plurality of mobile terminal devices 30 in the product sales floor, and the determined attendant's carrying A transmission control unit 117 that transmits information about the customer to the terminal device 30.

Referring to the customer category / attender correspondence table 300, the attendant 113 causes the attendant who is trained appropriately to speak, dress, and dress appropriately for the customer. In addition, if the customer speaks English, Chinese, Arabic, or the like, the attendant 113 causes a salesclerk who is fluent in the language to attend. The control unit 110 transmits information to the mobile terminal device 30 of the attendant most suitable for the customer. The control part 110 transmits information to the portable terminal device 30 of the attendant close to the customer.

With this configuration, attendees who are trained appropriately to speak, dress, and dress for VIPs or customers can increase sales and seize the demand of wealthy people. it can. In order for department stores to survive, it is important to seize the demand of the wealthy, so the system will be able to respond to it.

On the contrary, for the Kramer, the clerk trained appropriately for the wording, clothes, and dressing is attended, so the demands of the Kramer can be handled well and the situation can be calmed down. For shoplifters, wording, clothing, and personal care are also attended by trained clerk who are trained appropriately, so the crime prevention effect can be enhanced. Also, nearby attendants can rush to the site in real time, and shoplifting can be prevented.

As a result, the digital smart earning / security system 1000 can be effective for both the sales improvement by earning and the security prevention by security.

[Modification]
In this embodiment, the customer is authenticated by performing face matching based on the face image (face information) accumulated in the face information DB 160 (see FIG. 1), but the customer may be authenticated in any way. For example, when a customer carries a mobile terminal device, the mobile terminal device carried by the customer can establish a Wi-Fi connection by installing Wi-Fi (Wireless Fidelity) equipment in the store. Since the mobile terminal device can be identified, the customer can be authenticated. Similarly, since the mobile terminal device can be identified by the iBeacon (registered trademark) facility, the customer carrying the mobile terminal device can be authenticated. When authenticating a customer using these portable terminal devices, the position of the portable terminal device can be detected by the response of the radio wave from the portable terminal device, so that the customer carrying the portable terminal device The position can be detected, and as a result, it is possible to detect the movement situation of the customer and the area in the store where the customer is concentrated. Therefore, it is possible to use this information for the attendant of the customer by the attendant. .

In addition, the customer's movement concentration situation continues, the customer stops at a specific sales corner, display case, etc., moves, or looks for a store clerk, etc. The number of actions exceeds a predetermined number of times within a unit time By detecting this through authentication using a monitoring camera image, it is possible to detect an area in which the behavior of the customer in the store appears, so that this information can also be used for attending the customer by the attendant.

In addition, the digital smart-earning / security system 1000 uses a technique such as statistical analysis based on accumulated data, pattern recognition, machine learning, or artificial intelligence (AI) to lurk in the data. A mode of performing analysis / evaluation using a data processing technique (generally called data mining) for digging out valuable information or knowledge and predicting demand may be used.

When the artificial intelligence (AI) is applied to the digital smart earning / security system 1000, there are the following configurations. The control unit 110 of the control device 100 illustrated in FIG. 1 includes an information analysis unit that captures a face image (face information), performs preprocessing as necessary, performs data conversion, and performs data mining. This information analysis unit performs analysis on items that are causal with purchasing or crime prevention, such as clothes and dressing. When such analysis is performed, various algorithms such as machine learning for data mining can be used by using open source, commercially available data analysis software, and software dedicated to data mining.

And this digital smart earning security system 1000 predicts the future behavior of the customer, and predicts the location where purchase etc. are expected. In this way, when the customer can be predicted to be a wealthy person, a Kramer, or a shoplifting addict, information is transmitted to the mobile terminal device 30 possessed by an attendant suitable for the customer. When artificial intelligence (AI) is applied, it is possible to make an attendant attend from an inference to a customer who is not stored in the face information DB 160 (see FIG. 1).

The above description is an illustration of a preferred embodiment of the present invention, and the scope of the present invention is not limited to this. For example, in this embodiment, a case where a telephone line is used as a public line has been described, but a wireless communication line, the Internet, a LAN, or the like may be used as a public line. When the public line is the Internet or a LAN, a personal computer or a smartphone may be used as the communication terminal device. In this way, by constructing a digital smart-earning / security system using an existing public line, the use of the digital smart-earning / security system can be expanded and the digital smart-earning / security system can be expanded. Construction cost can be reduced.

Also, in the present embodiment, the name “Digital Smart Earning / Security System and Method” is used, but this is for convenience of explanation, and it may be an Earning / Security System, a Sales System, a Security Method, or the like.

The digital smart earning security system and method of the present invention can also be realized by a program for causing a computer to function as the digital smart earning security system or method. This program may be stored in a computer-readable recording medium.

The recording medium on which this program is recorded may be the ROM itself of this digital smart learning security system, or a program reading device such as a CD-ROM drive is provided as an external storage device, and the recording medium is provided there. It may be a CD-ROM or the like that can be read by inserting.

Further, the recording medium may be a magnetic tape, a flexible disk, a hard disk, an MO / MD / DVD, or a semiconductor memory.

The digital smart-earning / security system, method, and program according to the present invention can be used in real-time in corporations / commercial facilities and the like, and the use effect is great from both the earning and security.

DESCRIPTION OF SYMBOLS 11 Surveillance camera 20 RFID reader 21 Authentication tag 30 Portable terminal device 40 GPS
100 control device 110 control unit (control means)
111 Face authentication function part 112 Specific person recognition part 113 Attend part (control means)
114 Position determination unit (position information acquisition means)
115 layout information storage unit 116 authorized person tracking unit 117 transmission control unit 120 input unit 130 storage unit 140 display unit 150 output unit 160 face information database (DB)
170 Image processing unit 180 Interface (I / F) unit 190 Communication unit 200 Customer category table (profile storage means)
211 VIP
212 Customer 213 Kramer 214 Shoplifter 300 Customer category / attender correspondence table (part of control means)
400,500 Sales floor layout (product sales floor)
1000 Digital Smart Earning Security System

Claims

Profile storage means for storing customer profiles for each customer;
An authentication means for authenticating customers coming to the store;
Based on the profile stored in the profile storage means of the customer authenticated by the authentication means, an attendant suitable for the customer is determined, and information related to the customer is transmitted to the portable terminal device carried by the determined attendant. And a digital smart-earning security system.
The digital smart earning / security system according to claim 1, wherein the profile includes two or more of VIP, customer, Kramer and shoplifting addict.
3. The digital smart-earning / security system according to claim 1, wherein the profile includes a language spoken by a customer.
Position information acquisition means for acquiring the position information of each mobile terminal device carried by the attendant in the store,
4. The digital smart-earning / security system according to claim 1, wherein the control means determines an attendant suitable for the customer based on a distance between the customer and the portable terminal device.
A profile storage step for storing customer profiles for each customer;
An authentication step for authenticating customers coming to the store;
Based on the profile stored in the profile storing step of the customer authenticated in the authentication step, an attendant suitable for the customer is determined, and information related to the customer is transmitted to the mobile terminal device carried by the determined attender. A digital smart-earning security method.
Computer
Based on the profile storage means for storing the customer profile for each customer, the authentication means for authenticating the customer visiting the store, and the profile stored in the profile storage means of the customer authenticated by the authentication means, A program for determining a suitable attendant for the customer and causing the mobile terminal device carried by the determined attendant to function as a digital smart earning / security system comprising control means for transmitting information related to the customer.