WO2023127122A1

WO2023127122A1 - Shop assistance device, system, and method, and computer-readable medium

Info

Publication number: WO2023127122A1
Application number: PCT/JP2021/048862
Authority: WO
Inventors: 健吾秋元
Original assignee: 日本電気株式会社
Priority date: 2021-12-28
Filing date: 2021-12-28
Publication date: 2023-07-06

Abstract

A shop assistance device (1) comprises: an acquisition unit (11) that acquires an image obtained by photographing a first visitor by a camera installed in a commercial facility; a first determination unit (12) that refers to a first database that registers in advance biometric information for a member of a shop in the commercial facility to determine whether first biometric authentication for first biometric information extracted from the acquired image has succeeded or failed; an extraction unit (13) that extracts object information relating to a worn object from the region of the first visitor if the first biometric authentication is determined to have failed; a second determination unit (14) that refers to a second database associating a product with a shop selling the product to determine, on the basis of the object information, whether the object has a predetermined or higher level of relevance to the product in terms of luxuriousness, and determines that the first visitor is a candidate visitor to be served if the object is determined to have a predetermined or higher level of relevance; and a notification unit (15) that issues notification information based on the object information to a first terminal of a related person in the commercial facility if the first visitor is determined to be a candidate visitor to be served.

Description

STORE SUPPORT DEVICE, SYSTEM AND METHOD, AND COMPUTER-READABLE MEDIUM

The present invention relates to a store support device, system, method, and program, and more particularly to a store support device, system, method, and program for supporting a store by notifying the store of visitor information.

In stores, so-called CRM (Customer Relationship Management) is sometimes used to serve each customer appropriately. CRM is an information system that records and analyzes customer service information, including purchase histories, for customers identified by names, membership numbers, and the like.

Further, in Japanese Patent Laid-Open No. 2005-100001, a photographed image of a visitor is analyzed to generate belongings-related information, and when it is determined that it is necessary to provide a service suitable for the customer based on the belongings-related information, customer identification information is generated. A technique for outputting is disclosed.

JP 2021-105945 A

Here, the above-mentioned CRM provides services, etc. to customers registered in advance in the customer database. However, it can also be said that it is beneficial for the store to find customers other than registered customers who are candidates for customer service and appropriately serve them.

In view of the above-mentioned problems, the purpose of the present disclosure is to provide a store support device, system, method, and program for detecting candidates for customer service from among visitors and supporting acquisition of new customers at actual stores. to provide.

A store support device according to a first aspect of the present disclosure includes:
Acquisition means for acquiring an image of the first visitor captured by a camera installed in the commercial facility;
Referring to a first database in which biometric information is pre-registered as a member of a store in the commercial facility, for the first biometric information extracted from the area of the first visitor in the acquired image a first determination means for determining success or failure of the first biometric authentication;
extracting means for extracting wearable item information about wearable items from the area of the first store visitor when it is determined that the first biometric authentication has failed;
Referring to a second database that associates the product with the store that handles the product, and based on the attachment information, it is determined whether or not the attachment and the product are related to each other at a predetermined level or higher. a second determination means for determining the first store visitor as a customer service candidate store visitor when it is determined that there is the relevance;
notification means for notifying a first terminal of a person concerned in the commercial facility of notification information based on the attachment information when the first store visitor is determined to be a customer service candidate store visitor;
Prepare.

A store support system according to a second aspect of the present disclosure includes:
A camera installed in a commercial facility,
a first terminal of a party in the commercial facility;
a first database in which biometric information is registered in advance as a member of a store in the commercial facility;
a second database that associates a product with a store that handles the product;
a store support device connected to the camera, the first terminal, the first database, and the second database;
with
The store support device is
Acquisition means for acquiring an image of the first visitor captured by the camera;
A first determining whether the first biometric authentication for the first biometric information extracted from the area of the first visitor in the acquired image is successful or unsuccessful by referring to the first database. a determination means for
extracting means for extracting wearable item information about wearable items from the area of the first store visitor when it is determined that the first biometric authentication has failed;
If the second database is referenced and based on the attached item information, it is determined whether or not the attached item and the product have a high-grade level equal to or higher than a predetermined level, and it is determined that the associated item is present. a second determination means for determining the first store visitor as a customer service candidate store visitor;
notification means for notifying the first terminal of notification information based on the attachment information when the first store visitor is determined to be a customer service candidate store visitor;
Prepare.

A store support method according to a third aspect of the present disclosure includes:
the computer
Acquiring an image of the first visitor taken by a camera installed in the commercial facility,
Referring to a first database in which biometric information is pre-registered as a member of a store in the commercial facility, for the first biometric information extracted from the area of the first visitor in the acquired image determining success or failure for the first biometric;
when it is determined that the first biometric authentication has failed, extracting wearable item information about the wearable item from the region of the first visitor;
Referring to a second database that associates products with shops that carry the products, and based on the information on the accessories, it is determined whether the accessories and the product have a relationship of a level of luxury equal to or higher than a predetermined level. and determining that the first store visitor is a customer service candidate store visitor when it is determined that there is the relevance,
When the first store visitor is determined to be a customer service candidate store visitor, notification information based on the attachment information is sent to the first terminal of the person concerned in the commercial facility.

A store support program stored in a non-transitory computer-readable medium according to the fourth aspect of the present disclosure,
Acquisition processing for acquiring an image of the first visitor captured by a camera installed in the commercial facility;
Referring to a first database in which biometric information is pre-registered as a member of a store in the commercial facility, for the first biometric information extracted from the area of the first visitor in the acquired image A first determination process for determining whether the first biometric authentication is successful or unsuccessful;
an extraction process for extracting wearable item information about wearable items from the area of the first store visitor when it is determined that the first biometric authentication has failed;
Referring to a second database that associates products with shops that carry the products, and based on the information on the accessories, it is determined whether the accessories and the product have a relationship of a level of luxury equal to or higher than a predetermined level. and a second determination process of determining the first store visitor as a customer service candidate store visitor when it is determined that there is the relevance;
a notification process of notifying a first terminal of a person concerned in the commercial facility with notification information based on the attachment information when the first store visitor is determined to be a customer service candidate store visitor;
run on the computer.

According to the present disclosure, it is possible to provide a store support device, system, method, and program for detecting customer service candidates from among visitors and assisting acquisition of new customers at actual stores.

1 is a block diagram showing the configuration of a store support device according to the first embodiment; FIG. 4 is a flow chart showing the flow of the store support method according to the first embodiment; FIG. 11 is a block diagram showing the overall configuration of a store support system according to a second embodiment; FIG. FIG. 11 is a block diagram showing the configuration of a store support device according to a second embodiment; FIG. 13 is a flowchart showing the flow of store support processing according to the second embodiment; FIG. 12 is a flow chart showing the flow of store support processing according to the third embodiment; FIG. FIG. 12 is a block diagram showing the overall configuration of a store support system according to Embodiment 4; FIG. 16 is a flow chart showing the flow of store support processing according to the fourth embodiment; FIG. FIG. 11 is a block diagram showing the overall configuration of a store support system according to a fifth embodiment;

Below, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same reference numerals are given to the same or corresponding elements, and redundant description will be omitted as necessary for clarity of description.

<Embodiment 1>
FIG. 1 is a block diagram showing the configuration of a store support device 1 according to the first embodiment. The store support device 1 is an information processing device for supporting sales promotion and the like at a predetermined store in a commercial facility including one or more stores. The store support device 1 is connected to a first database (not shown) and a second database (not shown).

The first database is a database system in which biometric information is registered in advance as members of stores in commercial facilities. Here, biometric information is feature information indicating physical features extracted from an image of at least a part of a person's body. The biometric information is, for example, facial feature information, but is not limited to this. For example, the first database may be a first storage device in which member identification information and biometric information are stored in association with each other. Also, the first storage device may be built in the store support device 1 or may be in a database server connected to the store support device 1 via a communication network.

The second database is a database system that associates products with stores that carry them. Moreover, the store includes at least a store in the commercial facility. Therefore, the stores registered in the second database are at least open in the commercial facilities, and may include stores in which the member's biometric information is not registered in the first database. Also, for example, the second database may be a second storage device that stores products and stores in association with each other. The second storage device may be built in the store support device 1 or may be in a database server connected to the store support device 1 via a communication network.

The store support device 1 includes an acquisition unit 11 , a first determination unit 12 , an extraction unit 13 , a second determination unit 14 and a notification unit 15 . Acquisition unit 11 acquires an image of the first visitor captured by a camera (not shown) installed in the commercial facility. The first determination unit 12 refers to the first database to determine whether the first biometric authentication for the first biometric information extracted from the area of the first visitor in the acquired image is successful or unsuccessful. judge. Biometric information of members of the first shop in the commercial facility is registered in advance in the first database. Therefore, if the first biometric authentication is successful, it indicates that the first visitor is a member of the first store, and if the first biometric authentication fails, the first visitor is a non-member of the first store. Indicates that you are a member (a non-registered member). Therefore, it can also be said that the first determination unit 12 determines whether or not the first visitor is a member of the predetermined store based on the first biometric authentication. The first biometric information is biometric information extracted from the body region of the first visitor in the acquired image by image recognition or the like.

When it is determined that the first biometric authentication has failed, i.e., when it is determined that the first visitor is not a member, the extraction unit 13 extracts a Extract equipment information. For example, the extracting unit 13 estimates the attachment worn by the first visitor by image recognition or the like. Here, the wearable item is an item worn by the first visitor, and may also be referred to as a personal item. Examples of accessories include, but are not limited to, bags, accessories (accessories, rings, necklaces, earrings, etc.), watches, glasses, sunglasses, shoes, clothes (coats, outerwear, pants, skirts, etc.). . The attachment information is information indicating an image of an area recognized as an attachment in the image, the type of attachment, brand name, product name, color, pattern, logo, material, shape, and the like.

The second determination unit 14 refers to the second database, and based on the attachment information, determines whether or not there is a relationship between the attachment and the product with a degree of luxury equal to or higher than a predetermined level. If determined, the first store visitor is determined to be a customer service candidate store visitor. Here, the relevance between the wearable item and the product may be, for example, a commonality of attributes between the wearable item and the product, or a certain degree of similarity in terms of product characteristics. For example, the fact that the wearable item and the product are related may mean that the wearable item of the first visitor is the same or similar product or product type as the product handled at the store in the commercial facility. Alternatively, the fact that the wearable item and the product are related may mean that the wearable item and the product are of the same or similar brand even if the product types are different. In addition, that the attachment item and the product have a high-grade relationship of a predetermined level or higher means that the attachment item and the product are common or similar in that they are luxury items or brands of a certain level or higher. Here, the degree of luxury is an index value corresponding to the brand, price, etc. of the product, such as a numerical value, a class or rank (such as a symbol), a level value, or information in which these are combined. For example, when there is a high-grade relationship of a predetermined level or higher between the wearable item and the product, it may be assumed that the wearable item and the product are clothes of a high-grade level of a predetermined level or higher. Therefore, if there is a certain relationship between the wearable item indicated by the wearable item information and the product registered in the second database, the first visitor will have a certain attribute of the product handled at the store in the commercial facility. It can be said that there is a high possibility that they are wearing accessories that have commonalities or similarities. Therefore, it can be said that the first store visitor is highly likely to be interested in products related to the wearable item. Also, at this point in time, it has been determined that the first visitor is not a member of the store within the commercial facility. Therefore, in these cases, the second determination unit 14 can determine that the first store visitor is a customer service candidate store visitor.

When the first visitor is determined to be a customer service candidate visitor, the notification unit 15 notifies the first terminal of the person concerned in the commercial facility of the notification information based on the wearable item information. Here, the parties concerned in the commercial facility are, for example, shop clerks in the commercial facility, staff members of the entire commercial facility, or the like. The staff of the entire commercial facility refers to persons other than the staff of a specific store, such as the staff of the service counter of the commercial facility and the concierge of the entire commercial facility. The first terminal is an information terminal worn or carried by a person concerned in the commercial facility, or a computer device connected to a screen visible to the person concerned.

FIG. 2 is a flow chart showing the flow of the store support method according to the first embodiment. First, the acquiring unit 11 acquires an image of the first visitor captured by a camera installed in the commercial facility (S11). Next, the first determination unit 12 refers to the first database, and performs the first biometric authentication for the first biometric information extracted from the area of the first visitor in the image acquired in step S11. (S12). For example, the first determination unit 12 identifies the face region of the first visitor by image recognition or the like from the acquired image, and extracts facial feature information from the identified face region as first biometric information. . Alternatively, the first determination unit 12 acquires the first biological information extracted from the image by another configuration (not shown). Then, the first determination unit 12 compares the first biometric information with one or more biometric information registered in advance in the first database, and calculates the degree of matching, thereby performing the first biometric authentication. conduct.

Then, the first determination unit 12 determines whether the first biometric authentication has succeeded or failed (S13). Specifically, the first determination unit 12 compares the first biometric information with the biometric information registered in the first database, calculates the degree of matching, and determines whether or not the degree of matching is equal to or greater than a predetermined value. judge. When determining that the degree of matching is equal to or greater than the predetermined value, the first determining unit 12 determines that the first biometric authentication has succeeded. In that case, the processing of the store support method according to the first embodiment ends. On the other hand, when determining that the degree of matching is less than the predetermined value, the first determination unit 12 determines that the first biometric authentication has failed. In other words, it can be said that the first determination unit 12 determines whether or not the first visitor is a member based on the authentication result of the first biometric authentication. Then, when the authentication result indicates success, the first determination unit 12 determines that the first visitor is a member. On the other hand, when the authentication result indicates failure, the first determination unit 12 determines that the first visitor is a non-member, that is, an unregistered person in the first database.

Alternatively, the first determination unit 12 transmits an authentication request including the first biometric information to the first database, and receives the authentication result of the authentication processing performed in the first database. In that case, the first determination unit 12 may determine whether the first biometric authentication is successful or unsuccessful, and whether the first visitor is a member, based on the received authentication result.

If the first biometric authentication fails (NO in step S13), that is, if it is determined that the first visitor is not a member, the extraction unit 13 extracts the wearable item from the area of the first visitor in the image. (S14). Then, the second determination unit 14 refers to the second database and determines whether or not there is a relationship between the attachment item and the product based on the attachment item information (S15). If there is a relationship between the wearable item and the product, it means that the first visitor is determined to be a customer service candidate visitor. On the other hand, if there is no relationship between the wearable item and the product, it is determined that the first visitor is not a customer service candidate visitor.

If it is determined in step S15 that there is a relationship between the attachment item and the product, the notification unit 15 notifies the first terminal of the person concerned in the commercial facility of notification information based on the attachment item information (S16). After that, the processing of the store support method according to the first embodiment ends. If it is determined in step S15 that there is no relationship between the attachment item and the product, the processing of the store support method according to the first embodiment is terminated.

As described above, the store support device 1 according to the present embodiment analyzes images captured by cameras installed in a commercial facility including one or more stores, extracts the first biometric information, and extracts the first database. , it can be determined that the first visitor is a non-member of the store within the commercial facility. Then, the store support device 1 extracts the wearable item information of the first visitor who is a non-member from the photographed image, refers to the second database, and refers to the wearable item indicated by the wearable item information and the product. If there is a relationship, it can be determined that the first store visitor is a customer service candidate store visitor. Here, the certain degree of relevance may be, as described above, higher than a predetermined level. Then, when the first visitor is a non-member of the store in the commercial facility and a customer candidate visitor, the store support device 1 notifies the terminals of the parties concerned in the commercial facility to that effect. Therefore, the related parties such as the store clerk can easily recognize visually that the first visitor has entered the store by being notified based on the information of the items worn by the customer candidate visitor. It becomes easier to perform appropriate customer service. Therefore, candidates for customer service can be appropriately detected from among visitors, and acquisition of new customers at the actual store can be supported.

The store support device 1 includes a processor, memory, and storage device (not shown). Further, the storage device stores a computer program in which the processing of the store support method according to the present embodiment is implemented. Then, the processor loads a computer program or the like from the storage device into the memory and executes the computer program. Thereby, the processor implements the functions of the acquisition unit 11 , the first determination unit 12 , the extraction unit 13 , the second determination unit 14 and the notification unit 15 .

Alternatively, each component of the store support device 1 may be realized by dedicated hardware. Also, part or all of each component of each device may be implemented by general-purpose or dedicated circuitry, processors, etc., or combinations thereof. These may be composed of a single chip, or may be composed of multiple chips connected via a bus. A part or all of each component of each device may be implemented by a combination of the above-described circuits and the like and programs. As a processor, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a quantum processor (quantum computer control chip), or the like can be used.

<Embodiment 2>
The second embodiment is a specific example of the first embodiment described above. FIG. 3 is a block diagram showing the overall configuration of the store support system 1000 according to the second embodiment. The store support system 1000 is an information system for supporting each store in a commercial facility 100 including stores 110, . Specifically, the store support system 1000 photographs the first visitor C1 with a camera 101 installed near the entrance/exit of the commercial facility 100, and determines whether the first visitor C1 is the store 110 or the like based on the analysis result of the photographed image. It is determined whether or not the visitor is one of the customer service candidate customers. When the first visitor C1 is determined to be a customer service candidate visitor, the store support system 1000 sends information about the physical characteristics of the visitor to the terminal of the store clerk who handles the brand information of the first visitor C1. and equipment information.

The store support system 1000 includes a camera 101, a store clerk terminal 111, . 1n1, store support device 200, and facility management server 300 are connected via network N so as to be able to communicate with each other. Here, the network N is a wired or wireless communication line or communication network, such as an in-store LAN (Local Area Network), the Internet, a wireless communication network, a mobile phone network, or the like. The network N does not care about the type of communication protocol.

The camera 101 is installed near the entrance of the commercial facility 100 as a whole. The camera 101 photographs a predetermined photographing range near the entrance at predetermined intervals or when a human sensor detects a person. The camera 101 transmits the photographed image to the store support device 200 via the network N. FIG. For example, when the first visitor C1 visits the commercial facility 100 and is near the entrance, the first visitor C1 is detected by the human sensor. Therefore, the camera 101 captures an image including the first visitor C1. A plurality of cameras may be installed in the commercial facility 100 . Also, the camera 101 may be installed at a location other than the entrance/exit of the entire commercial facility 100 .

Stores 110 to 1n0 are tenant stores that operate in the commercial facility 100. For example, store 110 has at least salesclerk S1. The store clerk S1 serves customers who have entered the store 110 . Store clerk S1 is equipped with a store clerk terminal 111 for business use. The store clerk terminal 111 is an example of a wearable terminal, and is, for example, a headset compatible with wireless communication. The store clerk terminal 111 communicates with the store support device 200 and the facility management server 300 via the network N using a built-in computer and a wireless communication function. For example, the store clerk terminal 111 receives notification information of a visitor from the store support device 200 or the like via the network N, reproduces voice corresponding to the notification information, and outputs the voice from a speaker.

In addition, at least store clerk Sn is in store 1n0. The store clerk Sn serves customers who have entered the store 1n0. Store clerk Sn carries a store clerk terminal 1n1 for business use. The store clerk terminal 1n1 is an example of a portable terminal, such as a smartphone (compatible with wireless communication) or a tablet terminal. The store clerk terminal 1n1 communicates with the store support device 200 and the facility management server 300 via the network N using a built-in computer and a wireless communication function. For example, the store clerk terminal 1n1 receives notification information of a visitor from the store support device 200 or the like via the network N, performs an incoming call notification operation (for example, a vibration operation or an application pop-up display) according to the notification information, A message or the like corresponding to the notification information is displayed on the screen.

The store clerks S1 to Sn are an example of the above-mentioned people involved in the commercial facility. Also, the store clerk terminals 111 to 1n1 are an example of the above-described first terminal. Therefore, the clerk terminal may be a computer and a display device installed in the store. Also, the people involved in the commercial facility 100 may be staff at locations other than the store 110, such as the information center of the commercial facility 100, for example. In that case, the first terminal may be a computer and display device located at the information center.

The facility management server 300 is a computer server that manages various information about the commercial facility 100. The facility management server 300 includes at least a member DB (DataBase) 310 and a product DB 320 . The facility management server 300 receives access to the member DB 310 and the product DB 320 from the store support device 200 and the like via the network N, performs processing corresponding to the access to the member DB 310 and the like, and transmits the processing result via the network N. A reply is sent to the store support device 200 or the like. For example, when the facility management server 300 receives a face authentication request including face information from the store support device 200, the facility management server 300 compares the received face information with the face information 312 in the member DB 310, and outputs the matching result (face authentication result). A reply is sent to the store support device 200 . Here, the face recognition result includes information indicating success or failure of face recognition. In addition, when face authentication indicates success, the face authentication result includes member information (at least information for uniquely identifying a user (member), such as a member ID) that has succeeded in face authentication. Further, when the facility management server 300 receives attachment item information from the store support device 200 , the facility management server 300 collates the item information included in the attachment item information with the item information 321 in the item DB 320 . The facility management server 300 returns a set of the product information 321 and the store information 322 to the store support device 200 when the degree of matching between the product information 321 and the received product information is equal to or greater than a threshold. Alternatively, if the degree of matching between the product information 321 including the advanced degree 3211 of a predetermined level or higher and the received product information is equal to or higher than a threshold, the facility management server 300 sends the set of the product information 321 and the store information 322 to the store support device 200. You can reply to Other configurations of the facility management server 300 can be realized by known techniques.

The member DB 310 is an example of the first database mentioned above. The member DB 310 is a database that manages member information 311, face information 312, and shop information 313 in association with each other. The member information 311 is information for managing members registered as customers of at least one of the stores 110 and the like. The member information 311 may be member information of the entire commercial facility 100 . The member information 311 includes a member ID, personal information such as name, gender, date of birth, purchase history, and the like.

The face information 312 is an example of the biometric information described above, and is the member's face feature information. For example, the face information 312 is a set of feature point positions and feature amounts extracted from the member's face image. The store information 313 is information that can identify a store registered as a member, such as store identification information and a store ID. The store information 313 typically corresponds to any of the stores 110 and the like in the commercial facility 100 .

The face information 312 does not have to be managed by the facility management server 300. For example, it is assumed that there is an authentication device outside the facility management server 300 that manages facial information and user IDs in association with each other, and that the authentication device is connected to the network N. FIG. In that case, the member DB 310 may have a unique correspondence between the member ID of the member information 311 and the user ID. Also, the member information 311 and face information 312 are registered in the member DB 310, but are pre-approved by the member (customer).

The product DB 320 is an example of the second database described above. The product DB 320 is a database that manages product information 321 and store information 322 in association with each other. The product information 321 includes product ID, product name, product type, brand name, price, product image, color, pattern, logo, material, shape, and the like. The product information 321 further includes a grade level 3211 . The degree of luxury 3211 is an example of an index value corresponding to the brand, price, etc. of the product corresponding to the product information 321 . The grade 3211 is, for example, a numerical value, a class or rank (such as a symbol), a level value, or information combining these. It is assumed that the commodity DB 320 manages commodity information 321 having at least a level of luxury 3211 equal to or higher than a predetermined level.

The store information 322 is information that specifies any of the stores 110 and the like in the commercial facility 100 that handle the product corresponding to the product information 321. That is, the store information 322 is information indicating the store that sells the product corresponding to the product information 321 . Therefore, one store information 322 may be associated with two or more product information 321 . Moreover, two or more store information 322 may be associated with the same product information 321 . Store information 322 is information corresponding to store information 313 described above. The store information 322 includes, for example, store ID, store name, store location, and the like. Store information 322 further includes salesclerk terminal information 3221 . The store clerk terminal information 3221 is information about a first terminal that can be worn, carried, or visually recognized by a store clerk going to work at the store corresponding to the store information 322, and includes at least destination information that can be accessed via the network N. .

The store support device 200 is an example of the store support device 1 described above. The store support device 200 is an information processing device connected to the camera 101, the store clerk terminals 111 to 1n1, the member DB 310, and the product DB 320 via the network N. FIG. When the first visitor C1 who has visited the commercial facility 100 is determined to be a customer service candidate visitor, the store support device 200 provides the store clerk terminal 111, etc. of the store 110, etc. related to the attachment information of the first visitor C1. , the physical characteristics and wearable item information of the first visitor C1 are notified. The store support device 200 may be made redundant by a plurality of servers, and each functional block may be realized by a plurality of computers.

FIG. 4 is a block diagram showing the configuration of the store support device 200 according to the second embodiment. Store support device 200 includes storage unit 210 , memory 220 , communication unit 230 and control unit 240 . The storage unit 210 is an example of a storage device such as a hard disk or flash memory. Storage unit 210 stores program 211 . The program 211 is a computer program in which store support processing and the like according to the second embodiment are implemented.

The memory 220 is a volatile storage device such as RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 240 operates. The communication unit 230 is a communication interface with the network N. FIG.

The control unit 240 is a processor that controls each component of the store support device 200, that is, a control device. The control unit 240 loads the program 211 from the storage unit 210 into the memory 220 and executes the program 211 . Thereby, the control unit 240 realizes the functions of the acquisition unit 241 , the extraction unit 242 , the determination unit 243 , the identification unit 244 , the generation unit 245 and the notification unit 246 .

The acquisition unit 241 is an example of the acquisition unit 11 described above. Acquisition unit 241 acquires an image of first visitor C<b>1 captured by camera 101 .

The extraction unit 242 is an example of the extraction unit 13 described above. The extraction unit 242 extracts face information of the first visitor C1 from the image acquired by the acquisition unit 241 . Further, when the determining unit 243 determines that the first visitor C1 is a non-member, the extracting unit 242 extracts wearing item information from the area of the first visitor C1 in the image. Specifically, the extracting unit 242 detects the area of each wearable article by image recognition of the area of the first visitor C1, analyzes the detected area of each wearable article, determines the type of wearable article, the brand of the wearable article, and so on. Names, product names, colors, patterns, logos, materials, shapes, etc. are extracted as wearable article information. Note that a known image recognition technique may be used as the logic for extracting the wearable item information from the area within the image. Also, the extraction unit 242 may refer to a predetermined database or the product DB 320 in order to extract attachment information.

In addition, the extraction unit 242 may further extract feature information regarding the body or appearance of the first visitor C1 from the region of the first visitor C1. Specifically, the extraction unit 242 extracts feature information of the body or appearance of the first visitor C1 by image recognition of the area of the first visitor C1 in the image acquired by the acquisition unit 241 . Body or appearance feature information includes, but is not limited to, height, hair length, hairstyle, presence or absence of glasses, shape of clothes, color of clothes, and the like. A known image recognition technique may be used for the logic for extracting body or appearance feature information from an area within an image.

The determination unit 243 is an example of the first determination unit 12 and the second determination unit 14 described above. The determination unit 243 refers to the member DB 310 and performs first face authentication on the face information extracted by the extraction unit 242 . For example, the determination unit 243 transmits a face authentication request including face information to the facility management server 300 and receives a face authentication result from the facility management server 300 . Then, the determination unit 243 determines whether or not the first visitor C1 has succeeded in the first face authentication according to the face authentication result. If the face authentication result indicates that the first face authentication was successful, the determination unit 243 determines that the first visitor C1 is a member. On the other hand, when the face authentication result indicates that the first face authentication has failed, the determination unit 243 determines that the first visitor C1 is a non-member.

The determination unit 243 also refers to the product DB 320 and determines whether or not the first visitor C1 is a customer service candidate visitor based on the attachment information extracted by the extraction unit 242 . Specifically, the determination unit 243 determines whether or not there is a certain relationship between the information indicated by the attachment item information and the product information 321 of the product DB 320 . Having a certain degree of relevance may mean, for example, that the information indicated by the attachment information is included in the product information 321 of the product DB 320 . If there is a certain relationship, for example, if the product information 321 includes attachment information, the determination unit 243 determines that the first visitor C1 is a customer service candidate visitor.

When it is determined that the first visitor C1 has succeeded in the first face authentication, the specifying unit 244 refers to the member DB 310 and specifies the member information 311 based on the face authentication result. Then, the specifying unit 244 specifies the store information 313 associated with the specified member information 311 as the notification destination. The specifying unit 244 then specifies the clerk terminal information 3221 corresponding to the specified store information 313 . Further, the specifying unit 244 specifies a face image for which face authentication has succeeded based on the face authentication result. For example, the identification unit 244 identifies the face area of the first visitor C1 in the image as the face image.

When it is determined that the first visitor C1 is a customer service candidate visitor, the identification unit 244 refers to the product DB 320 and identifies a store within the commercial facility 100 to be the notification destination based on the attachment information. . That is, when determining that there is a certain relationship between the information indicated by the attachment item information and the product information 321 of the product DB 320, the specifying unit 244 specifies the store that handles the product determined to have the relationship. Specifically, the identifying unit 244 identifies the product information 321 corresponding to the attachment information, and identifies the store information 322 associated with the identified product information 321 as the notification destination. Further, the identifying unit 244 identifies the salesclerk terminal information 3221 included in the identified store information 322 .

When the first visitor C1 succeeds in the first face authentication and is determined to be a member, the generating unit 245 generates notification information including the member information 311 identified by the identifying unit 244 and the identified face image. to generate In addition, when the first visitor C1 is determined to be a customer service candidate visitor, the generation unit 245 generates notification information including attachment information and body or appearance feature information.

The notification unit 246 is an example of the notification unit 15 described above. When the first visitor C1 succeeds in the first face authentication and is determined to be a member, the notification unit 246 sends notification information including the member information and the face image to the specified clerk terminal information as an address. Notify the clerk terminal.

Further, when the first visitor C1 is determined to be a customer service candidate visitor, the notification unit 246 notifies the salesclerk terminal of notification information based on the wearable item information with the identified salesclerk terminal information as the destination. In particular, the notification unit 246 notifies the notification information using the terminal of the clerk of the specified store as the first terminal. In addition, the notification unit 246 notifies the first terminal of the notification information including the feature information of the body or appearance.

FIG. 5 is a flowchart showing the flow of store support processing according to the second embodiment. As a premise, it is assumed that the first visitor C1 enters the entrance of the commercial facility 100 and the camera 101 captures an imaging range including the first visitor C1 near the entrance. Then, the camera 101 transmits the captured image to the store support device 200 via the network N. FIG.

In response, the store support device 200 acquires images (including the first visitor C1) captured by the camera 101 from the camera 101 via the network N (S201). Next, the store support device 200 extracts face information of the first visitor C1 from the acquired image (S202). Subsequently, the store support device 200 refers to the member DB 310 and performs face authentication on the face information (S203). Then, the store support device 200 determines whether the face authentication has succeeded or failed (S204). In other words, the store support device 200 determines whether or not the first visitor C1 is a member according to the face authentication result.

When face authentication succeeds in step S204 and it is determined that the first visitor C1 is a member, the store support device 200 identifies the member information, the store, and the store clerk terminal (S205). Specifically, the identification unit 244 of the store support device 200 identifies the member information 311 included in the face authentication result. Then, the specifying unit 244 specifies the store information 313 associated with the specified member information 311 from the member DB 310 as the notification destination. Then, the identifying unit 244 identifies the clerk terminal information 3221 (included in the store information 322 ) corresponding to the identified store information 313 from the product DB 320 . At the same time, the identifying unit 244 identifies the face area of the first visitor C1 in the image acquired in step S201 as a face image. That is, in this case, the first visitor C1 is a member of the identified store because the face authentication has been successful. Therefore, the identification unit 244 identifies the face image of the member who is the first visitor C1.

Then, the store support device 200 generates notification information including the specified member information and the specified face image (S206). After that, the store support device 200 notifies the generated notification information to the salesclerk terminal with the identified salesclerk terminal information 3221 as the destination (S212). For example, when the store clerk terminal information 3221 indicates the store clerk terminal 111, the store clerk terminal 111 receives notification information from the store support device 200, reproduces voice corresponding to the notification information, and outputs the sound from a speaker. This allows salesclerk S1 to recognize that first visitor C1 who is a member of store 110 has visited commercial facility 100 . Therefore, when the first visitor C1 enters the store 110, the salesclerk S1 can quickly and appropriately serve the customer.

On the other hand, if face authentication fails in step S204 and it is determined that the first visitor C1 is a non-member, the store support device 200 starts the area of the first visitor C1 in the image acquired in step S201. Product information is extracted (S207). Then, the store support device 200 determines whether or not the grade level of the wearable item is equal to or higher than a predetermined level based on the extracted wearable item information (S208). That is, the store support device 200 determines whether or not there is a certain relationship between the information indicated by the extracted attachment information and the product information 321 of the product DB 320 . Specifically, the determination unit 243 of the store support device 200 collates the attachment information with the product information 321 of the product DB 320 to calculate the matching degree. Then, the determination unit 243 determines whether or not the degree of matching is equal to or greater than a predetermined value. If the degree of matching is equal to or higher than the predetermined value, the determination unit 243 determines whether or not the grade 3211 included in the corresponding product information 321 is equal to or greater than a predetermined level. If it is determined in step S208 that the degree of luxury of the item to be attached is less than the predetermined level, the store support processing is terminated.

On the other hand, if it is determined in step S208 that the degree of luxury of the accessory is equal to or higher than the predetermined level, that is, if it is determined that the first visitor C1 is a customer service candidate visitor, the store support device 200 performs steps S209 and S209. Execute S210.

In that case, the store support device 200 first identifies the store that handles the brand of the wearable item and the clerk terminal (S209). For example, the identifying unit 244 of the store support device 200 identifies the brand name of the product information 321 corresponding to the attachment information. Then, the specifying unit 244 specifies, as a notification destination, the store information 322 associated with the product information 321 corresponding to the specified brand name. The identifying unit 244 then identifies the clerk terminal information 3221 included in the identified store information 322 .

Independently of step S209, the store support device 200 extracts body/appearance feature information from the area of the first visitor C1 in the image acquired in step S201 (S210). Then, the store support device 200 generates notification information including the attachment information extracted in step S207 and the body or appearance feature information extracted in step S210 (S211).

After steps S209 and S211, the shop support device 200 notifies the generated notification information to the salesclerk terminal with the specified salesclerk terminal information 3221 as the destination (S212). For example, when the store clerk terminal information 3221 indicates the store clerk terminal 111, the store clerk terminal 111 receives notification information from the store support device 200, reproduces voice corresponding to the notification information, and outputs the sound from a speaker. For example, the store clerk terminal 111 outputs a voice message such as the type of wearable item, the name of the product, and the visitor's visit to the store from the speaker. Alternatively, if the clerk terminal information 3221 indicates the clerk terminal 1n1, the clerk terminal 1n1 receives the notification information from the store support device 200, performs an incoming call notification operation according to the notification information, and sends a message or the like according to the notification information. display on the screen. For example, the store clerk terminal 1n1 may display, on the screen, the wearing item information and body or appearance feature information of the first store visitor C1 included in the notification information in the form of graphics or text. As a result, the store clerk S1 or the like can recognize that the first visitor C1 who is a customer service candidate visitor of the store 110 or the like where he or she works has visited the commercial facility 100 . Therefore, when the first customer C1 enters the store 110 or the like, the store clerk S1 or the like can quickly and appropriately serve the customer. In particular, since the first visitor C1 wears relatively expensive accessories, it can be said that the probability that the first visitor C1 has high purchasing power is high. Therefore, there is a high possibility that the store clerk will recommend a high-priced product to the first visitor C1 and make him/her purchase it. In other words, the present embodiment can contribute to improved sales promotion by the store clerk as compared to the case where there is no prior information about the first visitor C1. In other words, the store can easily realize customer service that makes effective use of human resources. In addition, the store clerk easily recommends customer service candidate customers to register as a member of the own store. Therefore, according to the present embodiment, the probability that the first visitor C1 registers as a member of the store as a new customer can be improved.

Furthermore, in this embodiment, when the visitor is a non-member, the wearable article information is extracted, so if the visitor is a member, the image analysis processing load and processing time can be reduced.

<Embodiment 3>
The third embodiment is an improved example of the second embodiment described above. In the second database according to the third embodiment, as in the second embodiment described above, the level of luxury is associated with each product. Then, the identification means according to the third embodiment refers to the second database, and handles other products whose luxury level is within a certain range with the product determined to be related in the commercial facility. Identify a store as a notification destination. As a result, even if there is no store in the commercial facility that sells the same product or the same brand as the item worn by the visitor, when a candidate visitor for customer service is detected, the related store will be able to identify the visitor in advance. can be grasped. Alternatively, even if there is a store in the commercial facility that sells the same product or the same brand as the item worn by the visitor, the notification information can be similarly sent to the store that handles a similar brand. Therefore, this embodiment can contribute to the improvement of sales promotion by shop clerks in stores that handle similar brands.

Note that the overall configuration of the store support system according to this embodiment is the same as in FIG. Therefore, the following description will focus on the difference from the above-described second embodiment.

FIG. 6 is a flowchart showing the flow of store support processing according to the third embodiment. Steps S201 to S203 and S205, S206 and S212 when the member is determined to be a member are the same processes as in FIG. 5 described above. Also, S207, S208, S210 and S211 when the member is determined to be a member in step S204 are the same processes as in FIG. 5 described above. If it is determined in step S208 that the degree of luxury of the item to be attached is equal to or higher than the predetermined level, that is, if it is determined that the first visitor C1 is a customer service candidate visitor, the store support device 200 performs the processing independently of step S210. and execute S209a.

In that case, the store support device 200 identifies stores and clerk terminals that handle other products whose accessories have a high-grade level within a certain range (S209a). For example, the identification unit 244 of the store support device 200 identifies the grade level 3211 of the product information 321 corresponding to the attachment information. Then, the specifying unit 244 specifies other product information whose specified luxury degree and level are within a certain range from the product DB 320 . Then, the specifying unit 244 specifies the store information 322 associated with the specified other product information from the product DB 320 as the notification destination. The identifying unit 244 then identifies the clerk terminal information 3221 included in the identified store information 322 .

After steps S209a and S211, the shop support device 200 notifies the generated notification information to the salesclerk terminal with the identified salesclerk terminal information 3221 as the destination (S212). As a result, the notification information is sent to the store clerk terminals that handle products and brands of the same level of luxury as the items worn by the first visitor C1. Therefore, the clerk wearing or carrying the clerk terminal to which the notification information is notified can grasp in advance that the candidate customer service visitor has visited the store and the characteristic information of the wearing item, body or appearance according to the notification. Therefore, the same effects as those of the second embodiment described above can be obtained.

<Embodiment 4>
Embodiment 4 is an improved example of Embodiment 2 or 3 described above. The first database according to the fourth embodiment includes information indicating whether the member is a good member. The image captured by the camera includes the second visitor as well as the first visitor. If the second biometric authentication for the second biometric information extracted from the area of the second visitor in the image is successful based on the first database, the first determination means determines the second biometric authentication. visitor is a good member or not. Then, when the first visitor is determined to be a customer service candidate visitor and the second visitor is determined to be a good member, the notification means notifies the image of the face area of the second visitor. It is included in the information and notified to the first terminal. As a result, when a registered good member (second visitor) is visiting the store together with a customer candidate (first visitor), the excellent member will visit the store where the excellent member is registered and be accompanied. It is possible to notify in advance that the person is a customer service candidate visitor. In particular, the sales clerk can grasp the face image of the excellent member, and can grasp the feature information of the body or appearance of the visitor candidate for customer service, and the information of the wearable item through the screen of the sales clerk terminal. Therefore, it can further contribute to the improvement of sales promotion by store clerks. The probability that the first visitor C1 registers as a member of the store as a new customer can be further improved.

FIG. 7 is a block diagram showing the overall configuration of the store support system 1000a according to the fourth embodiment. The shop support system 1000a shows a case where the second shop visitor C2 visits the commercial facility 100 together with the first shop visitor C1, as compared with the shop support system 1000 described above. For example, the first visitor C1 and the second visitor C2 may be a married couple, parent and child, brothers, partners, friends, or the like. Also, the store support system 1000a differs from the above-described store support system 1000 in the store support device 200a and the member DB 310a. The rest of the configuration of the store support system according to the present embodiment is the same as that of FIG. 3 described above, and redundant description will be omitted as appropriate. Therefore, the following description will focus on the difference from the above-described second embodiment.

In the member DB 310a, member information 311, face information 312, and store information 313 are associated with member types 314 in comparison with the member DB 310 described above. The member type 314 is an example of information indicating whether or not the member is a good member, and is information such as a good member or a regular member.

The store support device 200a is an improvement of the store support device 200 described above. The determination unit 243 of the shop support device 200a refers to the member DB 310a and determines that the second visitor C2 is a good customer by performing second face authentication on face information extracted from the area of the second visitor C2 in the image. Determine whether the member is a member or not. Further, when the first visitor C1 is determined to be a customer service candidate visitor, the determination unit 243 may determine whether or not the second visitor C2 is a good member by the second face authentication. That is, the order of the first face recognition and the second face recognition does not matter. Then, when it is determined that the second visitor C2 is a good member, the notification unit 246 of the store support device 200a includes the image of the face area of the second visitor C2 in the notification information, and sends the information to the clerk terminal. Notice.

FIG. 8 is a flowchart showing the flow of store support processing according to the fourth embodiment. First, the first visitor C1 and the second visitor C2 are present near the entrance of the commercial facility 100, and the camera 101 photographs the first visitor C1 and the second visitor C2. Then, the camera 101 transmits an image including the first visitor C1 and the second visitor C2 to the store support device 200a.

Accordingly, the first visitor C1 is determined to be a non-member in steps S201 to S203 and S204 of FIG. It is assumed that the degree is determined to be equal to or higher than a predetermined level. That is, it is assumed that the first visitor C1 is determined to be a customer service candidate visitor.

After that, the shop support device 200a determines whether or not the companion of the first visitor C1 is included in the image acquired in step S201 (S221). Specifically, the store support device 200a determines whether or not there is an area of a person within a predetermined distance from the area of the first visitor C1 by image recognition of the image. If it is determined in step S221 that no companion is included, steps S209 to S212 in FIG. 5 described above are executed.

However, hereinafter, as described above, the case where the second customer C2 visits the commercial facility 100 together with the first customer C1 will be described. Therefore, it is assumed that the area of the second visitor C2 exists within a predetermined distance from the area of the first visitor C1 in the image. Therefore, in step S221, the store support device 200a determines that the image includes the companion of the first visitor C1.

Then, the store support device 200a extracts the face information of the second visitor C2 from the acquired image (S222). Subsequently, the shop support device 200a refers to the member DB 310a and performs face authentication on the face information (S223). Then, the store support device 200a determines whether the face authentication has succeeded or failed (S224). In other words, the store support device 200a determines whether or not the second visitor C2 is a member according to the face authentication result. When the second visitor C2 is determined to be a member in step S224, the store support device 200a further determines whether the second visitor C2 who has successfully completed face authentication is a good member. Specifically, the store support device 200a refers to the member DB 310a and determines whether or not the member is a good member based on the face information 312 for which face authentication has succeeded or the member type 314 associated with the member information 311. When it is determined in step S224 that the second visitor C2 is a non-member, the store support device 200a executes steps S207 to S212 of FIG. . Alternatively, if it is determined that the second visitor C2 is not a good member, for example, a normal member, the store support device 200a performs the above step S207 in FIG. You may perform S212 from.

On the other hand, if it is determined in step S224 that the second visitor C2 is a good member, that is, the companion of the first visitor C1 who is a customer service candidate visitor is determined to be a good member, the store support device 200a performs step S226 and S210 are executed. In this case, the store support device 200a first identifies the member information of the companion, the store, and the clerk terminal (S226), as in step S205 described above. At the same time, the identifying unit 244 identifies the face area of the second visitor C2 in the image acquired in step S201 as a face image. Independently of step S226, the store support device 200a extracts body/appearance feature information from the area of the first visitor C1 in the image acquired in step S201 (S210).

After steps S226 and S210, the shop support device 200a collects information about the first visitor C1's attachments, body or appearance feature information, and membership information and facial information of the companion (second visitor C2). Notification information including the image is generated (S227). It should be noted that the notification information does not necessarily include the face image of the good member, and may at least include information that allows identification of the good member.

After that, the shop support device 200a notifies the generated notification information to the salesclerk terminal with the identified salesclerk terminal information 3221 as the destination (S228). In response to this, the store clerk wearing or carrying the store clerk terminal notified of the notification information, in addition to the fact that the customer candidate visitor has come to the store in response to the notification, It is possible to grasp in advance that a good member of one's store has visited the store. In particular, the store clerk can grasp member information such as the name, sex, and age group of the second visitor C2 who is a good member through the store clerk terminal. Furthermore, the clerk can grasp the face image of the good member through the screen of the clerk terminal. Therefore, it becomes easier for the clerk to identify the candidate customer visitor than when the first customer C1 who is the candidate customer customer visits the store alone.

It does not matter which of the first visitor C1 and the second visitor C2 comes first in the determination order by face authentication. Further, the store support device 200a may determine whether the second visitor C2 who is a companion is a non-member and a customer service candidate after the first visitor C1 is determined to be a good member. . Then, if the visitor is a customer service candidate, the shop support device 200a may execute steps S226, S210, S227 and S228. For example, in step S204, after the first visitor C1 is determined to be a member, the store support device 200a may further determine whether or not the first visitor C1 is a good member. Then, when the first visitor C1 is determined to be a good member, the store support device 200a determines whether the companion is included in the image as in step S221, and if the companion is included, the companion It may be determined whether the area is a non-member and a customer service candidate store visitor. Therefore, if one of the first visitor and the second visitor included in the image is determined to be a customer service candidate visitor and the other is determined to be a good member, The image of the face area of the good member may be included in the notification information and notified to the first terminal.

This embodiment may be further improved as follows. In other words, when the second visitor is determined to be a good member, the notification means sends privilege information for either the first visitor or the second visitor to the second visitor at the store. 2 terminal may be notified. In this case, for example, it is assumed that the member information 311 of the member DB 310a includes the mobile terminal information of the excellent member. Then, in S226 of FIG. 8 described above, the store support device 200a further identifies the mobile terminal information of the second visitor C2 who is a good member from the member DB 310a. Then, the store support device 200a notifies the specified portable terminal information of the privilege information at the corresponding store as the destination. Here, the privilege information may be a recommended product at the store for the first customer C1 who is a customer service candidate customer, a discount coupon for the product, or the like. Alternatively, the privilege information may be incentive information at the store for the second visitor C2 who is a good member. For example, the incentive information may be a member ranking upgrade, a discount coupon, or the like for the introduction of the store by the second visitor C2 to the first visitor C1. As a result, it is possible to encourage good members to guide customers who are candidates for customer service to the store and to encourage them to register as members. Therefore, the probability of being registered as a member can be improved as compared with the case where the candidate customer visitor visits the store alone.

<Embodiment 5>
Embodiment 5 is a modification of Embodiments 2 to 4 described above. The camera according to the fifth embodiment is installed at the entrance/exit of a store in a commercial facility that handles high-end products of a predetermined level or higher.

FIG. 9 is a block diagram showing the overall configuration of the store support system 1000b according to the fifth embodiment. Compared to the store support system 1000 described above, the store support system 1000b shows a case where a camera in the commercial facility 100b is installed near the entrance of each store. For example, commercial facility 100b includes stores 110b-1n0b. A camera 112 is installed near the entrance of the commercial facility 100b. Thereafter, similarly, a camera 1n2 is installed near the entrance of the store 1n0b. Each of the cameras 112 to 1n2 is connected to the network N so as to be able to communicate therewith.

Each of the cameras 112 to 1n2, like the camera 101 described above, shoots a predetermined shooting range near the entrance at predetermined intervals or when a human sensor detects a person. Each of the cameras 112 to 1n2 transmits the captured image to the store support device 200 via the network N. FIG. At this time, each camera may transmit the identification information of the camera and the identification information of the store to the store support device 200 together with the image.

For example, when the first visitor C1 visits the store 110b in the commercial facility 100 and is near the entrance of the store 110b, the first visitor C1 is detected by the human sensor. Therefore, the camera 112 captures an image including the first visitor C1. A plurality of cameras may be installed in each store. Also, in the present embodiment, cameras may be installed at the entrances and exits of the entire commercial facility 100 or outside the store, as in FIG. 3 described above.

Also, the store support system 1000b differs from the store support system 1000 described above in the store support device 200b. The rest of the configuration of the store support system according to the present embodiment is the same as that of FIG. 3 described above, and redundant description will be omitted as appropriate. Therefore, the following description will focus on the difference from the above-described second embodiment.

The store support device 200b acquires the photographed image from the camera 112 or the like via the network N, and serves the person (for example, the first visitor C1) in the image in the same manner as the store support device 200 described above. It is determined whether or not the visitor is a candidate visitor. When the store support device 200b determines that the visitor is a customer service candidate, the store support device 200b extracts body/appearance feature information from the detected first visitor C1 area, to generate Then, when the shop support device 200b according to the present embodiment determines that the visitor is a customer service candidate visitor, the shop support device 200b identifies the shop to which the camera that sent the image belongs and the clerk terminal of the clerk working at the shop. For example, when an image and the identification information of the store 110b are acquired from the camera 112, the store support device 200b specifies the store 110b as a notification destination from the identification information, and stores the store information 322 corresponding to the store 110b in the product DB 320. The included clerk terminal information 3221 is specified. Then, the shop support device 200b notifies the salesclerk terminal 111 of the notification information with the identified salesclerk terminal information 3221 as the destination. This makes it easier for store clerk S1 of store 110b to recognize the notification information via store clerk terminal 111 and to recognize that first visitor C1 who has visited commercial facility 100b is a customer service candidate visitor. Therefore, the store clerk S1 can appropriately serve the first customer C1. In other words, the store support device 200b can support the sales promotion of the store 110b and the like.

In the biometric authentication described above, feature information indicating the physical features of a person is extracted from a body image, and the feature information registered in advance is compared with the extracted feature information. shall be deemed to have been successfully authenticated. Biometric authentication may be face authentication, for example. In that case, the biometric information becomes facial feature information. The biometric information may be data (feature amounts) calculated from physical features unique to an individual, such as facial feature information, fingerprints, voiceprints, veins, retinas, irises, and palm patterns. I do not care.

In the above examples, the program includes instructions (or software code) that, when read into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or tangible storage medium. By way of example, and not limitation, computer readable media or tangible storage media may include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drives (SSD) or other memory technology, CDs - ROM, digital versatile disc (DVD), Blu-ray disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or communication medium. By way of example, and not limitation, transitory computer readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

It should be noted that the present disclosure is not limited to the above embodiments, and can be modified as appropriate without departing from the scope. In addition, the present disclosure may be implemented by appropriately combining each embodiment.

Some or all of the above embodiments may also be described in the following additional remarks, but are not limited to the following.
(Appendix 1)
Acquisition means for acquiring an image of the first visitor captured by a camera installed in the commercial facility;
Referring to a first database in which biometric information is pre-registered as a member of a store in the commercial facility, for the first biometric information extracted from the area of the first visitor in the acquired image a first determination means for determining success or failure of the first biometric authentication;
extracting means for extracting wearable item information about wearable items from the area of the first store visitor when it is determined that the first biometric authentication has failed;
Referring to a second database that associates the product with the store that handles the product, and based on the attachment information, it is determined whether or not the attachment and the product are related to each other at a predetermined level or higher. a second determination means for determining the first store visitor as a customer service candidate store visitor when it is determined that there is the relevance;
notification means for notifying a first terminal of a person concerned in the commercial facility of notification information based on the attachment information when the first store visitor is determined to be a customer service candidate store visitor;
A store support device comprising:
(Appendix 2)
further comprising identifying means for identifying a store that handles the product determined to be related by referring to the second database, wherein the notifying means notifies the terminal of the clerk of the store as the first terminal. The store support device according to appendix 1, which notifies information.
(Appendix 3)
The second database associates the luxury level with each product,
The specifying means refers to the second database to specify stores within the commercial facility that handle other products whose luxury level is within a certain range from the product determined to be related to the product. The store support device according to appendix 2.
(Appendix 4)
The extracting means further extracts feature information related to the body or appearance of the first visitor from the area of the first visitor,
4. The store support device according to any one of appendices 1 to 3, wherein the notification means includes the characteristic information in the notification information and notifies the first terminal.
(Appendix 5)
The first database includes information indicating whether the member is a good member,
The image includes a second visitor together with the first visitor,
The first determination means determines, based on the first database, when the second biometric authentication for the second biometric information extracted from the region of the second store visitor is successful, the second store visitor. determine whether the person is a good member,
When the first store visitor is determined to be a customer service candidate visitor and the second store visitor is determined to be the excellent member, the notification means is configured to change the face area of the second store visitor. 5. The store support device according to any one of appendices 1 to 4, wherein an image is included in the notification information and notified to the first terminal.
(Appendix 6)
If the second visitor is determined to be a good member, the notification means sends privilege information at the store to either the first visitor or the second visitor to the second visitor. The store support device according to appendix 5.
(Appendix 7)
7. The store support device according to any one of appendices 1 to 6, wherein the camera is installed at an entrance/exit of a store that handles the merchandise within the commercial facility.
(Appendix 8)
A camera installed in a commercial facility,
a first terminal of a party in the commercial facility;
a first database in which biometric information is registered in advance as a member of a store in the commercial facility;
a second database that associates a product with a store that handles the product;
a store support device connected to the camera, the first terminal, the first database, and the second database;
with
The store support device is
Acquisition means for acquiring an image of the first visitor captured by the camera;
A first determining whether the first biometric authentication for the first biometric information extracted from the area of the first visitor in the acquired image is successful or unsuccessful by referring to the first database. a determination means for
extracting means for extracting wearable item information about wearable items from the area of the first store visitor when it is determined that the first biometric authentication has failed;
If the second database is referenced and based on the attached item information, it is determined whether or not the attached item and the product have a high-grade level equal to or higher than a predetermined level, and it is determined that the associated item is present. a second determination means for determining the first store visitor as a customer service candidate store visitor;
notification means for notifying the first terminal of notification information based on the attachment information when the first store visitor is determined to be a customer service candidate store visitor;
store support system.
(Appendix 9)
The store support device is
further comprising identifying means for identifying a store that handles the product determined to be related by referring to the second database, wherein the notifying means notifies the terminal of the clerk of the store as the first terminal. Notifying information The store support system according to appendix 8.
(Appendix 10)
the computer
Acquiring an image of the first visitor taken by a camera installed in the commercial facility,
Referring to a first database in which biometric information is pre-registered as a member of a store in the commercial facility, for the first biometric information extracted from the area of the first visitor in the acquired image determining success or failure for the first biometric;
when it is determined that the first biometric authentication has failed, extracting wearable item information about the wearable item from the region of the first visitor;
Referring to a second database that associates products with shops that carry the products, and based on the information on the accessories, it is determined whether the accessories and the product have a relationship of a level of luxury equal to or higher than a predetermined level. and determining that the first store visitor is a customer service candidate store visitor when it is determined that there is the relevance,
When the first store visitor is determined to be a customer service candidate store visitor, notification information based on the attachment information is notified to a first terminal of a person concerned in the commercial facility;
Store support method.
(Appendix 11)
Acquisition processing for acquiring an image of the first visitor captured by a camera installed in the commercial facility;
Referring to a first database in which biometric information is pre-registered as a member of a store in the commercial facility, for the first biometric information extracted from the area of the first visitor in the acquired image A first determination process for determining whether the first biometric authentication is successful or unsuccessful;
an extraction process for extracting wearable item information about wearable items from the area of the first store visitor when it is determined that the first biometric authentication has failed;
Referring to a second database that associates products with shops that carry the products, and based on the information on the accessories, it is determined whether the accessories and the product have a relationship of a level of luxury equal to or higher than a predetermined level. and a second determination process of determining the first store visitor as a customer service candidate store visitor when it is determined that there is the relevance;
a notification process of notifying a first terminal of a person concerned in the commercial facility with notification information based on the attachment information when the first store visitor is determined to be a customer service candidate store visitor;
A non-transitory computer-readable medium storing a store support program that causes a computer to execute

Although the present invention has been described with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

1 store support device 11 acquisition unit 12 first determination unit 13 extraction unit 14 second determination unit 15 notification unit 1000 store support system 1000a store support system 1000b store support system N network 100 commercial facility 100b commercial facility 101 camera C1 first Visitor C2 Second visitor 110 store 110b store 111 store clerk terminal 112 camera S1 store clerk 1n0 store 1n0b store 1n1 store clerk terminal 1n2 camera Sn store clerk 200 store support device 200a store support device 200b store support device 210 storage unit 211 program 220 memory 230 communication unit 240 control unit 241 acquisition unit 242 extraction unit 243 determination unit 244 identification unit 245 generation unit 246 notification unit 300 facility management server 310 member DB
310a Member DB
311 member information 312 face information 313 store information 314 member type 320 product DB
321 product information 3211 luxury level 322 store information 3221 clerk terminal information

Claims

Acquisition means for acquiring an image of the first visitor captured by a camera installed in the commercial facility;
Referring to a first database in which biometric information is pre-registered as a member of a store in the commercial facility, for the first biometric information extracted from the area of the first visitor in the acquired image a first determination means for determining success or failure of the first biometric authentication;
extracting means for extracting wearable item information about wearable items from the area of the first store visitor when it is determined that the first biometric authentication has failed;
Referring to a second database that associates the product with the store that handles the product, and based on the attachment information, it is determined whether or not the attachment and the product are related to each other at a predetermined level or higher. a second determination means for determining the first store visitor as a customer service candidate store visitor when it is determined that there is the relevance;
notification means for notifying a first terminal of a person concerned in the commercial facility of notification information based on the attachment information when the first store visitor is determined to be a customer service candidate store visitor;
A store support device comprising:
further comprising identifying means for identifying a store that handles the product determined to be related by referring to the second database, wherein the notifying means notifies the terminal of the clerk of the store as the first terminal. The store support device according to claim 1, which notifies information.
The second database associates the luxury level with each product,
The specifying means refers to the second database to specify stores within the commercial facility that handle other products whose luxury level is within a certain range from the product determined to be related to the product. The store support device according to claim 2.
The extracting means further extracts feature information related to the body or appearance of the first visitor from the area of the first visitor,
4. The store support device according to any one of claims 1 to 3, wherein said notification means includes said feature information in said notification information and notifies said first terminal.
The first database includes information indicating whether the member is a good member,
The image includes a second visitor together with the first visitor,
The first determination means determines, based on the first database, when the second biometric authentication for the second biometric information extracted from the region of the second store visitor is successful, the second store visitor. determine whether the person is a good member,
When the first store visitor is determined to be a customer service candidate visitor and the second store visitor is determined to be the excellent member, the notification means is configured to change the face area of the second store visitor. The store support device according to any one of claims 1 to 4, wherein an image is included in the notification information and notified to the first terminal.
If the second visitor is determined to be a good member, the notification means sends privilege information at the store to either the first visitor or the second visitor to the second visitor. 6. The store support device according to claim 5, wherein the second terminal of the visitor is notified.
The store support device according to any one of claims 1 to 6, wherein the camera is installed at an entrance/exit of a store that handles the merchandise within the commercial facility.
A camera installed in a commercial facility,
a first terminal of a party in the commercial facility;
a first database in which biometric information is registered in advance as a member of a store in the commercial facility;
a second database that associates a product with a store that handles the product;
a store support device connected to the camera, the first terminal, the first database, and the second database;
with
The store support device is
Acquisition means for acquiring an image of the first visitor captured by the camera;
A first determining whether the first biometric authentication for the first biometric information extracted from the area of the first visitor in the acquired image is successful or unsuccessful by referring to the first database. a determination means for
extracting means for extracting wearable item information about wearable items from the area of the first store visitor when it is determined that the first biometric authentication has failed;
If the second database is referenced and based on the attached item information, it is determined whether or not the attached item and the product have a high-grade level equal to or higher than a predetermined level, and it is determined that the associated item is present. a second determination means for determining the first store visitor as a customer service candidate store visitor;
notification means for notifying the first terminal of notification information based on the attachment information when the first store visitor is determined to be a customer service candidate store visitor;
store support system.
The store support device is
further comprising identifying means for identifying a store that handles the product determined to be related by referring to the second database, wherein the notifying means notifies the terminal of the clerk of the store as the first terminal. The store support system according to claim 8, which notifies information.
the computer
Acquiring an image of the first visitor taken by a camera installed in the commercial facility,
Referring to a first database in which biometric information is pre-registered as a member of a store in the commercial facility, for the first biometric information extracted from the area of the first visitor in the acquired image determining success or failure for the first biometric;
when it is determined that the first biometric authentication has failed, extracting wearable item information about the wearable item from the region of the first visitor;
Referring to a second database that associates products with shops that carry the products, and based on the information on the accessories, it is determined whether the accessories and the product have a relationship of a level of luxury equal to or higher than a predetermined level. and determining that the first store visitor is a customer service candidate store visitor when it is determined that there is the relevance,
When the first store visitor is determined to be a customer service candidate store visitor, notification information based on the attachment information is notified to a first terminal of a person concerned in the commercial facility;
Store support method.
Acquisition processing for acquiring an image of the first visitor captured by a camera installed in the commercial facility;
Referring to a first database in which biometric information is pre-registered as a member of a store in the commercial facility, for the first biometric information extracted from the area of the first visitor in the acquired image A first determination process for determining whether the first biometric authentication is successful or unsuccessful;
an extraction process for extracting wearable item information about wearable items from the area of the first store visitor when it is determined that the first biometric authentication has failed;
Referring to a second database that associates products with shops that carry the products, and based on the information on the accessories, it is determined whether the accessories and the product have a relationship of a level of luxury equal to or higher than a predetermined level. and a second determination process of determining the first store visitor as a customer service candidate store visitor when it is determined that there is the relevance;
a notification process of notifying a first terminal of a person concerned in the commercial facility with notification information based on the attachment information when the first store visitor is determined to be a customer service candidate store visitor;
A non-transitory computer-readable medium storing a store support program that causes a computer to execute